Generating a digital collage using digital images

Patent metadata

Field	Value
Publication number	US-11398010-B2
Application number	US-202017037058-A
Country	US
Kind code	B2
Filing date	Sep 29, 2020
Priority date	Nov 7, 2018
Publication date	Jul 26, 2022
Grant date	Jul 26, 2022

Abstract

Techniques for generating a digital collage using digital images are described. An image editing system obtains a set of digital images and a collage template to be used for generating a digital collage. The image editing system calculates different arrangement permutations for placing the digital images into digital frames of the collage template, and identifies a region of interest in each of the digital images. The image editing system fits the digital images into the digital frames for each of the arrangement permutations, and calculates a permutation error value for each arrangement permutation based on proportions of the regions of interest for each of the digital images that fit into respective digital frames. The image editing system selects an arrangement permutation with an optimal permutation error value, and uses the selected arrangement permutation to arrange the set of digital images in the collage template to generate the digital collage.

First claim

What is claimed is:

1. A method performed in a digital medium environment to generate a digital collage using a set of digital images, the method comprising:
obtaining, by at least one computing device, a set of digital images and a set of collage templates that are usable for generating a digital collage using the set of digital images, each collage template including a different respective arrangement of digital frames into which individual digital images of the set of digital images are placeable to generate the digital collage;
detecting, by the at least one computing device, a region of interest in each digital image of the set of digital images;
assigning, by the at least one computing device, a template error value for each collage template by, for each collage template: fitting the set of digital images into a corresponding arrangement of digital frames, determining a proportion of the region of interest for each digital image that fits into a respective digital frame of the arrangement of frames, and calculating a template error value for the collage template on the proportion, wherein calculating a template error value comprises, for each collage template:
determining an image error value for a respective digital image in the digital frame based on the proportion of an area of the region of interest that fits into the digital frame relative to a total area of the region of interest; and
processing the image error values for the set of digital images to determine the template error value;

selecting, by the at least one computing device, a collage template with an optimal template error value; and
generating, by the at least one computing device, the digital collage by placing the set of digital images into the collage template with the optimal template error value.

2. A method as described in claim 1 , wherein said obtaining the set of collage templates comprises selecting, by the at least one computing device, the collage templates based on a number of digital frames in each of the collage templates being equal to a number digital images in the set of digital images.

3. A method as described in claim 1 , wherein said detecting the region of interest comprises using, by the at least one computing device, a region of interest algorithm that defines a region of interest type and processes each digital image to identify one or more instances of the region of interest type in each digital image.

4. A method as described in claim 1 , wherein said fitting comprises, for each digital image of the set of digital images, manipulating the digital image by performing one or more of resizing the digital image within a respective digital frame or panning the digital image within the respective digital frame, while maintaining the region of interest centered in the respective digital frame.

5. A method as described in claim 1 , wherein the proportion of the region of interest for each digital image that fits into a respective digital frame is relative to a total area of the digital image.

6. A method as described in claim 1 , wherein said placing the digital images into the collage template comprises:
generating, by the at least one computing device, different arrangement permutations that each represent a different arrangement for placing the set of digital images into an arrangement of digital frames of the collage template;
assigning, by the at least one computing device, a permutation error value for each arrangement permutation by, for each arrangement permutation: fitting the set of digital images into a corresponding arrangement of digital frames, determining a proportion of the region of interest for each digital image that fits into a respective digital frame of the arrangement of frames, and determining the permutation error value based on the proportions for the set of digital images; and
generating, by the at least one computing device, the digital collage by placing the set of digital images into the collage template according to the arrangement permutation with an optimal permutation error value.

7. A method as described in claim 1 , wherein processing the image error values for the set of digital images comprises summing the image error values to determine the template error value.

8. A system implemented in a digital medium environment to generate a digital collage using a set of digital images, the system comprising:
at least one processor; and
memory having stored thereon computer-readable instructions that are executable by the at least one processor to:
obtain a set of digital images and a set of collage templates that are usable for generating a digital collage using the set of digital images, each collage template including a different respective arrangement of digital frames into which individual digital images of the set of digital images are placeable to generate the digital collage;
detect a region of interest in each digital image of the set of digital images;

assign a template error value for each collage template by, for each collage template, the computer-readable instructions are executable by the at least one processor to: fit the set of digital images into a corresponding arrangement of digital frames, determine a proportion of the region of interest for each digital image that fits into a respective digital frame of the arrangement of frames, and calculate a template error value for the collage template on the proportion, wherein to calculate a template error value comprises, for each collage template, to:
determine an image error value for a respective digital image in the digital frame based on the proportion of an area of the region of interest that fits into the digital frame relative to a total area of the region of interest; and
process the image error values for the set of digital images to determine the template error value;
select a collage template with an optimal template error value; and
generate the digital collage by placing the set of digital images into the collage template with the optimal template error value.

9. A system as described in claim 8 , wherein to obtain the set of collage templates comprises to select the collage templates based on a number of digital frames in each of the collage templates being equal to a number digital images in the set of digital images.

10. A system as described in claim 8 , wherein to detect the region of interest comprises to use a region of interest algorithm that is operable to define a region of interest type and process each digital image to identify one or more instances of the region of interest type in each digital image.

11. A system as described in claim 8 , wherein to fit the set of digital images into a corresponding arrangement of digital frames comprises, for each digital image of the set of digital images, to manipulate the digital image by performing one or more of resizing the digital image within a respective digital frame or panning the digital image within the respective digital frame, while maintaining the region of interest centered in the respective digital frame.

12. A system as described in claim 8 , wherein the proportion of the region of interest for each digital image that fits into a respective digital frame is relative to a total area of the digital image.

13. A system as described in claim 8 , wherein to place the digital images into the collage template comprises to:
generate different arrangement permutations that each represent a different arrangement for placing the set of digital images into an arrangement of digital frames of the collage template;
assign a permutation error value for each arrangement permutation by, for each

Assignees

• Adobe Inc

Inventors

• YADAV Nitesh
• Bhatt Sameer
• Jindal Pulkit

Classifications

• G06T3/4038 Primary

  Image mosaicing, e.g. composing plane images from plane sub-images · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title