Automatic image product creation for user accounts comprising large number of images

Patent metadata

Field	Value
Publication number	US-9892342-B2
Application number	US-201715695298-A
Country	US
Kind code	B2
Filing date	Sep 5, 2017
Priority date	Nov 4, 2015
Publication date	Feb 13, 2018
Grant date	Feb 13, 2018

Abstract

A computer-implemented method of grouping faces in large user account for creating an image product includes adding the face images obtained from an image album in a user's account into a first chunk; if the chunk size of the first chuck is smaller than a maximum chuck value, keeping the face images from the image album into the first chunk; otherwise, automatically separating the face images from the image album into a first portion and one or more second portions; keeping the first portion in the first chunk; automatically moving the second portions to subsequent chunks; automatically grouping face images in the first chunk to form face groups; assigning the face groups to known face models associated with the user account; and creating a design for an image-based product based on the face images in the first chunk associated with the face models.

First claim

What is claimed is:

1. A computer system for grouping faces in large user account for creating an image product, comprising:
a computer processor configured to select a first portion of face images from a user's account to add to a first chunk, wherein the first portion of face images is selected to keep chuck size of the first chunk in an optimal chunk size range,
wherein the computer processor is configured to automatically grouping face images in the first chunk to form face groups,
to assign at least some of the face groups in the first chunk to known face models associated with the user account,
to move the ungrouped face images in the first chunk to one or more subsequent chunks that have not been processed with face grouping,
to discard ungrouped face images that have been moved to subsequent chunks for more than a predetermined number of times, and
to create a design for an image-based product based at least in part on the face images in the first chunk associated with the face models.

2. The computer system of claim 1 , wherein the computer processor is further configured to compare the chuck size of the first chunk with a maximum chuck value for an optimal chunk size range,
to keep the face images from the user's account in the first chunk if the chunk size of the first chuck is smaller than the maximum chuck value,
to automatically separate the face images from the user's account into the first portion and the one or more second portions if the chunk size of the first chuck is larger than the maximum chuck value,
to add the first portion in the first chunk while keeping the current chunk size below the maximum chuck value; and
to automatically move one or more second portions of face images from the user's account to one or more subsequent chunks.

3. The computer system of claim 1 , wherein the computer processor is further configured to set up new face models for at least some of the face groups that cannot be assigned to existing face models, wherein the design for an image-based product is created based on the face images associated with the known face models and the new face models.

4. The computer system of claim 1 , wherein the computer processor is further configured to repeat operations to select a first portion of face images from a user's account to assigning at least some of the face groups in a second chunk subsequent to the first chunk,
to assigning at least some of the face groups in the second chunk to known face models associated with the user account, and
to create the design for the image-based product based at least in part on the face images in the first chunk and the second chunk associated with the face models.

5. The computer system of claim 1 , wherein the computer processor is further configured:
to receive an initial set of n* face groups in the face images in the first chunk, wherein n* is a positive integer bigger than 1;
to train classifiers between pairs of face groups in the initial set of face groups using image-product statistics;
to classify the plurality of face images by n*(n*−1)/2 classifiers to output binary vectors for the face images;
to calculate a value for a similarity function using the binary vectors for each pair of the face images, and
to group the face images in the first chunk into modified face groups based on values of the binary similarity functions.

6. The computer system of claim 5 , wherein the computer processor is further configured to compare a difference between the modified face groups and the initial face groups to a threshold value, wherein the image product is created based at least in part on the modified face groups if the difference is smaller than the threshold value.

7. The computer system of claim 6 , wherein there are an integer m number of face images in the plurality of face images, wherein the step of classifying the plurality of face images by n*(n*−1)/2 classifiers outputs m number of binary vectors.

8. The computer system of claim 6 , wherein the face images are grouped into modified face groups using non-negative matrix factorization based on values of the improved similarity functions.

9. A computer system for grouping faces in large user account for creating an image product, comprising:
a computer processor configured to select a first portion of face images from a user's account to add to a first chunk, wherein the first portion of face images is selected to keep chuck size of the first chunk in an optimal chunk size range,
wherein the computer processor is configured to automatically group face images in the first chunk to form face groups, which includes: calculating similarity functions between pairs of face images in the first chunk, joining face images that have values of the similarity functions above a predetermined threshold into a hypothetical face group, wherein the face images in the hypothetical face group hypothetically belong to a same person, conducting non-negative matrix factorization on values of the similarity functions in the hypothetical face group to test truthfulness of the hypothetical face group; and identifying the hypothetical face group as a true face group if a percentage of the associated similarity functions being true is above a threshold based on the non-negative matrix factorization,
wherein the computer processor is further configured to assign at least some of the face groups in the first chunk to known face models associated with the user account,
wherein the computer processor is further configured to create a design for an image-based product based at least in part on the face images in the first chunk associated with the face models.

10. The computer system of claim 9 , wherein the computer processor is further configured to reject the hypothetical face group as a true face group if a percentage of the associated similarity functions being true is below a threshold.

11. The computer system of claim 9 , wherein the computer processor is further configured to form a non-negative matrix using values of similarity functions between all different pairs of face images in the hypothetical face group, wherein the non-negative matrix factorization is conducted over the non-negative matrix.

12. The computer system of claim 9 , wherein the similarity functions in the hypothetical face group are described in a similarity distribution function, wherein the step of non-negative matrix factorization outputs a True similarity distribution function and a False similarity distribution function.

13. The computer system of claim 9 , wherein every pair of face images in the hypothetical face group has a similarity function above the predetermined threshold.

14. The computer system of claim 9 , wherein the computer processor is further configured to join two true face groups to form a joint face group,
to conducting non-negative matrix factorization on values of similarity functions in the joint face group, and
to merging the two true face groups if a percentage of the associated similarity functions being true is above a threshold in the joint face group.

15. A computer system for grouping faces in large user account for creating an image product, comprising:
a computer processor configured to select a first portion of face images from a user's account to add to a first chunk, wherein the first portion of face images is selected to keep chuck size of the first chunk in an optimal chunk size range,
wherein the computer processor is configured to automatically group face images in the first chunk to form face groups,
to assign at least some of the face groups in the first chunk to know

Assignees

• Shutterfly Inc

Inventors

• Sandler Roman
• Kenis Alexander M

Classifications

• G06V10/772 Primary

  Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries · CPC title

• G06F18/2413

  based on distances to training or reference patterns · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06F18/28

  Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries · CPC title

• G06F18/24

  Classification techniques · CPC title