Facial image bucketing with expectation maximization and facial coordinates

Patent metadata

Field	Value
Publication number	US-9405963-B2
Application number	US-201414447571-A
Country	US
Kind code	B2
Filing date	Jul 30, 2014
Priority date	Jul 30, 2014
Publication date	Aug 2, 2016
Grant date	Aug 2, 2016

Abstract

Facial image bucketing is disclosed, whereby a query for facial image recognition compares the facial image against existing candidate images. Rather than comparing the facial image to each candidate image, the candidate images are organized or clustered into buckets according to their facial similarities, and the facial image is then compared to the image(s) in most-likely one(s) of the buckets. The organizing uses particular selected facial features, computes distance between the facial features, and selects ones of the computed distances to determine which facial images should be organized into the same bucket.

First claim

The invention claimed is:

1. A method for facial image bucketing, comprising:
analyzing each of a plurality of facial images in a candidate image set, comprising:
determining, for the each image, a location of each of a plurality of face points;
computing, for the each image, a distance between the location of each of the plurality of face points; and
computing, for the each image, a ratio for each unique pair of the computed distances;

selecting, from the computed ratios for the plurality of facial images, at least one particular one of the computed face ratios;
clustering the facial images in the candidate image set into a plurality of buckets using the selected at least one particular one of the computed face ratios, comprising iteratively computing a mean and a standard deviation, according to the at least one particular one of the computed face ratios, for each of at least one image to be included in each of the plurality of buckets until achieving convergence; and
performing a query for a query facial image by comparing the query facial image only to images clustered into a selected subset of the plurality of buckets.

2. The method according to claim 1 , wherein the computed ratios represent relationships among ones of the face points.

3. The method according to claim 1 , wherein the selected at least one particular one is selected as uniquely representing the face points of each of the facial images in the candidate image set.

4. The method according to claim 1 , wherein the clustering is performed using an Expectation Maximization algorithm.

5. The method according to claim 1 , wherein a count of the plurality of buckets to be used for the clustering is provided by a user.

6. The method according to claim 1 , wherein performing the query further comprises:
determining, for the query facial image, the location of each of the plurality of face points;
computing, for the query facial image, the distance between the location of each of the plurality of face points;
computing, for the query facial image, the ratio for each unique pair of the computed distances;
computing, for the query facial image, a probability of the computed ratios for the query facial image being in each of the plurality of buckets; and
using the computed probabilities for selecting at least one of the plurality of buckets as comprising the selected subset.

7. The method according to claim 6 , wherein:
the selected subset comprises one or more of the plurality of buckets for which the computed probability is highest.

8. The method according to claim 7 , wherein:
a user provides a count of the plurality of buckets to include in the selected subset.

9. The method according to claim 1 , wherein:
performing the query determines which of the plurality of facial images is most similar to the query facial image.

10. A system for facial image bucketing, comprising:
a plurality of facial images in a candidate image set stored in persistent storage of a computing system;
a computer comprising a processor; and
instructions which are executable, using the processor, to perform functions comprising:
analyzing each of the plurality of facial images, comprising:
determining, for the each image, a location of each of a plurality of face points;
computing, for the each image, a distance between the location of each of the plurality of face points; and
computing, for the each image, a ratio for each unique pair of the computed distances;

selecting, from the computed ratios for the plurality of facial images, at least one particular one of the computed face ratios;
clustering the facial images in the candidate image set into a plurality of buckets using the selected at least one particular one of the computed face ratios, wherein the clustering is performed using an Expectation Maximization algorithm that iteratively computes a mean and a standard deviation, according to the at least one particular one of the computed face ratios, for each of at least one image to be included in each of the plurality of buckets until achieving convergence; and
performing a query for a query facial image by comparing the query facial image only to images clustered into a selected subset of the plurality of buckets.

11. The system according to claim 10 , wherein:
the computed ratios represent relationships among ones of the face points; and
the selected at least one particular one is selected as uniquely representing the face points of each of the facial images in the candidate image set.

12. The system according to claim 10 , wherein performing the query further comprises:
determining, for the query facial image, the location of each of the plurality of face points;
computing, for the query facial image, the distance between the location of each of the plurality of face points;
computing, for the query facial image, the ratio for each unique pair of the computed distances;
computing, for the query facial image, a probability of the computed ratios for the query facial image being in each of the plurality of buckets; and
using the computed probabilities for selecting at least one of the plurality of buckets as comprising the selected subset, the selected subset comprising one or more of the plurality of buckets for which the computed probability is highest.

13. The system according to claim 10 , wherein:
performing the query determines which of the plurality of facial images is most similar to the query facial image.

14. A computer program product for facial image bucketing, the computer program product comprising:
a computer-readable storage medium having computer readable program code embodied therein, the computer-readable program code configured for:
analyzing each of a plurality of facial images in a candidate image set, comprising:
determining, for the each image, a location of each of a plurality of face points;
computing, for the each image, a distance between the location of each of the plurality of face points; and
computing, for the each image, a ratio for each unique pair of the computed distances;

selecting, from the computed ratios for the plurality of facial images, at least one particular one of the computed face ratios;
clustering the facial images in the candidate image set into a plurality of buckets using the selected at least one particular one of the computed face ratios, wherein the clustering is performed using an Expectation Maximization algorithm that iteratively computes a mean and a standard deviation, according to the at least one particular one of the computed face ratios, for each of at least one image to be included in each of the plurality of buckets until achieving convergence; and
performing a query for a query facial image by comparing the query facial image only to images clustered into a selected subset of the plurality of buckets.

15. The computer program product according to claim 14 , wherein:
the computed ratios represent relationships among ones of the face points; and
the selected at least one particular one is selected as uniquely representing the face points of each of the facial images in the candidate image set.

16. The computer program product according to claim 14 , wherein performing the query further comprises:
determining, for the query facial image, the location of each of the plurality of face points;
computing, for the query facial image, the distance between the location of each of the plurality of face points;
computing, for the query facial image, the ratio for each unique pair of the computed distances;
computing, for the qu

Assignees

• IBM

Inventors

• Poplavski Michael
• Schumacher Scott
• Snehal Prachi
• Welleck Sean J
• Xia Alan
• Zhou Yinle

Classifications

• G06V10/762

  using clustering, e.g. of similar faces in social networks · CPC title

• G06V40/173 Primary

  face re-identification, e.g. recognising unknown faces across different face tracks · CPC title

• G06V40/171

  Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships · CPC title

• G06F18/217

  Validation; Performance evaluation; Active pattern learning techniques · CPC title

• G06F18/23

  Clustering techniques · CPC title