Person recognition apparatus and person recognition method

Patent metadata

Field	Value
Publication number	US-9530078-B2
Application number	US-201414200270-A
Country	US
Kind code	B2
Filing date	Mar 7, 2014
Priority date	Mar 18, 2013
Publication date	Dec 27, 2016
Grant date	Dec 27, 2016

Abstract

A person recognition apparatus is disclosed that includes an image input unit, a face detection unit in which a face is expressed from the inputted image data, as a score which takes a value in accordance with facial likeness, a facial feature point detection unit, a feature extraction unit, a feature data administrative unit, a person identification unit to calculate similarity between the amount calculated by the feature extraction unit and the amount stored in the feature data administrative unit, a number of candidates calculation unit which displays the images stored in descending order of the similarity, and calculates a score from the face detection unit and the facial feature point detection unit, a candidate confirmation unit in which images displayed in descending order of the similarity are subjected to visual inspection.

First claim

What is claimed is:

1. A person recognition apparatus, comprising:
an input device to input image data;
a face detection device configured to:
detect a face area in which a face of a person is expressed from the inputted image data, and to output a score with a large value when a face is detected, and a small value when a face is not detected, based on a brightness value of each pixel of the inputted image;
detect and output a size of the face in a longitudinal direction and a lateral direction;
detect and output a yaw direction, a pitch direction, and a roll direction of the face;

a number of candidates calculation device configured to:
adaptively determine a threshold value relating to a calculation of the number of candidates for each input, based on the value of the detected longitudinal direction, lateral direction, yaw direction, pitch direction, and roll direction of the face;
display the facial images stored in the feature data administrative device in descending order of the similarity calculated by the person identification device; and
calculate a number of facial images to be displayed in accordance with the threshold value, the score outputted from the face detection device, and the yaw direction, pitch direction, and roll direction outputted from the facial feature point detection device; and

a candidate confirmation device configured to:
display retrieval candidates of the facial images in descending order of the similarity and subject said facial images to visual inspection by a user, and
recalculate the number of the facial images displayed by the number of candidates calculation device in accordance with an increase or decrease of the number of candidates to be confirmed.

2. The apparatus of claim 1 , wherein: the second feature amount includes the facial image of the person; and
an output device is configured to display and output a facial image corresponding to the face area detected from the inputted image data, and the facial images of the persons of the number corresponding to the number of candidates from a higher rank of the persons extracted in descending order of the similarity.

3. The apparatus of claim 2 , further comprising:
a selection device configured to select a prescribed facial image out of the facial images of the persons of the number corresponding to the number of candidates;
wherein an output device displays and outputs the facial image corresponding to the face area detected from the inputted image data, and the facial image selected by the selection device, side by side.

4. The apparatus of claim 2 , wherein: an output device is configured to display and output the facial images of the persons of the number corresponding to the number of candidates in the order of age of the extracted person, side by side.

5. The apparatus of claim 2 , wherein: an output device is configured to display and output the facial images of the persons of the number corresponding to the number of candidates in the order of the face direction of the extracted person, side by side.

6. The apparatus of claim 1 , further comprising:
an acceptance device configured to accept an input of a distribution number;
wherein an output device is configured to distribute person information of the persons of the number corresponding to the number of candidates from a higher rank of the persons extracted in descending order of the similarity, by the inputted distribution number, and outputs the distributed person information.

7. A person recognition method, comprising:
inputting image data;
detecting a face area in which a face of a person is expressed from the inputted image data, and outputting a score with a large value when a face is detected, and a small value when a face is not detected, based on a brightness value of each pixel of the inputted image;
detecting and outputting a size of the face in a longitudinal direction and a lateral direction;
detecting and outputting a yaw direction, a pitch direction, and a roll direction of the face;
adaptively determine a threshold value relating to a calculation of the number of candidates for each input, based on the value of the detected longitudinal direction, lateral direction, yaw direction, pitch direction, and roll direction of the face;
displaying the facial images stored in the feature data administrative device in descending order of the calculated similarity, and calculating a number of facial images to be displayed in accordance with the threshold value, the outputted score, and the outputted yaw direction, pitch direction, and roll direction of the face;
subjecting to visual inspection by a user retrieval candidates of the facial images displayed in descending order of the similarity, and recalculating the number of the facial images to be displayed in accordance with increase or decrease of the number of candidates to be confirmed.

Assignees

• Toshiba Kk

Inventors

• Saito Hiroo
• Sukegawa Hiroshi

Classifications

• G06V10/945

  User interactive design; Environments; Toolboxes · CPC title

• G06F18/40

  Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor · CPC title

• G06V40/172 Primary

  Classification, e.g. identification · CPC title

• G06K9/00617

  Physics · mapped topic

• G06K9/6253 Primary

  Physics · mapped topic