People search system and people search method

Patent metadata

Field	Value
Publication number	US-10303927-B2
Application number	US-201615257225-A
Country	US
Kind code	B2
Filing date	Sep 6, 2016
Priority date	Sep 7, 2015
Publication date	May 28, 2019
Grant date	May 28, 2019

Abstract

According to an embodiment, a people search system includes a receiver, a detector, a search unit, and a display. The search unit obtains features of a first face image and a second face image of a predetermined person and searches for the predetermined person based on a similarity between the features of the first and the second face images when an inhibiting factor is not detected, and generates a third face image that is a composite image of the second face image and the inhibiting factor, obtains features of the first and the third face images, and searches for the predetermined person based on a similarity between the features of the first and the third face images when the inhibiting factor is detected. The display displays the search result of the predetermined person obtained by the search unit.

First claim

The invention claimed is:

1. A people search method comprising:
receiving image data captured by an image-capturing unit provided so as to be capable of capturing people passing through a first location;
detecting an inhibiting factor that inhibits a search for a predetermined person based on a face image from a first face image contained in the image data;
obtaining a feature of the first face image and a feature of a second face image of the predetermined person and searching for the predetermined person based on a similarity between the feature of the first face image and the feature of the second face image when the inhibiting factor has not been detected;
generating a third face image that is a composite image of the second face image and the inhibiting factor, obtaining the feature of the first face image and a feature of the third face image, and searching for the predetermined person based on a similarity between the feature of the first face image and the feature of the third face image when the inhibiting factor has been detected;
displaying, when the similarity between the feature of the first face image and the feature of the third face image is equal to or higher than a certain threshold, the first face image, the second face image, and the third face image as a search result of the predetermined person on a display; and
displaying, when the similarity between the feature of the first face image and the feature of the third face image is lower than the certain threshold, the first face image and the third face image except the second face image as the search result.

2. The people search method according to claim 1 , wherein the generating includes generating the third face image by combining only the inhibiting factor detected from the first face image with the second face image.

3. The people search method according to claim 1 , wherein the detecting includes detecting at least one of concealment, a human race, facial orientation, headwear, glasses, sunglasses, an accessory, a lighting condition, and image quality in the face image as the inhibiting factor.

4. The people search method according to claim 1 , wherein when the inhibiting factor has not been detected, the predetermined person is found when the similarity between the feature of the first face image and the feature of the second face image exceeds a certain threshold, and, when the inhibiting factor has been detected, the predetermined person is found when the similarity between the feature of the first face image and the feature of the third face image exceeds the certain threshold.

5. The people search method according to claim 1 , further comprising:
storing, as the second face image, the first face image and the third face image that have been used in searching for the predetermined person in association with identification information of the predetermined person in a first storage, wherein
when the inhibiting factor has not been detected, the searching includes searching for the predetermined person based on the similarity between the feature of the first face image and the feature of the second face image stored in the first storage, and, when the inhibiting factor has been detected, the generating includes generating the third face image that is a composite image of the second face image stored in the first storage and the inhibiting factor.

6. The people search method according to claim 1 , wherein when the inhibiting factor has not been detected, the third face image is not generated.

7. The people search method according to claim 1 , wherein when the similarity between the feature of the first face image and a feature of the third face image is equal to or higher than the certain threshold, the displaying includes displaying third face image whose similarities to the feature of the first face image are lower than the certain threshold among the third face images, in descending order of similarity to the feature of the first face image on the display.

8. The people search method according to claim 1 , wherein a search result of the predetermined person is stored in a second storage.

Assignees

• Toshiba Kk

Inventors

• Saito Hiroo
• Sato Toshio

Classifications

• G06K9/00771

  Physics · mapped topic

• G06T2207/30201

  Face · CPC title

• G06T7/97

  Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85) · CPC title

• G06K9/00288

  Physics · mapped topic

• G06K9/00295

  Physics · mapped topic