Information processing apparatus, information processing method, and non-transitory storage medium

Patent metadata

Field	Value
Publication number	US-11398024-B2
Application number	US-201916676571-A
Country	US
Kind code	B2
Filing date	Nov 7, 2019
Priority date	Dec 27, 2018
Publication date	Jul 26, 2022
Grant date	Jul 26, 2022

Abstract

An information processing apparatus according to the invention includes: an acquisition unit that acquires a two-dimensional image of a person and a three-dimensional registered image of a registrant; and a generation unit that, when superimposing the two-dimensional image and the three-dimensional registered image to generate a composite image, performs an editing process for changing an appearance of the person or the registrant for at least one of the two-dimensional image, the three-dimensional registered image, and the composite image.

First claim

What is claimed is:

1. An information processing apparatus comprising:
at least one memory configured to store instructions; and
a processor configured to execute the instructions to:
identify an orientation of a target person in a two-dimensional image;
identify a matching mode as a two-dimensional matching mode or a three-dimensional matching mode based on the orientation;
acquire a plurality of similarity degrees by matching the two-dimensional image of the target person with registered images of a plurality of registrants in accordance with the identified matching mode, wherein the registered images are three-dimensional registered images or two-dimensional registered images;
extract a plurality of candidates from the plurality of registrants based on the plurality of acquired similarity degrees;
generate display information for displaying a list of registered images of the plurality of candidates in an order of the plurality of similarity degrees;
combine the two-dimensional image and a registered image of a candidate selected from the list by a user operation to generate a composite image; and
perform an editing process for changing at least one of a first appearance of the target person in the two-dimensional image and a second appearance of the candidate in the registered image to generate the composite image.

2. The information processing apparatus according to claim 1 , wherein the processor is further configured to detect a difference in the appearance between the two-dimensional image and the three-dimensional registered image and perform the editing process for causing the appearance in one of the images to be closer to the appearance in the other image.

3. The information processing apparatus according to claim 1 , wherein the processor is further configured to perform the editing process on a selected item from a plurality of target items related to the appearance based on a user operation.

4. The information processing apparatus according to claim 1 , wherein the appearance corresponds to at least one of a part, an amount, a shape, and a color of hair growth on a head.

5. The information processing apparatus according to claim 1 , wherein the appearance corresponds to presence or absence of a predetermined attachment on a head.

6. The information processing apparatus according to claim 1 , wherein the appearance corresponds to facial expression.

7. The information processing apparatus according to claim 1 , wherein the appearance is an aging degree of a face.

8. The information processing apparatus according to claim 7 , wherein the processor is further configured to perform the editing process for simulating a change over the years of the aging degree for one of the two-dimensional image and the three-dimensional registered image based on attribute information of the two-dimensional image and the three-dimensional registered image.

9. The information processing apparatus according to claim claim 1 , wherein the processor is further configured to:
acquire the plurality of similarity degrees by matching the two-dimensional image with the two-dimensional registered images when the identified matching mode is the two-dimensional matching mode; and
acquire the plurality of similarity degrees by matching the two-dimensional image with the three-dimensional registered images when the identified matching mode is the three-dimensional matching mode.

10. The information processing apparatus according to claim 9 , wherein the processor is further configured to analyze the two-dimensional image to identify the orientation of the target person.

11. An information processing method comprising:
identifying an orientation of a target person in a two-dimensional image;
identifying a matching mode as a two-dimensional matching mode or a three-dimensional matching mode based on the orientation;
acquiring a plurality of similarity degrees by matching the two-dimensional image of the target person with registered images of a plurality of registrants in accordance with the identified matching mode, wherein the registered images are three-dimensional registered images or two-dimensional registered images;
extracting a plurality of candidates from the plurality of registrants based on the plurality of acquired similarity degrees;
generating display information for displaying a list of registered images of the plurality of candidates in the order of the plurality of similarity degrees;
combining the two-dimensional image and a registered image of a candidate selected from the list by a user operation to generate a composite image; and
performing an editing process for changing at least one of a first appearance of the target person in the two-dimensional image and a second appearance of the candidate in the registered image to generate the composite image.

12. A non-transitory storage medium in which a program is stored, the program being configured to cause a computer to perform:
identifying an orientation of a target person in a two-dimensional image;
identifying a matching mode as a two-dimensional matching mode or a three-dimensional matching mode based on the orientation;
acquiring a plurality of similarity degrees by matching the two-dimensional image of the target person with registered images of a plurality of registrants in accordance with the identified matching mode, wherein the registered images are three-dimensional registered images or two-dimensional registered images;
extracting a plurality of candidates from the plurality of registrants based on the plurality of acquired similarity degrees;
generating display information for displaying a list of registered images of the plurality of candidates in the order of the plurality of similarity degrees;
combining the two-dimensional image and a registered image of a candidate selected from the list by a user operation to generate a composite image; and
performing an editing process for changing at least one of a first appearance of the target person in the two-dimensional image and a second appearance of the candidate in the registered image to generate the composite image.

Assignees

• Nec Corp

Inventors

• Fukuda Junichi
• Nakamura Ryosuke
• Hamada Yasushi

Classifications

• G06V40/174

  Facial expression recognition · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06T2219/2024

  Style variation · CPC title