Method and apparatus for processing image

Patent metadata

Field	Value
Publication number	US-11475232-B1
Application number	US-202117538666-A
Country	US
Kind code	B1
Filing date	Nov 30, 2021
Priority date	Oct 28, 2021
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

A method for processing an image, which is performed by an image processing apparatus, is provided. The method includes acquiring a first image including an object and a second image including an object identical to the object in the first image under the same condition, acquiring three-dimensional direction information of a specific part of the object in the first image, and providing a three-dimensionally processed image by three-dimensionally rotating the object in the second image by an angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image.

First claim

What is claimed is:

1. A method for processing an image performed by an image processing apparatus, the method comprising:
acquiring a first image including an object and a second image including the object in the first image under the same condition;
acquiring three-dimensional direction information of a specific part of the object in the first image; and
providing a three-dimensionally processed image by three-dimensionally rotating the object in the second image by an angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image,
wherein, in the providing the three-dimensionally processed image, a partial image including the specific part of the object in the second image is acquired, and then, a three-dimensionally processed partial image is provided by three-dimensionally rotating the partial image by the angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image.

2. The method of claim 1 , wherein the first image is a 2-dimensional image, and the second image is a 3-dimensional image.

3. The method of claim 2 , wherein the 2-dimensional image is a 2-dimensional infrared ray (IR) image or a 2-dimensional color image.

4. The method of claim 1 , wherein the object is a human body, and the specific part is a face of the human body.

5. The method of claim 1 , wherein, in the acquiring the three-dimensional direction information, the three-dimensional direction information is acquired by using an artificial intelligence neural network model which is trained with input data and label data, and
the input data includes a plurality of training 2-dimensional images, and the label data includes three-dimensional direction information of a specific part of an object included in each of the plurality of training 2-dimensional images.

6. The method of claim 1 , further comprises providing a comparison result between the three-dimensionally processed partial image and reference data.

7. The method of claim 6 , wherein the object is a human body, and the specific part is a face of the human body, and
wherein, in the providing the comparison result, the comparison result is information that indicates whether the three-dimensionally processed partial image and the reference data show the same face.

8. An apparatus for processing an image, the apparatus comprising:
an acquisition unit configured to acquire a first image including an object and a second image including the object in the first image under the same condition; and
a processor configured to provide a processing image obtained by using the first image and the second image,
wherein the processor
acquires three-dimensional direction information of a specific part of the object in the first image; and
provides the processing image by three-dimensionally rotating the object in the second image by an angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image,
wherein the processor acquires a partial image including the specific part of the object in the second image, and then provides a three-dimensionally processed partial image by three-dimensionally rotating the partial image by an angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image.

9. The apparatus of claim 8 , wherein the first image is a 2-dimensional image, and the second image is a 3-dimensional image.

10. The apparatus of claim 9 , wherein the 2-dimensional image is a 2-dimensional infrared ray (IR) image or a 2-dimensional color image.

11. The apparatus of claim 8 , wherein the object is a human body, and the specific part is a face of the human body.

12. The apparatus of claim 8 , wherein the processor acquires the three-dimensional direction information by using an artificial intelligence neural network model which is trained with input data and label data, and
the input data includes a plurality of training 2-dimensional images, and the label data includes three-dimensional direction information of a specific part of an object included in each of the plurality of training 2-dimensional images.

13. The apparatus of claim 8 ,
the processor further provides a comparison result between the three-dimensionally processed partial image and reference data.

14. The apparatus of claim 13 , wherein the object is a human body, and the specific part is a face of the human body, and
wherein the processor provides, as the comparison result, information that indicates whether the three-dimensionally processed partial image and the reference data show the same face.

15. A non-transitory computer-readable storage medium including computer-executable instructions which cause, when executed by a processor, the processor to perform a method for processing an image performed by an image processing apparatus, the method comprising:
acquiring a first image including an object and a second image including the object in the first image under the same condition;
acquiring three-dimensional direction information of a specific part of the object in the first image; and
providing a three-dimensionally processed image by three-dimensionally rotating the object in the second image by an angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image,
wherein, in the providing the three-dimensionally processed image, a partial image including the specific part of the object in the second image is acquired, and then, a three-dimensionally processed partial image is provided by three-dimensionally rotating the partial image by the angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image.

Assignees

• Suprema Inc

Inventors

• Lee Hyogi
• Lee Kideok
• Song Bong Seop

Classifications

• G06V40/162

  using pixel segmentation or colour matching · CPC title

• G06V20/647

  by matching two-dimensional images to three-dimensional objects · CPC title

• G06V10/143 Primary

  Sensing or illuminating at different wavelengths · CPC title

• G06F18/22 Primary

  Matching criteria, e.g. proximity measures · CPC title

• G06F18/2148

  characterised by the process organisation or structure, e.g. boosting cascade · CPC title