Image processing device and image processing method

Patent metadata

Field	Value
Publication number	US-10204404-B2
Application number	US-201515115510-A
Country	US
Kind code	B2
Filing date	May 27, 2015
Priority date	May 28, 2014
Publication date	Feb 12, 2019
Grant date	Feb 12, 2019

Abstract

There is provided an image processing device including circuitry configured to generate an image of a subject under an illumination environment based on illumination information, from subject information which is associated with illumination of the subject and from the illumination information, wherein the illumination information is acquired on the basis of a virtual illumination body within a real space.

First claim

The invention claimed is:

1. An image processing apparatus comprising:
circuitry configured to
generate an image of a subject under an illumination environment based on illumination information, from subject information which is associated with illumination of the subject and from the illumination information,

wherein the illumination information is acquired on the basis of a virtual illumination body within a real space and an illumination source which illuminates the virtual illumination body.

2. The image processing apparatus of claim 1 , wherein the circuitry is further configured to
acquire the illumination information on the basis of the virtual illumination body within the real space.

3. The image processing apparatus of claim 1 , wherein the illumination information is acquired on the basis of three-dimensional information of the virtual illumination body in the real space.

4. The image processing apparatus of claim 3 , further comprising a memory configured to store a feature quantity of the virtual illumination body,
wherein the circuitry is further configured to
acquire information of the real space in which the virtual illumination body is placed,
discriminate the virtual illumination body on the basis of the feature quantity which is stored in the memory and the acquired information of the real space, and
generate the illumination information on the basis of the information of the real space and the discriminated virtual illumination body.

5. The image processing apparatus of claim 3 , wherein the circuitry is further configured to
acquire information of the real space in which the virtual illumination body is placed,
learn a feature quantity of the virtual illumination body,
initiate a storing of the learned feature quantity into a memory,
discriminate the virtual illumination body on the basis of the stored feature quantity and the acquired information of the real space, and
generate the illumination information on the basis of the information of the real space and the discriminated virtual illumination body.

6. The image processing apparatus of claim 3 , wherein the circuitry is further configured to
initiate a communication with the virtual illumination body, and
receive a communication signal from the virtual illumination body and generate the illumination information on the basis of data contained within the received communication signal.

7. The image processing apparatus of claim 6 , wherein the illumination information is generated on the basis of a position and posture of the virtual illumination body and a change thereof which are indicated by the data contained within the received communication signal.

8. The image processing apparatus of claim 7 , wherein the illumination information is generated for setting a position, direction, and intensity of illumination on the basis of the position and posture of the virtual illumination body and the change thereof which are indicated by the data contained within the received communication signal.

9. The image processing apparatus of claim 7 , wherein the illumination information is generated for setting an intensity and type of illumination on the basis of a user's setting in the virtual illumination body.

10. The image processing apparatus of claim 1 , wherein the illumination information is generated on the basis of information of the real space designated as the virtual illumination body by a user from information which is presented by acquiring the information of the real space in which the virtual illumination body is placed.

11. The image processing apparatus of claim 1 , wherein the illumination information includes information of at least any of a three-dimensional position of the illumination source, an illumination direction of the illumination source, an illumination intensity of the illumination source, and an illumination type of the illumination source.

12. The image processing apparatus of claim 1 , wherein the virtual illumination body is any recognizable object.

13. The image processing apparatus of claim 12 , wherein any recognizable object is provided with a frame region in a plane surface, and is a marker obtained by drawing a predetermined pattern within the frame region.

14. The image processing apparatus of claim 13 , wherein the frame region is rectangular.

15. The image processing apparatus of claim 1 , wherein the subject information comprises reflection characteristics of the subject.

16. An image processing method comprising:
generating an image of a subject under an illumination environment based on illumination information, from subject information which is associated with illumination of the subject and from the illumination information,
wherein the illumination information is acquired on the basis of a virtual illumination body within a real space and an illumination source which illuminates the virtual illumination body.

17. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an image processing method, the method comprising:
generating an image of a subject under an illumination environment based on illumination information, from subject information which is associated with illumination of the subject and from the illumination information,
wherein the illumination information is acquired on the basis of a virtual illumination body within a real space and an illumination source which illuminates the virtual illumination body.

Assignees

• Sony Corp

Inventors

• Lu Ying
• Hirasawa Yasutaka

Classifications

• G06T15/50 Primary

  Lighting effects · CPC title

• G06T7/40

  Analysis of texture (depth or shape recovery from texture G06T7/529) · CPC title

• G06T15/506

  Illumination models · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T5/009 Primary

  Physics · mapped topic