Image processing apparatus and image processing method

Patent metadata

Field	Value
Publication number	US-10275938-B2
Application number	US-201615551177-A
Country	US
Kind code	B2
Filing date	Jan 19, 2016
Priority date	Feb 27, 2015
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

An image processing apparatus including: a real space information input portion into which information about a real space is input; and a signal generating portion that generates a control signal for an image that creates a virtual shadow effect in the real space on the basis of the information about the real space.

First claim

The invention claimed is:

1. An image processing apparatus, comprising:
at least one sensor unit configured to acquire information about a real space; and
a central processing unit (CPU) configured to:
set a parameter of a virtual light source;
receive the information about the real space from the at least one sensor unit;
generate a first control signal for a first image based on the information about the real space and the parameter of the virtual light source;
generate a virtual shadow effect of the first image based on the first control signal;
output the virtual shadow effect of the first image on the real space, wherein the outputted virtual shadow effect of the first image is displayed on the real space; and
control the virtual shadow effect to display content which is related to an object in the real space.

2. The image processing apparatus according to claim 1 , wherein
the information about the real space includes object information associated with the object in the real space, and
the first image creates the virtual shadow effect based on the object information.

3. The image processing apparatus according to claim 2 , wherein
the object information includes information indicative of a position of the object, and
the first image creates the virtual shadow effect based on the position of the object in the real space.

4. The image processing apparatus according to claim 3 , wherein
the parameter of the virtual light source includes a value associated with at least one of a light source characteristic, a position of the light source, a direction of light emitted from the light source, a range of light emitted from the light source, a color of light emitted from the light source, or a brightness of light emitted from the light source.

5. The image processing apparatus according to claim 3 , wherein
the object information further includes information indicative of a three-dimensional shape of the object, and
the first image creates the virtual shadow effect based on the three-dimensional shape of the object in the real space.

6. The image processing apparatus according to claim 5 , wherein the CPU is further configured to generate a second control signal to control an illumination unit to illuminate the object based on the three-dimensional shape of the object.

7. The image processing apparatus according to claim 2 , wherein
the information about the real space includes information indicative of a user operation in the real space, and
the virtual shadow effect changes based on the user operation.

8. The image processing apparatus according to claim 7 , wherein the user operation is a pointing operation with respect to the real space or a virtual space.

9. The image processing apparatus according to claim 8 , wherein the pointing operation includes at least one of a touch operation, a finger pointing operation, an eye gaze operation, a pointing operation based on a cursor, or a pointing operation based on a laser pointer.

10. The image processing apparatus according to claim 7 , wherein the user operation is a pointing operation with respect to the object.

11. The image processing apparatus according to claim 7 , wherein the user operation is a pointing operation with respect to a virtual shadow of the first image in the real space.

12. The image processing apparatus according to claim 1 , wherein
the information about the real space includes information indicative of a position of a shadow of an actual light source in the real space, and
wherein the CPU is further configured to generate the virtual shadow effect at a position corresponding to the position of the shadow created by the actual light source.

13. The image processing apparatus according to claim 1 , wherein the CPU is further configured to change a size of a virtual shadow of the first image in the real space based on change in time.

14. The image processing apparatus according to claim 13 , wherein
the virtual shadow is a shadow corresponding to the object in the real space,
the CPU is further configured to:
generate a third control signal for a second image that illuminates the object and creates an illumination effect, and
control an illumination unit to change a brightness of the illumination effect based on the change in the size of the virtual shadow.

15. An image processing method, comprising:
acquiring information about a real space;
setting a parameter of a virtual light source;
receiving the information about the real space;
generating a control signal for an image based on the information about the real space and the parameter of the virtual light source;
generating a virtual shadow effect of the image based on the control signal;
outputting the virtual shadow effect of the image on the real space, wherein the outputted virtual shadow effect of the image is displayed on the real space; and
controlling the virtual shadow effect to display content which is related to an object in the real space.

16. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which when executed cause a computer to execute operations, the operations comprising:
acquiring information about a real space;
setting a parameter of a virtual light source;
receiving the information about the real space;
generating a control signal for an image based on the information about the real space and the parameter of the virtual light source;
generating a virtual shadow effect of the image based on the control signal;
outputting the virtual shadow effect of the image on the real space, wherein the outputted virtual shadow effect of the image is displayed on the real space; and
controlling the virtual shadow effect to display content which is related to an object in the real space.

Assignees

• Sony Corp

Inventors

• Kondo Masao
• Tako Hirotaka
• Tsujita Yusuke
• Shiono Daisuke
• Nakajima Isao
• Yamaura Kenichi

Classifications

• G06T15/60 Primary

  Shadow generation · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0425

  using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386) · CPC title

• H04N9/3147

  Multi-projection systems (video walls G06F3/1446) · CPC title

• G06F3/0354

  with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks · CPC title