Information processing apparatus, display control method, and program

Patent metadata

Field	Value
Publication number	US-9569895-B2
Application number	US-201214356008-A
Country	US
Kind code	B2
Filing date	Aug 31, 2012
Priority date	Nov 9, 2011
Publication date	Feb 14, 2017
Grant date	Feb 14, 2017

Abstract

There is provided an information processing apparatus including a judgment unit for judging an anteroposterior relationship between a shot actual object and a virtual object for each part by use of depth information, and a display control unit for displaying a virtual image in which the virtual object is projected to be overlapped on a shot image in which the actual object is shot based on the anteroposterior relationship judged by the judgment unit.

First claim

The invention claimed is:

1. An information processing apparatus comprising:
a depth determination unit for acquiring actual object depth information of different portions of an actual object as a function of distance of the portions of the actual object from an object imaging device;
a display control unit for providing virtual object depth information of different portions of a virtual object as a function of the distance of the portions of the virtual object from a virtual imaging device at a location corresponding to the object imaging device; and
a judgment unit for judging an anteroposterior relationship between a shot image of the actual object and the virtual object for each portion by use of the actual object depth information and the virtual object depth information of the portions included in the actual object and in the virtual object;
wherein the display control unit causes projection of the virtual object to be overlapped on the shot image of the actual object based on the anteroposterior relationship judged by the judgment unit, such that portions of the shot image overlap the virtual object when the actual object depth information is less than the virtual object depth information and particular portions of the virtual object overlap the shot image of the actual object when the depth information of corresponding portions of the actual object is greater than the depth information of the particular portions of the virtual object.

2. The information processing apparatus according to claim 1 , wherein the depth determination unit calculates the depth of the actual object based on detection data detected from a real space,
and
wherein the virtual object comprises a virtual clothing ornament and the display control unit displays a virtual clothing ornament image in which the clothing ornament is projected to be overlapped on the shot image based on the anteroposterior relationship judged by the judgment unit.

3. The information processing apparatus according to claim 2 ,
wherein the display control unit controls the presence of the projected virtual clothing ornament image per pixel based on the judgment result of the anteroposterior relationship per pixel by the judgment unit.

4. A display control method comprising the steps of:
calculating actual object depth information of different portions of an actual object by determining distance of the portions of the actual object from an object imaging device;
providing virtual object depth information of different portions of a virtual object as a function of the distance of the portions of the virtual object from a virtual imaging device at a location corresponding to the object imaging device;
judging an anteroposterior relationship between a shot image of the actual object and the virtual object for each portion by use of the actual object depth information and the virtual object depth information of the portions included in the actual object and in the virtual object; and
displaying a virtual image in which the virtual object is projected to be overlapped on the shot image of the actual object based on the anteroposterior relationship judged in the judgment step, such that portions of the shot image overlap the virtual object when the actual object depth information is less than the virtual object depth information and particular portions of the virtual object overlap the shot image of the actual object when the depth information of corresponding portions of the actual object is greater than the depth information of the particular portions of the virtual object.

5. A non-transitory computer readable medium on which is stored a program for causing a computer to perform:
a processing of acquiring actual object depth information of different portions of an actual object as a function of distance of the portions of the actual object from an object imaging device;
a processing of providing virtual object depth information of different portions of a virtual object as a function of the distance of the portions of the virtual object from a virtual imaging device at a location corresponding to the object imaging device;
a processing of judging an anteroposterior relationship between a shot image of the actual object and the virtual object for each portion by use of the actual object depth information and the virtual object depth information portions included in the actual object and in the virtual object; and;
a processing of displaying a virtual image in which the virtual object is projected to be overlapped on the shot image of the actual object based on the anteroposterior relationship judged by the judgment processing, such that portions of the shot image overlap the virtual object when the actual object depth information is less than the virtual object depth information and particular portions of the virtual object overlap the shot image of the actual object when the depth information of corresponding portions of the actual object is greater than the depth information of the particular portions of the virtual object.

6. The medium according to claim 5 , for causing the computer to further perform a processing of calculating a depth of the actual object based on detection data detected from a real space,
and
wherein the virtual object comprises a virtual clothing ornament and the display processing displays a virtual clothing ornament image in which the clothing ornament is projected to be overlapped on the shot image based on the anteroposterior relationship judged by the judgment processing.

7. The medium according to claim 6 ,
wherein the display processing controls the presence of the projected virtual clothing ornament image per pixel based on the judgment result of the anteroposterior relationship per pixel by the judgment processing.

Assignees

• Suzuki Seiji
• Sony Corp

Inventors

• Suzuki Seiji

Classifications

• G06T2210/16

  Cloth · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title