Apparatus, method, and program for changing augmented-reality display in accordance with changed positional relationship between apparatus and object

Patent metadata

Field	Value
Publication number	US-9928626-B2
Application number	US-201214344135-A
Country	US
Kind code	B2
Filing date	Sep 14, 2012
Priority date	Nov 11, 2011
Publication date	Mar 27, 2018
Grant date	Mar 27, 2018

Abstract

An apparatus including an image processor configured to receive a video including an object, determine a positional relationship between the apparatus and the object, and change a positional relationship between an image superimposed on the video and the object when the positional relationship between the apparatus and the object changes.

First claim

The invention claimed is:

1. An apparatus comprising:
circuitry configured to
receive a video including an object,
control a display to display a virtual object based on the object;
store model data corresponding to the object,
detect, from the video, an angle between a direction of the object and a direction of the apparatus by detecting model data of the object in the video and comparing the model data of the object in the video with the stored model data of the object;
determine a positional relationship between the virtual object and the object based on the angle;
control the display to display the virtual object in a first position and attitude that give the virtual object an appearance of being in a plane of the object when the angle is below a first threshold angle; and
control the display to display the virtual object in a second position and attitude that give the virtual object an appearance of protruding from the object when the angle exceeds the first threshold angle.

2. The apparatus according to claim 1 , wherein the circuitry is configured to change the positional relationship between the virtual object and the object from an oblique relationship to a front view relationship when the angle drops below a second threshold angle.

3. The apparatus according to claim 2 , wherein the second threshold angle is lower than the first threshold angle.

4. The apparatus according to claim 1 , wherein the circuitry is configured to superimpose a text message on the video.

5. The apparatus according to claim 4 , wherein the circuitry is configured to superimpose a text message on the video when the virtual object is modified to fit on the display.

6. The apparatus according to claim 5 , wherein the circuitry is configured to superimpose a text message providing instructions to eliminate modification of the virtual object to fit on the display.

7. The apparatus according to claim 1 , wherein the circuitry is configured to determine a distance between the object and the apparatus and change the positional relationship between the virtual object and the object based on the distance.

8. The apparatus according to claim 7 , wherein the circuitry is configured to change the virtual object based on the distance.

9. The apparatus according to claim 8 , wherein the circuitry is configured to change the virtual object based on the distance such that additional detail is displayed when the distance is less than a first threshold distance.

10. The apparatus according to claim 9 , wherein the circuitry is configured to change the virtual object based on the distance such that additional detail is removed when the distance exceeds a second threshold distance.

11. The apparatus according to claim 10 , wherein the second threshold distance is shorter than the first threshold distance.

12. The apparatus according to claim 1 , wherein the circuitry is configured to receive the virtual object from an external device.

13. The apparatus according to claim 1 , further comprising:
the display.

14. The apparatus according to claim 1 , wherein the circuitry is configured to measure positional information of the apparatus.

15. A method comprising:
receiving, by circuitry, a video including an object,
controlling, using the circuitry, a display to display a virtual object based on the object;
storing, using the circuitry, model data corresponding to the object;
detecting, from the video, using the circuitry, an angle between a direction of the object and a direction of the apparatus by detecting model data of the object in the video and comparing the model data of the object in the video with the stored model data of the object;
determining, using the circuitry, a positional relationship between the virtual object and the object based on the angle;
controlling the display, using the circuitry, to display the virtual object in a first position and attitude that give the virtual object an appearance of being in a plane of the object when the angle is below a first threshold angle; and
object controlling the display, using the circuitry, to display the virtual object in a second position and attitude that give the virtual object an appearance of protruding from the object when the angle exceeds the first threshold angle.

16. A non-transitory computer readable medium encoded with a program that, when loaded on a processor, causes the processor to perform a method comprising:
receiving a video including an object,
controlling a display to display a virtual object based on the object;
storing model data corresponding to the object;
detecting, from the video, an angle between a direction of the object and a direction of the apparatus by detecting model data of the object in the video and comparing the model data of the object in the video with the stored model data of the object;
determining a positional relationship between the virtual object and the object based on the angle;
controlling the display to display the virtual object in a first position and attitude that give the virtual object an appearance of being in a plane of the object when the angle is below a first threshold angle; and
controlling the display to display the virtual object in a second position and attitude that give the virtual object an appearance of protruding from the object when the angle exceeds the first threshold angle.

17. The apparatus according to claim 1 , wherein the circuitry is configured to detect the angle by
forming a transformation matrix between the stored model data of the object and the model data of the object in the video, and
extracting the angle from the transformation matrix.

Assignees

• Kasahara Shunichi
• Sony Corp

Inventors

• Kasahara Shunichi

Classifications

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title