Three dimensional user interface in augmented reality

Patent metadata

Field	Value
Publication number	US-9489774-B2
Application number	US-201314235958-A
Country	US
Kind code	B2
Filing date	May 16, 2013
Priority date	May 16, 2013
Publication date	Nov 8, 2016
Grant date	Nov 8, 2016

Abstract

Technologies are generally described for a three dimensional user interface in augmented reality. In some examples, a method for generating a virtual object in a display area may include generating a first virtual object in the display area with use of at least two viewing cones generated by a display. The method may further include receiving spatial data that relates to a location of a real object in the display area and determining that the real object is interfering with at least one of the viewing cones. The method may further include generating a second virtual object corresponding to the first virtual object. The second virtual object may be located between the display and the location of the real object.

First claim

What is claimed is:

1. A method to generate a virtual object, the method comprising, by a processor:
controlling a free space three dimensional display to generate at least two first viewing cones to generate an image of a first virtual object at a first location of a display area;
receiving spatial data that relates to a second location of a real object in the display area;
determining that the real object is between the display and the first location;
determining that the real object is interfering with at least one of the first viewing cones; and
controlling the free space three dimensional display to generate at least two second viewing cones to generate an image of a second virtual object corresponding to the first virtual object at a third location of the display area, the third location being different from the first location, wherein the third location is between the display and the location of the real object.

2. The method of claim 1 , wherein the second virtual object is a two dimensional image of the first virtual object.

3. The method of claim 1 , further comprising stopping generation of the first virtual object.

4. The method of claim 1 , wherein determining that the real object is interfering with at least one of the first viewing cones includes determining an interfered visual area around the real object, where the interfered visual area includes a buffer region that surrounds the real object.

5. The method of claim 1 , wherein:
the real object interferes with an interfered area in the display area;
the first virtual object has a size larger than the interfered area; and
the second virtual object corresponds to the whole first virtual object.

6. The method of claim 1 , wherein:
the real object interferes with an interfered area in the display area;
the first virtual object has a size larger than the interfered area; and
the second virtual object corresponds to a portion of the first virtual object.

7. The method of claim 1 , wherein the real object includes one of a hand, a foot, or a finger.

8. The method of claim 1 , wherein determining that the real object is interfering with at least one of the first viewing cones includes determining that the real object is travelling along a path that would interfere with at least one of the first viewing cones.

9. The method of claim 1 , wherein:
generating the at least two second viewing cones by the display includes replacing the at least two first viewing cones used to generate the image of the first virtual object.

10. The method of claim 1 , wherein the second virtual object is the same scale as the first virtual object.

11. The method of claim 1 , wherein the second virtual object is of a scale that is either bigger or smaller than the first virtual object.

12. The method of claim 1 , wherein the generating the second virtual object includes generating an animation.

13. The method of claim 12 , wherein the animation includes at least one of compressing the first virtual object, changing a color of the first virtual object, performing a color overlay of the first virtual object, or displaying a movement of the first virtual object to the location of the second virtual object.

14. A system effective to generate a virtual object, the system comprising:
a memory;
a free space three dimensional display that includes a display area; and
a processor configured to be in communication with the memory and the display;
wherein the processor is configured to:
control the display to generate at least two first viewing cones to generate an image of a first virtual object at a first location of the display area;
receive spatial data that relates to a second location of a real object in the display area;
determine that the real object is between the display and the first location;
determine that the real object interferes with at least one of the first viewing cones; and
control the free space three dimensional display to generate at least two second viewing cones to generate an image of a second virtual object that corresponds to the first virtual object at a third location of the display area, the third location being different from the first location, wherein the third location is between the display and the location of the real object.

15. The system of claim 14 , wherein the second virtual object is a two dimensional image of the first virtual object.

16. The system of claim 14 , wherein the determination as to whether the real object interferes with at least one of the first viewing cones includes a determination of an interfered visual area around the real object, where the interfered visual area includes a buffer region that surrounds the real object.

17. The system of claim 14 , wherein the processor is further effective to generate an animation, wherein the animation includes at least one of compression of the first virtual object, change of a color of the first virtual object, performance of a color overlay of the first virtual object, or display of a movement of the first virtual object to the location of the second virtual object.

18. A system effective to generate a virtual object, the system comprising:
a memory; and
a processor configured to be in communication with the memory and the spatial detector;
wherein the processor is configured to:
generate first virtual object data, the first virtual object data effective to control a free space three dimensional display to generate at least two first viewing cones to generate an image of a first virtual object at a first location of the display area, where the first viewing cones are generated by the display;
receive spatial data that relates to a second location of a real object in the display area;
determining that the real object is between the display and the first location;
determine that the real object interferes with at least one of the first viewing cones; and
generate second virtual object data, the second virtual object data effective to control the free space three dimensional display to generate at least two second viewing cones to generate an image of a second virtual object in the display area at a third location of the display area, the third location being different from the first location, wherein the third location is between the display and the location of the real object, where the second virtual object corresponds to the first virtual object.

19. The system of claim 18 , wherein the second virtual object is a two dimensional image of the first virtual object.

Assignees

• Empire Technology Dev Llc

Inventors

• Kruglick Ezekiel

Classifications

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• H04N13/0402

  Electricity · mapped topic

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06T2200/04

  involving 3D image data · CPC title