Technique for more efficiently displaying text in virtual image generation system

Patent metadata

Field	Value
Publication number	US-9978182-B2
Application number	US-201615198983-A
Country	US
Kind code	B2
Filing date	Jun 30, 2016
Priority date	Jun 30, 2015
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

A virtual image generation system and method of operating same is provided. An end user is allowed to visualize the object of interest in a three-dimensional scene. A text region is spatially associated with the object of interest. A textual message that identifies at least one characteristic of the object of interest is generated. A textual message is streamed within the text region.

First claim

What is claimed is:

1. A method of operating a virtual image generation system, the method comprising:
allowing an end user to visualize an object of interest in a three-dimensional scene;
spatially associating a text region within a field of view of the user, wherein the text region is spatially associated with the object of interest;
generating a gesture reference associated with the object of interest;
generating a textual message that identifies at least one characteristic of the object of interest;
streaming the textual message within the text region;
sensing gestural commands from the end user by detecting an angular position of an anatomical part of the end user relative to a plurality of different regions of the gesture reference; and
controlling the streaming of the textual message in response to the sensed gestural commands, wherein the gesture reference is an annular ring surrounding the object of interest, and
wherein a first side of the annular ring forms one of the different regions, and
a second side of the annular ring opposite of the first side of the annular ring forms another one of the different regions.

2. The method of claim 1 , further comprising displaying the gesture reference as a gesture reference object adjacent the object of interest.

3. The method of claim 1 , wherein the anatomical part of the end user is a head of the end user.

4. The method of claim 3 , wherein the anatomical part of the end user is a finger or hand of the end user.

5. The method of claim 1 , wherein the gesture reference is separate and distinct from the object of interest.

6. The method of claim 1 , wherein the annular ring comprises a plurality of concentric rings, and an interface between two adjacent ones of the concentric rings forms one of the different regions.

7. The method of claim 6 , wherein an inner or outer edge of the annular ring forms another one of the different regions.

8. The method of claim 1 , wherein the gesture reference is the object of interest.

9. The method of claim 1 , wherein the streaming of the textual message is controlled in response to the sensed gestural commands by initiating the streaming of the textual message when the anatomical part of the end user is pointed at the one region of the gesture reference, and terminating the streaming of the textual message when the anatomical part of the end user is pointed at another different region of the gesture reference.

10. The method of claim 1 , wherein the streaming of the textual message is controlled in response to the sensed gestural commands by displaying at least one word of the textual message when the anatomical part of the end user is pointed at the one region of the gesture reference, and displaying at least another word of the textual message when the anatomical part of the end user is pointed at another different region of the gesture reference.

11. The method of claim 1 , wherein the gestural commands are sensed from the end user as the anatomical part of the end user is scanned across the gesture reference.

12. The method of claim 1 , wherein the one or more sensors are configured for sending the gestural commands from the end user as the anatomical part of the end user is scanned across the gesture reference.

13. A virtual image generation system for use by an end user, comprising: a display system configured for allowing the end user to visualize an object of interest in a three dimensional scene;
a control system configured for spatially associating a text region with a field of view of the end user, wherein the text region is spatially associated with the object of interest,
generating a gesture reference associated with the object of interest,
generating a textual message that identifies at least one characteristic of the object of interest, and
instructing the display system to stream the textual message within the text region; and
one or more sensors configured for sensing gestural commands from the end user by detecting an angular position of an anatomical part of the end user relative to a plurality of different regions of the gesture reference, wherein the control system is further configured for controlling the streaming of the textual message in response to the sensed gestural commands,
wherein the gesture reference is an annular ring surrounding the object of interest, and
wherein a first side of the annular ring forms one of the different regions, and
a second side of the annular ring opposite of the first side of the annular ring forms another one of the different regions.

14. The virtual image generation system of claim 13 , wherein the control system is further configured for instructing the display system to display the gesture reference as a gesture reference object adjacent the object of interest.

15. The virtual image generation system of claim 13 , wherein the anatomical part of the end user is a head of the end user.

16. The virtual image generation system of claim 15 , wherein the anatomical part of the end user is a finger or hand of the end user.

17. The virtual image generation system of claim 13 , wherein the gesture reference is separate and distinct from the object of interest.

18. The virtual image generation system of claim 13 , wherein the annular ring comprises a plurality of concentric rings, and an interface between two adjacent ones of the concentric rings forms one of the different regions.

19. The virtual image generation system of claim 18 , wherein an inner or outer edge of the annular ring forms another one of the different regions.

20. The virtual image generation system of claim 19 , wherein the gesture reference is the object of interest.

21. The virtual image generation system of claim 13 , wherein the control system is configured for controlling the streaming of the textual message in
response to the sensed gestural commands by instructing the display system to initiate the streaming of the textual message when the anatomical part of the end user is pointed at the one region of the gesture reference, and terminate the streaming of the textual message when the anatomical part of the end user is pointed at another different region of the gesture reference.

22. The virtual image generation system of claim 13 , wherein the control system is configured for controlling the streaming of the textual message in response to the sensed gestural commands by instructing the display system to display at least one word of the textual message when the anatomical part of the end user is pointed at the one region of the gesture reference, and display at least another word of the textual message when the anatomical part of the end user is pointed at another different region of the gesture reference.

Assignees

• Magic Leap Inc

Inventors

• Yeoh Ivan Li Chuen
• Miller Samuel A
• Hand Randall E
• Edwin Lionel Ernest
• O'Connor Philip
• Schwab Brian David
• Lindsay Spencer

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G02B27/0172 Primary

  characterised by optical features · CPC title

• G06T2207/20112

  Image segmentation details · CPC title

• G06T7/60

  Analysis of geometric attributes · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title