Using historical attributes of a user for virtual or augmented reality rendering

Patent metadata

Field	Value
Publication number	US-9429752-B2
Application number	US-201514702734-A
Country	US
Kind code	B2
Filing date	May 3, 2015
Priority date	Mar 15, 2013
Publication date	Aug 30, 2016
Grant date	Aug 30, 2016

Abstract

One embodiment is directed to a user display device comprising a housing frame mountable on the head of the user, a lens mountable on the housing frame and a projection sub system coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on at least one of a detection of a head movement of the user and a prediction of a head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object.

First claim

What is claimed is:

1. A method of operation in an augmented reality system, the method comprising:
receiving information indicative of an identity of an end user;
retrieving at least one user specific historical attribute for the end user based at least in part on the received information indicative of the identity of the end user;
displaying frames to the end user based at least in part on the retrieved at least one user specific historical attribute for the end user;
predicting an end point of a head movement of the end user based on a location of a virtual object in a field of view of the end user;
displaying frames to the end user based at least in part on the retrieved at least one user specific historical attribute for the end user includes rendering at least one subsequent frame to at least one image buffer, the at least one subsequent frame shifted toward the predicted end point of the head movement;
rendering a plurality of subsequent frames that shift toward the predicted end point of the head movement in at least partial accommodation of at least one head movement attribute for the end user, the at least one head movement attribute indicative of at least one previous head movement of the end user; and
predicting an occurrence of a head movement of the end user based at least in part on a location of appearance of the virtual object in the field of view of the end user.

2. The method of claim 1 wherein the received information is image information indicative of an image of at least a portion of an eye of the end user.

3. The method of claim 2 wherein providing frames to the end user includes providing frames via at least one optical fiber and receiving image information indicative of an image of at least a portion of an eye of the end user includes receiving the image information via the at least an optical fiber which also provides the frames to the end user.

4. The method of claim 1 wherein the retrieved at least one user specific historical attribute for the end user is at least one attribute that provides an indication of the at least one head movement attribute for the end user.

5. The method of claim 1 wherein the retrieved at least one user specific historical attribute for the end user is at least one attribute that provides an indication of at least one previous head movement speed for at least one previous head movement for the end user.

6. The method of claim 1 wherein the retrieved at least one user specific historical attribute for the end user is at least one attribute that provides an indication of variation in a head movement speed across at least part of a range of at least one previous head movement by the end user.

7. The method of claim 1 wherein the retrieved at least one user specific historical attribute for the end user is at least one attribute that provides an indication of at least one previous head movement acceleration for at least one previous head movement by the end user.

8. The method of claim 1 wherein the retrieved at least one user specific historical attribute for the end user is at least one attribute that provides an indication of a relationship between at least one previous head movement and at least one previous eye movement by the end user.

9. The method of claim 1 wherein the retrieved at least one user specific historical attribute for the end user is at least one attribute that provides an indication of a ratio between at least one previous head movement and at least one previous eye movement by the end user.

10. The method of claim 1 , wherein the at least one head movement attribute indicative of at least one previous head movement of the end user is a historical head movement speed for the end user.

11. The method of claim 1 , wherein the at least one head movement attribute indicative of at least one previous head movement of the end user is historical head movement acceleration for the end user.

12. The method of claim 1 , wherein the at least one head movement attribute indicative of at least one previous head movement of the end user is a historical ratio between head movement and eye movement for the end user.

13. The method of claim 1 , further comprising determining the location of appearance of the virtual object when the virtual object is newly introduced in the field of view of the end user temporally relative to previous frames presented to the end user.

14. The method of claim 1 , further comprising determining the location of appearance of the virtual object in a new position as presented to the end user relative to a position of the virtual object as previously presented to the end user.

Assignees

• Magic Leap Inc

Inventors

• Schowengerdt Brian T
• Miller Samuel A

Classifications

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title