Transitioning views of a virtual model

Patent metadata

Field	Value
Publication number	US-10373392-B2
Application number	US-201514836818-A
Country	US
Kind code	B2
Filing date	Aug 26, 2015
Priority date	Aug 26, 2015
Publication date	Aug 6, 2019
Grant date	Aug 6, 2019

Abstract

Embodiments are disclosed for transitioning views presented via a head-mounted display device. One example method for operating a head-mounted display device includes displaying a virtual model at a first position in a coordinate frame of the head-mounted display device, receiving sensor data from one or more sensors of the head-mounted display device, and determining a line of sight of the user that intersects the virtual model to identify a location the user is viewing. The example method further includes, responsive to a trigger, moving the virtual model to a second position in the coordinate frame of the head-mounted display device corresponding to the location the user is viewing and simultaneously scaling the virtual model.

First claim

The invention claimed is:

1. A method for operating a head-mounted display device, the method comprising:
displaying via the head-mounted display device a virtual model at a first position in a coordinate frame of the head-mounted display device;
receiving sensor data from one or more sensors of the head-mounted display device;
determining a line of sight of a user that intersects the virtual model to identify a location the user is viewing; and
responsive to a trigger, moving the virtual model to a second position in the coordinate frame of the head-mounted display device corresponding to the location the user is viewing and simultaneously scaling a size of the virtual model relative to a field of view of the head-mounted display device, and adjusting a speed of the movement and scaling by moving and scaling the virtual model more quickly while the virtual model is smaller relative to the field of view of the head-mounted display device and more slowly as the virtual model grows larger relative to the field of view of the head-mounted display device, such that the virtual model appears to move and scale in size at a consistent rate relative to the field of view of the head-mounted display device.

2. The method of claim 1 , wherein moving the virtual model comprises performing one or more of the scaling and the moving of the virtual model progressively non-linearly.

3. The method of claim 1 , where determining a line of sight of the user that intersects the virtual model comprises determining a ray along an eyeline of the user and determining where the ray intersects the virtual model.

4. The method of claim 1 , wherein scaling the virtual model comprises scaling the virtual model from a smaller size to a larger size.

5. The method of claim 4 , wherein moving the virtual model to the second position comprises moving from an overhead view of the model to a first person view within the model, and wherein the location the user is viewing is maintained within the line of sight of the user while scaling and moving the virtual model.

6. The method of claim 4 , wherein moving the virtual model to the second position comprises moving a surface of the model to an estimated location of a foot of the wearer of the head-mounted display device.

7. The method of claim 6 , further comprising determining the estimated location of the foot of the wearer based upon one or more of head pose data and user profile data.

8. The method of claim 1 , further comprising adjusting one or more of a volume and a perceived location of audio associated with the virtual model that is output during moving of the virtual model.

9. The method of claim 1 , further comprising fading out an appearance of the virtual model at the first position and fading in an appearance of the virtual model at the second position while moving the virtual model to the second position.

10. The method of claim 1 , wherein the trigger includes a detected gesture.

11. The method of claim 1 , wherein the trigger includes detection of an actuation of a physical input device in communication with the head-mounted display device.

12. A head-mounted display device, comprising:
a display;
a logic device; and
a storage device storing instructions executable by the logic device to
display via the display of the head-mounted display device a virtual model at a first position in a coordinate frame of the head-mounted display device; and
responsive to a trigger, display an animation representing a movement of the virtual model from the first position to a second position in the coordinate frame of the head-mounted display device and simultaneously scale a size of the virtual model relative to a field of view of the head-mounted display device based on the movement such that the movement and scaling occurs at a variable rate progression in which the virtual model moves and scales more quickly while the virtual model is smaller relative to the field of view of the head-mounted display device and more slowly as the virtual model grows larger relative to the field of view of the head-mounted display device, such that the virtual model appears to move and scale in size at a consistent rate relative to the field of view of the head-mounted display device.

13. The head-mounted display device of claim 12 , further comprising one or more sensors, wherein the instructions are further executable to receive sensor data from the one or more sensors, determine a head pose of a user based on the sensor data, and determine a line of sight of the user that intersects the virtual model to identify a location the user is viewing, the second position corresponding to the location the user is viewing.

14. The head-mounted display device of claim 12 , wherein the instructions to scale the virtual model comprise instructions executable to scale the virtual model from a smaller size to a larger size.

15. The head-mounted display device of claim 14 , wherein the instructions executable to move the virtual model to the second position comprise instructions executable to move from an overhead view of the model to a first person view within the model.

16. The head-mounted display device of claim 14 , wherein the instructions executable to move the virtual model to the second position comprise instructions executable to move a surface of the model to an estimated location of a foot of the wearer of the head-mounted display device.

17. A head-mounted display device comprising:
a display;
one or more sensors;
a logic device; and
a storage device storing instructions executable by the logic device to
display via the display of the head-mounted display device a virtual model at a first position in a coordinate frame of the head-mounted display device;
determine a head pose of a user based on sensor data acquired via the one or more sensors;
determine a line of sight of the user that intersects the virtual model to identify a location the user is viewing; and
responsive to a trigger, displaying, via the display, an animation representing a movement of the virtual model to a second position in the coordinate frame of the head-mounted display device, the second position corresponding to the location the user is viewing, and simultaneously scaling a size of the virtual model relative to a field of view of the head-mounted display device based on the movement such that the movement and the scaling occurs at a variable rate progression in which the virtual model moves and scales more quickly while the virtual model is smaller relative to the field of view of the head-mounted display device and more slowly as the virtual model grows larger relative to the field of view of the head-mounted display device, such that the virtual model appears to move and scale in size at a consistent rate relative to the field of view of the head-mounted display device.

18. The head-mounted display device of claim 17 , wherein scaling the virtual model comprises scaling the virtual model from a smaller size to a larger size and wherein moving the virtual model to the second position comprises moving from an overhead view of the model to a first person view within the model.

19. The head-mounted display device of claim 17 , wherein moving the virtual model to the second position comprises moving a surface of the model to an estimated location of a foot of the wearer of the head-mounted display device.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Christen Jonathan R
• Memmott Robert Courtney
• Sugden Benjamin John
• Nance James L
• Tanner Marcus
• Mcculloch Daniel Joseph

Classifications

• G06T7/73

  using feature-based methods · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G06T2219/2016

  Rotation, translation, scaling · CPC title