Methods and apparatus for interacting with a distant object within a virtual reality environment

Patent metadata

Field	Value
Publication number	US-10445947-B2
Application number	US-201715666561-A
Country	US
Kind code	B2
Filing date	Aug 1, 2017
Priority date	Aug 1, 2017
Publication date	Oct 15, 2019
Grant date	Oct 15, 2019

Abstract

In at least one general aspect, a method can include determining a position of a user in a virtual reality (VR) environment, determining a position of object in the VR environment, defining a vector between the position of the user and the position of the object, and defining an elongated collision volume along the vector. The elongated collision volume may have a medial portion around at least a portion of the object, a proximal portion disposed proximal to the object, and a distal portion disposed proximal to the object. The proximal portion may have a cross-sectional area less than a cross-sectional area of the distal portion.

First claim

What is claimed:

1. A method comprising:
determining, via a controller, a first position of a user in a virtual reality (VR) environment;
determining a position of each of a plurality of objects in the VR environment;
defining a first vector between the first position of the user and the position of each of the plurality of objects;
defining a plurality of elongated collision volumes with each of the plurality of elongated collision volumes being aligned along the respective first vectors associated with the plurality of objects, each of the plurality of elongated collision volumes has a medial portion around at least a portion of a respective object from the plurality of objects, a proximal portion disposed closest to the first position of the user, and a distal portion disposed farthest from the first position of the user, wherein a cross-sectional area of the proximal portion is less than a cross-sectional area of the distal portion;
detecting a change of the user from the first position to a second position;
defining a second vector between the second position of the user and the position of each of the plurality of objects;
aligning the plurality of elongated collision volumes along the respective second vectors based on the second position of the user such that a portion of one elongated collision volume overlaps with a portion of another elongated collision volume; and
detecting an interaction of the user with at least one of the plurality of elongated collision volumes.

2. The method of claim 1 , further comprising:
determining that the position of at least one of the plurality of objects is outside of a threshold reach of the user, wherein the defining the plurality of elongated collision volumes is in response to when the at least one of the plurality of objects being outside of the threshold reach of the user.

3. The method of claim 1 , wherein the at least one of the plurality of elongated collision volumes has a trapezoidal shape.

4. The method of claim 1 , wherein the at least one of the plurality of elongated collision volumes has a trapezoidal shape along a first side and a trapezoidal shape along a second side.

5. The method of claim 1 , wherein at least one of a volume of the distal portion of the at least one of the plurality of elongated collision volumes or a volume of the proximal portion of the at least one of the plurality of elongated collusion volumes is greater than a volume of the medial portion of the at least one of the plurality of elongated collision volumes.

6. The method of claim 1 , wherein a volume of the distal portion of the at least one of the plurality of elongated collision volumes is greater than a volume of the proximal portion of the at least one of the plurality of elongated collision volumes.

7. A method comprising:
determining, via a controller, a position of a user in an environment;
identifying a plurality of collision volumes, each collision volume from the plurality of collision volumes being associated with a respective virtual object from a plurality of virtual objects;
modifying each of the plurality of collision volumes along a direction between the respective virtual object of the plurality of virtual objects and the position of the user to define a plurality of modified collision volumes;
detecting a change in position of the user, wherein during the detected change in position of the user, a portion of one modified collision volume is re-aligned, and based on the re-alignment, overlaps with a portion of another modified collision volume; and
detecting an interaction by the user with at least one of the plurality of modified collision volumes.

8. The method of claim 7 , wherein the modifying includes elongating each of the plurality of modified collision volumes at least one of toward or away from the position of the user.

9. The method of claim 7 , wherein each of the plurality of modified collision volumes rotates in response to the change in position of the user.

10. The method of claim 7 , wherein each of the plurality of modified collision volumes is in a shape of at least one of a cube, rectangular-cube, sphere, tetrahedron or a polyhedron.

11. The method of claim 7 , wherein the at least one of the plurality of modified collision volumes has similar shape as one of the plurality of virtual objects.

12. The method of claim 7 , wherein the at least one of the plurality of modified collision volumes has a trapezoidal shape, in which an end of the trapezoidal shape farthest to the position of the user is larger than an end of the trapezoidal shape closest to the position of the user.

13. The method of claim 7 , further comprising:
determining whether at least one of the plurality of virtual objects is outside of a threshold reach of the user,
wherein the at least one of the plurality of modified collision volumes is identified when the at least one of the plurality of virtual objects is outside of the threshold reach of the user.

14. An apparatus comprising:
a sensor configured to determine a position of a user within an environment; and
a processor programmed to:
determine a position of a plurality of virtual objects;
identify a plurality of collision volumes associated with the plurality of virtual objects, each of the plurality of collision volumes being associated with a respective virtual object from the plurality of virtual objects;
modify each of the plurality of collision volumes along a direction between the respective virtual object from the plurality of virtual objects and the position of the user to define a plurality of modified collision volumes;
detect a change in position of the user, wherein during the detected change in position of the user, a portion of one modified collision volume is re-aligned, and based on the re-alignment, overlaps with a portion of another modified collision volume; and
detect an interaction of the user with at least one of the plurality of modified collision volumes.

15. The apparatus of claim 14 , wherein the processor is further programmed to elongate the at least one of the plurality of modified collision volumes associated with at least one of the plurality of virtual objects at least one of toward or away from the position of the user.

16. The apparatus of claim 14 , wherein the processor is further programmed to rotate the at least one of the plurality of modified collision volumes associated with at least one of the plurality of virtual objects in response to the change in position of the user.

17. The apparatus of claim 14 , wherein the processor is further programmed to determine whether at least one of the plurality of virtual objects is outside of a threshold reach of the user, and identify the at least one of the plurality of modified collision volumes when the at least one of the plurality of virtual objects is outside of the threshold reach of the user.

18. A non-transitory machine-readable medium storing machine-readable instructions that, when executed, cause a machine to at least perform the method of claim 1 .

Assignees

• Google Inc
• Google Llc

Inventors

• Jagnow Robert Carl
• TILTON Robbie
• Prasso Luca

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T19/003

  Navigation within 3D models or images · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title