Systems and methods for generating sound wavefronts in augmented or virtual reality systems

Patent metadata

Field	Value
Publication number	US-9852548-B2
Application number	US-201514706891-A
Country	US
Kind code	B2
Filing date	May 7, 2015
Priority date	Apr 18, 2014
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

First claim

What is claimed is:

1. A method of displaying augmented reality, comprising:
determining a head pose of a user of a head-mounted virtual or augmented reality display system;
determining a perceived location, in a passable real world model, of a virtual object to be associated with an audio object in relation to the head pose of the user, wherein the audio object corresponds to predetermined sound data, and the passable real world model shares at least an interaction of the user with one or more other users;
reducing computational resource utilization at least by identifying a plurality of object recognizers in a ring topology;
dynamically altering one or more parameters of the predetermined sound data based at least in part on the perceived location of the virtual object to be associated with the audio object in relation to the head pose of the user; and
generating a visual trigger for signaling a head movement to the user toward the virtual object and presenting the visual trigger within a field of view of the user with the virtual or augmented reality display system that transmits light signals of the virtual object associated with the audio object to at least one eye of the user.

2. The method of claim 1 , wherein the audio object is associated with the virtual object.

3. The method of claim 2 , wherein the audio object is proximate to the virtual object.

4. The method of claim 2 , wherein the audio object is at a distance from the virtual object.

5. The method of claim 1 , wherein the one or more parameters pertains to a direction in which a sound signal emanates.

6. The method of claim 1 , wherein the one or more parameters pertains to an intensity of a sound signal.

7. The method of claim 1 , wherein the sound data is equalized.

8. The method of claim 1 , wherein the one or more parameters pertains to a quality of sound signals.

9. The method of claim 1 , further comprising selecting another sound data to accompany the sound data based at least in part on the perceived location of the audio object in relation to the head pose of the user.

10. The method of claim 9 , wherein the audio object is associated with the virtual object.

11. The method of claim 1 , further comprising:
identifying a space transfer function; and
transforming the predetermined sound data into transformed sound data at least by applying the space transfer function to the predetermined sound data based in part or in whole upon the head pose or information about the virtual object.

12. The method of claim 1 , further comprising:
identifying the perceived location of the virtual object; and
placing the audio object at the perceived location of the virtual object in relation to the head pose of the user.

13. The method of claim 1 , further comprising:
identifying the perceived location of the virtual object; and
placing the audio object in relation to the virtual object based in part or in whole upon the head pose of the user.

14. The method of claim 13 , further comprising:
associating the virtual object with the audio object so that the audio object is perceived by the user to emanate from the virtual object; and
identifying the passable real world model including one or more scenes of a real world environment that further includes one or more physical objects.

15. The method of claim 14 , further comprising:
rendering an augmented or virtual reality environment including the virtual object and the one or more physical objects; and
projecting, with the head-mounted virtual or augmented reality display system, light beams corresponding to the augmented or virtual reality environment to the at least one eye of a user based in part or in whole upon the head pose of the user to allow the user to interact with the virtual object and the one or more physical objects in the virtual or augmented reality environment.

16. The method of claim 15 , further comprising:
organizing the plurality of object recognizers in the ring topology; and
processing data for the passable real world model by using the plurality of object recognizers.

17. The method of claim 16 , further comprising:
storing the data relevant to one or more objects recognized by an object recognizer of the plurality of object recognizers for the one or more objects.

18. The method of claim 1 , wherein the virtual object includes a different user interacting with the virtual or augmented reality environment with the virtual or augmented reality display system.

19. A system for displaying augmented reality, comprising:
one or more sensors or transducers configured to capture information about a user;
a processor coupled to the one or more sensors or transducers and configured to determine a head pose of a user of a head-mounted virtual or augmented reality display system;
the processor further configured to determine a perceived location in a passable real world model of a virtual object to be associated with an audio object in relation to the head pose of the user, wherein the audio object corresponds to predetermined sound data, and the passable real world model shares at least an interaction of the user with one or more other users;
the processor further configured to reduce computational resource utilization at least by identifying a plurality of object recognizers in a ring topology;
one or more sound modules in the processor configured to dynamically alter one or more parameters of the predetermined sound data based at least in part on the perceived location of the virtual object to be associated with the audio object in relation to the head pose of the user; and
the processor operatively coupled to one or more optical components and configured generate a visual trigger for signaling a head movement to the user and presenting the visual trigger within a field of view of the user with the virtual or augmented reality display system that transmits light signals of the virtual object associated with the audio object to at least one eye of the user.

Assignees

• Magic Leap Inc

Inventors

• Greco Paul M
• Miller Samuel A

Classifications

• H04S2400/15

  Aspects of sound capture and related signal processing for recording or reproduction · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• H04S7/304

  For headphones · CPC title

• G06Q30/02

  Marketing; Price estimation or determination; Fundraising · CPC title

• A63F13/577

  using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars · CPC title