Generating a sound wavefront in augmented or virtual reality systems

Patent metadata

Field	Value
Publication number	US-10186085-B2
Application number	US-201514707001-A
Country	US
Kind code	B2
Filing date	May 8, 2015
Priority date	Apr 18, 2014
Publication date	Jan 22, 2019
Grant date	Jan 22, 2019

Abstract

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

First claim

What is claimed is:

1. An augmented reality display system, comprising:
an optical apparatus to project light associated with one or more virtual objects to a user of a head-mounted augmented reality display system, wherein a perceived location of the one or more virtual objects is known, and wherein the one or more virtual objects is associated with a predetermined sound data;
a processor having at least a sound module to dynamically alter one or more parameters of the predetermined sound data based at least in part on the perceived location and movement of the one or more virtual objects in relation to the user, thereby producing a sound wavefront; and
an equalization module that equalizes sound of the sound wavefront,
wherein the predetermined sound data is associated with an audio object associated with, but located a distance from, the one or more virtual objects.

2. The augmented reality display system of claim 1 , wherein the processor determines a head pose of the user of the head-mounted augmented reality display system, and wherein the one or more parameters of the predetermined sound data is dynamically altered based at least in part on the determined head pose of the user.

3. The augmented reality display system of claim 1 , further comprising a sound design tool to dynamically alter the one or more parameters of the predetermined sound data.

4. The augmented reality display system of claim 1 , further comprising a spatial and proximity sound render to dynamically alter the one or more parameters of the predetermined sound data.

5. The augmented reality display system of claim 1 , further comprising an audio object corresponding to a further predetermined sound data, and wherein the processor dynamically alters one or more parameters of the further predetermined sound data based at least in part on a perceived location of the additional audio object, wherein the audio object is made to appear to emanate from a peripheral view or out of a field of view of the user.

6. The augmented reality display system of claim 1 , further comprising an audio object corresponding to a further predetermined sound data, and wherein the processor dynamically alters one or more parameters of the further predetermined sound data based at least in part on a perceived location of the additional audio object, wherein the perceived location corresponds to a known coordinate space of the audio object in the real world.

7. The augmented reality display system of claim 1 , wherein a spatialized sound field is rendered.

8. The augmented reality display system of claim 1 implemented as a method.

9. The augmented reality display system of claim 1 , wherein the processor renders the sound wavefront to have an echo.

10. The augmented reality display system of claim 1 , wherein the augmented reality display system further provides a plurality of autonomous navigation objects that are each independent from one another, said plurality of autonomous navigation objects including a first autonomous virtual navigation object that responds to a source of light by moving.

11. The augmented reality display system of claim 10 , wherein the augmented reality display system further provides an autonomous virtual navigation object responsive to a source of food or water.

12. The augmented reality display system of claim 1 , wherein the augmented reality display system further provides an audio or aural cue or trigger that appears to emanate from a sound source that is out of a field of view of the user to cause the user to turn in a desired direction.

13. The augmented reality display system of claim 1 , wherein the augmented reality display system dynamically adjusts microphone gain in a sound range of the sound wavefront to mix real physical features with said one or more virtual objects.

14. The augmented reality display system of claim 1 , wherein the one or more virtual objects is displayed in a virtual user interface in the form of a floating virtual screen and the augmented reality display system is responsive to user eye movement.

15. An augmented reality display system comprising:
an optical apparatus to project light associated with one or more virtual objects to a user of a head-mounted augmented reality display system, wherein a perceived location of the one or more virtual objects is known, and wherein the one or more virtual objects is associated with a predetermined sound data; and
a processor having at least a sound module to dynamically alter one or more parameters of the predetermined sound data based at least in part on the perceived location and movement of the one or more virtual objects in relation to the user, thereby producing a sound wavefront, and to dynamically alter one or more parameters of further predetermined sound data associated with an audio object associated with, but located a distance from, the one or more virtual objects,
wherein the augmented reality display system further provides a plurality of autonomous navigation objects that are each independent from one another, said plurality of autonomous navigation objects including a first autonomous virtual navigation object that responds to a source of light by moving, at least some properties of said autonomous navigation objects being adjustable.

16. The augmented reality display system of claim 15 , further comprising an equalization module that equalizes sound of the sound wavefront and the augmented reality display system providing an audio or aural cue or trigger that appears to emanate from a sound source that is out of a field of view of the user to cause the user to turn in a desired direction.

17. The augmented reality display system of claim 15 , wherein the processor renders the sound wavefront to have an echo.

18. The augmented reality display system of claim 15 , wherein the augmented reality display system further provides an autonomous virtual navigation object responsive to a source of fear or food.

19. The augmented reality display system of claim 15 , wherein the one or more virtual objects is displayed in a virtual user interface in the form of a floating virtual screen.

20. An augmented reality display system, comprising:
an optical apparatus to project light associated with one or more virtual objects to a user of a head-mounted augmented reality display system, wherein a perceived location of the one or more virtual objects is known, and wherein the one or more virtual objects is associated with a predetermined sound data;
a processor having at least a sound module to dynamically alter one or more parameters of the predetermined sound data based at least in part on the perceived location and movement of the one or more virtual objects in relation to the user, thereby producing a sound wavefront; and
an equalization module that equalizes sound of the sound wavefront,
wherein the predetermined sound data is associated with an audio object associated with, but located a distance from, the one or more virtual objects, the one or more virtual objects is displayed in a virtual user interface in the form of a floating virtual screen, the user interacts with the virtual user interface by selecting a button of the virtual user interface by squeezing a virtual icon and the augmented reality display system further provides an autonomous virtual navigation object that responds to a source of fear by moving.

Assignees

• Magic Leap Inc

Inventors

• Greco Paul M
• Miller Samuel A

Classifications

• H04S2400/15

  Aspects of sound capture and related signal processing for recording or reproduction · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• H04S7/304

  For headphones · CPC title

• G06Q30/02

  Marketing; Price estimation or determination; Fundraising · CPC title

• A63F13/577

  using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars · CPC title