Augmented reality virtual reality ray tracing sensory enhancement system, apparatus and method

Patent metadata

Field	Value
Publication number	US-12108239-B2
Application number	US-202217816960-A
Country	US
Kind code	B2
Filing date	Aug 2, 2022
Priority date	Apr 24, 2017
Publication date	Oct 1, 2024
Grant date	Oct 1, 2024

Abstract

Systems, apparatuses and methods may provide away to render augmented reality (AR) and/or virtual reality (VR) sensory enhancements using ray tracing. More particularly, systems, apparatuses and methods may provide a way to normalize environment information captured by multiple capture devices, and calculate, for an observer, the sound sources or sensed events vector paths. The systems, apparatuses and methods may detect and/or manage one or more capture devices and assign one or more the capture devices based on one or more conditions to provide observer an immersive VR/AR experience.

First claim

What is claimed is:

1. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed, cause a computing device to:
perform, by a ray tracing engine, acoustic path-tracing of a sound from a sound source of an augmented reality (AR) environment or a virtual reality (VR) environment, wherein the performance of the acoustic path-tracing comprises application of two or more filters to the sound from the sound source based on two or more of the following features: a directionality filter feature, an attenuation filter feature, or a change in wave direction filter feature to form a filtered sound associated with acoustic properties of material of surfaces within the augmented reality (AR) environment or the virtual reality (VR) environment; and
cause playback of the filtered sound to a listener as an AR sensory enhancement or a VR sensory enhancements.

2. The at least one non-transitory computer readable storage medium of claim 1 , wherein the change in wave direction filter feature comprises a reflective filter feature.

3. The at least one non-transitory computer readable storage medium of claim 1 , wherein the directionality filter feature is a relative motion filter.

4. The at least one non-transitory computer readable storage medium of claim 3 , the computing device further to:
produce a ray trace Doppler effect for an observer based on the relative motion filter.

5. The at least one non-transitory computer readable storage medium of claim 1 , wherein the performance of the acoustic path-tracing comprises application of the two or more filters to the sound from the sound source to form a filtered sound associated with a geometric environment within the augmented reality (AR) environment or the virtual reality (VR) environment.

6. A method, comprising:
performing, by a ray tracing engine, acoustic path-tracing of a sound from a sound source of an augmented reality (AR) environment or a virtual reality (VR) environment, wherein the performance of the acoustic path-tracing comprises application of two or more filters to the sound from the sound source based on one or more features to form a filtered sound associated with acoustic properties of material of surfaces within the augmented reality (AR) environment or the virtual reality (VR) environment, and wherein the one or more features comprise an attenuation filter feature; and
causing playback of the filtered sound to a listener as an AR sensory enhancement or a VR sensory enhancement.

7. The method of claim 6 , wherein the one or more features further comprise a directionality filter feature and a change in wave direction filter feature.

8. The method of claim 7 , wherein the change in wave direction filter feature comprises a reflective filter feature.

9. The method of claim 7 , wherein the directionality filter feature is a relative motion filter.

10. The method of claim 8 , further comprising:
producing a ray trace Doppler effect for an observer based on the relative motion filter.

11. The method of claim 6 , wherein the performance of the acoustic path-tracing comprises application of the two or more filters to the sound from the sound source to form the filtered sound associated with a geometric environment within the augmented reality (AR) environment or the virtual reality (VR) environment.

12. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed, cause a computing device to:
perform, by a ray tracing engine, acoustic path-tracing of a sound from a sound source of an augmented reality (AR) environment or a virtual reality (VR) environment, wherein the performance of the acoustic path-tracing comprises application of two or more filters to the sound from the sound source based on one or more features to form a filtered sound associated with acoustic properties of material of surfaces within the augmented reality (AR) environment or the virtual reality (VR) environment, and wherein the one or more features comprise an attenuation filter feature; and
cause playback of the filtered sound to a listener as an AR sensory enhancement or a VR sensory enhancement.

13. The at least one non-transitory computer readable storage medium of claim 12 , wherein the one or more features further comprise a directionality filter feature and a change in wave direction filter feature.

14. The at least one non-transitory computer readable storage medium of claim 13 , wherein the change in wave direction filter feature comprises a reflective filter feature.

15. The at least one non-transitory computer readable storage medium of claim 13 , wherein the directionality filter feature is a relative motion filter.

16. The at least one non-transitory computer readable storage medium of claim 15 , the computing device further to:
produce a ray trace Doppler effect for an observer based on the relative motion filter.

17. The at least one non-transitory computer readable storage medium of claim 12 , wherein the performance of the acoustic path-tracing comprises application of the two or more filters to the sound from the sound source to form the filtered sound associated with a geometric environment within the augmented reality (AR) environment or the virtual reality (VR) environment.

Assignees

• Intel Corp

Inventors

• Ray Joydeep
• Schluessler Travis T
• Surti Prasoonkumar
• Feit John H
• Kaburlasos Nikos
• Kwiatkowski Jacek
• Appu Abhishek R
• Holland James M
• Boles Jeffery S
• Kennedy Jonathan
• Feng Louis
• Kuwahara Atsuo
• Das Barnan
• Biswal Narayan
• Baran Stanley J
• Cilingir Gokcen
• Shah Nilesh V
• Sharma Archie
• Varerkar Mayuresh M

Classifications

• H04S2420/01

  Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• G09B21/003

  using tactile presentation of the information, e.g. Braille displays · CPC title

• G09B21/006

  using audible presentation of the information · CPC title

• G09B21/008

  using visual presentation of the information for the partially sighted · CPC title