Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions

Patent metadata

Field	Value
Publication number	US-11049326-B2
Application number	US-202016902141-A
Country	US
Kind code	B2
Filing date	Jun 15, 2020
Priority date	Jun 20, 2016
Publication date	Jun 29, 2021
Grant date	Jun 29, 2021

Abstract

In some embodiments, a display system comprising a head-mountable, augmented reality display is configured to perform a neurological analysis and to provide a perception aid based on an environmental trigger associated with the neurological condition. Performing the neurological analysis may include determining a reaction to a stimulus by receiving data from the one or more inwardly-directed sensors; and identifying a neurological condition associated with the reaction. In some embodiments, the perception aid may include a reminder, an alert, or virtual content that changes a property, e.g. a color, of a real object. The augmented reality display may be configured to display virtual content by outputting light with variable wavefront divergence, and to provide an accommodation-vergence mismatch of less than 0.5 diopters, including less than 0.25 diopters.

First claim

We claim:

1. An augmented reality display system comprising:
a head-mountable display configured to:
transmit light from an ambient environment to allow a view of the ambient environment; and
output light with different amounts of wavefront divergence to display virtual content on a plurality of depth planes;

one or more outwardly-directed sensors;
one or more processors; and
one or more computer storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
providing a therapy to a wearer of the head-mountable display by:
monitoring an ambient environment by receiving data from the one or more outwardly-directed sensors;
detecting the presence of a stimulus associated with an identified neurological condition of the wearer based on the data received from the one or more outwardly-directed sensors; and
providing a perception aid associated with the identified neurological condition based on the detected presence of the stimulus.

2. The augmented reality display system of claim 1 , wherein the perception aid comprises virtual content displayed in response to the presence of the environmental trigger.

3. The augmented reality display system of claim 1 , wherein the neurological condition is part of a user profile corresponding to the wearer, wherein the perception aid is selected based at least in part on the user profile.

4. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors are configured to detect one or more of objects, stimuli, people, animals, and locations.

5. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise a camera.

6. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise one or more of an altimeter and a barometer.

7. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise one or more of a chemical sensor, a humidity sensor, and a temperature sensor.

8. The augmented reality display system of claim 1 , wherein the outwardly-directed sensors comprise one or more of an external microphone and a thermal imaging sensor.

9. The augmented reality display system of claim 1 , wherein the operations further comprise:
monitoring a status of the identified neurological condition on a daily basis; and
automatically repeating the therapy in response to detected stimuli a plurality of times,
wherein automatically repeating the therapy comprises updating the therapy based on the status of the identified neurological condition.

10. The augmented reality display system of claim 1 , wherein the operations further comprise transmitting an indication of the detection of the presence of the stimulus to a plurality of other display systems.

11. The augmented reality display system of claim 1 , wherein the operations further comprise providing an alert to the wearer that the perception aid is being provided.

12. The augmented reality display system of claim 1 , wherein the display is configured to output virtual content with an accommodation-vergence mismatch of less than 0.25 diopters for each of the depth planes.

13. A method performed by a display system comprising one or more processors, one or more outwardly-directed sensors, and a head-mounted display, the method comprising:
providing a therapy by:
monitoring an ambient environment around a user by collecting data from the one or more outwardly-directed sensors;
detecting the presence of a stimulus associated with an identified neurological condition of the user based on monitoring the data collected from the one or more outwardly-directed sensors; and
providing a perception aid associated with the identified neurological condition based on the detected presence of the stimulus.

14. The method of claim 13 , wherein the perception aid comprises virtual content displayed in response to the presence of the environmental trigger.

15. The method of claim 13 , further comprising automatically repeating the therapy a plurality of times on a daily basis and updating the therapy based on monitoring a status of the identified neurological condition.

16. The method of claim 13 , wherein providing the perception aid comprises displaying visual content to the user via the head-mounted display.

17. The method of claim 13 , wherein detecting the presence of the stimulus comprises detecting one or more of objects, people, and animals with the outwardly-directed sensors.

18. The method of claim 13 , wherein detecting the presence of the stimulus comprises detecting one or more environmental conditions with the outwardly-directed sensors.

19. The method of claim 13 , wherein detecting the presence of the stimulus comprises detecting a location with the outwardly-directed sensors.

20. The method of claim 13 , wherein the outwardly-directed sensors comprise a camera.

21. The method of claim 13 , wherein the outwardly-directed sensors comprise one or more of an altimeter and a barometer.

22. The method of claim 13 , wherein the outwardly-directed sensors comprise one or more of a chemical sensor, a humidity sensor, and a temperature sensor.

23. The method of claim 13 , wherein the outwardly-directed sensors comprise one or more of an external microphone and a thermal imaging sensor.

Assignees

• Magic Leap Inc

Inventors

• Samec Nicole Elizabeth
• Harrises Christopher M
• Baerenrodt Mark
• Mangiat Stephen Vincent
• Robaina Nastasja U
• Wright Adam Carl

Classifications

• A61B5/163

  by tracking eye movement, gaze, or pupil change · CPC title

• G02B2027/0105

  Holograms with particular structures · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B27/017

  Head mounted · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title