Double-blinded, randomized trial of augmented reality low-vision mobility and grasp aid

Patent metadata

Field	Value
Publication number	US-2022015982-A1
Application number	US-201917298589-A
Country	US
Kind code	A1
Filing date	Dec 2, 2019
Priority date	Nov 30, 2018
Publication date	Jan 20, 2022
Grant date	—

Abstract

An augmented reality system for providing depth perspective includes a sensor system that provides spatial data of objects in a surrounding environment of a user. A computer processor system calculates spatial information of the objects from the spatial data received the sensor system. The computer processor system determines a depth-to-color mapping in which distance of objects from the user is mapped to a predetermined viewable representation. The system also includes a head mountable display that displays the depth-to-color mapping to the user. Characteristically, distances of the objects from the user are rendered to allow at least partial viewability of the object by the user. A method utilizing the augmented reality system is also provided.

First claim

What is claimed is:

1 . An augmented reality system for providing depth perspective to a user, the augmented reality system comprising:
a sensor system that provides spatial data of objects in a surrounding environment of the user; a computer processor system that calculates spatial information of the objects from the spatial data received from the sensor system, the computer processor system determining a depth-to-color mapping in which distance of objects from the user is mapped to a predetermined viewable representation; and a head-mountable display that displays the depth-to-color mapping to the user, wherein distances of the objects from the user are rendered to allow at least partial viewability of the object by the user.

2 . The augmented reality system of claim 1 where the depth-to-color mapping assists in identifying objects.

3 . The augments reality system of claim 1 wherein the sensor system and the head-mountable display are integrated into a single device.

4 . The augments reality system of claim 1 wherein the sensor system, the computer processor system and the head-mountable display are integrated into a single device.

5 . The augments reality system of claim 1 wherein the sensor system and the head-mountable display are integrated into a first device and the computer processor system being a separate device in communication with the first device.

6 . The augments reality system of claim 1 wherein the predetermined viewable representation is selected from the group consisting of pseudocolor map, a frequency map in which there are different frequencies for different distances, a brightness map in which there are different brightness for different distances, size map in which closer objects are bigger, and combinations thereof.

7 . The augments reality system of claim 1 wherein the predetermined viewable representation is a predetermined color.

8 . The augmented reality system of claim 7 wherein the depth-to-color mapping in which distances of the objects from the user is mapped to a colored wireframe with edge-enhancement.

9 . The augmented reality system of claim 7 wherein the predetermined color is a pseudocolor or false-color with a plurality of discrete color changes based on distance from the user.

10 . The augmented reality system of claim 9 wherein the plurality of discrete color changes includes from 3 to 10 color changes.

11 . The augmented reality system of claim 1 wherein the sensor system includes at least one electromagnetic sensor, optical sensor, or video sensor.

12 . The augmented reality system of claim 1 wherein the sensor system includes a plurality of electromagnetic, optical or video sensors.

13 . The augmented reality system of claim 12 wherein spatial data from the plurality of electromagnetic, optical or video sensors is analyzed by sensor fusion to provide the spatial information.

14 . The augmented reality system of claim 1 wherein the sensor system includes a plurality of electromagnetic, optical or video sensors.

15 . The augmented reality system of claim 1 wherein the sensor system includes a depth camera.

16 . The augmented reality system of claim 15 wherein the sensor system includes at least one greyscale environment sensing camera that works with the depth camera to track the surrounding environment.

17 . The augmented reality system of claim 1 wherein the sensor system includes a video camera and a light sensor.

18 . The augmented reality system of claim 1 wherein the computer processor system includes a CPU, GPU, and optionally a custom chipset, application-specific integrated chip, HPU, or other integrated chip.

19 . A method for providing depth perspective to a user, the method comprising:
receiving spatial data for objects in a surrounding environment of the user; calculating spatial information of the objects from spatial data, the spatial information including a depth-to-color mapping in which distance of objects from the user is mapped to a predetermined viewable representation; and displaying the depth-to-color mapping to the user on a head-mountable display wherein distances of the objects from the user are rendered to allow at least partial viewability of the objects by the user.

20 . The method of claim 19 wherein the predetermined viewable representation is selected from the group consisting of pseudocolor map, a frequency map in which there are different frequencies for different distances, a brightness map in which there are different brightness for different distances, size map in which closer objects are bigger, and combinations thereof.

21 . The method of claim 19 wherein the depth-to-color mapping assists in object identification.

22 . The method of claim 19 wherein the predetermined viewable representation is a predetermined color.

23 . The method of claim 22 wherein the depth-to-color mapping is such that distances of the objects from the user is mapped to a colored wireframe with edge-enhancement.

24 . The method of claim 22 wherein the predetermined color is a pseudocolor or false-color with a plurality of discrete color changes based on distance from the user.

25 . The method of claim 23 wherein the plurality of discrete color changes includes from 3 to 10 color changes.

Assignees

• Univ Southern California

Inventors

• Humayun Mark S
• Angelopoulos Anastasios

Classifications

• G06T7/90

  Determination of colour characteristics · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B2027/0127

  comprising devices increasing the depth of field · CPC title

• G02B27/0101

  characterised by optical features (G02B27/0172 takes precedence) · CPC title

• A61H2201/165

  Wearable interfaces · CPC title