Systems and methods for minimizing cognitive decline using augmented reality

Patent metadata

Field	Value
Publication number	US-12508394-B2
Application number	US-202017614719-A
Country	US
Kind code	B2
Filing date	May 28, 2020
Priority date	May 31, 2019
Publication date	Dec 30, 2025
Grant date	Dec 30, 2025

Abstract

An exemplary device, according to the present disclosure, provides a housing, an AR lens, a projector, a memory, and a control system. The control system and memory determine when the user is confused. The control system then provides for projecting a reorientation graphic via the projector directed at the AR lens. In some implementations, the reorientation graphic provides real time information and reminders to a user as they proceed through life. The exemplary device enables a user to maintain greater independence and a more normal lifestyle with the assistance of the reorientation graphic.

First claim

What is claimed is:

1 . A system for aiding a user in overcoming disorientation, the system comprising:
a housing configured to be coupled to a frame configured to be worn on a head of a user; an augmented reality (AR) lens coupled to the housing; a projector coupled to the housing and being configured to emit electromagnetic radiation such that the electromagnetic radiation at least partially reflects off the AR lens and is directed towards an eyeball of the user, the electromagnetic radiation being visible to the user as an augmented reality reorientation graphic; a memory storing machine-readable instructions; and a control system including one or more processors configured to execute the machine-readable instructions to:
calibrate the projector based on a location of the housing along the frame;
determine a user confusion index; and
cause the projector to emit the electromagnetic radiation such that the augmented reality reorientation graphic is visible to the user when the determined user confusion index satisfies a predetermined threshold.

2 . The system of claim 1 , further comprising a camera coupled to the housing and being configured to generate image data.

3 . The system of claim 2 , wherein the control system is further configured to estimate a movement component of the head of the user based at least in part on the generated image data, and wherein the determination of the user confusion index is based at least in part on the estimated movement component.

4 . The system of claim 1 , further comprising a motion sensor coupled to the housing and being configured to generate motion data, the motion data being indicative of movement of the head of the user.

5 . The system of claim 4 , wherein the determination of the user confusion index is based at least in part on the generated motion data.

6 . The system of claim 4 , wherein the determining the user confusion index includes estimating a movement component of the head of the user based at least in part on the generated motion data.

7 . The system of claim 6 , wherein the estimating the movement component of the head of the user includes estimating an angular velocity of the head, a frequency of movements of the head, an angular acceleration of the head, or any combination thereof.

8 . The system of claim 6 , wherein the movement component of the head of the user is indicative that the user is shaking its head, looking around, looking back and forth, or any combination thereof.

9 . The system of claim 4 , wherein the determining the user confusion index includes estimating a walking movement of the user based at least in part on the generated motion data.

10 . The system of claim 4 , wherein the motion sensor is a gyroscope or accelerometer.

11 . The system of claim 1 , wherein the housing is removable from the frame without the use of tools.

12 . The system of claim 1 , wherein the housing is permanently coupled to the frame.

13 . The system of claim 1 , wherein the augmented reality reorientation graphic includes (i) text based information that is indicative of a current mission of the user, (ii) text based information that is indicative of a reminder for the user to take a specific medication at a specific time, (iii) augmented reality directions, (iv) a current day of week, a current year, a current time of day, a current season, or any combination thereof, (v) current event information, (vi) a representation of a portion of a newspaper previously viewed by the user, (vii) social media news feed information previously viewed by the user, (viii) a representation of a portion of a website previously viewed by the user, (ix) information identifying a human in the field of view of the user by name, (x) identity information associated with the user, the identity information including a name of the user, a home address of the user, a name of a user's spouse, or any combination thereof, (xi) or any combination of (i)-(x).

14 . The system of claim 1 , further comprising:
a camera coupled to the housing and being configured to generate image data; and a motion sensor coupled to the housing and being configured to generate motion data, wherein the control system is further configured to estimate a movement component of the head of the user based at least in part on the generated image data and based at least in part on the generated motion data.

15 . The system of claim 14 , wherein the determination of the user confusion index is based at least in part on the estimated movement component.

16 . The system of claim 1 , further comprising a heart rate sensor coupled to the housing and being configured to generate heart rate data.

17 . The system of claim 16 , wherein the determination of the user confusion index is based at least in part on the generated heart rate data.

18 . The system of claim 16 , wherein the heart rate data is indicative of a heart rate of the user, a variability of heart rate of the user between breathing in and breathing out, or both.

19 . The system of claim 1 , further comprising a skin conductance sensor coupled to the housing and being configured to generate skin conductance data, wherein the determination of the user confusion index is based at least in part on the generated skin conductance data.

Assignees

• ResMed Pty Ltd

Inventors

• Perera Bodiyabaduge Dimithri Joseph
• Matthews Lisa Nicole
• Donker Clare
• Dassos Peter James
• Spink Corey Anthony
• Saunders Francis Eric

Classifications

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06F3/015

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title