Augmenting reality

Patent metadata

Field	Value
Publication number	US-2023364424-A1
Application number	US-202118041029-A
Country	US
Kind code	A1
Filing date	Aug 13, 2021
Priority date	Aug 14, 2020
Publication date	Nov 16, 2023
Grant date	—

Abstract

Disclosed examples include monitoring consumption behavior of a recipient of a sensory prosthesis (e.g., a cochlear implant). The sensory prosthesis identifies specific sounds (e.g., the sounds of vomiting, snoring, opening a beer bottle, lighting a cigarette, or taking medication from a blister, among others) or visuals and record data regarding the frequency, timing, intensity, or other characteristics of the behavior. The recorded data can then be analyzed by the recipient or caregivers. The sensory prosthesis further adjusts its sensory output to enhance, degrade, or otherwise modify the recipient's perception of the consumption behavior.

First claim

1 . A method comprising:
detecting a consumption behavior of a recipient of a sensory prosthesis; and adjusting stimulation provided by the sensory prosthesis to adjust the consumption behavior.

2 . The method of claim 1 , wherein detecting the consumption behavior includes:
receiving consumption behavior indicia from one or more sensors; and processing the consumption behavior indicia to detect the consumption behavior.

3 . The method of claim 2 , wherein obtaining consumption behavior indicia from one or more sensors includes:
receiving auditory indicia of the consumption behavior with an implanted microphone.

4 . The method of claim 2 , wherein obtaining consumption behavior indicia from one or more sensors includes:
receiving motion indicia of the consumption behavior with a motion detector.

5 . The method of claim 1 , wherein adjusting the stimulation provided by the sensory prosthesis to adjust the consumption behavior includes:
selecting stimulation that enhances a pleasurability of the consumption behavior; selecting stimulation that decreases a pleasurability of the consumption behavior; or selecting stimulation that otherwise alters the consumption behavior.

6 . The method of claim 1 , further comprising:
logging the consumption behavior; and presenting the logged consumption behavior.

7 . The method of claim 1 , wherein detecting the consumption behavior includes detecting the consumption behavior responsive to detecting a specific sensory input.

8 . The method of claim 1 ,
wherein the consumption behavior is at least one of an eating behavior, a drinking behavior, a vaping behavior, or a smoking behavior.

9 . A system comprising:
a sensory prosthesis of a recipient; a microphone; a movement sensor; and a computing device configured to:
receive, from the microphone and the movement sensor, consumption behavior indicia regarding the recipient;
determine a consumption behavior of the recipient based on the consumption behavior indicia; and
act on the determined behavior to adjust the consumption behavior.

10 . The system of claim 9 , wherein to determine the consumption behavior based on the consumption behavior indicia includes to:
apply an artificial intelligence framework to the consumption behavior indicia; and determine the behavior based on an output of the artificial intelligence framework.

11 . The system of claim 10 , wherein the artificial intelligence framework is a machine learning framework trained on consumption behaviors.

12 . The system of claim 9 , wherein to act on the determined consumption behavior includes to:
provide a message to the recipient, the message including an indication of the consumption behavior; or adjust a stimulation provided by the sensory prosthesis.

13 . The system of claim 9 , wherein to receive the consumption behavior indicia regarding the recipient of the sensory prosthesis includes to:
receive auditory indicia from the microphone; and receive hand movement indicia or head movement indicia from the movement sensor.

14 . The system of claim 9 , wherein the microphone is an implanted microphone.

15 . The system of claim 9 ,
wherein to receive the consumption behavior indicia regarding the recipient of the sensory prosthesis includes to: receive data from a location sensor, a manual input, a scene classifier, a glucose sensor, an alcohol sensor, a blood oxygen sensor, a near field communication sensor, or a financial transaction monitor.

16 . A computer-readable medium having instructions stored thereon that, when executed by one or more processors cause the one or more processors to:
log a consumption behavior by a recipient of a sensory prosthesis based on data obtained by the sensory prosthesis; and display information regarding the consumption behavior.

17 . The computer-readable medium of claim 16 , wherein the instructions further cause the one or more processors to:
receive the data from the sensory prosthesis; and determine the consumption behavior based on the received data.

18 . The computer-readable medium of claim 17 , wherein to determine the consumption behavior based on the received data includes to:
apply an artificial intelligence framework to the data from the sensory prosthesis; and determine the consumption behavior based on an output of the artificial intelligence framework.

19 . The computer-readable medium of claim 16 , wherein the instructions further cause the one or more processors to:
adjust sensory output of the sensory prosthesis responsive to a sensory input to at least one of encourage, discourage, or adjust the consumption behavior of the recipient of the sensory prosthesis.

20 . The computer-readable medium of claim 16 , wherein the instructions further cause the one or more processors to provide a message to the recipient, the message including an indication of the consumption behavior.

Assignees

• Cochlear Ltd

Inventors

• Feeney Nicholas
• Andersson Marcus
• Oplinger Kenneth

Classifications

• G16H20/60

  relating to nutrition control, e.g. diets · CPC title

• A61N1/36139 Primary

  with automatic adjustment · CPC title

• A61N1/36038

  Cochlear stimulation · CPC title

• G16H40/67

  for remote operation · CPC title

• G16H20/30

  relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising · CPC title