User adjustment interface using remote computing resource

Patent metadata

Field	Value
Publication number	US-10129664-B2
Application number	US-201615130020-A
Country	US
Kind code	B2
Filing date	Apr 15, 2016
Priority date	Apr 15, 2015
Publication date	Nov 13, 2018
Grant date	Nov 13, 2018

Abstract

Disclosed herein, among other things, are systems and methods for a user adjustment interface using remote computing resources. Specifically, a system can include a mobile device in communication with a hearing assistance device or a remote server. The mobile device can interpret an acoustic environment and send information about the environment to a remote server. The remote server can determine and send information to the mobile device for use in a user interface. The mobile device can receive a user selection of hearing assistance parameter information to be sent to the hearing assistance device.

First claim

What is claimed is:

1. A mobile device for adjusting hearing assistance parameters, the mobile device comprising:
a processor configured to:
interpret environmental sound to determine an acoustic feature vector;
send the acoustic feature vector to a remote server;
receive information for use in a user interface of the mobile device from the remote server based on a machine learning trained classification of the acoustic feature vector, the information including user interface components corresponding to the classification;
receive a user selection of one of the user interface components identifying hearing assistance parameter information on the user interface from the information for use in the user interface; and
prepare the selected hearing assistance parameter information for sending to a hearing assistance device.

2. The mobile device of claim 1 , further comprising a microphone connected to the processor, the microphone configured to receive the environmental sound.

3. The mobile device of claim 1 , further comprising a transceiver connected to the processor, the transceiver configured to send the selected hearing assistance parameter information to the hearing assistance device.

4. The mobile device of claim 1 , wherein to interpret environmental sound, the processor is configured to extract features from the environmental sound.

5. The mobile device of claim 4 , wherein the information for use in the user interface includes environment classifications based on the extracted features.

6. The mobile device of claim 1 , wherein the processor is configured to interpret the environmental sound in response to receiving a user initialization.

7. The mobile device of claim 1 , wherein the selected hearing assistance parameter information includes at least one of a selected parameter, a parameter change, or a set of visual coordinates.

8. The mobile device of claim 1 , wherein to receive the user selection includes to receive a user touch input including a movement on a touch screen, the touch screen coupled to the processor.

9. The mobile device of claim 8 , wherein the movement is in a pre-defined space on the touch screen.

10. The mobile device of claim 1 , wherein information for use in the user interface is determined using at least one of a user adjustment to the hearing assistance device, a volume control adjustment, geolocation information, or navigation data.

11. The mobile device of claim 1 , wherein the selected hearing assistance parameter information modifies a default setting of the hearing assistance device.

12. The mobile device of claim 1 , wherein the processor is further configured to send the selected hearing assistance parameter information to the remote server.

13. The mobile device of claim 12 , wherein the processor is configured to:
send a second acoustic feature vector to the remote server; and
automatically receive, in response to sending the second acoustic feature vector, the selected hearing assistance parameter information from the remote server when the second acoustic feature vector includes information identifiable from the acoustic feature vector.

14. A method for adjusting hearing assistance parameters, the method comprising:
interpreting, at a mobile device, environmental sound to determine an acoustic feature vector;
sending, from the mobile device, the acoustic feature vector to a remote server;
receiving, at the mobile device, information for use in a user interface of the mobile device from the remote server based on a machine learning trained classification of the acoustic feature vector, the information including user interface components corresponding to the classification;
receiving, on the user interface, a user selection of one of the user interface components identifying hearing assistance parameter information from the information for use in the user interface; and
sending, from the mobile device, the selected hearing assistance parameter information to a hearing assistance device.

15. The method of claim 14 , wherein interpreting the environmental sound includes extracting features from the environmental sound, and wherein the information for use in the user interface includes environment classifications based on the extracted features.

16. The method of claim 14 , wherein receiving the user selection includes receiving a user touch input including a movement on a touch screen of the mobile device.

17. At least one non-transitory machine-readable medium including instructions for receiving information, which when executed by a machine, cause the machine to:
interpret environmental sound to determine an acoustic feature vector;
send the acoustic feature vector to a remote server;
receive information for use in a user interface of a mobile device from the remote server based on a machine learning trained classification of the acoustic feature vector, the information including user interface components corresponding to the classification;
receive a user selection of one of the user interface components identifying hearing assistance parameter information on the user interface from the information for use in the user interface; and
send the selected hearing assistance parameter information to a hearing assistance device.

18. The at least one machine-readable medium of claim 17 , wherein the information for use in the user interface is determined using at least one of a user adjustment to the hearing assistance device, a volume control adjustment, geolocation information, or navigation data.

19. The at least one machine-readable medium of claim 17 , wherein the information for use in the user interface includes voice identification information, the voice identification information identifying a voice in the environmental sound and further comprising sending the selected hearing assistance parameter information to the remote server.

20. The mobile device of claim 1 , wherein the machine learning trained classification is trained using an artificial neural network.

Assignees

• Starkey Labs Inc

Inventors

• Fitz Kelly
• Klobe Kirk
• Haggerty David

Classifications

• H04R25/558 Primary

  Remote control, e.g. of amplification, frequency · CPC title

• H04R25/507

  implemented by neural network or fuzzy logic · CPC title

• H04R2225/55

  Communication between hearing aids and external devices via a network for data exchange · CPC title

• H04R25/70

  Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting · CPC title

• H04R29/004

  for microphones (H04R29/007 takes precedence) · CPC title