Apparatus and methods for converting user input accurately to a particular system function

Patent metadata

Field	Value
Publication number	US-10198696-B2
Application number	US-201514611625-A
Country	US
Kind code	B2
Filing date	Feb 2, 2015
Priority date	Feb 4, 2014
Publication date	Feb 5, 2019
Grant date	Feb 5, 2019

Abstract

An apparatus for use in adjusting a controllable system based on a user-communication input, such as non-detailed or indiscriminate input. The apparatus includes a processor and a computer-readable storage medium comprising instructions that, when executed by the processor, cause the processor to perform operations for determining an objective system command, corresponding to the user input, for use in adjusting the controllable system.

First claim

What is claimed is:

1. An apparatus, for implementation at a vehicle, comprising:
a vehicle processing unit; and
a non-transitory computer-readable storage device comprising:
an input module that, when executed by the vehicle processing unit, receives, from a microphone, user-communication data including user-indiscriminate-utterance data indicating an indiscriminate utterance, not including words, received at the microphone from a user and receives, from a sensor, context data indicating a state of a vehicle system;
an interpretation module that, when executed by the vehicle processing unit, interprets the user-indiscriminate-utterance data of the user-communication data and the context data, yielding an interpretation output identifying a user need indicated by the user-indiscriminate-utterance data of the user-communication data and the context data;
an analysis module comprising:
a goal-recognizer module that, when executed by the vehicle processing unit, generates, based on the interpretation output and user-specific data representing a user condition, a subjective system output indicating a manner by which to adjust a controllable vehicle system to achieve the user need identified; and
a translation module that, when executed by the vehicle processing unit, generates, based on the subjective system output, an objective system command for use in adjusting the controllable vehicle system toward meeting the user need identified; and

an activity-execution module that, when executed by the vehicle processing unit, executes the objective system command by adjusting the controllable vehicle system, based on the objective system command, toward meeting the user need indicated by the user indiscriminate utterance sensed by the microphone.

2. The apparatus of claim 1 , wherein:
at least one of the interpretation module, the goal-recognizer module, and the translation module processes non-gesture context data to yield module output; and
the non-gesture context data includes environmental data indicating a characteristic of an environment at or proximate the controllable vehicle system.

3. The apparatus of claim 1 , wherein:
at least one of the interpretation module, the goal-recognizer module, and the translation module processes non-gesture context data to yield module output; and
the non-gesture context data indicates a user-specific characteristic.

4. The apparatus of claim 3 , wherein:
the user-specific characteristic is indicated by user-specific profile data received from a user-model database; and
the user-model database includes various user-specific profile data corresponding respectively to each of multiple users.

5. The apparatus of claim 1 , wherein:
one or more modules of the non-transitory computer-readable storage device comprise feedback-based-learning code that, when executed by the vehicle processing unit:
generates, based in interactions with the user, learned user information; and
stores the learned user information for use to improve subsequent apparatus operation; and

one or more modules of the non-transitory computer-readable storage device uses the learned user information later to improve the subsequent apparatus operation.

6. The apparatus of claim 5 , wherein:
the objective system command is a first objective system command;
in operation of the apparatus, the interactions with the user comprise interactions after the translation module, when executed by the vehicle processing unit, generates the first objective system command; and
the translation module, when executed by the vehicle processing unit in the subsequent apparatus operation, uses the learned use information in generating a second objective system comment.

7. The apparatus of claim 1 wherein the user-communication data comprises the indiscriminate utterance, which does not include any words, or includes at least a portion of one word.

8. An apparatus, for implementation at a vehicle, comprising:
a vehicle processing unit; and
a non-transitory computer-readable storage device comprising:
an input module that, when executed by the vehicle processing unit:
receives, from a tangible, hardware-based, sensor, user-indiscriminate-communication data indicating an indiscriminate user communication, not including words;
receives, from the user, non-gesture context data; and
receives, from a vehicle sensor, vehicle context data indicating a state of a vehicle system;

an interpretation module that, when executed by the vehicle processing unit, interprets the user-indiscriminate-communication data, non-gesture context data, and vehicle context data, yielding an interpretation output identifying a user need indicated by the user-indiscriminate-communication data, non-gesture context data, and vehicle context data;
an analysis module comprising:
a goal-recognizer module that, when executed by the vehicle processing unit, generates, based on the interpretation output and user-specific data representing a user condition, a subjective system output indicating a manner by which to adjust a controllable vehicle system to achieve the user need identified; and
a translation module that, when executed by the vehicle processing unit, generates, based on the subjective system output, an objective system command for use in adjusting the controllable vehicle system toward meeting the user need identified; and

an activity-execution module that, when executed by the vehicle processing unit, executes the objective system command by adjusting the controllable vehicle system, based on the objective system command, toward meeting the user need indicated by the user-indiscriminate-communication data generated by the tangible, hardware-based, sensor.

9. The apparatus of claim 8 , wherein the non-gesture context data indicates one or both of:
a characteristic of an environment at or proximate the controllable vehicle system; and
a user-specific characteristic.

10. The apparatus of claim 8 , wherein:
the non-gesture context data indicates a user-specific characteristic;
the user-specific characteristic is, in operation of the apparatus, obtained from a user-specific profile of a user-model database;
the user-specific profile is a first user-specific profile; and
the user-model database comprises multiple distinct user-specific profiles, including the first user-specific profile, corresponding to various users.

11. The apparatus of claim 8 , wherein the user-indiscriminate-communication data comprises an indiscriminate utterance, which does not include any words, or includes at least a portion of one word.

12. An apparatus, for implementation at a vehicle, comprising:
a vehicle processing unit; and
a non-transitory computer-readable storage device comprising:
an input module that, when executed by the vehicle processing unit:
receives, from a tangible, hardware-based, sensor, user-indiscriminate-communication data indicating an indiscriminate user communication, not including words;
receives prior-learned user data, generated based on a prior user interaction with the apparatus; and
receives, from a vehicle sensor, vehicle context data indicating a state of a vehicle system;

an interpretation module that, when executed by the vehicle processing unit, interprets, based on the prior-learned user data, the user-indiscriminate-communication data, and vehicle context data yielding an interpretation output identifying a user need indicated by the user-indiscriminate-communication data and vehicle context data;
an analysis module comprising:
a goal-recognizer module that, when executed by the vehicle processing unit, generates, based on the interpretation output and

Assignees

• Gm Global Tech Operations Llc

Inventors

• Goldman-Shenhar Claudia V
• Degani Asaf
• Deutsch Omer
• Stelzer Sean Richard
• Grost Timothy J

Classifications

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• G06K9/00355

  Physics · mapped topic

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G06N99/005 Primary

  Physics · mapped topic