Vehicular speech recognition grammar selection based upon captured or proximity information

Patent metadata

Field	Value
Publication number	US-9487167-B2
Application number	US-201113977535-A
Country	US
Kind code	B2
Filing date	Dec 29, 2011
Priority date	Dec 29, 2011
Publication date	Nov 8, 2016
Grant date	Nov 8, 2016

Abstract

Speech recognition systems and/or techniques are provided in which grammar elements and/or speech inputs are targeted to selected functions. One or more input capture devices facilitate the collection of user input associated with a vehicle, and a vehicle function may be selected based upon received user input. A subset of available grammar elements that are associated with audible commands for the selected function may then be identified and utilized to evaluate received audio input. In this regard, speech recognition may be targeted to the selected function.

First claim

The claimed invention is:

1. A vehicle comprising:
at least one memory configured to store a plurality of grammar elements associated with audible commands for the vehicle;
at least one microphone;
at least one user input capture device, wherein the at least one user input capture device comprises a sensor that detects a proximity of an arm, a hand, or a finger of a user to a vehicle function control input element; and
one or more processors configured to:
identify, based upon information received from the sensor, a user input associated with the vehicle function control input element;
select, based at least in part upon an evaluation of the identified user input, a function associated with the vehicle function control input element, wherein the function is associated with a subset of the plurality of stored grammar elements;
receive audio input from the at least one microphone;
identify, based upon an evaluation of the received audio input, a grammar element associated with the selected function; and
output information associated with the identified grammar element.

2. The vehicle of claim 1 , wherein the identified user input comprises one of a user gesture.

3. The vehicle of claim 2 , wherein the at least one input capture device comprises at least one image capture device, and
wherein the one or more processors are further configured to receive one or more images from the at least one image capture device and determine the user gesture from the one or more images.

4. The vehicle of claim 2 , wherein the user gesture is determined based at least in part upon at least one of: tracking hand movement or determining contact or proximity of a hand or finger to a defined region within the vehicle.

5. The vehicle of claim 1 , wherein the one or more processors are further configured to initiate, based upon the identification of the user input, the receipt of audio input.

6. The vehicle of claim 1 , wherein the output information comprises one or more of a vehicle control command, a climate control command, an audio system command, a window control command, a seat control command, a display control command, a Web command, or a communications control command.

7. The vehicle of claim 1 , wherein the one or more processors are further configured to:
identify a learn new input indication;
track, based at least in part upon identifying the learn new input indication, one or more learn new user inputs; and
associate the tracked one or more learn new user inputs with a learn new input function.

8. The vehicle of claim 7 , wherein the one or more processors are further configured to:
direct an output of a prompt for a user to speak one or more words associated with a first grammar element to be associated with control of the learn new input function;
receive audio data collected in response to the prompt; and
associate at least a portion of the received audio data with the first grammar element.

9. A method comprising executing computer-executable instructions by one or more processors, the method further comprising:
storing a plurality of grammar elements associated with audible commands for a vehicle;
identifying a user input associated with the vehicle function control input element, based at least upon information received from a sensor, wherein the information is indicative of a proximity of an arm, a hand, or a finger of a user to the vehicle function control input element;
selecting, based at least in part upon an evaluation of the identified user input, a function associated with the vehicle function control input element, wherein the function is associated with a subset of the plurality of stored grammar elements;
receiving audio input from at least one audio capture device associated with the vehicle;
identifying, based upon an evaluation of the received audio input, a grammar element associated with the selected function; and
outputting information associated with the identified grammar element.

10. The method of claim 9 , wherein identifying the user input comprises identifying at least one of: a user gesture.

11. The method of claim 10 , wherein identifying the user input comprises:
receiving one or more images from at least one image capture device; and
determining, from the one or more images, the user gesture.

12. The method of claim 10 , wherein determining the user gesture comprises at least one of: determining the gesture based at least in part upon tracking hand movement or determining the gesture based at least in part upon contact or proximity of a hand or finger to a defined region within the vehicle.

13. The method of claim 9 , further comprising:
initiating, based upon the identification of the user input, the receipt of audio input.

14. The method of claim 9 , wherein outputting information comprises outputting one or more of a vehicle control command, a climate control command, an audio system command, a window control command, a seat control command, a display control command, a Web command, or a communications control command.

15. The method of claim 9 , further comprising:
identifying a learn new input indication;
tracking, based at least in part upon identifying the learn new input indication, one or more learn new user inputs; and
associating the tracked one or more learn new user inputs with a learn new input function.

16. The method of claim 15 , further comprising:
prompting a user to speak one or more words associated with a first grammar element to be associated with control of the learn new input function;
receiving audio data in response to the prompting; and
associating at least a portion of the received audio data with the first grammar element.

17. An apparatus comprising one or more processors configured to:
store a plurality of grammar elements associated with audible commands for a vehicle;
identify a user input associated with the vehicle function control input element, based at least upon information received from a sensor, wherein the information is indicative of a proximity of an arm, a hand, or a finger of a user to the vehicle function control input element;
select, based at least in part upon an evaluation of the identified user input, a function associated with the vehicle function control input element, wherein the function is associated with a subset of the plurality of stored grammar elements;
receive audio input;
identify, based upon an evaluation of the received audio input, a grammar element associated with the selected function; and
output information associated with the identified grammar element.

18. The apparatus of claim 17 , wherein the identified user input comprises at least one of a user gesture.

19. The apparatus of claim 18 , wherein the apparatus is further configured to:
receive one or more images from at least one image capture device; and
determine the user gesture from the one or more images.

20. The apparatus of claim 18 , wherein the user gesture is determined based at least in part upon one of tracking hand movement or determining contact or proximity of a hand or finger to a defined region within the vehicle.

21. The apparatus of claim 17 , wherein the apparatus is further configured to initiate, based upon the identification of the user input, the receipt of audio input.

22. The apparatus of claim 17 , wherein the output information comprises one or more of a vehicle control command, a climate control command, an audio system command, a window contro

Assignees

• Graumann David L
• Rosario Barbara
• Intel Corp

Inventors

• Graumann David L
• Rosario Barbara

Classifications

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/183

  using context dependencies, e.g. language models · CPC title

• B60W2540/21

  Voice · CPC title