Audio command intent determination system and method

Patent metadata

Field	Value
Publication number	US-2016004501-A1
Application number	US-201414321562-A
Country	US
Kind code	A1
Filing date	Jul 1, 2014
Priority date	Jul 1, 2014
Publication date	Jan 7, 2016
Grant date	—

Abstract

Methods and apparatus are provided for generating aircraft cabin control commands from verbal speech onboard an aircraft. An audio command supplied to an audio input device is processed. Each word of the processed audio command is compared to words stored in a vocabulary map to determine a word type of each word. Each determined word type is processed to determine if an intent of the audio command is discernable. If the intent is discernable, an aircraft cabin control command is generated based on the discerned intent. If a partial intent is discernable, feedback is generated.

First claim

What is claimed is:

1 . A method of generating aircraft cabin control commands from verbal speech onboard an aircraft, comprising the steps of:
processing an audio command supplied to an audio input device, the audio command including at least one word; comparing each word of the processed audio command to words stored in a vocabulary map to determine a word type of each word, the vocabulary map comprising a predetermined set of word types; and processing each determined word type to determine if an intent of the audio command is discernable; if the intent is discernable, generating an aircraft cabin control command based on the discerned intent; and generating feedback if no or only a partial intent of the audio command is discernable.

2 . The method of claim 1 , wherein the step of processing each determined word type to determine if the intent of the audio command is discernable comprises:
determining if the audio command includes at least a context word type and an action word type; identifying an anchor node in a normalized intent rules tree structure that corresponds to the context word type; determining if the action word type is associated with the anchor node and, if so, determining the intent therefrom.

3 . The method of claim 2 , wherein the normalized intent rules tree structure comprises:
a root node, the root node associated with the aircraft; a plurality of context nodes, each context node corresponding to a context word type and serving as an anchor node that has a plurality of non-anchor nodes associated therewith, wherein each non-anchor node corresponds to a word type that is not a context word type.

4 . The method of claim 3 , wherein each non-anchor node is one of at least an action node, a location node, a source node, a destination node, a unit node, and a value node.

5 . The method of claim 3 , wherein each anchor node and each non-anchor node comprises a set of attributes, each attribute representative of information present in words that correspond to each anchor node and each non-anchor node.

6 . The method of claim 5 , wherein the set of attributes comprises one or more of equivalent words, a command identification, a command mask value, a transform function, range values, and assistance media files.

7 . The method of claim 1 , wherein the step of processing the audio command comprises:
supplying the audio command to a speech recognizer; implementing, in the speech recognizer, an N-best hypothesis algorithm to generate one or more words for each word of the audio command; and hashing each of the one or more words generated by the N-best hypothesis generator to thereby generate a hash value for each of the one or more words.

8 . The method of claim 1 , further comprising:
generating an intent map for each word by representing each word as a plurality of bits, each bit representative of a different one of the predetermined number of word types.

9 . The method of claim 1 , wherein the predetermined set of word types comprises context words, action words, location words, source words, destination words, unit words, and value words.

10 . A system for generating aircraft cabin control commands from verbal speech onboard an aircraft, the system comprising:
an audio input device adapted to receive an audio command and configured, upon receipt thereof, to supply speech signals representative thereof, the audio command including at least one word; memory having a vocabulary map stored therein, the vocabulary map comprising a predetermined set of word types; and a processor in operable communication with the audio input device and the memory, the processor coupled to receive the speech signals and configured, upon receipt thereof, to:
compare each word of the received audio command to words stored in the vocabulary map to determine a word type of each word,
determine, from each determined word type, if an intent of the audio command is discernable,
if the intent is discernable, generate an aircraft cabin control command based on the discerned intent, and
generate feedback if no or only a partial intent of the audio command is discernable.

11 . The system of claim 10 , wherein the processor is configured to determine if the intent of the audio command is discernable by:
determining if the audio command includes at least a context word type and an action word type; identifying an anchor node in a normalized intent rules tree structure that corresponds to the context word type; determining if the action word type is associated with the anchor node and, if so, determining the intent therefrom.

12 . The system of claim 11 , wherein the normalized intent rules tree structure comprises:
a root node, the root node associated with the aircraft; a plurality of context nodes, each context node corresponding to a context word type and serving as an anchor node that has a plurality of non-anchor nodes associated therewith, wherein each non-anchor node corresponds to a word type that is not a context word type.

13 . system of claim 12 , wherein each non-anchor node is one of at least an action node, a location node, a source node, a destination node, a unit node, and a value node.

14 . The system of claim 12 , wherein each anchor node and each non-anchor node comprises a set of attributes, each attribute representative of information present in words that correspond to each anchor node and each non-anchor node.

15 . The system of claim 14 , wherein the set of attributes comprises one or more of equivalent words, a command identification, a command mask value, a transform function, range values, and assistance media files.

16 . The system of claim 10 , wherein the processor comprises:
a speech recognizer adapted to receive the audio command, the speech recognizer configured to (i) supply implement an N-best hypothesis algorithm to generate one or more words for each word of the audio command and (ii) hash each of the one or more words generated by the N-best hypothesis generator to thereby generate a hash value for each of the one or more words.

17 . The system of claim 10 , wherein the processor is further configured to generate an intent map for each word by representing each word as a plurality of bits, each bit representative of a different one of the predetermined number of word types.

18 . The system of claim 10 , wherein the predetermined set of word types comprises context words, action words, location words, source words, destination words, unit words, and value words.

Assignees

• Honeywell Int Inc

Inventors

• Kar Satyanarayan
• Mead Stephen
• Mazumdar Anupam

Classifications

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/193

  Formal grammars, e.g. finite state automata, context free grammars or word networks · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G10L25/51

  for comparison or discrimination · CPC title

• B64D2011/0053

  Cabin passenger reading lights · CPC title