Systems and methods for contextual tagging of data on vehicle display

Patent metadata

Field	Value
Publication number	US-10275427-B2
Application number	US-201615347506-A
Country	US
Kind code	B2
Filing date	Nov 9, 2016
Priority date	Nov 9, 2016
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

A system and method for contextual tagging of data on at least one display associated with a vehicle is provided. The method includes: receiving data regarding the vehicle from at least one of a source of verbal data and a source of non-verbal data; determining a context associated with the data and a variable parameter associated with the context; determining a display element associated with the at least one display that corresponds to the determined variable parameter; generating a symbol for the display to display adjacent to the determined display element based on at least one of the determined context and the determined variable parameter; generating a selectable icon for the display to render adjacent to the symbol based on received verbal data; associating the received verbal data to the selectable icon; and outputting the received verbal data to an audio device based on a selection of the selectable icon.

First claim

What is claimed is:

1. A method for contextual tagging of data on at least one display associated with a vehicle, comprising:
receiving data regarding the vehicle from a source of verbal data;
comparing, by a processor, the data to one or more instruction keywords to determine a context associated with the data and a variable parameter associated with the context, the variable parameter having a value;
querying, by the processor, a listing of display elements currently displayed on the at least one display and determining, by the processor, a display element from the listing of display elements that corresponds to the determined variable parameter;
generating, by the processor, a symbol for the display to display adjacent to the display element that is currently displayed on the at least one display based on at least one of the determined context and the determined variable parameter;
determining, by the processor, a position for the display of the symbol adjacent to the display element that is currently displayed on the at least one display based on the value of the variable parameter;
generating, by the processor, a selectable icon for the display to render adjacent to the symbol based on received verbal data;
associating, by the processor, the received verbal data to the selectable icon; and
outputting the received verbal data to an audio device based on a selection of the selectable icon.

2. The method of claim 1 , wherein the source of verbal data is a radio communication system.

3. The method of claim 1 , further comprising receiving data regarding the vehicle from a source of non-verbal data, wherein the source of non-verbal data is at least one of a user input device associated with the vehicle or a data link system associated with the vehicle.

4. The method of Claim 3 , wherein the comparing, by the processor, the data to one or more instruction keywords further comprises:
identifying, by the processor, one or more keywords in the non-verbal data; and
determining, by the processor, the context and the variable parameter based on the identified keywords.

5. The method of claim 1 , wherein the comparing, by the processor, the data to one or more instruction keywords further comprises:
transcribing, by the processor, the data received from the source of verbal data that includes a request for pilot action;
identifying, by the processor, one or more keywords from the transcribed data;
determining, by the processor, the context and the variable parameter based on the identified keywords.

6. The method of claim 1 , wherein the vehicle is an aircraft, and the context is a requested pilot action.

7. A contextual tagging system for contextually tagging data on at least one display associated with a vehicle, comprising:
a source of verbal data associated with the vehicle;
a source of display element data that provides a plurality of display elements associated with the at least one display that are currently displayed on the at least one display; and
a processor associated with the vehicle, the processor in communication with the source of verbal data and the source of display element data, and the processor:
receives the verbal data;
compares the verbal data to one or more instruction keywords and determines a context associated with the verbal data;
determines a variable parameter associated with the context, the variable parameter having a value;
queries the source of display element data and determines whether at least one of the plurality of display elements currently displayed on the at least one display is associated with the variable parameter;
generates a symbol for the at least one display to display adjacent to the determined at least one of the plurality of display elements based on the variable parameter;
based on the determination that at least one of the plurality of display elements currently displayed on the at least one display is associated with the variable parameter, determines a position for the display of the symbol adjacent to the at least one of the plurality of display elements based on the value of the variable parameter;
generates a selectable icon for the at least one display to display adjacent to the symbol based on received verbal data;
associates the received verbal data to the selectable icon; and
outputs the received verbal data to an audio device based on a selection of the selectable icon.

8. The contextual tagging system of claim 7 , wherein the at least one source of verbal data is a communication system associated with the vehicle.

9. The contextual tagging system of claim 7 , further comprising a source of non-verbal data associated with the vehicle, the processor receives the non-verbal data and the processor determines the context associated with the non-verbal data by identifying one or more keywords in the non-verbal communication, and determines the context and the variable parameter based on the identified keywords.

10. The contextual tagging system of Claim 9 , wherein the at least one source of non-verbal data is selected from the group comprising a data link system, a user input device and combinations thereof.

11. The contextual tagging system of claim 7 , wherein the processor determines the context associated with the verbal data by transcribing the verbal data, the verbal data including a request for pilot action, identifying one or more keywords from the transcribed data and the processor determines the context and the variable parameter based on the identified keywords.

12. The contextual tagging system of claim 7 , wherein based on a determination that at least one of the plurality of display elements is unassociated with the determined variable parameter, the processor determines a position for the display of the symbol on the at least one display based on the variable parameter.

13. The contextual tagging system of claim 7 , wherein the vehicle is an aircraft, and the context is a requested pilot action.

14. An aircraft, comprising:
a communication system that receives at least a verbal communication;
a display onboard the aircraft having a plurality of display elements associated with the display;
a processor that contextually tags data on the display, the processor in communication with the communication system and the display, and the processor:
receives the verbal communication;
determines a pattern associated with the verbal communication;
compares the pattern to one or more instruction keywords to extract a context and a variable parameter associated with the context, the variable parameter having a value;
queries a listing of display elements currently displayed on the display and determines whether at least one of the plurality of display elements displayed on the display is associated with the variable parameter;
generates a symbol for the display to display adjacent to the determined at least one of the plurality of display elements currently displayed on the display based on at least one of the variable parameter and the context;
based on the determination that at least one of the plurality of display elements currently displayed on the display is associated with the variable parameter, determines a position for the display of the symbol adjacent to the at least one of the plurality of display elements based on the value of the variable parameter;
generates a selectable icon for the display to display adjacent to the symbol based on received verbal data;
associates the received verbal data to the selectable icon; and outputs the
received verbal data to an audio device based on a selection of the selectable icon.

Assignees

• Honeywell Int Inc

Inventors

• Saptharishi Hariharan
• Srinivasan Narayanan
• Chandrashekarappa Mohan Gowda

Classifications

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G10L15/1815

  Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning · CPC title

• G10L2015/088

  Word spotting · CPC title

• B64D43/00

  Arrangements or adaptations of instruments · CPC title