Methods and apparatus for voice-activated control of an interactive display

Patent metadata

Field	Value
Publication number	US-10198246-B2
Application number	US-201615242104-A
Country	US
Kind code	B2
Filing date	Aug 19, 2016
Priority date	Aug 19, 2016
Publication date	Feb 5, 2019
Grant date	Feb 5, 2019

Abstract

A method for controlling an interactive display is provided. The method receives a set of voice input data, via a voice input device communicatively coupled to the interactive display; interprets, by at least one processor, the set of voice input data to produce an interpreted result, wherein the at least one processor is communicatively coupled to the voice input device and the interactive display; presents, by the interactive display, a text representation of the interpreted result coupled to a user-controlled cursor; receives, by a user interface, a user input selection of a textual or graphical element presented by the interactive display, wherein the user interface is communicatively coupled to the at least one processor and the interactive display; and performs, by the at least one processor, an operation associated with the interpreted result and the user input selection.

First claim

What is claimed is:

1. A method for controlling an interactive display, the method comprising:
receiving a set of voice input data, via a voice input device communicatively coupled to the interactive display;
interpreting, by at least one processor, the set of voice input data to produce an interpreted result, wherein the at least one processor is communicatively coupled to the voice input device and the interactive display;
presenting, by the interactive display, a combination element comprising a text representation of the interpreted result coupled to a user-controlled cursor, wherein presentation of the combination element provides visual feedback indicating content of the interpreted result, and wherein the combination element is configured for user manipulation including positioning the combination element and making selections using the combination element;
receiving, by a user interface, a user input selection of a textual or graphical element presented by the interactive display, wherein the user input selection is performed via the user manipulation of the combination element over the textual or graphical element and performance of a click to select the textual or graphical element, and wherein the user interface is communicatively coupled to the at least one processor and the interactive display;
performing, by the at least one processor, an operation associated with the interpreted result and the user input selection, wherein the interpreted result comprises a command, and wherein the command comprises the operation applicable to manipulate the textual or graphical element presented by the interactive display; and
after performing the operation associated with the interpreted result, presenting the user-controlled cursor without the text representation of the interpreted result, to indicate performance of the operation associated with the interpreted result.

2. The method of claim 1 , wherein receiving the user input selection further comprises receiving a user input selection of a data field; and
wherein performing the operation associated with the interpreted result and the user input selection further comprises:
positioning the text representation coupled to the user-controlled cursor in the data field; and
pasting the text representation in the data field, based on the positioning.

3. The method of claim 1 , wherein receiving the user input selection further comprises receiving a user input selection of a data field; and
wherein performing the operation associated with the interpreted result and the user input selection further comprises:
identifying a data type associated with the text representation;
positioning the text representation coupled to the user-controlled cursor in the data field; and
when the data type associated with the text representation corresponds to a type associated with the data field, pasting the text representation in the data field, based on the positioning.

4. The method of claim 1 , wherein receiving the user input selection further comprises receiving a user input selection of a graphical list comprising a plurality of list items; and
wherein performing the operation associated with the interpreted result and the user input selection further comprises:
performing an automatic selection of one of the list items, based on the interpreted result; and
presenting the one of the list items.

5. The method of claim 1 , wherein receiving the user input selection further comprises receiving a user input selection of one of a plurality of displayed features;
wherein the method further comprises identifying a command, based on the interpreted result; and
wherein performing the operation associated with the interpreted result and the user input selection further comprises:
executing the command, by the at least one processor;
altering the one of the plurality of displayed features, based on executing the command, to create an altered plurality of displayed features; and
presenting the altered plurality of displayed features, by the interactive display.

6. The method of claim 1 , wherein the voice input device comprises a push-to-talk (PTT) voice input device communicatively coupled to the interactive display, the PTT voice input device comprising a work-center selection switch; and
wherein the method further comprises:
receiving, via the work-center selection switch, a user input selection of a second work-center; and
routing the interpreted result to a second interactive display associated with the second work-center, wherein the interactive display is associated with a first work-center;

wherein the text representation is presented by the second interactive display; and
wherein the user input selection of the textual or graphical element is presented by the second interactive display.

7. The method of claim 1 , further comprising:
wherein the voice input device comprises a voice-activated microphone communicatively coupled to the interactive display; and
wherein the method further comprises:
receiving, via the voice-activated microphone, a user input selection of a second work-center; and
routing the interpreted result to a second interactive display associated with the second work-center, wherein the interactive display is associated with a first work-center;

wherein the text representation is presented by the second interactive display; and
wherein the user input selection of the textual or graphical element is presented by the second interactive display.

8. The method of claim 1 , further comprising:
receiving, by a second voice input device, a user input voice command selecting the interactive display, and a second set of voice input data, wherein the second voice input device is communicatively coupled to a second interactive display and the at least one processor, and wherein the at least one processor is communicatively coupled to the interactive display and the second interactive display;
interpreting, by the at least one processor, the second set of voice input data to produce a second interpreted result;
presenting, by the interactive display, a second text representation of the second interpreted result coupled to the user-controlled cursor;
receiving, by the user interface, a second user input selection of a second graphical element presented by the interactive display; and
performing, by the at least one processor, a second operation associated with the second interpreted result and the second user input selection.

9. A system for user interaction with an interactive display, the system comprising:
a system memory element;
a voice input device, configured to receive a set of voice input data;
an interactive display, configured to present a plurality of graphical elements and a user-controlled cursor;
a user interface, configured to receive a user input manipulation of the user-controlled cursor;
at least one processor, communicatively coupled to the system memory element, the voice input device, the interactive display, and the user interface, the at least one processor configured to:
interpret the set of voice input data to produce an interpreted result;
present, via the interactive display, a combination element comprising a text representation of the interpreted result coupled to the user-controlled cursor, wherein presentation of the combination element provides visual feedback indicating content of the interpreted result, and wherein the combination element is configured for user manipulation including positioning the combination element and making selections using the combination element;
receive, via the user interface, a user input selection of one of the plurality of graphical elements, wherein the user input select

Assignees

• Honeywell Int Inc

Inventors

• Paulraj Vasantha Selvi
• Krishna Kiran Gopala
• Agarwal Jitender Kumar
• Pasupathi Sivaprakash

Classifications

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L2015/221

  Announcement of recognition results · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• G06F40/174

  Form filling; Merging · CPC title