Visual indication of a recognized voice-initiated action

Patent metadata

Field	Value
Publication number	US-2016335052-A1
Application number	US-201615220835-A
Country	US
Kind code	A1
Filing date	Jul 27, 2016
Priority date	Mar 17, 2014
Publication date	Nov 17, 2016
Grant date	—

Abstract

A computing device is described that outputs, for display, an initial speech recognition graphical user interface (GUI) having at least one element. The computing device receives audio data and determines, based on the audio data, a voice-initiated action. Responsive to determining the voice-initiated action, the computing device outputs, for display, an updated speech recognition GUI having an animation of a change in a position of the at least one element to indicate that the voice-initiated action has been determined.

First claim

What is claimed is:

1 . A method comprising:
while receiving an initial portion of a voice input, outputting, by a computing device and for display, an initial speech recognition graphical user interface (GUI) including at least one element; and while receiving a subsequent portion of the voice input:
responsive to determining that no voice-initiated action from a predetermined set of actions is associated with the initial portion of the voice input, outputting, by the computing device, for display, a first updated speech recognition GUI including a first animation in which the at least one element from the initial speech recognition GUI changes position, the first animation indicating that none of the voice-initiated actions from the predetermined set of actions has been determined based on the initial portion of the voice input; and
responsive to determining that a voice-initiated action from the predetermined set of actions is associated with the initial portion of the voice input:
outputting, by the computing device, for display, a second updated speech recognition GUI including a second animation in which the at least one element from the initial speech recognition GUI changes position, the second animation being different than the first animation and indicating that the voice-initiated action has been determined based on the initial portion of the voice input; and
after outputting the second updated speech recognition GUI, executing the voice-initiated action based on the initial portion of the voice input and the subsequent portion of the voice input.

2 . The method of claim 1 , wherein the at least one element changes position in a horizontal direction in the first animation and the at least one element changes position in a vertical direction in the second animation.

3 . The method of claim 1 , wherein the first animation is a shake animation and the second animation is a bounce animation.

4 . The method of claim 1 , wherein outputting the initial speech recognition GUI for display includes outputting the at least one element for display in a first visual format indicating the computing device is receiving the voice input.

5 . The method of claim 4 , wherein outputting the second updated speech recognition GUI for display includes outputting the at least one element for display in a second visual format, the second visual format being different than the first visual format and further indicating that the voice-initiated action has been determined based on the initial portion of the voice input.

6 . The method of claim 1 , wherein:
outputting the initial speech recognition GUI for display comprises outputting the at least one element for display at an initial location of a display device, outputting the first updated speech recognition GUI comprises outputting the at least one element for display at the initial location of the display device after outputting the at least one element for display at a second location of the display device, and outputting the second updated speech recognition GUI comprises outputting the at least one element for display at the initial location of the display device after outputting the at least one element for display at a second location of the display device. The method of claim 6 , wherein: the first location is positioned left or right of the initial location, and the second location is positioned above or below the initial location.

8 . A computing device comprising:
at least one processor; and at least one module operable by the at least one processor to:
while receiving an initial portion of a voice input, output, for display, an initial speech recognition graphical user interface (GUI) including at least one element; and
while receiving a subsequent portion of the voice input:
responsive to determining that no voice-initiated action from a predetermined set of actions is associated with the initial portion of the voice input, output, for display, a first updated speech recognition GUI including a first animation in which the at least one element from the initial speech recognition GUI changes position, the first animation indicating that none of the voice-initiated actions from the predetermined set of actions has been determined based on the initial portion of the voice input; and
responsive to determining that a voice-initiated action from the predetermined set of actions is associated with the initial portion of the voice input:
output, for display, a second updated speech recognition GUI including a second animation in which the at least one element from the initial speech recognition GUI changes position, the second animation being different than the first animation and indicating that the voice-initiated action has been determined based on the initial portion of the voice input; and
after outputting the second updated speech recognition GUI, execute the voice-initiated action based on the initial portion of the voice input and the subsequent portion of the voice input.

9 . The computing device of claim 8 , wherein the at least one element changes position in a horizontal direction in the first animation and the at least one element changes position in a vertical direction in the second animation.

10 . The computing device of claim 8 , wherein the first animation is a shake animation and the second animation is a bounce animation.

11 . The computing device of claim 8 , wherein the at least one module is further operable by the at least one processor to output the initial speech recognition GUI for display by at least outputting the at least one element for display in a first visual format indicating the computing device is receiving the voice input.

12 . The computing device of claim 11 , wherein the at least one module is further operable by the at least one processor to output the second updated speech recognition GUI for display by at least outputting the at least one element for display in a second visual format, the second visual format being different than the first visual format and further indicating that the voice-initiated action has been determined based on the initial portion of the voice input.

13 . The computing device of claim 8 , wherein the at least one module is further operable by the at least one processor to:
output the initial speech recognition GUI for display by at least outputting the at least one element for display at an initial location of a display device; output the first updated speech recognition GUI by at least outputting the at least one element for display at the initial location of the display device after outputting the at least one element for display at a second location of the display device; and output the second updated speech recognition GUI by at least outputting the at least one element for display at the initial location of the display device after outputting the at least one element for display at a second location of the display device.

14 . The computing device of claim 13 , wherein:
the first location is positioned left or right of the initial location, and the second location is positioned above or below the initial location.

15 . A computer-readable storage medium comprising instructions that, when executed, cause at least one processor of a computing device to:
while receiving an initial portion of a voice input, output, for display, an initial speech recognition graphical user interface (GUI) including at least one element; and while receiving a subsequent portion of the voice input:
responsive to determining that no voice-initiated action from a predetermined set of actions

Assignees

• Google Inc

Inventors

• Faaborg Alexander
• Sonoda Gustavo
• Kaplan Joshua Robin

Classifications

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• H04M2250/74

  with voice recognition means · CPC title

• G10L2015/225

  Feedback of the input speech · CPC title