Voice activated features on multi-level voice menu

Patent metadata

Field	Value
Publication number	US-9368113-B2
Application number	US-201313754503-A
Country	US
Kind code	B2
Filing date	Jan 30, 2013
Priority date	Jan 30, 2013
Publication date	Jun 14, 2016
Grant date	Jun 14, 2016

Abstract

Methods, apparatus, and computer-readable media are described herein related to a user interface (UI) that can be implemented on a head-mountable device (HMD). The UI can include a voice-navigable UI. The voice-navigable UI can include a voice navigable menu that includes one or more menu items comprising an original menu item and an added command menu item. The original menu item can be associated with one or more original commands, and the added menu item can be associated with one or more added commands, including a first added command. The interface can also present a first visible menu that includes at least a portion of the voice navigable menu. Responsive to a first utterance comprising the first added command, the interface can invoke the first added command. In some embodiments, the interface can display a second visible menu, wherein the first added command can be displayed above other menu items.

First claim

We claim:

1. A method, comprising:
at a head-mountable device (HMD) with a voice-navigable user interface, displaying a first visible menu comprising at least a portion of a voice navigable menu, wherein the voice navigable menu includes one or more menu items, the one or more menu items comprising an original menu item comprising a text version of a first original speech command from one or more original speech commands;
receiving a first utterance at the HMD, the first utterance comprising an original speech command of the one or more original speech commands;
after receiving the first utterance, invoking the original speech command;
receiving an added command menu item at the HMD, wherein the added command menu item comprises a text version of a first added speech command from one or more added speech commands, and wherein at least one of the added speech commands differs from the one or more original speech commands;
adding the added command menu item to the voice-navigable user interface of the HMD, such that the text version of the first added speech command is included in a top level of the voice-navigable user interface;
receiving a second utterance at the HMD, the second utterance comprising the first added speech command; and
after receiving the second utterance, invoking the first added speech command.

2. The method of claim 1 , further comprising:
receiving a third utterance at the HMD, the third utterance comprising an identification of the added command menu item; and
after receiving the third utterance, modifying the first visible menu to display one or more menu items that comprise one or more text versions the one or more added speech commands.

3. The method of claim 2 , further comprising:
displaying at least a portion of a second visible menu, wherein the second visible menu includes the first added speech command and at least one menu item of the one or more menu items; and
wherein the second visible menu displays the first added speech command above the at least one menu item.

4. The method of claim 3 , wherein the one or more added speech commands further comprise a second added speech command, the second added speech command differing from the first added speech command, and wherein the method further comprises:
receiving a fourth utterance at the HMD, the fourth utterance comprising the second added speech command;
after receiving the fourth utterance, invoking the second added speech command;
displaying at least a portion of a third visible menu, wherein the third visible menu includes the second added speech command and at least one menu item of the one or more menu items, and wherein the third visible menu displays the second added speech command above the at least one menu item.

5. The method of claim 4 ,
wherein the third visible menu further includes the first added speech command; and
wherein an order in which the first added speech command and the second added speech command are displayed in the third visible menu is determined based on at least a frequency of use for the first added command and a frequency of use for the second added speech command.

6. The method of claim 4 ,
wherein the third visible menu further includes the first added speech command; and
wherein an order in which the first added speech command and the second added speech command are displayed in the third visible menu is determined based on at least a recency of use for the first added command and a recency of use for the second added speech command.

7. The method of claim 4 ,
wherein the third visible menu further includes the first added speech command; and
wherein an order in which the first added speech command and the second added speech command are displayed in the third visible menu is determined based on at least a combination of a frequency of use and a recency of use for the first added speech command and a combination of a frequency of use and a recency of use for the second added speech command.

8. The method of claim 1 , wherein displaying a first visible menu further comprises:
displaying at least a portion of the first visible menu in response to the HMD receiving a hotword utterance comprising a hotword.

9. The method of claim 1 , wherein at least one of the one or more menu items comprise the original speech command.

10. The method of claim 1 , wherein at least one of the one or more menu items comprise an added speech command of the one or more added speech commands.

11. The method of claim 1 , wherein at least one of the one or more menu items comprise an identification of a category.

12. The method of claim 1 , wherein the one or more added speech commands are associated with at least one third-party.

13. A head-mountable device (HMD), comprising:
a processor; and
a non-transitory computer-readable medium configured to store at least program instructions that, when executed by the processor, cause the HMD to carry out functions comprising:
displaying a first visible menu comprising at least a portion of a voice navigable menu, wherein the voice navigable menu includes one or more menu items, the one or more menu items comprising an original menu item comprising a text version of a first original speech command from one or more original speech commands;
receiving a first utterance at the HMD, the first utterance comprising an original speech command of the one or more original speech commands;
after receiving the first utterance, invoking the original speech command;
receiving an added command menu item at the HMD, wherein the added command menu item comprises a text version of a first added speech command from one or more added speech commands, and wherein at least one of the added speech commands differs from the one or more original speech commands;
adding the added command menu item to the voice-navigable user interface of the HMD, such that the text version of the first added speech command is included in a top level of the voice-navigable user interface;
receiving a second utterance at the HMD, the second utterance comprising the first added speech command; and
after receiving the second utterance, invoking the first added speech command.

14. The HMD of claim 13 , wherein the functions further comprise:
receiving a third utterance, the third utterance comprising an identification of the added command menu item; and
after receiving the third utterance, modifying the first visible menu to display the one or more added speech commands.

15. The HMD of claim 14 , wherein the functions further comprise:
displaying at least a portion of a second visible menu, wherein the second visible menu includes the first added speech command and at least one menu item of the one or more menu items; and
wherein the second visible menu displays the first added speech command above the at least one menu item.

16. The HMD of claim 15 , wherein the one or more added speech commands further comprise a second added speech command, the second added speech command differing from the first added speech command, and wherein the functions further comprise:
receiving a fourth utterance, the fourth utterance comprising the second added speech command;
after receiving the fourth utterance, invoking the second added speech command; and
displaying at least a portion of a third visible menu, wherein the third visible menu includes the second added speech command and at least one menu item of the one or more menu items, and wherein the third visible menu displays the second added speech command above the at least one menu item.

17.

Assignees

• Google Inc

Inventors

• Lebeau Michael J
• Balez Mat
• Pinsky Yury

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G02B2027/0132

  comprising binocular systems · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B27/017

  Head mounted · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title