Electronic device and method of executing function of electronic device

Patent metadata

Field	Value
Publication number	US-10440167-B2
Application number	US-201916389216-A
Country	US
Kind code	B2
Filing date	Apr 19, 2019
Priority date	Mar 27, 2017
Publication date	Oct 8, 2019
Grant date	Oct 8, 2019

Abstract

An artificial intelligence system and method are disclosed herein. The system includes a processor which implements the method, including: receiving by an input unit a first user input including a request to execute a task using at least one of the electronic device or an external device, transmitting by a wireless communication unit first data associated with the first user input to an external server, receiving a first response from the external server including information associated with at least one of the first user input and a sequence of electronic device states for performing at least a portion of the task, receiving a second user input assigning at least one of a voice command and a touch operation received by a touch screen display as the request to perform the task, and transmitting second data associated with the second user input to the external server.

First claim

What is claimed is:

1. A portable communication device comprising:
a microphone;
a touchscreen display; and
at least one processor configured to:
execute a first function of a plurality of functions of a first application at the portable communication device based at least in part on a first touch input received via the touchscreen display;
after the executing of the first function is terminated, display, via the touchscreen display, a recommendation text and a graphical indication based at least in part on a determination that the first function is executable based at least in part on one or more voice command being received via the microphone, the recommendation text including one or more words related to the first function;
receive a second touch input with respect to the graphical indication;
after the second touch input is received, receive a first voice input via the microphone at least temporarily while the recommendation text is displayed, wherein the first voice input is registered as a voice command to execute the first function;
receive a second voice input after the first voice input is registered; and
based on a determination that the second voice input corresponds to the registered voice command, execute the first function of the first application at the portable communication device.

2. The portable communication device of claim 1 , wherein the at least one processor is configured to:
perform the displaying of the recommendation text and the graphical indication using a second application, wherein the second application is different from the first application.

3. The portable communication device of claim 1 , wherein the at least one processor is configured to:
generate the recommendation text such that a name of the first application is included as at least part of the recommendation text.

4. The portable communication device of claim 1 , wherein the at least one processor is configured to:
transmit at least part of the first voice input to a server external to the portable communication device, such that the server registers the at least part of the first voice input as the registered voice command to execute the first function.

5. The portable communication device of claim 1 , further comprising a memory to store the first application, wherein the at least one processor is configured to:
store, in the memory, at least part of the first voice input as the registered voice command to execute the first function.

6. The portable communication device of claim 1 , wherein the at least one processor is configured to:
execute a plurality of functions including the first function and a second function different from the first function based at least in part on reception of the registered voice command.

7. The portable communication device of claim 1 , wherein the at least one processor is configured to:
transmit the second voice input to a server external to the portable communication device, such that the server determines that the second voice input corresponds to the registered voice command.

8. A portable communication device comprising:
a memory storing a specified application;
a microphone;
a touchscreen display; and
at least one processor configured to:
execute, using the specified application, a specified function based at least in part on a first touch input received via the touchscreen display, the executing including displaying a first user interface corresponding to the specified application via the touchscreen display;
after the specified function is executed, display, via the touchscreen display, a text indication indicative of the specified function and a graphical indication as part of a second user interface different from the first user interface, wherein the displaying is based at least in part on a determination that the specified function is executable based at least in part on one or more voice command;
receive, via the touchscreen display, a second touch input with respect to the graphical indication; and
based at least in part on the second touch input, display, via the touchscreen display, a recommendation text as part of a third user interface different from the first user interface and the second user interface, the recommendation text including one or more words to be used to execute the specified function,
while the recommendation text is displayed as part of the third user interface via the touchscreen display, receive a voice input via the microphone, and
wherein at least part of the voice input is registered as a voice command to be used to execute the specified function.

9. The portable communication device of claim 8 , wherein the at least one processor is configured to:
receive another voice input via the microphone while the first and second user interfaces are not displayed;
determine that the other voice input corresponds to the registered voice command; and
execute the specified function based at least in part on the determining.

10. The portable communication device of claim 8 , wherein the voice input includes a different word from the one or more words included in the recommendation text such that the different word is registered as at least part of the registered voice command to be used to execute the specified function.

11. The portable communication device of claim 8 , wherein the at least one processor is configured to:
transmit the at least part of the voice input to a server external to the portable communication device, such that the server registers the at least part of the voice input as the registered voice command.

12. The portable communication device of claim 8 , wherein the at least one processor is configured to:
store, in the memory, the at least part of the voice input as the registered voice command.

13. The portable communication device of claim 8 , wherein the at least one processor is configured to:
execute a plurality of functions including the specified function and another function different from the specified function based on reception of another of the one or more voice command.

14. The portable communication device of claim 8 , wherein the at least one processor is configured to:
perform the displaying of the text indication and the graphical indication using a second application, wherein the second application is different from the specified application.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Choi Il-Hwan
• Kang Sang-Wook
• Kim Young-Hoon
• Park Seung-Hoon
• Seo Hyun-Ju
• Um Tae-Kwang
• Lee Jae-Yong
• Choi Jin-Ho
• Lee Da-Som
• Yeo Jae-Yung

Classifications

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• H04M2250/74

  with voice recognition means · CPC title

• G06F3/04847

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title

• H04M2250/22

  including a touch pad, a touch sensor or a touch detector · CPC title