Electronic device, server and recording medium supporting task execution using external device

Patent metadata

Field	Value
Publication number	US-11765234-B2
Application number	US-202117322077-A
Country	US
Kind code	B2
Filing date	May 17, 2021
Priority date	Sep 7, 2017
Publication date	Sep 19, 2023
Grant date	Sep 19, 2023

Abstract

An electronic device is provided. The electronic device includes housing, a touch screen display, a microphone, a wireless communication circuit, a processor, and a memory. The memory stores a software program including a user interface supporting the control of at least one external device based on a user account, and the memory stores at least one instruction that, when executed, causes the processor to receive a first user input for connecting the electronic device to a first external device, to receive a second user input corresponding to a request for performing at least part of a task by using the first external device, to receive a first response including a sequence of states from the second external device to perform, by the first external device, the at least part of the task depending on the sequence.

First claim

What is claimed is:

1. A portable communication device comprising:
a housing;
an inputter;
a communicator configured to perform wireless communication; and
a processor configured to:
obtain, via the inputter, a first voice input for a first external device to perform a first task, the first voice input including a word indicative of the first external device,
transmit, to a second external device via the communicator, first information corresponding to the first voice input,
in response to the transmitting of the first information to the second external device, receive, via the communicator from the second external device, second information determined by the second external device based at least in part on a portion of the first information corresponding to the first voice input,
based on the second information determined by and received from the second external device indicating that the first external device is not registered with respect to the portable communication device, output a feedback for prompting a registration of the first external device with respect to the portable communication device, the feedback being generated based at least in part on the second information, and
after registering the first external device with respect to the portable communication device, transmit a request to perform at least part of the first task via the wireless communication such that the at least part of the first task is to be performed based at least in part on the request, the transmitting being performed based at least in part on third information being received from the second external device via the communicator, the third information being determined by the second external device based at least in part on the registering of the first external device.

2. The portable communication device of claim 1 , wherein the processor is further configured to:
perform the transmitting of the request based on obtaining a second voice input through the inputter.

3. The portable communication device of claim 1 , wherein the inputter includes a microphone.

4. The portable communication device of claim 1 , wherein the first information includes information for performing an operation to register the first external device by executing a first application.

5. The portable communication device of claim 4 , wherein the operation includes being performed based on user account information.

6. The portable communication device of claim 4 , wherein the first application includes an application that supports control of at least one external device based on user account information.

7. The portable communication device of claim 1 , wherein the second information includes information for performing the first task corresponding to an intent of the first voice input using the first external device.

8. The portable communication device of claim 1 , wherein the processor is further configured to:
obtain a second voice input for performing a second task by using a second application and the first external device,
execute the second application according to the third information received through the communicator from the second external device, and
control the first external device to perform the second task according to the third information.

9. The portable communication device of claim 8 , wherein the third information is determined by the second external device based on information related to the second application and information related to the first external device.

10. The portable communication device of claim 9 , wherein the information related to the second application includes version information of the second application.

11. The portable communication device of claim 9 , wherein the information related to the first external device includes model information, device version information, operating country information, and operating system (OS) information.

12. The portable communication device of claim 1 , wherein the first task comprises a specific command task different from registering the first external device.

13. The portable communication device of claim 1 , wherein the feedback is output together with a specific sound or a vibration of a specific pattern.

14. The portable communication device of claim 1 ,
wherein the outputting of the feedback comprises outputting text requesting whether the registering of the first external device is desired, and
wherein the feedback comprises an object for supporting the registering of the first external device.

15. The portable communication device of claim 1 , wherein the processor is further configured to:
in response to receiving the second information generated by the second external device based on the first voice input, output the feedback for prompting the registering of the first external device, and
after the outputting of the feedback, transmit, to the second external device via the communicator, registration completion information of the first external device for the registering of the first external device with respect to the portable communication device.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Je Seong Min
• Lee Sun Key
• Kim Kyung Tae
• Kim Joo Hwan
• Yeo Jae Yung
• Woo Kyoung Gu
• Yun Jeong Hyeon
• Lim Dong Sun

Classifications

• H04L67/125 Primary

  involving control of end-device applications over a network · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• H04L67/63 Primary

  Routing a service request depending on the request content or context · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title