Method and apparatus for managing intelligent agent

Patent metadata

Field	Value
Publication number	US-11301266-B2
Application number	US-201816608656-A
Country	US
Kind code	B2
Filing date	Mar 27, 2018
Priority date	Apr 27, 2017
Publication date	Apr 12, 2022
Grant date	Apr 12, 2022

Abstract

The present invention can receive a user input comprising a request to perform a task using at least one of the application programs via at least one of a display or a microphone, transmit data related to the user input to an external server through a communication circuit, transmit version information on at least one of the application programs to the external server via the communication circuit together with the data transmission or after the data transmission, receive a pass rule as a response to the request from the external server via the communication circuit, and store instructions that cause an electronic device to perform the task by allowing the electronic device to have the sequence. The pass rule comprises information on a sequence of states of the electronic device for performing the task, and at least one of the states may be one determined by the external server on the basis of at least a portion of the version information.

First claim

The invention claimed is:

1. An electronic device comprising:
a touchscreen display;
a microphone;
at least one speaker;
a wireless communication circuitry;
a processor electrically connected to the display, the microphone, the speaker, and the communication circuitry; and
a memory electrically connected to the processor,
wherein the memory is configured to store a plurality of application programs installed in the electronic device, and
the memory, when executed, includes instructions to cause the processor to:
receive a user input including a request for performing a task using at least one of the application programs through at least one of the display or the microphone,
transmit data related to the user input to an external server through the communication circuitry,
transmit version information on at least one of the application programs to the external server through the communication circuit together with or after the data transmission,
receive a path rule from the external server through the communication circuitry as a response to the request, the received path rule including information on a sequence of operations of the task to be performed by the electronic device using at least one of the application programs, and the received path rule being selected by the external server based on the version information from among a plurality of path rules that are different for each version of the application programs, and
perform the task based on the received path rule.

2. The electronic device of claim 1 , wherein the instructions cause the processor to receive, from an external electronic device, parameters necessary for at least one of the operations of the task,
wherein the parameters are acquired from the user input.

3. The electronic device of claim 1 , wherein the instructions cause the processor to display a user interface for the user input necessary when at least one of the operations of the task is executed.

4. The electronic device of claim 1 , wherein the instructions cause the processor to upgrade an application to a version necessary to execute the operations of the task.

5. The electronic device of claim 1 , wherein the instructions cause the processor to display a change in stages of the operations of the task through the display.

6. The electronic device of claim 1 , wherein the instructions cause the processor to transmit information indicating a change of an application to the external server through the communication circuitry,
wherein the change is deletion, version upgrade, or installation into the electronic device.

7. The electronic device of claim 1 , wherein the instructions cause the processor to transmit the version information corresponding to the application programs installed in the electronic device to the external server through the communication circuitry if booting completion of the electronic device, insertion of an SD card into the electronic device, or removal of the SD card from the electronic device is recognized.

8. The electronic device of claim 1 , wherein the instructions cause the processor to:
acquire a hint based on the version information corresponding to application programs installed in the electronic device,
display the hint through the display,
receive a second user input for the hint, and
control operations of at least one of the application programs using the path rule corresponding to the hint in response to the second user input,
wherein the hint differs for each version of the at least one application program.

9. A server comprising:
a path planner module configured to:
receive, from a user terminal, version information indicating each version of applications installed in the user terminal, and
select a path rule set corresponding to the version information from a path rule set database including a plurality of path rule sets that are different for each version of the applications; and

a natural language understanding module configured to:
analyze a user input received from the user terminal,
select a path rule from the selected path rule set based on at least a part of an analysis result, and
transmit the selected path rule to the user terminal,

wherein the selected path rule includes information on operations performed by the user terminal using at least one of the applications installed in the user terminal.

10. The server of claim 9 , wherein the result comprises:
a domain indicating at least one of the applications to be controlled using the selected path rule;
a user's intent corresponding to the selected path rule; and
a parameter necessary when the at least one of the operations is executed,
wherein the natural language understanding module is further configured to:
select the path rule corresponding to the domain among the path rule set selected by the path planner module, and
transmit the parameter to the user terminal together with the selected path rule.

11. The server of claim 9 , wherein the natural language understanding module comprises:
a plurality of intent classification managers configured to:
grasp a user's intent through analysis of the user input, and
determine the path rule corresponding to the grasped intent; and

a domain classification manager configured to:
determine a domain of the user input,
select version information corresponding to the domain among the received version information, and
determine one of the plurality of intent classification managers as a manager for the analysis of the user input based on the selected version information,

wherein the plurality of intent classification managers are identified by application versions, and classify and manage path rules into supportable ones and unsupportable ones.

12. The server of claim 9 , wherein the natural language understanding module comprises:
a domain classification manager configured to:
determine a domain of the user input, and
select version information corresponding to the domain among the received version information; and

an intent classification manager configured to:
grasp a user's intent through analysis of the user input, and
determine whether to transmit the selected path rule to the user terminal based on the version information selected by the domain classification manager.

13. An electronic device comprising:
a touchscreen display;
a microphone;
at least one speaker;
a wireless communication circuitry;
a processor electrically connected to the display, the microphone, the speaker, and the communication circuitry; and
a memory electrically connected to the processor,
wherein the memory, when executed, includes instructions to cause the processor to:
receive a user input through at least one of the display or the microphone,
transmit the user input to an external server,
receive an analysis result of the user input from the external server,
select a path rule set from a path rule set database based on at least a part of the analysis result and version information corresponding to respective applications installed in the electronic device, the path rule set database including a plurality of path rule sets that are different for each version of the applications,
select a path rule from the path rule set based on at least the part of the analysis result, the selected path rule including information on operations performed by the electronic device using at least one of the applications and an order of the operations, and
control the operations using the path rule.

14. A method for operating an electronic device, comprising:
receiving a user input through at least one of a touc

Assignees

• Samsung Electronics Co Ltd

Inventors

• Woo Kyounggu
• Jaygarl Hojun
• JEON Jehun
• Park Hyunjin
• Kang Sangwook
• Kim Kyungtae
• Yeo Jaeyung

Classifications

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G06F9/451 Primary

  Execution arrangements for user interfaces · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L2015/228

  of application context · CPC title