Building multimodal collaborative dialogs with task frames
US-10114676-B2 · Oct 30, 2018 · US
US11194545B2 · US · B2
| Field | Value |
|---|---|
| Publication number | US-11194545-B2 |
| Application number | US-201816493277-A |
| Country | US |
| Kind code | B2 |
| Filing date | Mar 8, 2018 |
| Priority date | Mar 24, 2017 |
| Publication date | Dec 7, 2021 |
| Grant date | Dec 7, 2021 |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
The electronic device according to an embodiment may receive a first user input including a first request for performing a first task requiring one or more first parameters for execution, to transmit first data associated with the first user input through the communication circuit to a server including an intelligence system providing a sequence of action states for the electronic device performing at least one task using the at least one application program, to receive the first sequence of the action states for performing the first task, from the server through the communication circuit, to perform not all but part of the first sequence of the action states, based at least on the first user input, and to transmit second data associated with an action state of the electronic device caused from the performing of the part of the first sequence, to the server through the communication circuit.
Opening claim text (preview).
The invention claimed is: 1. An electronic device comprising: a housing; a display exposed through a part of the housing; a microphone; a speaker; a communication circuit; a processor electrically connected to the display, the microphone, the speaker, and the communication circuit; and a memory electrically connected to the processor, wherein the memory is configured to store at least one application program, wherein instructions stored by the memory, when executed, cause the processor to: receive a first user input including a first request for performing a first task using one or more first parameters for execution, wherein the first user input includes a part of the one or more first parameters and the first task is performed by executing the at least one application program irrelevant to defining rules of an action, transmit first data associated with the first user input through the communication circuit to a server including an intelligence system configured to provide a first sequence of action states for the electronic device to perform at least one task using the at least one application program, receive the first sequence of the action states for performing the first task, from the server through the communication circuit, perform a portion of the first sequence of the action states while displaying a first execution state screen on the display, based on the part of the one or more first parameters included in the first user input, perform partial landing by stopping the execution of the first sequence when a parameter necessary to perform the first sequence is missing in the part of the one or more first parameters, display a second execution state screen on the display while maintaining the partial landing of the electronic device, the second execution state screen distinguished by the first execution state screen, and transmit second data associated with the partial landing of the electronic device based on the performing the portion of the first sequence, to the server through the communication circuit. 2. The electronic device of claim 1 , wherein the second data includes an identifier indicating an action state of the electronic device. 3. The electronic device of claim 1 , wherein the instructions cause the processor to: while sequentially displaying at least part of changed action states on the display, perform the portion of the first sequence of the action states. 4. The electronic device of claim 1 , wherein the instructions cause the processor to: provide a command through the display or the speaker, wherein the command is to receive a first parameter for performing the first task, which is missing from the first user input, from a user; receive a second user input including the missing first parameter, through the microphone or a user interface on the display; transmit third data associated with the second user input to the server through the communication circuit; and receive a second sequence of action states from the server through the communication circuit. 5. The electronic device of claim 4 , wherein the second sequence of the action states includes the portion of the first sequence of the action states already performed to perform the first task. 6. The electronic device of claim 4 , wherein the instructions cause the processor to: determine whether the second sequence of the action states includes the portion of the first sequence of the action states already performed to perform the first task; and perform the first task based on the second sequence of the action states, without repeating the performed portion of the first sequence. 7. The electronic device of claim 6 , wherein the second sequence of the action states is the same as the first sequence of the action states. 8. The electronic device of claim 6 , wherein the second sequence of the action states is different from the first sequence of the action states. 9. The electronic device of claim 6 , wherein the instructions cause the processor to: after performing the first task, receive a third user input including a second request for performing a second task using one or more second parameters for execution, wherein the third user input does not include all of the one or more second parameters and includes at least one first parameter; transmit four data associated with the third user input to the server through the communication circuit; and receive a third sequence of action states from the server through the communication circuit. 10. The electronic device of claim 9 , wherein the instructions cause the processor to: determine whether the third sequence of the action states includes the portion of the first sequence of the action states already performed to perform the first task; and perform the second task based on the third sequence of the action states, without repeating the performed portion of the first sequence. 11. The electronic device of claim 1 , wherein the instructions cause the processor to: provide a command through the display or the speaker, wherein the command is to receive a first parameter for performing the first task, which is missing from the first user input, from a user, receive a third user input including a second request for performing a second task using one or more second parameters for execution, wherein the third user input does not include all of the one or more second parameters and includes at least one first parameter; transmit third data associated with the third user input to the server through the communication circuit; and receive a second sequence of action states from the server through the communication circuit. 12. The electronic device of claim 11 , wherein the instructions cause the processor to: determine whether the second sequence of the action states includes the portion of the first sequence of the action states already performed to perform the first task; and perform the second task based on the second sequence of the action states, without repeating the performed portion of the first sequence. 13. The electronic device of claim 1 , wherein the instructions cause the processor to: when the first user input includes the first request for performing the first task on the at least one application program and the received first sequence of the action states is a sequence performed on a single program, after performing the portion of the first sequence of the action states, transmit the first data and information about the performed portion of the first sequence of the action states, to the server through the communication circuit. 14. The electronic device of claim 1 , wherein the intelligence system includes at least one of a path rule-based, ontology-based or deep learning-based system. 15. The electronic device of claim 1 , wherein the second execution state screen is distinguished by the first execution state screen based on the second execution state screen displaying at least one of: an edge, a background color, an adjustment of transparency, or an icon of the display, from the second execution state screen. 16. An electronic device comprising: a housing; a display exposed through a part of the housing; a microphone; a speaker; a communication circuit; a processor electrically connected to the display, the microphone, the speaker, and the communication circuit; and a memory electrically connected to the processor, wherein the memory is configured to store at least one application program, wherein instructions stored by the memory, when executed, cause the processor to: receiv
Probabilistic graphical models, e.g. probabilistic networks · CPC title
Feedforward networks · CPC title
Learning methods · CPC title
Forward inferencing; Production systems · CPC title
Knowledge engineering; Knowledge acquisition · CPC title
Related publications grouped by family.
Answers are generated from the same data shown on this page.