Method of providing speech recognition service and electronic device for same

Patent metadata

Field	Value
Publication number	US-11474780-B2
Application number	US-202016791073-A
Country	US
Kind code	B2
Filing date	Feb 14, 2020
Priority date	Feb 14, 2019
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

An electronic device includes a communication circuit, a display, a microphone, a processor operatively connected to the communication circuit, the display, and the microphone, and a memory operatively connected to the processor, wherein the memory is configured to store instructions which, when executed, cause the processor to control the electronic device to: transmit information related to a predetermined event to a server through the communication circuit in response to detection of the predetermined event through an application, display a user interface through the display in response to reception of information related to the user interface including at least one visual object selectable by a user to control a function of the application through the communication circuit, receive a user-uttered input for selecting one of the at least one visual object included in the user interface through the microphone, and transmit information related to the user-uttered input to the server through the communication circuit to perform a function corresponding to the visual object selected by the user-uttered input.

First claim

What is claimed is:

1. An electronic device comprising:
a communication circuit;
a display;
a microphone;
a processor operatively connected to the communication circuit, the display, and the microphone; and
a memory operatively connected to the processor,
wherein the memory is configured to store instructions which, when executed, cause the processor to control the electronic device to:
detect a predetermined event through application,
identify a preference for the application, wherein the preference for the application has a value based on recorded user-uttered input information to control a function of the application,
in response to the preference being greater than or equal to a reference value, transmit information related to the predetermined event to a server through the communication circuit in response to detection of the predetermined event through an application, wherein the predetermined event is performed by the application in response to receiving a communication request or a message from an external device through the communication circuit,
display a user interface through the display in response to reception of information related to the user interface through the communication circuit from the server, the user interface including at least one visual object selectable by a user to control a function of the application,
receive a user-uttered input for selecting one of the at least one visual object included in the user interface through the microphone, and
transmit information related to the user-uttered input to the server through the communication circuit to perform a function corresponding to the visual object selected by the user-uttered input,
wherein the information related to the predetermined event includes information on generation of the user interface.

2. The electronic device of claim 1 , wherein the instructions, when executed, further cause the processor to control the electronic device to: receive a control signal for performing a function of an application corresponding to the visual object selected by the user-uttered input from the server through the communication circuit and perform the function of the application corresponding to the visual object selected by the user-uttered input.

3. The electronic device of claim 1 , wherein the information related to the predetermined event comprises at least one piece of information on an application corresponding to the predetermined event, information on generation of the user interface, or identification information of the electronic device.

4. The electronic device of claim 1 , wherein the information related to the predetermined event comprises at least one piece of information related to an intent corresponding to the predetermined event, or identification information of the electronic device.

5. The electronic device of claim 1 , wherein the instructions, when executed, further cause the processor to control the electronic device to: identify a preference for the application in response to detection of the predetermined event, determine whether the preference for the application is greater than a reference value, and based on the preference for the application being greater than the reference value, transmit the information related to the predetermined event to the server through the communication circuit.

6. The electronic device of claim 5 , wherein the instructions, when executed, further cause the processor to control the electronic device to restrict transmission of the information related to the predetermined event based on the preference for the application not being greater than the reference value.

7. The electronic device of claim 5 , wherein the instructions, when executed, further cause the processor to control the electronic device to control the preference for the application based on a use time of the application, a use frequency, or the user-uttered input.

8. The electronic device of claim 1 , wherein the instructions, when executed, further cause the processor to control the electronic device to limit transmission of the information related to the predetermined event based on the electronic device not operating in a predetermined mode.

9. A server comprising:
a communication circuit;
a processor operatively connected to the communication circuit; and
a memory operatively connected to the processor,
wherein the memory is configured to store instructions which, when executed, cause the processor to control the server to:
receive information related to a predetermined event from an electronic device through the communication circuit, wherein the predetermined event is performed by an application executed by the electronic device in response to receiving a communication request or a message,
identify a preference for the application in response to reception of the information related to the predetermined event, the preference for the application has a value based on recorded user-uttered input information to control a function of the application,
in response to the preference for the application being greater than or equal to a reference value, generate a user interface including at least one visual object selectable by a user to control a function of an application corresponding to the predetermined event based on the information related to the predetermined event, wherein the received information related to the predetermined event includes information on generation of the user interface and the user interface is generated based on the received information on generation of the user interface,
transmit information related to the user interface to the electronic device through the communication circuit,
receive information related to a user-uttered input for selecting one of the at least one visual object included in the user interface from the electronic device through the communication circuit, and
transmit a control signal for performing a function of an application corresponding to the visual object selected by the user-uttered input to the electronic device through the communication circuit based on the information related to the user-uttered input.

10. The server of claim 9 , wherein the information related to the predetermined event comprises at least one piece of information on an application corresponding to the predetermined event, information related to a function of the application, or identification information of the electronic device.

11. The server of claim 9 , wherein the instructions, when executed, cause the processor to control the server to: select an application corresponding to the predetermined event among at least one application stored in the memory based on the information related to the predetermined event and generate the user interface based on the selected application.

12. The server of claim 9 , wherein the information related to the predetermined event comprises at least one piece of information related to an intent corresponding to the predetermined event, or identification information of the electronic device.

13. The server of claim 12 , wherein the instructions, when executed, further cause the processor to control the server to: identify an intent corresponding to the predetermined event based on the information related to the predetermined event, determine a function corresponding to the intent based on intent information stored in the memory, and generate the user interface based on the determined function.

14. The server of claim 9 , wherein the instructions, when executed, further cause the processor to control the server to: identify a preference for the application in response to rece

Assignees

• Samsung Electronics Co Ltd

Inventors

• Yang Jaeyoung
• Suh Donghee
• Jaygarl Hojun
• Kim Minsung
• Kim Jinwoong
• Kim Youngbin
• Lee Kwangbin
• Lee Youngmin

Classifications

• G10L15/04

  Segmentation; Word boundary detection · CPC title

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L2015/225

  Feedback of the input speech · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title