Context aware service provision method and apparatus of user device

Patent metadata

Field	Value
Publication number	US-11048474-B2
Application number	US-201916407803-A
Country	US
Kind code	B2
Filing date	May 9, 2019
Priority date	Sep 20, 2012
Publication date	Jun 29, 2021
Grant date	Jun 29, 2021

Abstract

A context aware service provision method and apparatus for recognizing the user context and executing an action corresponding to the user context according to a rule defined by the user and feeding back the execution result to the user interactively are provided. The method for providing a context-aware service includes receiving a user input, the user input being at least one of a text input and a speech input, identifying a rule including a condition and an action corresponding to the condition based on the received user input, activating the rule to detect a context which corresponds to the condition of the rule, and executing, when the context is detected, the action corresponding to the condition.

First claim

What is claimed is:

1. A method for providing a context-aware service using an electronic device, the method comprising at least:
providing, for display on a touchscreen of the electronic device, a screen of a context-aware service application being executed, the screen of the context-aware service application including a user selectable visual element for adding a rule;
based on receiving a first user input to the user selectable visual element for adding the rule, providing, for display on the touchscreen of the electronic device, an interactive user interface for interacting with a user of the electronic device to add the rule, the first user input being a touch input to the user selectable visual element for adding the rule;
providing, for display on the touchscreen of the electronic device, a first guidance by the interactive user interface for adding at least one condition of the rule, the first guidance guiding the user of the electronic device to enter text for a condition of the rule that is meetable based on receiving speech that corresponds to the entered text;
based on receiving at least one second user input, the at least one second user input being a text input, identifying a first condition of the rule, the first condition being meetable based on receiving speech that corresponds to the text input of the at least one second user input;
providing, for display on the touchscreen of the electronic device, a second guidance by the interactive user interface for adding at least one action of the rule;
based on receiving a third user input, identifying a first action of the rule based on the third user input, the first action of the rule corresponding to a first performable operation;
providing again, for display on the touchscreen of the electronic device, the second guidance by the interactive user interface for adding at least one action of the rule;
based on receiving a fourth user input, identifying a second action of the rule based on the fourth user input, the second action of the rule corresponding to a second performable operation;
receiving a fifth user input for storing the rule including the first condition of the rule, the first action of the rule, and the second action of the rule;
based on receiving a sixth user input, the sixth user input being a speech input for meeting the first condition, determining whether the first condition of the rule is met based on whether the speech input of the sixth user input corresponds to the text input of the at least one second user input; and
based on a determination that the first condition of the rule is met, performing both the first action of the rule and the second action of the rule,
wherein the first guidance by the interactive user interface for adding the at least one condition of the rule that guides the user of the electronic device to enter the text for the condition of the rule that is meetable based on receiving the speech that corresponds to the entered text, and the second guidance by the interactive user interface for adding the at least one action of the rule, are provided, for display on the touchscreen of the electronic device, at different times, and
wherein upon the receiving of the second user input, the providing, for display on the touchscreen of the electronic device, of the first guidance by the interactive user interface for adding the at least one condition of the rule is discontinued.

2. The method of claim 1 , wherein the determining of whether the first condition of the rule is met based on whether the speech input of the sixth user input corresponds to the text input of the at least one second user input comprises at least:
determining whether the speech input of the sixth user input corresponds to the text input of the at least one second user input based on results of a speech recognition performed on the speech input of the sixth user input.

3. The method of claim 1 , further comprising at least:
providing again, for display on the touchscreen of the electronic device, the first guidance by the interactive user interface for adding at least one condition of the rule; and
based on receiving a seventh user input, identifying a second condition of the rule based on the seventh user input,
wherein the second condition of the rule is based on at least one of location, schedule, time, an event of the electronic device, or one or more spoken words or sounds.

4. The method of claim 1 , wherein the first action and the second action are each at least one of:
sending a message,
changing a device setting,
music playback,
providing weather information,
providing information from an external server,
providing information to the external server, or
providing control of an external device.

5. The method of claim 1 , further comprising at least:
based on receiving a user selection of a button for inputting the sixth user input, entering a mode for receiving the speech input of the sixth user input.

6. The method of claim 1 , wherein the screen of the context-aware service application including the user selectable visual element for adding the rule includes one or more delineated areas that each correspond to a saved rule.

7. The method of claim 6 ,
wherein each delineated area of the one or more delineated areas includes at least one of an icon, a textual description, and another user selectable visual element, and
wherein the other user selectable visual element is for providing, for display on a touchscreen of the electronic device, information regarding a corresponding rule based on the other user selectable visual element being selected.

8. The method of claim 1 , further comprising at least:
based on receiving the text input of the at least one second user input, providing, for display on a touchscreen of the electronic device, the text input of the at least one second user input.

9. The method of claim 1 , further comprising at least:
based on a user selection of another user selectable visual element, the other user selectable visual element being for confirming the rule, confirming the rule including the first condition of the rule, the first action of the rule, and the second action of the rule.

10. The method of claim 1 , wherein data for the context-aware service is communicated with an external server.

11. A non-transitory computer readable storage medium with instructions stored thereon to provide a context-aware service using an electronic device, the instructions executable by a processor of the electronic device to cause the processor to at least:
control to provide, for display on a touchscreen of the electronic device, a screen of a context-aware service application being executed, the screen of the context-aware service application including a user selectable visual element for adding a rule;
based on receiving a first user input to the user selectable visual element for adding the rule, control to provide, for display on the touchscreen of the electronic device, an interactive user interface for interacting with a user of the electronic device to add the rule, the first user input being a touch input to the user selectable visual element for adding the rule;
control to provide, for display on the touchscreen of the electronic device, a first guidance by the interactive user interface for adding at least one condition of the rule, the first guidance guiding the user of the electronic device to enter text for a condition of the rule that is meetable based on receiving speech that corresponds to the entered text;
based on receiving at least one second user input, the at least one second user input being a text input, control to identify a first condition of the

Assignees

• Samsung Electronics Co Ltd

Inventors

• Bae Jooyoon
• Ko Minjeong
• Kim Sungsoo
• Kim Jinsung
• Kim Hwakyung
• Jun Jinha

Classifications

• G06F3/038

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• H04M2250/74

  with voice recognition means · CPC title

• H04M1/72454 Primary

  according to context-related or environment-related conditions · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title