Systems and methods for context-aware application control

Patent metadata

Field	Value
Publication number	US-9459889-B2
Application number	US-201514712847-A
Country	US
Kind code	B2
Filing date	May 14, 2015
Priority date	May 19, 2014
Publication date	Oct 4, 2016
Grant date	Oct 4, 2016

Abstract

A method performed by an electronic device is described. The method includes obtaining sensor information. The method also includes identifying a class of an object based on the sensor information. The method further includes determining one or more actions based on the sensor information, the class of the object and an action usage history. The method additionally includes performing at least one of the one or more actions based on at least one application.

First claim

What is claimed is:

1. A method performed by an electronic device, comprising:
obtaining sensor information;
identifying a class of an object based on the sensor information;
determining one or more actions based on the sensor information, the class of the object and an action usage history; and
performing at least one of the one or more actions based on at least one application.

2. The method of claim 1 , wherein performing at least one of the one or more actions comprises at least one of running a dialer application, running a text message application and running a contacts application when the class of the object is a phone number.

3. The method of claim 1 , wherein performing at least one of the one or more actions comprises running a browser application when the class of the object is a Uniform Resource Locator (URL).

4. The method of claim 1 , wherein performing at least one of the one or more actions comprises running a map application when the class of the object is an address.

5. The method of claim 1 , wherein performing at least one of the one or more actions comprises running an e-mail application when the class of the object is an e-mail address.

6. The method of claim 1 , wherein performing at least one of the one or more actions comprises running a note application when the class of the object is generic text.

7. The method of claim 1 , wherein performing at least one of the one or more actions comprises running a document writer application when the class of the object is a whiteboard object.

8. The method of claim 1 , wherein the sensor information comprises at least one of image information, location information, motion information, and ambient light information.

9. The method of claim 1 , wherein the sensor information comprises image information, wherein the method further comprises performing object detection based on the image information to indicate the object.

10. The method of claim 1 , wherein performing at least one of the one or more actions comprises selecting, from a database, one or more highest ranked actions.

11. The method of claim 1 , wherein determining the one or more actions is further based on temporal information.

12. The method of claim 1 , wherein the action usage history comprises a record of actions performed with contextual information.

13. The method of claim 1 , further comprising ranking the one or more actions based on the class of the object.

14. The method of claim 13 , further comprising ranking the one or more actions based on the action usage history.

15. The method of claim 14 , comprising ranking the one or more actions by associating weights based on a number of times an action is performed according to the action usage history and a number of times the class of the object is used to perform the action.

16. An electronic device configured to provide a context-aware application, comprising:
a processor configured to obtain sensor information, to identify a class of an object based on the sensor information, to determine one or more actions based on the sensor information, the class of the object and an action usage history, and to perform at least one of the one or more actions based on at least one application; and
a memory in electronic communication with the processor, wherein the memory is configured to store the action usage history.

17. The electronic device of claim 16 , wherein the processor is configured to run a search application when the class of the object is a grocery item.

18. The electronic device of claim 16 , wherein the processor is configured to run a banking application when the class of the object is banking information.

19. The electronic device of claim 16 , wherein the processor is configured to run a payment application when the class of the object is payment information.

20. The electronic device of claim 16 , wherein the processor is configured to run at least one of a contacts application, a dialer application, a text messaging application and a search application when the class of the object is a face.

21. The electronic device of claim 16 , wherein the processor is configured to run at least one of a search application, a contacts application, a dialer application, a text messaging application and a browser when the class of the object is a barcode.

22. The electronic device of claim 16 , wherein the sensor information comprises at least one of image information, location information, motion information, and ambient light information.

23. The electronic device of claim 16 , wherein the sensor information comprises image information, wherein the processor is configured to perform object detection based on the image information to indicate the object, and wherein the electronic device comprises a display in electronic communication with the processor, wherein the display is configured to present an image corresponding to the image information.

24. The electronic device of claim 16 , wherein the electronic device is a wireless communication device, an automobile, a drone or a robot.

Assignees

• Qualcomm Inc

Inventors

• Huang Pengjun
• Deng Fan
• Ma Lei
• Zheng Baozhong
• Kandhadai Ananthapadmanabhan Arasanipalai

Classifications

• G06F9/466

  Transaction processing · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F9/542

  Event management; Broadcasting; Multicasting; Notifications · CPC title

• G06F9/4451 Primary

  User profiles; Roaming · CPC title