Emotion-related query processing

Patent metadata

Field	Value
Publication number	US-9594807-B2
Application number	US-201314127951-A
Country	US
Kind code	B2
Filing date	Aug 6, 2013
Priority date	Aug 6, 2013
Publication date	Mar 14, 2017
Grant date	Mar 14, 2017

Abstract

Embodiments of techniques, apparatuses and systems associated with emotion information processing are disclosed. In some embodiments, a computing system may receive an image of a person and identify an emotional state of the person, based at least in part on the image. The computing system may cause storage of the emotional state of the person in combination with other data to enable subsequent response to an emotion-related query provided to the computing system. The emotion-related query may include an emotion-related criteria and a non-emotion-related criteria and the response may be based at least in part on the emotional state in combination with at least some of the other data. Other embodiments may be described and/or claimed.

First claim

What is claimed is:

1. An apparatus for facilitating emotion-related query, comprising:
an input device interface to receive an image of a person;
a memory; and
logic, coupled to the input device interface and the memory, wherein the logic is to:
identify an identity of the person and a context associated with the image, based at least in part on the image, wherein the context associated with the image is based in part on an environment in which the image was captured, wherein the logic is to identify the context based on one or more non-human objects identified in the image, and at least one of one or more sounds in audio data obtained by the input device interface or one or more measurements in sensor data obtained by the input device interface;
determine an emotional state of the person based on one or more facial features of the person and the context;
cause storage of the identity of the person, the emotional state of the person, and the context, in the memory, in combination with other data wherein the other data includes data associating the person, the context, and the emotional state of the person; and
provide, in response to an emotion-related query, information based at least in part on the stored emotional state in combination with at least some of the other data, wherein the emotion-related query comprises an emotion-related criteria and a non-emotion-related criteria, wherein the non-emotion related criteria includes association of the person with the emotion-related criteria to be searched in response to the emotion-related query.

2. The apparatus of claim 1 , wherein the image is captured by an image capture device included in a wearable computing device that is a different device than the apparatus, wherein the image capture device faces away from a user of the wearable computing device.

3. The apparatus of claim 2 , wherein the apparatus is a handheld computing device in wireless communication with the wearable computing device.

4. The apparatus of claim 1 , wherein:
the image is captured by an image capture device;
the apparatus is remote from the image capture device; and
the input device interface is to receive captured images from a plurality of image capture devices.

5. The apparatus of claim 1 , wherein determine an emotional state of the person comprises determine the identity of the person.

6. The apparatus of claim 5 , wherein determine the identity of the person comprises:
determine a facial signature of the person based on the image;
provide the facial signature to facial identity logic, the facial identity logic configured to output, based on the facial signature of the person, an identifier of the person or an indicator that the person could not be identified based on the facial signature;
receive an indicator that the person could not be identified based on the facial signature;
receive an identifier of the person from a source other than the facial identity logic; and
in response to receiving the indicator that the person could not be identified based on the facial signature and the identifier, cause the storage of the facial signature of the person, in combination with the identifier, in a set of data used for training the facial identity logic.

7. The apparatus of claim 5 , wherein determine the identity of the person comprises:
detect a key phrase in audio data captured in a time period prior to or including a time at which the image was captured; and
determine an identifier of the person based at least in part on the detected key phrase;
wherein the other data stored in combination with the emotional state of the person comprises the identifier.

8. The apparatus of claim 1 , wherein the other data comprises an identifier of the person, a time at which the image was captured, a location at which the image was captured, or an object identified in the image.

9. The apparatus of claim 1 , wherein the image is a first image and the person is a first person, and wherein the logic is further to:
receive a second image of the same person or a second person; and
determine a second emotional state of the same or second person in the image;
wherein causing storage comprises causing storage of the second emotional state of the same or second person in combination with other data, wherein the information to be provided in response to the emotion-related query is further based at least in part on the stored first and second emotional states in combination with at least some of the other data.

10. The apparatus of claim 9 , wherein the information is further based at least in part on at least one previously stored emotional state associated with the person in combination with at least some of the other data.

11. The apparatus of claim 1 , wherein the logic is further to:
in response to determine the emotional state of the person in the image, provide information about the emotional state to a display communicatively coupled with an image capture device that captured the image.

12. One or more non-transitory computer readable media having instructions thereon that, when executed by one or more processing devices of a computing system, cause the computing system to:
receive an image of a person;
identify an identity of the person and a context associated with the image, based at least in part on the image, wherein the context associated with the image is based in part on an environment in which the image was captured;
identify the context based on one or more non-human objects identified in the image, and at least one of one or more sounds in audio data obtained by an input device interface or one or more measurements in sensor data obtained by the input device interface;
determine an emotional state of the person based on one or more facial features of the person and the context;
cause storage of the emotional state of the person, the identity of the person, and the context in combination with other data; and
provide, in response to an emotion-related query, information based at least in part on the stored emotional state in combination with at least some of the other data, wherein the emotion-related query comprises an emotion-related criteria and a non-emotion-related criteria, wherein the non-emotion related criteria includes association of the person with the emotion-related criteria to be searched in response to the emotion-related query.

13. The one or more non-transitory computer readable media of claim 12 , wherein the image is captured by an image capture device included in a wearable computing device that is different from a portion of the computing system that determines the emotional state of the person, wherein the image capture device faces away from a user of the wearable computing device.

14. The one or more non-transitory computer readable media of claim 13 , wherein the portion of the computing system that determines the emotional state of the person is a handheld computing device in wireless communication with the wearable computing device.

15. The one or more non-transitory computer readable media of claim 12 , wherein the image is captured by an image capture device and a portion of the computing system that determines the emotional state of a person is remote from the image capture device and receives captured images from a plurality of image capture devices.

16. The one or more non-transitory computer readable media of claim 12 , wherein determine the emotional state of the person comprises determining an identity of the person.

17. The one or more non-transitory computer readable media of claim 16 ,

Assignees

• Rappoport Rinat
• Yehezkel Raanan
• Fishtein Roman
• Goffman Sergei
• Jacob Guy
• Gershon Oren
• Sloutsman Andrey
• Lapidot Ido
• Givoli Ofer
• Intel Corp

Inventors

• Rappoport Rinat
• Yehezkel Raanan
• Fishtein Roman
• Goffman Sergei
• Jacob Guy
• Gershon Oren
• Sloutsman Andrey
• Lapidot Ido
• Givoli Ofer

Classifications

• G06Q10/101 Primary

  Collaborative creation, e.g. joint development of products or services · CPC title

• G06K9/00302

  Physics · mapped topic

• G06T2207/30201

  Face · CPC title

• G06F17/30528 Primary

  Physics · mapped topic

• G06V40/174

  Facial expression recognition · CPC title