System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications

Patent metadata

Field	Value
Publication number	US-9569986-B2
Application number	US-201313779497-A
Country	US
Kind code	B2
Filing date	Feb 27, 2013
Priority date	Feb 27, 2012
Publication date	Feb 14, 2017
Grant date	Feb 14, 2017

Abstract

A system and method for measuring biologically and behaviorally based responses to social media, locations, or experiences and providing instant and continuous feedback in response thereto. The system and method of the invention is capable of monitoring stress levels and well-being and may be implemented using a cloud-based infrastructure for remote monitoring.

First claim

What is claimed is:

1. A system comprising:
a first sensor to determine an activity of a mobile device;
a second sensor to determine an environment surrounding the mobile device;
a third sensor to measure biometric parameters associated with a user of the mobile device; and
a processor to execute instructions to:
determine an emotional response of the user based on the biometric parameters;
associate the activity related to the mobile device and the environment surrounding the mobile device with the emotional response of the user;
detect a social media action performed by the user in a social media application;
correlate the social media action with the emotional response, the activity of the mobile device, and the environment surrounding the mobile device; and
create and store a record of the correlation of the social media action with the emotional response, the activity of the mobile device, and the environment surrounding the mobile device;
automatically perform the social media action a subsequent time in accordance with the record based on (1) a subsequent determination of the emotional response and (2) a subsequent determination of one or more of (a) the activity of the mobile device or (b) the environment surrounding the mobile device, wherein the social media action is performed in accordance with a priority schedule that prioritizes association of the subsequent emotional response and the subsequent activity of the mobile device over the association of the subsequent emotional response and the subsequent environment.

2. The system of claim 1 , wherein the mobile device is configured to access a marketing or advertising application, or a combination thereof.

3. The system of claim 1 , wherein the mobile device is at least one of a smart phone, a tablet, a laptop, a desktop, goggles, and a watch.

4. The system of claim 1 , including an image acquisition device capable of acquiring at least one of an image or a video representing the user's view, the user, or a combination thereof.

5. The system of claim 4 , wherein the processor is to perform image recognition on at least one of the image or the video representing the user's view.

6. The system of claim 4 , wherein the processor is to perform facial recognition on at least one of the image and the video.

7. A system comprising:
a first sensor to determine social media being accessed by a mobile device in a social media application;
a second sensor to determine an environment surrounding the mobile device;
a third sensor to measure a biometric parameter associated with a user of the mobile device;
a memory including machine executable instructions; and
a processor to execute the instructions to:
determine an emotional response of the user based on the biometric parameter;
associate the social media accessed by the user and the environment surrounding the mobile device with the emotional response;
detect a social media action performed by the user in response to the social media;
correlate the emotional response to the social media action performed by the user, the social media accessed by the user, and the environment surrounding the mobile device;
create and store a record of the correlation of the social media action with the emotional response, the social media accessed by the user, and the environment surrounding the mobile device; and
automatically perform the social media action a subsequent time in accordance with the record based on (1) a subsequent determination of the emotional response and (2) a subsequent determination of one or more of (a) the social media accessed by the user or (b) the environment surrounding the mobile device, wherein the social media action is performed in accordance with a priority schedule that prioritizes association of the subsequent emotional response and the subsequent accessing of the social media over association of the subsequent emotional response and the subsequent environment.

8. The system of claim 7 , wherein the third sensor includes at least two biometric sensors.

9. The system of claim 8 , wherein the at least two biometric sensors are structured to measure at least two of galvanic skin response, heart response, motion, skin temperature, breathing, EEG, EMG, pupil dilation, eye tracking, facial recognition, or a combination thereof.

10. The system of claim 9 , further including an image acquisition device to acquire an image in the user's view, an image of the user, or a combination thereof.

11. The system of claim 10 , wherein the processor is to perform image recognition on the image in the user's view, the image of the user, or the combination thereof.

12. The system of claim 7 , wherein the processor is to collect motion data to determine activity level, direction, or a combination thereof.

13. The system of claim 7 , wherein the processor is to determine a current activity of the user.

14. The system of claim 13 , wherein the processor is to transmit the current activity and the emotional response to an application residing on the mobile device or on a central server.

15. The system of claim 7 , wherein the processor is provide tailored content to the user based on the emotional response.

16. The system of claim 7 , wherein the processor is to modify a social media feed based on the emotional response.

17. The system of claim 1 , wherein the third sensor is to monitor vital signs and biological signatures for well-being and share the vital signs and biological signatures with a health care provider.

18. The system of claim 1 , wherein the processor is to determine if a second mobile device is in proximity to the mobile device and to add contact information relating to the second mobile device to the mobile device in response to selection of an affinity input by the user.

19. The system of claim 1 , wherein the processor is to associate a signature of biometric parameters to the activity of the user.

20. The system of claim 19 , wherein the processor is to suggest a further activity to the user based on the emotional response matching the signature.

21. The system of claim 19 , wherein the processor is to determine the further activity based on the signature.

22. The system of claim 1 , wherein the biometric parameters include at least one of: galvanic skin response, heart response, motion, skin temperature, breathing, EEG, EMG, pupil dilation, eye tracking, or facial expressions.

23. The system of claim 1 , wherein the processor is to execute machine learning to identify the activity related to the mobile device, to execute the machine learning the processor is to at least one of:
analyze user input from a training period,
use a background service to monitor activities on the mobile device,
use a most recently opened item on the mobile device, or
prioritize activities based on respective types of the activities.

Assignees

• Nielsen Co Us Llc

Inventors

• Levine Brian
• Marci Carl
• Kothuri Ravi Kanth V

Classifications

• A61B5/0533

  Measuring galvanic skin response · CPC title

• A61B3/112

  for measuring diameter of pupils · CPC title

• A61B5/0077

  Devices for viewing the surface of the body, e.g. camera, magnifying lens · CPC title

• A61B5/165

  Evaluating the state of mind, e.g. depression, anxiety · CPC title

• G09B25/00 Primary

  Models for purposes not provided for in G09B23/00, e.g. full-sized devices for demonstration purposes (model vehicles, tracks therefor, models in the nature of toys A63H) · CPC title