Providing recommendations based upon environmental sensing

Patent metadata

Field	Value
Publication number	US-2016255401-A1
Application number	US-201615152137-A
Country	US
Kind code	A1
Filing date	May 11, 2016
Priority date	Feb 5, 2013
Publication date	Sep 1, 2016
Grant date	—

Abstract

Embodiments are disclosed that relate to providing digital content recommendations based upon environmental sensor data. For example, one embodiment provides a computing device configured to receive sensor data from a sensor system, to detect a user present in the use environment via the sensor data, identify the user, recognize a current state of each of one or more use environment state features associated with the user via the sensor data, and store the current state of each of the one or more use environment state features. The computing device is further configured to detect a triggering condition for a selected use environment state feature, and in response provide information related to the selected use environment state feature based upon one or more of the current state of the use selected use environment state feature and a previously-stored state of the selected use environment state feature.

First claim

1 . A computing device, comprising:
a logic subsystem; and a data storage subsystem comprising instructions stored thereon that are executable by the logic subsystem to:
receive sensor data from a sensor system including one or more sensors configured to acquire the sensor data by monitoring a use environment;
associate the sensor data with a user;
recognize a current state of each of one or more use environment state features associated with the user via the sensor data;
store the current state of each of the one or more use environment state features;
detect a triggering condition for a selected use environment state feature; and
upon detecting the triggering condition, provide information related to the selected use environment state feature based upon one or more of the current state of the use selected use environment state feature and a previously-stored state of the selected use environment state feature.

2 . The computing device of claim 1 , where the current state of each of the one or more use environment features is stored via one or more of a local storage machine and a remote storage machine.

3 . The computing device of claim 1 , where the instructions are further executable to determine whether the user has provided authorization to be monitored by the sensor system, where the current state of each of the one or more use environment state features associated with the user are stored only if the user has provided authorization.

4 . The computing device of claim 1 , further comprising capturing the sensor data at a first, lower bitrate corresponding to a passive monitoring mode when no activity is detected, and at a second, higher bitrate corresponding to an active monitoring mode when activity is detected.

5 . The computing device of claim 1 , where the selected use environment state feature includes one of a physical feature of the user, an activity performed by the user, and a device being operated by the user.

6 . The computing device of claim 5 , where the triggering condition includes a change in the physical feature of the user meeting a triggering threshold.

7 . The computing device of claim 6 , where the information related to the selected use environment feature includes one or more of information describing the change in the physical feature, a recommendation of goods or services related to the physical feature, and a recommendation of one or more changes to user behavior.

8 . The computing device of claim 1 , where the selected use environment state feature includes one of an identity of a content item being consumed in the use environment, an identity of a constituent component of the content item being consumed in the use environment, a device accessing the content item, and a current access position of the content item.

9 . The computing device of claim 8 , where the triggering condition includes a user input requesting provision of the information related to the selected use environment state feature.

10 . The computing device of claim 8 , where the information related to the selected use environment state feature includes one or more of information regarding a related content item, auxiliary information for the content item, and a link to acquire an instance of the content item.

11 . The computing device of claim 1 , where the one or more sensors include one or more of an audio sensor and an image sensor.

12 . A method for monitoring a use environment, the method comprising:
acquiring first sensor data at a first bitrate via one or more sensors monitoring the use environment, the first bitrate corresponding to a passive monitoring mode; recognizing activity in the use environment based on the first sensor data; in response, acquiring second sensor data at a second bitrate via the one or more sensors, the second bitrate being higher than the first bitrate and corresponding to an active monitoring mode; recognizing in the use environment a content item being consumed in the use environment via the second sensor data; and providing information related to the content item.

13 . The method of claim 12 , where recognizing activity in the use environment comprises detecting one or more of motion meeting a motion threshold, sound meeting a sound threshold, and a user present in the use environment.

14 . The method of claim 12 , where recognizing the content item being experienced in the use environment comprises comparing an audio sample of the second sensor data representing the content item to known audio information.

15 . The method of claim 12 , where recognizing the content item being experienced in the use environment comprises comparing an image sample of the second sensor data representing the content item to known image information.

16 . The method of claim 12 , where recognizing the content item being experienced in the use environment includes identifying a source of the content item.

17 . The method of claim 12 , further comprising adding the content item to a content playlist.

18 . The method of claim 12 , further comprising recognizing a number of users present in the use environment, where the information related to the selected use environment state feature is selected based upon the number of users.

19 . A computing device, comprising:
a logic subsystem; and a data storage subsystem comprising instructions stored thereon that are executable by the logic subsystem to:
receive first sensor data from a sensor system including one or more sensors configured to acquire data via monitoring a use environment, the first sensor data acquired at a first bitrate corresponding to a passive monitoring mode;
detect a user present in the use environment via the first sensor data;
receive second sensor data from the sensor system, the second sensor data acquired at a second bitrate corresponding to an active monitoring mode, the second bitrate being higher than the first bitrate;
identify the user;
upon identifying the user, recognize a current state of each of one or more use environment state features associated with the user via the second sensor data;
store the current state of each of the one or more use environment state features;
detect a triggering condition for a selected use environment state feature; and
upon detecting the triggering condition, provide information related to the selected use environment state feature based upon one or more of the current state of the use selected use environment state feature and a previously-stored state of the selected use environment state feature.

20 . The computing device of claim 19 , the instructions being further executable to determine whether the user has provided authorization to be monitored by the sensor system by recognizing one or more of previously-defined authorization information and an authorization gesture, where the current state of each of one or more use environment features is not stored authorization to be monitored by the sensor system has not been provided.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Hayton Mike
• Johnson Zach

Classifications

• G06F16/436

  using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures · CPC title

• H04N21/8126

  involving additional data, e.g. news, sports, stocks, weather forecasts · CPC title

• H04N21/4668 Primary

  for recommending content, e.g. movies · CPC title

• H04N21/44218

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title

• H04N21/42202

  environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes · CPC title