Multi-user sensor-based interactions

Patent metadata

Field	Value
Publication number	US-9633622-B2
Application number	US-201414575797-A
Country	US
Kind code	B2
Filing date	Dec 18, 2014
Priority date	Dec 18, 2014
Publication date	Apr 25, 2017
Grant date	Apr 25, 2017

Abstract

Disclosed in some examples are methods systems and machine readable mediums in which actions or states of a first user (e.g., natural interactions) having a first corresponding computing device are observed by a sensor on a second computing device corresponding to a second user. A notification describing the observed actions or states of a first user may be shared across a network with the first corresponding computing device. In this way, the first computing device may be provided with information concerning the state of the user without having to directly sense the user.

First claim

What is claimed is:

1. A central computing device comprising:
one or more computer processors configured to include:
a notification module to:
receive, over a computer network, a first notification from a first computing device, the first notification including data determined from a sensor on the first computing device, the data determined from the sensor indicating information determined about a user associated with a second computing device;

a control module to:
confirm that the second computing device is registered with an augmented reality application; and

a model module to:
calculate an updated model in response to confirming the second computing device is registered using the data determined from the sensor, the updated model describing at least a portion of a real world including a state for the user describing an inferred emotion of the user;

the control module to, in response to confirming that the second computing device is registered:
send a second notification to the second computing device, wherein the second notification includes at least a portion of the updated model describing the state for the user describing the inferred emotion of the user, the second computing device displaying the inferred emotion to the user; and
send a third notification to the first computing device, wherein the third notification includes at least a portion of the updated model.

2. The central computing device of claim 1 , wherein the first notification comprises raw sensor data.

3. The central computing device of claim 1 , wherein the first notification comprises raw sensor data, and wherein the control module is further configured to determine model data about the user from the raw sensor data.

4. The central computing device of claim 3 , wherein the model data includes action information describing an action of the user.

5. The central computing device of claim 1 , wherein the first notification comprises action information describing an action of the user.

6. The central computing device of claim 1 , wherein the augmented reality application is a game.

7. The central computing device of claim 1 , wherein the augmented reality application is an application which displays a state of the user to the user, the state detected by the second computing device.

8. At least one non-transitory machine-readable medium, including instructions, which when performed by a machine cause the machine to perform operations for a collaborative multi-user interaction service, the operations comprising:
receiving, over a computer network, a first notification from a first computing device, the first notification including data determined from a sensor on the first computing device, the data determined from the sensor indicating information about a user associated with a second computing device;
confirming that the second computing device is registered with an augmented reality application; and
responsive to confirming that the second computing device is registered to the augmented reality application:
calculating, using the data determined from the sensor, an updated model, the updated model describing at least a portion of a real world including a state for the user describing an inferred emotion of the user;
sending a second notification to the second computing device, wherein the second notification includes at least a portion of the updated model describing the state for the user describing the inferred emotion of the user, the second computing device displaying the inferred emotion for the user to the user; and
sending a third notification to the first computing device, wherein the third notification includes at least a portion of the updated model.

9. The at least one machine-readable medium of claim 8 , wherein the first notification comprises raw sensor.

10. The at least one machine-readable medium of claim 8 , wherein the model includes action information describing an action of the user.

11. The at least one machine-readable medium of claim 8 , wherein the augmented reality application is a game.

12. The at least one machine-readable medium of claim 8 , wherein the augmented reality application is an application which displays an action of the user to the user, the action detected by the second computing device.

13. A computing device participating in a collaborative multi-user interaction service, the computing device comprising:
one or more computer processors configured to include:
a registration module to:
send a registration message to a central computing device, the registration message registering the computing device with the central computing device;

a notification module to:
receive a notification from the central computing device, wherein the notification comprises data determined about a user of the computing device from a forward-facing sensor on a second computing device, the notification includes at least a portion of an updated model calculated by the central computing device and describing a state for the user, the state for the user including an emotion of the user inferred by the central computing device; and

a control module to:
utilize the data determined about the user of the computing device in a sensor-based application coupled to the computing device, by at least displaying an indication of the inferred emotion to the user.

14. The computing device of claim 13 , wherein the second computing device is also participating in a same augmented reality.

15. The computing device of claim 14 , wherein the includes state information describing a state of the user.

16. The computing device of claim 13 , wherein the sensor-based application is a game, and wherein the first and second notifications are inputs that act on an object from the game.

17. At least one non-transitory machine-readable medium, including instructions, which when performed by a machine cause the machine to perform operations for a collaborative multi-user interaction service, the operations comprising:
at a first computing device associated with a user:
sending a registration message to a central computing device, the registration message registering the first computing device with the central computing device;
receiving a notification from the central computing device, wherein the notification comprises data determined about the user from a forward-facing sensor on a second computing device, the notification includes at least a portion of an updated model calculated by the central computing device and describing a state for the user, the state for the user including an emotion of the user inferred by the central computing device; and
utilizing the data determined about the user of the computing device in a sensor-based application coupled to the computing device by at least displaying an indication of the inferred emotion to the user.

18. The at least one machine-readable medium of claim 17 , wherein the model includes state information describing a state of the user.

19. The at least one machine-readable medium of claim 17 , wherein the model includes action information describing an action of the user.

20. The at least one machine-readable medium of claim 17 , wherein the sensor-based application is a game, and wherein the first and second notifications are inputs that act on an object from the game.

Assignees

• Intel Corp

Inventors

• Kamhi Gila
• Ferens Ron
• Cooperman Vladimir Vova
• Nistel Kobi
• Hurwitz Barak

Classifications

• G06F9/542

  Event management; Broadcasting; Multicasting; Notifications · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G2358/00

  Arrangements for display data security · CPC title

• G09G2370/10

  Use of a protocol of communication by packets in interfaces along the display data pipeline · CPC title

• G06F3/14 Primary

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title