System and method for enhancing content using brain-state data

Patent metadata

Field	Value
Publication number	US-10009644-B2
Application number	US-201314096822-A
Country	US
Kind code	B2
Filing date	Dec 4, 2013
Priority date	Dec 4, 2012
Publication date	Jun 26, 2018
Grant date	Jun 26, 2018

Abstract

A computer system or method may be provided for modulating content based on a person's brainwave data, including modifying presentation of digital content at at least one computing device. The content may also be modulated based on a set of rules maintained by or accessible to the computer system. The content may also be modulated based on user input, including through receipt of a presentation control command that may be processed by the computer system of the present invention to modify presentation of content. Content may also be shared with associated brain state information.

First claim

What is claimed is:

1. A system for videoconferencing at least one user with at least one remote user, the system comprising:
at least one computing device;
at least one bio-signal sensor in communication with the at least one computing device;
at least one user input device in communication with the at least one computing device;
the at least one computing device configured to:
receive digital content over a communication network from at least one remote computing device with at least one remote user, the digital content comprising a video stream and a current brain state from each of the at least one remote user;
present the digital content at the at least one computing device for presentation to the at least one user;
receive bio-signal data of the at least one user from the at least one bio-signal sensor, at least one of the at least one bio-signal sensor comprising a brainwave sensor, and the received bio-signal data comprising at least brainwave data of the at least one user;
determine at least one current brain state of the at least one user in response to the presented digital content using the bio-signal data, the brain state determined based at least partly on received bio-signal data;
transmit the at least one current brain state of the at least one user to the at least one remote computing device for presentation to the at least one remote user;
receive at least one presentation control command from the at least one user via the at least one user input device, wherein the at least one presentation control command comprises an instruction to modify or not modify at least one feature of the presentation of the digital content at the at least one computing device; and
modify presentation of the digital content at the at least one computing device based at least partly on the received bio-signal data, at least one presentation modification rule associated with the presented digital content, and the at least one presentation control command.

2. The system of claim 1 wherein the presentation modifying comprises presenting at least a subset of the received bio-signal data based at least partly on the received bio-signal data.

3. The system of claim 1 wherein the presentation modifying comprises presenting at least one representation of the user's brain state based at least partly on the received bio-signal data, the at least one presentation modification rule, and the at least one presentation control command.

4. The system of claim 1 wherein the received bio-signal data comprises time-coded bio-signal data, and the digital content presentation comprises time-coded presentation data, the at least one computing device configured to synchronize the time-coded bio-signal data to the time-coded presentation data at least partly by synchronizing time stamps between the time-coded bio-signal data and the time-coded presentation data, wherein the time-coded presentation data may be used by the at least one computing device to determine at least one presentation state of the presented digital content at a respective time stamp.

5. The system of claim 4 wherein the presentation modifying comprises modifying presentation of the digital content based at least partly on a correspondence between the time-coded bio-signal data at at least one time stamp with the time-coded presentation data at the at least one time stamp.

6. The system of claim 1 wherein the presentation modifying comprises modifying presentation of the digital content based at least partly on a bio-signal interaction classification profile.

7. The system of claim 6 wherein the bio-signal interaction classification profile is associated with the at least one user.

8. The system of claim 6 wherein the at least one computing device is configured to update the bio-signal interaction classification profile based at least partly on the presentation control command.

9. The system of claim 6 wherein the at least one computing device is configured to update the bio-signal interaction classification profile based at least partly on bio-signal interaction classification data received from at least one computer server over a communications network.

10. The system of claim 1 wherein the at least one computing device is configured to update the at least one presentation modification rule based at least partly on presentation modification rule data received from at least one computer server over a communications network.

11. The system of claim 1 wherein the at least one presentation control command indicates a target brain state, and the presentation modification comprises presenting digital content that is associated with the target brain state at the at least one computing device.

12. The system of claim 1 wherein the presentation modification comprises the at least one computing device sharing at least a part of the presented digital content, or a link thereto, with at least one other user on a content sharing server.

13. The system of claim 12 wherein the sharing comprises associated the received bio-signal data with the shared presented digital content, and sharing the associated received bio-signal data with the at least one other user on the content sharing server.

14. The system of claim 1 wherein the at least one current brain state of the at least one user includes a cognitive load, and wherein the presentation modifying is based at least partly on the cognitive load.

15. A system comprising:
at least one computing device;
at least one bio-signal sensor in communication with the at least one computing device;
at least one user input device in communication with the at least one computing device;
the at least one computing device configured to:
receive digital content over a communication network from at least one remote computing device with at least one remote user, the digital content comprising a video stream and a current brain state from each of the at least one remote user;
present the digital content at the at least one computing device for presentation to the at least one user;
receive bio-signal data of the at least one user from the at least one bio-signal sensor, at least one of the at least one bio-signal sensor comprising a brainwave sensor, and the received bio-signal data comprising at least brainwave data of the at least one user;
determine at least one current brain state of the at least one user in response to the presented digital content, the brain state determined based at least partly on received bio-signal data;
transmit the at least one current brain state of the at least one user to the at least one remote computing device for presentation to the at least one remote user;
receive at least one presentation control command from the at least one user via the at least one user input device, wherein the at least one presentation control command comprises an instruction to modify or not modify at least one feature of the presentation of the digital content at the at least one computing device; and
modify presentation of the digital content at the at least one computing device based at least partly on the at least one determined brain state, at least one presentation modification rule associated with the presented digital content, and the at least one presentation control command associated with the presented digital content.

16. The system of claim 15 wherein the received bio-signal data comprises time-coded bio-signal data, and the digital content presentation comprises time-coded presentation data, the at least one computing device configured to synchronize the time-coded bio-signal data to

Assignees

• Interaxon Inc

Inventors

• Aimone Christopher Allen
• Coleman Trevor Ce
• Garten Ariel Stephanie
• Pino Locillo (Lou) Giuseppe
• Vidyarthi Kapil Jay Mishra
• Baranowski Paul Harrison
• Rupsingh Raul Rajiv
• Chong Tracy Nicole

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• A61B5/163

  by tracking eye movement, gaze, or pupil change · CPC title

• H04L12/1827

  Network arrangements for conference optimisation or adaptation · CPC title

• A61B5/0006

  ECG or EEG signals · CPC title

• A61B5/7455

  characterised by tactile indication, e.g. vibration or electrical stimulation · CPC title