System and method for changing content based on user reaction

Patent metadata

Field	Value
Publication number	US-11145219-B2
Application number	US-201716308502-A
Country	US
Kind code	B2
Filing date	Apr 12, 2017
Priority date	Jun 23, 2016
Publication date	Oct 12, 2021
Grant date	Oct 12, 2021

Abstract

Provided is an information processing apparatus including a processing unit that presents content to a user on a basis of sensor information acquired by a sensor that detects reaction of the user to a stimulus given to the user.

First claim

The invention claimed is:

1. An information processing apparatus, comprising:
a sensor configured to:
detect a first reaction of a user to a stimulus given to the user; and
output first sensor information based on the detected first reaction of the user; and

a processing unit configured to acquire the first sensor information from the sensor, wherein the processing unit includes:
a model setting unit configured to:
specify a sense type of the user among a plurality of sense types based on the acquired first sensor information, wherein
each of the plurality of sense types represents a corresponding way of recognition of the stimulus by the user; and
set a user model of the user based on the specified sense type, wherein the user model represents the first reaction of the user to the stimulus; and

a presentation processing unit configured to control presentation of content to the user based on the set user model.

2. The information processing apparatus according to claim 1 , wherein the processing unit is further configured to control the presentation of the content to the user further based on a user characteristic.

3. The information processing apparatus according to claim 1 , wherein the sensor includes at least one of a biometric sensor configured to acquire biometric information of the user or an imaging device configured to capture an image of the user.

4. The information processing apparatus according to claim 1 , wherein the specified sense type includes at least one of a visual sense type, an auditory sense type, or a tactile sense type.

5. The information processing apparatus according to claim 1 , wherein the model setting unit is further configured to:
in a case where the plurality of sense types corresponds to the first reaction of the user, give weight to the plurality of sense types; and
set the user model of the user based on the weight to the plurality of sense types.

6. The information processing apparatus according to claim 1 , further comprising a storage unit configured to store a specific initial user model as the user model.

7. The information processing apparatus according to claim 1 , wherein
the presentation processing unit is further configured to control presentation of test content to the user, and
the model setting unit is further configured to:
evaluate the first reaction of the user based on the acquired first sensor information,
wherein the acquired first sensor information is based on the presentation of the test content; and

execute initial setting of the user model of the user based on the evaluation of the first reaction of the user.

8. The information processing apparatus according to claim 1 , wherein the model setting unit is further configured to:
acquire second sensor information from the sensor based on the presentation of the content to the user;
evaluate a second reaction of the user based on the acquired second sensor information; and
update the user model of the user based on the evaluation of the second reaction of the user.

9. The information processing apparatus according to claim 1 , wherein the presentation processing unit is further configured to:
set, based on the user model, stimulus information on an impression object of a plurality of objects included in the content, wherein
the impression object is for provision of an impression to the user; and

control presentation of the impression object based on the set stimulus information.

10. The information processing apparatus according to claim 9 , wherein the stimulus information is information to one of scale up or scale down the impression object.

11. The information processing apparatus according to claim 9 , wherein the stimulus information is information to blink the impression object.

12. The information processing apparatus according to claim 9 , wherein the stimulus information is information for addition of speech to the impression object to be displayed.

13. The information processing apparatus according to claim 9 , wherein the stimulus information is information for vibration of a specific equipment together with the presentation of the impression object.

14. The information processing apparatus according to claim 9 , wherein the presentation processing unit is further configured to change the stimulus information based on a degree of importance of the impression object.

15. An information processing method, comprising:
in an information processing apparatus that includes a sensor and a processing unit, wherein the processing unit includes a model setting unit and a presentation processing unit:
detecting, by the sensor, a reaction of a user to a stimulus given to the user;
outputting, by the sensor, sensor information based on the detected reaction of the user;
acquiring, by the processing unit, the sensor information from the sensor;
specifying, by the model setting unit, a sense type of the user among a plurality of sense types based on the acquired sensor information, wherein
each of the plurality of sense types represents a corresponding way of recognition of the stimulus by the user;

setting, by the model setting unit, a user model of the user based on the specified sense type, wherein the user model represents the reaction of the user to the stimulus; and
controlling, by the presentation processing unit, presentation of content to the user based on the set user model.

16. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by an information processing apparatus, cause the information processing apparatus to execute operations, the operations comprising:
detecting, by a sensor of the information processing apparatus, a reaction of a user to a stimulus given to the user;
outputting, by the sensor, sensor information based on the detected reaction of the user;
acquiring, by a processing unit of the information processing apparatus, the sensor information from the sensor;
specifying, by a model setting unit of the processing unit, a sense type of the user among a plurality of sense types based on the acquired sensor information, wherein
each of the plurality of sense types represents a corresponding way of recognition of the stimulus by the user;

setting, by the model setting unit, a user model of the user based on the specified sense type, wherein the user model represents the reaction of the user to the stimulus; and
controlling, by a presentation processing unit of the processing unit, presentation of content to the user based on the set user model.

Assignees

• Sony Corp

Inventors

• Yoshikawa Kiyoshi
• Sazuka Naoya
• Wakita Yoshihiro

Classifications

• G09B5/06 Primary

  with both visual and audible presentation of the material to be studied · CPC title

• A61B5/0816

  Measuring devices for examining respiratory frequency (measuring frequency of electric signals G01R23/00) · CPC title

• G09B21/007

  using both tactile and audible presentation of the information · CPC title

• G09B7/02

  of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student · CPC title

• G09B19/00 Primary

  Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26) · CPC title