Information processing system, information processingmethod, and recording medium

Patent metadata

Field	Value
Publication number	US-11544968-B2
Application number	US-201917044066-A
Country	US
Kind code	B2
Filing date	Feb 18, 2019
Priority date	May 9, 2018
Publication date	Jan 3, 2023
Grant date	Jan 3, 2023

Abstract

An information processing system, an information processing method, and a recording medium, which implement effective information presentation by presentation of information when a user is in a situation where information is easily acceptable, are to be provide. An information processing system including a control unit that controls a presentation unit to present a message to a user when the user is presumed, based on sensing data related to the user, to be in a situation where a message is easily acceptable.

First claim

The invention claimed is:

1. An information processing system, comprising:
control circuitry configured to
determine, based on at least one of biological information of a user or a facial expression of the user, whether the user is in a situation where a message can be accepted;
when determining that the user is in the situation where the message can be accepted, determine whether to present the message to the user by comparing (1) a physical state of the user, as determined by sensing data of the physical state of the user, to (2) a desired physical state of the user, as indicated by a content of the message; and
cause a projector to project the message, only when determining to present the message to the user.

2. The information processing system according to claim 1 , wherein
the system further includes the projector, and
when there is a projection place satisfying a given condition around the user, the control circuitry is further configured to control the projector to project the message onto the projection place.

3. The information processing system according to claim 2 , wherein the control circuitry is further configured to determine, based on sensing data around the user, the projection place satisfying the given condition.

4. The information processing system according to claim 2 , wherein when there is a projection place visually recognizable by the user, the control circuitry is further configured to control the projector to project the message onto the projection place.

5. The information processing system according to claim 2 , wherein the control circuitry is further configured to perform line-of-sight analysis on the user, based on sensing data related to the user, and determine the projection place visually recognizable by the user.

6. The information processing system according to claim 1 , wherein the control circuitry is further configured to control the presentation of the message that is perceptible by the user.

7. The information processing system according to claim 6 , wherein the control circuitry is further configured to present the message by means of at least one of an image or a sound.

8. The information processing system according to claim 1 , wherein when the user is determined to be not in the situation where a message can be accepted, the control circuitry is further configured to present a control guide for bringing the situation of the user into a situation where a message can be accepted.

9. The information processing system according to claim 8 , wherein the control guide presented by the control circuitry is an image or a sound that is aimed to change at least one of a noise situation around the user, the biological information of the user, the facial expression of the user, or motion information of the user.

10. The information processing system according to claim 1 , wherein the control circuitry is further configured to present a control guide to make the physical state of the user match the desired physical state of the user indicated by the content of the message, when the physical state of the user is determined to not match the content of the message.

11. The information processing system according to claim 1 , wherein the control circuitry is further configured to
detect, based on sensing data related to the user, a reaction of the user to the presented message, and
update the situation of the user where a message is acceptable by learning a relation between a result of the detection and a situation of the user.

12. The information processing system according to claim 1 , wherein the control circuitry is further configured to control the presentation, to the user, of the message, which is provided from an external agent system.

13. An information processing method, comprising:
determining, by control circuitry, based on at least one of biological information of a user or a facial expression of the user, whether the user is in a situation where a message can be accepted;
when determining that the user is in the situation where the message can be accepted, determining whether to present the message to the user by comparing (1) a physical state of the user, as determined by sensing data of the physical state of the user, to (2) a desired physical state of the user, as indicated by a content of the message; and
causing a projector to project the message, only when determining to present the message to the user.

14. A non-transitory recording medium storing a program therein for causing a computer to perform a method comprising:
determining, based on at least one of biological information of a user or a facial expression of the user, whether the user is in a situation where a message can be accepted;
when determining that the user is in the situation where the message can be accepted, determining whether to present the message to the user by comparing (1) a physical state of the user, as determined by sensing data of the physical state of the user to (2) a desired physical state of the user, as indicated by a content of the message; and
causing a projector to project the message, only when determining to present the message to the user.

15. The information processing system of claim 1 , wherein the control circuitry is further configured to determine whether or not the user is in the situation where the message can be accepted, based on at least one of heart rate information of the user, body temperature information of the user, or respiration information of the user.

16. The information processing system of claim 1 , wherein the control circuitry is further configured to determine whether or not the user is in the situation where the message can be accepted based on only the facial expression of the user.

17. The information processing system of claim 1 , wherein the control circuitry is further configured to perform a line-of-sight analysis on the user based on sensing data related to the user, determine a projection place visually recognizable by the user based on the line-of-sight analysis, and control the projector to project the message onto the determined projection place, wherein the line-of-sight analysis determines a direction in which the user is looking.

18. The information processing system of claim 1 , wherein the control circuitry is further configured to determine the desired physical state of the user by performing semantic analysis on the content of the message.

19. The information processing system of claim 1 , wherein the control circuitry is further configured to determine the desired physical state of the user by extracting supplemental information included in the message.

20. The information processing system of claim 1 , wherein the control circuitry is further configured to, only when determining that the user is in the situation where the message can be accepted, determine whether there is one of a single-color plane, a mirror surface, and a still-water surface at a projectable distance onto which the message can be projected by the projector.

Assignees

• Sony Corp

Inventors

• Ihara Keigo
• Ono Hideyuki

Classifications

• H04L51/046

  Interoperability with other network applications or services · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06V40/20 Primary

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• H04L51/224

  providing notification on incoming messages, e.g. pushed notifications of received messages · CPC title

• G06V40/176

  Dynamic expression · CPC title