Information processing device and information processing method

Patent metadata

Field	Value
Publication number	US-11284047-B2
Application number	US-201816637423-A
Country	US
Kind code	B2
Filing date	May 24, 2018
Priority date	Aug 18, 2017
Publication date	Mar 22, 2022
Grant date	Mar 22, 2022

Abstract

An information processing device including a recognition unit that recognizes a projection environment in space on the basis of sensor data obtained by sensing the space in which content is projected, and an inducement control unit that presents, to a user, inducement information to change a state of the projection environment from the recognized first projection environment state to a second projection environment state with improved visibility.

First claim

The invention claimed is:

1. An information processing device, comprising:
a recognition unit configured to recognize a first projection environment state of a projection environment in space based on sensor data obtained by sensing the space in which content is projected;
an inducement decision unit configured to calculate a priority of inducement information associated with a factor of a human state and a factor of an environmental state, wherein
the inducement information is different from the projected content,
the inducement information is a notification that prompts a user action from a user, and
the user action changes at least one of the human state or the environmental state that affects a visibility of the projected content; and

an inducement control unit configured to present, to the user, the inducement information to change a state of the projection environment from the recognized first projection environment state to a second projection environment state, wherein
the inducement information is presented based on the priority of the inducement information, and
the visibility of the projected content in the second projection environment state is higher than the visibility of the content in the first projection environment state.

2. The information processing device according to claim 1 , wherein the human state is at least one of a viewing or listening distance of the user from a projection plane, a posture of the user, a state of the user, an angular difference from the projection plane, a direction of a line of sight of the user, or a viewing or listening position of the user.

3. The information processing device according to claim 1 , wherein the environmental state is at least one of a shadowing object around a projection plane, an obstacle on the projection plane, a reflection of the projection plane, at least one of a color, a character, or a diagram on the projection plane, an environmental illuminance, or an environmental sound.

4. The information processing device according to claim 1 , wherein the inducement control unit is further configured to present the inducement information to the user via at least one of an audio, an image, or a vibration.

5. The information processing device according to claim 4 , wherein the inducement decision unit is further configured to determine a notification mode, based on one of the audio or the image, to present the inducement information to the user.

6. The information processing device according to claim 1 , wherein the inducement decision unit is further configured to:
calculate evaluation values of the factor associated with the human state and the factor associated with the environmental state, wherein the evaluation values are calculated based on the sensor data; and
decide the inducement information, of at least one factor from the factor associated with the human state and the factor associated with the environmental state, to be presented to the user based on the priority, wherein the priority of the inducement information is calculated based on the calculated evaluation values.

7. The information processing device according to claim 6 , wherein an evaluation value of the factor associated with the environmental state corresponds to an amount of reduction in a projection area of the content.

8. The information processing device according to claim 1 , wherein the inducement control unit is further configured to move a projection image from a direction of a line of sight of the user to a projection location.

9. The information processing device according to claim 1 , wherein the inducement control unit is further configured to prompt, based on display of a projection image at a viewing or listening position, the user action.

10. The information processing device according to claim 1 , wherein the inducement control unit is further configured to prompt, based on indication of a shadowing object in a projection image, the user action to exclude the shadowing object.

11. The information processing device according to claim 1 , wherein the inducement control unit is further configured to prompt, based on explicit indication of an obstacle on a projection plane in the space of a projection image, the user action to exclude the obstacle.

12. The information processing device according to claim 1 , wherein the inducement control unit is further configured to prompt, based on superimposition of a projection image on a texture on a projection plane, the user action to erase the texture.

13. The information processing device according to claim 1 , wherein the inducement control unit is further configured to control display of the inducement information in a direction of a line of sight of the user.

14. An information processing method, comprising,
by a processor:
recognizing a first projection environment state of a projection environment in space based on sensor data obtained by sensing the space in which content is projected;
calculating a priority of inducement information associated with a factor of a human state and a factor of an environmental state, wherein
the inducement information is different from the projected content,
the inducement information is a notification that prompts a user action from a user, and
the user action changes at least one of the human state or the environmental state that affects a visibility of the projected content; and
presenting, to the user, the inducement information to change a state of the projection environment from the recognized first projection environment state to a second projection environment state, wherein
the inducement information is presented based on the priority of the inducement information, and
the visibility of the projected content in the second projection environment state is higher than the visibility of the content in the first projection environment state.

15. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:
recognizing a first projection environment state of a projection environment in space based on sensor data obtained by sensing the space in which content is projected,
calculating a priority of inducement information associated with a factor of a human state and a factor of an environmental state, wherein
the inducement information is different from the projected content,
the inducement information is a notification that prompts a user action from a user, and
the user action changes at least one of the human state or the environmental state that affects a visibility of the projected content; and

presenting, to the user, the inducement information to change a state of the projection environment from the recognized first projection environment state to a second projection environment state, wherein
the inducement information is presented based on the priority of the inducement information,
the visibility of the projected content in the second projection environment state is higher than the visibility of the content in the first projection environment state.

Assignees

• Sony Corp

Inventors

• Ikeda Takuya
• Iida Fumihiko
• Ida Kentaro
• Suzuki Seiji
• Suzuki Ryuichi

Classifications

• H04N9/3102 Primary

  using two-dimensional electronic spatial light modulators (micromechanical modulators as such G02B26/0833; liquid crystal modulators as such G02F1/13) · CPC title

• H04N9/3194

  including sensor feedback · CPC title

• G09G5/00

  Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) · CPC title

• G03B21/00

  Projectors or projection-type viewers; Accessories therefor (devices for changing pictures G03B23/00) · CPC title

• H04N9/3185 Primary

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title