Information processing device and information processing method

Patent metadata

Field	Value
Publication number	US-11683471-B2
Application number	US-201716348846-A
Country	US
Kind code	B2
Filing date	Nov 28, 2017
Priority date	Nov 29, 2016
Publication date	Jun 20, 2023
Grant date	Jun 20, 2023

Abstract

An information processing device includes: a displacement information acquisition unit that acquires displacement information corresponding to 3-dimensional displacement of a predetermined portion of an object that a user mounts in accordance with a body motion on the basis of positional information of the predetermined portion and an output control unit that performs control such that an output unit performs a predetermined output on the basis of the acquired displacement information. The object has, for example, a seatback on which a user can sit. The displacement information acquisition unit acquires a change in a position in at least one of front and rear directions, right and left directions, or upward and downward directions of a seatback.

First claim

The invention claimed is:

1. An information processing device comprising:
a displacement information acquisition unit configured to acquire displacement information that corresponds to 3-dimensional displacement of a predetermined portion of a predetermined object that a user mounts based on a body motion of the user and positional information of the predetermined portion; and
an output control unit configured to:
perform control such that an output unit performs one or more predetermined outputs based on the acquired displacement information, wherein the one or more predetermined outputs include display of a video;
estimate a head position of the user based on the acquired displacement information of the predetermined portion of the predetermined object that the user mounts; and
control a display position of the displayed video based on the acquired displacement information and the head position of the user.

2. The information processing device according to claim 1 ,
wherein the predetermined object is an object on which the user is able to sit, and
the body motion of the user includes an inclination motion of an upper half of a body of the user.

3. The information processing device according to claim 2 ,
wherein the predetermined object has a seatback, and
the displacement information corresponds to a change in a position of the seatback in at least one of front and rear directions, right and left directions, or upward and downward directions.

4. The information processing device according to claim 3 , wherein the displacement information further corresponds to a tilting angle of the seatback in the front and rear directions.

5. The information processing device according to claim 4 ,
wherein the displacement information acquisition unit is further configured to acquire a first tilting angle and a second tilting angle greater than the first tilting angle as the displacement information, and wherein the one or more predetermined outputs further include a first output and a second output different from the first output, and
the output control unit is further configured to perform control such that the output unit performs the first output in a case where the seatback has the first tilting angle, and the second output in a case where the seatback has the second tilting angle.

6. The information processing device according to claim 5 ,
wherein the one or more predetermined outputs further include a fourth output different from both the first output and the second output,
the displacement information further corresponds to vibration or oscillation of the predetermined portion, and
the output control unit is further configured to perform control such that the output unit performs the fourth output based on the vibration or the oscillation.

7. The information processing device according to claim 3 , wherein the displacement information further corresponds to a tilting angle per predetermined time of the seatback.

8. The information processing device according to claim 3 ,
wherein the displacement information further corresponds to a tilting angle acceleration of the seatback,
the one or more predetermined outputs further include a third output, and
the output control unit is further configured to perform control such that the output unit performs the third output in a case where the tilting angle acceleration is equal to or greater than a predetermined threshold.

9. The information processing device according to claim 2 , wherein the displacement information corresponds to a change in a position in at least one of front and rear directions, right and left directions, or upward and downward directions of a seat of the predetermined object.

10. The information processing device according to claim 2 , wherein the displacement information corresponds to a change in a position in at least one of front and rear directions, right and left directions, or upward and downward directions of an armrest of the predetermined object.

11. The information processing device according to claim 2 , wherein the output unit includes a display unit that is configured to display the video.

12. The information processing device according to claim 11 , wherein the output control unit is further configured to control a brightness of the video based on a tilting angle in right and left directions of the predetermined object.

13. The information processing device according to claim 11 , wherein the output control unit is further configured to control a parallax of the video based on a tilting angle in right and left directions of the predetermined object.

14. The information processing device according to claim 11 , wherein the output control unit is further configured to control a transition direction of the video based on a tilting angle in right and left directions of the predetermined object.

15. The information processing device according to claim 11 , wherein the output control unit is further configured to cause an effect image based on an audio signal to be displayed.

16. The information processing device according to claim 15 , wherein the output control unit is further configured to cause the effect image to be changed based on an analysis result of the audio signal.

17. The information processing device according to claim 15 , wherein the effect image includes a particle displayed so that a relative length extends as the particle is closer to a vicinity of an outer edge of the display unit.

18. The information processing device according to claim 15 , wherein the effect image includes a plurality of particle group layers which overlaps in a depth direction in a virtual space and moves away from or toward each other in the depth direction in the virtual space based on a change in the audio signal.

19. The information processing device according to claim 1 , wherein the displacement information corresponds to a change in a position in at least one of front and rear directions, right and left directions, or upward and downward directions of an upper surface of the predetermined object.

20. The information processing device according to claim 19 ,
wherein the output unit includes a display unit that is installed above the predetermined object and is configured to display the video, and
the output control unit is further configured to:
estimate a front direction of the user based on the acquired displacement information; and
control the video based on at least one of the front direction of the user or the head position of the user.

21. The information processing device according to claim 1 , wherein the output control unit is further configured to:
estimate a front direction of the user based on the acquired displacement information; and
control a direction of the video based on at least one of the estimated front direction of the user or the estimated head position of the user.

22. The information processing device according to claim 1 , wherein the output unit includes a speaker that is configured to output an audio sound and the speaker is installed so that a straight line facing in a vibration direction of the speaker crosses a face of the user.

23. The information processing device according to claim 22 , wherein the straight line facing in the vibration direction of the speaker is not obstructed between the speaker and the face of the user.

24. An information processing method comprising:
a displacement information acquisition

Assignees

• Sony Corp

Inventors

• Nashida Tatsushi
• Mikami Masanori
• Yamazaki Tatsuya
• Takahashi Naomasa
• Shimizu Yosuke
• Nishikawa Jun
• Edamitsu Naoko

Classifications

• H04N9/3147

  Multi-projection systems (video walls G06F3/1446) · CPC title

• H04N13/366 Primary

  using viewer tracking · CPC title

• H04N21/431

  Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering · CPC title

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• H04N21/442

  Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk {(arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00)} · CPC title