Image vibration compensation for vehicle display device

Patent metadata

Field	Value
Publication number	US-12136366-B2
Application number	US-202117760460-A
Country	US
Kind code	B2
Filing date	Feb 12, 2021
Priority date	Feb 20, 2020
Publication date	Nov 5, 2024
Grant date	Nov 5, 2024

Abstract

The present technique relates to an information processing device, an information processing method, and a program such that information with high usability can be presented.
As a parameter related to presentation information to be presented in a vehicle interior of a vehicle, at least one of parameters of brightness, blur, area, and transparency is changed on the basis of vibration information. The present technology can be applied as a projection device placed in a vehicle interior of a vehicle.

First claim

The invention claimed is:

1. An information processing device, comprising:
a central processing unit (CPU) configured to:
acquire vibration information based on a vibration of an interior of a vehicle;
acquire a set of images including a set of users seated in the interior of the vehicle;
detect a number of users in the set of users and a gaze direction of each user of the set of users, based on the acquired set of images;
detect a target screen of a set of screens in the interior of the vehicle, wherein
the detected target screen is associated with a first presentation location in the interior of the vehicle, and
the detection of the target screen is based on the detected number of users and the gaze direction;

determine a set of parameters related to presentation information, wherein
the determination of the set of parameters is based on the acquired vibration information and the first presentation location, and
the determined set of parameters includes at least one of brightness, blur, area, or transparency; and

control rendering of the presentation information on the detected target screen in the interior of the vehicle, based on the determined set of parameters.

2. The information processing device according to claim 1 , wherein attributes of the first presentation location includes a ceiling, a headrest, and a window in the vehicle interior.

3. The information processing device according to claim 1 , wherein the CPU is further configured to update a first value of a first parameter of the determined set of parameters based on attributes of a first user of the set of users who is viewing the presentation information.

4. The information processing device according to claim 3 , wherein the attributes of the first user include a race, adult/child, and a seated position of the first user.

5. The information processing device according to claim 4 , wherein the first value of the first parameter of the determined set of parameters is defined for each attribute of the attributes of the first user.

6. The information processing device according to claim 5 , wherein
the set of users corresponds to a single user including the first user, and
the CPU is further configured to assign the first value of the first parameter of the determined set of parameters defined for each attribute of the attributes of the first user as a second value of the determined set of parameters related to the presentation information.

7. The information processing device according to claim 5 , wherein
the set of users corresponds to a plurality of users including the first user, and
the CPU is further configured to assign a maximum value or a minimum value of the first value defined for each attribute of the attributes of the plurality of users as a second value of the determined set of parameters related to the presentation information.

8. The information processing device according to claim 7 , wherein
the first parameter of the set of parameters corresponds to the brightness, and
the CPU is further configured to assign a minimum value of the first value defined for each attribute of the attributes of the plurality of users as a third value of the brightness related to the presentation information.

9. The information processing device according to claim 7 , wherein
the first parameter of the set of parameters corresponds to the blur, and the CPU is further configured to assign a maximum value of the first value defined for each attribute of the attributes of the plurality of users as a third value of the blur related to the presentation information.

10. The information processing device according to claim 7 , wherein
the first parameter of the set of parameters corresponds to the area, and
the CPU is further configured to assign a minimum value of the first value defined for each attribute of the attributes of the plurality of users as a third value of the area related to the presentation information.

11. The information processing device according to claim 7 , wherein
the first parameter of the set of parameters corresponds to the transparency, and
the CPU is further configured to assign a maximum value of the first value defined for each attribute of the attributes of the plurality of users as a third value of the transparency related to the presentation information.

12. The information processing device according to claim 1 , wherein the CPU is further configured to update the determined set of parameters based on of whether or not vibration of the vehicle that is currently traveling is detected.

13. The information processing device according to claim 1 , wherein the CPU is further configured to update the determined set of parameters based on the basis of whether or not there is-vibration of the vehicle is predicted to be detected at a future time.

14. The information processing device according to claim 13 , wherein the CPU is further configured to gradually update the determined set of parameters until the vibration of the vehicle is detected.

15. The information processing device according to claim 1 , wherein the presentation information is a projection image.

16. The information processing device according to claim 1 , wherein
the presentation information corresponds to GUI parts presented at a second presentation location, and
the CPU is further configured to control the GUI parts to move in parallel at the second presentation location, based on the vibration information.

17. The information processing device according to claim 1 , wherein
the presentation information corresponds to GUI parts associated with a range in which a touch operation of a first user is configured to be performed, and
the CPU is further configured to control the range associated with the GUI parts, based on the vibration information.

18. An information processing method, comprising:
by a central processing unit (CPU) of an information processing device;
acquiring vibration information, based on a vibration of an interior of a vehicle;
acquiring a set of images including a set of users seated in the interior of the vehicle;
detecting a number of users in the set of users and a gaze direction of each user of the set of users, based on the acquired set of images;
detecting a target screen of a set of screens in the interior of the vehicle, wherein
the detected target screen is associated with a first presentation location in the interior of the vehicle, and
the detection of the target screen is based on the detected number of users and the gaze direction;

determining a set of parameters related to presentation information, wherein
the determination of the set of parameters is based on the acquired vibration information and the first presentation location, and
the determined set of parameters includes at least one of brightness, blur, area, or transparency; and

controlling rendering of the presentation information on the detected target screen in the interior of the vehicle, based on the determined set of parameters.

19. A non-transitory computer-readable medium having stored thereon, computer-executable instructions that when executed by an information processing device, causes the information processing device to execute operations, the operations comprising:
acquiring vibration information, based on a vibration of an interior of a vehicle;
acquiring a set of images including a set of users seated in the interior of the vehicle;
detecting a number of users in the set of users and a gaze direction of each user of the s

Assignees

• Sony Group Corp

Inventors

• Ikeda Tetsuo
• NISHIDE Sachiko
• Shirakawa Miyuki
• Murakami Tomonari
• Nagata Koji
• HAYASHI Maho
• Tomonaga Seishi

Classifications

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G09G2380/10

  Automotive applications · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G2320/0626

  for control of overall brightness · CPC title

• G09G3/001 Primary

  using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP) · CPC title