Systems and methods for superimposing augmented reality vehicle lights in a vehicle display

Patent metadata

Field	Value
Publication number	US-12475611-B2
Application number	US-202318526511-A
Country	US
Kind code	B2
Filing date	Dec 1, 2023
Priority date	Dec 1, 2023
Publication date	Nov 18, 2025
Grant date	Nov 18, 2025

Abstract

Systems, methods, and other embodiments described herein relate to superimposing computer-generated exterior vehicle lights over asynchronous real-world exterior vehicle lights to reduce a sensory overload of a vehicle driver. In one embodiment, a method includes assessing a sensory environment of a vehicle driver. The method also includes determining that the vehicle driver is in a sensory-overloaded state based on 1) a characteristic of the sensory environment, 2) physiological sensor data for the vehicle driver, and 3) driving behavior sensor data. The method also includes superimposing an augmented reality (AR) overlay of computer-generated synchronized exterior vehicle lights over asynchronous real-world exterior vehicle lights viewed through an AR display device of the vehicle based on a determination that the vehicle driver is in the sensory-overloaded state.

First claim

What is claimed is:

1 . A system, comprising:
a processor; and a memory storing machine-readable instructions that, when executed by the processor, cause the processor to:
assess a sensory environment of a vehicle driver;
determine that the vehicle driver is in a sensory-overloaded state based on:
a characteristic of the sensory environment;
physiological sensor data for the vehicle driver; and
driving behavior sensor data; and

superimpose an augmented reality (AR) overlay of computer-generated synchronized exterior vehicle lights over asynchronous real-world exterior vehicle lights viewed through an AR display device of a vehicle based on a determination that the vehicle driver is in the sensory-overloaded state.

2 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to superimpose the AR overlay of computer-generated synchronized exterior vehicle lights over the asynchronous real-world exterior vehicle lights comprises machine-readable instructions that, when executed by the processor, cause the processor to:
superimpose a digital vehicle image of a neighboring vehicle over the neighboring vehicle viewed through the AR display device, wherein the digital vehicle image conceals the asynchronous real-world exterior vehicle lights of the neighboring vehicle; and superimpose the AR overlay of computer-generated synchronized exterior vehicle lights over the digital vehicle image.

3 . The system of claim 1 , wherein the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to synchronize at least one of a turn signal visual indicator or a turn signal audio indicator with the computer-generated synchronized exterior vehicle lights.

4 . The system of claim 1 , wherein the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to disable at least one of a turn signal visual indicator or a turn signal audio indicator responsive to a generation of the computer-generated synchronized exterior vehicle lights.

5 . The system of claim 1 , wherein the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to synchronize a turn signal lamp of the vehicle with the computer-generated synchronized exterior vehicle lights.

6 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to assess the sensory environment of the vehicle driver comprises a machine-readable instruction that, when executed by the processor, causes the processor to:
assess an external sensory environment of the vehicle driver; and assess an in-cabin sensory environment of the vehicle driver.

7 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises a machine-readable instruction that, when executed by the processor, causes the processor to assess at least one of biometric data for the vehicle driver or images of the vehicle driver to determine that the vehicle driver is in the sensory-overloaded state.

8 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises a machine-readable instruction that, when executed by the processor, causes the processor to assess sensor data indicative of a driver interaction with a vehicle system.

9 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises a machine-readable instruction that, when executed by the processor, causes the processor to assess environment sensor data indicative of a surrounding environment of the vehicle.

10 . The system of claim 1 , wherein:
the machine-readable instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises a machine-learning instruction that, when executed by the processor, causes the processor to compare the physiological sensor data and the driving behavior sensor data to baseline sensor data; and the baseline sensor data comprises at least one of:
historical data for the vehicle driver; or
historical data for an additional vehicle driver.

11 . The system of claim 1 , wherein the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to produce a notification of a sensory-overloaded vehicle driver to at least one of:
another human vehicle operator; an autonomous vehicle system; or an infrastructure element.

12 . A non-transitory machine-readable medium comprising instructions that, when executed by a processor, cause the processor to:
assess a sensory environment of a vehicle driver; determine that the vehicle driver is in a sensory-overloaded state based on:
a characteristic of the sensory environment;
physiological sensor data for the vehicle driver; and
driving behavior sensor data; and
superimpose an augmented reality (AR) overlay of computer-generated synchronized exterior vehicle lights over asynchronous real-world exterior vehicle lights viewed through an AR display device of a vehicle based on a determination that the vehicle driver is in the sensory-overloaded state.

13 . The non-transitory machine-readable medium of claim 12 , wherein the instruction that, when executed by the processor, causes the processor to superimpose the AR overlay of computer-generated synchronized exterior vehicle lights over the asynchronous real-world exterior vehicle lights comprises instructions that, when executed by the processor, cause the processor to:
superimpose a digital vehicle image of a neighboring vehicle over the neighboring vehicle viewed through the AR display device, wherein the digital vehicle image conceals the asynchronous real-world exterior vehicle lights of the neighboring vehicle; and superimpose the AR overlay of computer-generated synchronized exterior vehicle lights over the digital vehicle image.

14 . The non-transitory machine-readable medium of claim 12 , wherein the instructions further comprise an instruction that, when executed by the processor, causes the processor to synchronize at least one of a turn signal visual indicator or a turn signal audio indicator with the computer-generated synchronized exterior vehicle lights.

15 . The non-transitory machine-readable medium of claim 12 , wherein:
the instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises an instruction that, when executed by the processor, causes the processor to compare the physiological sensor data and the driving behavior sensor data to baseline sensor data; and the baseline sensor data comprises at least one of:
historical data for the vehicle driver; or
historical data for an additional vehicle driver.

16 . The non-transitory machine-readable medium of claim 12 , wherein the instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded stat

Assignees

• Toyota Eng & Mfg North America
• Toyota Motor Co Ltd

Inventors

• Austin Benjamin Piya
• Gupta Rohit
• Garrett William Patrick

Classifications

• B60R2300/205

  using a head-up display · CPC title

• B60R2300/605

  the adjustment being automatic · CPC title

• G06V20/597

  Recognising the driver's state or behaviour, e.g. attention or drowsiness · CPC title

• B60R1/24 Primary

  in front of the vehicle · CPC title

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title