Systems and methods for testing vehicle systems

Patent metadata

Field	Value
Publication number	US-12008681-B2
Application number	US-202217658281-A
Country	US
Kind code	B2
Filing date	Apr 7, 2022
Priority date	Apr 7, 2022
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

Systems and methods of testing a vehicle system. The systems and methods generate a simulation of a driving scenario to provide simulation video data, display the simulation on a monitor using the simulation video data, capture the displayed simulation using a camera system of the vehicle system to provide video data, process the video data using a perception algorithm to detect and track objects in the video data to provide perception data, control a vehicle actuator of the vehicle system in response to the perception data to provide command data, and adapt the simulation based on the command data. The camera system has a field of view and the monitor has a viewable area. The simulation of the driving scenario is scaled in proportion to a ratio of the field of view of the camera projected onto the monitor and dimensions of the viewable area.

First claim

What is claimed is:

1. A method of testing a vehicle system, the method comprising:
generating, via at least one processor, a simulation of a driving scenario to provide simulation video data;
displaying the simulation on a monitor using the simulation video data;
capturing the displayed simulation using a camera of the vehicle system to provide video data;
processing, via the at least one processor, the video data using a perception algorithm to detect and track objects in the video data to provide perception data;
controlling a vehicle actuator of the vehicle system in response to the perception data to provide command data; and
adapting the simulation based on the command data;
wherein the camera has a field of view and the monitor has a viewable area and wherein the simulation of the driving scenario is scaled, via the at least one processor, in proportion to a ratio of the field of view of the camera projected onto the monitor and dimensions of the viewable area, wherein the vehicle camera is removably mounted in a bracket, wherein the bracket includes a through opening and an optical system of the camera is aligned with the through opening when the vehicle camera is mounted to the bracket, reference markers are distributed about the through opening, wherein the bracket includes the reference markers, the laser has a beam shaped to impinge upon the reference markers and the center of the monitor when the bracket is aligned with the center of the monitor such the when the vehicle camera is mounted to the bracket, the vehicle camera is aligned with the center of the monitor.

2. The method of claim 1 , wherein the camera includes a vehicle camera and an external lens.

3. The method of claim 2 , wherein the vehicle camera and the external lens are mounted to the same bracket.

4. The method of claim 1 , comprising aligning the vehicle camera with a center of the monitor using the reference markers and a laser.

5. The method of claim 4 , wherein aligning the vehicle camera comprises adjusting a vertical and horizontal position of the bracket.

6. The method of claim 1 , wherein the reference markers include fins forming a cross shape and the laser beam is cross-shaped.

7. The method of claim 1 , wherein a refresh rate of the monitor is at least 98 Hz.

8. A system for testing a vehicle system, the system comprising:
a monitor having a viewable area;
a camera system of the vehicle system directed to capture video displayed on the monitor, wherein the camera system has a field of view, and wherein the camera system includes a vehicle camera and an external lens that are mounted to a bracket, wherein the bracket includes reference markers;
a vehicle actuator of the vehicle system;
at least one processor in operable communication with the monitor, the camera system and the vehicle actuator, wherein the at least one processor is configured to execute program instructions, wherein the program instructions are configured to cause the at least one processor to:
generate a simulation of a driving scenario to provide simulation video data;
display the simulation on the monitor using the simulation video data;
capture the displayed simulation using the camera system to provide video data;
process the video data using a perception algorithm to detect and track objects in the video data to provide perception data;
control the vehicle actuator in response to the perception data to provide command data;
adapt the simulation based on the command data; and
scale the simulation of the driving scenario in proportion to a ratio of the field of view of the camera projected onto the monitor and dimensions of the viewable area, and

a laser directed at a center of the monitor and the bracket includes a through opening and an optical system of the vehicle camera is aligned with the through opening when the vehicle camera is mounted to the bracket, the reference markers are distributed about the through opening, the laser has a beam shaped to impinge upon the reference markers and the center of the monitor when the bracket is aligned with the center of the monitor such the when the vehicle camera is mounted to the bracket, the vehicle camera is aligned with the center of the monitor.

9. The system of claim 8 , wherein the reference markers include fins forming a cross shape and the laser beam is cross-shaped.

10. The system of claim 8 , comprising at least one adjustable table to which the bracket is mounted for adjusting a vertical and horizontal position of the bracket.

11. The system of claim 8 , wherein a refresh rate of the monitor is at least 98 Hz.

12. The system of claim 8 , wherein the actuator comprises a braking device and a brake sensor is associated with the braking device that provides braking data to adapt the simulation based on the braking data.

Assignees

• Gm Global Tech Operations Llc
• Gm Tech Operations Llc

Inventors

• Meyer Robert
• Latto Samuel

Classifications

• H04N23/54 Primary

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06V20/40

  in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title