Systems and methods for modeling and simulation in vehicle forensics

Patent metadata

Field	Value
Publication number	US-12315316-B2
Application number	US-202418409437-A
Country	US
Kind code	B2
Filing date	Jan 10, 2024
Priority date	May 30, 2019
Publication date	May 27, 2025
Grant date	May 27, 2025

Abstract

An autonomous vehicle (AV) including a vehicle body, and a vehicle computing device is provided. The vehicle computing device includes a processor in communication with a memory device. The processor is configured to identify a time and a geographic location of a traffic collision involving the AV, retrieve map data and contextual data associated with the time and the geographic location of the traffic collision, retrieve vehicle telematics data collected by sensors coupled to the vehicle body, determine for each of a plurality of moments in time during the traffic collision a position and an orientation of the AV during the traffic collision, generate a simulation of the traffic collision including a representation of the AV based upon the map data, the contextual data, and the vehicle telematics data, and provide content to enable display of the simulation on a display device.

First claim

We claim:

1. A computing device comprising at least one processor and at least one memory device in communication therewith, the at least one processor configured to:
receive audio data relating to a traffic collision involving an autonomous vehicle (AV), the audio data identifying a time and geographic location of the AV;
retrieve vehicle telematics data collected by sensors of the AV;
verify a time of the traffic collision provided in the audio data based upon the vehicle telematics data, the time of the traffic collision including a time period starting before a collision event of the traffic collision and ending after the collision event;
determine, based upon the retrieved vehicle telematics data and the received audio data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision; and
generate a simulation of the traffic collision including a representation of the AV based upon the determined position and orientation of the AV for each of the plurality of moments in time; and
provide content to enable display of the simulation on a display device.

2. The computing device of claim 1 , wherein the at least one processor is further configured to:
retrieve map data and contextual data associated with the time and the geographic location of the traffic collision; and
generate the simulation further based upon the retrieved map data and contextual data.

3. The computing device of claim 1 , wherein the at least one processor is further configured to generate the simulation of the traffic collision based further upon one or more of vehicle specification data stored in the memory device, photographic data collected by one or more of the sensors or from third-party providers, or physics data.

4. The computing device of claim 1 , wherein the at least one processor is further configured to:
receive the audio data via a microphone in communication with the at least one processor; and
parse the audio data for phrases describing the traffic collision.

5. The computing device of claim 4 , wherein the received audio data is received as an audio signal, and the at least one processor is further configured to convert the audio signal into text.

6. The computing device of claim 5 , wherein the at least one processor is further configured to cause the text to be displayed on the display device.

7. The computing device of claim 4 , wherein the at least one processor is further configured to analyze the parsed audio data, and identify inconsistent phrases by comparing the inconsistent phrases to the vehicle telematics data or other phrases obtained from the parsed audio data to determine that the inconsistent phrases are not consistent with the telematics data or other phrases obtained from the parsed audio data.

8. The computing device of claim 7 , wherein the at least one processor is further configured to determine whether to use a phrase to generate the simulation based upon whether the phrase is identified as an inconsistent phrase.

9. At least one non-transitory computer-readable media having computer-executable instructions embodied thereon, wherein when executed by at least one processor in communication with at least one memory device, the computer-executable instructions cause the at least one processor to:
receive audio data relating to a traffic collision involving an autonomous vehicle (AV), the audio data identifying a time and geographic location of the AV;
retrieve vehicle telematics data collected by sensors of the AV;
verify a time of the traffic collision provided in the audio data based upon the vehicle telematics data, the time of the traffic collision including a time period starting before a collision event of the traffic collision and ending after the collision event;
determine, based upon the retrieved vehicle telematics data and the received audio data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision; and
generate a simulation of the traffic collision including a representation of the AV based upon the determined position and orientation of the AV for each of the plurality of moments in time; and
provide content to enable display of the simulation on a display device.

10. The at least one non-transitory computer-readable of claim 9 , wherein the instructions further cause the at least one processor to:
retrieve map data and contextual data associated with the time and the geographic location of the traffic collision; and
generate the simulation further based upon the retrieved map data and contextual data.

11. A computer-implemented method for collecting vehicle forensics implemented using at least one processor in communication with at least one memory device, the computer-implemented method comprising:
receiving audio data relating to a traffic collision involving an autonomous vehicle (AV), the audio data identifying a time and geographic location of the AV;
retrieving vehicle telematics data collected by sensors of the AV;
verifying a time of the traffic collision provided in the audio data based upon the vehicle telematics data, the time of the traffic collision including a time period starting before a collision event of the traffic collision and ending after the collision event;
determining, based upon the retrieved vehicle telematics data and the received audio data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision; and
generating a simulation of the traffic collision including a representation of the AV based upon the determined position and orientation of the AV for each of the plurality of moments in time; and
providing content to enable display of the simulation on a display device.

12. The computer-implemented method of claim 11 , further comprising:
retrieving map data and contextual data associated with the time and the geographic location of the traffic collision; and
generating the simulation further based upon the retrieved map data and contextual data.

13. The computer-implemented method of claim 11 , further comprising:
receiving the audio data via a microphone in communication with the at least one processor; and
parsing the audio data for phrases describing the traffic collision.

14. The computer-implemented method of claim 13 , wherein the received audio data is received as an audio signal, and the computer-implemented further comprises converting the audio signal into text.

15. The computer-implemented method of claim 14 , further comprising causing the text to be displayed on the display device.

16. The computer-implemented method of claim 13 , further comprising analyzing the parsed audio data, and identify inconsistent phrases by comparing the inconsistent phrases to the vehicle telematics data or other phrases obtained from the parsed audio data to determine that the inconsistent phrases are not consistent with the telematics data or other phrases obtained from the parsed audio data.

17. The computer-implemented method of claim 16 , further comprising determining whether to use a phrase to generate the simulation based upon whether the phrase is identified as an inconsistent phrase.

18. The computer-implemented method of claim 11 , further comprising generating the simulation of the traffic collision based further upon one or more of vehicle specification data stored in the memory device, photographic data collected by o

Assignees

• State Farm Mutual Automobile Insurance Co

Inventors

• Cardona Alexander
• Trayer Jerome Scott
• Ho An

Classifications

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G06F40/205 Primary

  Parsing · CPC title

• G06F30/20

  Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) · CPC title

• G07C5/008

  communicating information to a remotely located station (transmission systems for measured values G08C) · CPC title

• G08G1/0137

  for specific applications · CPC title