Systems and methods for modeling and simulation in vehicle forensics

Patent metadata

Field	Value
Publication number	US-11893840-B2
Application number	US-202217723124-A
Country	US
Kind code	B2
Filing date	Apr 18, 2022
Priority date	May 30, 2019
Publication date	Feb 6, 2024
Grant date	Feb 6, 2024

Abstract

An autonomous vehicle (AV) including a vehicle body, and a vehicle computing device is provided. The vehicle computing device includes a processor in communication with a memory device. The processor is configured to identify a time and a geographic location of a traffic collision involving the AV, retrieve map data and contextual data associated with the time and the geographic location of the traffic collision, retrieve vehicle telematics data collected by sensors coupled to the vehicle body, determine for each of a plurality of moments in time during the traffic collision a position and an orientation of the AV during the traffic collision, generate a simulation of the traffic collision including a representation of the AV based upon the map data, the contextual data, and the vehicle telematics data, and provide content to enable display of the simulation on a display device.

First claim

We claim:

1. An autonomous vehicle (AV) comprising:
a vehicle body; and
a vehicle computing device comprising a processor in communication with a memory device, the processor configured to:
identify a time and a geographic location of a traffic collision involving the AV;
retrieve map data and contextual data associated with the time and the geographic location of the traffic collision;
retrieve vehicle telematics data collected by sensors coupled to the vehicle body;
receive speech data from a witness of the traffic collision;
determine, based upon the retrieved vehicle telematics data and the received speech data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision;
generate a simulation of the traffic collision including a representation of the AV based upon the map data, the contextual data, and the determined position and orientation of the AV for each of the plurality of moments in time; and
provide content to enable display of the simulation on a display device.

2. The AV of claim 1 , wherein the processor is further configured to identify the time of the traffic collision based upon the vehicle telematics data, the time of the traffic collision including a time period starting before a collision event of the collision and ending after the collision event.

3. The AV of claim 1 , wherein the processor is further configured to:
receive the speech data from the witness of the traffic collision using a microphone in communication with the processor; and
parse the speech data for phrases describing the traffic collision.

4. The AV of claim 3 , wherein the received speech data is received as an audio signal, and the processor is further configured to convert the audio signal into text.

5. The AV of claim 4 , wherein the processor is further configured to cause the text to be displayed on the display device.

6. The AV of claim 3 , wherein the processor is further configured to analyze the parsed speech data, and identify inconsistent phrases by comparing the inconsistent phrases to one or more of the map data, the contextual data, the telematics data, or other phrases obtained from the parsed speech data to determine that the inconsistent phrases are not consistent with the map data, the contextual data, the telematics data, or other phrases obtained from the parsed speech data.

7. The AV of claim 6 , wherein, the processor is further configured to determine whether to use a phrase based upon whether the phrase is identified as an inconsistent phrase.

8. The AV of claim 1 , wherein the processor is further configured to generate the simulation of the traffic collision by determining the position and orientation of the AV at each of the moments in time based further upon one or more of vehicle specification data stored in the memory device, photographic data collected by one or more of the sensors or from third-party providers, or physics data.

9. A computer-implemented method performed by an autonomous vehicle (AV) including a vehicle computing device, the vehicle computing device including a processor in communication with a memory device, the method comprising:
identifying, by the vehicle computing device, a time and a geographic location of a traffic collision involving the AV;
retrieving, by the vehicle computing device, map data and contextual data associated with the time and the geographic location of the traffic collision;
retrieving, by the vehicle computing device, vehicle telematics data collected by sensors associated with the AV;
receiving, by the vehicle computing device, speech data from a witness of the traffic collision;
determining, by the vehicle computing device, based upon the retrieved vehicle telematics data and the received speech data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision;
generating, by the vehicle computing device, a simulation of the traffic collision including a representation of the AV based upon the map data, the contextual data, and the determined position and orientation of the AV for each of the plurality of moments in time; and
providing, by the vehicle computing device, content to enable display of the simulation on a display device.

10. The computer-implemented method of claim 9 , further comprising identifying, by the vehicle computing device, the time of the traffic collision based upon the vehicle telematics data, the time of the traffic collision including a time period starting before a collision event of the collision and ending after the collision event.

11. The computer-implemented method of claim 9 , further comprising:
receiving, by the vehicle computing device, the speech data from the witness of the traffic collision using a microphone in communication with the processor; and
parsing, by the vehicle computing device, the speech data for phrases describing the traffic collision.

12. The computer-implemented method of claim 11 , further comprising analyzing, by the vehicle computing device, the parsed speech data, and identify inconsistent phrases by comparing the inconsistent phrases to one or more of map data, the contextual data, the telematics data, or other phrases obtained from the parsed speech data to determine that the inconsistent phrases are not consistent with the map data, the contextual data, the telematics data, or other phrases obtained from the parsed speech data.

13. The computer-implemented method of claim 12 , further comprising determining, by the vehicle computing device whether to use a phrase based upon whether the phrase is identified as an inconsistent phrase.

14. The computer-implemented method of claim 11 wherein the received speech data is received as an audio signal, and wherein the computer-implemented method further includes converting, by the vehicle computing device, the audio signal into text.

15. The computer-implemented method of claim 14 , further comprising causing, by the vehicle computing device, the text to be displayed on the display device.

16. The computer-implemented method of claim 9 , further comprising generating, by the vehicle computing device, the simulation of the traffic collision by determining the position and orientation of the AV at each of the moments in time based further upon one or more of vehicle specification data stored in the memory device, photographic data collected by one or more of the sensors or from third-party providers, or physics data.

17. At least one non-transitory computer-readable media having computer-executable instructions embodied thereon, wherein when executed by an autonomous vehicle (AV) computing device having a processor, the computer-executable instructions cause the processor to:
identify a time and a geographic location of a traffic collision involving the AV;
retrieve map data and contextual data associated with the time and the geographic location of the traffic collision;
retrieve vehicle telematics data collected by sensors associated with the AV;
receive speech data from a witness of the traffic collision;
determine, based upon the retrieved vehicle telematics data and the received speech data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision;
generate a simulation of the traffic collision including a representation of the AV based upon the map data, the contextual data, and the determined position and orientation of the AV for e

Assignees

• State Farm Mutual Automobile Insurance Co

Inventors

• Cardona Alexander
• Trayer Jerome Scott
• Ho An

Classifications

• G07C5/0841 Primary

  Registering performance data (recording measured values G01D; information storage G11B) · CPC title

• G06F30/20

  Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) · CPC title

• G06F40/205 Primary

  Parsing · CPC title

• G07C5/008

  communicating information to a remotely located station (transmission systems for measured values G08C) · CPC title

• G08G1/0137

  for specific applications · CPC title