Systems and methods for enhancing and developing accident scene visualizations

Patent metadata

Field	Value
Publication number	US-12555335-B2
Application number	US-202318514935-A
Country	US
Kind code	B2
Filing date	Nov 20, 2023
Priority date	Apr 7, 2017
Publication date	Feb 17, 2026
Grant date	Feb 17, 2026

Abstract

Systems and methods are disclosed for enhancing and developing a damage scene virtual reality (VR) visualization. Annotated immersive multimedia image(s) may be received from a first user, where the annotated immersive multimedia image(s) can be associated with a damage scene. A VR visualization of the annotated immersive multimedia image(s) may be rendered using a VR device associated with a second user. The VR visualization may be used to determine a damage amount, where the damage amount is determined from one or more damaged items identifiable in the annotated immersive multimedia image(s).

First claim

What is claimed is:

1 . A system, comprising:
a virtual reality (VR) device configured to provide an immersive visualization; and a visualization processor communicatively coupled to the VR device, the visualization processor configured to:
receive a digital image depicting a damaged item located within a damage scene;
receive telematics data associated with the damaged item;
generate, based on the digital image, a VR image of the damage scene, wherein the VR image illustrates:
the damaged item, and
at least part of the damage scene;

generate, based at least in part on the telematics data and the VR image, an augmented VR image,
wherein the augmented VR image includes a simulated video illustrating an operation of the damaged item at the damage scene;

determine, based at least in part on the augmented VR image, a damage amount of the damaged item; cause the VR device to render a three-dimensional (3D) visualization of the augmented VR image; provide the 3D visualization to an additional VR device associated with a service entity, wherein the 3D visualization is rendered from a first viewpoint; receive, from the VR device or the additional VR device, a selection of a second viewpoint, wherein the selection of the second viewpoint is based on a head location correspondingto a firstuser of the VR device or a second user of the additional VR device; based on receiving the selection, cause the VR device and the additional VR device to simultaneously render the 3D visualization from the second viewpoint; receive, from the additional VR device and based on the 3D visualization, an input indicative of a repair cost associated with the damaged item; determine, based on the input and the augmented VR image, an adjustment amount; and determine, based at least in part on the damage amount and the adjustment amount, a modified damage amount associated with the damaged item.

2 . The system of claim 1 , wherein the visualization processor is further configured to:
generate, based on the telematics data, an annotation to be applied to the VR image, wherein the augmented VR image includes the annotation.

3 . The system of claim 1 , wherein the visualization processor is further configured to:
receive, from the VR device or the additional VR device, an interaction indicative of a voice command or body gesture; and modify, based on the interaction, the augmented VR image, wherein modifying the augmented VR image comprises one or more of adding, moving, altering, or highlighting an annotation.

4 . The system of claim 1 , wherein the damaged item is a vehicle, and the telematics data comprises at least one of a speed of the vehicle, a deployment status of an airbag of the vehicle, or proximity information of another vehicle.

5 . The system of claim 4 , wherein the visualization processor is further configured to:
provide, via the VR device, an indication of the simulated video; and receive, from the VR device, a selection of the indication, wherein, based on receiving the selection, causing the VR device to render the 3D visualization includes playing causing the VR device to play the simulated video.

6 . The system of claim 1 , wherein the telematics data includes a time of capture of the telematics data and a geographic location of capture of the telematics data, and the visualization processor is further configured to:
access weather information associated with the geographic location of capture, the weather information indicating a weather condition, of the geographic location of capture, at a time of occurrence of damage; and update the augmented VR image to include an indication of the weather information.

7 . The system of claim 6 , wherein the visualization processor is further configured to:
access, based on the time of capture and the geographic location of capture, an additional digital image comprising of a dashboard camera view, a map view, or a street view; and update the 3D visualization to render an overlay of the additional digital image on the augmented VR image.

8 . The system of claim 1 , wherein the telematics data includes a time of capture of the telematics data, and the visualization processor is further configured to:
determine, based on the telematics data, a time of occurrence of damage to the damaged item; receive, on the time of occurrence, video data captured at the damage scene including the time of occurrence; and update the augmented VR image to include an indication of the video data.

9 . The system of claim 1 , wherein the visualization processor is further configured to:
receive, from the VR device, additional data comprising one or more of: police records, witness statements, parking lot data, or a repair estimate; and update the augmented VR image to include an indication of the additional data.

10 . The system of claim 1 , wherein:
the VR device and the additional VR device are configured to be worn on a head of a user, and the 3D visualization is rendered from a viewpoint corresponding to a head location or eye gaze of the user.

11 . The system of claim 1 , wherein the 3D visualization comprises one or more of:
a 360-degree image, a 360-degree video, a panoramic image, or a panoramic video.

12 . A method, comprising:
receiving, at a visualization processor communicatively coupled to a virtual reality (VR) device, a digital image depicting a damaged item located within a damage scene, wherein the VR device is configured to provide an immersive visualization of the damage scene; receiving, at the visualization processor, telematics data associated with the damaged item; generating, by the visualization processor and based on the digital image, a VR image of the damage scene, wherein the VR image illustrates:
the damaged item, and
at least part of the damage scene;
generating, by the visualization processor, based at least in part on the telematics data and the VR image, an augmented VR image, wherein the augmented VR image includes a simulated video illustrating an operation of the damaged item at the damage scene; determining, by the visualization processor and based at least in part on the augmented VR image, a damage amount of the damaged item; causing, by the visualization processor, the VR device to render a three-dimensional (3D) visualization of the augmented VR image; providing, by the visualization processor, the 3D visualization to an additional VR device associated with a service entity, wherein the 3D visualization is rendered from a first viewpoint; receiving, by the visualization processor, and from the VR device or the additional VR device, a selection of a second viewpoint, wherein the selection of the second viewpoint is based on a head location corresponding to a first user of the VR device or a second user of the additional VR device; based on receiving the selection, causing, by the visualization processor, the VR device and the additional VR device to simultaneously render the 3D visualization from the second viewpoint; receiving, by the visualization processor, from the additional VR device and based on the 3D visualization, an input indicative of a repair cost associated with the damaged item; determining, by the visualization processor and based on the input and the augmented VR image, an adjustment amount; and determining, by the visualization processor andbased at leastin part on the damage amount and the adjustment amount, a modified damage amount associated with the damaged item.

13 . The method of claim 12 , further comprising:
receiving, by the visualization processor and from the additional VR

Assignees

• State Farm Mutual Automobile Insurance Co

Inventors

• Fields Brian Mark
• Assam Lee Marvin John

Classifications

• G06F40/169

  Annotation, e.g. comment data or footnotes · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06Q40/08 Primary

  Insurance · CPC title

• H04L67/025

  for remote control or remote monitoring of applications · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title