Extended reality methods and systems for collecting, managing, and using home-related information

Patent metadata

Field	Value
Publication number	US-12469223-B2
Application number	US-202318111208-A
Country	US
Kind code	B2
Filing date	Feb 17, 2023
Priority date	Feb 18, 2022
Publication date	Nov 11, 2025
Grant date	Nov 11, 2025

Abstract

Embodiments of extended reality (XR) methods and systems for handling home-related information are disclosed. In one embodiment, a computer-implemented method may include (1) obtaining one or more XR preferences for a party; (2) presenting, using one or more devices associated with the party instructions constructed to guide the party to move throughout or around a real property, and prompts constructed to direct the party to capture data representing one or more of the real property or belongings; (3) determining, by one or more processors processing the captured data, asset data representing one or more of the real property or the belongings; and/or (4) presenting, in a virtualized environment in accordance with the party's XR preferences via an XR device, one or more visual depictions of the determined asset data such that the party or an insurance representative can at least one of view, modify, or approve the asset data.

First claim

What is claimed is:

1 . A computer-implemented method for collecting and collaboratively reviewing asset information using different extended reality (XR environments, the computer-implemented method comprising:
obtaining one or more XR preferences for a party, the one or more XR preferences including a preference to use virtual reality (VR); presenting, using at least an XR device associated with the party, an AR environment to the party, at least in part by overlaying, on real-world content viewed using the XR device,
instructions constructed to guide the party to move throughout or around a real property, and
prompts constructed to direct the party to capture data representing one or more of the real property or belongings associated with the real property;
determining, by one or more processors processing the captured data, asset data representing one or more of the real property or the belongings; and presenting, in a VR environment that includes a first avatar of the party and a second avatar of an insurance representative, in accordance with the party's XR preferences, and via the XR device or another XR device associated with the party, one or more visual depictions of the determined asset data such that the party or the insurance representative can at least one of view, modify, or approve the asset data.

2 . The computer-implemented method of claim 1 , wherein determining the asset data includes processing input data representing the captured data using one or more configured and trained machine learning models.

3 . The computer-implemented method of claim 2 , wherein the captured data includes images or video frames, and wherein the one or more machine learning models are configured and trained to process the images or the video frames to one or more of (i) identify the belongings, (ii) determine details or information related to the belongings, (iii) identify features of the real property, or (iv) determine details or information related to the features.

4 . The computer-implemented method of claim 1 , wherein obtaining the XR preferences includes obtaining the XR preferences using the XR device, wherein the XR further comprise preferences representing one or more of profile data for the party, metaverse preferences, or avatar preferences.

5 . The computer-implemented method of claim 1 , wherein
determining the asset data includes identifying one or more of (i) features of the real property, (ii) construction materials, or (iii) the belongings, and the method further comprises:
generating a quote for an insurance policy for the party based upon the asset data, wherein at least one of the one or more visual depictions represents the quote for the insurance policy such that the party or the insurance representative can at least one of view, modify, or accept the quote.

6 . The computer-implemented method of claim 1 , wherein the captured data (i) includes one or more images or video frames of the real property or the belongings and (ii) is captured before, during, or after a damage-causing event.

7 . The computer-implemented method of claim 6 , further comprising:
processing the captured data and the asset data to generate an insurance claim that includes repair or replacement costs for damaged portions of the real property, or damaged belongings.

8 . The computer-implemented method of claim 6 , further comprising:
generating, based upon the captured data, a virtual reconstruction of the damage-causing event, wherein at least one of the one or more visual depictions includes the virtual reconstruction such that the party or the insurance representative can at least one of view, modify, or approve the virtual reconstruction.

9 . The computer-implemented method of claim 8 , further comprising:
obtaining, using one or more sensors and before, during, or after the damage-causing event, sensor data related to the damage-causing event, wherein the virtual reconstruction is generated based upon the captured data and the sensor data.

10 . The computer-implemented method of claim 1 , wherein determining the asset data includes determining one or more potential damage risks to the real property, or the belongings.

11 . The computer-implemented method of claim 10 , further comprising:
determining, by one or more processors processing the captured data, the asset data, and second data representing risk mitigation, one or more risk mitigation options for the one or more potential damage risks, wherein at least one of the one or more visual depictions includes the risk mitigation options.

12 . The computer-implemented method of claim 11 , further comprising:
obtaining, using one or more sensors, sensor data related to the real property, or the belongings, wherein the potential damage risks are determined based upon the captured data, the asset data, and the sensor data.

13 . The computer-implemented method of claim 1 , wherein determining the asset data includes:
identifying a potential remodeling project for the real property; determining one or more of potential layouts, components, materials, costs, suppliers, or contractors for the remodeling project; generating a virtual representation of a potential result of the remodeling project, wherein at least one of the one or more visual depictions includes the virtual representation.

14 . A system for collecting and collaboratively reviewing asset information using different extended reality (XR) environments, the system comprising:
a communication interface configured to receive one or more XR preferences for a party, the one or more XR preferences including a preference to use virtual reality (VR); and one or more processors configured to:
present, using at least an XR device associated with the party, an AR environment to the party, at least in part by overlaying, on real-world content viewed using the XR device,
instructions constructed to guide the party to move throughout or around a real property, and
prompts constructed to direct the party to capture data representing one or more of the real property or belongings associated with the real property;

determine, by processing the captured data, asset data representing one or more of the real property or the belongings; and
present, in a VR environment that includes a first avatar of the party and a second avatar of an insurance representative, in accordance with the party's XR preferences, and via the XR device or another XR device associated with the party, one or more visual depictions of the determined asset data such that the party or the insurance representative can at least one of view, modify, or approve the asset data.

15 . The system of claim 14 , wherein the one or more processors are configured to determine the asset data by processing input data representing the captured data using one or more configured and trained machine learning models.

16 . The system of claim 15 , wherein the captured data includes images or video frames, and wherein the one or more machine learning models are configured and trained to process the images or the video frames to one or more of (i) identify the belongings, (ii) determine details or information related to the belongings, (iii) identify features of the real property, or (iv) determine details or information related to the features.

17 . A non-transitory computer-readable storage medium storing instructions for collecting and collaboratively reviewing asset information using different extended reality (XR) environments, wherein the instructions, when executed by one

Assignees

• State Farm Mutual Automobile Insurance Co

Inventors

• Breitweiser Edward W
• Gross Ryan
• Stoiber Jeffrey W
• Cope Craig
• Kawakita Christopher N
• Floyd Matthew L

Classifications

• G06Q50/186 Primary

  Estate planning · CPC title

• G06Q50/163

  Real estate management · CPC title

• G06Q50/16

  Real estate · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06Q40/08

  Insurance · CPC title