Processing system having a machine learning engine for providing a surface dimension output

Patent metadata

Field	Value
Publication number	US-12333581-B2
Application number	US-202217676701-A
Country	US
Kind code	B2
Filing date	Feb 21, 2022
Priority date	May 4, 2018
Publication date	Jun 17, 2025
Grant date	Jun 17, 2025

Abstract

Systems and apparatuses for generating surface dimension outputs are provided. The system may collect an image from a mobile device. The system may analyze the image to determine whether they comprise one or more standardized reference objects. Based on analysis of the image and the one or more standardized reference objects, the system may determine a surface dimension output. The system may determine one or more settlement outputs and one or more repair outputs for the driver based on the surface dimension output.

First claim

What is claimed is:

1. A method comprising:
receiving, by an image analysis and device control system and from a mobile device, at least one image;
determining, by the image analysis and device control system and using edge detection, an indication of boundaries of a surface comprising included in the at least one image, comprising:
determining, using one or more machine learning algorithms, a plurality of bounding boxes corresponding to the at least one image, wherein determining the plurality of bounding boxes includes adjusting dimensions of the plurality of bounding boxes to match predetermined dimensions for a neural network, and
inputting, into the neural network, the plurality of bounding boxes for analysis by the one or more machine learning algorithms to determine whether the at least one image comprises a reference object;

determining, by the image analysis and device control system, pixel dimensions for the surface;
determining, by the image analysis and device control system and based at least on the pixel dimensions for the surface, an actual surface dimension comprising actual dimensions for the surface; and
transmitting, by the image analysis and device control system and to the mobile device, the actual surface dimension output.

2. The method of claim 1 , further comprising transmitting, by the image analysis and device control system and to the mobile device, an instruction to capture the at least one image.

3. The method of claim 2 , further comprising receiving, by the image analysis and device control system and from the mobile device, a damage indication output, wherein the transmitting the instruction to capture the at least one image is responsive to the receiving the damage indication output.

4. The method of claim 2 , wherein the instruction to capture the at least one image comprises a link to download a damage processing application.

5. The method of claim 1 , wherein the reference object comprises at least one of: a light switch, an outlet, an outlet plate, a light bulb, a can light, a phone outlet, a data jack, a base board, a nest, a smoke detector, a kitchen sink, a faucet, a stove, a dishwasher, a floor tile, hot and cold faucets, a heat vent, a key hole, a door handle, a door frame, a deadbolt, a door, a stair, a railing, a table, a chair, a bar stool, a toilet, and a cabinet.

6. The method of claim 1 , further comprising:
transmitting, by the image analysis and device control system and to the mobile device, an instruction to prompt for a room indication input comprising an indication of a type of room in which the at least one image was captured;
receiving, by the image analysis and device control system and from the mobile device, the room indication input;
determining, by the image analysis and device control system and based on the room indication input, a room indication output; and
determining, by the image analysis and device control system and based on the room indication output, a plurality of reference objects.

7. The method of claim 6 , wherein the at least one image comprises at least one of the plurality of reference objects.

8. An image analysis and device control system comprising:
a memory; and
a processor coupled to the memory and programmed with computer-executable instructions for performing operations comprising:
receiving, from a mobile device, at least one image;
determining, using edge detection, an indication of boundaries of a surface included in the at least one image, comprising:
determining, using one or more machine learning algorithms, a plurality of bounding boxes corresponding to the at least one image, wherein determining the plurality of bounding boxes includes adjusting dimensions of the plurality of bounding boxes to match predetermined dimensions for a neural network, and
inputting, into the neural network, the plurality of bounding boxes for analysis by the one or more machine learning algorithms to determine whether the at least one image comprises a reference object;

determining pixel dimensions for the surface;
determining, based at least on the pixel dimensions for the surface, an actual surface dimension comprising actual dimensions for the surface; and
transmitting, by the image analysis and device control system and to the mobile device, the actual surface dimension output.

9. The system of claim 8 , the operations further comprising transmitting, to the mobile device, an instruction to capture the at least one image.

10. The system of claim 9 , the operations further comprising receiving, from the mobile device, a damage indication output, wherein the transmitting the instruction to capture the at least one image is responsive to the receiving the damage indication output.

11. The system of claim 9 , wherein the instruction to capture the at least one image comprises a link to download a damage processing application.

12. The system of claim 8 , wherein the reference object comprises at least one of: a light switch, an outlet, an outlet plate, a light bulb, a can light, a phone outlet, a data jack, a base board, a nest, a smoke detector, a kitchen sink, a faucet, a stove, a dishwasher, a floor tile, hot and cold faucets, a heat vent, a key hole, a door handle, a door frame, a deadbolt, a door, a stair, a railing, a table, a chair, a bar stool, a toilet, and a cabinet.

13. The system of claim 8 , the operations further comprising:
transmitting, by the image analysis and device control system and to the mobile device, an instruction to prompt for a room indication input comprising an indication of a type of room in which the at least one image was captured;
receiving, by the image analysis and device control system and from the mobile device, the room indication input;
determining, by the image analysis and device control system and based on the room indication input, a room indication output; and
determining, by the image analysis and device control system and based on the room indication output, a plurality of reference objects.

14. The system of claim 13 , wherein the at least one image comprises at least one of the plurality of reference objects.

15. A non-transitory computer-readable medium storing computer executable instructions, which when executed by a processor, cause an image analysis and device control system to perform operations comprising:
receiving, from a mobile device, at least one image;
determining, using edge detection, an indication of boundaries of a surface included in the at least one image, comprising:
determining, using one or more machine learning algorithms, a plurality of bounding boxes corresponding to the at least one image, wherein determining the plurality of bounding boxes includes adjusting dimensions of the plurality of bounding boxes to match predetermined dimensions for a neural network, and
inputting, into the neural network, the plurality of bounding boxes for analysis by the one or more machine learning algorithms to determine whether the at least one image comprises a reference object;

determining pixel dimensions for the surface;
determining, based at least on the pixel dimensions for the surface, an actual surface dimension comprising actual dimensions for the surface; and
transmitting, by the image analysis and device control system and to the mobile device, the actual surface dimension output.

16. The media of claim 15 , the operations further comprising transmitting, to the mobile device, an instruction to capture the at least one image.

17. The media of claim 16 , the operations further comprising receiving, from

Assignees

• Allstate Insurance Co

Inventors

• Cornelison Michael T
• Sharma Anurag
• Brickman Daniel
• Zahn David M
• Daniels Andrew
• Patel Pinal
• Gilkison David L
• Genc Steven

Classifications

• G06V40/162

  using pixel segmentation or colour matching · CPC title

• G06N20/00

  Machine learning · CPC title

• G06T7/13

  Edge detection · CPC title

• G06N3/02

  Neural networks · CPC title

• G06T2210/12

  Bounding box · CPC title