Systems and methods for depicting vehicle information in augmented reality

Patent metadata

Field	Value
Publication number	US-11017230-B2
Application number	US-201916247642-A
Country	US
Kind code	B2
Filing date	Jan 15, 2019
Priority date	Aug 8, 2018
Publication date	May 25, 2021
Grant date	May 25, 2021

Abstract

Systems and methods are provided for depicting information about a vehicle in augmented reality. An exemplary method may include determining identification information of a vehicle based on input received from a client device and obtaining, from an information source, vehicle information based on the identification information. The method may also include analyzing the vehicle information using an artificial intelligence engine and extracting vehicle history data from the vehicle information based on the analysis. The method may also include identifying a portion of the vehicle associated with the vehicle history data and providing instructions, based on the vehicle history data, to an augmented reality-enabled device to superimpose an indicator on a visual representation of the vehicle at a location corresponding to the portion of the vehicle.

First claim

The invention claimed is:

1. A system for extracting vehicle information for depiction in augmented reality, the system comprising:
at least one processor in communication with an augmented reality-enabled device; and
at least one storage medium storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving vehicle information associated with a vehicle;
analyzing the vehicle information using an artificial intelligence engine;
extracting vehicle history information from the vehicle information based on the analysis, wherein the vehicle history information includes a maintenance history of the vehicle;
identifying, using the extracted vehicle history information, a vehicle portion associated with the vehicle history information for which a maintenance service is recommended, the vehicle portion being a portion of the vehicle;
providing instructions, based on the vehicle history information, to the augmented reality-enabled device to perform operations including:
identifying, in an augmented-reality visual representation of the vehicle, a location corresponding to the vehicle portion for which the maintenance service is recommended, and
superimposing an indicator on the augmented-reality visual representation of the vehicle on the location corresponding to the vehicle portion for which the maintenance service is recommended; and

post-processing the vehicle history information based on a predefined lexicon.

2. The system of claim 1 , further comprising pre-processing the vehicle history information, wherein the pre-processing comprises recognizing text or image associated with the vehicle from the vehicle history information, and de-skewing the text or image.

3. The system of claim 2 , wherein the recognizing comprises comparing the text or image to a glyph on a pixel-by-pixel basis.

4. The system of claim 3 further comprising:
decomposing glyphs from the vehicle history information into features; and
comparing the features to a representation of a character.

5. The system of claim 1 , wherein the post-processing comprises at least one of:
constraining text from the vehicle history information based on the lexicon; or
influencing character or word segmentation in the text based on the lexicon.

6. The system of claim 1 , wherein:
the vehicle history information comprises accident information relating to an accident involving the vehicle; and
identifying the vehicle portion for which the maintenance service is recommended comprises identifying a location on the vehicle impacted by the accident.

7. The system of claim 1 , wherein the indicator comprises information associated with an overdue maintenance service associated with the identified vehicle portion.

8. The system of claim 1 , wherein the augmented-reality visual representation of the vehicle comprises a live image of the vehicle captured by the augmented reality-enabled device.

9. The system of claim 8 , wherein the position of the superimposed indicator changes based on a real-time change in the live image due to a change in angle or position of the augmented reality-enabled device.

10. A method for processing vehicle information for depiction in augmented reality, the method comprising:
receiving vehicle information associated with a vehicle;
analyzing the vehicle information using an artificial intelligence engine;
extracting vehicle history information from the vehicle information based on the analysis, wherein the vehicle history information includes a maintenance history of the vehicle;
identifying, using the extracted vehicle history information, a vehicle portion associated with the vehicle history information for which a maintenance service is recommended, the vehicle portion being a portion of the vehicle;
providing instructions, based on the vehicle history information, to the augmented reality-enabled device to perform operations including:
identifying, in an augmented-reality visual representation of the vehicle, a location corresponding to the vehicle portion for which the maintenance service is recommended, and
superimposing an indicator on the augmented-reality visual representation of the vehicle on the location corresponding to the vehicle portion for which the maintenance service is recommended; and

post-processing the vehicle history information based on a predefined lexicon.

11. The method of claim 10 , further comprising pre-processing the vehicle history information, wherein the pre-processing comprises recognizing text or image associated with the vehicle from the vehicle history information, and de-skewing the text or image.

12. The method of claim 11 , wherein the recognizing comprises comparing the text or image to a glyph on a pixel-by-pixel basis.

13. The method of claim 12 further comprising:
decomposing glyphs from the vehicle history information into features; and
comparing the features to a representation of a character.

14. The method of claim 10 , wherein the post-processing comprises at least one of:
constraining text from the vehicle history information based on the lexicon; or
influencing character or word segmentation in the text based on the lexicon.

15. The method of claim 10 , wherein:
the vehicle history information comprises accident information relating to an accident involving the vehicle; and
identifying the vehicle portion for which the maintenance service is recommended comprises identifying a location on the vehicle impacted by the accident.

16. The method of claim 10 , wherein the indicator comprises information associated with an overdue maintenance service associated with the identified vehicle portion.

17. The method of claim 10 , wherein the augmented-reality visual representation of the vehicle comprises a live image of the vehicle captured by the augmented reality-enabled device.

18. The method of claim 17 , wherein the position of the superimposed indicator changes based on a real-time change in the live image due to a change in angle or position of the augmented reality-enabled device.

Assignees

• Capital One Services Llc

Inventors

• Chikkaveerappa Satish
• Mathews Liju
• Subramanian Ponnazhakan

Classifications

• G06V30/10

  Character recognition · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06Q40/08 Primary

  Insurance · CPC title

• G06N3/045

  Combinations of networks · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title