Systems and methods for depicting vehicle information in augmented reality

Patent metadata

Field	Value
Publication number	US-2020050856-A1
Application number	US-201916247642-A
Country	US
Kind code	A1
Filing date	Jan 15, 2019
Priority date	Aug 8, 2018
Publication date	Feb 13, 2020
Grant date	—

Abstract

Systems and methods are provided for depicting information about a vehicle in augmented reality. An exemplary method may include determining identification information of a vehicle based on input received from a client device and obtaining, from an information source, vehicle information based on the identification information. The method may also include analyzing the vehicle information using an artificial intelligence engine and extracting vehicle history data from the vehicle information based on the analysis. The method may also include identifying a portion of the vehicle associated with the vehicle history data and providing instructions, based on the vehicle history data, to an augmented reality-enabled device to superimpose an indicator on a visual representation of the vehicle at a location corresponding to the portion of the vehicle.

First claim

1 - 20 . (canceled)

21 . A system for extracting vehicle information for depiction in augmented reality, the system comprising:
at least one processor in communication with a client device; and a storage medium storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving vehicle history information associated with a vehicle, wherein the vehicle history information contains text or an image associated with the vehicle;
recognizing the text or image;
analyzing the recognized text or image using an artificial intelligence engine to identify vehicle history data, wherein the vehicle history data comprises a maintenance history of the vehicle;
identifying a location on the vehicle subject to maintenance services based on the maintenance history of the vehicle; and
providing instructions, based on the location on the vehicle subject to maintenance services, to an augmented reality-enabled device to superimpose an indicator on a visual representation of the vehicle at the location corresponding to the identified location on the vehicle.

22 . The system of claim 21 , further comprising post-processing the vehicle history information based on a predefined lexicon.

23 . The system of claim 21 , further comprising pre-processing the vehicle history information, wherein the pre-processing comprises de-skewing the text or image.

24 . The system of claim 21 , wherein the recognizing comprises comparing the text or image to a glyph on a pixel-by-pixel basis.

25 . The system of claim 21 , wherein the recognizing comprises:
decomposing glyphs from the vehicle history information into features; and comparing the features to a representation of a character.

26 . The system of claim 22 , wherein the post-processing comprises at least one of:
constraining recognized text from the vehicle history information based on the lexicon; or influencing character or word segmentation in the recognized text based on the lexicon.

27 . The system of claim 21 , wherein:
the vehicle history data comprises accident information relating to an accident involving the vehicle; and identifying the location on the vehicle subject to maintenance services comprises identifying a location on the vehicle impacted by the accident.

28 . The system of claim 21 , wherein the indicator comprises information associated with an overdue maintenance service associated with the identified location.

29 . The system of claim 21 , wherein the visual representation of the vehicle comprises a live image of the vehicle captured by the augmented reality-enabled device.

30 . The system of claim 29 , wherein the position of the superimposed indicator changes based on a real-time change in the live image due to a change in angle or position of the augmented reality-enabled device.

31 . A method for processing vehicle information for depiction in augmented reality, the method comprising:
receiving vehicle history information associated with a vehicle, wherein the vehicle history information contains text or an image associated with the vehicle; recognizing the text or image; analyzing the recognized text or image using an artificial intelligence engine to identify vehicle history data, wherein the vehicle history data comprises a maintenance history of the vehicle; identifying a location on the vehicle subject to maintenance services based on the maintenance history of the vehicle; and providing instructions, based on the location on the vehicle subject to maintenance services, to an augmented reality-enabled device to superimpose an indicator on a visual representation of the vehicle at the location corresponding to the identified location on the vehicle.

32 . The method of claim 31 , further comprising post-processing the vehicle history information based on a predefined lexicon.

33 . The method of claim 31 , further comprising pre-processing the vehicle history information, wherein the pre-processing comprises de-skewing the text or image.

34 . The method of claim 31 , wherein the recognizing comprises comparing the text or image to a glyph on a pixel-by-pixel basis.

35 . The method of claim 31 , wherein the recognizing comprises:
decomposing glyphs from the vehicle history information into features; and comparing the features to a representation of a character.

36 . The method of claim 31 , wherein the post-processing comprises at least one of:
constraining recognized text from the vehicle history information based on the lexicon; or influencing character or word segmentation in the recognized text based on the lexicon.

37 . The method of claim 31 , wherein:
the vehicle history data comprises accident information relating to an accident involving the vehicle; and identifying the location on the vehicle subject to maintenance services comprises identifying a location on the vehicle impacted by the accident.

38 . The method of claim 31 , wherein the indicator comprises information associated with an overdue maintenance service associated with the identified location.

39 . The method of claim 31 , wherein the visual representation of the vehicle comprises a live image of the vehicle captured by the augmented reality-enabled device.

40 . The method of claim 39 , wherein the position of the superimposed indicator changes based on a real-time change in the live image due to a change in angle or position of the augmented reality-enabled device.

Assignees

• Capital One Services Llc

Inventors

• Chikkaveerappa Satish
• Mathews Liju
• Subramanian Ponnazhakan

Classifications

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06N3/063

  using electronic means · CPC title

• G06N5/04

  Inference or reasoning models · CPC title

• G06V30/10

  Character recognition · CPC title