Utilizing machine learning to generate augmented reality vehicle information for a scale model of a vehicle

Patent metadata

Field	Value
Publication number	US-10535201-B1
Application number	US-201916277843-A
Country	US
Kind code	B1
Filing date	Feb 15, 2019
Priority date	Feb 15, 2019
Publication date	Jan 14, 2020
Grant date	Jan 14, 2020

Abstract

A device receives an image including image data of a scale model of a vehicle, and processes the image data, with a model, to identify a make, a model, and a year represented by the scale model. The device determines augmented reality (AR) vehicle information based on the make, the model, and the year represented by the scale model of the vehicle, and provides the AR vehicle information to enable a user device to associate the AR vehicle information with the image of the scale model of the vehicle. The device receives an input associated with the AR vehicle information, and determines updated AR vehicle information based on the input associated with the AR vehicle information. The device provides the updated AR vehicle information to enable the user device to associate the updated augmented reality vehicle information with the image of the scale model of the vehicle.

First claim

What is claimed is:

1. A method, comprising:
receiving, by a device, live streaming image data of a scale model of a vehicle,
wherein the live streaming image data is transmitted by a user device to the device;

processing, by the device and with a model, at least a portion of the live streaming image data to determine vehicle information associated with the scale model of the vehicle,
wherein the vehicle information includes at least one of:
information identifying a year of the vehicle,
information identifying a make of the vehicle, or
information identifying a vehicle model of the vehicle;

providing, by the device, the vehicle information to the user device;
receiving, by the device and from the user device, an input associated with the vehicle information,
the input indicating a vehicle option affecting an appearance of the vehicle;

determining, by the device, augmented reality vehicle information based on the input associated with the vehicle information,
wherein the augmented reality vehicle information includes data enabling the user device to display, with the live streaming image data, the vehicle option using augmented reality to reflect the appearance of the vehicle on the scale model of the vehicle; and

providing, by the device, the augmented reality vehicle information to the user device to enable the user device to associate the augmented reality vehicle information with the live streaming image data of the scale model of the vehicle,
the augmented reality vehicle information causing the user device to display the vehicle option using augmented reality to reflect the appearance of the vehicle on the scale model of the vehicle, and
the augmented reality vehicle information being associated with the live streaming image data based on augmented reality markers associated with the scale model of the vehicle,
the augmented reality markers indicating where to provide the augmented reality vehicle information in relation to the scale model of the vehicle.

2. The method of claim 1 , further comprising:
determining a particular vehicle in inventory that includes features that substantially match the vehicle option;
determining financial information for the particular vehicle,
wherein the financial information includes at least one of:
information indicating a price of the particular vehicle, or
information indicating financing terms for the particular vehicle; and

providing the financial information to the user device.

3. The method of claim 2 , further comprising:
receiving, from the user device, an input associated with the financial information;
determining updated financial information based on the input associated with the financial information; and
providing the updated financial information to the user device.

4. The method of claim 1 , further comprising:
determining test drive information based on the vehicle information associated with the scale model of the vehicle,
wherein the test drive information includes at least one of:
information indicating that a test drive is available for the vehicle, or information indicating a time of the test drive;
receiving, from the user device, an input associated with the test drive information;

determining updated test drive information based on the input associated with the test drive information,
wherein the updated test drive information includes information indicating an updated time for the test drive of the vehicle;

providing, to the vehicle, instructions to drive to a location of the user device at the updated time; and
providing the updated test drive information to the user device.

5. The method of claim 1 , further comprising:
determining updated vehicle information based on the input associated with the vehicle information; and
providing the updated vehicle information to the user device.

6. The method of claim 1 , further comprising:
determining projector information based on the input associated with the vehicle information,
wherein the projector information includes information to be projected on the scale model of the vehicle; and

providing, to a projector associated with the scale model of the vehicle, the projector information to enable the projector to project the projector information on the scale model of the vehicle.

7. The method of claim 1 , further comprising:
providing, to the user device, an augmented reality application to enable the user device to display the augmented reality vehicle information.

8. A device, comprising:
one or more memories; and
one or more processors, communicatively coupled to the one or more memories, configured to:
receive live streaming image data of a scale model of a vehicle,
wherein the live streaming image data is captured by a user device;

process at least a portion of the live streaming image data, with a model, to identify a make, a vehicle model, and a year represented by the scale model of the vehicle;
determine augmented reality vehicle information based on the make, the vehicle model, and the year represented by the scale model of the vehicle,
wherein the augmented reality vehicle information includes data enabling the user device to display, with the live streaming image data, a vehicle option using augmented reality to reflect an appearance of the vehicle on the scale model of the vehicle;

provide the augmented reality vehicle information to the user device to enable the user device to associate the augmented reality vehicle information with the live streaming image data of the scale model of the vehicle,
the augmented reality vehicle information causing the user device to display the vehicle option using augmented reality to reflect the appearance of the vehicle on the scale model of the vehicle, and
the augmented reality vehicle information being associated with the live streaming image data based on augmented reality markers associated with the scale model of the vehicle,
the augmented reality markers indicating where to provide the augmented reality vehicle information in relation to the scale model of the vehicle;

receive, from the user device, an input associated with the augmented reality vehicle information;
determine updated augmented reality vehicle information based on the input associated with the augmented reality vehicle information; and
provide the updated augmented reality vehicle information to the user device to enable the user device to associate the updated augmented reality vehicle information with the live streaming image data of the scale model of the vehicle.

9. The device of claim 8 , wherein the one or more processors are further configured to:
determine financial information of a real-world version of the vehicle based on the make, the vehicle model, and the year represented by the scale model of the vehicle,
wherein the financial information includes at least one of:
information indicating a price of the real-world version of the vehicle, or
information requesting information associated with a user of the user device; and

provide the financial information to the user device.

10. The device of claim 9 , wherein the one or more processors are further configured to:
receive, from the user device, the information associated with the user of the user device;
determine updated financial information based on the information associated with the user of the user device,
wherein the updated financial information includes information indicating financing terms for the user; and

provide the updated financial information to the user device.

11. The device of claim 8 , wherein the one or more processors are further configured to:
determine test dri

Assignees

• Capital One Services Llc

Inventors

• Price Micah
• Tang Qiaochu
• Hoover Jason
• Wylie Stephen
• Dagley Geoffrey
• Przano Kristen

Classifications

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06Q40/02 Primary

  Banking, e.g. interest calculation or account maintenance (credit or loans G06Q40/03) · CPC title

• G06N7/01

  Probabilistic graphical models, e.g. probabilistic networks · CPC title

• G06N3/045

  Combinations of networks · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title