Generating augmented reality vehicle information for a vehicle captured by cameras in a vehicle lot

Patent metadata

Field	Value
Publication number	US-11037225-B2
Application number	US-201916394572-A
Country	US
Kind code	B2
Filing date	Apr 25, 2019
Priority date	Apr 25, 2019
Publication date	Jun 15, 2021
Grant date	Jun 15, 2021

Abstract

A device receives, from multiple cameras, streaming video data associated with multiple vehicles and provides the streaming video data to a user device associated with a user. The device receives, from the user device, a request to control a first camera and provides, to the user device, first streaming video data associated with the first camera. The device receives, from the user device, a camera control command for the first camera and causes the first camera to perform an action. The device receives updated first streaming video data from the first camera and provides, to the user device, the updated first streaming video data. The device receives, from the user device, information identifying a first vehicle in the updated first streaming video data and identifies first augmented reality vehicle information associated with the first vehicle. The device provides the first augmented reality vehicle information to the user device.

First claim

What is claimed is:

1. A method, comprising:
determining, by a device, an inventory of a plurality of vehicles in a vehicle lot based on first streaming video data received from a plurality of cameras associated with the vehicle lot,
wherein the plurality of cameras includes a first camera equipped to an unmanned aerial vehicle (UAV);

determining, by the device and using the first streaming video data, a condition of each vehicle of the plurality of vehicles;
receiving, by the device and from the plurality of cameras, second streaming video data associated with the plurality of vehicles,
the plurality of cameras providing respective portions of the second streaming video data;

providing, by the device, the second streaming video data to a user device associated with a user;
receiving, by the device and from the user device, a request to control the first camera, of the plurality of cameras, based on a user interaction with the second streaming video data;
providing, by the device, to the user device, and based on the request, third streaming video data associated with the first camera,
wherein the third streaming video data includes a respective portion of the second streaming video data captured by the first camera;

receiving, by the device and from the user device, a camera control command for the first camera;
causing, by the device, the UAV to perform an action based on the camera control command,
the action including moving the UAV;

receiving, by the device, updated third streaming video data from the first camera based on the first camera performing the action,
wherein the updated third streaming video data includes the respective portion of the second streaming video data captured by the first camera after performance of the action;

providing, by the device and to the user device, the updated third streaming video data;
receiving, by the device and from the user device, information identifying a first vehicle, of the plurality of vehicles, in the updated third streaming video data;
identifying, by the device, first augmented reality vehicle information associated with the first vehicle based on the information identifying the first vehicle,
the first augmented reality vehicle information including data identifying the condition of the first vehicle; and

providing, by the device, the first augmented reality vehicle information to the user device to enable the user device to overlay the first augmented reality vehicle information on the updated third streaming video data.

2. The method of claim 1 , further comprising:
utilizing information indicating the inventory of the plurality of vehicles to determine augmented reality vehicle information for each of the plurality of vehicles.

3. The method of claim 1 , wherein identifying the first augmented reality vehicle information comprises:
processing the information identifying the first vehicle, with a machine learning model, to match the information identifying the first vehicle and a portion of augmented reality vehicle information associated with the plurality of vehicles; and
identifying the first augmented reality vehicle information based on matching the information identifying the first vehicle and the portion of the augmented reality vehicle information associated with the plurality of vehicles.

4. The method of claim 1 , further comprising:
receiving, from the user device, information requesting a communication with a sales person at the vehicle lot; and
causing the communication to be established between the user device associated with the user and a user device associated with the sales person.

5. The method of claim 1 , further comprising:
receiving, from the user device, another request to control a second camera, of the plurality of cameras, based on another user interaction with the second streaming video data; and
providing, to the user device and based on the other request, fourth streaming video data associated with the second camera,
wherein the fourth streaming video data includes a respective portion of the second streaming video data captured by the second camera.

6. The method of claim 5 , further comprising:
receiving, from the user device, another camera control command for the second camera;
causing the second camera to perform another action based on the other camera control command,
the other action including moving the second camera;

receiving updated fourth streaming video data from the second camera based on the second camera performing the other action,
wherein the updated fourth streaming video data includes the respective portion of the second streaming video data captured by the second camera after performance of the other action; and

providing, to the user device, the updated fourth streaming video data.

7. The method of claim 6 , further comprising:
receiving, from the user device, information identifying a second vehicle, of the plurality of vehicles, in the updated fourth streaming video data;
identifying second augmented reality vehicle information associated with the second vehicle based on the information identifying the second vehicle; and
providing the second augmented reality vehicle information to the user device to enable the user device to associate the second augmented reality vehicle information with the updated fourth streaming video data.

8. A device, comprising:
one or more memories; and
one or more processors, communicatively coupled to the one or more memories, configured to:
determine an inventory of a plurality of vehicles in a vehicle lot based on first streaming video data received from a plurality of cameras associated with the vehicle lot,
wherein the plurality of cameras includes a particular camera, of the plurality of cameras, equipped to an unmanned aerial vehicle (UAV);

receive, from the plurality of cameras, second streaming video data associated with the plurality of vehicles,
the plurality of cameras providing respective portions of the second streaming video data;

receive, from a user device associated with a user, user input indicating a particular vehicle, of the plurality of vehicles;
provide, based on the user input, the second streaming video data to the user device,
the second streaming video data depicting the particular vehicle;

receive, from the user device, a request to control the particular camera based on a user interaction with the second streaming video data;
provide, to the user device and based on the request, particular streaming video data associated with the particular camera,
wherein the particular streaming video data includes a respective portion of the second streaming video data captured by the particular camera, and
wherein the particular streaming video data includes information identifying the particular vehicle;

receive, from the user device, a camera control command for the particular camera,
wherein the camera control command includes a command to cause the particular camera to one or more of tilt, rotate, pan, or zoom;

cause the UAV to move based on the camera control command;
receive updated particular streaming video data from the particular camera based on the particular camera one or more of tilting, rotating, panning, or zooming,
wherein the updated particular streaming video data includes the respective portion of the second streaming video data captured by the particular camera after the particular camera one or more of tilts, rotates, pans, or zooms;

provide, to the user device, the updated particular streaming video data;
identify augmented reality vehicle information associated with the particular vehicle based on the information identifying the particular vehicle,
the augmented reality vehicle infor

Assignees

• Capital One Services Llc

Inventors

• Tang Qiaochu
• Wylie Stephen
• Dagley Geoffrey
• Awoyemi Olalekan
• Duckworth Staevan
• Hoover Jason
• Price Micah

Classifications

• G06V2201/08

  Detecting or categorising vehicles · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title