Method for determining correct scanning distance using augmented reality and machine learning models

Patent metadata

Field	Value
Publication number	US-12008724-B2
Application number	US-202318101982-A
Country	US
Kind code	B2
Filing date	Jan 26, 2023
Priority date	Oct 23, 2018
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

A smart device is provided with an application program for displaying a video feed received from the smart device's camera. The application can determine the coordinates for an intersection point, which is a point on the ground where the smart device is pointing at. The application can display a target on the visual representation of the intersection point. Based on whether the smart device is at an appropriate distance from the intersection point, the user interface can superimpose an indicator on the video feed received from the camera. This can inform the user whether the smart device is at an optimal scan distance from the intersection point (or an object) so that the object can be identified by a machine learning model.

First claim

The invention claimed is:

1. A non-transitory computer-accessible medium having stored thereon computer-executable instructions executable by a computing hardware arrangement, wherein, when the computing hardware arrangement executes the instructions, the computing hardware arrangement is configured to perform procedures comprising:
displaying, on a display, a video feed captured by a camera from a first position;
determining an intersection point between a ground plane and the first position;
displaying a target over a visual representation of the intersection point on the display;
determining a distance between the first position and the intersection point; and
capturing by the camera an image of an object in the video feed when the distance between the first position and the intersection point is within an optimal scan distance.

2. The non-transitory computer-accessible medium of claim 1 , wherein the computing hardware arrangement further comprises instruction for identifying, using an object recognition model, an object in the video feed.

3. The non-transitory computer-accessible medium of claim 2 , wherein the computing hardware arrangement further comprises instruction for displaying information about the identified object on the display.

4. The non-transitory computer-accessible medium of claim 1 , wherein the intersection point is a point on a ground plane where a perpendicular hypothetical line extending from the first position would intersect the ground plane.

5. The non-transitory computer-accessible medium of claim 1 , wherein the optimal scanning distance is determined based on a threshold percentage of a field of view being occupied by the object.

6. The non-transitory computer-accessible medium of claim 1 , wherein the optimal scan distance is a learned value received from the object recognition model.

7. The non-transitory computer-accessible medium of claim 1 , wherein the intersection point corresponds to a center point of a field of view of the camera located at the first position.

8. The non-transitory computer-accessible medium of claim 1 , wherein the image of the object is captured automatically based upon the distance between the first position and the intersection point.

9. The non-transitory computer-accessible medium of claim 1 , wherein the optimal scan distance is determined based on an altitude of the first position relative to the ground plane.

10. The non-transitory computer-accessible medium of claim 1 , wherein the optical scan distance is determined based on a field of view and an angular separation of pixels of the camera located at the first position.

11. The non-transitory computer-accessible medium of claim 2 , wherein the computing hardware arrangement further comprises instruction displaying a notification in the video feed upon the capture of the image of the object.

12. A method comprising:
displaying, on a display, a video feed captured by a camera from a first position;
determining an intersection point between a ground plane and the first position;
displaying a target over a visual representation of the intersection point;
determining a distance between the first position and the intersection point; and
capturing by the camera an image of an object in the video feed when the distance between the first position and the intersection point is within an optimal scan distance.

13. The method of claim 12 , further comprising: identifying, using an object recognition model, an object in the video feed.

14. The method of claim 13 , further comprising: displaying information about the identified object on the display.

15. The method of claim 12 , wherein the intersection point is a point on a ground plane where a perpendicular hypothetical line extending from the first position would intersect the ground plane.

16. The method of claim 12 , wherein the optimal scanning distance is determined based on a threshold percentage of a field of view being occupied by the object.

17. The method of claim 12 , wherein the optimal scan distance is a learned value received from the object recognition model.

18. The method of claim 12 , wherein the intersection point corresponds to a center point of a field of view of the camera located at the first position.

19. The method of claim 12 , wherein the image of the object is captured automatically based upon the distance between the first position and the intersection point.

20. The method of claim 12 , wherein the optimal scan distance is determined based on an altitude of the first position relative to the ground plane.

21. The method of claim 12 , wherein the optical scan distance is determined based on a field of view and an angular separation of pixels of the camera located at the first position.

22. A device comprising:
a camera configured to capture a video feed from a first position;
a display configured to display the video feed; and
a processor,
wherein the processor is configured to:
display, on the display, a video feed captured by a camera from a first position;
determine an intersection point between a ground plane and the first position;
display a target over a visual representation of the intersection point;
determine a distance between the first position and the intersection point; and
capture, by the camera, an image of an object in the video feed when the distance between the first position and the intersection point is within an optimal scan distance.

Assignees

• Capital One Services Llc

Inventors

• Duckworth Staevan
• Martinez Daniel
• Hardin William
• Castaneda Jonathan
• Lee Susie

Classifications

• G06V20/64

  Three-dimensional [3D] objects · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G06V10/17

  using hand-held instruments · CPC title

• G06V20/584

  of vehicle lights or traffic lights · CPC title