Self-learning three-dimensional boundaries from images

Patent metadata

Field	Value
Publication number	US-11113841-B1
Application number	US-201916438028-A
Country	US
Kind code	B1
Filing date	Jun 11, 2019
Priority date	Jun 11, 2019
Publication date	Sep 7, 2021
Grant date	Sep 7, 2021

Abstract

Techniques are disclosed. The techniques include receiving, from a camera, an image showing a portion of a physical topography and target object. The techniques include determining, based on the image, a location of the target object shown in the image and a physical characteristic of the target object shown in the image, the physical characteristic being common with at least another target object. The techniques then include determining a three dimensional (3D) position of the target object in a 3D representation of the portion of the physical topography, the 3D position determined based on (i) the location of the target object, and (ii) the physical characteristic. Based on detecting a cluster of 3D positions of target objects (over several images), the techniques involve generating a 3D boundary of a zone of a portion of the physical topography.

First claim

What is claimed is:

1. A system, comprising:
a camera; and
a computer system communicatively coupled with the camera, the computer system comprising one or more processors and one or more computer-readable storage media storing instructions that, upon execution by the one or more processors, cause the computer system to, at least:
receive, from the camera, a first image of a first plurality of images representing a motion of a first vehicle license plate through a portion of a parking lot, the portion being within a field of view of the camera;
determine, based at least in part on the first image, a location of the first vehicle license plate shown in the first image;
determine, based at least in part on the first image, a physical characteristic of the first vehicle license plate shown in the first image, the physical characteristic being common with a second vehicle license plate;
generate a three-dimensional (3D) representation of the portion of the parking lot based at least in part on (i) the location and (ii) the physical characteristic;
subsequent to generating the 3D representation of the portion of the parking lot, receive, from the camera, a second image of a second plurality of images, the second image showing the portion of the parking lot and the second vehicle license plate;
determine a 3D position of the second vehicle license plate in the 3D representation based at least in part on (i) a second location of the second vehicle license plate shown in the second image, and (ii) the physical characteristic shown in the second image;
determine that a vehicle is parked in the parking lot, the vehicle being associated with the second vehicle license plate;
based in part on determining that the vehicle is parked, determine that the 3D position belongs to a cluster of 3D positions of one or more vehicle license plates shown in the second plurality of images; and
generate a 3D boundary of a parking space within the portion of the parking lot based at least in part on the 3D positions of the cluster, the parking space corresponding to where the vehicle is parked.

2. The system of claim 1 , wherein the motion of the first vehicle license plate corresponds to a movement in a two-dimensional (2D) plane that is substantially parallel to a ground of the parking lot.

3. The system of claim 1 , wherein the physical characteristic comprises a first vehicle license plate corner of the first vehicle license plate being at a fixed relative distance from a second vehicle license plate corner.

4. The system of claim 1 , wherein the second image of the second plurality of images is associated with a timestamp, the timestamp being used to determine that the vehicle is parked.

5. The system of claim 1 , further comprising:
a second camera, wherein the camera and the second camera have overlapping fields of view; and
the one or more computer-readable storage media storing further instructions that, when executed by the one or more processors, further cause the computer system to:
receive, from the camera, a third image showing a third vehicle license plate of another vehicle;
determine, from the third image, a unique identifier that identifies the third vehicle license plate;
determine, from the third image, a second 3D position of the third vehicle license plate in the 3D representation based at least in part on (i) a third location of the third vehicle license plate shown in the third image, and (ii) the physical characteristic shown in the third image;
determine that the another vehicle is parked in the parking space, based at least in part on (i) the second 3D position, and (ii) the 3D boundary of the parking space;
receive, from the second camera, a fourth image, the fourth image showing a second portion of the parking lot that is within a field of view of the second camera;
determine, from the fourth image, the unique identifier that identifies the third vehicle license plate; and
generate a second 3D boundary of the parking space corresponding to the second camera based at least in part on the 3D boundary of the parking space corresponding to the camera.

6. A method implemented on a computer system, the method comprising:
receiving, from a camera, an image showing a portion of a parking lot and a vehicle license plate;
determining, based at least in part on the image, a location of the vehicle license plate shown in the image;
determining, based at least in part on the image, a physical characteristic of the vehicle license plate shown in the image, the physical characteristic being common with at least another vehicle license plate;
determining a three dimensional (3D) position of the vehicle license plate in a 3D representation of the portion of the parking lot, the 3D position determined based at least in part on (i) the location of the vehicle license plate, and (ii) the physical characteristic;
determining that the 3D position belongs to a cluster of 3D positions of one or more vehicle license plates; and
generating a 3D boundary of a parking space for a vehicle within the portion of the parking lot based at least in part on the 3D positions of the cluster.

7. The method of claim 6 , further comprising:
determining that the vehicle is parked in the parking lot, and wherein the 3D position is determined to belong to the cluster of 3D positions further based at least in part on the vehicle being parked.

8. The method of claim 7 , further comprising determining that the vehicle is parked in the parking lot by at least:
receiving an indication that the vehicle is checked-in, wherein the vehicle being checked-in corresponds to a state in which the vehicle is ready for receiving a delivery; and
based on receiving the indication, determining that the vehicle is parked.

9. The method of claim 7 , further comprising determining that the vehicle is parked in the parking lot by at least:
receiving as input a dwell time threshold;
determining a first timestamp associated with the image;
receiving, from the camera, a second image being associated with a second timestamp, the second image showing the portion of the parking lot and the vehicle license plate;
determining that the vehicle license plate is shown in the second image;
determining a second 3D position of the vehicle license plate in the 3D representation based at least in part on (i) a second location of the vehicle license plate shown in the second image, and (ii) the physical characteristic of the vehicle license plate shown in the second image; and
based at least in part on (i) a difference between the 3D position and the second 3D position, and (ii) a difference between the first timestamp and the second timestamp matching the dwell time threshold, determining that the vehicle is parked in the parking lot.

10. The method of claim 6 , further comprising determining the 3D representation by at least:
receiving, from the camera, a second image of a plurality of images representing a motion of a second vehicle license plate through the portion of the parking lot;
determining, based at least in part on the second image, a location of the second vehicle license plate shown in the second image;
determining, based at least in part on the second image, the physical characteristic of the second vehicle license plate shown in the second image that is common with the vehicle license plate; and
generating the 3D representation of the portion of the parking lot based at least in part on (i) the location and (ii) the physical characteristic.

11. The method of claim 10 , wherein determining the 3D representation further comprises:
receiving a third image of the plurality of images;
determining, based at leas

Assignees

• Amazon Tech Inc

Inventors

• Zelenskiy Lev
• Ducrou Jon
• Eather James
• Neville Michael

Classifications

• G06Q10/0835 Primary

  Relationships between shipper or supplier and carriers · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06V10/255

  Detecting or recognising potential candidate objects based on visual cues, e.g. shapes · CPC title

• G06T7/74 Primary

  involving reference images or patches · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title