Photo instructions and confirmation

Patent metadata

Field	Value
Publication number	US-12260643-B2
Application number	US-202418648095-A
Country	US
Kind code	B2
Filing date	Apr 26, 2024
Priority date	Aug 29, 2022
Publication date	Mar 25, 2025
Grant date	Mar 25, 2025

Abstract

Computer program products, methods, systems, apparatus, and computing entities are provided for optimizing package delivery and confirmation are disclosed. In one embodiment, the system's processors accesses a first image of an assigned delivery location captured by a first computing device. The first image comprises an annotation indicating a specific location at the assigned delivery location for delivery of a parcel. At a display device of a second computing device, a real-time image stream comprising the annotation is captured by a camera of the second computing device is displayed. The annotation is overlaid within the real-time image stream based on comparing the first image received from the first computing device to the real-time image stream. The system further captures, from the real-time image stream, a second image when the parcel is positioned at the specific location based on the annotation overlaid within the real-time image stream.

First claim

What is claimed is:

1. A computing device comprising:
a camera;
a non-transitory computer-readable medium storing instructions; and
a processor communicatively coupled to the non-transitory computer-readable medium, wherein the processor is configured to execute the instructions and thereby perform operations comprising:
accessing a first image of a delivery destination captured by a remote computing device, wherein the first image comprises an annotation identifying an assigned delivery location at the delivery destination for delivery of a parcel;
initiating the camera to continuously capture image data as a real-time image stream of the delivery destination;
comparing the first image to the real-time image stream;
superimposing, based at least in part on comparing the first image to the real-time image stream, the annotation over the real-time image stream to overlay the annotation onto the real-time image stream at a position that corresponds to the assigned delivery location;
displaying, on a display of the computing device, the real-time image stream with the annotation overlaid onto the real-time image stream; and
capturing, via the camera and from the real-time image stream, a second image of the delivery destination.

2. The computing device of claim 1 , wherein the operations further comprise determining, from the real-time image stream, that the parcel has been placed at the assigned delivery location, wherein capturing the second image is performed in response to determining that the parcel has been placed at the assigned delivery location.

3. The computing device of claim 2 , wherein the annotation comprises a boundary marker delineating the assigned delivery location, and determining that the parcel has been placed at the assigned delivery location comprises determining the parcel is positioned within the boundary marker.

4. The computing device of claim 1 , wherein the operations further comprise:
identifying, based at least in part on the annotation, machine readable indicia affixed to the parcel;
determining, based at least in part on the machine readable indicia, a delivery location for the parcel; and
determining that the delivery location matches the assigned delivery location, wherein capturing the second image is performed in response to the delivery location matching the assigned delivery location.

5. The computing device of claim 1 , wherein the first image is associated with location data, and accessing the first image comprises:
determining a current location of the computing device;
determining, based at least in part on the location data, that the current location of the computing device is within a threshold distance of the delivery destination; and
responsive to determining that the current location of the computing device is within the threshold distance of the delivery destination, accessing the first image from remote storage.

6. The computing device of claim 1 , wherein the first image is associated with location data, and the operations further comprise:
determining a current location of the computing device; and
providing, on the display and based at least in part on the location data, guidance instructions indicating a direction from the current location of the computing device to the assigned delivery location.

7. The computing device of claim 1 , wherein determining that the parcel has been placed at the assigned delivery location comprises identifying the parcel using an object recognition model.

8. The computing device of claim 7 , wherein the second image is automatically captured from the real-time image stream based on identifying the parcel is positioned at the assigned delivery location.

9. A method comprising:
receiving an annotation indicating a specific location at an assigned delivery location for delivery of a parcel, the annotation being determined from a first image of the assigned delivery location captured by a first computing device, wherein the first image of the assigned delivery location is annotated at the first computing device;
causing display, at a display device of a second computing device, the annotation indicating the specific location, the annotation being overlaid on a real-time image stream captured by a camera of the second computing device, wherein the annotation indicates the assigned delivery location; and
causing a second image to be captured from the real-time image stream, wherein the second image comprises the parcel positioned at the specific location based on the annotation overlaid within the real-time image stream.

10. The method of claim 9 , further comprising identifying the parcel is positioned at the specific location by identifying the parcel using an object recognition model.

11. The method of claim 9 , further comprising:
identifying a first location of the first computing device determined at a time the first image is captured; and
providing, at the display device of the second computing device, guidance instructions indicating a direction from a second location of the second computing device to the first location of the first computing device.

12. The method of claim 9 , further comprising determining a location of the second computing device while the real-time image stream is being captured, wherein causing capture of the second image from the real-time image stream is based at least in part on the location of the second computing device relative to the assigned delivery location.

13. The method of claim 9 , further comprising:
identifying machine readable indicia affixed to the parcel;
determining, based at least in part on the machine readable indicia, a delivery location for the parcel; and
determining that the delivery location matches the assigned delivery location, wherein causing capture of the second image from the real-time image stream is based at least in part on the delivery location matching the assigned delivery location.

14. The method of claim 9 , wherein the annotation comprises a boundary marker, the boundary marker delineating the specific location at the assigned delivery location, and causing capture of the second image from the real-time image stream is based at least in part on the parcel being positioned within the boundary marker.

15. The method of claim 14 , further comprising detecting the parcel is positioned within the boundary marker using an object recognition model.

16. A system comprising:
a server configured for performing operations comprising:
receiving a first image of a delivery destination captured by a first computing device, wherein the first image comprises an annotation identifying an assigned delivery location at the delivery destination for delivery of a parcel; and
storing the first image in a datastore; and

a second computing device communicatively coupled to the datastore and configured for performing operations comprising:
accessing the first image from the datastore;
initiating a camera to continuously capture image data as a real-time image stream of the delivery destination;
superimposing the annotation over the real-time image stream to overlay the annotation onto the real-time image stream at a position that corresponds to the assigned delivery location;
displaying the real-time image stream with the annotation overlaid onto the real-time image stream; and
capturing, via the camera and from the real-time image stream, a second image of the delivery destination.

17. The system of claim 16 , wherein the second computing device is further configured for performing operations comprising com

Assignees

• United parcel service america inc

Inventors

• Carder David
• Fannon Ryan
• Mccauley William

Classifications

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06T2207/30204

  Marker · CPC title

• G06V20/62

  Text, e.g. of license plates, overlay texts or captions on TV images · CPC title

• G06K7/1443

  locating of the code in an image · CPC title

• G06Q10/0836

  Recipient pick-ups · CPC title