Displaying items of interest in an augmented reality environment

Patent metadata

Field	Value
Publication number	US-11580684-B2
Application number	US-202117497048-A
Country	US
Kind code	B2
Filing date	Oct 8, 2021
Priority date	Nov 2, 2016
Publication date	Feb 14, 2023
Grant date	Feb 14, 2023

Abstract

Computer program products, methods, systems, apparatus, and computing entities are provided for an augmented reality display using an actual image of the item. Additionally, the present disclosure provides for a proportionally dimensioned representation of the item in the augmented reality display. In some aspects, a beacon/tag/sensor-based approach may be used. In some aspects, a marker-based approach may be used.

First claim

The invention claimed is:

1. A method for providing an image of an item, the method comprising:
receiving a signal from a tag;
generating a request for the image of the item based at least in part on the signal;
receiving the image of the item, the image of the item being previously captured at a point associated with transportation of the item; and
proportionally sizing the image of the item over a real world background based on a size and a location of the tag at the point associated with transportation of the item.

2. The method of claim 1 , wherein the tag comprises a Bluetooth low energy (BLE) tag, a radio frequency identification (RFID) tag, a near field communication (NFC) device, or a Wi-Fi device, and wherein the signal from the tag comprises a tracking identifier, and wherein the tag is affixed to the item.

3. The method of claim 2 , further comprising transmitting a trigger to the tag and receiving the signal in response to the trigger.

4. The method of claim 1 , wherein the method further comprises:
processing the signal to obtain a tracking identifier associated with the item; and
identifying item information of the item based on the tracking identifier obtained for receiving the image of the item previously captured at the point associated with transportation.

5. The method of claim 4 , further comprising:
determining an electronic storage location of a particular image for receiving the image of the item; and
using an API request to receive the image of the item from the electronic storage location that was determined.

6. The method of claim 1 , wherein the image of the item is received based on using a uniform resource identifier and a uniform resource locator.

7. An apparatus comprising:
a display;
at least one processor; and
at least one memory including program code, wherein the at least one memory is configured to, with the at least one processor, cause the apparatus to at least:
receive at least one signal from a tag;
receive an image of an item associated with a powered asset, the image of the item being previously captured at a point associated with transportation of the item via the powered asset; and
generating an augmented reality display layer for display via the display over a real world environment, wherein the generating comprises orienting the image of the item within the augmented reality display layer based on a size of the item and a location of the item at the point associated with transportation of the item, the size and the location determined from the at least one signal.

8. The apparatus of claim 7 , wherein the powered asset is associated with a dispatch plan, and wherein the dispatch plan is navigable to from the augmented reality display layer.

9. The apparatus of claim 8 , wherein the apparatus further comprises a head-mounted display having a see-through lens, wherein the image of the item is superimposed on the see-through lens.

10. The apparatus of claim 7 , wherein the tag is associated with the item associated with transportation of the item via the powered asset.

11. The apparatus of claim 10 , wherein the at least one signal comprises location information associated with the item, wherein the location of the item at the point associated with transportation of the item is determined based on received RSSI signals from the tag during a time in which the tag was affixed to the item.

12. The apparatus of claim 10 , wherein the location of the item is determined based on one or more communications between the tag and a second tag affixed to the powered asset.

13. One or more computer-readable media having stored thereon instructions that when executed by a processor, cause the processor to perform a method for providing an image of an item on a display, the method comprising:
identifying, via a computing entity, a tag associated with the item;
receiving, via the computing entity, the image of the item while the item is located on a powered asset for transportation of the item;
receiving, via the computing entity, location information of the item from the tag;
based on the location information, determining, via the computing entity, a location of the item while the item is located on the powered asset; and
orienting, via the computing entity, the image of the item on an augmented reality environment layer for display over a real world environment, the orienting based on the location of the item determined.

14. The media of claim 13 , the method further comprising:
determining a distance between the computing entity and the tag using an RSSI signal received from the tag; and
using the distance to determine the location of the item.

15. The media of claim 13 , wherein the location of the item is determined based on additional location information based on one or more communications between the tag and a second tag associated with the powered asset.

16. The media of claim 15 , wherein the one or more communications between the tag and the second tag include the second tag providing GPS coordinates to the tag.

17. The media of claim 13 , wherein the method further comprises:
overlaying the augmented reality environment layer over at the least a portion of the real world environment; and
causing for displaying, via a display of the computing entity, the overlaying of the augmented reality environment layer over at the least the portion of the real world environment.

18. The media of claim 17 , wherein the powered asset is associated with a dispatch plan, and wherein the dispatch plan is navigable to from the augmented reality environment layer.

19. The media of claim 18 , wherein the computing entity is a wearable device and the display is a head-mounted display.

20. The media of claim 13 , wherein the computing entity comprises an accelerometer circuitry for detecting pitch, bearing, and orientation, and wherein the method further comprises:
determining an area of the augmented reality environment layer corresponding to an orientation of the computing entity using the accelerometer circuitry; and
overlaying the area of the augmented reality environment layer over at the least a portion of the real world environment.

Assignees

• United parcel service america inc

Inventors

• Dotterweich Andrew
• Schenken Christopher T
• Cooper Jeffrey

Classifications

• G06K7/1413

  1D bar codes · CPC title

• G06Q10/0838

  Historical data · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G09G2340/12

  Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels · CPC title

• G06K7/1417

  2D bar codes · CPC title