Fixed retail scanner with annotated video and related methods

Patent metadata

Field	Value
Publication number	US-11869319-B2
Application number	US-202117646278-A
Country	US
Kind code	B2
Filing date	Dec 28, 2021
Priority date	Dec 31, 2020
Publication date	Jan 9, 2024
Grant date	Jan 9, 2024

Abstract

A fixed retail scanner and related methods comprises imagers configured to capture image data, and a processor operably coupled to the imagers. The processor configured to provide image data from at least some of the imagers in real-time during a transaction to a decoder within the data reader for decoding an optical code on an object within the image data, generate annotations for the image data based on an analysis of image content of the image data to generate annotated image data, and provide the annotated image data from at least some of the imagers to an external system in real-time during the transaction.

First claim

What is claimed:

1. A fixed retail scanner, comprising:
one or more imagers configured to capture image data; and
a processor operably coupled to one or more of the imagers, the processor configured to:
provide image data from at least some of the imagers in real-time during a transaction to a decoder within the data reader for decoding an optical code on an object within the image data;
detect an event of interest based on an analysis of image content, the event of interest being different than the decoding of the optical code;
generate annotations for the image data based on the analysis of image content of the image data to generate annotated image data, wherein the annotations for the annotated image data includes:
information associated with the object being identified within the image; and
an event label including a description of the detected event of interest; and

provide the annotated image data from at least some of the imagers to an external system in real-time during the transaction.

2. The fixed retail scanner of claim 1 , wherein:
the fixed retail scanner is a bioptic scanner having a horizontal housing and a vertical housing, the one or more imagers include one or more monochrome imagers, color imagers, or any combination thereof disposed within the horizontal housing, the vertical housing, a top down reader, and/or an external peripheral camera operably coupled to the bioptic scanner, and
the processor includes at least one of a system processor, an image processor, an artificial intelligence accelerator, a processor on-board a camera module, or any combination thereof that are configured to generate annotations for creating the annotated image data to be sent to the external system via the fixed retail scanner.

3. The fixed retail scanner of claim 2 , wherein the annotated image data includes concatenated synchronized image data from at least one imager within the horizontal housing and at least one imager within the vertical housing.

4. The fixed retail scanner of claim 1 , wherein the annotations for the annotated image data further include information associated with non-barcode object data identified within the captured image data.

5. The fixed retail scanner of claim 1 , wherein the annotations for the annotated image data further include information about vector movement of an object of interest within successive frames of the image data captured by the one or more imagers.

6. The fixed retail scanner of claim 1 , wherein the annotations for the annotated image data further includes at least one of a distance measurement to a detected object, a size of the detected object of interest, an object weight, or an estimate of an object volume of the object upon which an optical code is located.

7. The fixed retail scanner of claim 1 , wherein the remote system is one of a POS host system, a security system, a system configured to identify exceptions from the annotated image data, or a system configured to perform analytics analysis from the annotated image data.

8. The fixed retail scanner of claim 1 , wherein the one or more imagers includes a full set of imagers having a full set of available views for the fixed retail scanner, and wherein the annotated image data provided to the external system includes combining image data for a subset of views from different imagers of the data reader, the subset of views being selected from the full set of available views from the full set of imagers of the data reader, with the selection of the subset being changeable over time.

9. The fixed retail scanner of claim 8 , wherein selection of the subset of views from the data reader for the combined image data from the different imagers that is included with the annotated image data transmitted to the external system is changeable responsive to a real-time instruction from the external system.

10. The fixed retail scanner of claim 8 , wherein the selection of subset of views from the data reader for the combined image data from the different imagers that is included with the annotated image data transmitted to the external system is changeable responsive to a real-time determination by the processor of the fixed retail scanner of meeting a pre-determined criteria.

11. The fixed retail scanner of claim 1 , wherein the event label is indicative of an exception alert including at least one of a no barcode read exception, a no item in database exception, or mismatch between the barcode data and non-barcode data as the detected event of interest.

12. The fixed retail scanner of claim 1 , wherein the event label is indicative of at least one of:
detecting little or no backward motion relative to an expected flow direction when no barcode was read as the detected event of interest; or
detecting excessive backward motion relative to an expected flow direction after a barcode read as the detected event of interest.

13. The fixed retail scanner of claim 1 , wherein the event label is indicative of a determination that a user's hand is proximate a detected barcode as the detected event of interest.

14. The fixed retail scanner of claim 1 , wherein the annotations for the annotated image data further includes data received from a point-of-sale system operably coupled to the fixed retail scanner.

15. The fixed retail scanner of claim 1 , wherein the annotations for the annotated image data further includes data indicative of at least one of a customer of the transaction, a clerk assisting the transaction, which imager(s) of the one or more imagers was used to capture the image data that is part of the annotated image data, a store identifier, or a location identifier for where the fixed retail scanner is located within a store.

16. The fixed retail scanner of claim 1 , wherein access to the annotated video data is restricted based on a subscription by the external remote system with different types of annotations and/or imager views being included in the annotated image data based on a subscription tier.

17. The fixed retail scanner of claim 1 , wherein the external system includes a point of sale system including an electronic display configured to display the annotated image data thereon to provide real-time feedback to the user during the transaction.

18. A method of generating annotated image data for fixed retail scanner, the method comprising:
capturing image data from a plurality of imagers during a real-time transaction in a retail environment;
communicating at least some of the image data to a decoder within the data reader for decoding an optical code on an object within the image data;
detecting an event of interest based on an analysis of image content, the event of interest being different than the decoding of the optical code;
generating annotations for at least some of the image data based on an analysis of image content of the image data, wherein the annotations for the annotated image data includes:
information associated with the object being identified within the image; and
an event label including a description of the detected event of interest;

creating annotated image data with the annotations and the image data; and
transmitting the annotated image data to a remote system that is external to the fixed retail scanner for additional analysis or manual inspection.

19. The method of claim 18 , wherein generating annotations and creating annotated image data includes deriving annotation data from information obtained from first image data captured by a first camera having a first view that is then provided as

Assignees

• Datalogic Usa Inc

Inventors

• Howard Brett
• Zandhuisen Aric
• Monte Matt

Classifications

• G07G1/0045 Primary

  with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader · CPC title

• G06F40/169

  Annotation, e.g. comment data or footnotes · CPC title

• G06N20/00

  Machine learning · CPC title

• G06Q20/208

  Input by product or record sensing, e.g. weighing or scanner processing · CPC title

• G07G1/0018

  Constructional details, e.g. of drawer, printing means, input means · CPC title