Method of displaying price tag information, apparatus, and shelf system

Patent metadata

Field	Value
Publication number	US-11475800-B2
Application number	US-201916768392-A
Country	US
Kind code	B2
Filing date	Mar 21, 2019
Priority date	Mar 21, 2019
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

Provided is a method of displaying price tag information applied to a price tag generating apparatus in a shelf system which includes a shelf and at least one display screen arranged on the shelf. The method includes: acquiring an image of a commodity placed on the shelf; determining price tag related information based on the image of the commodity, wherein the price tag related information comprises price tag information of the commodity; and sending the price tag related information to a target display screen, which is a display screen for displaying the price tag information in the at least one display screen, and the price tag related information being configured to allow the target display screen to display the price tag information.

First claim

What is claimed is:

1. A method of displaying price tag information, wherein the method is applied to a price tag generating apparatus in a shelf system, the shelf system further comprises a shelf and at least one display screen arranged on the shelf, and the method comprises:
acquiring an image of a commodity placed on the shelf;
determining price tag related information based on the image of the commodity, wherein the price tag related information comprises price tag information of the commodity placed on the shelf; and
sending the price tag related information to a target display screen, wherein the target display screen is a display screen for displaying the price tag information in the at least one display screen, and the price tag related information is configured to allow the target display screen to display the price tag information; wherein
the price tag related information further comprises display position information, and a linear coordinate system is established along a length direction of a placement board where the commodity is placed, the display position information comprises a length of the price tag information in the linear coordinate system, and a starting coordinate for displaying the price tag information in the linear coordinate system; and
determining the price tag related information based on the image of the commodity comprises:
determining the display position information based on a position calculation formula when an overlapping range between an arrangement range of the commodity and an arrangement range of the target display screen is within the arrangement range of the target display screen, wherein the position calculation formula is:
L=Xm +( X−K )/2,

wherein L is the starting coordinate for displaying the price tag information in the linear coordinate system, Xm≤L<Xn, Xm is a starting coordinate of the overlapping range in the linear coordinate system, Xn is an ending coordinate of the overlapping range in the linear coordinate system, K is the length of the price tag information in the linear coordinate system, and X is a length of the overlapping range in the linear coordinate system.

2. The method of claim 1 , wherein the display position information for indicating a display position of the price tag information on the target display screen, the image of the commodity further comprises an image of a shelf where the commodity is placed, and
the determining the price tag related information based on the image of the commodity comprises:
recognizing the image of the commodity to obtain a position of the commodity on the shelf;
determining the target display screen based on the position of the commodity on the shelf and a position of the at least one display screen on the shelf; and
determining the display position information based on the position of the commodity on the shelf and a position of the target display screen on the shelf.

3. The method of claim 2 , wherein the shelf comprises a shelf body and at least one placement board, at least one display screen is arranged at a front end of each placement board, the target display screen and the commodity are arranged on the same placement board, and
the determining the display position information based on the position of the commodity on the shelf and the position of the target display screen on the shelf comprises:
determining the overlapping range between the arrangement range of the commodity and the arrangement range of the target display screen in the length direction of the placement board where the commodity is placed, based on the position of the commodity on the shelf and the position of the target display screen on the shelf; and
determining the display position information, the display position information indicating a position within the overlapping range.

4. The method of claim 2 , wherein the shelf comprises a shelf body and at least one placement board, at least one display screen is arranged at a front end of each placement board; and
the determining the target display screen based on the position of the commodity on the shelf and the position of the at least one display screen on the shelf comprises:
determining display screens located on the same placement board as the commodity based on the position of the commodity on the shelf and the position of the at least one display screen on the shelf; and
determining a display screen, having an intersection with the arrangement range of the commodity in the length direction of the placement board where the commodity is placed, as the target display screen from the display screens located on the same placement board as the commodity.

5. The method of claim 1 , wherein the determining the price tag related information based on the image of the commodity comprises:
recognizing the image of the commodity to obtain an identifier of the commodity placed on the shelf; and
determining the price tag information of the commodity based on the identifier of the commodity.

6. The method of claim 5 , wherein the recognizing the image of the commodity to obtain the identifier of the commodity placed on the shelf comprises:
inputting the image of the commodity to an image recognition model, and obtaining the commodity identifier output from the image recognition model, the image recognition model being configured to recognize the input image to obtain the identifier of the commodity in the image.

7. The method of claim 6 , wherein prior to inputting the image of the commodity to the image recognition model, the method further comprises:
acquiring an initial image recognition model; and
training the initial image recognition model by using images of a plurality of commodities and identifiers of the plurality of commodities as training samples to obtain the image recognition model.

8. The method of claim 7 , wherein the image of the commodity comprises images of the commodity captured at a plurality of directions.

9. The method of claim 6 , wherein the image recognition model is a Region with Convolutional Neural Network feature model or a Single Shot MultiBox Detector model.

10. The method of claim 5 , wherein the determining the price tag information of the commodity based on the identifier of the commodity comprises:
querying a corresponding relationship between identifiers of commodities and information of the commodities based on the identifier of the commodity to obtain commodity information of the commodity; and
generating the price tag information of the commodity based on the commodity information of the commodity.

11. The method of claim 1 , further comprising:
updating the price tag related information when an update condition is met; and
sending the updated price tag related information to the target display screen.

12. The method of claim 11 , wherein the update condition comprises at least one of the followings:
a price tag update instruction for updating the price tag related information is received;
a distance between a position indicated by first display position information and a position indicated by second display position information is greater than a position distance threshold, wherein the first display position information is display position information in price tag related information determined based on a re-acquired image of the commodity, and the second display position information is display position information in historical price tag related information determined at a previous time point closest to a time point of the price tag related information determined based on the re-acquired image of the commodity; or
first price tag information is different from second price tag info

Assignees

• Boe Technology Group Co Ltd
• Beijing Boe Technology Dev Co Ltd

Inventors

• Wang Xiaohong
• Wang Shu
• Li Xin
• Yang Xinxin

Classifications

• G06T7/0008 Primary

  checking presence/absence · CPC title

• G06V10/774

  Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting · CPC title

• G06V20/10 Primary

  Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) · CPC title

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G09F3/208 Primary

  Electronic labels, Labels integrating electronic displays · CPC title