Computer implemented system and method for recognizing and counting products within images
US-2016371634-A1 · Dec 22, 2016 · US
US10417696B2 · US · B2
| Field | Value |
|---|---|
| Publication number | US-10417696-B2 |
| Application number | US-201615164829-A |
| Country | US |
| Kind code | B2 |
| Filing date | May 25, 2016 |
| Priority date | Dec 18, 2015 |
| Publication date | Sep 17, 2019 |
| Grant date | Sep 17, 2019 |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
The disclosure includes a system and method for comparing a realogram and a planogram to determine differences and generate suggestions, for example, a corrective action, and present the corrective action to a user. An application receives a realogram, the realogram including information about product recognitions, and a planogram corresponding to the realogram. The application aligns the realogram with the planogram using the information about product recognitions. The application retrieves a rule, detects an issue in the realogram based on applying the rule to the realogram aligned with the planogram, generates a corrective action corresponding to the issue in the realogram, and provides the corrective action for display as an overlay on the realogram.
Opening claim text (preview).
What is claimed is: 1. A method comprising: receiving, by a recognition server, data representing a current state of a realogram from a client device, the data including information about product recognitions in the realogram; receiving, by the recognition server, a planogram corresponding to the realogram; identifying, by the recognition server, a planogram product facing in the planogram and a realogram product facing in the realogram; comparing, by the recognition server, one or more of an index position, an aspect ratio, an identifier, and a neighboring product facing of the planogram product facing and the realogram product facing; aligning, by the recognition server, the realogram with the planogram based on comparing one or more of the index position, the aspect ratio, the identifier, and the neighboring product facing of the planogram product facing and the realogram product facing; retrieving, by the recognition server, a rule; detecting, by the recognition server, an issue in the realogram based on applying the rule to the realogram aligned with the planogram; generating, by the recognition server, a corrective action including a suggestion for correcting the issue in the realogram; and transmitting, by the recognition server, for displaying on the client device, the corrective action as an overlay at a location of the issue in the realogram. 2. The method of claim 1 , wherein aligning the realogram with the planogram comprises: identifying a planogram brand chunk in the planogram, wherein the planogram brand chunk is a grouping of planogram product facings that belong to a same brand; identifying a realogram brand chunk in the realogram, wherein the realogram brand chunk is a grouping of realogram product facings that belong to the same brand; aligning the realogram brand chunk with the planogram brand chunk; identifying the planogram product facing in the planogram brand chunk; identifying the realogram product facing in the realogram brand chunk; and aligning the realogram product facing with the planogram product facing. 3. The method of claim 1 , wherein detecting the issue in the realogram comprises: identifying a first planogram product facing in the planogram; determining whether the first planogram product facing is aligned with a first realogram product facing in the realogram, wherein the first realogram product facing is a hole; and responsive to determining that the first planogram product facing is aligned with the first realogram product facing, identifying the issue as an out of stock issue that is visible in the realogram. 4. The method of claim 1 , wherein detecting the issue in the realogram comprises: identifying a first planogram product facing in the planogram; determining that the first planogram product facing is unaligned with any realogram product facing in the realogram; and responsive to determining that the first planogram product is unaligned with any realogram product facing, identifying the issue as an out of stock issue that is hidden in the realogram. 5. The method of claim 1 , wherein detecting the issue in the realogram comprises: identifying a first planogram product facing in the planogram; identifying a second planogram product facing similar to the first planogram product facing; determining whether the first planogram product facing is aligned with a first realogram product facing in the realogram, wherein the first realogram product facing is a hole; determining whether the second planogram product facing is aligned with a second realogram product facing in the realogram; and responsive to determining that the first planogram product facing is aligned with the first realogram product facing and the second planogram product facing is aligned with the second realogram product facing, identifying the issue as a missing facing issue that is visible in the realogram. 6. The method of claim 1 , wherein detecting the issue in the realogram comprises: identifying a first planogram product facing in the planogram; identifying a second planogram product facing similar to the first planogram product facing; determining whether the first planogram product facing is unaligned with any realogram product facing in the realogram; determining whether the second planogram product facing is aligned with a second realogram product facing in the realogram; and responsive to determining that the first planogram product facing is unaligned with any realogram product facing and the second planogram product facing is aligned with the second realogram product facing, identifying the issue as a missing facing issue that is hidden in the realogram. 7. The method of claim 1 , wherein detecting the issue in the realogram comprises: identifying a first realogram product facing in the realogram; determining whether the first realogram product facing is unaligned with any planogram product facing in the planogram; determining whether the first realogram product facing is a hole; and responsive to determining that the first realogram product facing is unaligned with any planogram product facing and the first realogram product facing is not a hole, identifying the issue as an extra facing issue that is visible in the realogram. 8. The method of claim 2 , further comprising: generating a first share of shelf report for the planogram based on the planogram brand chunk; generating a second share of shelf report for the realogram based on the realogram brand chunk; comparing the first share of shelf report with the second share of shelf report; and providing the compared share of shelf report for display. 9. A system comprising: one or more processors; and a memory, the memory storing instructions, which when executed cause the one or more processors to: receive data representing a current state of a realogram from a client device, the data including information about product recognitions in the realogram; receive a planogram corresponding to the realogram; identify a planogram product facing in the planogram and a realogram product facing in the realogram; compare one or more of an index position, an aspect ratio, an identifier, and a neighboring product facing of the planogram product facing and the realogram product facing; align the realogram with the planogram based on comparing one or more of the index position, the aspect ratio, the identifier, and the neighboring product facing of the planogram product facing and the realogram product facing; retrieve a rule; detect an issue in the realogram based on applying the rule to the realogram aligned with the planogram; generate a corrective action including a suggestion for correcting the issue in the realogram; and transmit for displaying on the client device the corrective action as an overlay at a location of the issue in the realogram. 10. The system of claim 9 , wherein to align the realogram with the planogram, the instructions further cause the one or more processors to: identify a planogram brand chunk in the planogram, wherein the planogram brand chunk is a grouping of planogram product facings that belong to a same brand; identify a realogram brand chunk in the realogram, wherein the realogram brand chunk is a grouping of realogram product facings that belong to the same brand; align the realogram brand chunk with the planogram brand chunk; identify the planogram product facing in the planogram brand chunk; identify the realogram product facing in the realogram brand chunk; and align the realogram product facing with the planogram product facing. 11. The system of claim 9 , wherein to detect the issue in the realogram, the instructions
graphically representing goods, e.g. 3D product representation · CPC title
Inventory or stock management, e.g. order filling, procurement or balancing against orders · CPC title
by shelf level inventory management, e.g. planograms · CPC title
Related publications grouped by family.
Answers are generated from the same data shown on this page.