Action detection during image tracking
US-10621444-B1 · Apr 14, 2020 · US
US2021241213A1 · US · A1
| Field | Value |
|---|---|
| Publication number | US-2021241213-A1 |
| Application number | US-202017108960-A |
| Country | US |
| Kind code | A1 |
| Filing date | Dec 1, 2020 |
| Priority date | Feb 4, 2020 |
| Publication date | Aug 5, 2021 |
| Grant date | — |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
A registration device includes a shelf including a sensor and on which a commodity is placed, a camera configured to capture an image of a first area and a second area outside the first area, and a processor configured to start tracking of a customer who has entered the second area from outside based on the image captured by the camera, determine whether the commodity is taken from the shelf based on changes in weight measured by the sensor, upon determining that the commodity has been taken, determine whether the tracked customer performs a particular action within the first area, upon determining that the tracked customer has performed the particular action, determine whether the customer has entered the second area, and upon determining that the customer has entered the second area, register the taken commodity as a commodity being purchased by the customer.
Opening claim text (preview).
What is claimed is: 1 . A registration device for registering a commodity to be purchased by a customer, comprising: a shelf on which a commodity can be placed, the shelf including a sensor; a camera configured to capture an image of a first area and a second area outside the first area; and a processor configured to: start tracking of a customer who has entered the second area from outside the first and second areas based on the image captured by the camera, determine whether the commodity is taken from the shelf based on changes in weight measured by the sensor, upon determining that the commodity has been taken, determine whether the tracked customer has performed a particular action within the first area, upon determining that the tracked customer has performed the particular action, determine whether the customer has entered the second area from the first area, and upon determining that the customer has entered the second area from the first area, register the taken commodity as a commodity being purchased by the customer. 2 . The registration device according to claim 1 , wherein the processor is further configured to identify the customer as a registered customer of a store based on the image captured by the camera. 3 . The registration device according to claim 2 , wherein the processor is further configured to perform settlement processing on the taken commodity when the identified customer enters the second area from the first area. 4 . The registration device according to claim 1 , wherein the processor is further configured to, upon determining that a customer who is not being tracked performs the particular action, issue a warning signal. 5 . The registration device according to claim 4 , further comprising: a display configured to display an error screen when the warning signal is issued. 6 . The registration device according to claim 4 , further comprising: a speaker configured to output a sound when the warning signal is issued. 7 . The registration device according to claim 1 , further comprising: one or more wheels attached under the shelf. 8 . The registration device according to claim 1 , further comprising: an input device through which identification information about the customer can be input. 9 . The registration device according to claim 1 , further comprising: a projector configured to project an image on a floor, the image indicating an area including the first and second areas. 10 . The registration device according to claim 1 , further comprising: a handle on each of side surfaces of the shelf. 11 . A method carried out by a registration device for registering a commodity to be purchased by a customer, the method comprising: capturing an image of a first area and a second area outside the first area; starting tracking of a customer who has entered the second area from outside the first and second areas based on the captured image; determining whether a commodity is taken from a shelf based on changes in weight measured by a sensor; upon determining that the commodity has been taken, determining whether the tracked customer has performed a particular action within the first area; upon determining that the tracked customer has performed the particular action, determining whether the customer has entered the second area; and upon determining that the customer has entered the second area from the first area, registering the taken commodity as a commodity being purchased by the customer. 12 . The method according to claim 11 , further comprising: identifying the customer as a registered customer of a store based on the image captured by the camera. 13 . The method according to claim 12 , further comprising: performing settlement processing on the taken commodity when the identified customer enters the second area from the first area. 14 . The method according to claim 11 , further comprising: upon determining that a customer who is not being tracked performs the particular action, issuing a warning signal. 15 . The method according to claim 14 , further comprising: displaying an error screen on a display when the warning signal is issued. 16 . The method according to claim 14 , further comprising: outputting a sound when the warning signal is issued. 17 . The method according to claim 11 , wherein one or more wheels are attached under the shelf. 18 . The method according to claim 11 , further comprising: receiving identification information about the customer via an input device. 19 . The method according to claim 11 , further comprising: projecting an image on a floor, the image indicating an area including the first and second areas. 20 . A non-transitory computer readable medium storing a program causing a computer to execute a method for registering a commodity to be purchased by a customer, the method comprising: capturing an image of a first area and a second area outside the first area; starting tracking of a customer who has entered the second area from outside the first and second areas based on the captured image; determining whether a commodity is taken from a shelf based on changes in weight measured by a sensor; upon determining that the commodity has been taken, determining whether the tracked customer has performed a particular action within the first area; upon determining that the tracked customer has performed the particular action, determining whether the customer has entered the second area from the first area; and upon determining that the customer has entered the second area from the first area, registering the taken commodity as a commodity being purchased by the customer.
Transmitting camera control signals through networks, e.g. control via the Internet · CPC title
Recognition of whole body movements, e.g. for sport training · CPC title
electronically operated · CPC title
Gliders or the like · CPC title
Furniture or installations specially adapted to particular types of service systems, not otherwise provided for (conveyor aspects B65G; building aspects E04H; coin-freed apparatus G07F) · CPC title
Related publications grouped by family.
Answers are generated from the same data shown on this page.