Article recognition apparatus and article recognition method

Patent metadata

Field	Value
Publication number	US-10095939-B2
Application number	US-201715425343-A
Country	US
Kind code	B2
Filing date	Feb 6, 2017
Priority date	Feb 6, 2017
Publication date	Oct 9, 2018
Grant date	Oct 9, 2018

Abstract

According to one embodiment, an article recognition apparatus includes an image interface, a weight interface and a processor. The image interface acquires an image captured by photographing a predetermined place where a plurality of articles are disposed. The processor acquires a first image, acquires a second image after detecting a predetermined event, recognizes an article, based on an image of an article area of an article which is absent in the second image, among article areas extracted from the first image, acquires a registered weight of the recognized article from an article database, and outputs an error if total of the registered weights disagrees with a difference weight between a first weight which a weight scale measures at a time of photographing the first image, and a second weight which the weight scale measures at a time of photographing the second image.

First claim

The invention claimed is:

1. An article recognition apparatus which recognizes an article, comprising:
an image interface configured to acquire an image captured by photographing a predetermined place where a plurality of articles are disposed;
a weight interface configured to acquire a weight of the articles which was measured by a weight scale, the weight scale being configured to measure the weight of the articles disposed at the predetermined place; and
a processor configured to:
acquire a first image through the image interface,
acquire a second image through the image interface after detecting a predetermined event,
recognize one or more articles out of the plurality articles, based on an image of an article area which is absent in the second image, among article areas, each corresponding to one of the articles, extracted from the first image,
acquire a registered weight of the recognized one or more articles from an article database, and
output an error if a total of the registered weights disagrees with a difference between a first weight which the weight scale measures at a time of photographing the first image, and a second weight which the weight scale measures at a time of photographing the second image.

2. The article recognition apparatus of claim 1 , further comprising a display interface configured to communicate with a display,
wherein the processor is configured to display the article areas, which are extracted from the first image, on the display through the display interface.

3. The article recognition apparatus of claim 2 , wherein the processor is configured to display the first image on the display through the display interface, and to display, on the first image, frames indicating the article areas extracted from the first image.

4. The article recognition apparatus of claim 1 , further comprising an operation unit configured to input an operation,
wherein the processor is configured to accept, as the predetermined event, a predetermined operation through the operation unit.

5. The article recognition apparatus of claim 1 , wherein the processor is configured to accept a predetermined gesture as the predetermined event.

6. The article recognition apparatus of claim 1 , wherein the processor is configured to determine, if the total of the registered weights agrees with the difference weight, whether an article is present at the predetermined place at the time of photographing the second image, and
to set the second image as the first image and set the second weight as the first weight if the processor determines that the article is present at the predetermined place at the time of photographing the second image, to acquire a second image through the image interface after detecting a predetermined event, to recognize an article, based on an image of an article area of an article which is absent in the second image, among the article areas extracted from the first image, to acquire a registered weight of the recognized article from the article database, and to output an error if total of the registered weights disagrees with a difference weight between the first weight which the weight scale measures at the time of photographing the first image, and a second weight which the weight scale measures at the time of photographing the second image.

7. The article recognition apparatus of claim 1 , further comprising a memory including the article database.

8. The article recognition apparatus of claim 1 , wherein the article is a commodity, and
the processor is configured to acquire a price corresponding to the recognized article, and
to settle the recognized article, based on the price.

9. The article recognition apparatus of claim 1 , wherein the processor is configured to generate a difference image between the first image and the second image, to generate a mask image based on the difference image, and to generate, based on the mask image, an image of the article area of the article which is absent in the second image, among the article areas extracted from the first image.

10. An article recognition method of recognizing an article, comprising:
acquiring a first image captured by photographing a predetermined place where a plurality of articles are disposed;
acquiring a second image captured by photographing the predetermined place after detecting a predetermined event,
recognizing one or more articles out of the plurality of articles, based on an image of an article area which is absent in the second image, among article areas, each corresponding to one of the articles, extracted from the first image,
acquiring a registered weight of the recognized one or more articles from an article database, and
outputting an error if total of the registered weights disagrees with a difference between a first weight which a weight scale measures at a time of photographing the first image, and a second weight which the weight scale measures at a time of photographing the second image, the weight scale being configured to measure a weight on the predetermined place.

Assignees

• Toshiba Tec Kk

Inventors

• Sawada Takayuki

Classifications

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06V20/60

  Type of objects · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G07G1/0072

  with means for detecting the weight of the article of which the code is read, for the verification of the registration (weighing combined with recording means, e.g. in weighing scale, G01G19/415) · CPC title

• G01G19/417

  with provision for checking computing part of balance · CPC title