Drug inspection device

Patent metadata

Field	Value
Publication number	US-2016005160-A1
Application number	US-201314646879-A
Country	US
Kind code	A1
Filing date	Nov 21, 2013
Priority date	Nov 22, 2012
Publication date	Jan 7, 2016
Grant date	—

Abstract

Embodiments of the present invention provide a high accuracy medicament inspection device and system to inspect medicaments enclosed in a package with a printing area. The medicament inspection device implements a medicament information detection process that includes: a medicament candidate area extraction step extracting a dark colored area in a back side illuminated image as a medicament candidate area A (assumed presence of medicament); a print candidate area extraction step extracting an area containing the print on the package based on a front side illuminated image as a print candidate area B; a print area identification step specifying an area corresponding to the print contained in the print candidate area B based on the brightness distribution of the back side illuminated image as a print area C; and a medicament area identification step identifying a medicament area X by subtracting the print area C from the medicament candidate area A.

First claim

1 - 8 . (canceled)

9 . A medicament inspection device comprising:
an inspection section where a medicament enclosed in a package is placed; an illuminating device for illuminating the package placed in the inspection section; a camera device for taking images of the package placed in the inspection section and illuminated by the illuminating device; and a control device for executing a medicament information detection process to detect a number and/or a type of the medicament enclosed in the package, as medicament information, by performing an image matching process using the images taken by the camera device; wherein the illuminating device comprises:
a front side illuminating device for illuminating the package from a side where the camera device is located, and
a back side illuminating device for illuminating the package from a side opposite to the camera device;
wherein the images taken by the camera device include:
a front side illuminated image, which is an image of the package taken by the camera device with the front side illuminating device being ON, and
a back side illuminated image, which is an image of the package taken by the camera device with the back side illuminating device being ON; and
wherein the control device executes the medicament information detection process by performing the following steps:
a medicament candidate area extraction step comprising extracting a dark colored area in the back side illuminated image as a medicament candidate area A where the medicament is assumed to be present,
a print candidate area extraction step comprising extracting an area containing a print on the package based on the front side illuminated image as a print candidate area B,
a print area identification step comprising identifying an area corresponding to the print contained in the print candidate area B as a print area C based on a brightness distribution of the back side illuminated image, and
a medicament area identification step comprising identifying a medicament area X by subtracting the print area C from the medicament candidate area A.

10 . The medicament inspection device of claim 9 , wherein in the medicament candidate area extraction step, the control device performs the steps of:
obtaining a grey back side illuminated image by converting the back side illuminated image into a grey scale image, specifying an assumed print and medicament area where the print and the medicament are assumed to be present by binarizing the grey back side illuminated image, calculating a sum region of a top hat region obtained by top-hat processing the grey back side illuminated image and a bottom hat region obtained by bottom-hat processing the grey back side illuminated image, as an assumed print area where the print is assumed to be present, and obtaining the medicament candidate area A from a difference between the assumed print and medicament area and the assumed print area.

11 . The medicament inspection device of claim 9 , wherein in the print candidate area extraction step, the control device performs the steps of:
bottom-hat processing all the images of an R-channel image, a G-channel image, and a B-channel image that are obtained by an RGB decomposition of the front side illuminated image, and extracting an area that is assumed to be black in all the images of the R-channel image, the G-channel image, and the B-channel image as the print candidate area B.

12 . The medicament inspection device of claim 9 , wherein in the print area identification step, the control device performs the steps of:
obtaining a brightness distribution in an assumed print area, where the print is assumed to be present, in the front side illuminated image, defining a brightness threshold for distinguishing an area corresponding to the print and other area, and narrowing down the print candidate area B in the front side illuminated image to the print area C based on the brightness threshold defined.

13 . The medicament inspection device of claim 9 , wherein the control device further performs an inspection area defining step comprising defining a medicament inspection area Z, which is an area to be inspected, based on the medicament area X, and wherein in the inspection area defining step, the control device performs the steps of:
obtaining a reduced medicament candidate area A 2 , which is a reduced area of the medicament candidate area A, and calculating a sum region of the medicament area X and the reduced medicament candidate area A 2 as the medicament inspection area Z.

14 . The medicament inspection device of claim 9 , wherein the control device performs an image matching using an image database, in which master images of medicaments are stored, for detecting the medicament information,
wherein the control device further performs a master image creation process for creating a master image of a divided medicament from a master image including an entire shape of the medicament and storing the master image of the divided medicament in the image database, and wherein in the master image creation process, the control device performs the steps of:
a contour acquisition step of acquiring a contour of the entire shape of the medicament based on the back side illuminated image of the medicament,
an entire image acquisition step of acquiring an image in an area inside the contour in the front side illuminated image as an image of the entire shape of the medicament,
a background brightness derivation step of recognizing an image in an area outside the contour in the front side illuminated image as a background image, and calculating an average brightness of the background image, and
an overlay step of creating a masking image having a brightness corresponding to the average brightness of the background image, and overlaying the masking image on a portion of the image of the entire shape of the medicament to obtain the master image of the divided medicament.

15 . The medicament inspection device of claim 9 , wherein the control device performs a comparison process using an image database, in which a master image of the medicament is stored, and
wherein in the comparison process, the control device performs the steps of:
comparing an image of a medicament placed in the inspection section and taken by the camera device with the master image of this medicament stored in the image database;
determining if the medicament in the master image and the medicament in the image taken by the camera device are different from each other,
creating a new master image of the medicament from the image taken by the camera device when the control device determines that both the medicaments are different from each other, and
replacing the master image of the medicament stored in the image database with the master image of this medicament newly created.

16 . A medicament packing system, comprising:
a medicament packing device for packing medicaments in a package in accordance with a prescription; and the medicament inspection device of claim 9 , wherein the medicament inspection device counts a number of the medicaments packed in the package by the medicament packing device.

17 . A device for updating a master image of a medicament stored in a database; comprising:
a camera device for taking an image of a medicament; and a control device capable of accessing the database, wherein the control device performs the steps of: comparing the image of the medicament taken by the camera device with the master image of this medicament stored in the database, determining if the medicament in the master image and the medicament in the image taken by the camera device are different from each other, creat

Assignees

• Yuyama Mfg Co Ltd

Inventors

• Ito Koji
• Tsuda Hiromichi
• Amano Hirokazu
• Yoshikawa Yasuyuki
• Zhang Mei

Classifications

• G06V20/66

  Trinkets, e.g. shirt buttons or jewellery items (recognising microscopic objects G06V20/69) · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• G06V10/56

  relating to colour · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title