Collation device, non-transitory computer readable medium storing program, and collation method

Patent metadata

Field	Value
Publication number	US-12424003-B2
Application number	US-202217586787-A
Country	US
Kind code	B2
Filing date	Jan 28, 2022
Priority date	Sep 24, 2021
Publication date	Sep 23, 2025
Grant date	Sep 23, 2025

Abstract

A collation device includes a processor configured to, by executing a program: (a) acquire a photographed image including a collation area provided on an object and a reference position area that serves as a reference for a position of the collation area; (b) detect the reference position area from the photographed image; (c) set a peripheral image area in the photographed image based on the reference position area and predetermined relative coordinates; and (d) detect the collation area in the peripheral image area.

First claim

What is claimed is:

1. A collation device comprising:
a processor, storing a registered image in association with an identity of a registered object, the registered image acquired by irradiating the registered object with a light source at a predetermined irradiation angle, and configured to, by executing a program:
(a) receive a photographed image including a collation area provided on an object and a reference position area that serves as a reference for a position of the collation area, wherein the photographed image is acquired by photographing the object to be collated by using a mobile terminal as the collation image photographing machine, and at an elevation angle that is formed by a light source, the object, and a camera of the collation image photographing machine used to capture the object;
(b) detect the reference position area from the photographed image;
(c) acquire a peripheral image area from the photographed image based on the reference position area and predetermined relative coordinates; and
determine a color of a background area of the peripheral image area in the photographed image, wherein the color changes depending on the elevation angle, and determine whether the color is appropriate or not by comparing the color with a desired color stored in a memory, wherein the desired color is a color of a background area of the registered object, at an angle at which the registered image was acquired,
repeat processing of the (a) to (c) in a case where the color does not match the desired color using a new photographed image, which is obtained by adjusting the elevation angle, until the color matches the desired color;
(d) detect the collation area in the peripheral image area, wherein the processor is further configured to:

determine an image quality of a random pattern image of the detected collation area is good or not by evaluating a plurality of index values related to the random pattern image and determine whether or not the index values exceed a predetermined threshold,
in a case where the evaluation value of the random pattern image of the detected collation area is equal to or less than the threshold, calculate an evaluation value of an image of the detected collation area, and repeat processing of the (a) to (d) using the new photographed image, and after adjusting an elevation angle to a desired angle in a case where the evaluation value is equal to or less than a threshold, collate the random pattern image with the registered image, and return the collation result to the collation image photographing machine.

2. The collation device according to claim 1 , further comprising:
a display unit,
wherein the processor is configured to:
display a guide indicating the peripheral image area on the display unit.

3. The collation device according to claim 2 , wherein the processor is configured to:
display a guide indicating the collation area on the display unit.

4. The collation device according to claim 3 , wherein the processor is configured to:
after setting the peripheral image area, determine a color or pattern of a background area of the peripheral image area in the photographed image, and repeat processing of the (a) to (c) using the new photographed image after adjusting the elevation angle to the desired angle in a case where the pattern does not match a predetermined condition.

5. The collation device according to claim 2 , wherein the processor is configured to:
after setting the peripheral image area, determine a color or pattern of a background area of the peripheral image area in the photographed image, and repeat processing of the (a) to (c) using the new photographed image after adjusting the elevation angle to the desired angle in a case where the pattern does not match a predetermined condition.

6. The collation device according to claim 2 , wherein the processor is further configured to:
acquire data of the relative coordinates from an external server.

7. The collation device according to claim 1 , wherein the processor is configured to:
after setting the peripheral image area, determine a color or pattern of a background area of the peripheral image area in the photographed image, and repeat processing of the (a) to (c) using the new photographed image after adjusting the elevation angle to the desired angle in a case where the pattern does not match a predetermined condition.

8. The collation device according to claim 7 , wherein the processor is further configured to:
notify a user in a case where the color or pattern matches the predetermined condition.

9. The collation device according to claim 1 , wherein the processor is further configured to:
acquire data of the relative coordinates from an external server.

10. The collation device according to claim 1 , wherein the processor is further configured to:
notify a user in a case where the reference position area is detected.

11. The collation device according to claim 1 ,
wherein the collation area has a specific shape of an ellipse including a circle or a polygon, and
the processor is configured to:
detect the collation area by extracting the specific shape from the peripheral image area.

12. The collation device according to claim 1 ,
wherein the reference position area includes a QR code.

13. A non-transitory computer readable medium storing a program causing a computer processor to execute a process, wherein a registered image in association with an identity of a registered object is stored, and the registered image is acquired by irradiating the registered object with a light source at a predetermined irradiation angle, comprising:
(a) acquiring a photographed image including a collation area provided on an object and a reference position area that serves as a reference for a position of the collation area;
(b) detecting the reference position area from the photographed image;
(c) setting a peripheral image area in the photographed image based on the reference position area and predetermined relative coordinates;

repeating processing of the (a) to (c) in a case where the color does not match the desired color using a new photographed image, which is obtained by adjusting the elevation angle, until the color matches the desired color;
(d) detecting the collation area in the peripheral image area;

determining an image quality of a random pattern image of the detected collation area is good or not by evaluating a plurality of index values related to the random pattern image and determine whether or not the index values exceed a predetermined threshold, and
calculating an evaluation value of an image of the detected collation area, and
repeating processing of the (a) to (d) using a new photographed image after adjusting an elevation angle to a desired angle in a case where the evaluation value is equal to or less than the threshold and acquire a collation image of the new photographed image in which the evaluation value exceeds the threshold, wherein the elevation angle is formed by a light source, the object, and a camera used to capture the object, wherein the photographed image and the new photographed image are captured by the camera, collating the random pattern image with the registered image, and returning the collation result to the collation image photographing machine.

14. The non-transitory computer readable medium according to claim 13 , wherein the program causing the computer processor to execute the process further comprising after setting the peripheral image area, determining a color or pattern of a background area of the peripheral image area in

Assignees

• Fujifilm Business Innovation Corp

Inventors

• Motosugi Yukari
• Sato Ken
• Oshima Minoru

Classifications

• G06V10/255

  Detecting or recognising potential candidate objects based on visual cues, e.g. shapes · CPC title

• G06V20/95

  Pattern authentication; Markers therefor; Forgery detection · CPC title

• G06V10/56

  relating to colour · CPC title

• G06V10/993

  Evaluation of the quality of the acquired pattern · CPC title

• G06V10/235

  based on user input or interaction · CPC title