Judgement method, judgement device, and judgement program

Patent metadata

Field	Value
Publication number	US-12223774-B2
Application number	US-202217828482-A
Country	US
Kind code	B2
Filing date	May 31, 2022
Priority date	Dec 22, 2020
Publication date	Feb 11, 2025
Grant date	Feb 11, 2025

Abstract

A judgement method includes: selecting two or more living body judgement processes among a plurality of living body judgement processes; determining an order of executing the two or more selected living body judgement processes; executing the two or more selected living body judgement processes in the determined order; executing, in each of the two or more selected living body judgement processes: a processing of showing a subject an action required; a processing of acquiring a facial image containing a face of the subject when acting in accordance with the shown action; and a processing of judging whether the subject is of living body based on a feature of a section of the face contained in the facial image; and judging that the subject is of living body when judgement results obtained from the two or more selected living body judgement processes satisfy a predetermined condition.

First claim

The invention claimed is:

1. A judgement method for a judgement device, comprising:
by a computer of the judgement device,
selecting two or more living body judgement processes among a plurality of living body judgement processes for judging whether a subject contained in an image is of living body;
determining an order of executing the two or more selected living body judgement processes;
executing the two or more selected living body judgement processes in the determined order;
executing, in each of the two or more selected living body judgement processes: (1) a processing of showing a subject an action required for the living body judgement process; (2) a processing of acquiring a facial image containing a face of the subject when acting in accordance with the shown action; and (3) a processing of judging whether the subject is of living body based on a feature of a section of the face contained in the facial image;
determining whether judgement results obtained from the two or more selected living body judgement processes satisfy a predetermined condition; and
judging that the subject is of living body when the judgement results satisfy the predetermined condition, and judging that the subject is not of living body when the judgement results fail to satisfy the predetermined condition,
wherein, prior to the selection of two or more living body judgment processes from among the plurality of living body judgement processes, a state of the subject is detected, and
the selection of two or more living body judgment processes includes eliminating any living body judgement process that includes an action unsuitable for judging whether the subject contained in the image is of living body based on the detected state of the subject.

2. The judgement method according to claim 1 , wherein
in the selection of two or more living body judgement processes,
two or more living body judgement processes are randomly selected among the plurality of living body judgement processes.

3. The judgement method according to claim 1 , wherein
in the determination of the order of executing the two or more selected living body judgement processes,
the order of executing the two or more selected living body judgement processes is randomly determined.

4. The judgement method according to claim 1 , wherein
the plurality of living body judgement processes includes:
a living body judgement process having an orientation of the face as the feature of the section of the face;
a living body judgement process having an orientation of an eye as the feature of the section of the face;
a living body judgement process having an opening state of an eye as the feature of the section of the face;
a living body judgement process having an opening state of a mouth as the feature of the section of the face; and
a living body judgement process having a wearing state of glasses as the feature of the section of the face.

5. The judgement method according to claim 1 , wherein
in each of the two or more selected living body judgement processes:
the processings (1) through (3) are executed a plurality of times; and
an action to be shown to the subject in the processing (1) is randomly determined.

6. The judgement method according to claim 1 , wherein
in the determination as to whether the judgement results satisfy the predetermined condition,
the judgement result is converted into a numerical value, the converted results are each weighted with a coefficient specified for each living body judgement process, and when a sum of the weighted results meets a predetermined numerical criterion, the judgement results are determined to satisfy the predetermined condition.

7. The judgement method according to claim 1 , further comprising:
by the computer,
acquiring a subject image containing the face of the subject; and
determining whether the subject image includes an outer frame surrounding the face of the subject, judging that the subject is not of living body when the subject image is determined to include the outer frame, and executing the processings starting from the selection of two or more living body judgement processes when the subject image is determined to include no outer frame.

8. The judgement method according to claim 7 , wherein
in the determination as to whether the subject image includes the outer frame:
a face region including the face of the subject is detected from the subject image;
a vertical edge line detection processing is executed which detects, among vertically extending edge lines contained in the subject image, a first edge line closest to a left end of the face region and having a first predetermined length or greater, and a second edge line closest to a right end of the face region and having the first predetermined length or greater;
a horizontal edge line detection processing is executed which detects, among horizontally extending edge lines contained in the subject image, a third edge line closest to an upper end of the face region, having both end points closer to the face region than the first edge line and the second edge line, and having a second predetermined length or greater, and a fourth edge line closest to a lower end of the face region, having both end points closer to the face region than the first edge line and the second edge line, and having the second predetermined length or greater; and
the subject image is determined to include the outer frame when a total number of edge lines detected in the vertical edge line detection processing and the horizontal edge line detection processing is three or more.

9. The judgement method according to claim 7 , wherein
in the determination as to whether the subject image includes the outer frame:
a face region including the face of the subject is detected from the subject image; and
the subject image is determined to include the outer frame when the face region has a width greater than a predetermined upper limit, or a length greater than a predetermined upper limit.

10. The judgement method according to claim 8 , wherein
in the determination as to whether the subject image includes the outer frame:
a face region including the face of the subject is detected from the subject image; and
the subject image is determined to include the outer frame when the first edge line and the second edge line are detected in the vertical edge line detection processing while the upper end of the face region falls within a predetermined first margin from an upper end of the subject image, or the lower end of the face region falls within a predetermined second margin from a lower end of the subject image.

11. The judgement method according to claim 8 , wherein
in the determination as to whether the subject image includes the outer frame,
the subject image is determined to include the outer frame when the first edge line or the second edge line detected in the vertical edge line detection processing intersects the third edge line or the fourth edge line detected in the horizontal edge line detection processing while the left end of the face region falls within a predetermined third margin from a left end of the subject image, or the right end of the face region falls within a predetermined fourth margin from a right end of the subject image.

12. A judgement device, comprising:
a judgement way determination section for selecting two or more living body judgement processes among a plurality of living body judgement processes for judging whether a subject contained in an image is of living body, and determining an order of executing the two or more selected living body judgement processes;
an execution section f

Assignees

• Swallow Incubate Co Ltd
• Panasonic Holdings Corp

Inventors

• Ohno Toshikazu

Classifications

• G06T2207/30201

  Face · CPC title

• G06F21/32 Primary

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G06V40/171

  Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships · CPC title

• G06V40/45 Primary

  Detection of the body part being alive · CPC title