Information processing apparatus, information processing method, system, and storage medium to determine staying time of a person in predetermined region

Patent metadata

Field	Value
Publication number	US-11210528-B2
Application number	US-201916592686-A
Country	US
Kind code	B2
Filing date	Oct 3, 2019
Priority date	Oct 18, 2018
Publication date	Dec 28, 2021
Grant date	Dec 28, 2021

Abstract

An information processing apparatus associates a registration image with first clock time at which a person of the registration image has passed through a gate in a first direction with use of tracking, performs matching, based an image containing a person who is tracked starting with a state of being situated inside a predetermined region and the registration image, to determine whether the person and a person of the registration image are an identical person, determines whether a person who is tracked has passed through the gate in a second direction, associates a person determined as an identical person by matching with second clock time at which the person has passed through the gate in the second direction with use of tracking, and derives a time during which the person has stayed in the predetermined region, based on the first clock time and the second clock time.

First claim

What is claimed is:

1. An information processing apparatus comprising a computer executing instructions that, when executed by the computer, cause the computer to:
detect a person from an image containing a gate through which a person enters or exits a predetermined region;
perform a tracking process for tracking the person;
determine whether a person who has been tracked by the tracking process has passed through the gate in a first direction which is a direction from outside to inside the predetermined region, to obtain a first clock time when the person has passed through the gate in the first direction;
extract, from a plurality of images each containing the person who has been tracked by the tracking process starting with a state of being situated outside the predetermined region, an image satisfying a predetermined condition as a registration image of the person;
store the registration image of the person so as to associate the registration image of the person with the first clock time of the person by use of the tracking process, even if a timing when the registration image of the person was captured is different from the first clock time of the person;
determine whether a given person who has been tracked by the tracking process has passed through the gate in a second direction which is a direction from inside to outside the predetermined region, to obtain a second clock time when the given person has passed through the gate in the second direction;
perform matching process, by using the registration image of the person and at least one image of a plurality of captured images each containing the given person who has been tracked by the tracking process starting with a state of being situated inside the predetermined region, to determine whether the person of the registration image and the given person are identical; and
derive, in a case where the person of the registration image and the given person are determined to be identical, a staying time which is a time during which the person has stayed in the predetermined region,
based on the first clock time and the second clock time.

2. The information processing apparatus according to claim 1 , wherein the image satisfying the predetermined condition is, from among the plurality of images each containing a person who has been tracked by the tracking process, an image whose face likelihood, which is information indicating a degree of image capturing of a face of the person, is greater than or equal to a first threshold value.

3. The information processing apparatus according to claim 1 , wherein the image satisfying the predetermined condition is, from among the plurality of images each containing a person who has been tracked by the tracking process, an image whose face likelihood, which is information indicating a degree of image capturing of a face of the person, is greater than or equal to a first threshold value and is the highest.

4. The information processing apparatus according to claim 1 , wherein the matching process is performed, based on a feature quantity of the given person from at least one image of the plurality of captured images each containing the given person, and a feature quantity of a person corresponding to the registration image, to determine whether the person of the registration image and the given person are identical.

5. The information processing apparatus according to claim 4 , wherein, in a case where an authentication score indicating a degree of coincidence of persons calculated by comparing a feature quantity of the given person from at least one image of the plurality of captured images each containing the given person with a feature quantity of the person corresponding to the registration image is greater than a second threshold value, it is determined that the given person and the person of the registration image are identical.

6. The information processing apparatus according to claim 5 , wherein, in a case where the given person who is tracked by the tracking process starting with a state of being situated inside the predetermined region has passed through a predetermined position, a threshold value used for comparison with the authentication score is changed to a third threshold value smaller than the second threshold value, and, in a case where the authentication score is greater than the third threshold value, it is determined that the given person and the person of the registration image are identical.

7. The information processing apparatus according to claim 4 ,
wherein the instruction further causes the computer to extract an image satisfying a predetermined condition from the plurality of images each containing the given person who has been tracked by the tracking process starting with a state of being situated inside the predetermined region, and
wherein the matching process is performed, based on a feature quantity of the given person from the extracted image and a feature quantity of the person of the registration image, to determine whether the given person and the person of the registration image are identical.

8. An information processing method comprising:
detecting a person from an image containing a gate through which a person enters or exits a predetermined region;
performing a tracking process for tracking the person;
determining whether a person who has been tracked by the tracking process has passed through the gate in a first direction, which is a direction from outside to inside the predetermined region, to obtain a first clock time when the person has passed through the gate in the first direction;
extracting, from a plurality of images each containing the person who has been tracked by the tracking process starting with a state of being situated outside the predetermined region, an image satisfying a predetermined condition as a registration image of the person;
storing the registration image of the person so as to associate the registration image of the person with the first clock time of the person by use of the tracking process, even if a timing when the registration image of the person was captured is different from the first clock time of the person;
determining whether a given person who has been tracked by the tracking process has passed through the gate in a second direction which is a direction from inside to outside the predetermined region, to obtain a second clock time when the given person has passed through the gate in the second direction;
performing matching process, by using the registration image of the person and at least one image of a plurality of captured images each containing the given person who has been tracked by the tracking process starting with a state of being situated inside the predetermined region, to determine whether the person of the registration image and the given person are identical;
and
deriving, in a case where the person of the registration image and the given person are determined to be identical, a staying time which is a time during which the person has stayed in the predetermined region, based on the first clock time and the second clock time.

9. A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by a computer, cause the computer to perform a method, the method comprising:
detecting a person from an image containing a gate through which a person enters or exits a predetermined region;
performing a tracking process for tracking the person who is detected;
determining whether a person who has been tracked by the tracking process has passed through the gate in a first direction, which is a direction from outside to inside the predetermined region, to obtain a first clock time when the person has passed

Assignees

• Canon Kk

Inventors

• Yamashita Yutaka

Classifications

• G07C2011/02

  related to amusement parks · CPC title

• G07C9/00896

  specially adapted for particular uses · CPC title

• G07C9/38

  with central registration · CPC title

• G07C1/12

  wherein the time is indicated in figures · CPC title

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title