Information processing system, method and computer readable medium for determining whether moving bodies appearing in first and second videos are the same or not

Patent metadata

Field	Value
Publication number	US-10854057-B2
Application number	US-201916274948-A
Country	US
Kind code	B2
Filing date	Feb 13, 2019
Priority date	Apr 26, 2013
Publication date	Dec 1, 2020
Grant date	Dec 1, 2020

Abstract

A similarity computation unit (130) derives a first probability P indicating that a first moving body appearing in the first video is the same as a second moving body appearing in the second video on the basis of similarity of feature value of the moving bodies. A non-appearance probability computation unit (140) derives a second probability Q indicating that the first moving body is not the same as the second moving body on the basis of an elapsed time after the first moving body exits from the first video. A person determination unit (150) determines whether the first moving body is the same as the second moving body by comparing the probability P and Q.

First claim

The invention claimed is:

1. An information processing system comprising:
at least one memory storing instructions; and
at least one processor configured to execute the instructions to:
receive inputs of videos captured by a plurality of imaging apparatuses; and
determine whether a first moving body appearing in a first video captured by a first imaging apparatus among the plurality of imaging apparatuses and a second moving body appearing in a second video captured by a second imaging apparatus among the plurality of imaging apparatuses are the same based on a similarity between the first moving body appearing in the first video and the second moving body appearing in the second video and an elapsed time from a first time point when the first moving body disappears from the first video;

wherein in determining whether the first moving body and the second moving body are the same, the at least one processor is further configured to execute the instructions to:
when it is determined that the first moving body can reach, within the elapsed time, an imaging range of a third imaging apparatus from an imaging range of the first imaging apparatus, but does not appear, even after the elapsed time from the first time point, in a third video captured by the third imaging apparatus, decrease a second index value.

2. The information processing system according to claim 1 , wherein the at least one processor is further configured to execute the instructions to determine that the first moving body and the second moving body are the same when a first index value indicating the similarity is larger than the second index value indicating that the first moving body does not appear in the second video at a second time point when the second moving body appears in the second video.

3. The information processing system according to claim 2 , wherein the first index value is a first probability indicating that both moving bodies are the same and the second index value is a second probability indicating that the first moving body does not appear in the second video at the second time point when the second moving body appears in the second video.

4. The information processing system according to claim 1 , wherein the processor is further configured to:
display the second video on a display device.

5. The information processing system according to claim 4 , wherein the processor is further configured to:
display, on the display device, a screen for presenting a result of the determination indicating whether or not the first moving body and the second moving body are the same.

6. The information processing system according to claim 5 , wherein the processor is further configured to:
change a display method, when the second moving body appearing in the second video is determined the same as the first moving body appearing in the first video, into a different display method from a display method used before the moving bodies are determined to be the same moving body.

7. An information processing method performed by at least one computer, the method comprising:
receiving inputs of videos captured by a plurality of imaging apparatuses; and
determining whether a first moving body appearing in a first video captured by a first imaging apparatus among the plurality of imaging apparatuses and a second moving body appearing in a second video captured by a second imaging apparatus among the plurality of imaging apparatuses are the same based on a similarity between the first moving body appearing in the first video and the second moving body appearing in the second video and an elapsed time from a first time point when the first moving body disappears from the first video;
wherein determining whether the first moving body and the second moving body are the same comprises:
when it is determined that the first moving body can reach, within the elapsed time, an imaging range of a third imaging apparatus from an imaging range of the first imaging apparatus, but does not appear, even after the elapsed time from the first time point, in a third video captured by the third imaging apparatus, decreasing a second index value.

8. The image processing method according to claim 7 , further comprising:
determining that the first moving body and the second moving body are the same when a first index value indicating the similarity is larger than the second index value indicating that the first moving body does not appear in the second video at a second time point when the second moving body appears in the second video.

9. The image processing method according to claim 8 , wherein the first index value is a first probability indicating that both moving bodies are the same and the second index value is a second probability indicating that the first moving body does not appear in the second video at the second time point when the second moving body appears in the second video.

10. The image processing method according to claim 7 , further comprising:
displaying the second video on a display device.

11. The image processing method according to claim 10 , wherein:
displaying, on the display device, a screen for presenting a result of the determination indicating whether or not the first moving body and the second moving body are the same.

12. The image processing method according to claim 11 , wherein:
changing a display method, when the second moving body appearing in the second video is determined the same as the first moving body appearing in the first video, into a different display method from a display method used before the moving bodies are determined to be the same moving body.

13. A non-transitory computer readable recording medium storing programs, the programs causing at least one computer to perform:
receiving inputs of videos captured by a plurality of imaging apparatuses; and
determining that a first moving body appearing in a first video captured by a first imaging apparatus among the plurality of imaging apparatuses and a second moving body appearing in a second video captured by a second imaging apparatus among the plurality of imaging apparatuses are the same based on a similarity between the first moving body appearing in the first video and the second moving body appearing in the second video and an elapsed time from a first time point when the first moving body disappears from the first video;
wherein determining whether the first moving body and the second moving body are the same comprises:
when it is determined that the first moving body can reach, within the elapsed time, an imaging range of a third imaging apparatus from an imaging range of the first imaging apparatus, but does not appear, even after the elapsed time from the first time point, in a third video captured by the third imaging apparatus, decreasing a second index value.

14. The non-transitory computer readable recording medium according to claim 13 , wherein the programs further cause the at least one computer to perform:
determining that the first moving body and the second moving body are the same when a first index value indicating the similarity is larger than the second index value indicating that the first moving body does not appear in the second video at a second time point when the second moving body appears in the second video.

15. The non-transitory computer readable recording medium according to claim 14 , wherein the first index value is a first probability indicating that both moving bodies are the same and the second index value is a second probability indicating that the first moving body does not appear in the second video at the second ti

Assignees

• Nec Corp

Inventors

• Miyano Hiroyoshi

Classifications

• G06V20/30

  in albums, collections or shared content, e.g. social network photos or video · CPC title

• G06V20/54

  of traffic, e.g. cars on the road, trains or boats · CPC title

• G06V20/53

  Recognition of crowd images, e.g. recognition of crowd congestion · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• G08B13/19645

  Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over · CPC title