Method and apparatus for counting number of person using plurality of cameras

Patent metadata

Field	Value
Publication number	US-9781339-B2
Application number	US-201314053732-A
Country	US
Kind code	B2
Filing date	Oct 15, 2013
Priority date	Nov 30, 2012
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

A person counting device generates a single panorama image by using a plurality of images respectively captured by a plurality of cameras, inserts an imaginary line to the single panorama image; and counts the number of persons that pass the imaginary line. To this end, identification numbers are allocated to respective persons in the plurality of images, the single panorama image including the imaginary line is restored to a plurality of images including same imaginary line information, the number of persons that pass a new imaginary line in each of the plurality of restored images is determined, and the number of duplicate-counted persons is ruled out.

First claim

What is claimed is:

1. A person counting device comprising at least one processor to implement:
a single panorama image generator configured to match a plurality of images respectively captured by a plurality of cameras and generate a single panorama image;
a line inserter configured to insert an imaginary line to the single panorama image;
a person counter configured to allocate identification numbers to respective persons in the single panorama image and count the number of persons that pass the imaginary line; and
a duplication remover configured to rule out a number of duplicate-counted persons by using the identification numbers allocated to the respective persons in a plurality of images which are restored from the single panorama image, information regarding overlapping regions between the plurality of images, and imaginary line information,
wherein the person counter, in the restored plurality of images, allocates a same identification number to a person in the overlapping regions between the plurality of images.

2. The person counting device of claim 1 , wherein the single panorama image generator is configured to generate the single panorama image by using a homography method or an image stitching method, and
the generated single panorama image is displayed on a display screen.

3. The person counting device of claim 1 , wherein the single panorama image generator is configured to generate the single panorama image in real-time by reflecting changes of parameters of each of the plurality of cameras in real-time,
the generated single panorama image is displayed on a display screen in real-time, and
the parameters comprise data regarding panning, tilting, and zooming.

4. The person counting device of claim 1 , wherein the line inserter is further configured to receive an input of the imaginary line from a user via a display screen.

5. The person counting device of claim 1 , further comprising:
a count statistic unit configured to generate and manage statistical data regarding the number of persons counted by the person counting unit; and
a transmitter configured to transmit the information regarding the number of persons counted by the person counter or the statistical data.

6. The person counting device of claim 1 , further comprising a count displayer configured to display the number of persons counted by the person counting unit on a display screen in real-time.

7. The person counting device of claim 1 , further comprising a storage configured to store and manage the statistical data from the count statistic unit.

8. The person counting device of claim 1 , wherein the person counter further comprises an object detector configured to detect persons in images respectively captured by a plurality of cameras.

9. A method of counting a number of persons, the method comprising:
matching a plurality of images respectively captured by a plurality of cameras and generating a single panorama image;
inserting an imaginary line into the single panorama image;
allocating identification numbers to respective persons in the single panorama image and counting the number of persons that pass the imaginary line; and
ruling out a number of duplicate-counted persons by using the identification numbers allocated to the respective persons in a plurality of images which are restored from the single panorama image, information regarding overlapping regions between the plurality of images, and imaginary line information,
wherein the counting comprises allocating, in the restored plurality of images, a same identification number to a person in the overlapping regions between the plurality of images.

10. The method of claim 9 , wherein, in response to the single panorama image being generated, generating the single panorama image by using a homography method or an image stitching method, and
displaying the generated single panorama image on a display screen.

11. The method of claim 9 , wherein the single panorama image is generated in real-time by reflecting changes of parameters of each of the plurality of cameras in real-time,
the generated single panorama image is displayed on a display screen in real-time, and
the parameters comprise data regarding panning, tilting, and zooming.

12. The method of claim 9 , wherein, in response to the imaginary line being inserted into the single panorama image, imputing the imaginary line from a user via a display screen.

13. The method of claim 9 , wherein the allocating and counting further comprises:
generating and managing statistical data regarding the number of persons counted; and
transmitting the information regarding the number of persons counted or statistical data.

14. The method of claim 9 , further comprising displaying the number of persons counted on a display screen in real-time.

15. A method of counting a number of persons with a system including a plurality of cameras, the method comprising:
generating a single panorama image based on a plurality of images captured by the respective plurality of cameras;
inserting an imaginary line into the single panorama image;
restoring the single panorama image including the imaginary line into a plurality of sub-images including same imaginary line information;
inserting an imaginary line into each of the plurality of sub-images;
counting the number of persons that pass each imaginary line in each of the plurality of sub-images; and
adjusting the counted number of persons by subtracting a number of duplicate counted persons by using information regarding overlapping regions between the plurality of images and imaginary line information,
wherein the adjusting comprises allocating, in the restored plurality of sub-images, a same identification number to a person in the overlapping regions between the plurality of images.

16. The method of claim 15 , wherein each of the plurality of images overlaps with at least one other image of the plurality of images.

17. The method of claim 15 , wherein the adjusting comprises:
identifying a number of persons in the single panorama image;
allocating a different identification number to each of the identified persons; and
determining if the identification number of an identified person is counted more than once.

18. The method of claim 15 , wherein the inserting the imaginary line into the single panorama image comprises inserting an imaginary line input by a user via a display screen.

19. The method of claim 15 , wherein the generating comprises:
generating the single panorama image by using a homography method or an image stitching method.

Assignees

• Hanwha Techwin Co Ltd
• Hanwha Techwin Co Ltd

Inventors

• Lim Jeong-Eun
• Noh Seung-In
• Hong Ha-Na

Classifications

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G06V20/53 Primary

  Recognition of crowd images, e.g. recognition of crowd congestion · CPC title

• H04N5/23238 Primary

  Electricity · mapped topic

• G06K9/00778

  Physics · mapped topic

• G06M7/00

  Counting of objects carried by a conveyor · CPC title