Methods and systems for video surveillance

Patent metadata

Field	Value
Publication number	US-10671857-B2
Application number	US-201615737283-A
Country	US
Kind code	B2
Filing date	May 23, 2016
Priority date	Jun 17, 2015
Publication date	Jun 2, 2020
Grant date	Jun 2, 2020

Abstract

A system for video surveillance includes an image sensor configured capture an image including a reference zone and a memory device that stores instructions. The system also includes one or more processors that are configured to execute the instructions to determine 3D coordinates of a target comprised in the image and determine 3D coordinates of the reference zone. The one or more processors are further configured to identify an event according to the 3D coordinates of the target and the 3D coordinates of the reference zone.

First claim

We claim:

1. A system comprising:
an image sensor configured to capture an image including a reference zone;
a memory device that stores instructions; and
one or more processors that are configured to execute the instructions to:
determine 3D coordinates of a target comprised in the image;
determine 3D coordinates of the reference zone; and
identify an event according to the 3D coordinates of the target and the 3D coordinates of the reference zone, wherein identifying the event further includes identifying the event according to a distance between an endpoint of a segment in the reference zone and a reference point and a distance between the target and the reference point.

2. The system of claim 1 , wherein the reference zone is perpendicular to a ground plane in the image.

3. The system of claim 1 , wherein the one or more processors are further configured to:
identify a pixel or a pixel group in the image;
identify the pixel or the pixel group as the target; and
determine the 3D coordinates of the pixel or a pixel group.

4. The system of claim 1 , wherein the image is a 2D image.

5. The system of claim 4 , wherein the 3D coordinates of the targets are determined according to the 2D coordinates of the target.

6. The system of claim 1 , wherein the image sensor is configured to capture one or more 2D images at different positions.

7. The system of claim 6 , wherein determining the 3D coordinates of the target includes:
reconstructing a 3D image according to the one or more 2D images; and
determining the 3D coordinates of the target according to the reconstructed 3D image.

8. The system of claim 1 , wherein the image sensor is configured to capture an image with depth information.

9. The system of claim 1 , wherein identifying the event further includes:
determining horizontal information of the 3D coordinates of the target and horizontal information of the 3D coordinates of the reference zone; and
identifying the event based on the determined horizontal information of the 3D coordinates of the target and the reference zone.

10. The system of claim 1 , wherein the one or more processors are further configured to:
determine a trail of the target over a period of time;
determine 3D coordinates of the trail of the target over the period of time; and
determine the event according to the 3D coordinates of the trail of the target and 3D coordinates of the reference zone over the period of time.

11. The system of claim 1 , wherein the event includes one of:
the target locating inside of the reference zone;
the target locating outside of the reference zone;
the target locating on a boundary of the reference zone;
the target passing through the reference zone from the outside of the reference zone to the inside of the reference zone;
the target passing through the reference zone from the inside of the reference zone to the outside of the reference zone;
the target leaving the reference zone without passing through the reference zone; or
the target approaching the reference zone without passing through the reference zone.

12. A method comprising:
capturing an image including a reference zone;
determining 3D coordinates of a target comprised in the image;
determining 3D coordinates of the reference zone; and
identifying an event according to the 3D coordinates of the target and 3D coordinates of the reference zone, wherein identifying the event further includes identifying the event according to a distance between an endpoint of a segment in the reference zone and a reference point and a distance between the target and the reference point.

13. The method of claim 12 , further comprising:
identifying a pixel or a pixel group in the image;
identifying the pixel or the pixel group as the target; and
determining the 3D coordinates of the pixel or the pixel group.

14. The method of claim 12 , wherein the image is a 2D image, and the 3D coordinates of the target is determined according to 2D coordinate of the target.

15. The method of claim 14 , wherein the image is captured by an image sensor including a 2D camera.

16. The method of claim 12 , wherein one or more 2D images are captured at different positions, and determining the 3D coordinates of the target includes:
reconstructing a 3D image according to the one or more 2D images; and
determining the 3D coordinates of the target according to the reconstructed 3D images.

17. The method of claim 16 , wherein the image is captured by an image sensor including more than one camera.

18. The method of claim 12 , wherein the image is captured with depth information.

19. The method of claim 12 , further comprising the step of determining a type of the target.

20. A non-transitory computer readable medium embodying a computer program product, the computer program product comprising instructions configured to cause a computing device to perform a method comprising:
capturing an image including a reference zone;
determining 3D coordinates of a target comprised in the image;
determining 3D coordinates of the reference zone; and
identifying an event according to the 3D coordinates of the target and 3D coordinates of the reference zone, wherein identifying the event further includes identifying the event according to a distance between an endpoint of a segment in the reference zone and a reference point and a distance between the target and the reference point.

Assignees

• Zhejiang Dahua Technology Co

Inventors

• Pan Huadong
• Cheng Miao
• Pan shizhu
• Zhang Xingming

Classifications

• G08B13/19613

  Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion · CPC title

• G08B5/36

  using visible light sources · CPC title

• G06T2207/30232

  Surveillance · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T7/292

  Multi-camera tracking · CPC title