Method and system to characterize video background changes as abandoned or removed objects

Patent metadata

Field	Value
Publication number	US-9237316-B2
Application number	US-201313783625-A
Country	US
Kind code	B2
Filing date	Mar 4, 2013
Priority date	Mar 4, 2013
Publication date	Jan 12, 2016
Grant date	Jan 12, 2016

Abstract

A method and system for analyzing video data in a security system. An analysis compares a current frame to a background model. The analysis system compares the background model to the current frame to identify changed pixel patches. The analysis system uses morphological image processing to generate masks based on the changed pixel patches. Next, the analysis system applies the masks to the background model and the current frames to determine whether the changed pixel patches are characteristic of abandoned or removed objects within the video data.

First claim

What is claimed is:

1. A method for analyzing video data in a security system, the method comprising:
comparing a background model to at least one frame of the video data to identify at least one patch of changed pixels between the background model and the at least one frame;
performing morphological image processing on the at least one patch of changed pixels including erosions and/or dilations to generate masks;
extracting edge pixels in the background model and the at least one frame with an edge detection algorithm;
summing gradient magnitudes for the edge pixels in the background model with respect to the masks;
summing gradient magnitudes for edge pixels in the at least one frame of video data with respect to the masks; and
characterizing objects in the video data as abandoned or removed based on a comparison of the sums of gradient magnitudes between the background model and the at least one frame.

2. The method according to claim 1 , further comprising continually updating the background model based determination of the abandoned objects and/or the removed objects.

3. The method according to claim 2 , wherein the background model is temporarily stored in a processing pipeline.

4. The method according to claim 1 , further comprising associating metadata with the at least one frame and creating alerts based on the metadata.

5. A security system comprising:
video cameras to capture video data;
a video recorder to store the captured video data;
an analysis system that analyzes video data in a security system; and
wherein the analysis system compares a background model to at least one frame of the video data to identify at least one patch of changed pixels between the background model and the at least one frame, performs morphological image processing on the at least one patch of changed pixels including erosions and/or dilations to generate masks, extracts edge pixels in the background model and the at least one frame with an edge detection algorithm, sums gradient magnitudes for the edge pixels in the background model with respect to the masks, sums gradient magnitudes for edge pixels in the at least one frame of video data with respect to the masks, and characterizes objects in the video data as abandoned or removed based on a comparison of the sums of gradient magnitudes of the background model and the at least one frame.

6. The system according to claim 5 , wherein the analysis system further continually updates the background model based determination of the abandoned objects and/or the removed objects.

7. The system according to claim 6 , wherein the background model is temporarily stored in a processing pipeline.

8. The system according to claim 5 , wherein the analysis system further associates metadata with the at least one frame and creates alerts based on the metadata.

Assignees

• Sensormatic Electronics Llc

Inventors

• Li Changchun
• Westmacott Ian
• Ristivojevic Mirko
• Gruenke Matthew A

Classifications

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title

• G06T7/2053

  Physics · mapped topic

• G06T2207/20036

  Morphological image processing · CPC title