Automatic extraction of secondary video streams

Patent metadata

Field	Value
Publication number	US-9524437-B2
Application number	US-201514961805-A
Country	US
Kind code	B2
Filing date	Dec 7, 2015
Priority date	Mar 28, 2006
Publication date	Dec 20, 2016
Grant date	Dec 20, 2016

Abstract

The automatic generation ( 702 ) of one or more secondary video streams based on an input primary video stream ( 701 ) may use analytics performed on the video to provide information on targets, events, and/or areas of interest to permit the one or more secondary video streams ( 703 ) to concentrate on one or more targets, events, and/or areas of interest.

First claim

We claim:

1. A system to automatically generate at least one secondary video stream based on an incoming primary video stream, the system comprising:
a user interface; and
a computer responsive to the user interface and configured to perform video analytics on the primary video stream to generate one or more analysis results, the one or more analysis results including information relating to at least one element selected from the group consisting of a target, an event, and an area, to detect at least one of a target of interest, an event of interest and an area of interest using the analysis results and at least one of a user specified criterion received via the user interface or an automatically detected criterion, and to classify at least one of the detected target of interest and the detected event of interest, and in response to the classifying, to automatically extract a first secondary video stream comprising at least a portion of at least one of the detected target of interest and the detected event of interest, wherein a field of view of the first secondary video stream is smaller than a field of view of the primary video stream,
wherein the computer is configured to detect foreground objects in the primary video stream.

2. The system of claim 1 , wherein the computer is configured to perform video analytics by down-sampling a higher resolution primary video stream to obtain a lower resolution primary video stream and the computer is configured to perform video analytics on the lower resolution primary video stream.

3. The system of claim 2 , wherein the computer is configured to extract the first secondary video stream from the higher resolution primary video stream.

4. The system according to claim 1 , wherein the computer is configured to detect foreground objects by determining regions in the primary video stream containing newly-modified objects.

5. The system according to claim 1 , wherein the computer is configured to automatically extract, as the first secondary video stream, a best-shot of the detected target of interest in the primary video stream.

6. The system of claim 1 , wherein the computer is configured to automatically extract, as the first secondary video stream, a face of a human target detected in the primary video stream.

7. The system of claim 1 , wherein the computer is configured to classify the detected target of interest as a human, and in response to classifying the detected target of interest as a human, to extract the first secondary video stream comprising a face of the detected human target.

8. The system of claim 1 , wherein the computer is configured to classify the detected target of interest as a human, and in response to classifying the detected target of interest as a human, to extract the first secondary video stream comprising an upper portion of the detected human target.

9. The system of claim 1 , wherein the computer is configured to classify the detected target of interest as a vehicle, and in response to classifying the detected target of interest as a vehicle, to extract the first secondary video stream comprising a license plate of the detected vehicle target.

10. The system of claim 1 , wherein the field of view of the first secondary video stream is a portion of the field of view of the primary video stream.

11. The system of claim 10 , wherein the data comprises data describing a location of the detected target of interest in relation to the primary video stream.

12. The system of claim 10 , wherein the data comprises data describing a location of the detected target of interest.

13. The system of claim 10 , wherein the data comprises data describing a location of a base of a detected object.

14. The system of claim 1 , wherein the one or more analysis results comprise data describing at least one of the detected target of interest and the detected event of interest.

15. The system of claim 1 , further comprising a video camera, wherein the primary video stream is obtained directly from an image sensor of the video camera.

16. The system of claim 1 , wherein the computer is configured to detect the detected target of interest in the primary video stream and to determine an orientation of the detected target of interest in the primary video stream.

17. The system of claim 16 , wherein the computer is configured to automatically extract the first secondary video stream in response to the determined orientation of the detected target of interest.

18. The system of claim 1 , wherein the computer is configured to detect the detected target of interest in the primary video stream and to determine a direction of motion of the detected target of interest in the primary video stream.

19. The system of claim 18 , wherein the computer is configured to automatically extract the first secondary video stream in response to the determined direction of motion of the detected target of interest.

20. The system of claim 1 , wherein the computer is configured to automatically extract the first secondary video stream to contain multiple detected objects in response to detecting the multiple detected objects in the primary video stream.

21. The system of claim 20 , wherein the computer is configured to determine a relationship between multiple human objects by performing video analytics on the primary video stream, wherein the first secondary video stream is generated to include the multiple human objects in response to the determined relationship between the multiple human objects.

22. The system of claim 20 , wherein the computer is configured to generate the first secondary video stream to include first and second human objects in response to an analysis of movement of the first and second human objects in the performing of video analytics on the primary video stream.

23. The system of claim 1 , wherein the computer is configured to automatically extract plural secondary video streams.

24. The system of claim 23 , wherein the computer is configured to automatically extract the first secondary video stream in response to detecting a first target and a second secondary video stream in response to detecting a second target.

25. The system of claim 1 , wherein the computer is configured to perform video analytics on the primary video comprises to analyze the primary video to detect an object that has been left behind, and to automatically extract the first secondary video stream in response to the detection of an object that has been left behind.

26. The system of claim 25 , wherein the computer is configured to extract the first secondary video stream to include the object that has been left behind in response to the detection that the object that has been left behind.

27. The system of claim 1 , wherein the computer is configured to calculate a 3-D position for a target detected by the performed video analytics.

28. The system of claim 1 , wherein the computer is configured to automatically extract the first secondary video stream in order to track the detected target of interest.

29. The system of claim 1 , wherein the computer is configured to automatically extract the first secondary video stream to keep the detected target of interest at a particular position in the first secondary video stream.

30. The system of claim 1 , wherein the computer is configured to automatically extract the firs

Assignees

• Avigilon Fortress Corp

Inventors

• Scanlon W Andrew
• Chosak Andrew J
• Clark John I W
• Cutting Robert A
• Lipton Alan J
• Myers Gary W

Classifications

• H04N19/17

  the unit being an image region, e.g. an object · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• H04N5/262

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title

• H04N19/20

  using video object coding · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title