Analytics-driven summary views for surveillance networks

Patent metadata

Field	Value
Publication number	US-12342105-B2
Application number	US-202117487380-A
Country	US
Kind code	B2
Filing date	Sep 28, 2021
Priority date	May 13, 2013
Publication date	Jun 24, 2025
Grant date	Jun 24, 2025

Abstract

A method of displaying surveillance video streams is provided that includes receiving surveillance video streams generated by a plurality of video cameras, and displaying a selected subset of the surveillance video streams in a summary view on at least one display device, wherein, for each surveillance video stream in the summary view, only a relevant portion of each frame in the surveillance video stream is displayed, and wherein a relevant portion is a subset of a frame for at least some of the surveillance video streams in the summary view.

First claim

What is claimed is:

1. A method, the method comprising:
receiving a plurality of video streams from a plurality of video cameras;
detecting an object and an event in two or more video streams of the plurality of video streams;
selecting the two or more video streams to display in a summary view based at least in part on a priority of the detected event and based at least in part on the detected object, wherein the priority of the detected event is based in part on whether at least two of the video streams include a same object;
determining, by a video management server, a relevant portion in each of the two or more video streams to display in the summary view, wherein the relevant portion is a subset of a frame in each of the two or more video streams; and
displaying the relevant portion in each of the two or more video streams in the summary view on at least one display device.

2. The method of claim 1 , further comprising displaying the two or more video streams on a plurality of monitors.

3. The method of claim 1 , wherein the relevant portion of a video stream is a zone in a field of view of a video camera that generated the video stream or a bounding box of the object identified in the video stream.

4. The method of claim 1 , wherein displaying the two or more video streams comprises including a video stream in the two or more video streams when the object is detected in a zone in a field of view of a video camera that generated the video stream.

5. A non-transitory computer readable medium comprising instructions that, when executed by at least one processor, cause the at least one processor to:
receive a plurality of video streams from a plurality of video cameras;
detect an object and an event in two or more video streams of the plurality of video streams;
select the two or more video streams to display in a summary view based at least in part on a priority of the detected event and based at least in part on the detected object, wherein the priority of the detected event is based in part on whether at least two of the video streams include a same object;
determine, by a video management server, a relevant portion in each of the two or more video streams to display in the summary view, wherein the relevant portion is a subset of a frame in each of the two or more video streams; and
display the relevant portion in each of the two or more video streams in the summary view on at least one display device.

6. The non-transitory computer readable medium of claim 5 , wherein the relevant portion of a video stream is a zone in a field of view of a video camera that generated the video stream or a bounding box of the object identified in the video stream.

7. The non-transitory computer readable medium of claim 5 , wherein the instructions that cause the at least one processor to display the two or more video streams include instructions that cause the at least one processor to include a video stream in the two or more video streams when the object is detected in a zone in a field of view of a video camera that generated the video stream.

8. The non-transitory computer readable medium of claim 7 , wherein the instructions that cause the at least one processor to display the two or more video streams include instructions that cause the at least one processor to include a video stream in the two or more video streams based on the priority of the detected event.

9. The non-transitory computer readable medium of claim 7 , wherein the instructions that cause the at least one processor to display the two or more video streams include instructions that cause the at least one processor to include a video stream in the two or more video streams based on a type of the detected event.

10. The non-transitory computer readable medium of claim 5 , wherein the instructions further cause the at least one processor to display the two or more video streams on a plurality of monitors.

11. A device comprising one or more processors configured to:
receive a plurality of video streams from a plurality of video cameras;
detect an object and an event in two or more video streams of the plurality of video streams;
select the two or more video streams to display in a summary view based at least in part on a priority of the detected event and based at least in part on the detected object, wherein the priority of the detected event is based in part on whether at least two of the video streams include a same object;
determine, by a video management server, a relevant portion in each of the two or more video streams to display in the summary view, wherein the relevant portion is a subset of a frame in each of the two or more video streams; and
display the relevant portion in each of the two or more video streams in the summary view on at least one display device.

12. The device of claim 11 , wherein the relevant portion of a video stream is a zone in a field of view of a video camera that generated the video stream or a bounding box of the object identified in the video stream.

13. The device of claim 11 , wherein the one or more processors are further configured to include a video stream in the two or more video streams when the object is detected in a zone in a field of view of a video camera that generated the video stream.

14. The device of claim 13 , wherein the one or more processors are further configured to include a video stream in the two or more video streams based on the priority of the detected event.

15. The device of claim 13 , wherein the one or more processors are further configured to include a video stream in the two or more video streams based on a type of the event detected in the video stream.

16. The device of claim 11 , wherein the one or more processors are further configured to display the two or more video streams on a plurality of monitors.

17. The device of claim 11 , wherein at least one video camera in the plurality of video cameras is a mobile video camera.

18. The device of claim 11 , wherein each video stream of the two or more video streams is associated with metadata.

19. The device of claim 18 , wherein the metadata includes:
a type of event;
size and location of zones where the event was detected;
size and locations of any bounding boxes of any objects corresponding to the detected event;
object centroids; or
object labels.

20. The method of claim 1 , wherein at least one video camera in the plurality of video cameras is a mobile video camera.

21. The method of claim 1 , wherein each video stream of the two or more video streams is associated with metadata.

22. The method of claim 21 , wherein the metadata includes:
a type of event;
size and location of zones where the event was detected;
size and locations of any bounding boxes of any objects corresponding to the detected event;
object centroids; or
object labels.

23. The non-transitory computer readable medium of claim 5 , wherein at least one video camera in the plurality of video cameras is a mobile video camera.

24. The non-transitory computer readable medium of claim 5 , wherein each video stream of the two or more video streams is associated with metadata.

25. The non-transitory computer readable medium of claim 24 , wherein the metadata includes:
a type of event;
size and location of zones where the event was detected;
size and locations of any bounding boxes of any objects corresponding to the detected event;
object c

Assignees

• Texas Instruments Inc

Inventors

• Dedeoglu Goksel
• Moore Darnell Janssen

Classifications

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• H04N21/21805

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• H04N21/44008

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• G09G5/14

  Display of multiple viewports · CPC title

• H04N21/8549

  Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)} · CPC title