Method for display-based video analytics

Patent metadata

Field	Value
Publication number	US-11281913-B2
Application number	US-202117192259-A
Country	US
Kind code	B2
Filing date	Mar 4, 2021
Priority date	Jan 9, 2017
Publication date	Mar 22, 2022
Grant date	Mar 22, 2022

Abstract

The present disclosure is directed to a video surveillance system and method for performing display-based video analytics on video streams provided by internet protocol (IP) cameras and/or a video management system (VMS) over an IP network. Display-based video analytics can perform video analytics on the video streams without a direct connection to the IP network. Because the display-based video analytics can perform video analytics on the video streams without being directly connected to the IP network, the display-based video analytics can be more readily implemented in video surveillance systems with secure IP networks.

First claim

What is claimed is:

1. A non-transitory computer-readable medium storing instructions that, when executed by a processor of an electronic device, cause the processor to perform operations for a display-based video analytics system, the operations comprising:
receiving, via a display cable, a video stream in a format for a display, wherein the video stream comprises video captured by an internet protocol (IP) camera coupled to a secure IP network,
wherein the secure IP network complies with a first security policy, wherein the format for the display complies with a second security policy, wherein the second security policy is not in compliance with the first security policy, and
wherein the display-based video analytics system is decoupled from the secure IP network such that the display-based video analytics system cannot directly receive or transmit IP packets over the secure IP network; and
performing video analytics on the video stream received via the display cable.

2. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise: outputting the video stream with results of the video analytics to the display or a video sharing gateway, wherein the results comprise: embedded text or a visual cue that indicates or highlights an event.

3. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise: outputting the video stream in a virtual IP camera stream, wherein results of the video analytics are applied to the video stream in the virtual IP camera stream or are provided as metadata together with the virtual IP camera stream.

4. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise:
encoding the video stream and results of the video analytics applied to the video stream for transmission over an external network; or
encrypting the video stream and the results of the video analytics applied to the video stream for transmission over the external network.

5. The non-transitory computer-readable medium of claim 1 , wherein the performing video analytics on the video stream comprises:
detecting an object in the video stream in the format for the display;
tracking the object in the video stream in the format for the display; and
extracting one or more features of the object for classification of the object or to recognize the one or more features of the object.

6. The non-transitory computer-readable medium of claim 1 , wherein the performing video analytics on the video stream comprises:
detecting an object in the video stream in the format for the display; and
recognizing an occurrence of an event associated with the object, in the video stream in the format for the display.

7. The non-transitory computer-readable medium of claim 6 , wherein the operations further comprise: issuing an alert including: a video cue embedded in the video stream that highlights the event, or metadata linked to the video stream.

8. A method for a display-based video analytics system, comprising:
receiving, via a display cable, a video stream in a format for a display, wherein the video stream comprises video captured by an internet protocol (IP) camera coupled to a secure IP network,
wherein the secure IP network complies with a first security policy, wherein the format for the display complies with a second security policy, wherein the second security policy is not in compliance with the first security policy, and
wherein the display-based video analytics system is decoupled from the secure IP network such that the display-based video analytics system cannot directly receive or transmit IP packets over the secure IP network; and
performing video analytics on the video stream received via the display cable.

9. The method of claim 8 , further comprising: outputting the video stream with results of the video analytics to the display or a video sharing gateway, wherein the results comprise: embedded text or a visual cue that indicates or highlights an event.

10. The method of claim 8 , wherein performing video analytics on the video stream further comprises:
encoding the video stream and results of the video analytics applied to the video stream for transmission over an external network; or
encrypting the video stream and the results of the video analytics applied to the video stream for transmission over the external network.

11. The method of claim 8 , wherein the performing video analytics on the video stream comprises:
detecting an object in the video stream in the format for the display;
tracking the object in the video stream in the format for the display; and
extracting one or more features of the object for classification of the object or to recognize the one or more features of the object.

12. The method of claim 8 , wherein the performing video analytics on the video stream comprises:
detecting an object in the video stream; in the format for the display; and
recognizing an occurrence of an event associated with the object, in the video stream in the format for the display.

13. The method of claim 12 , further comprising: issuing an alert including: a video cue embedded in the video stream that highlights the event, or metadata linked to the video stream.

14. A system for a display-based video analytics system, comprising:
a memory; and
one or more processors coupled to the memory, configured to:
receive, via a first display cable, a first video stream in a first format for display, wherein the first video stream comprises first video captured by a first internet protocol (IP) camera coupled to a first secure IP network,
wherein the first secure IP network complies with a first security policy, wherein the first format for display complies with a second security policy, wherein the second security policy is not in compliance with the first security policy;
receive, via a second display cable, a second video stream in a second format for display, wherein the second video stream comprises second video captured by a second internet protocol (IP) camera coupled to a second secure IP network, and
wherein the display-based video analytics system is decoupled from the first secure IP network and the second secure IP network such that the display-based video analytics system cannot directly receive or transmit IP packets via the first secure IP network or the second secure IP network; and
perform video analytics on the first video stream received via the first display cable and the second video stream received via the second display cable.

15. The system of claim 14 , wherein to perform the video analytics, the one or more processors are configured to:
detect an object across video frames of the first video stream and the second video stream; and
track the object of both the first video stream and the second video stream.

16. The system of claim 15 , wherein the one or more processors are further configured to:
recognize an occurrence of an event associated with the detected object; and
issue an alert comprising: a video cue embedded in the first and the second video streams that highlights the event, or metadata linked to the first and the second video streams.

17. The system of claim 14 , wherein to perform the video analytics, the one or more processors are configured to: cycle in time between the first video stream and the second video stream.

18. The system of claim 14 , wherein the one or more processors are further configured to:
format the first video stream and first results of the video analytics applied to the

Assignees

• Mutualink Inc

Inventors

• Wengrovitz Michael S
• Mazzarella Joseph R

Classifications

• G08B13/19613 Primary

  Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• G06F18/24

  Classification techniques · CPC title

• G06V20/44

  Event detection · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title