Display-based video analytics

Patent metadata

Field	Value
Publication number	US-10943123-B2
Application number	US-201715401862-A
Country	US
Kind code	B2
Filing date	Jan 9, 2017
Priority date	Jan 9, 2017
Publication date	Mar 9, 2021
Grant date	Mar 9, 2021

Abstract

The present disclosure is directed to a video surveillance system and method for performing display-based video analytics on video streams provided by internet protocol (IP) cameras and/or a video management system (VMS) over an IP network. Display-based video analytics can perform video analytics on the video streams without a direct connection to the IP network. Because the display-based video analytics can perform video analytics on the video streams without being directly connected to the IP network, the display-based video analytics can be more readily implemented in video surveillance systems with secure IP networks.

First claim

What is claimed is:

1. A system comprising:
an internet protocol (IP) camera configured to:
capture video; and
transmit a video stream based on the captured video over a secure IP network,

wherein the secure IP network complies with a first security policy;
a video receiving device configured to:
receive the video stream over the secure IP network; and
provide to a display-based video analytics system via a display cable, the video stream in a format for a display; and

the display-based video analytics system configured to:
receive from the video receiving device via the display cable, the video stream in the format for the display, wherein the format for the display complies with a second security policy, wherein the second security policy is not in compliance with the first security policy;
compare a first video frame and a second video frame of the video stream received via the display cable;
determine a change in a color frequency distribution between the first video frame and the second video frame; and
in response to the determination, perform video analytics on the video stream in the format for the display,
wherein the display-based video analytics system is decoupled from the secure IP network such that the display-based video analytics system cannot directly receive or transmit IP packets over the secure IP network.

2. The system of claim 1 , wherein the display cable is a High-Definition Multimedia Interface (HDMI) cable, a Digital Visual Interface (DVI) cable, or a Video Graphics Array (VGA) cable.

3. The system of claim 1 , wherein the display-based video analytics system is further configured to: output the video stream with results of the video analytics to a display or a video sharing gateway, wherein the output comprises: embedded text or a visual cue that indicates or highlights an event.

4. The system of claim 1 , wherein the display-based video analytics system is further configured to: output the video stream in a virtual IP camera stream, wherein results of the video analytics are applied to the video stream in the virtual IP camera stream or are provided as metadata together with the virtual IP camera stream.

5. The system of claim 1 , wherein the display-based video analytics system is further configured to:
encode and encrypt the video stream and the results of the video analytics applied to the video stream for transmission over an external network; or
encrypt the video stream and the results of the video analytics applied to the video stream for transmission over the external network.

6. The system of claim 1 , further comprising:
a video management system (VMS) coupled to the secure IP network configured to:
receive the video stream over the secure IP network from the IP camera;
store the video stream; and
distribute the video stream.

7. The system of claim 6 , wherein the video receiving device is further configured to receive the video stream over the secure IP network from the VMS.

8. The system of claim 1 , wherein to perform the video analytics on the video stream in the format for the display, the display-based video analytics system is configured to:
detect an object in the video stream in the format for the display; and
track the object in the video stream in the format for the display.

9. The system of claim 1 , wherein to perform the video analytics on the video stream in the format for the display, the display-based video analytics system is configured to:
detect an object in the video stream in the format for the display; and
extract one or more features of the object for classification of the object or to recognize recognition of the one or more features of the object.

10. The system of claim 1 , wherein to perform the video analytics on the video stream in the format for the display, the display-based video analytics system is configured to:
detect an object in the video stream; in the format for the display and
recognize an occurrence of an event associated with the object, in the video stream in the format for the display.

11. A system comprising:
a first internet protocol (IP) camera configured to: transmit a first video stream over a first secure IP network, wherein the first secure IP network complies with a first security policy;
a first video receiving device configured to:
receive the first video stream over the first secure IP network; and
provide to a display-based video analytics system, the first video stream in a first format for a first display via a first display cable;

a second IP camera configured to: transmit a second video stream over a second secure IP network;
a second video receiving device configured to:
receive the second video stream over the second secure IP network; and
provide the second video stream in a second format for a second display via a second display cable; and

the display-based video analytics system decoupled from the first secure IP network and the second secure IP network, configured to:
receive the first video stream from the first video receiving device via the first display cable in the first format for the first display, wherein the first format for the first display complies with a second security policy, wherein the second security policy is not in compliance with the first security policy;
receive the second video stream in the second format for the second display via the second display cable;
compare a first video frame and a second video frame of the first video stream received via the first display cable;
determine a change in a color frequency distribution between the first video frame and the second video frame; and
in response to the determining, perform video analytics on both the first video stream and the second video stream.

12. The system of claim 11 , wherein the first display cable is a High-Definition Multimedia Interface (HDMI) cable, a Digital Visual Interface (DVI) cable, or a Video Graphics Array (VGA) cable.

13. The system of claim 11 , wherein to perform the video analytics, the display-based video analytics system is configured to:
detect an object across the first and second video frames of the first video stream and the second video stream; and
track the object of both the first video stream and the second video stream.

14. The system of claim 13 , wherein to perform the video analytics, the display-based video analytics system is further configured to: extract features of the object from both the first video stream and the second video stream for classification and recognition of the features.

15. The system of claim 11 , wherein to perform the video analytics, the display-based video analytics system is configured to: cycle in time between the first video stream and the second video stream, wherein the cycle comprises a range of 0.5 seconds to 2 seconds.

16. A method for a display-based video analytics system, comprising:
receiving, from a video receiving device via a display cable, a first video stream in a format for display, wherein the first video stream comprises video captured by an internet protocol (IP) camera coupled to a first secure IP network,
wherein the first secure IP network complies with a first security policy, wherein the format for the display complies with a second security policy, wherein the second security policy is not in compliance with the first security policy, and
wherein the display-based video analytics system is decoupled from the first secure IP network such that the display-based video analytics system cannot directly receive or transmit IP packets over the first secure IP network

Assignees

• Mutualink Inc

Inventors

• Wengrovitz Michael S
• Mazzarella Joseph R

Classifications

• G08B13/19613 Primary

  Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• G06F18/24

  Classification techniques · CPC title

• G06V20/44

  Event detection · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title