Systems and methods for video analysis rules based on map data

Patent metadata

Field	Value
Publication number	US-10110856-B2
Application number	US-201514959919-A
Country	US
Kind code	B2
Filing date	Dec 4, 2015
Priority date	Dec 5, 2014
Publication date	Oct 23, 2018
Grant date	Oct 23, 2018

Abstract

Systems, methods and computer-readable media for creating and using video analysis rules that are based on map data are disclosed. A sensor(s), such as a video camera, can track and monitor a geographic location, such as a road, pipeline, or other location or installation. A video analytics engine can receive video streams from the sensor, and identify a location of the imaged view in a geo-registered map space, such as a latitude-longitude defined map space. A user can operate a graphical user interface to draw, enter, select, and/or otherwise input on a map a set of rules for detection of events in the monitored scene, such as tripwires and areas of interest. When tripwires, areas of interest, and/or other features are approached or crossed, the engine can perform responsive actions, such as generating an alert and sending it to a user.

First claim

What is claimed is:

1. A system for generating video analysis rules, the system comprising:
a memory containing instructions;
an interface to a sensor that provides video of at least a portion of a geographic area;
a map-based user interface; and
a processor, operably connected to the memory, the interface to the sensor, and the map-based user interface, that executes the instructions to perform operations comprising:
displaying, on the map-based user interface, a map of the geographic area that is covered by the sensor;
accepting, via the map-based user interface, a rule-representing feature that is placed in a specific location on the map by a user;
generating a video analysis rule based on the rule-representing feature and the specific location on the map, wherein the video analysis rule is expressed in a geo-registered map space;
applying the video analysis rule to the video from the sensor to detect a triggering event in the video;
generating a notification upon detection of the triggering event; and
transmitting the notification to a connected device.

2. The system of claim 1 , wherein the notification causes the connected device to perform an action from the group consisting of: emitting a sound; displaying a view of the geographic area that is covered by the sensor; and providing a user-selectable link that activates transfer of information regarding the triggering event from another device.

3. The system of claim 1 , wherein the rule-representing feature is a tripwire.

4. The system of claim 1 , wherein the rule-representing feature is an area of interest.

5. The system of claim 1 , wherein the geo-registered map space is defined in coordinates that are latitude and longitude coordinates.

6. The system of claim 1 , wherein the video provided by the sensor comprises pixel-space video.

7. The system of claim 6 , further comprising:
transforming the pixel-space video into video in the geo-registered map space.

8. The system of claim 7 , wherein transforming further comprises:
associating an element from a frame of the video with coordinates in the geo-registered map space.

9. The system of claim 8 , wherein the coordinates in the geo-registered map space are latitude and longitude coordinates.

10. The system of claim 8 , wherein the video analysis rule is expressed in coordinates in the geo-registered map space; and
wherein applying the video analysis rule to the video from the sensor comprises:
comparing the coordinates of the element from the frame of the video with the coordinates of the video analysis rule to detect the triggering event.

11. A method for generating video analysis rules, the method comprising:
displaying, by a computing device, a map of a geographic area that is covered by a sensor that provides video of at least a portion of the geographic area;
providing, by the computing device, a user with an interface to place a rule-representing feature in a specific location on the map;
generating, by the computing device, a video analysis rule based on the rule-representing feature and the specific location on the map, wherein the video analysis rule is expressed in a geo-registered map space;
applying, by the computing device, the video analysis rule to the video from the sensor to detect a triggering event in the video;
generating, by the computing device, a notification upon detection of the triggering event; and
transmitting the notification to a connected device that alerts a user.

12. The method of claim 11 , wherein the notification causes the connected device to perform an action from the group consisting of: emitting a sound; displaying a view of the geographic area that is covered by the sensor; and providing a user-selectable link that activates transfer of information regarding the triggering event from another device.

13. The method of claim 11 , wherein the rule-representing feature is a tripwire.

14. The method of claim 11 , wherein the rule-representing feature is an area of interest.

15. The method of claim 11 , wherein the geo-registered map space is defined in coordinates that are latitude and longitude coordinates.

16. The method of claim 11 , wherein the video comprises pixel-space video.

17. The method of claim 16 , further comprising:
transforming the pixel-space video into video in the geo-registered map space.

18. The method of claim 17 , wherein transforming further comprises:
associating an element from a frame of the video with coordinates in the geo-registered map space.

19. The method of claim 18 , wherein the coordinates in the geo-registered map space are latitude and longitude coordinates.

20. The method of claim 18 , wherein the video analysis rule is expressed in coordinates in the geo-registered map space; and
wherein applying the video analysis rule to the video from the sensor comprises:

comparing the coordinates of the element from the frame of the video with the coordinates of the video analysis rule to detect the triggering event.

Assignees

• Avigilon Fortress Corp

Inventors

• Rasheed Zeeshan
• Eubanks Dana
• Yin Weihong
• Zhang Zhong
• Glowacki Kyle
• Beach Allison

Classifications

• G06V10/772

  Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries · CPC title

• G06F18/28

  Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries · CPC title

• G06K9/6255

  Physics · mapped topic

• G06K9/00771

  Physics · mapped topic

• G06T2207/30232

  Surveillance · CPC title