Access point stream and video surveillance stream based object location detection and activity analysis

Patent metadata

Field	Value
Publication number	US-2016335484-A1
Application number	US-201514644913-A
Country	US
Kind code	A1
Filing date	Mar 11, 2015
Priority date	Mar 11, 2015
Publication date	Nov 17, 2016
Grant date	—

Abstract

Methods and systems for co-relating location and identity data available from Access Points (APs) and video surveillance systems are provided. According to one embodiment, data, including a unique identifier of an object and information regarding a first geo-position of the object, is received from an AP of a wireless network of a venue. A video feed captured by a camera system monitoring a portion of the venue and/or information regarding a second geo-position corresponding to the object are also received. The first and second geo-positions are then mapped to a common coordinate system. Based on the unique identifier, information regarding the object as reported by the AP and the camera system or derived therefrom are correlated. Finally, behavioral attributes of the correlated object are assessed based on one or a combination of actions of the object, the first and second geo-positions and the common coordinate system.

First claim

What is claimed is:

1 . A system comprising:
an access point based location detection module configured to receive data from at least one Access Point (AP) of a wireless network of a venue, wherein the data includes (i) a unique identifier of an object and (ii) a first geo-position of the object or data from which the first geo-position can be derived; a video surveillance based location detection module configured to receive from at least one camera system, monitoring a portion of the venue, one or more of a video feed captured by the at least one camera system and a second geo-position corresponding to the object; a geo-position data based mapping module configured to map the first geo-position and the second geo-position to a common coordinate system; a tracking module configured to correlate, based on the unique identifier for the object, information regarding the object as reported by the at least one AP or derived therefrom and match it with information regarding the object as reported by the at least one camera system or derived therefrom; and an object assessment module configured to assess behavioral attributes of the correlated object based on one or a combination of actions of the object, the first geo-position, the second geo-position and the common coordinate system.

2 . The system of claim 1 , wherein the unique identifier of the object enables retrieval of behavioral history of the object for assessment of the behavioral attributes of the object.

3 . The system of claim 1 , wherein the unique identifier comprises a Media Access Control (MAC) address of a wireless computing device associated with the object, and wherein the MAC address is received from the wireless computing device by the at least one AP.

4 . The system of claim 1 , wherein the object comprises a human being, and wherein the wireless computing device comprises any or a combination of a mobile phone, a smartphone, a laptop, and wherein the wireless computing device transmits a management frame or a control frame to the at least one AP containing therein a MAC address of the wireless computing device.

5 . The system of claim 3 , wherein the first geo-position is calculated by the at least one AP or by the access point based location detection module using triangulation based on signal strengths associated with management or control frames originated by the wireless computing device and observed by a plurality of APs of the wireless network.

6 . The system of claim 1 , wherein analytics are performed on the video feed to one or more of identify and locate the object and assess the object's behavior.

7 . The system of claim 6 , wherein the unique identifier for the object is extracted from the data received from the at least one AP, and wherein the unique identifier is used to facilitate the analytics on the video feed.

8 . The system of claim 1 , wherein one or more actions are performed on the object based on the assessed behavioral attributes.

9 . The system of claim 1 , wherein responsive to detecting one or more anomalies based on the assessed behavioral attributes, at least one restriction is imposed on the object.

10 . The system of claim 1 , wherein the object assessment module is further configured to determine behavioral attributes of a plurality of objects within the venue along with one or a combination of assessment of concentration attributes of the plurality of objects, and action-based attributes of the plurality of objects.

11 . A method comprising:
receiving, by one or more computer systems of a location and behavioral attribute detection system, data from at least one Access Point (AP) of a wireless network of a venue, wherein the data includes (i) a unique identifier of an object and (ii) a first geo-position of the object or data from which the first geo-position can be derived; receiving, by the one or more computer systems, one or more of a video feed captured by at least one camera system monitoring a portion of the venue and a second geo-position corresponding to the object; mapping, by the one or more computer systems, the first geo-position and the second geo-position to a common coordinate system; correlating, by the one or more computer systems, based on the unique identifier for the object, information regarding the object as reported by the at least one AP or derived therefrom and information regarding the object as reported by the at least one camera system or derived therefrom; and assessing behavioral attributes of the correlated object based on one or a combination of actions of the object, the first geo-position, the second geo-position and the common coordinate system.

12 . The method of claim 11 , wherein the unique identifier enables retrieval of behavioral history of the object for assessment of the behavioral attributes of the object.

13 . The method of claim 11 , wherein the unique identifier comprises a Media Access Control (MAC) address of a wireless computing device associated with the object, and wherein the MAC address is received from the wireless computing device by the at least one AP.

14 . The method of claim 11 , wherein the object comprises a human being, and wherein the wireless computing device comprises any or a combination of a mobile phone, a smartphone, a laptop, and wherein the wireless computing device transmits a management frame or a control frame to the at least one AP containing therein a MAC address of the wireless computing device.

15 . The method of claim 13 , wherein the first geo-position is calculated by the at least one AP or by the access point based location detection module using triangulation based on signal strengths associated with management or control frames originated by the wireless computing device and observed by a plurality of APs of the wireless network.

16 . The method of claim 11 , wherein analytics are performed on the video feed to one or more of identify and locate the object and assess the object's behavior.

17 . The method of claim 6 , wherein the unique identifier for the object is extracted from the data received from the at least one AP, and wherein the unique identifier is used to facilitate the analytics on the video feed.

18 . The method of claim 11 , further comprising responsive to detecting one or more anomalies based on the assessed behavioral attributes, imposing at least one restriction on the object.

19 . The method of claim 11 , further comprising determining, by the one or more computer systems, behavioral attributes of a plurality of objects within the venue along with one or a combination of assessment of concentration attributes of the plurality of objects, and action-based attributes of the plurality of objects.

Assignees

• Fortinet Inc

Inventors

• Xie Michael
• Westendorp Robert
• Mihelich Joseph R

Classifications

• G06V10/803

  of input or preprocessed data · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• H04W4/023 Primary

  using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds · CPC title

• G06F18/251

  of input or preprocessed data · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title