Line rate visual analytics on edge devices

Patent metadata

Field	Value
Publication number	US-9600494-B2
Application number	US-201414163169-A
Country	US
Kind code	B2
Filing date	Jan 24, 2014
Priority date	Jan 24, 2014
Publication date	Mar 21, 2017
Grant date	Mar 21, 2017

Abstract

In one embodiment, a stream of data packets originated by a visual data source is received at an edge device in a network. The data packets include at least one of video data, image data, and geo spatial data. Next, a visual data attribute is extracted at the edge device from the stream of data packets according to an edge-based extraction algorithm. The extracted visual data attribute is vectorized at the edge device via quantization vectors. The vectorized visual data attribute is then indexed at the edge device in a schema-less database that stores indexed visual data attributes.

First claim

What is claimed is:

1. A method, comprising:
receiving, at an edge device in a network, a stream of data packets originated by a visual data source, the data packets including at least one of video data, image data, and geospatial data, wherein the edge device acts as a local proxy device within its respective local area network (LAN) between the network and a core network to forward data packets into and out of the network;
extracting, at the edge device, a visual data attribute from the stream of data packets;
vectorizing, at the edge device, the extracted visual data attribute via quantization vectors;
indexing, at the edge device, the vectorized visual data attribute in a schema-less database that stores indexed visual data attributes;
receiving, at the edge device, a search query including a vectorized visual data attribute to be searched; and
searching, at the edge device, the indexed visual data attributes for at least one candidate visual data attribute comparable to the vectorized visual data attribute to be searched.

2. The method as in claim 1 , further comprising:
defining a region of interest in the stream of data packets, wherein the extracted visual data attribute is extracted from the region of interest.

3. The method as in claim 1 , further comprising:
determining whether the stream of data packets includes video data, image data, or geospatial data, wherein the extracting at the edge device is based on the determination.

4. The method as in claim 1 , further comprising:
determining the visual data source by which the stream of data packets is originated, wherein the extracting at the edge device is based on the determination.

5. The method as in claim 1 , further comprising:
compressing the stream of data packets; and
placing the compressed stream of data packets in a visual data container.

6. The method as in claim 1 , wherein the extracting of the visual data attribute comprises:
projecting an object in Q dimensions onto an object plane with Q- 1 dimensions;
calculating a bounding region on the object plane in which the projected object is located, wherein the bounding region is defined by at least one bounding parameter.

7. The method as in claim 6 , wherein the at least one bounding parameter includes at least one of a first and second area value, a separation amount of the first and second area value, a center point of a line segment, and an angular orientation of the line segment.

8. The method as in claim 1 , wherein the extracting of the visual data attribute is performed in a transform space.

9. The method as in claim 1 , further comprising:
creating the schema-less database using at least one bounding parameter as a field.

10. The method as in claim 1 , further comprising:
providing access to the schema-less database to at least one other edge device in the network.

11. The method as in claim 1 , further comprising:
identifying visual data trends based on the extracted visual data attribute; and
storing the extracted visual data attribute at a storage location.

12. An apparatus, comprising:
one or more network interfaces that communicate with a network;
a processor coupled to the one or more network interfaces and configured to execute a process; and
a memory configured to store program instructions which contain the process executable by the processor, the process comprising:
receiving, as an edge device in the network, a stream of data packets originated by a visual data source, the data packets including at least one of video data, image data, and geospatial data, wherein the edge device acts as a local proxy device within its respective local area network (LAN) between the network and a core network to forward data packets into and out of the network:
extracting, as the edge device, a visual data attribute from the stream of data packets;
vectorizing, as the edge device, the extracted visual data attribute via quantization vectors;
indexing, as the edge device, the vectorized visual data attribute in a schema-less database that stores indexed visual data attributes;
receiving, as the edge device, a search query including a vectorized visual data attribute to be searched; and
searching, as the edge device, the indexed visual data attributes for at least one candidate visual data attribute comparable to the vectorized visual data attribute to be searched.

13. The apparatus as in claim 12 , wherein the process further comprises:
defining a region of interest in the stream of data packets, wherein the extracted visual data attribute is extracted from the region of interest.

14. The apparatus as in claim 12 , wherein the process further comprises:
determining whether the stream of data packets includes video data, image data, or geospatial data, wherein the extracting at the edge device is based on the determination.

15. A tangible, non-transitory, computer-readable media having software encoded thereon, the software when executed by a processor operable to:
receive, as an edge device in the network, a stream of data packets originated by a visual data source, the data packets including at least one of video data, image data, and geospatial data, wherein the edge device acts as a local proxy device within its respective local area network (LAN) between the network and a core network to forward data packets into and out of the network;
extract, as the edge device, a visual data attribute from the stream of data packets;
vectorize, as the edge device, the extracted visual data attribute via quantization vectors;
index, as the edge device, the vectorized visual data attribute in a schema-less database that stores indexed visual data attributes;
receive, as the edge device, a search query including a vectorized visual data attribute to be searched; and
searching, as the edge device, the indexed visual data attributes for at least one candidate visual data attribute comparable to the vectorized visual data attribute to be searched.

Assignees

• Cisco Tech Inc

Inventors

• Maluf David A
• Sudhaakar Raghuram S
• Stanley Iii James D
• Addepalli Sateesh K

Classifications

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title

• G06T2210/12

  Bounding box · CPC title

• G06F17/30321

  Physics · mapped topic

• G06F17/30247 Primary

  Physics · mapped topic

• H04N21/23418

  involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title