Indexing sensor data

Patent metadata

Field	Value
Publication number	US-9275093-B2
Application number	US-201113016945-A
Country	US
Kind code	B2
Filing date	Jan 28, 2011
Priority date	Jan 28, 2011
Publication date	Mar 1, 2016
Grant date	Mar 1, 2016

Abstract

In particular embodiments, a method includes, from an indexer in a sensor network, accessing a set of sensor data that includes sensor data aggregated together from sensors in the sensor network, one or more time stamps for the sensor data, and metadata for the sensor data identifying one or more pre-determined attributes of the sensor data. The method includes, at the indexer, generating an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data. One or more first ones of the dimensions of the multi-dimensional array include time, and one or more second ones of the dimensions of the multi-dimensional array include one or more of the pre-determined sensor-data attributes. The method includes, from the indexer, communicating the index of the set of sensor data for use in responding to one or more queries of the set of sensor data along with a plurality of other sets of sensor data.

First claim

What is claimed is:

1. A method comprising, by one or more computer systems:
from an indexer in a sensor network, accessing a set of sensor data that comprises:
a plurality of sensor data aggregated together from a plurality of sensors in the sensor network;
one or more time stamps for the sensor data; and
metadata for the sensor data identifying one or more pre-determined attributes of the sensor data;

at the indexer,
generating an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data, one or more first ones of the dimensions of the multi-dimensional array comprising time and one or more second ones of the dimensions of the multi-dimensional array comprising one or more of the pre-determined sensor-data attributes;
classifying the sensor data;
based on the classification, generating keywords for the sensor data using the metadata;
forming a keyword frequency distribution by combining the keywords for different time windows; and
summarizing the sensor data by eigenvalues of an array associated with the sensor data in a keyword space and generating, using the eigenvalues, a set of searchable sensor data that represents the sensor data and has a smaller size than the sensor data; and

from the indexer, communicating the index of the set of sensor data in response to one or more queries of the set of sensor data along with a plurality of other sets of sensor data, and
wherein generating the index comprises inputting the sensor data to a state machine with programmable rule criteria that is configured to drop sensor data that fail to meet the rule criteria as programmed.

2. The method of claim 1 , wherein aggregation of the sensor data comprised:
deduplicating the sensor data;
validating the sensor data to block malicious data from reaching the indexer;
formatting the sensor data for processing of the sensor data at the indexer;
generating the metadata for the sensor; and
generating the time-stamps for the sensor data.

3. The method of claim 1 , wherein the metadata comprises one or more identifiers designating one or more data types of the sensor data.

4. The method of claim 1 , wherein the sensor data comprises one or more streams of real-time streaming sensor data.

5. The method of claim 4 , wherein generating the index comprises representing each of the streams as a time-series of data for indexing.

6. One or more computer-readable non-transitory storage media embodying software that is configured when executed to:
access a set of sensor data that comprises:
a plurality of sensor data aggregated together from a plurality of sensors in the sensor network;
one or more time stamps for the sensor data; and
metadata for the sensor data identifying one or more pre-determined attributes of the sensor data;

generate an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data, one or more first ones of the dimensions of the multi-dimensional array comprising time and one or more second ones of the dimensions of the multi-dimensional array comprising one or more of the pre-determined sensor-data attributes;
classify the sensor data;
based on the classification, generate keywords for the sensor data using the metadata;
form a keyword frequency distribution by combining the keywords for different time windows;
summarize the sensor data by eigenvalues of an array associated with the sensor data in a keyword space and generate, using the eigenvalues, a set of searchable sensor data that represents the sensor data and has a smaller size than the sensor data;
communicate the index of the set of sensor data in response to one or more queries of the set of sensor data along with a plurality of other sets of sensor data, and
wherein generating the index comprises inputting the sensor data to a state machine with programmable rule criteria that is configured to drop sensor data that fail to meet the rule criteria as programmed.

7. The media of claim 6 , wherein aggregation of the sensor data comprised:
deduplicating the sensor data;
validating the sensor data to block malicious data from reaching the indexer;
formatting the sensor data for processing of the sensor data at the indexer;
generating the metadata for the sensor; and
generating the time-stamps for the sensor data.

8. The media of claim 6 , wherein the metadata comprises one or more identifiers designating one or more data types of the sensor data.

9. The media of claim 6 , wherein the sensor data comprises one or more streams of real-time streaming sensor data.

10. The media of claim 9 , wherein generating the index comprises representing each of the streams as a time-series of data for indexing.

11. An apparatus comprising:
one or more communication interfaces;
one or more memory devices containing one or more instructions for execution by one or more processing devices; and
the processing devices, configured when executing the instructions to:
access a set of sensor data that comprises:
a plurality of sensor data aggregated together from a plurality of sensors in the sensor network;
one or more time stamps for the sensor data; and
metadata for the sensor data identifying one or more pre-determined attributes of the sensor data;

generate an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data, one or more first ones of the dimensions of the multi-dimensional array comprising time and one or more second ones of the dimensions of the multi-dimensional array comprising one or more of the pre-determined sensor-data attributes;
classify the sensor data;
based on the classification,
forming a keyword frequency distribution by combining the keywords for different time windows;
summarizing the sensor data by eigenvalues of an array associated with the sensor data in a keyword space and generating, using the eigenvalues, a set of searchable sensor data that represents the sensor data and has a smaller size than the sensor data; and

communicate the index of the set of sensor data in response to one or more queries of the set of sensor data along with a plurality of other sets of sensor data, and
wherein generating the index comprises inputting the sensor data to a state machine with programmable rule criteria that is configured to drop sensor data that fail to meet the rule criteria as programmed.

12. The apparatus of claim 11 , wherein the aggregation of the sensor data comprised:
deduplicating the sensor data;
validating the sensor data to block malicious data from reaching the indexer;
formatting the sensor data for processing of the sensor data at the indexer;
generating the metadata for the sensor; and
generating the time-stamps for the sensor data.

13. The apparatus of claim 11 , wherein the metadata comprises one or more identifiers designating one or more data types of the sensor data.

14. The apparatus of claim 11 , wherein the sensor data comprises one or more streams of real-time streaming sensor data.

15. The apparatus of claim 14 , wherein generating the index comprises representing each of the streams as a time-series of data for indexing.

16. A system comprising, by one or more computer systems:
means for accessing a set of sensor data that comprises:
a plurality of sensor data aggregated together from a plurality of s

Assignees

• Pandey Manoj Kumar
• Banka Tarun
• Dutta Debojyoti
• Sen Mainak
• Balakrishnan Raja Suresh Krishna
• Cisco Tech Inc

Inventors

• Pandey Manoj Kumar
• Banka Tarun
• Dutta Debojyoti
• Sen Mainak
• Balakrishnan Raja Suresh Krishna

Classifications

• G06F17/30333 Primary

  Physics · mapped topic

• H04W28/065

  using assembly or disassembly of packets · CPC title

• H04L67/16

  Electricity · mapped topic

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• H04W84/18

  Self-organising networks, e.g. ad-hoc networks or sensor networks · CPC title