Pre-processing of geo-spatial sensor data

Patent metadata

Field	Value
Publication number	US-10515102-B2
Application number	US-201715495793-A
Country	US
Kind code	B2
Filing date	Apr 24, 2017
Priority date	Mar 19, 2014
Publication date	Dec 24, 2019
Grant date	Dec 24, 2019

Abstract

Data is received that is derived from a plurality of geo-spatial sensors that respectively generate data characterizing a plurality of sources within a zone of interest. The data includes series time-stamped frames for each of the sensors and at least one of the sources has two or more associated sensors. The received data can be sorted and processed, for each sensor on a sensor-by-sensor basis, using a sliding window. The sorted and processed data can then be correlated and written into a data storage application. Related apparatus, systems, techniques and articles are also described.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving data derived from a plurality of geo-spatial sensors, the received data comprising information characterizing a plurality of sources within a zone of interest, the received data comprising a series of time-stamped frames for the plurality of geo-spatial sensors, at least one of the plurality of sources associated with two or more sensors of the plurality of geo-spatial sensors;
sorting, for at least a portion of the plurality of geo-spatial sensors, the received data into a plurality of buckets using a sliding window, wherein the sorting comprises filtering the series of time-stamped frames based on timestamps associated with the series of time-stamped frames, the filtering comprising recording, for at least a portion of the plurality of geo-spatial sensors, a system time and a time of a first recorded time-stamped frame;
generating a missing time-stamped frame by interpolating a first and a second time-stamped frame of the series of time-stamped frames, wherein the first time-stamped frame is associated with a first bucket of the plurality of buckets and the second time-stamped frame is associated with a second bucket of the plurality of buckets;
correlating the sorted data from at least the two or more sensors with the at least one of the plurality of sources, wherein the sorted data includes the missing time-stamped frame; and
storing the correlated data.

2. The method as in claim 1 , wherein filtering of the series of time-stamped frames further comprises:
determining an expected timestamp for arriving frames; and
discarding arriving frames having a timestamp outside a pre-defined time window relative to the expected timestamp.

3. The method as in claim 1 , wherein the sorting comprises:
subdividing, based on a sample rate, a time bar into the plurality of buckets;
assigning, based on time, the series of time-stamped frames into a corresponding bucket of the plurality of buckets; and
interpolating, when an amount of time between two assigned time-stamped frames spans multiple buckets, missing values.

4. The method as in claim 1 , wherein correlating the sorted data for the plurality of sources comprises:
assigning, based on transposition using a mapping table, the time-stamped frames in the plurality of buckets to an originating source from the plurality of sources.

5. The method as in claim 1 further comprising:
providing the sorted data into a pre-processing library prior to storing the correlated data.

6. The method as in claim 1 , wherein the correlated data is stored in an in-memory database.

7. The method as in claim 6 , wherein the in-memory database stores data in a columnwise fashion.

8. The method as in claim 1 , wherein the receiving and the sorting are implemented by at least one data processor comprised in a computing system.

9. A non-transitory computer program product storing instructions which, when executed by at least one data processor forming part of at least one computing system, result in operations comprising:
receiving data derived from a plurality of geo-spatial sensors, the received data comprising information characterizing a plurality of sources within a zone of interest, the received data comprising a series of time-stamped frames for the plurality of geo-spatial sensors, at least one of the plurality of sources associated with two or more sensors of the plurality of geo-spatial sensors;
sorting, for at least a portion of the plurality of geo-spatial sensors on a sensor-by-sensor basis, the received data into a plurality of buckets using a sliding window, wherein the sorting comprises filtering the series of time-stamped frames based on timestamps associated with the series of time-stamped frames, the filtering comprising recording, for at least a portion of the plurality of geo-spatial sensors, a system time and a time of a first recorded time-stamped frame;
generating a missing time-stamped frame by interpolating a first and a second time-stamped frame of the series of time-stamped frames, wherein the first time-stamped frame is associated with a first bucket of the plurality of buckets and the second time-stamped frame is associated with a second bucket of the plurality of buckets;
correlating the sorted data from at least the two or more sensors with the at least one of the plurality of sources, wherein the sorted data includes the missing time-stamped frame; and
storing the correlated data.

10. The computer program product as in claim 9 , wherein filtering of the series of time-stamped frames further comprises:
determining an expected timestamp for arriving frames; and
discarding arriving frames having a timestamp outside a pre-defined time window relative to the expected timestamp.

11. The computer program product as in claim 9 , wherein the sorting comprises:
subdividing, based on a sample rate, a time bar into the plurality of buckets;
assigning, based on time, the series of time-stamped frames into a corresponding bucket of the plurality of buckets; and
interpolating, when an amount of time between two assigned time-stamped frames spans multiple buckets, missing values.

12. The computer program product as in claim 9 , wherein correlating the sorted data for each of the plurality of sources comprises:
assigning, based on transposition using a mapping table, the time-stamped frames in the plurality of buckets to an originating source from the plurality of sources.

13. The computer program product as in claim 9 , wherein the operations further comprise:
providing the sorted data into a pre-processing library prior to storing the correlated data.

14. The computer program product as in claim 9 , wherein the correlated data is stored in an in-memory database.

15. The computer program product as in claim 14 , wherein the in-memory database stores data in a columnwise fashion.

16. A system comprising:
an in-memory database;
at least one data processor; and
memory storing instructions which, when executed by the at least one data processor, result in operations comprising:
receiving data derived from a plurality of geo-spatial sensors, the received data comprising information characterizing a plurality of sources within a zone of interest, the received data comprising a series of time-stamped frames for the plurality of geo-spatial sensors, at least one of the plurality of sources associated with two or more sensors of the plurality of geo-spatial sensors;
sorting, for at least a portion of the plurality of geo-spatial sensors on a sensor-by-sensor basis, the received data into a plurality of buckets using a sliding window, wherein the sorting comprises filtering the series of time-stamped frames based on timestamps associated with the series of time-stamped frames, the filtering comprising recording, for at least a portion of the plurality of geo-spatial sensors, a system time and a time of a first recorded time-stamped frame;
generating a missing time-stamped frame by interpolating a first and a second time-stamped frame of the series of time-stamped frames, wherein the first time-stamped frame is associated with a first bucket of the plurality of buckets and the second time-stamped frame is associated with a second bucket of the plurality of buckets;
correlating the sorted data from at least the two or more sensors with the at least one of the plurality of sources, wherein the sorted data includes the missing time-stamped frame; and
storing the correlated data.

Assignees

• Sap Se

Inventors

• Abraham Torsten
• Foebel Florian
• Gruschko Boris
• Kazmaier Gerrit Simon
• Lahmer Christian
• Licht Nico
• Lieberenz Marcus
• Volker Lars

Classifications

• G06F16/29 Primary

  Geographical information databases · CPC title

• G06F16/86

  Mapping to a database · CPC title

• G06F16/25 Primary

  Integrating or interfacing systems involving database management systems · CPC title