Method, electronic device, and computer program product for data stream processing

Patent metadata

Field	Value
Publication number	US-11416498-B2
Application number	US-202017125696-A
Country	US
Kind code	B2
Filing date	Dec 17, 2020
Priority date	Oct 30, 2020
Publication date	Aug 16, 2022
Grant date	Aug 16, 2022

Abstract

Data stream processing is performed. For instance, a method includes: in response to a query request on an input data stream, determining data labels for input data items in the input data stream, the data labels at least indicating a first matching relationship between the input data items and a first query condition of the query request; determining an output data stream corresponding to the input data stream, the output data stream including output data items corresponding to the input data items, and each output data item having a data label; and determining query information corresponding to the query request based on the output data stream. In this way, it is possible to respond to real-time query requests for data streams.

First claim

What is claimed is:

1. A method, comprising:
in response to receiving a registration of a complex continuous query request on an input data stream, continuously determining, by a system comprising a processor, as input data items in the input data stream are received, data labels for the input data items, wherein the data labels indicate at least respective first matching relationships between the input data items and a first query condition of the complex continuous query request;
continuously generating, by the system, as the input data items in the input data stream are received, an output data stream corresponding to the input data stream, wherein the output data stream comprises output data items corresponding to the input data items, and each output data item having the data label of a corresponding input data item; and
continuously generating, by the system, as the input data items in the input data stream are received, query information comprising query results responding to the complex continuous query request based on the output data stream.

2. The method according to claim 1 , wherein the continuously determining the data labels comprises:
determining a first query field corresponding to the complex continuous query request;
acquiring first record data, corresponding to the first query field, in the input data item; and
determining the first matching relationship for the first record data and the first query condition.

3. The method according to claim 2 , wherein the continuously determining the data labels further comprises:
determining a second query condition and a second query field corresponding to the complex continuous query request, the second query condition being different from the first query condition;
acquiring second record data, corresponding to the second query field, in the input data item;
determining a second matching relationship between the input data item and the second query condition based on the second record data and the second query condition; and
determining the data label indicating the first matching relationship and the second matching relationship.

4. The method according to claim 1 , wherein the continuously generating the query information comprises:
filtering the output data stream based on the data labels to determine a target output data item; and
determining the query information corresponding to the query request based on the target output data item.

5. The method according to claim 1 , further comprising:
in response to receiving an additional registration of an additional complex continuous query request on an additional input data stream, continuously determining, by the system, as additional input data items in the additional input data stream are received, additional data labels for the additional input data items, wherein the additional data labels indicate at least third matching relationships between the additional input data items and an additional query condition of the additional complex continuous query request;
continuously generating, by the system, as the additional input data items in the additional input data stream are received, an additional output data stream corresponding to the additional input data stream, wherein the additional output data stream comprises additional output data items corresponding to the additional input data items, and each additional output data item having the additional data label, wherein the additional data label is associated with the additional data label of a corresponding additional input data item; and
continuously merging, by the system, as the additional input data items in the additional input data stream are received, the additional output data stream into the output data stream to determine the query information.

6. The method according to claim 1 , wherein the output data items further comprise record data in the input data items, and the record data is associated with the query information.

7. The method according to claim 1 , wherein the output data items further comprise the input data items.

8. A device, comprising:
a processor; and
a memory coupled to the processor and having instructions stored therein, wherein the instructions, when executed by the processor, cause the device to execute operations, and the operations comprise:
in response to a receiving a registration of a complex continuous query request on an input data stream, continuously determining, as input data items in the input data stream are received, data labels for the input data items, wherein the data labels indicate at least respective first matching relationships between the input data items and a first query condition of the complex continuous query request;
continuously generating, as the input data items in the input data stream are received, an output data stream corresponding to the input data stream, wherein the output data stream comprises output data items corresponding to the input data items, and each output data item having the data label of a corresponding input data item; and
continuously generating, as the input data items in the input data stream are received, query information comprising query results responding to the complex continuous query request based on the output data stream.

9. The device according to claim 8 , wherein the continuously determining the data labels comprises:
determining a first query field corresponding to the complex continuous query request;
acquiring first record data, corresponding to the first query field, in the input data item; and
determining the first matching relationship for the first record data and the first query condition.

10. The device according to claim 9 , wherein the continuously determining the data labels further comprises:
determining a second query condition and a second query field corresponding to the complex continuous query request, the second query condition being different from the first query condition;
acquiring second record data, corresponding to the second query field, in the input data item;
determining a second matching relationship between the input data item and the second query condition based on the second record data and the second query condition; and
determining the data label indicating the first matching relationship and the second matching relationship.

11. The device according to claim 8 , wherein the continuously generating the query information comprises:
filtering the output data stream based on the data labels to determine a target output data item; and
determining the query information corresponding to the query request based on the target output data item.

12. The device according to claim 8 , wherein the operations further comprise:
in response to receiving an additional registration of an additional complex continuous query request on an additional input data stream, continuously determining, as additional input data items in the additional input data stream are received, additional data labels for the additional input data items, wherein the additional data labels indicate at least respective third matching relationships between the additional input data items and an additional query condition of the additional complex continuous query request;
continuously generating, as the additional input data items in the additional input data stream are received, an additional output data stream corresponding to the additional input data stream, wherein the additional output data stream comprises additional output data items corresponding to the additional input data items, and each additional output data item having the additional data label, wherein the additional data l

Assignees

• Emc Ip Holding Co Llc

Inventors

• Lei Lu
• Huang Frank Yifan
• Zhu Julius Jian
• Teng Yu

Classifications

• G06F16/24568 Primary

  Data stream processing; Continuous queries · CPC title

• G06F16/9532

  Query formulation · CPC title

• G06F16/242

  Query formulation · CPC title

• G06F16/24573

  using data annotations, e.g. user-defined metadata · CPC title

• G06F16/248

  Presentation of query results · CPC title