System and method for large volume data streaming as a service

Patent metadata

Field	Value
Publication number	US-11250202-B2
Application number	US-201916543041-A
Country	US
Kind code	B2
Filing date	Aug 16, 2019
Priority date	Mar 19, 2019
Publication date	Feb 15, 2022
Grant date	Feb 15, 2022

Abstract

A computing system includes a server. The server is communicatively coupled to a data repository and is configured to store a data in the data repository. The server is further configured to configure, via the data stream handler system, the data stream object to transmit a request to an external system. The server is additionally configured to configure, via the data stream handler system, the data stream object to capture a response from the external system, wherein the response comprises a paginated data set, a data stream, or a combination thereof, wherein creating the data stream object, configuring the data stream object to transmit the request, configuring the data stream object to capture the response, or a combination thereof, comprises using visual controls in lieu of entering text for a computer program.

First claim

The invention claimed is:

1. A computing system, comprising:
a server communicatively coupled to a data repository and configured to store a data in the data repository, wherein the server is configured to perform operations comprising:
creating, via a data stream handler system, a data stream object configured to be implemented into a flow that is configured to process a dataset, a data stream, or a combination thereof;
presenting, via the data stream handler system, a selectable feature that, when selected, is configured to enable a selection to paginate the dataset or the data stream;
receiving, via the data stream handler system, the selection to paginate the dataset or the data stream;
in response to receiving the selection to paginate the dataset or the data stream, providing a menu to select a type of pagination, wherein the menu comprises a plurality of types of pagination, and wherein at least one type of the plurality of types of pagination is next page token pagination, next link pagination, or offset pagination;
receiving, via the data stream handler system, a selection of a type of pagination from the menu;
in response to receiving the selection of the type of pagination from the menu, providing a set of options detailing one or more variables for customization based on the type of pagination selected;
configuring, via the data stream handler system, the data stream object to transmit a request including one or more selected options from the set of options to an external system; and
configuring, via the data stream handler system, the data stream object to capture a response to the request from the external system, wherein the response to the request comprises the pagination of the dataset, the pagination of the data stream, or a combination thereof, wherein creating the data stream object, configuring the data stream object to transmit the request, configuring the data stream object to capture the response, or a combination thereof, comprises using visual controls in lieu of entering text for a computer program.

2. The computing system of claim 1 , wherein configuring the data stream object to transmit the request comprises configuring the data stream object to call an application programming interface (API) included in the external system.

3. The computing system of claim 2 , wherein the server is configured to perform operations comprising executing a script in a preprocessor system only once to configure the data stream object to transmit the request.

4. The computing system of claim 3 , wherein at least one of the visual controls is configured to provide for a drag-and-drop operation of a data pill into the script, and wherein the data pill comprises a visual data object resolving to at least one value.

5. The computing system of claim 1 , wherein configuring the data stream object to capture the response comprises configuring a splitter system to receive the response and to extract at least one item from the response.

6. The computing system of claim 5 , wherein configuring the splitter system to receive the response and to extract at least one item from the response comprises applying an XPath, a JavaScript Object Notation JSON Path, or a delimiter system to the response.

7. The computing system of claim 5 , wherein configuring the data stream object to capture the response comprises providing the at least one item to a parser for parsing the at least one item into an object.

8. The computing system of claim 7 , wherein the item comprises an XML item and wherein the object comprises a Visual Designer Flow system object.

9. A method, comprising:
creating, via a data stream handler system, a data stream object configured to be implemented into a flow that is configured to process a dataset or a data stream;
presenting, via the data stream handler system, a selectable feature that, when selected, is configured to enable a selection to paginate the dataset or the data stream;
receiving, via the data stream handler system, the selection to paginate the dataset or the data stream;
in response to receiving the selection to paginate the dataset or the data stream, providing a menu to select a type of pagination, wherein the menu comprises a plurality of types of pagination, and wherein at least one type of the plurality of types of pagination is next page token pagination, next link pagination, or offset pagination;
receiving, via the data stream handler system, a selection of a type of pagination from the menu;
in response to receiving the selection of the type of pagination from the menu, providing a set of options detailing one or more variables for customization based on the type of pagination selected;
configuring, via the data stream handler system, the data stream object to transmit a request including one or more selected options from the set of options to an external system; and
configuring, via the data stream handler system, the data stream object to capture a response to the request from the external system, wherein the response to the request comprises the pagination of the dataset, the pagination of the data stream, or a combination thereof, wherein creating the data stream object, configuring the data stream object to transmit the request, configuring the data stream object to capture the response, or a combination thereof, comprises using visual controls in lieu of entering text for a computer program.

10. The method of claim 9 , wherein configuring the data stream object to capture the response comprises configuring a splitter system to receive the response and to extract at least one item from the response.

11. The method of claim 10 , wherein configuring the data stream object to capture the response comprises providing the at least one item to a parser for parsing the at least one item into an object.

12. The method of claim 11 , wherein the item comprises an XML item and wherein the object comprises a Visual Designer Flow system object.

13. A non-transitory, computer-readable medium storing instructions executable by a processor of a computing system, the instructions configured to:
create, via a data stream handler system, a data stream object configured to be implemented into a flow that is configured to process a dataset or a data stream;
present, via the data stream handler system, a selectable feature that, when selected, is configured to enable a selection to paginate the dataset or the data stream;
receive, via the data stream handler system, the selection to paginate the dataset or the data stream;
in response to receiving the selection to paginate the dataset or the data stream, provide a menu to select a type of pagination, wherein the menu comprises a plurality of types of pagination, and wherein at least one type of the plurality of types of pagination is next page token pagination, next link pagination, or offset pagination;
receiving, via the data stream handler system, a selection of a type of pagination from the menu;
in response to receiving the selection of the type of pagination from the menu, provide a set of options detailing one or more variables for customization based on the type of pagination selected;
configure, via the data stream handler system, the data stream object to transmit a request including one or more selected options from the set of options to an external system; and
configure, via the data stream handler system, the data stream object to capture a response to the request from the external system, wherein the response to the request comprises the pagination of the dataset, the pagination of the data stream, or a combination thereof, wherein creating the data stream ob

Assignees

• Servicenow Inc

Inventors

• Nerius Joshua Timothy
• Koya Venkata Kiran Kumar
• Bhogle Deepti Suryakant
• Courtney Pierce Edward
• Stark Nicholas Michael
• Nelson Harry Thomas

Classifications

• G06F40/186

  Templates · CPC title

• G06F3/0486

  Drag-and-drop · CPC title

• G06F40/114 Primary

  Pagination · CPC title

• G06F40/205

  Parsing · CPC title