Distributed dynamic architecture for error correction

Patent metadata

Field	Value
Publication number	US-10868895-B2
Application number	US-201816147168-A
Country	US
Kind code	B2
Filing date	Sep 28, 2018
Priority date	Nov 16, 2017
Publication date	Dec 15, 2020
Grant date	Dec 15, 2020

Abstract

Various systems and methods may be used to implement a software defined industrial system. For example, an orchestrated system of distributed nodes may run an application, including modules implemented on the distributed nodes. The orchestrated system may include an orchestration server, a first node executing a first module, and a second node executing a second module. In response to the second node failing, the second module may be redeployed to a replacement node (e.g., the first node or a different node). The replacement mode may be determined by the first node or another node, for example based on connections to or from the second node.

First claim

What is claimed is:

1. An orchestrated system of distributed nodes running an application, the orchestrated system comprising:
a first node executing a first module with a first output; and
a second node executing a second module, the second module using the first output as an input, and providing a second output to a third module executing on a third node;
wherein, in response to detection of a failure of the second node, the first node and the third node are configured to coordinate to identify a fourth node as a replacement node for redeploying the second module, wherein the fourth node is different from the second node, and wherein the second node is further configured to send parameters and state information about the second module to the fourth node before the failure.

2. The orchestrated system of claim 1 , wherein the replacement node is a redundant node preconfigured to receive the first output and operate the second module.

3. The orchestrated system of claim 2 , wherein the redundant node is not connected to provide output to any nodes until after the redundant node is operating as the replacement node.

4. The orchestrated system of claim 2 , wherein the second node is configured to periodically send parameters and state information about the second module to the redundant node.

5. The orchestrated system of claim 2 , wherein in response to the redundant node failing, a second redundant node is designated as the replacement node.

6. The orchestrated system of claim 1 , wherein the first node is configured to save a redundant state of the second module when the first output is generated.

7. The orchestrated system of claim 1 , wherein when coordinating, the first node and the third node are configured to determine a set of nodes connected to the second node.

8. The orchestrated system of claim 1 , wherein the replacement node is configured to connect to the first node to receive output from the first module and to connect to the third node to provide output from the second module to the third module.

9. The orchestrated system of claim 1 , wherein the configuration of the first, second, and third modules on the first, second, and third nodes is initially generated by an orchestration server, and wherein the orchestration server is configured to be disconnected from the first node, the second node, and the third node.

10. The orchestrated system of claim 1 , wherein the second node is implemented on a virtual machine and wherein the second module is instantiated in the replacement node based on an image of the second node on the virtual machine.

11. The orchestrated system of claim 1 , wherein the first node is selected as a leader node using a leader-election algorithm.

12. A method of running an application using distributed nodes of an orchestrated system, the method comprising:
executing a first module on a first node, the first module having a first output;
executing a second module on a second node, the second module using the first output as an input;
providing a second output from the second module to a third module executing on a third node;
in response to detection of a failure of the second node, identifying a fourth node as a replacement node for redeploying the second module by coordinating between the first node and the third node, wherein the fourth node is different from the second node; and
sending parameters and state information about the second module from the second node to the fourth node before the failure.

13. The method of claim 12 , wherein determining the replacement node includes identifying a redundant node preconfigured to receive the first output and operate the second module.

14. The method of claim 13 , wherein the redundant node is not connected to provide output to any nodes until after the redundant node is operating as the replacement node.

15. The method of claim 13 , further comprising periodically sending parameters and state information about the second module from the second node to the redundant node.

16. The method of claim 13 , wherein in response to the redundant node failing, designating a second redundant node as the replacement node.

17. The method of claim 12 , further comprising, at the first node, saving a redundant state of the second module when the first output is generated.

18. The method of claim 12 , wherein determining the replacement node includes determining a set of nodes connected to the second node.

19. The method of claim 16 , further comprising connecting the replacement node to the first node to receive output from the first module and connecting the replacement node to the third node to provide output from the second module to the third module.

20. The method of claim 12 , further comprising initially generating a configuration of the first, second, and third modules on the first, second, and third nodes using an orchestration server, and further comprising disconnecting the orchestration server from the first node, the second node, and the third node before the second node fails.

21. The method of claim 12 , further comprising implementing the second node on a virtual machine and further comprising instantiating the second module in the replacement node based on an image of the second node on the virtual machine.

22. The method of claim 12 , further comprising selecting the first node as a leader node using a leader-election algorithm.

Assignees

• Intel Corp

Inventors

• Wouhaybi Rita H
• Chavez Robert
• Yarvis Mark
• Vicente John
• Smith Kirk

Classifications

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title

• H04L69/40 Primary

  for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection (management of faults, events, alarms or notifications in data switching networks H04L41/06) · CPC title

• H04L67/565

  Conversion or adaptation of application format or content (adding application control or application functional data H04L67/561) · CPC title

• H04L41/0895

  Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements · CPC title

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title