Cognitive service request construction

Patent metadata

Field	Value
Publication number	US-11487603-B2
Application number	US-201715494530-A
Country	US
Kind code	B2
Filing date	Apr 23, 2017
Priority date	Apr 23, 2017
Publication date	Nov 1, 2022
Grant date	Nov 1, 2022

Abstract

An embodiment includes a method for use in managing a system comprising one or more computers, each computer comprising at least one hardware processor coupled to at least one memory. The method comprises a computer-implemented manager: detecting that the system is in an unhealthy state; determining a set of one or more possible actions to remedy the unhealthy state of the system; selecting at least one action of the set of one or more possible actions; and constructing a service request implementing the selected at least one action; wherein at least one of the detecting, determining, selecting, and constructing is based at least in part on applying a reinforcement learning algorithm.

First claim

What is claimed is:

1. An apparatus for use in managing a system comprising one or more computers, each computer comprising at least one hardware processor coupled to at least one memory, the apparatus comprising:
a memory storing instructions; and at least one processor coupled with the memory, the processor configured to execute the instructions to perform method steps comprising:
detecting that the system is at risk of shutdown due to memory usage exceeding a threshold, based at least in part on a real-time assessment of an operating context of the system and a cognitive state of a user;
determining, using a reinforcement learning algorithm, a set of possible actions to remedy the risk of shutdown of the system due to memory usage exceeding the threshold, the set of possible actions including adding memory, adding a file system, adding a processor, and deleting log files;
identifying at least one resource, comprising a node and at least one corresponding application, relevant to the detected risk of shutdown of the system;
displaying at least one form template corresponding to the at least one identified resource, wherein the form template is selected, created and/or modified based on learning which content items and configuration parameters are best to display for a specific cohort, based at least in part on the real-time assessment of an operating context of the system and the cognitive state of the user;
identifying one or more possibly affected properties of the at least one relevant resource;
based on the identified one or more properties, displaying at least one content item within the form template;
selecting at least one action of the set of possible actions;
wherein selecting at least one action of the set of one or more possible actions comprises:
displaying one or more content items associated with the at least one action; and
obtaining one or more selections by the user of respective configuration parameters for the one or more content items associated with the at least one action;

constructing a service request implementing the selected at least one action to remedy the risk of shutdown of the system, wherein the service request is constructed based on a user interface displaying the form template, and wherein constructing the service request comprises populating the form template with one or more configuration parameters corresponding to the one or more content items; and
based at least in part on the constructed service request, to implement the selected at least one action to remedy the risk of shutdown of the system, by carrying out, on the computer system, at least a corresponding one of adding the memory, adding the file system, adding the processor, and deleting the log files;
wherein:
the at least one processor is operative to determine the set of one or more possible actions by computing one or more risk values each corresponding to each respective one of the set of possible actions, wherein one or more reward signals of the reinforcement learning algorithm are inversely proportional to the one or more risk values; and
the at least one processor is operative to select at least one action by selecting the at least one action based at least in part on the computed one or more risk values corresponding to respective ones of the set of possible actions, by selecting a next highest risk action above a lowest risk action when a lowest risk action has a hardware precondition which cannot be met.

2. The apparatus of claim 1 , wherein selecting the at least one action comprises determining a sequence of actions wherein the sequence of actions collectively maximizes reward value although at least one action of the sequence does not individually maximize reward value.

3. The apparatus of claim 1 , wherein computing the one or more risk values comprises determining an overall impact function for the set of possible actions, wherein the impact function is determined based on at least one of:
an expectation over values of a vector of observations stochastically drawn from a population; and
a probability measure over the event space of the vector of observations, parameterized by a fixed state of the system.

4. The apparatus of claim 3 , wherein computing the one or more risk values further comprises optimizing the impact function based at least on assumed additivity thereof.

5. The apparatus of claim 4 , wherein computing the one or more risk values further comprises solving the optimized impact function at least in part using dynamic programming.

6. The apparatus of claim 1 , wherein the set of possible actions further comprises applying a patch to a distributed application.

7. The apparatus of claim 1 , wherein the reinforcement learning algorithm utilizes one or more data sources comprising at least one of: web forum discussions, chat sessions, and documentation.

8. The apparatus of claim 1 , wherein computing the one or more risk values each corresponding to each respective one of the set of possible actions comprises applying:
R (θ,δ)= E θ L (θ,δ( X ))=∫ x L (θ,δ( X )) dP θ ( X )

where:
θ is a fixed state of nature;
X is a vector of observations stochastically drawn from a population;
δ is a decision rule over which the risk function is calculated;
L is a loss function;
E θ is an expectation over all population values of X; and
dP θ is a probability measure over an event space of X, parametrized by θ.

9. A computer program product for use in managing a system comprising one or more computers, each computer comprising at least one hardware processor coupled to at least one memory, the computer program product comprising a machine-readable storage medium having machine-readable program code embodied therewith, said machine-readable program code comprising machine-readable program code configured to:
detect that the system is at risk of shutdown due to memory usage exceeding a threshold, based at least in part on a real-time assessment of an operating context of the system and a cognitive state of a user;
determine, using a reinforcement learning algorithm, a set of possible actions to remedy the risk of shutdown of the system due to memory usage exceeding the threshold, the set of possible actions including adding memory, adding a file system, adding a processor, and deleting log files;
identify at least one resource, comprising a node and at least one corresponding application, relevant to the detected risk of shutdown of the system;
display at least one form template corresponding to the at least one identified resource, wherein the form template is selected, created and/or modified based on learning which content items and configuration parameters are best to display for a specific cohort, based at least in part on the real-time assessment of an operating context of the system and the cognitive state of the user;
identify one or more possibly affected properties of the at least one relevant resource;
based on the identified one or more properties, display at least one content item within the form template;
select at least one action of the set of possible actions;
wherein selecting at least one action of the set of one or more possible actions comprises:
displaying one or more content items associated with the at least one action; and
obtaining one or more selections by the user of respective configuration parameters for the one or more content items associated with the at least one action;

construct a service request implementing the selected at least one action to remedy the risk of shutdown of the system, wherein the service request is constructed based on a user interface displaying the form template, and wherein constructing the service request comprises p

Assignees

• IBM

Inventors

• Kalia Anup
• Hwang Jinho
• Vukovic Maja
• Wu Frederick Y

Classifications

• G06N7/01

  Probabilistic graphical models, e.g. probabilistic networks · CPC title

• G06F11/0751

  Error or fault detection not based on redundancy (power supply failures G06F1/30; network fault management H04L41/06) · CPC title

• G06F11/0793

  Remedial or corrective actions (recovery from an exception in an instruction pipeline G06F9/3861; by retry G06F11/1402; for recovering from a failure of a protocol instance or entity H04L69/40) · CPC title

• G06N20/00

  Machine learning · CPC title

• G06F11/079 Primary

  Root cause analysis, i.e. error or fault diagnosis (in a hardware test environment G06F11/22; in a software test environment G06F11/36) · CPC title