Intelligent test case management for system integration testing

Patent metadata

Field	Value
Publication number	US-11042473-B2
Application number	US-201916671734-A
Country	US
Kind code	B2
Filing date	Nov 1, 2019
Priority date	Nov 1, 2019
Publication date	Jun 22, 2021
Grant date	Jun 22, 2021

Abstract

Techniques are provided to implement intelligent test case management for system integration testing in a continuous development and integration environment. For example, a system integration testing (SIT) tool obtains feature information regarding features within a feature space of a computing system and an operational status of the features. The SIT tool obtains a plurality of test cases associated with a given feature of the computing system, wherein each test case is mapped to a set of one or more features within the feature space, which are utilized by the test case to execute a test procedure to test the given feature. The SIT tool selects each test case among the plurality of test cases, which is mapped to features that have an active operational status. The SIT tool executes the selected test cases to test the given feature.

First claim

What is claimed is:

1. A method, comprising:
receiving, by a system integration testing (SIT) tool, a given feature to be tested for integration of the given feature in a computing system;
obtaining, by the SIT tool, feature information which comprises a list of features within a feature space of the computing system and a current operational status of each of the features in the list of features;
accessing, by the SIT tool, a database of test cases to obtain a set of test cases associated with the given feature to be tested, wherein each test case of the set of test cases is mapped to an associated set of one or more features within the feature space of the computing system, wherein the associated set of one or more features of a given test case are utilized by the given test case to execute a test procedure specified by the given test case to test the given feature;
utilizing, by the SIT tool, the obtained feature information to determine, for each test case of the set of test cases, whether each feature of the associated set of one or more features of the test case has an active operational status;
selecting, by the SIT tool, test cases in which each test case is determined to have an associated set of features in which each feature has an active operational status; and
executing, by the SIT tool, the selected test cases to test the given feature.

2. The method of claim 1 , wherein obtaining the feature information comprises accessing, the SIT tool, the feature information from a feature service that is configured to maintain an updated list of all features within the feature space of the computing system, and the operational status of each feature within the feature space of the computing system.

3. The method of claim 1 , wherein a given feature within the feature space of the computing system is deemed active if the given feature is deployed and running in the computing system, and wherein the given feature is deemed inactive if the given feature is one of: (i) deployed and stopped; (ii) deployed and inoperable; (iii) not yet deployed; and (iv) deployed and running, but utilizes at least one other feature that is inactive.

4. The method of claim 1 , wherein obtaining the feature information comprises obtaining a list of all active features within the feature space of the computing system.

5. The method of claim 1 , wherein obtaining the feature information comprises obtaining a list of all features within the feature space of the computing system and an indication of a current operational status of each feature as being active or inactive.

6. The method of claim 1 , wherein obtaining the plurality set of test cases associated with the given feature comprises accessing the database of test cases to obtain test cases that are configured to test functions of the given feature.

7. The method of claim 6 , wherein accessing the database of test cases further comprises obtaining a test case that is configured to test functions of at least one other feature which utilizes the given feature.

8. The method of claim 1 , further comprising generating, by the SIT tool, a test report which specifies a test result for each executed test case and which identifies each test case of the set of test cases that was not selected for execution.

9. The method of claim 1 , further comprising:
identifying, by the SIT tool, a given test case of the plurality set of test cases which is mapped to an inactive feature;
modifying the given feature to be tested by disabling a portion of the given feature which relies on the inactive feature of the given test case to perform a given function; and
executing the modified feature using the given test case.

10. An article of manufacture comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code is executable by one or more processors to implement a method comprising:
receiving, by a system integration testing (SIT) tool, a given feature to be tested for integration of the given feature in a computing system;
obtaining, by the SIT tool, feature information which comprises a list of features within a feature space of the computing system and a current operational status of each of the features in the list of features;
accessing, by the SIT tool, a database of test cases to obtain a set of test cases associated with the given feature to be tested, wherein each test case of the set of test cases is mapped to an associated set of one or more features within the feature space of the computing system, wherein the associated set of one or more features of a given test case are utilized by the given test case to execute a test procedure specified by the given test case to test the given feature;
utilizing, by the SIT tool, the obtained feature information to determine, for each test case of the set of test cases, whether each feature of the associated set of one or more features of the test case has an active operational status;
selecting, by the SIT tool, test cases in which each test case is determined to have an associated set of features in which each feature has an active operational status; and
executing, by the SIT tool, the selected test cases to test the given feature.

11. The article of manufacture of claim 10 , wherein obtaining the feature information comprises accessing, the SIT tool, the feature information from a feature service that is configured to maintain an updated list of all features within the feature space of the computing system, and the operational status of each feature within the feature space of the computing system.

12. The article of manufacture of claim 10 , wherein a given feature within the feature space of the computing system is deemed active if the given feature is deployed and running in the computing system, and wherein the given feature is deemed inactive if the given feature is one of: (i) deployed and stopped; (ii) deployed and inoperable; (iii) not yet deployed; and (iv) deployed and running, but utilizes at least one other feature that is inactive.

13. The article of manufacture of claim 10 , wherein obtaining the feature information comprises obtaining a list of all active features within the feature space of the computing system.

14. The article of manufacture of claim 10 , wherein obtaining the feature information comprises obtaining a list of all features within the feature space of the computing system and an indication of a current operational status of each feature as being active or inactive.

15. The article of manufacture of claim 10 , wherein obtaining the set of test cases associated with the given feature comprises accessing the database of test cases to obtain test cases that are configured to test functions of the given feature.

16. The article of manufacture of claim 15 , wherein accessing the database of test cases further comprises obtaining a test case that is configured to test functions of at least one other feature which utilizes the given feature.

17. The article of manufacture of claim 10 , wherein the program code is executable by the one or more processors to implement a method comprising generating, by the SIT tool, a test report which specifies a test result for each executed test case and which identifies each test case of the set of test cases that was not selected for execution.

18. The article of manufacture of claim 10 , wherein the program code is executable by the one or more processors to implement a method comprising:
identifying, by the SIT tool, a given test case of

Assignees

• Emc Ip Holding Co Llc

Inventors

• Joyce Scott E
• Yuan Dan
• Martin Yingying Wang

Classifications

• G06F11/3698

  Environments for analysis, debugging or testing of software · CPC title

• G06F11/3688 Primary

  for test execution, e.g. scheduling of test suites · CPC title

• G06F16/252 Primary

  between a Database Management System and a front-end application · CPC title

• G06F11/3684

  for test design, e.g. generating new test cases · CPC title

• G06F11/3692

  for test results analysis · CPC title