Traffic-based mutation/coverage testing requirements

Patent metadata

Field	Value
Publication number	US-11003572-B2
Application number	US-201916567093-A
Country	US
Kind code	B2
Filing date	Sep 11, 2019
Priority date	Sep 11, 2019
Publication date	May 11, 2021
Grant date	May 11, 2021

Abstract

An approach is provided in which the approach captures usage data corresponding to multiple users accessing a codebase that includes multiple code lines. The approach uses the captured usage data to compute a code line usage weighting for at least one of the code lines. The approach also computes a code line test coverage score for at least one code line based on at least one current software test program that tests the codebase. The approach compares the code line usage weighting against the code line test coverage score and flags the code line based on the comparison.

First claim

The invention claimed is:

1. A method comprising:
capturing usage data corresponding to a plurality of users accessing a codebase comprising a plurality of code lines, wherein the capturing further comprises:
duplicating the codebase;
adding usage tracking logic to the duplicated codebase;
routing a portion of the plurality of users to the duplicated codebase; and
capturing, by the usage tracking logic, the usage data based on the portion of the plurality of users accessing the duplicated codebase;

computing, based on the captured usage data, a code line usage weighting for at least one of the plurality of code lines;
computing a code line test coverage score for the at least one code line based on at least one current software test program that tests the codebase; and
flagging the at least one code line in response to comparing the code line usage weighting against the code line test coverage score.

2. The method of claim 1 wherein the codebase is a microservice and the duplicated codebase is a duplication of the microservice.

3. The method of claim 1 further comprising:
classifying each of the plurality of users as one of a plurality of user types;
assigning a user type weighting to each of the plurality of user types; and
using the assigned user type weighting in the computing of the code line usage weighting.

4. The method of claim 3 further comprising:
generating a heatmap of a set of routes through the codebase based on the usage data, wherein each of the set of routes identify one of the plurality of user types; and
flagging a different one of the plurality of code lines based on the heatmap.

5. The method of claim 1 wherein the flagging indicates that the at least one code line is under tested in response to determining that the code line usage weighting of the at least one code line is greater than the code line test coverage score of the at least one code line.

6. The method of claim 1 wherein the flagging indicates that the at least one code line is over tested in response to determining that the code line usage weighting of the at least one code line is less than the code line test coverage score of the at least one code line.

7. An information handling system comprising:
one or more processors;
a memory coupled to at least one of the processors;
a set of computer program instructions stored in the memory and executed by at least one of the processors in order to perform actions of:
capturing usage data corresponding to a plurality of users accessing a codebase comprising a plurality of code lines, wherein the capturing further comprises:
duplicating the codebase;
adding usage tracking logic to the duplicated codebase;
routing a portion of the plurality of users to the duplicated codebase; and
capturing, by the usage tracking logic, the usage data based on the portion of the plurality of users accessing the duplicated codebase;

computing, based on the captured usage data, a code line usage weighting for at least one of the plurality of code lines;
computing a code line test coverage score for the at least one code line based on at least one current software test program that tests the codebase; and
flagging the at least one code line in response to comparing the code line usage weighting against the code line test coverage score.

8. The information handling system of claim 7 wherein the codebase is a microservice and the duplicated codebase is a duplication of the microservice.

9. The information handling system of claim 7 wherein the processors perform additional actions comprising:
classifying each of the plurality of users as one of a plurality of user types;
assigning a user type weighting to each of the plurality of user types; and
using the assigned user type weighting in the computing of the code line usage weighting.

10. The information handling system of claim 9 wherein the processors perform additional actions comprising:
generating a heatmap of a set of routes through the codebase based on the usage data, wherein each of the set of routes identify one of the plurality of user types; and
flagging a different one of the plurality of code lines based on the heatmap.

11. The information handling system of claim 7 wherein the flagging indicates that the at least one code line is under tested in response to determining that the code line usage weighting of the at least one code line is greater than the code line test coverage score of the at least one code line.

12. The information handling system of claim 7 wherein the flagging indicates that the at least one code line is over tested in response to determining that the code line usage weighting of the at least one code line is less than the code line test coverage score of the at least one code line.

13. A computer program product stored in a computer readable storage medium, comprising computer program code that, when executed by an information handling system, causes the information handling system to perform actions comprising:
capturing usage data corresponding to a plurality of users accessing a codebase comprising a plurality of code lines, wherein the capturing further comprises:
duplicating the codebase;
adding usage tracking logic to the duplicated codebase;
routing a portion of the plurality of users to the duplicated codebase; and
capturing, by the usage tracking logic, the usage data based on the portion of the plurality of users accessing the duplicated codebase;

computing, based on the captured usage data, a code line usage weighting for at least one of the plurality of code lines;
computing a code line test coverage score for the at least one code line based on at least one current software test program that tests the codebase; and
flagging the at least one code line in response to comparing the code line usage weighting against the code line test coverage score.

14. The computer program product of claim 13 wherein the codebase is a microservice and the duplicated codebase is a duplication of the microservice.

15. The computer program product of claim 13 wherein the information handling system performs further actions comprising:
classifying each of the plurality of users as one of a plurality of user types;
assigning a user type weighting to each of the plurality of user types; and
using the assigned user type weighting in the computing of the code line usage weighting.

16. The computer program product of claim 15 wherein the information handling system performs further actions comprising:
generating a heatmap of a set of routes through the codebase based on the usage data, wherein each of the set of routes identify one of the plurality of user types; and
flagging a different one of the plurality of code lines based on the heatmap.

17. The computer program product of claim 13 wherein the flagging indicates that the at least one code line is under tested in response to determining that the code line usage weighting of the at least one code line is greater than the code line test coverage score of the at least one code line.

Assignees

• IBM

Inventors

• Naylor-Teece Alexander John
• Smith Samuel Christopher
• Masters Oliver Paul
• Dunnings Andrew James

Classifications

• G06F11/3698

  Environments for analysis, debugging or testing of software · CPC title

• G06F11/3003

  Monitoring arrangements specially adapted to the computing system or computing system component being monitored · CPC title

• G06F11/3692

  for test results analysis · CPC title

• G06F11/3684

  for test design, e.g. generating new test cases · CPC title

• G06F8/70

  Software maintenance or management · CPC title