Runtime class recompilation during mutation testing

Patent metadata

Field	Value
Publication number	US-11237952-B1
Application number	US-202117225027-A
Country	US
Kind code	B1
Filing date	Apr 7, 2021
Priority date	Apr 7, 2021
Publication date	Feb 1, 2022
Grant date	Feb 1, 2022

Abstract

The present disclosure provides a mutation test manager configured to initialize multiple computing threads configuring a computing host to perform parallel computation; mutate class files within context of each computing thread; recompile mutated class files independently in each respective computing thread to generate heterogeneous mutants; and execute pending unit tests against heterogeneous mutants independently in each respective computing thread. Consequently, the mutation testing process is decoupled from computational bottlenecks which would result from linear, sequential generation, compilation, and testing of each mutation, especially in the context of JVM® programming languages configured to generate class-rich object code.

First claim

What is claimed is:

1. A method, comprising:
mutating, by a processor running a first computing thread among a plurality of computing threads each executing target object code in a target runtime environment, part of a class file of target source code, wherein part of the class file or a different class file of the target source code is being mutated substantially concurrently, by the processor or by a different processor, in at least one other computing thread of the plurality of computing threads, and the part of the class file of the target source code is being mutated, by the processor or by a different processor, in the at least one other computing thread in a manner heterogeneous to the mutation of the part of the class file of the target source code in the first computing thread;
causing, by the processor, a compiler executing in the first computing thread to compile the class file of the target source code containing the mutation without compiling other class files of the target source code, resulting in generating a mutant class object code; and
replacing, by the processor, a non-mutant object class code of the executing target object code with the mutant class object code.

2. The method of claim 1 , further comprising writing, by the processor, the target source code to non-volatile storage including the class file containing the mutation before configuring the compiler.

3. The method of claim 1 , wherein mutating part of the class file comprises mutating a line of code of the class file.

4. The method of claim 1 , wherein mutating part of the class file is performed in accordance with one of a plurality of mutation patterns of a mutation configuration.

5. The method of claim 1 , wherein the compiler is configured by the processor executing a compiler script including a parameterized call to the compiler.

6. The method of claim 5 , wherein the compiler script configures a compiler target of the compiler as a Dynamic Code Evolution Virtual Machine (“DCEVM”).

7. The method of claim 1 , further comprising executing, by the processor in the first computing thread, pending unit tests among a test suite against the executing target object code after replacing the non-mutant object class code.

8. The method of claim 7 , wherein the compiler is further configured by the processor to run a test class tear down method before the pending unit tests are executed.

9. A computing host comprising:
one or more processors; and
memory communicatively coupled to the one or more processors, the memory storing computer-executable modules executable by the one or more processors that, when executed by the one or more processors, perform associated operations, the computer-executable modules comprising:
a compiler module; and
a mutation test managing module further comprising computer-executable submodules executable by the one or more processors that, when executed by the one or more processors, perform associated operations, the computer-executable submodules comprising:
a class file mutating submodule configured to mutate, in a first computing thread among a plurality of computing threads each executing target object code in a target runtime environment, part of a class file of target source code; to mutate part of the class file or a different class file of the target source code substantially concurrently among the plurality of computing threads; and to mutate the part of the class file of the target source code among the plurality of computing threads in a heterogeneous manner in each respective computing thread;
a compiler configuring submodule configured to configure the compiler module executing in the first computing thread to compile the class file of the target source code containing the mutation without compiling other class files of the target source code, resulting in generating a mutant class object code; and
a class loading submodule configured to replace a non-mutant object class code of the executing target object code with the mutant class object code.

10. The computing host of claim 9 , wherein the mutation test managing module further comprises a class file read/write submodule configured to write the target source code to non-volatile storage including the class file containing the mutation before the compiler configuring submodule configures the compiler.

11. The computing host of claim 9 , wherein the class file mutating submodule is configured to mutate part of the class file by mutating a line of code of the class file.

12. The computing host of claim 9 , wherein the class file mutating submodule is configured to mutate part of the class file in accordance with one of a plurality of mutation patterns of a mutation configuration.

13. The computing host of claim 9 , wherein the compiler configuring submodule is configured to configure the compiler by executing a compiler script including a parameterized call to the compiler.

14. The computing host of claim 13 , wherein the compiler script configures a compiler target of the compiler as a Dynamic Code Evolution Virtual Machine (“DCEVM”).

15. The computing host of claim 9 , wherein the computer-executable submodules further comprise a test executing submodule configured to execute, in the first computing thread, pending unit tests among a test suite against the executing target object code after the class loading submodule replaces the non-mutant object class code.

16. The computing host of claim 15 , wherein the compiler configuring submodule is further configured to configure the compiler to run a test class tear down method before the test executing submodule executes the pending unit tests.

17. A computer-readable storage medium storing computer-readable instructions executable by one or more processors, that when executed by the one or more processors, cause the one or more processors to perform operations comprising:
mutating, in a first computing thread among a plurality of computing threads each executing target object code in a target runtime environment, wherein part of a class file of target source code, part of the class file or a different class file of the target source code being mutated substantially concurrently in at least one other computing thread of the plurality of computing threads, and the part of the class file of the target source code being mutated in the at least one other computing thread in a manner heterogeneous to the mutation of the part of the class file of the target source code in the first computing thread;
configuring a compiler executing in the first computing thread to compile the class file of the target source code containing the mutation without compiling other class files of the target source code, resulting in generating a mutant class object code; and
replacing a non-mutant object class code of the executing target object code with the mutant class object code.

18. The computer-readable storage medium of claim 17 , wherein the operations further comprise writing the target source code to non-volatile storage including the class file containing the mutation before configuring the compiler.

19. The computer-readable storage medium of claim 17 , wherein mutating part of the class file comprises mutating a line of code of the class file.

20. The computer-readable storage medium of claim 17 , wherein mutating part of the class file is performed in accordance with one of a plurality of mutation patterns of a mutation configuration.

21. The computer-readable storage medium of claim 17 , wherein t

Assignees

• State Farm Mutual Automobile Insurance Co

Inventors

• Pearson Andrew L
• Shepherd Nate

Classifications

• G06F11/3692

  for test results analysis · CPC title

• G06F11/3688 Primary

  for test execution, e.g. scheduling of test suites · CPC title

• G06F8/41 Primary

  Compilation · CPC title

• G06F8/315

  Object-oriented languages · CPC title

• G06F8/447

  Target code generation · CPC title