Performance testing of software applications

Patent metadata

Field	Value
Publication number	US-9529701-B2
Application number	US-201414519461-A
Country	US
Kind code	B2
Filing date	Oct 21, 2014
Priority date	Jun 13, 2014
Publication date	Dec 27, 2016
Grant date	Dec 27, 2016

Abstract

Identifying performance issues in an application under test (AUT). The AUT executes on a system under test (SUT) in a test environment, and uses one or more context parameters of the SUT and/or the test environment. A rule engine identifies performance antipatterns in trace data generated by the AUT when executing a set of test suites, based on a set of performance antipattern definition rules, each performance antipattern associated with one or more context parameters. One or more performance test suites are identified that cause the AUT to use at least one of the one or more context parameters associated with the identified antipatterns. The list of identified performance test suites is ranked, based on respective priority values associated with each identified antipattern.

First claim

What is claimed is:

1. A method for identifying performance issues in an application under test (AUT), the AUT executing on a system under test (SUT) in a test environment, the AUT using one or more context parameters of the SUT and/or the test environment, the method comprising:
identifying, by a computer, performance antipatterns in trace data generated by the AUT when executing a set of test suites based on a set of performance antipattern definition rules, each performance antipattern associated with one or more context parameters;
identifying, by the computer, one or more performance test suites that cause the AUT to use at least one of the one or more context parameters associated with the identified antipatterns;
ranking, by the computer, the list of identified performance test suites based on respective priority values associated with each identified antipattern the priority values are based on a heuristic approach including assessing severity of an impact to performance of the AUT and/or the SUT or severity of the impact to AUT software code maintainability; and
performing, by the computer, at least one test suite in the list of identified performance test suites first based on a highest priority value from the priority values in the ranking.

2. A method in accordance with claim 1 , wherein the one or more context parameters includes one or more of: memory, CPU processing time, storage, sensors, devices, communication interfaces, battery, touchscreen, display screen WiFi, ad hoc network, near field communication, GPS, accelerometer, camera, thermometer, hygrometer, barometer.

3. A method in accordance with claim 1 , wherein identifying performance antipatterns in trace data generated by the AUT when executing a set of test suites further comprises identifying, by the computer, performance antipatterns in trace data generated by the AUT when executing a set of performance test suites based on a set of performance antipattern definition rules, each performance antipattern associated with one or more context parameters.

4. A method in accordance with claim 1 , wherein identifying performance antipatterns in trace data generated by the AUT when executing a set of test suites further comprises identifying, by the computer, performance antipatterns in trace data generated by the AUT when executing a set of functional test suites, based on a set of performance antipattern definition rules, each performance antipattern associated with one or more context parameters.

5. A method in accordance with claim 1 , wherein ranking the list of identified performance test suites further comprises ranking, by the computer, the list of identified performance test suites, based on the number of occurrences of one or more context parameters associated with the identified antipatterns that are also associated with one or more performance test suites.

Assignees

• IBM

Inventors

• Ekambaram Vijay
• Nandakumar Vikrant
• Rajput Nitendra

Classifications

• G06F11/3698

  Environments for analysis, debugging or testing of software · CPC title

• G06F11/3414

  Workload generation, e.g. scripts, playback · CPC title

• G06F11/3616

  using software metrics · CPC title

• G06F11/3604

  Analysis of software for verifying properties of programs (testing of software G06F11/3668) · CPC title

• G06F11/3688 Primary

  for test execution, e.g. scheduling of test suites · CPC title