System and method for end to end performance response time measurement based on graphic recognition

Patent metadata

Field	Value
Publication number	US-2018196742-A1
Application number	US-201815915866-A
Country	US
Kind code	A1
Filing date	Mar 8, 2018
Priority date	Mar 30, 2016
Publication date	Jul 12, 2018
Grant date	—

Abstract

Software testing techniques based on image recognition are disclosed. In various embodiments, a programmatically implemented image classifier is trained to recognize a screen shot image as being associated with a transaction end condition of a transaction. A test script configured to initiate an iteration of the transaction is run. A start time of the iteration of the transaction is recorded. Screen shot images are generated during performance of the iteration of the transaction to capture a series of screen shot images of at least a portion of a user interface display associated with the iteration of the transaction. The image classifier is used to find an earliest-captured image that matches the transaction end condition. A time associated with the matched image is used as a transaction end time to compute an end-to-end time to perform the iteration of the transaction.

First claim

What is claimed is:

1 . A computer program product to perform software testing, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
initiating a performance test iteration of a transaction; recording a start time of the performance test iteration of the transaction; capturing screen shot images of at least a portion of a user interface during performance of the performance test iteration of the transaction, each screen shot image having an associated timestamp; processing the screen shot images with an image classifier trained to detect at least a portion of a screen image that is associated with an end of transaction condition to identify a screen shot image from the screen shot images that matches the end of transaction condition; using a time from the timestamp associated with the identified screen shot image as a transaction end time to compute an end-to-end time to perform the performance test iteration of the transaction; and updating test results for the transaction with the end-to-end time.

2 . The computer program product of claim 1 , wherein the image classifier comprises a Haar image classifier.

3 . The computer program product of claim 1 , wherein the image classifier comprises an OpenCV image classifier.

4 . The computer program product of claim 1 , further comprising instructions for training the image classifier to recognize the at least the portion of the screen image as being associated with the end of transaction condition, wherein training the image classifier includes initiating a training iteration of the transaction and receiving an indication of a screen shot of a result end of transaction display for the training iteration.

5 . The computer program product of claim 1 , wherein the screen shot images are captured at a fixed interval.

6 . The computer program product of claim 5 , wherein the timestamp associated with the identified screen shot image comprises a timestamp of an image file for the identified screen shot image.

7 . The computer program product of claim 1 , wherein the end-to-end time is computed by subtracting the start time of the performance test iteration of the transaction from the end time.

8 . The computer program product of claim 1 , wherein the image classifier is trained to recognize a characteristic element comprising an end of transaction display page.

9 . The computer program product of claim 1 , wherein the performance test iteration of the transaction is initiated by a test script.

10 . A software testing system, comprising:
a processor; and a computer readable storage medium comprising instructions executable by the processor to:
initiate a performance test iteration of a transaction;
record a start time of the performance test iteration of the transaction;
capture screen shot images of at least a portion of a user interface during performance of the performance test iteration of the transaction, each screen shot image having an associated timestamp;
process the screen shot images with an image classifier trained to detect at least a portion of a screen image that is associated with an end of transaction condition to identify a screen shot image from the screen shot images that matches the end of transaction condition;
use a time from the timestamp associated with the identified screen shot image as a transaction end time to compute an end-to-end time to perform the performance test iteration of the transaction; and
update test results for the transaction with the end-to-end time.

11 . The system of claim 10 , wherein the image classifier comprises a Haar image classifier.

12 . The system of claim 10 , wherein the image classifier comprises an OpenCV image classifier.

13 . The system of claim 10 , further comprising instructions executable by the processor to initiate a training iteration of the transaction and receive an indication of a screen shot of a result end of transaction display for the training iteration.

14 . The system of claim 10 , wherein the screen shot images are captured at a fixed interval.

15 . The system of claim 14 , wherein the timestamp associated with the identified screen shot image comprises a timestamp of an image file for the identified screen shot image.

16 . The system of claim 10 , wherein the end-to-end time is computed by subtracting the start time of the performance test iteration of the transaction from the end time.

17 . The system of claim 10 , wherein the image classifier is trained to recognize a characteristic element comprising an end of transaction display page.

18 . The system of claim 10 , wherein the performance test iteration of the transaction is initiated by a test script.

Assignees

• Open Text Corp

Inventors

• Yuan Hong
• Nie Xiaochen
• Cheng Tingxian
• Wang Yujia
• Liu Xia
• Chen Chao

Classifications

• G06F11/3696 Primary

  Methods or tools to render software testable · CPC title

• G06V30/19173

  Classification techniques · CPC title

• G06N20/00 Primary

  Machine learning · CPC title

• G06F18/24

  Classification techniques · CPC title

• G06F18/24133

  Distances to prototypes · CPC title