Automated perceptual quality assessment of touchscreen devices

Patent metadata

Field	Value
Publication number	US-9298312-B2
Application number	US-201213997044-A
Country	US
Kind code	B2
Filing date	Feb 15, 2012
Priority date	Jun 30, 2011
Publication date	Mar 29, 2016
Grant date	Mar 29, 2016

Abstract

Methods and systems may provide for receiving a video of an interaction with a touch screen, using a computer vision process to identify a gesture in the video, and determining a response time of the touch screen with respect to the gesture. Moreover, a display area update percentage can be tracked subsequent to a response of the touch screen to the gesture, wherein a frame rate determination may be conducted for the touch screen based on the display area update percentage.

First claim

I claim:

1. A method comprising:
receiving a video of a user interaction with a touch screen;
using a computer vision process to identify a gesture in the video;
detecting a first display update on the touch screen;
determining a response time of the touch screen with respect to the gesture, wherein determining the response time includes counting one or more frames between the gesture and the first display update;
tracking a display area update percentage subsequent to the first display update, wherein the display area update percentage is tracked on a frame-by-frame basis;
conducting a frame rate determination for the touch screen based on the display area percentage update; and
outputting the response time and a result of the frame rate determination.

2. The method of claim 1 , further including deferring the frame rate determination if a second display update has occurred on the touch screen.

3. The method of claim 2 , further including using a no motion counter and a threshold to trigger the frame rate determination.

4. The method of claim 2 , further including detecting the second display update, wherein the first display update and the second display update are detected on a frame-by-frame basis.

5. A computing system comprising:
a non-volatile memory to store a video of a user interaction with a touch screen; and
a chipset including logic to,
receive the video,
use a computer vision process to identify a gesture in the video,
determine a response time of the touch screen with respect to the gesture,
track a display area update percentage subsequent to a response of the touch screen to the gesture,
conduct a frame rate determination for the touch screen based on the display area update percentage, and
output the response time and a result of the frame rate determination.

6. The system of claim 5 , wherein the logic is to count one or more frames between the gesture and a first display output on the touch screen.

7. The system of claim 6 , wherein the logic is to detect the first display output on a frame-by-frame basis.

8. The system of claim 5 , wherein the display area update percentage is to be tracked on a frame-by-frame basis.

9. The system of claim 5 , wherein the logic is to defer the frame rate determination if a second display update has occurred on the touch screen.

10. The system of claim 9 , wherein the logic is to use a no motion counter and a threshold to trigger the frame rate determination.

11. The system of claim 9 , wherein the logic is to detect the second display update on a frame-by-frame basis.

12. A non-transitory computer readable storage medium comprising a set of instructions which, if executed by a processor, cause a computer to:
receive a video of a user interaction with a touch screen;
use a computer vision process to identify a gesture in the video;
determine a response time of the touch screen with respect to the gesture;
track a display area update percentage subsequent to a response of the touch screen to the gesture;
conduct a frame rate determination for the touch screen based on the display area update percentage; and
output the response time and a result of the frame rate determination.

13. The medium of claim 12 , wherein the instructions, if executed, cause a computer to count one or more frames between the gesture and a first display update on the touch screen.

14. The medium of claim 13 , wherein the instructions, if executed, cause a computer to detect the first display update on a frame-by-frame basis.

15. The medium of claim 12 , wherein the display area update percentage is to be tracked on a frame-by-frame basis.

16. The medium of claim 12 , wherein the instructions, if executed, cause a computer to defer the frame rate determination if a second display update has occurred on the touch screen.

17. The medium of claim 16 , wherein the instructions, if executed, cause a computer to use a no motion counter and a threshold to trigger the frame rate determination.

18. The medium of claim 16 , wherein the instructions, if executed, cause a computer to detect the second display update on a frame-by-frame basis.

19. A method comprising:
receiving a video of a user interaction with a touch screen;
using a computer vision process to identify a gesture in the video;
determining a response time of the touch screen with respect to the gesture;
tracking a display area update percentage subsequent to a response of the touch screen to the gesture;
conducting a frame rate determination for the touch screen based on the display area update percentage; and
outputting the response time and a result of the frame rate determination.

20. The method of claim 19 , wherein determining the response time includes counting one or more frames between the gesture and a first display update on the touch screen.

21. The method of claim 20 , further including detecting the first display update on a frame-by-frame basis.

22. The method of claim 19 , wherein the display area update percentage is tracked on a frame-by-frame basis.

23. The method of claim 19 , further including deferring the frame rate determination if a second display update has occurred on the touch screen.

24. The method of claim 23 , further including using a no motion counter and a threshold to trigger the frame rate determination.

25. The method of claim 23 , further including detecting the second display update on a frame-by-frame basis.

Assignees

• Kuznetsov Eugene
• Intel Corp

Inventors

• Kuznetsov Eugene

Classifications

• G09G3/006

  Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays (testing individual LED's G01R31/2635; testing lamps G01R31/44; testing of optical features of LCD displays G02F1/1309) · CPC title

• G06F11/302

  where the computing system component is a software system · CPC title

• G06F3/0418 Primary

  for error correction or compensation, e.g. based on parallax, calibration or alignment · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/041 Primary

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title