Emulating a user performing spatial gestures

Patent metadata

Field	Value
Publication number	US-10162737-B2
Application number	US-201415114070-A
Country	US
Kind code	B2
Filing date	Feb 20, 2014
Priority date	Feb 20, 2014
Publication date	Dec 25, 2018
Grant date	Dec 25, 2018

Abstract

Examples disclosed herein provide tools for capturing spatial gestures performed by a user and scripting the gestures for testing an application under test. Scripts may be produced by capturing movement of extremities of a skeletal body corresponding to the user, wherein the movement is captured according to a change in coordinates of the extremities from an original position. The movement of the extremities may be matched to a predefined gesture found in a gesture database. A script may be generated from the matched predefined gesture with reference to the extremities captured and coordinates of the extremities from the original position, such that the user is emulated.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
capturing movement of extremities of a skeletal body corresponding to a user, wherein capturing the movement of extremities comprises determining a velocity and a distance of a change in coordinates of the extremities from an original position;
matching the captured movement of extremities to a predefined gesture found in a gesture database;
applying the matched predefined gesture to the captured movement of extremities;
applying an offset to the matched predefined gesture to emulate the captured movement of extremities from the original position, wherein applying the offset includes adding the coordinates of the extremities from the original position to coordinates of the predefined gesture; and
generating a script from the matched predefined gesture that is applied to the captured movement of extremities and that the offset is applied to; and
executing the script to emulate the captured movement of the user for a software application under testing, wherein executing the script comprises modifying the matched predefined gesture to correspond to a playback velocity and a playback distance.

2. The method of claim 1 , wherein applying the offset to the predefined gesture comprises:
multiplying coordinates of the predefined gesture by −1 to generate coordinates for opposite extremities; and
adding the coordinates of the extremities from the original position to the coordinates for the opposite extremities.

3. A system, comprising:
a processing resource; and
a storage device storing instructions that when executed cause the processing resource to:
capture movement of extremities of a skeletal body corresponding to a user, wherein capturing the movement of extremities comprises determining a velocity and a distance of a change in coordinates of the extremities from an original position;
match the captured movement of extremities to a predefined gesture found in a gesture database;
apply the matched predefined gesture to the captured movement of extremities;
apply an offset to the matched predefined gesture to emulate the captured movement of extremities from the original position, wherein applying the offset includes adding the coordinates of the extremities from the original position to coordinates of the predefined gesture; and
generate a script from the matched predefined gesture that is applied to the captured movement of extremities and that the offset is applied to; and
execute the script to emulate the captured movement of the user for a software application under testing, wherein to execute the script the matched predefined gesture is modified to correspond to a playback velocity and a playback distance.

4. A memory resource storing instructions that when executed cause a processing resource to:
capture movement of extremities of a skeletal body corresponding to a user, wherein capturing the movement of extremities comprises determining a velocity and a distance of a change in coordinates of the extremities from an original position;
match the captured movement of extremities to a predefined gesture found in a gesture database;
apply the matched predefined gesture to the captured movement of extremities;
apply an offset to the matched predefined gesture to emulate the captured movement of extremities from the original position, wherein applying the offset includes adding the coordinates of the extremities from the original position to coordinates of the predefined gesture; and
generate a script from the matched predefined gesture that is applied to the captured movement of extremities and that the offset is applied to; and
execute the script to emulate the captured movement of the user for a software application under testing, wherein to execute the script the matched predefined gesture is modified to correspond to a playback velocity and a playback distance.

Assignees

• Hewlett Packard Entpr Dev Lp
• Entit Software Llc

Inventors

• Nuriel Roy
• Retyk Pablo
• Levi Doron

Classifications

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F11/36

  Prevention of errors by analysis, debugging or testing of software · CPC title

• G06F9/44

  Arrangements for executing specific programs · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F9/44589

  Program code verification, e.g. Java bytecode verification, proof-carrying code (high-level semantic checks G06F8/43; prevention of errors by analysis, debugging or testing of software G06F11/36) · CPC title