Gestures visual builder tool

Patent metadata

Field	Value
Publication number	US-2017192514-A1
Application number	US-201514985775-A
Country	US
Kind code	A1
Filing date	Dec 31, 2015
Priority date	Dec 31, 2015
Publication date	Jul 6, 2017
Grant date	—

Abstract

A system for creating hand gestures representations, comprising:
(a) An interface for interacting with a user. (b) A storage storing a plurality of discrete pose values and discrete motion values. (c) A memory storing a gesture visual builder code. (d) One or more processors coupled to the interface, storage and memory to execute the gesture visual builder code allowing the user to create hand gesture. The gesture visual builder code comprising:
(1) Code instructions to present the user with a GUI which displays a hierarchical menu driven interface. (2) Code instructions to receive iteratively user instructions from the user using the hierarchical menu driven interface, for creating a logical sequence of hand gesture by defining one or more hand pose features records and hand motion features records. (3) Code instructions to generate a code segment defining the one or more hand pose/motion features records through the discrete pose/motion values respectively.

First claim

What is claimed is:

1 . A system for creating hand gestures representations, comprising:
an interface for interacting with a user; a storage storing a plurality of discrete pose values and a plurality of discrete motion values; a memory for storing a gesture visual builder code; at least one processor coupled to said interface, said storage and said memory to execute said gesture visual builder code to allow said user to create at least one hand gesture, said gesture visual builder code comprising:
code instructions to present a graphical user interface (GUI) to said user, said GUI displays a hierarchical menu driven interface;
code instructions to receive iteratively a plurality of user instructions indicated by said user using said hierarchical menu driven interface, for creating a logical sequence of at least one hand gesture by defining at least one of a plurality of hand pose features records and a plurality of hand motion features records; and
code instructions to generate a code segment which defines said at least one hand pose features record through at least one of said plurality of discrete pose values and said at least one hand motion features record through at least one of said plurality of discrete motion values.

2 . The system of claim 1 , wherein each of said discrete pose values is indicative of a corresponding one of a plurality of hand pose features and each of said discrete motion values is indicative of a corresponding one of a plurality of hand motion features.

3 . The system of claim 2 , wherein said hand pose feature is a member selected from a group consisting of: active hand, palm direction, palm rotation, flexion of at least one finger, direction of at least one finger, relative location between at least two fingers and tangency between at least two fingers.

4 . The system of claim 2 , wherein said hand motion feature is a member selected from a group consisting of: motion properties and motion script, said motion script defines at least one of: hand motion and motion of at least one finger.

5 . The system of claim 1 , wherein said logical sequence which represents said at least one hand gesture is defined by a unique finite state machine model.

6 . The system of claim 1 , further comprising said code segment conforms to a gesture application user interface (API).

7 . The system of claim 1 , further comprising said GUI displays said logical sequence so that each of said at least one hand pose features record and said at least one hand motion features record is assigned with a construction area which is displayed with an associated instance of said hierarchical menu driven interface.

8 . The system of claim 7 , further comprising said associated instance is a hierarchical arc menus structure comprising a plurality of menus shaped as arcs each having at least one of a plurality of feature fields, said hierarchical arc menus structure having at least one of a plurality of levels:
a first level arc menu which is displayed by said GUI adjacent to said construction area; and at least one of a plurality of next level arc menus, each of said plurality of next level arc menus is adjacent to a respective previous level arc menu and having a larger radius from a center of said construction area; wherein each of said plurality of feature fields is associated with a gesture feature which is assigned at least one of: said plurality of discrete pose values and said plurality of discrete motion values.

9 . The system of claim 8 , wherein said each next level arc menu is presented by said GUI following an indication in said at least one field of said previous level arc menu, said indication is made by said user.

10 . The system of claim 8 , further comprising said at least one feature field is actively displayed to indicate availability of said associated gesture creation operation.

11 . The system of claim 1 , further comprising at least one of: said plurality of hand pose features records and said plurality of hand motion features records, is included in said logical sequence by capturing at least one of hand pose and hand motion, said at least one of hand pose and hand motion are articulated by said user and captured by at least one imaging device.

12 . A computer implemented method for creating hand gestures representations, comprising:
using an application code executed on at least one processor for: presenting a graphical user interface (GUI) to a user, said GUI displays a hierarchical menu driven interface; receiving iteratively a plurality of user instructions indicated by said user using said hierarchical menu driven interface, for creating a logical sequence of at least one hand gesture by defining at least one of a plurality of hand pose features records and a plurality of hand motion features records; and generating a code segment which defines said at, least one hand pose features record through at least one of a plurality of discrete pose values and said at least one hand motion features record through at least one of a plurality of discrete motion values.

13 . The computer implemented method of claim 12 , wherein each of said discrete pose values is indicative of a corresponding one of a plurality of hand pose features and each of said discrete motion values is indicative of a corresponding one of a plurality of hand motion features.

14 . The computer implemented method of claim 13 , wherein said hand pose feature is a member selected from a group consisting of: active hand, hand direction, palm rotation, flexion of at least one finger, direction of at least one finger, relative location between at least two fingers and tangency between at least two fingers.

15 . The computer implemented method of claim 13 , wherein said hand motion feature is a member selected from a consisting of: motion properties and motion script, said motion script defines at least one of: hand motion and motion of at least one finger.

16 . A software program product for creating hand gestures representations, comprising:
a non-transitory computer readable storage medium; first program instructions to present a graphical user interface (GUI) to a user, said GUI displays a hierarchical menu driven interface; second program instructions code instructions to receive iteratively a plurality of user instructions indicated by said user using said hierarchical menu driven interface, for creating a logical sequence of at least one hand gesture by defining at least one of a plurality of hand pose features records and a plurality of hand motion features records; and third program instructions code instructions to generate a code segment which defines said at least one hand pose features record through at least one of a plurality of discrete pose values and said at least one hand motion features record through at least one of a plurality of discrete motion values; wherein said first, second and third program instructions are executed by at least one computerized processor from said non-transitory computer readable storage medium.

17 . The software program product of claim 16 , wherein each of said discrete pose values is indicative of a corresponding one of a plurality of hand pose features and each of said discrete motion values is indicative of a corresponding one of a plurality of hand motion features.

18 . The software program product of claim 17 , wherein said hand pose feature is a member selected from a group consisting of: active hand, palm direction, palm rotation, flexion of at least one finger, direction of at le

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Karmon Kfir
• Krupka Eyal
• Tzairi Yuval
• LEVANON Uri
• Horowitz Shelly

Classifications

• G06V10/40

  Extraction of image or video features · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06V40/11

  Hand-related biometrics; Hand pose recognition · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title