System and Methods of Camera-Based Fingertip Tracking

Patent metadata

Field	Value
Publication number	US-2016357267-A1
Application number	US-201615239501-A
Country	US
Kind code	A1
Filing date	Aug 17, 2016
Priority date	Dec 20, 2007
Publication date	Dec 8, 2016
Grant date	—

Abstract

Systems and methods for camera-based fingertip tracking are disclosed. One such method includes identifying at least one location of a fingertip in at least one of the video frames, and mapping the location to a user input based on the location of the fingertip relative to a virtual user input device.

First claim

What is claimed is:

1 . A method of translating sign language, the method comprising receiving a series of images from a camera pertaining to a motion of a provider's hand, finger, fingertip, and/or arm corresponding to a first unit of sign language information;
processing the images to correlate the motion to a stored unit of information stored on a computer readable medium; and outputting an output unit of information to a receiver in a form different relative to the first unit of information.

2 . The method of claim 1 , wherein said outputting comprises providing an aural signal.

3 . The method of claim 2 , wherein said aural signal comprises speaking a word to which the first unit of information pertains.

4 . The method of claim 1 , wherein said outputting comprises providing a word in text form.

5 . The method of claim 1 , wherein said outputting comprises providing a word in tactile form.

6 . The method of claim 5 , wherein said tactile form is Braille.

7 . The method of claim 1 , wherein said outputting comprises providing image information comprising motion of a hand, finger, fingertip, and/or arm pertaining to sign language of type different than said first unit of information.

8 . The method of claim 7 , wherein said different type of sign language is of a language different than that of said first unit of information.

9 . The method of claim 1 , wherein said outputting comprises displaying an visual image of an object to which the first unit of sign language information pertains.

10 . A system for manipulating a virtual object, the system comprising an eyewear device comprising a lens that generates an image field that displays a virtual object; a camera that monitor's motion in said image field, and a computer programmed to track motion of a user in the image field and mapping the motion to said virtual object.

11 . The system of claim 10 , wherein said eyewear device comprises eyeglasses, and where said camera is affixed to said eyeglasses.

12 . The system of claim 10 , wherein said eyewear device is a contact lens.

13 . A system for translating sign language, the system comprising a camera in communication with a computer, the computer comprising a computer readable media and being programmed to receive video image of a unit of sign language motion, correlating the sign language motion to unit of information stored on the computer readable media; and an output device for outputting an output unit of information, wherein the computer is programmed to output the output unit of information via said output device.

14 . The system of claim 13 , wherein said output device comprises a speaker, display, or Braille machine.

Assignees

• Sugaya Kiminobu
• Sugaya Andrew
• Univ Central Florida Res Found Inc

Inventors

• Sugaya Kiminobu
• Sugaya Andrew

Classifications

• G06F3/0304 Primary

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/0426

  tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886) · CPC title