Method and apparatus for classifying touch events on a touch sensitive surface

Patent metadata

Field	Value
Publication number	US-9851841-B2
Application number	US-201615206554-A
Country	US
Kind code	B2
Filing date	Jul 11, 2016
Priority date	Oct 18, 2011
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

An apparatus classifies touch events. The apparatus includes a touch sensitive surface configured to generate a touch event when an object touches the touch sensitive surface. The touch event entails a mechanical vibration upon contact with the surface. The apparatus includes a touch event detector configured to detect the onset of a touch, and a touch event classifier configured to classify the touch event to identify the object used for the touch event. The mechanical vibration is created via any one of finger parts including a tip, a pad, a fingernail, and a knuckle, each of which has a unique feature different from each other.

First claim

It is claimed:

1. An apparatus for classifying mechanical vibrations in a rigid surface caused by a finger or by a passive object coming into contact with the rigid surface, the apparatus comprising:
a sampler that receives electrical signals indicative of the mechanical vibrations in the rigid surface, wherein the sampler continuously generates digitized sample segments representative of at least a portion of the mechanical vibrations; and
a processor operatively coupled to a non-transient storage containing instructions which when executed cause the processor to:
perform digital signal analysis of the digitized sample segments to identify features of the mechanical vibrations; and
classify a combination of individual identified features as one of a plurality of types of touch events, wherein the combination of individual identified features comprises a first plurality of features selected at least in part from a first group consisting of an average absolute amplitude of the at least one of the mechanical vibrations, a total absolute amplitude of the at least one of the mechanical vibrations, and a standard deviation of absolute amplitude of the mechanical vibrations.

2. The apparatus of claim 1 , wherein the combination of individual identified features further comprises a second plurality of features selected from a second group consisting of:
a predetermined spectrogram of at least one of the mechanical vibrations;
power associated with at least one specific frequency component of the at least one of the mechanical vibrations;
a fundamental frequency component of the at least one of the mechanical vibrations;
a predetermined frequency spectrum content of the at least one of the mechanical vibrations; and
a frequency spectrum of a combination of more than one of the mechanical vibrations.

3. The apparatus of claim 1 , wherein the electrical signals are generated by at least one of an impact sensor, a vibration sensor, an accelerometer, a strain gauge, a condenser microphone, a piezoelectric microphone, or a micro-electro-mechanical microphone.

4. The apparatus of claim 1 , wherein the sampler is embedded in the apparatus to detect the mechanical vibrations.

5. The apparatus of claim 1 , wherein the mechanical vibrations are not actively induced by a component attached to the rigid surface.

6. The apparatus of claim 1 , wherein the mechanical vibrations are created via at least one finger part including a tip, a pad, a fingernail, or a knuckle.

7. The apparatus of claim 6 , wherein the plurality of types of touch events includes at least one distinct touch event corresponding to a distinct combination of features identified in the mechanical vibrations respectively created by each of the tip, the pad, the fingernail, or the knuckle.

8. The apparatus of claim 7 , wherein each of the at least one finger part are bound to different user interface actions.

9. The apparatus of claim 1 , wherein the mechanical vibrations are created by a passive tool impacting the rigid surface.

10. A method for classifying mechanical vibrations in a rigid surface caused by a finger or by a passive object coming into contact with the rigid surface, the method comprising:
sampling electrical signals to generate digitized samples representative of the mechanical vibrations;
analyzing the digitized samples in order to continuously identify features of the mechanical vibrations, and
classifying at least one individual identified feature as one of a plurality of touch events, wherein the at least one individual identified feature comprises a plurality of features selected at least in part from a group consisting of an average absolute amplitude of at least one of the mechanical vibrations, a total absolute amplitude of the at least one of the mechanical vibrations, and a standard deviation of absolute amplitude of the mechanical vibrations.

11. The method of claim 10 , wherein the classifying the at least one individual identified feature involves classifying at least two individual identified features as the one of the plurality of touch events.

12. The method of claim 11 , wherein the classifying mechanical vibrations in the rigid surface caused by the finger or by the passive object coming into contact with the rigid surface includes inducing the at least one of the mechanical vibrations in the rigid surface during onset of contact, during contact, or immediately after contact.

13. The method of claim 10 , further comprising:
creating the mechanical vibrations via at least one finger part including a tip, a pad, a fingernail, or a knuckle.

14. The method of claim 13 , further comprising:
employing each of the at least one finger part to provide input to a touch based interface.

15. The method of claim 13 , further comprising:
employing each of the at least one finger part to input different user interface actions.

16. The method of claim 10 , further comprising:
creating the mechanical vibrations through the use of a passive tool impacting the rigid surface.

17. The method of claim 13 , wherein the classifying the at least one individual identified feature includes distinguishing between mechanical vibrations caused by the tip, the pad, the fingernail, and the knuckle based at least in part on power associated with at least one frequency component of the mechanical vibrations.

18. An apparatus for classifying mechanical vibrations in a rigid surface caused by a finger or by a passive object coming into contact with the rigid surface, the apparatus comprising:
a sampler operatively coupled to receive electrical signals indicative of the mechanical vibrations, wherein the sampler continuously generates digitized sample segments representative of at least a portion of the mechanical vibrations; and
one or more processors operatively coupled to memory and a non-transient storage containing instructions which when executed cause the processor to:
perform digital signal analysis of the digitized sample segments in order to identify features of the mechanical vibrations, wherein the features comprises a plurality of features selected at least in part from a group consisting of an average absolute amplitude of at least one of the mechanical vibrations, a total absolute amplitude of the at least one of the mechanical vibrations, and a standard deviation of absolute amplitude of the mechanical vibrations; and
classify a feature as one of a plurality of touch events based at least in part on an amount of energy associated with at least two frequency components of the mechanical vibrations over a finite period of time.

19. The apparatus of claim 18 , wherein the plurality of touch events comprises at least one of four distinct touch events associated respectively with a tip of the finger, a pad of the finger, a nail of the finger, and a knuckle of the finger, wherein distinguishing features of each of the four distinct touch events comprises energy spectral density of respective portions of the mechanical vibrations represented by respective finite numbers of sample segments associated with each of the four touch events.

20. The apparatus of claim 18 , wherein the plurality of touch events comprises at least one of two distinct touch events classified based at least in part on distinct mechanical vibrations detected substantially simultaneously and distinguished by localizing an origin of the distinct mechanical vibrations to two distinct points on the rigid surface.

Assignees

• Univ Carnegie Mellon

Inventors

• Harrison Christopher
• Schwarz Julia
• Hudson Scott E

Classifications

• G06F3/0433

  in which the acoustic waves are either generated by a movable member and propagated within a surface layer or propagated within a surface layer and captured by a movable member · CPC title

• G06F2200/1636

  Sensing arrangement for detection of a tap gesture on the housing · CPC title

• G06F3/0416 Primary

  Control or interface arrangements specially adapted for digitisers · CPC title

• G06F2203/04106

  Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection · CPC title

• G06F3/043

  using propagating acoustic waves · CPC title