Signal processing for touch and hover sensing display device

Patent metadata

Field	Value
Publication number	US-9851829-B2
Application number	US-89567110-A
Country	US
Kind code	B2
Filing date	Sep 30, 2010
Priority date	Aug 27, 2010
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

Signal processing for a touch and hover sensing display device is disclosed. A touch and hover sensing display device can include a sensing panel for sensing a touch or hover event, a display for displaying graphical information to select based on the touch or hover event, and a control system for processing a signal indicative of the touch or hover event. The control system can process the signal to determine to which display location a hovering object is pointing according to a profile of the object's shape. In addition or alternatively, the control system can process the signal to differentiate between a close small object and a distant large object so as to subsequently perform intended actions of the device based, at least in part, on the object distance and/or area (or size). The display can be positioned at a desirable distance from the panel so as to reduce interference from the display to the panel and avoid adverse effects on the signal.

First claim

What is claimed is:

1. A touch and hover sensing display device comprising:
a touch and hover sensing panel having multiple sensors configured to detect one or more objects proximate to the panel, wherein the sensing panel is capable of detecting one or more objects touching the panel for a touch event, one or more objects hovering over the panel for a hover event, and objects concurrently touching and hovering over the panel for touch and hover events; and
a touch and hover control system configured to:
process signals indicative of the touch and hover events so as to determine a pointer location on the panel to which one of the proximate objects that is hovering over the panel is pointing, wherein the determined pointer location on the panel changes as a function of a distance at which the one proximate object is hovering over the panel,
in accordance with a determination that the one proximate object points in a first direction, the pointer location shifts in the first direction in response to an increase in the distance at which the one proximate object is hovering over the panel, and
in accordance with a determination that the one proximate object points in a second direction, the pointer location shifts in the second direction in response to an increase in the distance at which the one proximate object is hovering over the panel, the second direction different from the first direction.

2. The device of claim 1 , further comprising a display configured to display graphical information to select in response to the touch and hover events, the display being positioned at a distance from the panel so as to reduce interference from the display to the panel and to eliminate a grounding shield between the display and the panel.

3. The device of claim 2 , wherein determining an input location of the one proximate object comprises determining that the pointer location of the one proximate object is at the graphical information on the display.

4. The device of claim 2 , wherein at least one of an object area or an object distance from the panel is usable for selecting the graphical information on the display.

5. The device of claim 1 incorporated into at least one of a mobile phone, a digital media player, or a computer.

6. The device of claim 1 , wherein determining the pointer location comprises:
determining at least one characteristic of the one proximate object hovering over the device;
calculating a centroid of the hovering object based on the determined characteristic;
setting a pointer at the calculated centroid as an initial estimate of the pointer location of the hovering object;
shifting the pointer from the calculated centroid to another portion of the hovering object based on the determined characteristic; and
estimating the pointer location of the hovering object based on the shifted pointer.

7. The device of claim 6 , wherein determining the characteristic comprises determining an orientation of the hovering object.

8. The device of claim 7 , wherein determining the orientation comprises receiving a user input indicating the orientation.

9. The device of claim 6 , wherein determining the characteristic comprises determining a shape of the hovering object.

10. The device of claim 9 , wherein determining the shape comprises determining an extended portion of the shape and shifting the pointer from the calculated centroid to another portion of the hovering object based on the determined characteristic comprises shifting the pointer in a direction of the extended portion of the shape.

11. The device of claim 6 , wherein determining the characteristic comprises determining a direction of motion of the hovering object.

12. The device of claim 11 , wherein determining the direction of motion comprises:
detecting a first location of the hovering object relative to the sensing device at a first time;
detecting a second location of the hovering object relative to the sensing device at a second time; and
comparing the first and second locations to determine the direction of motion.

13. The device of claim 1 , further comprising a capture device configured to capture a representation of an object proximate to the panel.

14. The device of claim 13 , wherein the control system is further configured to receive captured representations of the proximate objects and to determine the distances of the proximate objects based on the received captured representations.

15. The device of claim 1 , further comprising a detector configured to detect an object proximate to the panel.

16. The device of claim 15 , wherein the control system is further configured to receive detection signals from the detector for the proximate objects and to determine the distance of the one proximate object based on the received detection signals.

17. The device of claim 2 , wherein the distance is about 1 mm.

18. The device of claim 2 , wherein the distance exceeds an effective reach of display signals causing the interference.

19. The device of claim 1 , wherein the one proximate object is associated with signals detected at a first set of sensors in a first area of the panel, and the determined pointer location is outside of the first area of the panel.

Assignees

• King Brian Michael
• Leung Omar
• Puskarich Paul G
• Bernstein Jeffrey Traer
• Mucignat Andrea
• Cieplinski Avi E
• Choudry Muhammad U
• Subramani Praveen R
• Piche Marc J
• Amm David T
• Kerr Duncan Robert
• Apple Inc

Inventors

• King Brian Michael
• Leung Omar
• Puskarich Paul G
• Bernstein Jeffrey Traer
• Mucignat Andrea
• Cieplinski Avi E
• Choudry Muhammad U
• Subramani Praveen R
• Piche Marc J
• Amm David T
• Kerr Duncan Robert

Classifications

• G06F2203/04106

  Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection · CPC title

• G06F3/0416 Primary

  Control or interface arrangements specially adapted for digitisers · CPC title

• G06F3/044

  by capacitive means · CPC title

• G06F3/0418

  for error correction or compensation, e.g. based on parallax, calibration or alignment · CPC title

• G06F2203/04101

  2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup · CPC title