Tracking approaching or hovering objects for user-interfaces

Patent metadata

Field	Value
Publication number	US-8988395-B2
Application number	US-201314064718-A
Country	US
Kind code	B2
Filing date	Oct 28, 2013
Priority date	Oct 23, 2008
Publication date	Mar 24, 2015
Grant date	Mar 24, 2015

Abstract

An architecture is described that can utilize photo-sensors embedded in a substantially transparent layer of a UI display for tracking objects that approach or hover over the UI display. The photo-sensors can be configured to detect light of certain wavelengths (e.g., visible light, infrared light) that are propagated toward the UI display, while ignoring light emanating from the UI display when displaying content. Accordingly, by examining various characteristics of the incoming light such as intensity, the architecture can identify a location of a shadow incident upon the display caused by an approaching or hovering selector object blocking portions of incoming light. Additionally or alternatively, the architecture can identify a location of higher intensity for light emanating from the selector object.

First claim

What is claimed is:

1. A display device, comprising:
a protection layer that covers a portion of the display device;
a display layer to present content; and
a sensing layer that is situated between the protection layer and the display layer, wherein the sensing layer comprises a set of photo sensors to sense electromagnetic radiation from a source other than the display layer.

2. The display device of claim 1 , further comprising a touch-sensitive layer that is situated between the protection layer and the display layer.

3. The display device of claim 2 , wherein the touch-sensitive layer detects contact with the display device.

4. The display device of claim 1 , wherein the sensing layer is transparent.

5. The display device of claim 1 , wherein the sensing layer comprises sub-layers, wherein a sub-layer of the sub-layers comprises a subset of the set of photosensors.

6. The display device of claim 5 , wherein the set of photosensors are configured to measure an angle of the electromagnetic radiation with respect to the sensing layer.

7. The display device of claim 1 , wherein the set of photosensors are configured to measure an intensity of the electromagnetic radiation.

8. The display device of claim 1 , further comprising:
a memory to store executable instructions; and
a processor, coupled to the memory, that facilitates execution of the executable instructions to perform operations, comprising:
determining a location of a selection object relative to the display device based on data received from the set of photosensors.

9. The display device of claim 8 , wherein the operations further comprise transforming the location of the selection object to a screen coordinate associated with the display device based on the data received from the set of photosensors.

10. The display device of claim 9 , wherein the location of the selection object is represented as a three-dimensional location and the screen coordinate associated with the display device is represented as a two-dimensional coordinate.

11. A non-transitory computer readable storage device comprising executable instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:
receiving angle data indicative of an angle associated with electromagnetic radiation that is sensed by a photosensor included in a display device;
receiving intensity data indicative of an intensity of the electromagnetic radiation sensed by the photosensor;
determining a location of an object proximal to the display device based on the angle data and the intensity data; and
mapping the location of the object to a screen coordinate associated with the display device based on the angle data and the intensity data.

12. The computer readable storage device of claim 11 , wherein the electromagnetic radiation originates from a source that is remote from the display device.

13. The computer readable storage device of claim 12 , wherein the object is between the display device and the source, and the source of the electromagnetic radiation is determined to be at a greater distance from the display device than the object.

14. The computer readable storage device of claim 11 , wherein the electromagnetic radiation has a wavelength in a range of about 300 nanometers to about 800 nanometers.

15. The computer readable storage device of claim 11 , wherein the electromagnetic radiation has a wavelength in a range of about 800 nanometers to about one millimeter.

16. The computer readable storage device of claim 15 , wherein the electromagnetic radiation originates from the object.

17. A method, comprising:
receiving, by a system including a processor and a set of sensors, electromagnetic radiation that propagates to the set of sensors from a source remote from the system;
storing, by the system, data sensed by the set of sensors that relates to an angle of electromagnetic radiation relative to the set of sensors and an intensity of the electromagnetic radiation; and
determining, by the system, a location of a selector object relative to the set of sensors based on the data.

18. The method of claim 17 , further comprising determining, by the system, a screen coordinate of a display of the system based on the data, wherein the screen coordinate maps to the location of the selector object.

19. The method of claim 18 , further comprising discarding, by the system, a second portion of the data that is associated with electromagnetic radiation that emanates from the display.

20. The method of claim 17 , wherein a first portion of the data is associated with electromagnetic radiation that originates from the source that is remote from the system.

Assignees

• At & T Ip I Lp
• At & T Ip I Lp

Inventors

• Soo Armstrong
• Ku Bernard
• Brandt Jeffrey

Classifications

• G06F2203/04106

  Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection · CPC title

• G06F2203/04101

  2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup · CPC title

• G06F3/042

  by opto-electronic means · CPC title

• G06F2203/04108

  Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction · CPC title

• G06F3/046 Primary

  by electromagnetic means · CPC title