Behind-display user interface

Patent metadata

Field	Value
Publication number	US-10175780-B2
Application number	US-201815920296-A
Country	US
Kind code	B2
Filing date	Mar 13, 2018
Priority date	Nov 26, 2013
Publication date	Jan 8, 2019
Grant date	Jan 8, 2019

Abstract

Example systems and methods of providing a user interface are presented. In one example, a graphical object is displayed on an opaque display component on a user-facing side of a computing device. Using a sensing component of the computing device, movement of a physical pointer controlled by a user is sensed. The physical pointer may be located opposite the user-facing side of the computer device. On the opaque display component, a representation of the physical pointer is displayed during the movement of the physical pointer. The graphical object, as displayed on the opaque display component, is modified based on the sensed movement of the physical pointer during the movement of the physical pointer.

First claim

What is claimed is:

1. A method of providing a user interface on a computing device, the method comprising:
providing a display of a graphical object on a display component of the computing device;
employing a movement sensing device to sense movement of a physical pointer; and
modifying the display of the graphical object based on the sensed movement of the physical pointer, wherein modifying the display includes modifying a distance between a first edge and a second edge of the graphical object such that at least a portion of the graphical object is stretched.

2. The method of claim 1 , further comprising:
employing the movement sensing device to sense additional movement of the physical pointer; and
further modifying the display of the graphical object based on the sensed additional movement of the physical pointer, wherein further modifying the display includes reorienting the graphical object.

3. The method of claim 2 , wherein the further sensed additional movement includes the user aligning a tip of the physical pointer with at least the first edge, the second edge, or a third edge of the graphical object and lifting the edge of the graphical object that is aligned with the tip of the physical pointer.

4. The method of claim 1 , further comprising:
employing the movement sensing device to sense additional movement of the physical pointer; and
further modifying the display of the graphical object based on the sensed additional movement of the physical pointer, wherein further modifying the display includes at least one of adding one or more features to the graphical object, removing one or more other features from the graphical object, or relocating the graphical object, resizing the graphical object.

5. The method of claim 1 , further comprising:
detecting a change in location of a background surface relative to the computing device; and
altering a location of the graphical object, within the display of the graphical object, based on the detected change in location of the background surface relative to the computing device.

6. The method of claim 1 , further comprising:
sensing a location of a user of relative to the computing device; and
further modifying the display of the graphical object based on the sensed location of the user relative to the computing device.

7. The method of claim 1 , wherein the sensed movement of the physical pointer occurs on a side of the display component that is opposite to a user-facing side of the user-facing side of the display component.

8. A non-transitory computer-readable storage medium comprising instructions that, when executed by at least one processor of a computing device, cause the computing device to perform a method comprising:
providing a display of a graphical object on a display component of the computing device;
employing a movement sensing device to sense movement of a physical pointer; and
modifying the display of the graphical object based on the sensed movement of the physical pointer, wherein modifying the display includes modifying a distance between a first edge and a second edge of the graphical object such that at least a portion of the graphical object is stretched.

9. The computer-readable storage medium of claim 8 , the method further comprising:
employing the movement sensing device to sense additional movement of the physical pointer; and
further modifying the display of the graphical object based on the sensed additional movement of the physical pointer, wherein further modifying the display includes reorienting the graphical object.

10. The computer-readable storage medium of claim 9 , wherein the further sensed further additional movement includes the user aligning a tip of the physical pointer with at least the first edge, the second edge, or a third edge of the graphical object and lifting the edge of the graphical object that is aligned with the tip of the physical pointer.

11. The computer-readable storage medium of claim 8 , the method further comprising:
employing the movement sensing device to sense additional movement of the physical pointer; and
further modifying the display of the graphical object based on the sensed additional movement of the physical pointer, wherein further modifying the display includes at least one of adding one or more features to the graphical object, removing one or more other features from the graphical object, or relocating the graphical object, resizing the graphical object.

12. The computer-readable storage medium of claim 8 , the method further comprising:
detecting a change in location of a background surface relative to the computing device; and
altering a location of the graphical object, within the display of the graphical object, based on the detected change in location of the background surface relative to the computing device.

13. The computer-readable storage medium of claim 8 , the method further comprising:
sensing a location of a user of relative to the computing device; and
further modifying the display of the graphical object based on the sensed location of the user relative to the computing device.

14. The computer-readable storage medium of claim 8 , wherein the sensed movement of the physical pointer occurs on a side of the display component that is opposite to a user-facing side of the user-facing side of the display component.

15. A computing device comprising:
at least one processor; and
memory having instructions stored thereon that, when executed by the at least one processor, cause the computing device to perform a method comprising:
providing a display of a graphical object on a display component;
employing a movement sensing device to sense movement of a physical pointer; and
modifying the display of the graphical object based on the sensed movement of the physical pointer, wherein modifying the display includes modifying a distance between a first edge and a second edge of the graphical object such that at least a portion of the graphical object is stretched.

16. The computing device of claim 15 , the method further comprising:
employing the movement sensing device to sense additional movement of the physical pointer; and
further modifying the display of the graphical object based on the sensed additional movement of the physical pointer, wherein further modifying the display includes reorienting the graphical object.

17. The computing device of claim 16 , wherein the further sensed additional movement includes the user aligning a tip of the physical pointer with at least the first edge, the second edge, or a third edge of the graphical object and lifting the edge of the graphical object that is aligned with the tip of the physical pointer.

18. The computing device of claim 15 , the method further comprising:
employing the movement sensing device to sense additional movement of the physical pointer; and
further modifying the display of the graphical object based on the sensed additional movement of the physical pointer, wherein further modifying the display includes at least one of adding one or more features to the graphical object, removing one or more other features from the graphical object, or relocating the graphical object, resizing the graphical object.

19. The computing device of claim 15 , the method further comprising:
detecting a change in location of a background surface relative to the computing device; and
altering a location of the graphical object, within the display of the graphical object, based on the detected change in location of t

Assignees

• Adobe Systems Inc
• Adobe Inc

Inventors

• Ito Daichi
• Carr Nathan
• Sasaki Naoki

Classifications

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/03545

  Pens or stylus · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/005

  Input arrangements through a video camera · CPC title

• G06F3/0346 Primary

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title