Execution of function based on location of display at which a user is looking and manipulation of an input device

Patent metadata

Field	Value
Publication number	US-2016266642-A1
Application number	US-201514643505-A
Country	US
Kind code	A1
Filing date	Mar 10, 2015
Priority date	Mar 10, 2015
Publication date	Sep 15, 2016
Grant date	—

Abstract

In one aspect, an apparatus includes a processor, a sensor accessible to the processor, a display accessible to the processor, and memory accessible to the processor. The memory bears instructions executable by the processor to receive first input from the sensor, and based on the first input, identify a location on the display at which a user is looking. The instructions are also executable to receive second input from an input device in communication with the apparatus and, responsive to receipt of the second input and based on the location on the display, execute a function at the apparatus regardless of a location of the input device when the second input was received.

First claim

What is claimed is:

1 . An apparatus, comprising:
a processor; a sensor accessible to the processor; a display accessible to the processor; and memory accessible to the processor and bearing instructions executable by the processor to: receive first input from the sensor; based on the first input, identify a location on the display at which a user is looking; receive second input from an input device in communication with the apparatus; and responsive to receipt of the second input and based on the location on the display, execute a function at the apparatus regardless of a location of the input device when the second input was received.

2 . The apparatus of claim 1 , wherein the input device is a stylus, and wherein the second input is from at least one of a motion sensor on the stylus and a contact sensor on the stylus.

3 . The apparatus of claim 1 , wherein the input device is selected from the group consisting of: a wearable device, a computer comprising a display, an input pad disposable on a surface.

4 . The apparatus of claim 1 , wherein the function is executed at the apparatus regardless of a location of a cursor presented on the display.

5 . The apparatus of claim 1 , wherein the input device is a device which is not mechanically coupled to the apparatus.

6 . The apparatus of claim 1 , wherein the function is replacement of a first word presented on the display with a second word different firom the first word.

7 . The apparatus of claim 1 , wherein an element is presented at the location on the display, and wherein the function is associated with selection of the element.

8 . The apparatus of claim 1 , wherein the function is presentation of a menu on the display.

9 . The apparatus of claim 8 , wherein the second input is received at an area of the display not comprising the location on the display.

10 . The apparatus of claim 1 , wherein the function is to highlight text presented on the display.

11 . The apparatus of claim 10 , wherein the function is executed at least in part based on detection of a gesture of at least one at least partially curved stroke one or more of: in free space, and against a surface other than the display.

12 . The apparatus of claim 1 , wherein the function is to remove from presentation on the display at least one word.

13 . The apparatus of claim 12 , wherein the function is executed based at least in part on detection of a gesture of at least two strokes in different directions one or more of: in free space, and against a surface other than the display.

14 . The apparatus of claim 1 , wherein the function is presentation of a representation of at least one character detected as gestured one or more of: in free space, and against a surface other than the display.

15 . A method, comprising:
receiving first input from a camera; based on the first input, identifying a location of a display at which a person is looking; receiving second input from an input device, wherein the second input is input received other than based on physical contact of the input device with the display; and based at least in part on the location and responsive to receiving the second input, performing an operation at a device.

16 . The method of claim 15 , comprising:
identifying the second input as input from a contact sensor on the input device, wherein the operation is performed based at least in part on the identifying of the second input as input from the contact sensor.

17 . The method of claim 15 , comprising:
identifying the second input as input from an electronic button on the input device, wherein the operation is performed based at least in part on the identifying of the second input as input from the electronic button.

18 . The method of claim 15 , comprising:
identifying the second input as input from an accelerometer on the input device, wherein the operation is performed based at least in part on the identifying of the second input as input from the accelerometer.

19 . Apparatus comprising:
a first processor; a network adapter; storage bearing instructions executable by a second processor for: performing a task using the second processor responsive to identification of a user looking at an area of a display and responsive to receipt of input generated based on manipulation of an input device other than against the display; wherein the first processor transfers the instructions over a network via the network adapter.

20 . The apparatus of claim 19 , wherein the input device is a mouse, and wherein the task is performed responsive to receipt of input generated based on manipulation of a button on the mouse regardless of a current position of a cursor presented on the display.

Assignees

• Lenovo Singapore Pte Ltd

Inventors

• Vanblon Russell Speight
• Zhang Jianbang
• Nicholson John Weldon

Classifications

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/03545

  Pens or stylus · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title