Command of a device by gesture emulation of touch gestures

Patent metadata

Field	Value
Publication number	US-9841827-B2
Application number	US-201314370811-A
Country	US
Kind code	B2
Filing date	Jan 7, 2013
Priority date	Jan 9, 2012
Publication date	Dec 12, 2017
Grant date	Dec 12, 2017

Abstract

A user to machine interface emulates a touch interface on a screen. The interface is configured for operating in a touch emulation mode based on a triggering event. A triggering event may be a rotation around a first axis of an angle higher than a first threshold. Analysis of the amount of rotation around a second axis may be used to determine the number of fingers defining a specific touch gesture. An infinite variety of touch gestures may therefore be emulated by a remote control based on application context thus allowing for multiple uses of the touch screen machine from a distance.

First claim

The invention claimed is:

1. A user to machine interface comprising:
at least a remote control with at least one motion sensor,
a communication link between the remote control and the machine, and
at least one processor for processing the motion signals from said at least one motion sensor,
wherein said machine runs an operating system configured to receive touch input points when a user touches a screen connected to the machine, said at least one processor being further configured for initiating a touch emulation mode based on a triggering event, using the at least one motion sensor to perform a gesture recognition of at least a 3D gesture of a user in the air with the remote control, generating at least one emulated touch point corresponding to a touch point on the screen, based on said at least a 3D gesture of a user in the air, and sending the at least one emulated touch point to the operating system of the machine to simulate the user touching the screen at the position of the at least one emulated touch point.

2. The interface of claim 1 , wherein the touch emulation mode comprises a definition of a number N representative of a number of points on a screen connected to the machine, a movement or position of the points being controlled by the output of the recognition.

3. The interface of claim 2 , wherein a gesture of a user with a remote control controls a joint movement of the N points on the screen.

4. The interface of claim 2 , wherein the triggering event is a gesture of rotation imparted by a user to a remote control around a predefined axis of said remote control, with one of an angle of rotation and an energy of motion higher than a predetermined threshold.

5. The interface of claim 2 , wherein the definition of the number N is given by one of the triggering event and a gesture of a user with a remote control.

6. The interface of claim 5 , wherein the gesture is a rotation around a predefined axis, and the definition of the number N is determined using an angle of rotation α of the remote control around said axis.

7. The interface of claim 6 , wherein, for a range of the angle α from a threshold α min to a maximum α max and a maximum number of points N max to be controlled by the remote control, N is defined by two plus an integer quotient of (α−α min )/(α max −α min )*(N max −1).

8. The interface of claim 2 , wherein the movement or position of the points are part of the output of the recognition.

9. The interface of claim 8 , wherein the at least one processor can cause a remote control to operate in the touch emulation mode based on the determination that the machine is capable of recognizing movement or position of the points.

10. The interface of claim 1 , wherein the triggering event is one of a contextual change in an application run by the machine, a press of a button on a remote control by a user and a gesture of a user with a remote control.

11. The interface of claim 1 , wherein the gesture being recognized defines a pressure applied by a user to a screen connected to the machine.

12. The interface of claim 11 , wherein the gesture is a rotation around a predefined axis of angle α, said angle α defining the pressure applied by the user to the screen.

13. The interface of claim 1 , further being configured for use by at least two users, at least one of them with a remote control for operating the interface in a touch emulation mode.

14. The interface of claim 13 , wherein each one of the users using a remote control is defined by an index which is used to identify the gestures being recognized.

15. A method of operating a user to machine interface comprising:
moving in space by at least a user a remote control with at least one motion sensor,
using a communication link between the remote control and the machine, and
processing signals from the at least one motion sensor,

wherein said machine runs an operating system configured to receive touch input points when a user touches a screen connected to the machine, said method further comprising initiating a touch emulation mode based on a triggering event, using the at least one motion sensor to perform a gesture recognition of at least a 3D gesture imparted by a user in the air to the remote control, generating at least one emulated touch point corresponding to a touch point on the screen based on said at least a 3D gesture imparted by a user in the air, and sending the at least one emulated touch point to the operating system of the machine to simulate the user touching the screen at the position of the at least one emulated touch point.

16. The method of claim 15 , wherein the touch emulation mode comprises a definition of a number N representative of a number of points on a screen connected to the machine, a movement or position of the points being controlled by the output of the recognition.

17. The method of claim 16 , wherein the number N is at least partly defined by a value of an angle of a rotation around an axis of a remote control imparted by a user of said remote control relative to a threshold angle.

18. The method of claim 15 , wherein a rotation around a predefined axis of the remote of an angle α defines a touch gesture of a pinch or spread zooming of factor k, said factor k of zooming being a function of said angle α.

19. The method of claim 15 , wherein a rotation around a predefined axis of the remote of an angle α defines a touch gesture of rotation of said angle α.

Assignees

• Movea

Inventors

• Gomez David
• Cortenraad Hubertus M R

Classifications

• G06F2203/04808

  Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/0416

  Control or interface arrangements specially adapted for digitisers · CPC title

• G06F3/033 Primary

  Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041) · CPC title