Remote control with 3D pointing and gesture recognition capabilities

Patent metadata

Field	Value
Publication number	US-9927876-B2
Application number	US-201213631134-A
Country	US
Kind code	B2
Filing date	Sep 28, 2012
Priority date	Sep 28, 2012
Publication date	Mar 27, 2018
Grant date	Mar 27, 2018

Abstract

A remote control, such as a 3D air mouse, includes motion sensors used to measure position/orientation in space to alternatively control a cursor on a display, recognize gestures by the user so that data/commands can be entered into an electronic system being controlled or the like. Timed sequences of pressing a single trigger button and the quantity of motion during said sequences are both timed in relation to thresholds to switch between modes.

First claim

What we claim is:

1. A user to machine interface comprising:
a remote control with at least a trigger button,
a communication link between the remote control and a display,
a motion sensor for generating motion signals at least partially representative of motion of the remote control, and
a processor configured to:
process said motion signals in at least one of a first mode and a second mode of operation of said interface, and
switch the operation of the interface between said first and second modes, at least one of which enables operation of said interface based on motion of the remote control,

wherein at least a switching decision is based on an evaluation of a combination of i) a duration δ ON indicative of a length of time of an ON state during which a user presses the trigger button in a press and release cycle of the trigger button, and ii) a function Q motion representative of a quantity of motion imparted to the remote by the user, derived from the motion signals including at least one moment during said ON state.

2. The interface of claim 1 , wherein said switching decision is based on an evaluation of a position of a point P defined at least by two coordinates values δ ON (P) and Q motion (P), in relation to at least a region in a coordinate system defined by axes of the coordinate values where said point P is plotted, the axes respectively corresponding to the duration δ ON and the function Q motion , each region corresponding to one of the first mode and the second mode.

3. The interface of claim 2 , wherein each region defines a class of user's actions.

4. The interface of claim 3 , wherein the switching decision depends on a combination of the result of the evaluation of the duration δ ON and the function Q motion , and of the switching decision defined by the region to which the point P belongs.

5. The interface of claim 2 , wherein said at least a region includes only one continuous region R.

6. The interface of claim 5 , wherein said first mode belongs to a group of modes comprising i) a mode A defined as a passive mode where the interface is not operated based on motion of the remote control and ii) a mode B of control of a cursor on the display, and the result of the evaluation of the duration δ ON and the function Q motion is that the point P belongs to the region R, the second mode to which the operation of the interface will switch is the other one of modes A and B in which the interface was not operating prior to said switching.

7. The interface of claim 5 , wherein said first mode belongs to a group of modes comprising i) a mode A defined as a passive mode where the interface is not operated based on motion of the remote control and ii) a mode B of control of a cursor on the display, and the result of the evaluation of the duration δ ON and the function Q motion is that the point P corresponding to said first mode does not belong the region R, the second mode to which the operation of the interface will switch is a mode C of user gesture recognition.

8. The interface of claim 7 , wherein, at the end of the ON state, the operation of the interface will switch to the first mode in which the interface was operating prior to the beginning of the ON state.

9. The interface of claim 8 , wherein the first mode is mode B.

10. The interface of claim 9 , wherein, when switching from the first mode to the second mode, the position of the cursor is frozen on the display at cursor coordinates at the start of the ON state.

11. The interface of claim 10 , wherein the cursor is unfrozen at a moment which is delayed by a preset value T after the end of the ON state.

12. The interface of claim 10 , wherein a position on the display of a virtual cursor corresponding to the motion of the remote device is computed during execution of the second mode and the cursor is unfrozen after the end of the ON state when the distance of said virtual cursor to said frozen cursor is less than a preset value.

13. The interface of claim 1 , wherein the motion sensor comprises at least one of a multi-axis accelerometer, a multi-axis gyrometer, a multi-axis magnetometer, a radio-locator and an image sensor.

14. A method of operating a user to machine interface comprising:
acquiring signals from a motion sensor, said signals being at least partially representative of motion of a remote control held by a user,
processing the signals from the motion sensor in one of a first mode and a second mode, at least one of which enables operation of said interface based on motion of the remote control, and
detecting pressing of a trigger button on the remote control by said user to switch between said first mode and said second mode,
said method further comprising determining switching decisions between said first and second modes based on an evaluation of a combination of: i) a duration δ ON indicative of a length of time of an ON state during which the user presses the trigger button in a press and release cycle of the trigger button, and ii) a function Q motion representative of a quantity of motion imparted to the remote by the user, derived from the motion signals including at least one moment during said ON state.

15. A remote control comprising:
at least a trigger button,
a circuit to establish a communication link with a display,
at least a motion sensor for generating motion signals at least partially representative of motion of the remote control, and
a processor configured to:
process said motion signals in at least one of a first mode and a second mode of operation of said remote, and
switch the operation between said first and second modes, at least one of which enables operation of said remote control based on motion imparted to the remote by a user,

wherein at least a switching decision is based on an evaluation of a combination of i) a duration indicative of a length of time of an ON state during which the user presses the trigger button in a press and release cycle of the trigger button, and ii) a function Q motion representative of a quantity of motion imparted to the remote by the user, derived from the motion signals including at least one moment during said ON state.

Assignees

• Movea

Inventors

• De Foras Etienne
• Aujay Guillaune
• Aujay Grégoire
• Gomez David
• Michallon Loic
• Meunier Nicolas

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G08C2201/32

  Remote control based on movements, attitude of remote control device · CPC title