Gesture control having automated calibration

Patent metadata

Field	Value
Publication number	US-9880670-B2
Application number	US-201414781997-A
Country	US
Kind code	B2
Filing date	Jan 15, 2014
Priority date	Apr 12, 2013
Publication date	Jan 30, 2018
Grant date	Jan 30, 2018

Abstract

A basis image is captured by an image capture device and transmitted to a computing unit. A gesture of a user of the computing unit is identified by the computing unit based on the basis image. An action is determined and executed by the computing unit depending on the identified gesture. The action is determined by the computing unit for at least one of the gestures in addition in dependence on a relative position of the image capture device relative to a display device. No later than upon capturing the basis image, an additional image is captured by at least one additional image capture device and transmitted to the computing unit. On the basis of the additional image, the relative position of the image capture device relative to the display device is determined by the computing unit.

First claim

The invention claimed is:

1. A method of control for a computing unit, the method comprising:
capturing a basis image by an image capture device
communicating the basis image to the computing unit,
determining, by the computing unit, by reference to the basis image, a gesture by a user of the computing unit,
determining, by the computing unit, an action that depends on the detected gesture,
executing the action as a control of the computing unit,
determining, for at least the gesture and by the computing unit, the action as a function of a relative position of the image capture device relative to a display device in addition to the detected gesture, the relative position known to the computer unit in determining the action,
capturing, at the latest when the basis image is being captured, a supplementary image by at least one further image capture device,
communicating the supplementary image to the computing unit, and
determining, by reference to the at least one supplementary image and by the computing unit, the relative position of the image capture device relative to the display device.

2. The method of control as claimed in claim 1 , further comprising fixing a location of the further image capture device.

3. The method of control as claimed in claim 2 , wherein determining the relative position comprises the computing unit determining, by reference to the at least one supplementary image, an absolute position for the image capture device relative to a fixed-location coordinate system and an absolute position for the display device relative to a fixed-location coordinate system and, by reference to the absolute positions of the image capture device and of the display device, the relative position of the image capture device relative to the display device.

4. The method of control as claimed in claim 1 , further comprising moving the image capture device and/or the display device.

5. The method of control as claimed in claim 1 , wherein the relative position of the image capture device relative to the display device is determined continuously, at fixed intervals of time, when initiated by a user command, or when initiated by a change recognized by a sensing system of an absolute position of the image capture device relative to a fixed-location coordinate system, a change of an absolute position of the display device relative to a fixed-location coordinate system, or a change of the relative position of the image capture device relative to the display device.

6. The method of control as claimed in claim 1 , further comprising controlling the display device with the action.

7. A computer facility comprising:
an image capture device,
at least one further image capture device,
a display device, and
a computing unit,
wherein the computing unit is linked to the image capture device, to the at least one further image capture device, and to the display device for exchanging items of data,
wherein the image capture device is configured to capture a basis image and communicate the basis image to the computing unit,
wherein the computing unit is configured to determine, by reference to the basis image, a gesture of a user of the computing unit,
wherein the computing unit is configured to determine an action that depends on the gesture and to execute the action,
wherein, for at least the gesture, the computing unit is configured to determine the action from, in addition to the gesture, a relative position of the image capture device relative to the display device,
wherein the at least one further image capture device is configured to capture, at the latest when the basis image is being captured, a supplementary image and is configured to communicate the supplementary image to the computing unit,
wherein, by reference to the supplementary image, the computing unit is configured to determine the relative position of the image capture device relative to the display device.

8. The computer facility as claimed in claim 7 , wherein the further image capture device has a fixed location.

9. The computer facility as claimed in claim 8 , wherein the computing unit is configured to determine, by reference to the at least one supplementary image, an absolute position for the image capture device relative to the fixed-location coordinate system and an absolute position for the display device relative to the fixed-location coordinate system and, by reference to the absolute positions of the image capture device and of the display device, is configured to determine the relative position of the image capture device relative to the display device.

10. The computer facility as claimed in claim 7 , wherein the image capture device and/or the display device are movable.

11. The computer facility as claimed in claim 7 , wherein the computing unit is configure to determine the relative position of the image capture device relative to the display device continuously, at fixed intervals of time, when initiated by a user command, or when initiated by a change recognized by a sensing system of an absolute position of the image capture device relative to a fixed-location coordinate system, of an absolute position of the display device relative to a fixed-location coordinate system, or of the relative position of the image capture device relative to the display device.

12. The computer facility as claimed in claim 7 , wherein the action is a control action for the display device.

13. The computer facility as claimed in claim 9 , wherein the image capture device and/or the display device are movable.

14. The computer facility as claimed in claim 13 , wherein the computing unit is configure to determine the relative position of the image capture device relative to the display device continuously, at fixed intervals of time, when initiated by a user command, or when initiated by a change recognized by a sensing system of the absolute position of the image capture device relative to a fixed-location coordinate system, of the absolute position of the display device relative to a fixed-location coordinate system, or of the relative position of the image capture device relative to the display device.

15. The computer facility as claimed in claim 13 , wherein the action is a control action for the display device.

16. The method of control as claimed in claim 3 further comprising moving the image capture device and/or the display device.

17. The method of control as claimed in claim 16 , wherein the relative position of the image capture device relative to the display device is determined continuously, at fixed intervals of time, when initiated by a user command, or when initiated by a change-recognized by a sensing system of the absolute position of the image capture device relative to a fixed-location coordinate system, a change of the absolute position of the display device relative to a fixed-location coordinate system, or a change of the relative position of the image capture device relative to the display device.

18. The method of control as claimed in claim 3 , further comprising controlling the display device with the action.

Assignees

• Siemens Ag

Inventors

• Friese Thomas
• Goβler Thomas

Classifications

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/0418 Primary

  for error correction or compensation, e.g. based on parallax, calibration or alignment · CPC title

• G06F3/0412

  Digitisers structurally integrated in a display · CPC title

• G06F2203/04808

  Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen · CPC title