Touch free operation of devices by use of depth sensors

Patent metadata

Field	Value
Publication number	US-9625993-B2
Application number	US-201213347943-A
Country	US
Kind code	B2
Filing date	Jan 11, 2012
Priority date	Jan 11, 2012
Publication date	Apr 18, 2017
Grant date	Apr 18, 2017

Abstract

An inventive system and method for touch free operation of a device is presented. The system can comprise a depth sensor for detecting a movement, motion software to receive the detected movement from the depth sensor, deduce a gesture based on the detected movement, and filter the gesture to accept an applicable gesture, and client software to receive the applicable gesture at a client computer for performing a task in accordance with client logic based on the applicable gesture. The client can be a mapping device and the task can be one of various mapping operations. The system can also comprise hardware for making the detected movement an applicable gesture. The system can also comprise voice recognition providing voice input for enabling the client to perform the task based on the voice input in conjunction with the applicable gesture. The applicable gesture can be a movement authorized using facial recognition.

First claim

What is claimed is:

1. A system for touch free operation of a medical 3D mapping system comprising:
a depth sensor for detecting body motion movements;
a motion software module operable to receive the detected body motion movements from the depth sensor, the software module being configured to:
track a series of body motion movements,
deduce a gesture based on the tracked series of body motion movements,
filter out invalid body motion movements from the tracked series of body motion movements, the invalid body motion movements resulting from motions that are not performed by the proper user and/or not performed in accordance with predetermined conditions,
judge whether or not the gesture is authorized, including determining whether the gesture is by a specific user and judging whether the gesture is performed at the same time that a hardware device is operated by an input from the specific user, and
accept an authorized and valid gesture; and
a client medical software module operable to receive the accepted gesture at a client computer, determine whether or not the accepted gesture is a recognized gesture for performing a task in accordance with client logic and cause the client computer to perform the task based on the recognized gesture, wherein the task relates to electroanatomical mapping.

2. The system according to claim 1 , wherein the client computer is a mapping device and the task is one of rotating a map, zooming in on a map, tilting a map, and panning a map.

3. The system according to claim 1 , wherein the tracked series of body motion movements is saved as a history of movements for a user and the judging whether the gesture is authorized is based on the saved history.

4. The system according to claim 3 , wherein whether the gesture is authorized includes analyzing differences in location in each frame of the tracked series of body motion movements to determined whether the movements are by the same specific user.

5. The system according to claim 1 , wherein judging whether the gesture is authorized includes determining whether the specific user is an authorized user.

6. The system according to claim 5 , wherein judging whether the gesture is by an authorized user includes using voice recognition.

7. The system according to claim 5 , wherein determining whether the gesture is by an authorized user includes using face recognition.

8. The system according to claim 1 , further comprising a client communication module for receiving the accepted gesture at the client computer.

9. The system according to claim 1 , wherein the client software module is further operable to use voice recognition for enabling the client to perform the task based on a voice input in conjunction with the accepted gesture.

10. A method for touch free operation of a medical 3D mapping system, comprising:
detecting body motion movements using a depth sensor;
tracking a series of body motion movements;
deducing a gesture based on the tracked series of body motion movements;
filtering out invalid body motion movements from the tracked series of body motion movements, wherein the invalid body motion movements are a motions that are not performed by the proper user and/or not performed in accordance with predetermined conditions;
judging whether or not the gesture is authorized, including determining whether the gesture is by a specific user and judging whether the gesture is performed at the same time that a hardware device is operated by the specific user;
accepting an authorized and valid gesture;
receiving the accepted gesture at a client computer comprising a medical software module;
determining whether or not the accepted gesture is a recognized gesture for performing a task in accordance with the client computer logic of the medical software module; and
causing the client computer to perform the task based on the recognized gesture, wherein the task relates to electroanatomical mapping.

11. The method according to claim 10 , wherein the client computer is a mapping device and the task is one of rotating a map, zooming in on the map, tilting a map, and panning the map.

12. The method according to claim 10 , wherein the tracked series of body motion movements is saved as a history of movements for a user and the judging whether the gesture is authorized is based on the saved history.

13. The method according to claim 12 , wherein whether the gesture is authorized includes analyzing differences in location in each frame of the tracked series of body motion movements to determined whether the movements are by the same specific user.

14. The method according to claim 10 , wherein judging whether the gesture is authorized includes determining whether the specific user is an authorized user.

15. The method according to claim 14 , wherein judging whether the gesture is by an authorized user includes using voice recognition.

16. The system according to claim 14 , wherein determining whether the gesture is by an authorized user includes using face recognition.

17. The method according to claim 10 , wherein the accepted gesture is a recognized gesture in accordance with the client logic.

18. The method according to claim 10 , further comprising a step of using voice recognition based on a voice input in conjunction with the accepted gesture.

19. A non-transitory computer readable storage device storing a program of instructions executable by a machine to perform a method for touch free operation of a medical 3D mapping system, comprising:
detecting body motion movements using a depth sensor;
tracking a series of body motion movements;
deducing, using a CPU, a gesture based on the tracked series of body motion movements;
filtering out invalid body motion movements from the tracked series of body motion movements, wherein the invalid body motion movements are motions that are not performed by the proper user and/or not performed in accordance with predetermine conditions;
judging whether or not the gesture is authorized, including determining whether the gesture is by a specific user and judging whether the gesture is performed at the same time that a foot petal is pressed by the specific user;
accepting an authorized and valid gesture;
receiving the accepted gesture at a client computer comprising a medical software module;
determining whether or not the accepted gesture is a recognized gesture for performing a task in accordance with the client computer logic of the medical software module; and
causing the client computer to perform the task based on the recognized gesture, wherein the task relates to electroanatomical mapping.

20. The program according to claim 19 , wherein the client computer is a mapping device wherein the task is one of rotating a map, zooming in on the map, tilting a map, and panning the map.

21. The program according to claim 19 , wherein the series of body motion movements is saved as a history of movements for a user and the judging whether the gesture is authorized is based on the saved history.

22. The program according to claim 19 , wherein whether the gesture is authorized includes analyzing differences in location in each frame of the tracked series of body motion movements to determined whether the movements are by the same specific user.

23. The non-transitory computer readable storage device according to claim 22 , wherein judging whether the gesture is by an authorized user includes using voice recognition.

Assignees

• Merschon Asaf
• Govari Assaf
• Altmann Andres Claudio
• Schwartz Yitzhack
• Biosense Webster Israel Ltd

Inventors

• Merschon Asaf
• Govari Assaf
• Altmann Andres Claudio
• Schwartz Yitzhack

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title