Redundant touchless inputs for automation system

Patent metadata

Field	Value
Publication number	US-11774940-B2
Application number	US-202117216103-A
Country	US
Kind code	B2
Filing date	Mar 29, 2021
Priority date	Mar 29, 2021
Publication date	Oct 3, 2023
Grant date	Oct 3, 2023

Abstract

A human machine interface for an industrial automation control system includes at least one touchless input device that is adapted to be in a first state in which said human machine interface provides a first input to said industrial automation control system or a second state in which said human machine interface provides a second input to said industrial automation control system. The at least one touchless input device includes first and second touchless input sensors each configured to detect hand gestures of an operator's hand to provide input to said human machine interface based upon said gestures. The first and second touchless input sensors can be identical with respect to each other or different. In one example, one or both of the sensors are both time-of-flight sensors and one of the sensors can be an electric field proximity sensor. A method of providing a human machine interface with at least one touchless input device is provided. In one embodiment, the touchless input device provides an emergency stop (Estop) switch device.

First claim

The following is claimed:

1. A human machine interface for an industrial automation control system, said human machine interface comprising at least one touchless input device that is adapted to be in a first state in which said human machine interface provides a first input to said industrial automation control system or a second state in which said human machine interface provides a second input to said industrial automation control system, wherein said at least one touchless input device comprises first and second touchless input sensors that are a same type of touchless input sensor and operate in an alternating arrangement with respect to one another to detect a hand gesture of an operator's hand to provide an input to said human machine interface based upon said hand gesture; and
wherein said first and second touchless input sensors are each configured to detect at least first and second different hand gestures, wherein said first hand gesture corresponds with said first input to said industrial automation control system, said second hand gesture corresponds with said second input to said industrial automation control system, and said at least one touchless input device ignores said first hand gesture when said at least one touchless input device is in said first state.

2. The human machine interface for said industrial automation control system as set forth in claim 1 , wherein one of said first and second hand gestures comprises a double tap gesture comprising two successive hand movements toward and away from the first and second touchless input sensors within a first select time period; and wherein the other of said first and second hand gestures comprises a double swipe gesture comprising two successive lateral hand movements laterally across the first and second touchless input sensors within a second select time period.

3. The human machine interface for said industrial automation control system as set forth in claim 2 , wherein said first and second select time periods are each in the range of 500 milliseconds to 1000 milliseconds.

4. The human machine interface for said industrial automation control system as set forth in claim 1 , wherein said first and second touchless input sensors are identical with respect to each other.

5. The human machine interface for said industrial automation control system as set forth in claim 1 , wherein said first and second touchless input sensors are each time-of-flight sensors.

6. The human machine interface for said industrial automation control system as set forth in claim 1 , wherein said first and second touchless input sensors are each time-of-flight photon sensors.

7. The human machine interface for said industrial automation control system as set forth in claim 1 , further comprising at least one visual indicator light that is configured to illuminate a select color when the touchless input device is in one of the first and second states.

8. The human machine interface for said industrial automation control system as set forth in claim 1 , further comprising a mechanical emergency stop switch operatively connected to said industrial automation control system and including at least one mechanical electric contact that provides an emergency stop signal to said industrial automation control system when actuated.

9. The human machine interface for said industrial automation control system as set forth in claim 1 , wherein said at least one touchless input device ignores said second hand gesture when said at least one touchless input device is in said second state.

10. A method of controlling a human machine interface for an industrial automation control system, said method comprising:
setting a state of a touchless input device of the human machine interface to a first state and providing a first input to the industrial automation control system;
using first and second touchless sensors that are a same type of touchless sensor and operate in an alternating arrangement with respect to one another to detect a first hand gesture; and
changing said state of said touchless input device from said first state to a second state and providing a second input to the industrial automation control system when both said first and second touchless sensors detect said first hand gesture, wherein said touchless input device ignores said first hand gesture when said touchless input device is in said second state.

11. The method of controlling the human machine interface for said industrial automation control system as set forth in claim 10 , further comprising:
changing said state of said touchless input device from said second state back to said first state and providing said first input to the industrial automation control system when at least one of said first and second touchless sensors detects a second hand gesture that is different from the first hand gesture.

12. The method of controlling the human machine interface as set forth in claim 11 , wherein said touchless input device ignores said second hand gesture when said touchless input device is in said first state.

13. A method of controlling a human machine interface for an industrial automation control system, said method comprising:
setting a state of a touchless Estop device of the human machine interface to a first state and providing a first input to the industrial automation control system;
using first and second touchless sensors that are a same type of touchless sensor and operate in an alternating arrangement with respect to one another to detect a first hand gesture;
changing said state of said touchless Estop device from said first state to a second state and providing a second input to the industrial automation control system when at least one of said first and second touchless sensors detects said first hand gesture; and
wherein said second input to the industrial automation control system corresponds to an emergency stop command and said touchless Estop device ignores said first hand gesture when said touchless Estop device is in said second state.

14. The method of controlling the human machine interface for said industrial automation control system as set forth in claim 13 , further comprising illuminating a visual indicator in a red color when said touchless Estop device is in said second state.

15. The method of controlling the human machine interface for said industrial automation control system as set forth in claim 13 , further comprising:
changing said state of said touchless Estop device from said second state back to said first state and providing said first input to the industrial automation control system when both said first and second touchless sensors detect a second hand gesture that is different from said first hand gesture.

16. The method of controlling the human machine interface for said industrial automation control system as set forth in claim 15 , wherein said touchless Estop device ignores said second hand gesture when said touchless Estop device is in said first state.

Assignees

• Rockwell Automation Tech Inc

Inventors

• Zhang Yanbin
• Peng Xiaobo
• Dotson Gary D
• Mason Christopher G

Classifications

• G05B19/406 Primary

  characterised by monitoring or safety (G05B19/19 takes precedence) · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G05B2219/31368

  MAP manufacturing automation protocol · CPC title

• G05B2219/50198

  Emergency stop · CPC title

• G05B19/0421 Primary

  Multiprocessor system · CPC title