Use of human input recognition to prevent contamination

Patent metadata

Field	Value
Publication number	US-10588492-B2
Application number	US-201816115173-A
Country	US
Kind code	B2
Filing date	Aug 28, 2018
Priority date	Jan 20, 2012
Publication date	Mar 17, 2020
Grant date	Mar 17, 2020

Abstract

Embodiments of a system and method for processing and recognizing non-contact types of human input to prevent contamination are generally described herein. In example embodiments, human input is captured, recognized, and used to provide active input for control or data entry into a user interface. The human input may be provided in variety of forms detectable by recognition techniques such as speech recognition, gesture recognition, identification recognition, and facial recognition. In one example, the human input recognition techniques are used in connection with a device cleaning workflow used to obtain data and human input during cleaning procedures while minimizing cross-contamination between the contaminated device or person and other objects or persons. In another example, the human input recognition techniques are used in connection with a device tracking workflow used to obtain data and human input while tracking interactions with and locations of the contaminated or uncontaminated device.

First claim

What is claimed is:

1. A method for preventing contamination in an endoscope handling workflow with use of non-contact human-machine input, comprising electronic operations performed by an input-controllable electronic system, the electronic operations including:
capturing a non-contact human-machine input provided by a human in a contamination-sensitive environment, the contamination-sensitive environment involving an endoscope being tracked in the endoscope handling workflow;
identifying a stage of the endoscope handling workflow involving the endoscope, wherein the captured non-contact human-machine input corresponds to a selectable option for a handling activity performed on the endoscope during the identified stage of the endoscope handling workflow;
determining a command of the input-controllable electronic system based on recognition of the non-contact human-machine input, wherein the command is available to be performed during the identified stage of the endoscope handling workflow; and
performing the command in the input-controllable electronic system, the command causing the selectable option for the handling activity to be implemented with the input-controllable electronic system, wherein implementation of the selectable option causes a change to a status of the endoscope within the identified stage of the endoscope handling workflow.

2. The method of claim 1 , the electronic operations further including:
displaying, in response to determining the command, a first visual indication that corresponds to the command; and
displaying a second visual indication that corresponds to the identified stage of the endoscope handling workflow;
wherein the first and the second visual indication are displayed to the human via a display device in the contamination-sensitive environment.

3. The method of claim 1 , the electronic operations further including:
capturing a separate voice prompt from the human in the contamination-sensitive environment prior to the capturing of the non-contact human-machine input, wherein the voice prompt is captured via an audio input device, and wherein the voice prompt triggers the electronic system to begin the capturing of the non-contact human-machine input;
wherein the non-contact human-machine input provided by the human includes a voice command also captured with the audio input device.

4. The method of claim 1 , the electronic operations further including:
outputting a system prompt to the human in the contamination-sensitive environment, wherein the system prompt is output via an output device;
wherein the non-contact human-machine input provided by the human includes a voice command; and
wherein the system prompt is used to obtain the voice command from the human.

5. The method of claim 4 , wherein the system prompt includes an audio indication that is output via a speaker, and wherein the audio indication requests the human to provide the voice command to an input device.

6. The method of claim 4 , wherein the system prompt includes a visual indication that is output from a display, wherein the visual indication requests the human to provide the voice command, and wherein the visual indication that is output with the display includes at least one of:
information that indicates a status of capturing the non-contact human-machine input, or
information that indicates at least one command available to be received via the non-contact human-machine input in connection with the identified stage of the endoscope handling workflow.

7. The method of claim 6 , the electronic operations further including:
outputting from the display, in response to determining the command, an indication of the selectable option for the handling activity to be implemented in the input-controllable electronic system.

8. The method of claim 1 , wherein the input-controllable electronic system is in communication with an automated cleaning machine, and wherein the selectable option for the handling activity relates to a machine-performed action conducted by the automated cleaning machine as part of cleaning activities performed on the endoscope in the endoscope handling workflow.

9. The method of claim 1 , the electronic operations further including:
capturing a second non-contact human-machine input provided by the human in the contamination-sensitive environment, wherein the non-contact human-machine input is a first type of input provided from among: audio input, gesture input, or machine-readable identifier input types, and wherein the second non-contact human-machine input is a second and different type of input provided from among: audio input, gesture input, or machine-readable identifier input types;
determining a second command of the input-controllable electronic system from recognition on the second non-contact human-machine input; and
performing the second command in the input-controllable electronic system, the second command causing a second activity to be performed in the input-controllable electronic system within the endoscope handling workflow.

10. The method of claim 1 , the electronic operations further including:
tracking data for the endoscope handling workflow in a database, the database maintaining a contamination status of the endoscope, and a state of cleaning actions performed on the endoscope in the endoscope handling workflow.

11. The method of claim 1 , the electronic operations further including:
tracking the command performed in the endoscope handling workflow in a tracking data store, wherein the tracking of the command logs the identified stage of the endoscope handling workflow, and wherein the tracking data store is accessible in connection with validation or auditing of performance of a plurality of commands in the endoscope handling workflow.

12. The method of claim 1 , the electronic operations further including:
identifying the human, wherein the command is performed in the input-controllable electronic system in response to identifying the human, and wherein the identifying of the human is performed based on at least one of: facial recognition of a face of the human, iris or retinal identification of an eye of the human, or voice recognition of a voice sample captured from the human; and
performing the command in response to a determination that the human, as identified, is a user authorized to perform the command.

13. An input-controllable electronic system, comprising:
an input device to capture non-contact input provided from a human in a contamination-sensitive environment, the contamination-sensitive environment involving an endoscope being tracked in an endoscope handling workflow;
an output device to output information, to the human, in the contamination-sensitive environment, in connection with the endoscope handling workflow; and
processing circuitry to execute instructions to:
obtain the non-contact input provided by the human;
identify a stage of the endoscope handling workflow for operations with the endoscope, wherein the non-contact input corresponds to a selectable option for a handling activity performed on the endoscope during the identified stage of the endoscope handling workflow;
determine a command of the input-controllable electronic system from recognition on the non-contact input, the command available to be performed during the identified stage of the endoscope handling workflow; and
perform the command in the input-controllable electronic system, the command causing the selectable option for the handling activity to be implemented with the input-controllable electronic system, wherein implementation of the selectable option causes a change to a status of

Assignees

• Medivators Inc

Inventors

• Sly Ward
• Lemmer Stacy
• Mistalski Terry
• Petersen Michael

Classifications

• A61B2090/701

  for flexible tubular instruments, e.g. endoscopes · CPC title

• A61B90/70

  Cleaning devices specially adapted for surgical instruments · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• A61B1/121

  provided with means for cleaning post-use · CPC title