Connected ecosystem for laboratory environment

Patent metadata

Field	Value
Publication number	US-12280368-B2
Application number	US-202017780352-A
Country	US
Kind code	B2
Filing date	Nov 9, 2020
Priority date	Nov 27, 2019
Publication date	Apr 22, 2025
Grant date	Apr 22, 2025

Abstract

A connected ecosystem for a laboratory environment comprises an electronic lab notebook, and instrumented biosafety cabinet, and one or more sensing vessels containing cell cultures. The electronic lab notebook interfaces with the instrumented biosafety cabinet to provide instructions, guidance, and monitoring of a user during the set up of the experimental protocol and to receive commands from the user via one of several input modalities. After the experimental protocol has been set up in the instrumented biosafety cabinet, cell cultures may be moved to an incubator where the connected ecosystem may provide automatic monitoring of the cultures. The automatic monitoring is provided by sensors integrated into cell culture vessels and supplemented by images of the cell cultures captured by a camera. The user may be informed of deviations from expected results detected based on the automatic monitoring.

First claim

We claim:

1. A biosafety cabinet comprising:
one or more output devices for providing information to a user of the biosafety cabinet regarding setup of experimental protocols within the biosafety cabinet, the experimental protocols being stored in an electronic lab notebook associated with the experimental protocol;
one or more input devices for providing input data from the user regarding setup of the experimental protocol, the input data to be stored in the electronic lab notebook associated with the experimental protocol;
a video output device for outputting videos and still images to be displayed on a surface of the biosafety cabinet;
an audio output device for outputting audio;
a camera for capturing videos or still images;
one or more scanners; and
an audio input device for capturing audio;
wherein at least one scanner tracks objects inserted into and extracted from the biosafety cabinet.

2. The biosafety cabinet of claim 1 , the videos and still images comprising step-by-step instructions guiding the user through the setup of the experimental protocol.

3. The biosafety cabinet of claim 1 , the videos and still images comprising warnings to the user that the user has deviated from parameters of the setup of the experimental protocol.

4. The biosafety cabinet of claim 1 , the scanner further tracking videos and still images comprising an inventory of objects required for the setup of the experimental protocol and an acknowledgment that the required objects for setup of the experimental protocol are present in the biosafety cabinet.

5. The biosafety cabinet of claim 1 , the videos and still images comprising one or more virtual buttons displayed on the surface of the biosafety cabinet, the biosafety cabinet being able to determine that the user has touched the area on the surface of the biosafety cabinet on which one of the virtual buttons is displayed.

6. The biosafety cabinet of claim 1 , the camera capturing images of objects in the biosafety cabinet and actions taken by the user during setup of the experimental protocol, the images being stored in the electronic lab notebook associated with the experimental protocol.

7. The biosafety cabinet of claim 1 , the audio input device capturing commands spoken by the user.

8. The biosafety cabinet of claim 1 , further comprising one or more user input devices, the one or more user input devices being selected from a group comprising a touchscreen display, a mouse and a foot actuated switch.

9. A biosafety cabinet comprising:
one or more output devices for providing information to a user of the biosafety cabinet regarding setup of experimental protocols within the biosafety cabinet, the experimental protocols being stored in an electronic lab notebook associated with the experimental protocol;
one or more input devices for providing input data from the user regarding setup of the experimental protocol, the input data to be stored in the electronic lab notebook associated with the experimental protocol;
a video output device for outputting videos and still images to be displayed on a surface of the biosafety cabinet;
an audio output device for outputting audio;
a camera for capturing videos or still images;
one or more scanners;
an audio input device for capturing audio;
a processor;
a network connection to a server comprising electronic lab book logic and an experimental protocol data storage containing one or more electronic lab books, each electronic lab book defining an experimental protocol including a list of materials and steps required to set-up the experimental protocol; and
software, for execution on the processor, the software configured to interface, via the network connection, with the electronic lab book logic to provide the functions of:
receiving video, including still images, from the electronic lab book logic and displaying the video on the surface of the biosafety cabinet;
receiving audio from the electronic lab book logic and playing the audio via the audio output device; and
receiving commands from the user and sending the commands to the electronic lab book logic.

10. The biosafety cabinet of claim 9 , the received video comprising step-by-step instructions for the user to set-up the experimental protocol.

11. The biosafety cabinet of claim 9 , the received video comprising an inventory of objects required for the setup of the experimental protocol indicating which of the required objects have been inserted into the biosafety cabinet.

12. The biosafety cabinet of claim 9 , the received video comprising ancillary information to assist the user in the setup of the experimental protocol.

13. The biosafety cabinet of claim 9 , the received video comprising warnings indicating the user has deviated from the step-by-step instructions for setting up the experimental protocol.

14. The biosafety cabinet of claim 9 , the software comprising one or more machine learning models trained to recognize one or more of voice commands, hand or eye gestures of the user and specific users based on facial recognition.

15. The biosafety cabinet of claim 14 , the software further configured to provide the functions of:
receiving voice input from the user via the audio input device;
interpreting the received voice input as a command; and
sending the command to the electronic lab notebook logic on the electronic lab notebook server via the network connection.

16. The biosafety cabinet of claim 14 , the software further configured to provide the functions of:
receiving video input from the user via the video input device, the video comprising hand or eye gestures of the user;
interpreting hand or eye gestures of the user in the received video as a command; and
sending the command to the electronic lab notebook logic on the electronic lab notebook server via the network connection.

17. The biosafety cabinet of claim 14 , the software further configured to provide the functions of:
receiving, via the video input device and image containing a facial image of the user; and
identifying and authenticating the user based facial image recognition of the user.

18. The biosafety cabinet of claim 9 , the software further configured to provide the functions of:
receiving video from the video input device; and
sending the video to the electronic lab notebook logic for storing in the electronic lab notebook associated with the experimental protocol.

19. The biosafety cabinet of claim 9 , the software further configured to provide the functions of:
receiving audio from the audio input device, the audio comprising a note spoken by the user; and
sending the note to the electronic lab book logic for storing in the electronic lab notebook associated with the experimental protocol.

Assignees

• Corning Inc

Inventors

• Coddaire John Wilfred
• De Chambeau Maryanne
• Eickmann James Thomas
• Flaherty Paula Mary
• Frutos Anthony Glenn
• Goral Vasiliy Nikolaevich
• Julien Angela Langer
• Kosovsky Marshall Jay
• Lanterman Brent Ravaughn
• Martin Gregory Roger
• Mccarthy Christie Leigh
• Roush John Forrest
• Shyu John
• Sirkka Tora Ann-Beatrice Eline
• Tanner Allison Jean
• Titus Kimberly Ann
• Upton Todd Michael
• Wood Timothy James

Classifications

• G06T2207/30242

  Counting objects in image · CPC title

• G06T7/0008

  checking presence/absence · CPC title

• G06F21/32

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title