Bioprocess system and method providing automated configuration detection

Patent metadata

Field	Value
Publication number	US-12223716-B2
Application number	US-202318525144-A
Country	US
Kind code	B2
Filing date	Nov 30, 2023
Priority date	May 30, 2018
Publication date	Feb 11, 2025
Grant date	Feb 11, 2025

Abstract

A method of automated configuration in a bioprocess system and to verify a process defined by a flow path representation. The method comprises the steps of: capturing one image of the bioprocess system comprising tubing for the fluid communication between units of the bioprocess system; analyzing the captured image to identify the tubing connecting units of the bioprocess system; producing a processed representation from the captured image wherein at least a part of the tubing is identified; and comparing the processed representation with the flow path representation to verify their functional concordance.

First claim

The invention claimed is:

1. A method of automated configuration detection in a bioprocess system, the method comprises the steps of:
forming a network of tubing in the bioprocess system, wherein the network of tubing is a network of disposable tubing for fluid communication between units of the bioprocess system,
capturing at least one of: one or more images and videos of the bioprocess system comprising the network of tubing;
analyzing, in an analyzing routine, the at least one captured image and/or video to identify at least a part of the tubing connecting units of the bioprocess system;
producing a processed representation from the at least one captured image and/or video wherein at least a part of the tubing connection is identified;
verifying a process defined by a flow path representation in the bioprocess system, comprising comparing the processed representation with the flow path representation to verify their functional concordance.

2. The method according to claim 1 , the processed representation is compared to the flow path representation to identify faulty connected and/or missing parts of the tubing.

3. The method according to claim 1 , further comprising:
producing an augmented live view image of the bioprocess system illustrating at least one step in the process represented by the flow path representation utilizing the processed representation to visually mark the part of the tubing and units engaged in the particular process step in the augmented live view image.

4. The method according to claim 1 , wherein the analyzing step further comprises:
determining if additional images and/or videos could be useful to extract information required to produce the processed representation and, if additional images and/or videos are determined as useful, issuing a notification to capture additional images and/or videos.

5. The method according to claim 4 , wherein the analyzing step further comprises:
determining if the tubing and optionally other features is sufficiently identified from the at least one captured image and/or video, and if determined as sufficient, continue to produce a processed representation, and if determined as not sufficient, continue to an evaluation of whether more images and/or videos should be captured;
determining if more images and/or videos should be captured, and
if more images and/or videos should be captured, proceeding to identification of problem areas, and if determined that more images and/or videos would not improve the processed representation, proceed to indication;
indicating that certain part of the tubing and/or features are not identified, and proceed to produce a processed representation;
identifying a problem area in the at least one captured image and/or video and proceed to selecting active action;
selecting a suitable active action, from a predefined list of active actions based on an analysis of the problem area;
informing the operator on the selected active action and how it should be performed and returning to the capturing step.

6. The method according to claim 1 , wherein the verifying step further comprises:
establishing a link between the flow path representation and the processed representation;
producing an enhanced image in which the tubing and units belonging to a particular flow path have a common identification.

7. The method according to claim 6 , further comprising providing setup assistance
for a new process or modification of an existing system.

8. The method according to claim 7 , further comprising:
identifying or constructing a flow path graph representing a new process or a modified process;
using the established link between the flow path representation and the processed representation to produce at least one of the following:
an enhanced image of the bioprocess system illustrating how the tubing should be connected to the units;
a series of enhanced images stepwise illustrating how each tubing connection, or a selection of tubing, should be connected to the units; and
an augmented live view of the bioprocess system stepwise illustrating how each tubing connection, or a selection of tubing, should be connected to the units.

9. A system for automated configuration detection in a bioprocess system, the system comprising:
a bioprocess system arranged to run a process defined by a flow path representation,
a memory configured to store instructions for the automated configuration detection,
a processor configured to execute the instructions, a GUI and a camera, wherein
the camera is adapted to capture at least one image and/or video of the bioprocess system comprising a network of tubing, wherein the network of tubing is a network of disposable tubing for fluid communication between units of the bioprocess system, and to transfer the least one image and/or video to the processor;
when the instructions are executed by the processor, the processor is configured to:
receive the at least one captured image and/or video from the camera,
host an analyzing routine adapted to analyze the at least one captured image and/or video to identify at least a part of the tubing connecting units of the bioprocess system;
produce a processed representation from the at least one captured image and/or video wherein at least a part of the tubing connection is identified;
present the processed representation on the GUI; and
verify the process in the bioprocess system by comparing the processed representation with the flow path representation to verify their functional concordance.

10. The system according to claim 9 , when the instructions are executed by the processor.

Assignees

• Cytiva Sweden Ab

Inventors

• Bangtsson Petra
• Arthursson Johan
• Hyckenberg Key
• Hedkvist Lotta

Classifications

• G06T2207/30164

  Workpiece; Machine component · CPC title

• G06T7/001 Primary

  using an image reference approach · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06V20/20 Primary

  in augmented reality scenes · CPC title