Bioprocess system and method providing automated configuration detection

Patent metadata

Field	Value
Publication number	US-11455797-B2
Application number	US-201917056484-A
Country	US
Kind code	B2
Filing date	May 21, 2019
Priority date	May 30, 2018
Publication date	Sep 27, 2022
Grant date	Sep 27, 2022

Abstract

The present invention relates to a method of automated configuration in a bioprocess system (10) and to verify a process defined by a flow path representation. The method comprises the steps of: —capturing one image of the bioprocess system (10) comprising tubing (50) for the fluid communication between units of the bioprocess system (10); —analyzing the captured image to identify the tubing (50) connecting units of the bioprocess system (10); —producing a processed representation from the captured image wherein at least a part of the tubing (50) is identified; and —comparing the processed representation with the flow path representation to verify their functional concordance.

First claim

The invention claimed is:

1. A method of automated configuration detection in a bioprocess system, the method comprises the steps of:
capturing at least one image of the bioprocess system comprising tubing for the fluid communication between units of the bioprocess system;
analyzing in an analyzing routine, the at least one captured image to identify at least a part of the tubing connecting units of the bioprocess system; and
producing a processed representation from the at least one captured image wherein at least a part of the tubing is identified.

2. The method according to claim 1 , further comprising verifying a process defined by a flow path representation in the bioprocess system, comprising comparing the processed representation with the flow path representation to verify their functional concordance.

3. The method according to claim 2 , further comprising a step of producing an augmented live view image of the bioprocess system illustrating at least one step in the process represented by the flow path representation utilizing the processed representation to visually mark the part of the tubing and units engaged in the particular process step in the augmented live view image.

4. The method according to claim 2 , wherein the processed representation is compared to the flow path representation to identified faulty connected and/or missing parts of the tubing.

5. The method according to claim 2 , further comprising providing setup assistance to a user by producing an augmented live view image of the bioprocess system indicating to a user where at least one individual tubing connection should be connected, wherein at least one individual tubing connection and one unit corresponding to a portion of the flow path are identified in the processed representation by comparing with the flow graph representation, and the identified units are marked in the augmented live view image.

6. The method according to claim 1 , wherein the step of analyzing the at least one picture comprises utilizing a priori information relating to the bioprocess system.

7. The method according to claim 6 , wherein the a priori information comprises information about the types of units present in the bioprocess system.

8. The method according to claim 1 , wherein in the analyzing step at least two different images are captured and used to produce the processed representation.

9. The method according to claim 8 , wherein the analyzing step comprises a substep of determining if additional images could be useful to extract information required to produce the processed representation and, if additional images are determined as useful, issuing a notification to capture additional images.

10. The method according to claim 9 , wherein a camera operated by a user is utilized to capture a plurality of images and in the analyzing step the user receives a notification to capture additional images or alternatively the user receives a notification to stop capturing images.

11. The method according to claim 10 , wherein in the analyzing step, a notification of an active action is issued and transferred to the user, the notification of an active action comprising instructions to the user to manipulate at least one part of the tubing and/or other units of the bioprocess system to facilitate the identification of features in the captured image.

12. The method according to claim 9 , wherein an automated camera is utilized to capture a plurality of images and in the analyzing step the automated camera receives a notification to capture additional images or alternatively the automated camera receives a notification to stop capturing images.

13. The method according to claim 1 , further comprising steps of producing an augmented live view image of the bioprocess system utilizing the processed representation in the form of a processed image, wherein at least part of the tubing is distinguishably marked in the image augmented live view.

14. The method according to claim 1 , comprising the steps of:
capturing an image of a bioprocess system;
analyzing the captured image to identify at least part of the tubing;
determining if the tubing and optionally other features from the captured image is sufficiently identified, and if determined as sufficient, continue to produce a processed representation, and if determined as not sufficient continue to an evaluation how the image might be improved;
determining if more images should be captured, and if more images should be capture proceed to identification of problem areas, and if determined that more images would not improve the processed representation, identified proceed to indication;
indicating that the image may contain part of the tubing and/or features that are not identified, and proceed to produce a processed representation;
identifying a problem area in the analyzed image and proceed to selecting active action;
selecting a suitable active action, from a predefined list of active actions based on an analysis of the problem area;
informing the operator on the selected active action and how it should be performed and go back to the capturing step; and
producing a processed representation with at least part of the tubing identified.

15. A system for automated configuration detection in a bioprocess system, wherein the process is defined by a flow path representation, the system comprising a bioprocess system, a CPU, a GUI and a camera, wherein
the camera is adapted to capture at least one image of the bioprocess system comprising tubing for the fluid communication between units of the bioprocess system and to transfer the image to the CPU;
the CPU is adapted to receive the capture image from the camera and hosts an analyzing routine adapted to analyze the at least one captured image to identify at least a part of the tubing connecting units of the bioprocess system; and
adapted to produce a processed representation from the at least one captured image wherein at least a part of the tubing is identified, and present the processed representation on the GUI.

Assignees

• Cytiva Sweden Ab

Inventors

• Bangtsson Petra
• Arthursson Johan
• Hyckenberg Key
• Hedkvist Lotta

Classifications

• G06T2207/30164

  Workpiece; Machine component · CPC title

• G06T7/001 Primary

  using an image reference approach · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06V20/20 Primary

  in augmented reality scenes · CPC title