Method for providing automatic configuration detection and biological process system

Abstract

The invention discloses a method for providing automatic configuration detection and a biological process system. The present invention relates to a method of automatic configuration in a biological process system (10) and to checking a process defined by a flow path representation. The method comprises the steps of:-capturing an image of a biological process system (10), said biological process system (10) comprising a conduit (50) for fluid communication between units of the biological process system (10); -analysing the captured images to identify conduits (50) connecting units of the biological process system (10); -generating a processed representation from the captured image, wherein at least a portion of the pipe (50) is identified; and-comparing the processed representation with the flow path representation in order to check its functional consistency.

Description

Technical Field

[0001] The present invention relates to bioprocess systems, and more particularly to systems and methods for detecting and validating system configurations. Background Art

[0002] Modern bioprocess systems (such as chromatography systems) are typically provided to end users as modular and highly flexible systems. Modern bioprocess systems typically include a frame or rack in which a plurality of valves, pumps, detectors, fraction collectors, etc. in the form of separate modules can be installed. The modules typically have connections for electrical power and electronic communication on their back surfaces facing the mounting frame. An electronic communication capability is provided by a CPU and a bus system, etc., and the bioprocess system is connected to a PC, tablet, or dedicated computer, etc. for controlling the process, presenting information and results, storing information, and external communication. Fluid communication between the modules is typically provided by flexible tubing on the front surfaces of the modules. Different functionalities are provided by different configurations, where one configuration utilizes a subset of the modules, while another configuration utilizes a different subset. The configurations are typically linked to a flow path, which represents the modules involved, their fluid connections, and functionalities. The flow path is a tool for establishing different functions (such as detection using the connected chromatography) as well as for monitoring the process. The flow path is typically presented graphically on a PC as part of a GUI.

[0003] Biological process systems are typically delivered in a number of predefined configurations including associated modules, the associated modules including piping that provides fluid communication between the modules. Alternatively, biological process systems are provided "unconfigured", and the mounting framework as well as the modules and piping are purchased separately and built by the end user. In either case, the end user is able to configure their own system by modifying an existing configuration or building a new configuration from scratch. Similarly, modifications to existing biological process systems can range from replacing worn or contaminated piping to testing and implementing an entirely new configuration. Through an in-built electronic communication system and electronic identification of the individual modules, a representation of the flow path and the link between the modules is automatically provided by the biological process system. No such automated functionality exists for fluid communication. The front side of the biological process framework is instead typically visually inspected by the user. A graphical representation of the flow path may include annotations or graphics indicating the actual connections between the modules as an aid. Additionally, the user typically uses annotations, sketches or images to document the setup. However, due to the fact that modern biological process systems are capable of providing a large number of different functions and flow paths simultaneously, and due to the high degree of flexibility in the selection of the modules and their position within the framework, the complexity can be high. Additionally, the sheer number of pipe segments, their loops and possible entanglements make it difficult to link the flow path to the correct set of pipes. This problem is most evident in modular biological process systems, but also exists to a large extent in non-modular biological process systems, since the piping can be equally complex and mistakes can be made when, for example, replacing piping or components of the piping.

[0004] US8821718 describes a biological process system that would advantageously benefit from the methods and systems according to the present invention and is hereby incorporated by reference in its entirety.

[0005] US 9304518 discloses systems and methods for assisting in identifying and coordinating fluid connections between modules in a modular biological process system and is hereby incorporated by reference in its entirety. The systems disclosed in US 9304518 require both new hardware and software in order for the advantages to be available to the user and are therefore not fully compatible with existing systems. SUMMARY OF THE INVENTION

[0006] It is an object of the present invention to provide a method for verifying or validating that the physical configuration of a biological process system corresponds to the flow path defined in the system software. This is particularly relevant in modular biological process systems where the units and piping may have been rearranged.

[0007] This is achieved by a method for a biological process system according to the present invention.

[0008] A method for automatic configuration detection in a biological process system according to the present invention (wherein the process is defined by a flow path representation) comprises the following steps: - Capturing at least one image of a biological process system, the biological process system including pipes for fluid communication between units of the biological process system.

[0009] - Analyzing the at least one captured image in an analysis routine to identify at least a portion of the pipes connecting the units of the biological process system.

[0010] - Generating a processed representation from the at least one captured image, wherein at least a portion of the pipes is identified.

[0011] According to one aspect of the present invention, the verification is performed by comparing the processed representation with the flow path representation to check their functional consistency. The comparison step can be an automatic step. Alternatively, the comparison is performed by a user of the biological process system using, for example, the processed representation in the form of a processed image and the flow path representation in the form of a flow path diagram.

[0012] According to one aspect of the present invention, the processed representation includes a processed image and optionally also includes a list describing the pipes and how the pipes interconnect the modules / units of the biological treatment system.

[0013] The method according to the present invention can utilize at least two captured images to generate a processed representation. The image analysis routine can determine that more images are required or at least may be advantageously used in the identification of pipes and / or units, and generate instructions and forward them to the operator to capture one more image. The analysis routine can also, for example, identify the need for an active action in order to be able to identify individual features in the image, and instruct the operator to perform the active action, such as to move a portion of a pipe, unfold a bundle of tubes, change the position of a photographic device, or change the lighting.

[0014] According to one aspect of the present invention, the image analysis routine conveys instructions to the user to capture additional images, or alternatively conveys a notification to stop capturing images. The instructions can be supplemented with instructions to perform active actions.

[0015] Image analysis can utilize prior information related to the biological process system. Examples of prior information include, but are not limited to, knowledge of the types of units present in the biological process system, the coloring of portions of the pipes, identification labels, etc.

[0016] According to one aspect of the present invention, a user utilizes a photographic device to capture a plurality of images, and in an analysis step, the user receives a notification to capture additional images, or alternatively, the user receives a notification to stop capturing images.

[0017] The method according to the present invention may include the step of generating an enhanced live view image of a bioprocess system using a processed representation in the form of a processed image, wherein in the enhanced live view image, parts of the pipeline are distinguishably marked.

[0018] The method according to the present invention may include the step of generating an enhanced live view image of a bioprocess system using a processed representation including at least a processed image so as to visually mark parts of the pipeline and units involved in a specific process step in the enhanced live view image, the enhanced live view image illustrating at least one step in the process represented by a flow path representation.

[0019] The method according to the present invention can be used to facilitate the establishment and modification of a bioprocess system. An enhanced live view image of the bioprocess system can be generated, thereby indicating to the user the location to which at least one individual pipeline connection should be connected. In the flow path representation, at least one individual pipeline connection corresponding to a part of the flow path is identified, and the units to be used in the part of the flow path are identified, and the identified units are marked in the enhanced live view image. The processed image can be used at least in part as an overlay on the live view image as a component in the enhanced live view image.

[0020] According to one aspect of the present invention, the processed representation is compared with the flow path representation to identify faulty connections and / or missing parts of the pipeline.

[0021] Due to the method and system according to the present invention, automatic configuration detection of a bioprocess system can be provided. This is particularly important for modular and / or complex establishment, where it may be difficult to pick out the configuration solely by optical inspection.

[0022] One advantage of the present invention is that the automatic detection can be used to link the processed representation (such as an image and / or a list) to the flow path representation. The established link can be used for system verification, and also for troubleshooting, facilitating establishment or modification and collecting user information. This represents a major improvement compared to currently available manual procedures. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] FIG. 1 schematically illustrates a bioprocess system in which the method according to the present invention can be utilized, wherein a) illustrates the mounting frame in a perspective view, b) illustrates the mounting frame with a plurality of modules in an exploded perspective view, and c) illustrates the complete bioprocess system in a front view; Figure 2 is a diagram of a flow path of a bioprocess system that can typically utilize the method according to the present invention; Figure 3 is a schematic diagram of a processed image generated by the method according to the present invention; Figure 4a -d is a schematic diagram of an enhanced image and enhanced live view generated by the method according to the present invention; Figure 5 is a flowchart of a method according to an embodiment of the present invention. Detailed Description

[0024] The method according to the present invention relates to establishing, validating, and maintaining a bioprocess system, particularly a modular bioprocess system (such as a chromatography system). A suitable modular bioprocess system is schematically depicted in Attachment Figure 1a -c, where Attachment Figure 1a is the mounting frame in perspective view, Attachment Figure 1b is the mounting frame with multiple modules providing different functions in the system in exploded perspective view, and Attachment Figure 1c is the complete bioprocess system in front view. The bioprocess system 10 includes a mounting frame 15 having multiple compartments 16 in which modules 20 can be received. The compartments 16 can typically each receive one module and can have different sizes, but are preferably only in a few standardized sizes. A wide range of modules can be installed in the system, including but not limited to pump modules, valve modules, detector modules, mixing modules, and fraction collectors. In the drawings, the modules 20 are illustrated by multiple valve modules 20:1 of different types, multiple pump modules 20:2, and multiple detection modules 20:3. The bioprocess system 10 can typically also be equipped with, for example, one or more chromatography columns 25, liquid storage containers 26, and a container 27 for receiving separated fractions. Moreover, other pieces of equipment (not shown) can be provided on or near the mounting frame. The modules 20, the chromatography columns 25, and other equipment that are part of the bioprocess system 10 will be referred to as the units and types of units of the bioprocess system.

[0025] The mounting frame 15 is communicatively connected to the processing unit 40. The processing unit 40 can be, for example, an integrated CPU in the mounting frame, a stand-alone PC, a laptop PC or a tablet, and generally includes a software suite for controlling the bioprocess system 10, including algorithms and routines required for performing measurements or production, setting up the system, maintaining the system, storing and analyzing data, etc. The software suite can be, for example, a combination of proprietary software provided by the bioprocess system manufacturer, open-source software providing specific analysis, and routines and modifications generated by the end user to adapt the system to specific requirements. The term "system software" will be used hereinafter to denote the software required for setting up, running and maintaining the bioprocess system. Data and system information are typically presented on a graphical unit interface GUI (such as a touch screen 41 connected to the processing unit 40).

[0026] The module 20 is provided on its back side with electrical contacts which are arranged to cooperate with corresponding electrical contacts provided in the compartment 16 of the mounting frame 15. The electrical contacts transfer two kinds of signals to and from the module 20 to the mounting frame 15 and supply power to the module for its operation. The module 20 has a separate means for identification (referred to as the module ID) which can be read by the processing unit 40 or passed to the processing unit 40. Commercially available bioprocess systems currently generally do not have the ability to provide the system software with information on the exact location of the modules 20 in the mounting frame 15. With a modular system and the possibility for the user to reconfigure the system, the system software may not know the location of the modules, even if that location is known to be delivered in a preconfigured state. Additionally, some bioprocess systems have the possibility of incorporating plug-in modules either individually or in a smaller mounting frame including several module positions into the system. In other words, the system software knows which modules are available and their corresponding functions and parameters, but does not know their location. A future bioprocess system with knowledge of the exact location of individual modules can be envisaged, for example, by providing the module 20 with an RFID tag. Such location information can be used in the method according to the invention, which will be illustrated below.

[0027] The bioprocess system 10 is provided with a network of conduits 50 to provide fluid communication between different units of the bioprocess system 10, such as modules 20, chromatography columns 25, and storage vessels 26. The conduits 50 can extend between units as separate entities, but can also be joined in a bundle 51. The conduits 50 can be used solely for transfer, but can also have individual functions, such as forming loops 52 or being part of a detection device or passing through a peristaltic pump. The conduits 50 are generally disposable and are replaced regularly due to wear or contamination. The conduits 50 are typically connected to valves and other units of the module 20 via connectors called hand-tight fittings, which provide tool-free operation. Individual conduit connections are generally standardized inside-dimension conduits such that a certain length will maintain a predictable volume. Conduit connections can be color-coded such that a particular color indicates a particular inner diameter. To some extent, the inner diameter is reflected in the outer diameter of the conduit connection such that conduit connections of different thicknesses can be distinguished. However, there is no direct or standardized relationship between the inner and outer diameters of the conduits.

[0028] A photographic device 60 is provided for acquiring images of the modular bioprocess system 10. The photographic device 60 can be a dedicated photographic device, but can also be a device with photographic device facilities, such as a smart phone, tablet, or laptop computer. The photographic device 60 is equipped to transfer the captured images to, for example, the processing unit 40, and preferably wirelessly, such as via Bluetooth or WiFi.

[0029] The above-described communication system should be regarded as a functional description. As recognized by a person skilled in the art, communication between different entities in a system can be implemented in many different ways. Additionally, communication is a rapidly evolving field. Different standards and protocols can be used for communication, and communication can be wire-bound (as described above) or wireless or a combination of both. For example, signaling between the module 20 and the processing unit 40 can be via a wireless protocol, such as NFC or Bluetooth, as well as an electrical contact that primarily supplies power to the module. Another possibility is that the units in the system, such as the module 20, mounting frame 15, and processing unit 40, are individually connected to WiFi, and communication between the units is indirect via WiFi.

[0030] A specific process to be performed by the bioprocess system 10 using at least one flow path is defined by a script in the system software. Multiple scripts are typically provided by the system manufacturer, but can also be programmed by the end user or provided by a third-party provider. The end user can also choose to modify an existing script in order to customize the process.

[0031] The script is typically supplemented by a process image or a flow path diagram given a graphical rendering of the process according to the script and also serves as a graphical interface to the process. Hereinafter, the term "flow path representation" is used to describe the information saved by the system software that describes a particular configuration in a functional manner. It should be understood that a "flow path representation" can be a process image or a flow path diagram and can also include non-graphical information or consist entirely of non-graphical information. FIG. 2a is an example of a flow path diagram presented to a user on the GUI 41, for example. The flow path diagram in FIG. 2a represents a detection process that utilizes a chromatographic column 25 and a UV detector in combination with a plurality of valves and pumps.

[0032] The flow path representation can be used in a variety of ways. During pre-configuration, the user uses the flow path representation to visualize and understand the process and, for example, switch valve positions. During operation, the user can monitor the process in real time via the flow path representation corresponding to the process. The flow path representation can also be used in some cases to modify an existing process or create an entirely new process, although most software suites associated with bioprocess systems do not yet allow this type of advanced object programming. From an electronic / electrical communication perspective, the processing unit can always be updated such that changes automatically indicated in the flow path representation are reflected in how modules and other units interact. However, for fluid connectivity (i.e., piping), such control and automation is not possible for today's systems - the user must manually view the piping to match the flow path.

[0033] The method according to the invention includes dedicated image analysis optimized for the automatic detection of the configuration of a bioprocess system.

[0034] According to one aspect of the invention, the results of the image analysis are used to verify at least one aspect of the functionality of the bioprocess system (10), typically the functionality related to a specific process performed or to be performed by the bioprocess system 10 and defined by the flow path representation.

[0035] By image analysis of at least one photographic image of the bioprocess system, a processed representation or other information identifying characteristic elements in the image is generated. Characteristic elements include, but are not limited to, pipes or parts of pipes. The image analysis includes the following steps: A) Capturing at least one image of the bioprocess system 10 (typically the front of the bioprocess system 10). B) Analyzing the captured image to identify at least part of the pipe 50. Optionally, other units of the bioprocess system 10 are also identified. Preferably, the analysis is performed by an image analysis routine residing in the photographic device 60 or the processing unit 40. Alternatively, the analysis routine resides in a remote server or the like, and the photographic device 60 or the processing unit 40 can communicate with the remote server or the like.

[0036] C) Generate a processed representation in which at least a part of the individual pipe connections is identified. The processed representation can be graphical, for example as a processed image, in which the identified pipe connections are distinguishable, for example, by individual artificial colors and / or in the form of a list of the pipe connections and units to which they are connected. Figure 3 The figure shows a processed image when the processed image can be presented to the user on the GUI. All individual pipe connections are identified as objects in the image, shown in Figure 3 by individual pipe connections and given references a - q. In a real - life processed image, it may be more convenient to give color - coding or other graphical identification to the identified individual pipe connections. The processed image can be a schematic diagram as shown in Figure 3 or, alternatively, a photograph of the front of a biological process system with the identified pipes, for example, as an artificial overlay. Also, other objects (such as valves and detectors) can be identified as distinguishable objects and presented as an artificial overlay. The processed image can be presented to the user together with a list of the identified pipes and units, or the list can be presented separately, for example, on demand. A number of options regarding how the processed image should be presented may be selectable by the user.

[0037] In image analysis, multiple images can be utilized, which represents one aspect of the present invention. An example of using multiple images is to identify individual pipes in a bundle. By using, for example, multiple images taken at different angles and / or from different positions, pipes or parts of pipes that are hidden in one view may be visible in another view, and using more than one image can facilitate identification. The camera device operator can be instructed by the image - analysis program to capture additional images from various positions until the image - analysis program can identify the object at a certain predefined level of certainty.

[0038] According to one aspect of the present invention, the camera device operator is instructed by the analysis program to perform effective actions to assist with the image analysis. A set of possible effective actions is predefined and stored in the system together with information about which identification problem the effective action addresses. Typically, during image analysis, problem areas are identified, such as areas with complex pipe bundles. Other problems may be general, such as poor lighting, which makes the analysis problematic as a whole. Effective actions can include, but are not limited to: - Changing the angle and / or distance between the camera device 60 and the biological process system 10 - Changing the lighting conditions, - Unfolding the pipe bundle so that the individual pipe connections are visible, - Move a pipe connection so that it can be identified within a set of pipes or a bundle. If the pipes are provided with some type of marking (e.g., dots or bars at preferably regular intervals), this identification can be simplified. - Move parts of the pipe so that, for example, labels or other means of fixed identification on a module can be made visible. - If such labels are used, move the labels on the pipe.

[0039] For some of the above valid actions, it may be advantageous to use video instead of still images, and image analysis should be understood to include video analysis if appropriate.

[0040] If multiple images or videos are utilized, steps A and B can be regarded as loops that run whenever identification is required.

[0041] According to one aspect of the present invention, image analysis using prior knowledge is employed. The prior knowledge can be, but is not limited to, information about what types of modules 20 and other units are present in / on the installation frame 15, the position of the modules 20 in the frame (if such information is available), information about the units and their order in a particular flow path, and the "as-delivered" initial configuration related to the bioprocess system 10. The image analysis routine / program can also utilize markings on the installation frame 15 or the units to scale and / or align the captured images. These markings can be provided on the bioprocess system for this purpose, but can also be existing features, such as logos, model numbers, or other visually distinguishable features (for which the size, color, etc. are known). The image analysis can further utilize the fact that a limited number of known shapes may be seen in the image. For example, the characteristic shapes of elongated pipes, valves, pumps, and columns, and even the color of the objects. Although the color and / or outer diameter of the pipes are not standardized, they can still be used to identify, for example, specific pipe connections entering and leaving a bundle. So that other knowledge about the pipes passing through the device in certain pumps and detectors can be used to identify that it is the same pipe connection, even though it is hidden from view when inside the device. Preferably, the prior knowledge is provided in one or more databases that are accessible by the unit (e.g., the processing unit 60) performing the image analysis. The prior art knowledge database can be a local database or a centralized database accessible via, for example, a client - server setup included and maintained by the manufacturer. For example, if a new module is introduced or a module is modified in its appearance, the client - server setup will facilitate updating the prior knowledge database. Alternatively, if the prior knowledge database is local, it can be updated periodically and / or on demand from a central database.

[0042] The image analysis routine may include a confirmation step, in which the user verifies that the proposed processed image or a portion of the processed image corresponds to the user's perception of the biological process system.

[0043] Image analysis (main step B)) is typically performed in the processing unit 40, and the captured image captured by the photographic device 60 is transmitted to the processing unit 40. Alternatively, the processing capacity of a capture device (such as a smartphone) is used for at least part of the image processing, and the processed representation is transmitted to the processing unit 40.

[0044] According to one aspect of the invention, the image analysis is based only on the image data, i.e., the information generated only from the individual pixels in the image, which is called image analysis without prior knowledge.

[0045] The image analysis may further include a plurality of operations well known in the field of automatic image analysis. Such operations include, but are not limited to: alignment / straightening, scaling, segmentation, and feature isolation. The image analysis may use artificial intelligence techniques for feature recognition, such as neural networks and deep learning.

[0046] The result of the image analysis represented by the processed representation can be used to examine aspects of the functionality of the system. Examining aspects of functionality should be interpreted broadly, including examining that the pipeline corresponds to the process defined by the flow path representation (such as a flow path diagram), troubleshooting, optimization, visualization of measurement / separation procedures, establishing or modifying processes, etc. As an example, the processed representation in the form of a processed image and / or list provides a way to examine the correct configuration of the process (such as represented by a flow path diagram) for fluid connectivity in the biological process system 10, particularly for the pipeline 50 and the unit.

[0047] According to one aspect of the invention, the functional consistency between the flow path representation and the actual pipeline is examined by comparing the processed representation resulting from the image analysis with the flow path representation. This may be a manual process, in which the user compares, for example, a flow path diagram with the processed image and / or list to examine the correspondence between the flow path and the pipeline. Alternatively, it is an automatic process. This procedure (whether manual or automatic) may include user approval of the consistency between the flow path representation and the processed representation.

[0048] According to one aspect of the invention, image analysis performed on a photographic image of a biological process system establishes a link between the flow path and the pipeline and the unit. According to one embodiment, the established link between the flow path and the network of pipelines and units of the biological process system 10 is used to monitor the process running on the biological process system 10, examine the process, and / or modify or optimize the process.

[0049] According to one aspect of the present invention, an established link is created between the flow path and the units of the bioprocess system 10 to provide visual assistance in connecting pipes to various units to participate in a process related to the flow path.

[0050] The processed representation can be presented to the user on a GUI connected to the processing unit 40. Alternatively, a separate screen or goggles (e.g., virtual reality goggles) can be used for presentation. According to one embodiment of the present invention, the results of the image analysis that has identified one or more pipes are presented by means of augmented reality AR or virtual reality VR. Using AR or VR, the visual recognition of a plastic pipe or a set of pipes is overlaid on the live image of the bioprocess system 10, thereby forming an enhanced image of the bioprocess system.

[0051] The inspection using the processed representation and the flow path representation according to one aspect of the present invention may include one or more of the following steps: a) Link the flow path representation to the processed image and generate an enhanced image, wherein the pipes belonging to a specific flow path and optionally also the modules / units are given a common identification (e.g., the same color). Thus, multiple pipes 50 and optionally modules 20 and other units used in the same process can be grouped and identified in the processed image. Figure 4a The schematic diagram shows how multiple individual pipe connections used in the same process are marked as dashed lines in the enhanced image presented to the user on the GUI. Alternatively, using the processed representation in the form of a list, and the link to the flow path representation generates a list of the relevant part(s) of the pipe 50.

[0052] Live view along the flow path: According to one aspect of the present invention, the established link between the flow path diagram and the image of the bioprocess system 10 is used to present an enhanced live view image. As the process continues, the pipes 50 and optionally the modules 20 are simultaneously marked (e.g., illuminated) in the enhanced live view image and also in the flow path diagram during use. This is illustrated in Figure 4b wherein the individual pipe connections are dashed in the enhanced live image, and the corresponding segments in the flow path diagram are also dashed. See also Figure 2b. Preferably, as indicated in the figure, the enhanced live view image and the flow path diagram are visible on the same screen. As an alternative, one or more enhanced still images can be presented instead. According to one embodiment, the simultaneous marking of the active modules and pipes is used by the user to verify that the network of pipes is correctly connected and corresponds to a defined flow path, for example, a measurement. The enhanced live view or a series of enhanced still images can be recorded for later analysis. The flow path diagram and the enhanced live view image can be presented to the user simultaneously, for example, on the same screen showing the flow path diagram and the enhanced live view image of the bioprocess system 10, wherein the pipes and / or units under the current operation are indicated in the enhanced live image and on the flow path.

[0053] b) Troubleshooting: According to one aspect of the present invention, the established link between the flow path representation and the image of the bioprocess system 10 is used to identify a malfunction of the bioprocess system. Such a malfunction may be, for example, a missing pipe connection or one end of a pipe connection not being coupled to a hand-tight fit. Some malfunctions can be identified solely from the processed image (such as a loose pipe end). Other aspects can be identified by indicating the differences between the representations, through the link to the flow path representation. The differences (such as a missing pipe connection) can be indicated on the enhanced live view image, similar to that described above. In Figure 4c the missing individual pipe connection is illustrated by a dashed line, while the missing connection is illustrated by a dotted line.

[0054] c) Facilitating establishment: According to one aspect of the present invention, the established link between the flow path representation and the image of the bioprocess system 10 is used to facilitate the establishment of a new process or the modification of an existing process. The method includes the following sub-steps: - Identifying or constructing a flowchart diagram representing the new process or the modified process. - Using the established link between the flow path representation and the image of the bioprocess system 10 to generate one or a combination of the following: -- An enhanced image of the bioprocess system, which illustrates how the pipe 51 should be connected to the unit; -- A series of enhanced images, which step by step illustrate how each pipe connection or the selection of pipes should be connected to the unit; -- An enhanced live view of the bioprocess system 10, which step by step illustrates how each pipe connection or the selection of pipes should be connected to the unit.

[0055] Figure 4d Illustrated in

[0056] is how a live view or a still image can indicate the locations where individual pipe connections should be made, see the dashed circles and arrows at the top of the image, indicating in which hand-tight fittings the two ends of the pipe should be connected.

[0057] A non-limiting example of the implementation of the method according to the present invention is illustrated in the flowchart of Figure 5 and includes the following steps: 501 Capture an image of the bioprocess system 10 provided with the pipe 10. 502 Analyze the captured image to identify at least part of the conduit 50. Optionally use the prior knowledge as described above. 503 Determine whether the conduit and optionally other features from the captured image are sufficiently identified. For example, most of the conduit may be identifiable, but in a certain part of the captured image, individual conduit connections appear to overlap such that the image analysis routine cannot resolve the individual conduit connections in that part. If sufficient, proceed to generate the processed representation in step 520. If not sufficient, proceed in step 506 to an evaluation of how the image can be improved. 506 Determine whether more images should be captured. If more images should be captured, proceed to step 508. If it is determined that more images will not result in improvement, although the features are not fully identified, proceed to step 507. 507 Indicate that not all conduits and / or all other features may be identifiable, optionally including information on the location and extent of problem areas of the image. The processed representation may still be of value and thus proceed to generate the processed representation (step 520). This step may include a confirmation procedure where the user approves / does not approve further generation of the processed representation. 508 Identify one or more problem areas, such as areas with unrecognized or unresolved conduits. 509 Select an appropriate effective action, such as moving a tube. A predefined set of effective actions is available and the selection is based on the analysis of the problem area. 510 Notify the operator about the selected effective action and how it should be performed and which section of the bioprocess system it pertains to. Go to the capture step 501. 520 Generate a processed representation in which at least part of the conduit 50 is identified. Optionally also identify other features, such as module 20 and column 25. 521 Examine the process running on the bioprocess system 10 by comparing the processed representation with a flow path representation (such as a flow path diagram). The examination may include 512: - Generate an enhanced image indicating the flow path in use. - Generate an enhanced live view image following the development of the process. - Troubleshoot, such as finding and indicating missing parts of the conduit. - Assist in the setup of the bioprocess system by indicating how the conduits should be connected. - Collect user data.

[0058] As those skilled in the art will clearly understand, the described embodiments can be combined. For example, an embodiment of using the method according to the present invention to assist in the establishment of a biological process system can be advantageously combined with using the method according to the present invention for troubleshooting. In many cases, synergistic effects can be achieved by using the individual embodiments in combination. For example, if the method according to the present invention for collecting user data is implemented, the results of such collection and the processing of the user data (such as suggestions for improving the process) can be presented to the user in an enhanced live view.

Claims

1. A method for automatic configuration detection in a biological process system, the method comprises the following steps: Form a network of pipes in the biological process system, wherein the network of pipes is a network of disposable pipes for fluid communication between units of the biological process system; Capture at least one of one or more images and videos of the biological process system including the network of pipes; Analyze the at least one captured image and / or video in an analysis routine to identify at least a part of the pipes connecting the units of the biological process system; Generate a processed representation from the at least one captured image and / or video, wherein at least a part of the pipe connections is identified; Inspect the process defined by the flow path representation in the biological process system, including comparing the processed representation with the flow path representation to inspect their functional consistency.

2. The method according to claim 1, comparing the processed representation with the flow path representation to identify faulty connections and / or missing parts of the pipes.

3. The method according to claim 1 or 2, further comprises: Generate an enhanced live view image of the biological process system, the image showing at least one step in the process represented by the flow path representation, and visually mark the parts of the pipes and units participating in a specific process step in the enhanced live view image using the processed representation.

4. The method according to claim 1 or 2, wherein, the analysis step further comprises: Determine whether additional images and / or videos are available for extracting the information required to generate the processed representation, and if it is determined that the additional images and / or videos are useful, issue a notice to capture additional images and / or videos.

5. The method according to claim 4, wherein, the analysis step further comprises: Determine whether the pipes and optionally other features are sufficiently identified from the at least one captured image and / or video, and if it is determined to be sufficient, continue to generate the processed representation, and if it is determined to be insufficient, continue to evaluate whether more images and / or videos should be captured; Determine whether more images and / or videos should be captured, and if more images and / or videos should be captured, continue to identify problem areas, and if it is determined that more images and / or videos will not improve the processed representation, continue to indicate; Indicate that a certain part of the feature and / or pipe is not identified, and continue to generate the processed representation; Identify problem areas in the at least one captured image and / or video and continue to select effective actions; Based on the analysis of the problem areas, select a suitable effective action from a predefined list of effective actions; Notify the operator about the selected effective action and how it should be executed and return to the capture step.

6. The method according to claim 1 or 2, wherein, the inspection step further comprises: Establish a link between the flow path representation and the processed representation; Generate an enhanced image, wherein the pipes and units belonging to a specific flow path have a common identifier.

7. The method according to claim 6 further includes providing setup assistance for modification of an existing system or a new process.

8. The method according to claim 7 further includes: identifying or constructing a flow path diagram representing the new process or the modified process; using the link established between the flow path representation and the processed representation to generate at least one of the following: an enhanced image of the bioprocess system showing how the pipes should be connected to the unit; a series of enhanced images showing step by step how each pipe connection or pipe selection should be connected to the unit; and an enhanced live view of the bioprocess system showing step by step how each pipe connection or pipe selection should be connected to the unit.

9. A system for automatic configuration detection in a bioprocess system, the system includes: a bioprocess system arranged to run a process defined by a flow path representation, a memory configured to store instructions for the automatic configuration detection, a processor, a GUI, and a photographic device configured to execute the instructions, wherein the photographic device is adapted to capture at least one image and / or video of the bioprocess system, the bioprocess system including a network of pipes, wherein the network of pipes is a network of disposable pipes for fluid communication between units of the bioprocess system, and the photographic device is adapted to transmit the at least one image and / or video to the processor; when the processor executes the instructions, the processor is configured to: receive the at least one captured image and / or video from the photographic device, accommodate an analysis routine adapted to analyze the at least one captured image and / or video to identify at least a part of the pipe connection units of the bioprocess system; generate a processed representation from the at least one captured image and / or video, wherein at least a part of the pipe connection is identified; present the processed representation on the GUI; and verify the process in the bioprocess system by comparing the processed representation with the flow path representation to check their functional consistency.

10. The system according to claim 9 when the instructions are executed by the processor.

Images