Sample visualization tracing method and system of automatic process and electronic equipment

Abstract

The embodiment of the invention provides a sample visualization tracing method and system of an automatic process and electronic equipment. The sample visualization tracing method for the automatic process comprises the following steps: acquiring an execution sequence of a plurality of operation nodes in the automatic process and visualization configuration information corresponding to each operation node, and displaying visualization modules connected according to the execution sequence according to the execution sequence and the visualization configuration information corresponding to the plurality of operation nodes, the displayed visualization module is a visualization module configured by a plurality of operation nodes. Therefore, by configuring the visual modules for the operation nodes and connecting and displaying the visual modules according to the execution sequence of the operation nodes, the position change of the to-be-traced sample in the automatic process can be visualized according to the execution sequence of the operation nodes, and a user can visually observe and know the execution state of the automatic process conveniently.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of automation. More particularly, it relates to a sample visualized trace method of an automation process, a sample visualized trace system of an automation process, an electronic device and a storage medium. BACKGROUND

[0002] With the development of science and technology, many fields are constantly achieving automation, so as to achieve the purpose of liberating manpower and improving efficiency. Whether it is automation manufacturing, automation detection or automation test / experiment, etc., an automation operation system will be used a lot. In the automation operation system, the whole automation process is usually disassembled into multiple operation nodes to adapt to the automation needs in different scenarios. For example, in the field of automated biochemistry, an automated experiment can be performed on a sample (e.g., a target liquid), and the experimental process of the automated experiment can include multiple operation nodes, which can be automatically executed by experimental equipment.

[0003] During the execution of the automation process, the position of the sample in the sample placement area after passing through different operation nodes can change. In the related art, there is a lack of display technology for the change of the sample position. SUMMARY

[0004] The present application is proposed in view of the above problems.

[0005] According to an aspect of the present application, a sample visualized trace method of an automation process is provided. The automation process includes multiple operation nodes executed by an automation operation system for a sample and an execution order of the multiple operation nodes, and the sample visualized trace method of the automation process includes:

[0006] obtaining the execution order of the multiple operation nodes and corresponding visualized configuration information of each operation node in the automation process, wherein the visualized configuration information is used to represent configuration information of a visualized module on the corresponding operation node, the visualized module in the automation process is used to display position trace information of a to-be-traced sample in the automation process, and the position trace information is used to indicate a position change of the to-be-traced sample;

[0007] displaying the visualized modules connected in the execution order according to the execution order and the corresponding visualized configuration information of the multiple operation nodes, wherein the displayed visualized modules are the visualized modules configured for the multiple operation nodes.

[0008] Exemplarily, the visualized module includes a sample disc template, the sample disc template includes at least one sample site, and each sample site in the sample disc template represents a single position in a sample placement area of the operation node corresponding to the sample disc template.

[0009] According to the execution sequence and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected according to the execution sequence are displayed, including: according to the execution sequence and the visualization configuration information corresponding to each operation node in the plurality of operation nodes, sequentially judging whether each operation node is configured with a visualization module, when the current operation node is configured with a visualization module and the visualization module is a non-first visualization module, creating a connection between the visualization module corresponding to the current operation node and the previous visualization module.

[0010] According to the execution sequence and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected according to the execution sequence are displayed, including: according to the execution sequence and the visualization configuration information corresponding to each operation node in the plurality of operation nodes, sequentially judging whether each operation node is configured with a visualization module, when the current operation node is configured with a visualization module and the visualization module is a non-first visualization module, creating a connection between the visualization module corresponding to the current operation node and the previous visualization module.

[0011] According to the execution sequence and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected according to the execution sequence are displayed, including: according to the execution sequence and the visualization configuration information corresponding to each operation node in the plurality of operation nodes, sequentially judging whether each operation node is configured with a visualization module, when the current operation node is configured with a visualization module and the visualization module is a non-first visualization module, creating a connection between the visualization module corresponding to the current operation node and the previous visualization module.

[0012] According to the execution sequence and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected according to the execution sequence are displayed, including: according to the execution sequence and the visualization configuration information corresponding to each operation node in the plurality of operation nodes, sequentially judging whether each operation node is configured with a visualization module, when the current operation node is configured with a visualization module and the visualization module is a non-first visualization module, creating a connection between the visualization module corresponding to the current operation node and the previous visualization module.

[0013] Exemplarily, the method further comprises: obtaining sample information of the at least one sample, wherein the sample information comprises a position of each sample in the at least one sample in a visualization module corresponding to a first operation node of the automated process; based on the sample information, controlling the automated operation system to execute the automated process for the at least one sample, and obtaining historical record information obtained by the execution of the automated process, the historical record information comprising sample position information of each sample in the at least one sample after execution of each operation node of the plurality of operation nodes, the sample position information comprising a position of the sample in a sample placement area corresponding to the operation node; determining a sample to be traced back in the at least one sample; determining, in the historical record information, sample position information corresponding to the sample to be traced back; and displaying, according to the sample position information corresponding to the sample to be traced back, position tracing information of the sample to be traced back on the displayed visualization module in the execution order of the plurality of operation nodes.

[0014] Exemplarily, the displaying, according to the sample position information corresponding to the sample to be traced back, the position tracing information of the sample to be traced back on the displayed visualization module in the execution order of the plurality of operation nodes comprises: sequentially highlighting the positions corresponding to the sample to be traced back on the visualization module in the execution order of the plurality of operation nodes, and / or connecting the positions corresponding to the sample to be traced back in adjacent two visualization modules to form a tracing line for the sample to be traced back, wherein the position tracing information comprises the highlighted positions and / or the tracing line.

[0015] According to another aspect of the present application, there is also provided a sample visualization tracing system of an automated process. The automated process comprises a plurality of operation nodes executed by an automated operation system for a sample and an execution order of the plurality of operation nodes, and the sample visualization tracing system of the automated process comprises an obtaining module and a display module. The obtaining module is configured to obtain the execution order of the plurality of operation nodes and visualization configuration information corresponding to each operation node in the automated process, wherein the visualization configuration information is used to represent configuration information of a visualization module on the corresponding operation node, and the visualization module in the automated process is used to display position tracing information of a sample to be traced back in the automated process, the position tracing information being used to indicate a position change of the sample to be traced back. The display module is configured to display the visualization modules connected in the execution order according to the execution order and the visualization configuration information corresponding to the plurality of operation nodes, wherein the displayed visualization modules are the visualization modules configured for the plurality of operation nodes.

[0016] According to still another aspect of the present application, there is also provided an electronic device comprising a processor and a memory, the memory storing computer program instructions, the computer program instructions being configured to cause the processor to execute the sample visualization tracing method of the automated process as described above.

[0017] According to still another aspect of the present application, there is also provided a storage medium having stored thereon program instructions which, when executed, implement the sample visualized trace method of an automated process as described above.

[0018] In the above technical solution, based on the execution sequence of the plurality of operation nodes in the automated process and the visualized configuration information, the visualized modules connected in the execution sequence are displayed, and the visualized modules are used to display the position trace information of the sample to be traced in the automated process. In this way, by configuring the visualized modules for the operation nodes and displaying the visualized modules according to the execution sequence of the operation nodes, the change of the position of the sample to be traced in the automated process can be visualized according to the execution sequence of the operation nodes, which facilitates the user to intuitively observe and understand the execution state of the automated process.

[0019] The above description is only a summary of the technical solutions of the present application. In order to enable one skilled in the art to better understand the technical means of the present application, the present application can be implemented according to the content of the specification, and in order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific embodiments of the present application are described below. BRIEF DESCRIPTION OF DRAWINGS

[0020] The above and other purposes, features and advantages of the present application will become more apparent from the following detailed description of the embodiments of the present application, taken in conjunction with the accompanying drawings. The accompanying drawings are intended to provide a further understanding of the embodiments of the present application and constitute a part of the specification, together with the embodiments of the present application, to explain the present application and do not constitute a limitation of the present application.

[0021] Figure 1 A schematic flowchart of a sample visualized trace method of an automated process according to an embodiment of the present application is shown;

[0022] Figure 2 A schematic diagram of a human-computer interaction interface according to an embodiment of the present application is shown;

[0023] Figure 3 A schematic block diagram of a sample disc template according to an embodiment of the present application is shown;

[0024] Figure 4 A schematic diagram of position trace information of a preset trace sample according to an embodiment of the present application is shown;

[0025] Figure 5 A schematic diagram of position trace information of a preset trace sample according to another embodiment of the present application is shown;

[0026] Figure 6 A schematic block diagram of a sample visualized trace system of an automated process according to an embodiment of the present application is shown;

[0027] Figure 7 A schematic block diagram of an electronic device according to an embodiment of the present invention is shown. Detailed Implementation

[0028] To make the objectives, technical solutions, and advantages of the present invention more apparent, exemplary embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are merely a subset of embodiments of the present invention.

[0029] To at least partially address the aforementioned technical problems, this invention provides a sample visualization and traceability method for automated processes. This method acquires the execution order of multiple operation nodes in the automated process and the visualization configuration information corresponding to each operation node, thereby displaying visualization modules connected in the execution order. Thus, the positional changes of the sample to be traced in the automated process can be visualized through the visualization modules according to the execution order of the operation nodes (this order can also be considered as the order of positional changes of the sample to be traced). This sample visualization and traceability method for automated processes can be applied to any electronic device, i.e., executed by any electronic device. Specifically, it can be applied to the processor of any electronic device, i.e., executed by the processor of any electronic device. The electronic device can be the automated device itself, or it can be an electronic device different from the automated device but capable of communicating with it (e.g., the control system described below). The communication connection described herein can be implemented using any wired and / or wireless connection method.

[0030] For example, Figure 1A schematic flowchart illustrating a sample visualization and traceability method for an automated process according to an embodiment of the present invention is shown. The automated process includes multiple operation nodes executed on a sample by an automated operating system and the execution order of these operation nodes. The automated process can consist of multiple operation nodes executed sequentially in the execution order. Each operation node can include at least one operation performed on the sample, and the operation can be performed by a corresponding automated device. For example, operation node A includes performing a movement operation and a centrifugation operation on the sample; the movement operation can be performed by a robotic arm, and the centrifugation operation can be performed by a centrifuge. It is understood that the multiple operation nodes of the automated process can be executed by an automated operating system, which can include automated devices and corresponding control systems. For example, automated devices can include robotic arms, centrifuges, vortex mixers, pipetting workstations, automated guided vehicles (AGVs), etc. The automated devices and corresponding control systems can be any existing or future-developed automated devices and corresponding control systems. Users can create automated processes as needed. For example, an automated process may include operation node 1, operation node 2, operation node 3 and operation node 4. The above four operation nodes can be executed in the order of 1, 2, 3 and 4. That is, after the operation corresponding to operation node 1 is completed, the operation corresponding to operation node 2 is executed.

[0031] like Figure 1 As shown, the sample visualization traceability method of this automated process includes steps S1100 and S1200.

[0032] In step S1100, the execution order of multiple operation nodes in the automated process and the visualization configuration information corresponding to each operation node are obtained. The visualization configuration information represents the configuration information of the visualization module on the corresponding operation node. The visualization module in the automated process displays the position tracing information of the sample to be traced within the automated process, and the position tracing information indicates the positional changes of the sample to be traced. The visualization module can be a graphical display of the physical sample placement area in the human-computer interaction interface. For example, the sample placement area can be a 48-well microplate, and the visualization module corresponding to the sample placement area can be a two-dimensional image generated according to the 48-well microplate (the image content is the 48-well microplate) or a three-dimensional model obtained by modeling according to the 48-well microplate. Each operation node in the automated process can have visualization configuration information. The visualization configuration information represents the configuration information of the visualization module on the corresponding operation node, i.e., the configuration status. For example, the visualization configuration information may include first information or include both first and second information, etc. The first information indicates whether the operation node corresponds to a visualization module, and the second information indicates the type of visualization module corresponding to the operation node. When the visualization configuration information includes both first and second information, the visualization configuration information of each operation node can be used to determine which operation nodes in the automated process correspond to visualization modules and the types of those modules. It can be understood that at least one operation node in the automated process can correspond to a visualization module. During the execution of the automated process, samples can move within the sample placement area corresponding to the operation node, meaning the sample position changes. The visualization module can display the physical sample placement area, thus showing the sample's position. Based on the position of the sample to be traced in each visualization module, the location tracing information of the sample to be traced in the automated process can be displayed on the visualization module. The sample to be traced can be a user-selected sample or a preset sample. Location tracing can be used to indicate the position change of the sample to be traced during the execution of the automated process. For example, the position corresponding to the sample to be traced can be highlighted on the visualization module; the highlighted position can be the location tracing information, indicating the position change of the sample to be traced. Another example is that, according to the execution order of the multiple operation nodes in the automated process, the positions of the samples to be traced in the visualization module can be connected sequentially; the connecting lines can be the location tracing information, indicating the position change of the sample to be traced.

[0033] For example, automated processes can be created by the user. In response to user settings, the automated process can include operational nodes and their corresponding visual configuration information. After creation, the execution order of the operational nodes and their corresponding visual configuration information can be obtained. For instance, a process file can be generated to store relevant information. This process file can be read to obtain the execution order of the operational nodes and their corresponding visual configuration information. Alternatively, automated processes can be pre-configured, meaning the user doesn't need to create the process; the operational nodes and their corresponding visual configuration information can be obtained automatically. For example, a pre-configured automated process can be used for general experiments / trials, eliminating the need for user creation.

[0034] In step S1200, based on the execution order and the visualization configuration information corresponding to multiple operation nodes, visualization modules connected in the execution order are displayed. The displayed visualization modules are those configured for the multiple operation nodes. The visualization modules configured for each operation node can be determined based on the visualization configuration information corresponding to the operation nodes in the automated process. The visualization modules corresponding to multiple operation nodes in the automated process can be connected and displayed sequentially according to their execution order. The electronic device used for executing the sample visualization traceability method of the automated process may include an output device or be communicatively connected to an output device. The output device may include a display, etc. A human-machine interface can be provided, and the human-machine interface can be displayed on the display screen. The visualization modules connected in the execution order can be displayed in the human-machine interface. For example, the automated process may include operation nodes A, B, C, and D, and operation nodes A, B, and D are configured with visualization modules. The visualization modules corresponding to operation nodes A, B, and D can be displayed in the human-machine interface. Figure 2 A schematic diagram of a human-computer interaction interface according to an embodiment of the present invention is shown. Figure 2 As shown, the human-computer interaction interface displays a visualization module corresponding to operation node A, operation node B, and operation node D. The visualization module corresponding to operation node A is connected to the visualization module corresponding to operation node B, and the visualization module corresponding to operation node B is connected to the visualization module corresponding to operation node D.

[0035] In the above technical solution, based on the execution order and visualization configuration information of multiple operation nodes in the automated process, visualization modules connected in the execution order are displayed. These visualization modules are used to display the location tracking information of the sample to be traced in the automated process. Therefore, by configuring visualization modules for the operation nodes and connecting and displaying these modules according to the execution order of the operation nodes, the location changes of the sample to be traced in the automated process can be visualized according to the execution order of the operation nodes, making it easier for users to intuitively observe and understand the execution status of the automated process.

[0036] For example, the visualization module includes a sample tray template, which includes at least one sample bit. Each sample bit in the sample tray template represents a single position within the sample placement area of ​​the operation node corresponding to the sample tray template. The sample tray template can be a simplified model of the sample placement area, and can include at least one sample bit, which can concisely display the position of the sample. A sample bit can be a graphical representation of the physical position of the sample within the corresponding sample placement area in the human-computer interaction interface. That is, each sample bit represents a single position within the sample placement area, which is the operation area of ​​the operation node corresponding to the sample tray template.

[0037] For example, the sample tray template can be a graphic template corresponding to a 16-well cell culture plate in the human-computer interaction interface, and each of the 16 wells can correspond to a sample position. Figure 3 A schematic block diagram of a sample tray template according to an embodiment of the present invention is shown. Figure 3 As shown, the sample tray template can be a rectangle with 16 circles inside. Each circle can represent a sample position. This sample tray template can correspond to a target preset operation node A, and the operation corresponding to the target preset operation node A can be executed on the sample in the sample position. The sample tray template can be used to display the position of the sample.

[0038] In the above technical solution, the visualization module includes a sample tray template, which includes at least one sample position. Each sample position in the sample tray template represents a single location within the sample placement area of ​​the operation node corresponding to the sample tray template. Therefore, the sample position can be concisely displayed through the sample positions in the sample tray template, making it easy for users to determine the positional changes of the sample to be traced.

[0039] For example, step S1200, which displays visualization modules connected in the execution order according to the execution order and the visualization configuration information corresponding to multiple operation nodes, includes step S1210. In step S1210, based on the execution order and the visualization configuration information corresponding to each operation node among the multiple operation nodes, it is sequentially determined whether each operation node is configured with a visualization module. If the current operation node is configured with a visualization module and this visualization module is not the first visualization module, then a connection is created between the visualization module corresponding to the current operation node and the previous visualization module. Multiple operation nodes in an automated process can each correspond to visualization configuration information. The visualization configuration information of each operation node can determine whether it is configured with a visualization module. For multiple operation nodes in an automated process, the execution order of the multiple operation nodes can be followed, and the visualization configuration information of each operation node can be used to determine whether the operation node is configured with a visualization module. During the process of sequentially determining whether an operation node is configured with a visualization module, if the current operation node is configured with a visualization module and this visualization module is not the first visualization module in the automated process, then a connection is created between the visualization module corresponding to the current operation node and the previous visualization module. The connecting lines can be straight or curved, solid or dashed, and can be of any form.

[0040] For example, an automated process may include operation node 1, operation node 2, operation node 3, and operation node 4. First, based on the visualization configuration information of operation node 1, it can be determined that operation node 1 corresponds to visualization module 1, which is the first visualization module. Then, based on the visualization configuration information of operation node 2, it can be determined that operation node 2 corresponds to visualization module 2, which is not the first visualization module. A connection can then be created between visualization module 2 and visualization module 1 (the previous visualization module of visualization module 2). Based on the visualization configuration information of operation node 3, it can be determined that operation node 3 is not configured with a visualization module. Based on the visualization configuration information of operation node 4, it can be determined that operation node 4 corresponds to visualization module 3, and a connection can then be created between visualization module 3 and visualization module 2 (the previous visualization module of visualization module 3).

[0041] In the above technical solution, based on the execution order and the visualization configuration information corresponding to each of the multiple operation nodes, it is sequentially determined whether each operation node is configured with a visualization module. If the current operation node is configured with a visualization module and this visualization module is not the first visualization module, then a connection is created between the visualization module corresponding to the current operation node and the previous visualization module. This better indicates the execution order of the automated process steps, facilitating the display of the location tracking information of the sample to be traced to the user.

[0042] For example, after step S1200 displays the visualization modules connected in the execution order according to the execution order and the visualization configuration information corresponding to the multiple operation nodes, the sample visualization traceability method for the automated process further includes step S1300. In step S1300, in response to the preview operation, the visualization modules configured for the multiple operation nodes are displayed in the human-computer interaction interface, and based on the preset location information of the preset traceability sample, the position traceability information of the preset traceability sample is displayed on the displayed visualization modules according to the execution order of the multiple operation nodes. The preset location information is used to indicate the position of the preset traceability sample in the corresponding visualization module. Before the automated process is executed, the user can preview the position changes of the preset traceability sample through the preview operation. The electronic device used to execute the sample visualization traceability method for the automated process may include an input device or be communicatively connected to an input device. For example, the input device may include, but is not limited to, one or more of a mouse, keyboard, trackball, touchpad, touch screen, microphone, etc. The user can use the input device to perform various user operations described herein, such as the preview operation. Users can perform any operation through an input device in ways including, but not limited to: triggering controls in the human-computer interaction interface (HCI) via a mouse, touchscreen, etc.; inputting voice commands via a microphone; inputting operation commands corresponding to keyboard shortcuts, etc. Users can perform preview operations using the input device. For example, the HCI may have a preview control, which can be clicked to perform a preview operation. In response to a preview operation, the visualization modules configured for multiple operation nodes of the automated process can be displayed in the HCI. For example, the HCI can provide a new display window, in which the corresponding visualization modules can be displayed according to the execution order of multiple operation nodes. Preset position information is used to indicate the position of a preset traceability sample in the corresponding visualization module. In some embodiments, the position change of the preset traceability sample during the execution of the automated process can be simulated based on multiple operation nodes of the automated process, thereby determining the position of the preset traceability sample in the visualization module of the automated process. In other embodiments, the preset position information of the preset traceability sample may include the preset position of each visualization module, that is, the position change of the preset traceability sample is set to move sequentially to the preset position of each visualization module. Based on the preset location information of the preset traceability sample, the specific location of the preset traceability sample in the visualization module can be determined, thereby displaying the location traceability information of the preset traceability sample.

[0043] In some embodiments, the location tracing information of a preset traceability sample may include highlighting the position of the preset traceability sample in the visualization module with a color different from other samples. Different preset traceability samples may have different highlight colors, and the user can determine the position change of the preset traceability sample based on the highlighted position. For example, multiple operation nodes in an automated process correspond to visualization modules 1, 2, and 3. Based on the preset location information of the preset traceability sample, the position of the preset traceability sample can be highlighted in visualization modules 1, 2, and 3 respectively to display the location tracing information of the preset traceability sample, thereby indicating the expected position change of the preset traceability sample. In other embodiments, the positions of the preset traceability samples in the visualization module can be sequentially connected according to the execution order of multiple operation nodes to indicate the position change of the preset traceability sample. Taking an automated process with multiple operation nodes corresponding to visualization modules 1, 2, and 3 as an example, a line can be drawn connecting the position of the preset traceability sample in visualization module 1 to its position in visualization module 2, and vice versa, to display the position traceability information of the preset traceability sample and thus indicate the expected position change of the preset traceability sample. The display of the position traceability information of the preset traceability sample can be achieved in any manner.

[0044] In the above technical solution, in response to the preview operation, the visualization modules configured for multiple operation nodes are displayed in the human-computer interaction interface. Based on the preset location information of the preset traceability sample, the location traceability information of the preset traceability sample is displayed on the displayed visualization modules according to the execution order of the multiple operation nodes. This allows users to preview the position change trend of the sample in the created automated process, enabling them to understand the status after the automated process is executed, determine whether the automated process is created reasonably, and thus improve the efficiency and accuracy of users in creating automated processes.

[0045] For example, step S1300, based on the preset location information of the preset traceability sample, displays the location traceability information of the preset traceability sample on the displayed visualization module according to the execution order of multiple operation nodes, including step S1310. In step S1310, according to the execution order of multiple operation nodes, the positions corresponding to the preset traceability samples on the visualization module are highlighted sequentially, and / or the positions corresponding to the preset traceability samples in two adjacent visualization modules are connected to form a traceability line for the preset traceability sample. The location traceability information includes the highlighted positions and / or the traceability lines. The preset location information may include the position of the preset traceability sample in the visualization module corresponding to the operation node of the automated process.

[0046] In some embodiments, the position of a preset traceability sample in the visualization module corresponding to an operation node in the automated process can be determined based on preset location information. According to the position of the preset traceability sample in the visualization module, and following the execution order of multiple operation nodes in the automated process, the positions corresponding to the preset traceability samples are sequentially highlighted on the visualization module. Different preset traceability samples can be highlighted with different colors. Users can determine the position changes of the preset traceability samples based on the highlighted positions. Figure 4 A schematic diagram illustrating the location tracing information of a preset traceability sample according to an embodiment of the present invention is shown. Figure 4 As shown, the position of the second column in the first row of visualization module 1 corresponding to operation node A is highlighted, the position of the second column in the first row of visualization module 2 corresponding to operation node B is highlighted, and the position of the first column in the second row of visualization module 3 corresponding to operation node C is highlighted. This demonstrates the positional changes of the preset traceability sample within the sample placement area corresponding to the visualization module during the expected execution of the automated process. For simplicity, Figure 4 The visualization modules corresponding to other operation nodes after operation node C are not shown, but they can clearly show the display method of the location tracing information of the preset traceability sample.

[0047] In other embodiments, based on the position of the preset traceability sample in each visualization module, the positions corresponding to the preset traceability sample in adjacent visualization modules can be connected to form a traceability line for the preset traceability sample. Figure 5 A schematic diagram illustrating the location tracing information of a preset traceability sample according to another embodiment of the present invention is shown. Figure 5 As shown, the position of the second column in the first row of the visualization module 1 corresponding to operation node A is connected to the position of the second column in the first row of the visualization module 2 corresponding to operation node B, and the position of the second column in the first row of the visualization module 2 corresponding to operation node B is connected to the position of the first column in the second row of the visualization module 3 corresponding to operation node C. Figure 5 The lines connecting the positions in the middle are called traceability lines. Traceability lines can have arrows, which indicate the direction of sample movement. This allows us to display the positional changes of the pre-defined traceability sample within the corresponding sample placement area in the visualization module during the expected execution of the automated process.

[0048] Optionally, while highlighting the location corresponding to the traceability sample on the visualization module, the locations corresponding to the traceability samples on two adjacent visualization modules can be connected.

[0049] In the above technical solution, the positions corresponding to the preset traceability samples on the visualization module are highlighted sequentially according to the execution order of multiple operation nodes. This highlights the positions of the preset traceability samples on the visualization module, allowing for better identification of their locations. Connecting the positions corresponding to the preset traceability samples in adjacent visualization modules forms a traceability line. This traceability line better indicates changes in the position of the preset traceability samples. Simultaneously highlighting the positions of the preset traceability samples on the visualization module and connecting the positions of the preset traceability samples in adjacent visualization modules both better identify the preset traceability samples and better indicate their positional changes, thus providing insight into the execution status of the automated process.

[0050] For example, step S1300, based on the preset location information of the preset traceability sample, displays the location traceability information of the preset traceability sample on the displayed visualization module according to the execution order of multiple operation nodes, including step S1320. In step S1320, the location of the preset traceability sample is randomly determined on each visualization module configured by the multiple operation nodes to display the location traceability information of the preset traceability sample on the displayed visualization module. Each visualization module may have at least one location for displaying the sample. For the visualization modules configured by the multiple operation nodes of the automated process, any location for displaying the sample can be randomly determined in each visualization module as the location of the preset traceability sample to display the location traceability information of the preset traceability sample on the displayed visualization module. It can be understood that when there is no preset location information of the preset traceability sample, the location traceability information of the preset traceability sample can be displayed on the visualization module by randomly determining the location of the preset traceability sample in the visualization module. The visualization module may include a sample tray template, which may have at least one sample position. In the sample tray templates configured in multiple operation nodes, any sample position can be randomly determined as the position of the preset traceability sample in the sample tray template, so as to display the position traceability information of the preset traceability sample on the sample tray template when there is no preset position information of the preset traceability sample.

[0051] In the above technical solution, the location of a preset traceability sample is randomly determined on each visualization module configured on multiple operation nodes, so that the location traceability information of the preset traceability sample is displayed on the displayed visualization module. Therefore, even when there is no preset location information for the preset traceability sample, the location traceability information can still be displayed, ensuring the display of location traceability information and improving the user experience.

[0052] For example, the sample visualization traceability method for automated processes further includes steps S1400, S1500, S1600, S1700 and S1800.

[0053] In step S1400, sample information for at least one sample is obtained. This sample information includes the position of each sample within the visualization module corresponding to the first operation node of the automated process.

[0054] An automated process can sequentially execute operations corresponding to multiple operation nodes for a sample in an execution order. It can be understood that the position of the sample can change sequentially as the automated process executes. Before the automated process begins execution, the position of the sample can be its position in the visualization module corresponding to the first operation node of the automated process. Sample information can include the position of at least one sample to be executed by the automated process in the visualization module corresponding to the first operation node of the automated process. Sample information can be obtained in any way. In some embodiments, a sample information file can be received to obtain sample information for at least one sample. In other embodiments, the user can set the position of the sample in the visualization module corresponding to the first operation node to obtain sample information for at least one sample.

[0055] In step S1500, based on the sample information, the automated operating system is controlled to execute an automated process for at least one sample, and historical record information obtained from the execution of the automated process is acquired. The historical record information includes the sample position information after each of the multiple operation nodes in the at least one sample has been executed. The sample position information includes the position of the sample in the sample placement area corresponding to the operation node.

[0056] Based on sample information, the position of a sample in the first operation node of an automated process can be determined, thereby controlling the automated operating system to execute the automated process for at least one sample. For example, an automated process may include operation nodes A, B, and C, with operation node A being the first operation node. Based on the sample information, the position of the sample in operation node A can be determined, and then the operations corresponding to operation nodes A, B, and C can be executed sequentially for the sample. During the execution of operations corresponding to multiple operation nodes by the automated operating system for a sample, the automated operating system can record the sample position information in real time after the operation corresponding to each operation node is completed, i.e., record historical information. In other words, the automated operating system can record changes in sample position during the execution of the automated process. Historical information can be obtained from the automated operating system. The historical information can record the sample position information after each sample has executed the operation corresponding to each of the multiple operation nodes. The sample position information can be used to indicate the position of the sample within the sample placement area after the operation corresponding to the operation node is completed. For example, an automated process can include operation nodes A, B, and C. It can record the position of the sample within the sample placement area after the operation corresponding to operation node A is completed, the position of the sample within the sample placement area after the operation corresponding to operation node B is completed, and the position of the sample within the sample placement area after the operation corresponding to operation node C is completed. In other words, the sample position information can indicate the position of the sample within the sample placement area at a specific moment. This specific moment refers to the moment after the operation corresponding to that operation node is completed; simply put, it's the position of the sample after the operation node is completed. The sample placement area can be used to store samples. The sample placement area can be the area where the sample is stored after the operation node for a particular sample is completed; this area is the sample placement area corresponding to that operation node. The sample placement area can correspond to a visualization module, and based on the sample position information, the position of the sample in the visualization module can be determined.

[0057] In step S1600, a traceable sample is determined from at least one sample. Any one or more samples can be determined as traceable samples in response to a user's selection operation. In some embodiments, a single selection operation can select one sample as a traceable sample. The user can select multiple samples as traceable samples through multiple selection operations. In other embodiments, a single selection operation can select at least one sample as a traceable sample. For example, traceable samples can be displayed via a menu, and a traceable sample can be selected from the displayed samples. Alternatively, a visualization module can be displayed on a human-computer interaction interface, and the traceable sample can be determined within the visualization module.

[0058] In step S1700, the sample location information corresponding to the sample to be traced is determined from the historical record information. The historical record information records the sample location information after each sample has performed an operation at each of the multiple operation nodes. For example, each sample can be assigned a corresponding identifier in the historical record information. The sample location information of the sample to be traced can be queried from the historical record information based on the identifier of the sample to be traced, and used as the target sample location information. For example, if the identifier of the sample to be traced is 05, the sample location information of the sample with identifier 05 can be determined from the historical record information to obtain the sample location information corresponding to the sample to be traced.

[0059] In step S1800, based on the sample location information corresponding to the sample to be traced, and according to the execution order of multiple operation nodes, the location tracing information of the sample to be traced is displayed on the visualization module. Based on the sample location information corresponding to the sample to be traced, the position of the sample to be traced in the visualization module can be determined, and thus the location tracing information of the sample to be traced can be displayed in the visualization module. The display method of the location tracing information of the sample to be traced is similar to the display method of the location tracing information of the preset traceable sample, and can be referred to step S1300 above. For simplicity, it will not be described again here.

[0060] In the above technical solution, sample information of at least one sample is obtained. Based on the sample information, the automated operating system is controlled to execute an automated process for at least one sample, and historical information obtained from the execution of the automated process is acquired to determine the sample to be traced. The sample location information corresponding to the sample to be traced is determined, and then the location tracing information of the sample to be traced is displayed on the visualization module according to the execution order of multiple operation nodes. Thus, the sample information includes the position of the sample in the visualization module corresponding to the first operation node, which provides the starting point for the execution of the automated process. The historical information stores the position of the sample after completing the corresponding operation node. Based on the historical information, the position change of the sample in the automated process can be determined, and the location tracing information of the sample to be traced is presented through the visualization module, making it convenient for users to observe the position change of the sample to be traced and understand the execution status of the automated process.

[0061] For example, step S1800 includes step S1810. In step S1810, according to the execution order of multiple operation nodes, the positions corresponding to the samples to be traced on the visualization modules are highlighted sequentially, and / or the positions corresponding to the samples to be traced in two adjacent visualization modules are connected to form a traceability line for the samples to be traced, wherein the location traceability information includes the highlighted positions and / or traceability lines.

[0062] Based on the sample location information corresponding to the sample to be traced, the position of the sample in the visualization module can be determined. The positions of the traceable samples can be highlighted sequentially on the visualization module according to the execution order of multiple operation nodes in the automated process. Multiple visualization modules can be provided, and during the execution of the automated process, the position of the sample in the visualization module can be displayed in real time after the operation nodes are completed. The specific highlighting method can be referred to in step S1310 above. Figure 4 For the sake of brevity, details will not be elaborated here. After determining the position of the sample to be traced in the visualization module, a line can be drawn connecting the corresponding positions of the samples to be traced in two adjacent visualization modules to form a traceability line for the sample. The display method of the traceability line can refer to steps S1310 above. Figure 5 For the sake of brevity, I will not go into details here.

[0063] In the above technical solution, the positions of the samples to be traced on the visualization module are highlighted sequentially according to the execution order of multiple operation nodes. Highlighting helps to better determine the position of the samples to be traced. Connecting the positions of the samples to be traced in adjacent visualization modules forms a traceability line. This traceability line better indicates changes in the position of the samples to be traced. Simultaneously highlighting the positions of the samples to be traced on the visualization module and connecting the positions of the samples to be traced in adjacent visualization modules both better determine the samples to be traced and better indicate changes in their position, thus providing insight into the execution status of the automated process.

[0064] By way of example, according to another aspect of the present invention, a sample visualization traceability system for automated processes is also provided. Figure 6 A schematic block diagram of a sample visualization traceability system 600 with an automated process according to an embodiment of the present invention is shown. The automated process includes multiple operation nodes executed by an automated operating system for a sample and the execution order of the multiple operation nodes. The sample visualization traceability system 600 with an automated process includes an acquisition module 610 and a display module 620.

[0065] The acquisition module 610 is used to acquire the execution order of multiple operation nodes in the automated process and the visualization configuration information corresponding to each operation node. The visualization configuration information represents the configuration information of the visualization module on the corresponding operation node. The visualization modules in the automated process are used to display the location tracking information of the sample to be traced in the automated process, and the location tracking information indicates the location change of the sample to be traced. The display module 620 is used to display the visualization modules connected in the execution order according to the execution order and the visualization configuration information corresponding to the multiple operation nodes. The displayed visualization modules are the visualization modules configured for the multiple operation nodes.

[0066] For example, the visualization module includes a sample tray template, which includes at least one sample bit. Each sample bit in the sample tray template represents a single position within the sample placement area of ​​the operation node corresponding to the sample tray template.

[0067] For example, the display module 620 includes a first display submodule. The first display submodule is used to determine whether each operation node is configured with a visualization module according to the execution order and the visualization configuration information corresponding to each operation node among multiple operation nodes. When the current operation node is configured with a visualization module and the visualization module is not the first visualization module, a connection is created between the visualization module corresponding to the current operation node and the previous visualization module.

[0068] For example, the sample visualization traceability system 600 for automated processes includes a preview module. In response to a preview operation, the preview module displays the visualization modules configured for multiple operation nodes in a human-computer interaction interface. Based on preset location information of the preset traceability sample, and according to the execution order of the multiple operation nodes, the preview module displays the location traceability information of the preset traceability sample on the displayed visualization modules, wherein the preset location information indicates the position of the preset traceability sample in the corresponding visualization module.

[0069] For example, the preview module includes a first preview submodule. The first preview submodule is used to sequentially highlight the positions corresponding to the preset traceability samples on the visualization module according to the execution order of multiple operation nodes, and / or connect the positions corresponding to the preset traceability samples in two adjacent visualization modules to form a traceability line for the preset traceability samples, wherein the position traceability information includes the highlighted positions and / or traceability lines.

[0070] For example, the preview module includes a second preview submodule. The second preview submodule is used to randomly determine the location of a preset traceability sample on each visualization module configured on multiple operation nodes, so as to display the location traceability information of the preset traceability sample on the displayed visualization module.

[0071] For example, the sample visualization traceability system 600 for automated processes further includes a second acquisition module, a third acquisition module, a first determination module, a second determination module, and a second display module. The second acquisition module acquires sample information for at least one sample, wherein the sample information includes the position of each sample in the visualization module corresponding to the first operation node of the automated process. The third acquisition module controls the automated operating system to execute the automated process for at least one sample based on the sample information, and acquires historical record information obtained from the execution of the automated process. The historical record information includes sample position information after each of the multiple operation nodes is executed for each sample in the at least one sample, and the sample position information includes the position of the sample within the sample placement area corresponding to the operation node. The first determination module determines the sample to be traced among the at least one sample. The second determination module determines the sample position information corresponding to the sample to be traced from the historical record information. The second display module displays the position traceability information of the sample to be traced on the displayed visualization module according to the sample position information corresponding to the sample to be traced, following the execution order of the multiple operation nodes.

[0072] For example, the second display module includes a first display submodule. The first display submodule is used to sequentially highlight the positions corresponding to the samples to be traced on the visualization module according to the execution order of multiple operation nodes, and / or connect the positions corresponding to the samples to be traced in two adjacent visualization modules to form a traceability line for the samples to be traced, wherein the position traceability information includes the highlighted positions and / or traceability lines.

[0073] By way of example, according to another aspect of the present invention, an electronic device is also provided. Figure 7 A schematic block diagram of an electronic device 700 according to an embodiment of the present invention is shown. The electronic device 700 includes a processor 710 and a memory 720. The memory 720 stores computer program instructions, which, when executed by the processor 710, are used to perform the sample visualization traceability method of the automated process described above.

[0074] By way of example, according to another aspect of the present invention, a storage medium is also provided, on which program instructions are stored, which, when executed, are used to perform the sample visualization traceability method of the automated process described above. The storage medium may, for example, include an erasable programmable read-only memory (EPROM), a portable read-only memory (CD-ROM), a USB memory, or any combination of the above storage media. The storage medium may be any combination of one or more computer-readable storage media.

[0075] By way of example, according to another aspect of the present invention, a computer program product is also provided, including computer program instructions, which, when run, are used to perform a sample visualization traceability method for an automated process as described above.

[0076] Those skilled in the art can understand the specific implementation scheme and beneficial effects of the above-mentioned sample visualization traceability system, electronic equipment, storage medium and computer program product for automated processes by reading the relevant description of the sample visualization traceability method for automated processes. For the sake of brevity, they will not be described in detail here.

[0077] Although exemplary embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above exemplary embodiments are merely illustrative and are not intended to limit the scope of this application. Various changes and modifications can be made therein by those skilled in the art without departing from the scope and spirit of this application. All such changes and modifications are intended to be included within the scope of this application as claimed in the appended claims.

[0078] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0079] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed.

[0080] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of this application may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this specification.

[0081] Similarly, it should be understood that, in order to streamline this application and aid in understanding one or more of the various inventive aspects, features of this application may sometimes be grouped together in a single embodiment, figure, or description thereof in the description of exemplary embodiments of this application. However, this approach should not be construed as reflecting an intention that the claimed application requires more features than are expressly recited in each claim. Rather, as reflected in the corresponding claims, its inventive point lies in solving the corresponding technical problem with features fewer than all features of a single disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into that detailed description, wherein each claim itself is a separate embodiment of this application.

[0082] Those skilled in the art will understand that, apart from the mutual exclusion of features, all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or apparatus so disclosed can be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.

[0083] Furthermore, those skilled in the art will understand that although some embodiments described herein include certain features but not others included in other embodiments, combinations of features from different embodiments are intended to be within the scope of this application and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

[0084] The various component embodiments of this application can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some modules in a sample visualization traceability system for automated processes according to embodiments of this application. This application can also be implemented as an apparatus program (e.g., a computer program and computer program product) for performing part or all of the methods described herein. Such an implementation of this application can be stored on a computer-readable medium, or can take the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

[0085] It should be noted that the above embodiments are illustrative of this application and not restrictive, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. This application can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names.

[0086] The above description is merely a specific embodiment or illustration of the embodiments of this application. The scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. The scope of protection of this application shall be determined by the scope of the claims.

Claims

1. A method for sample visualisation traceability of an automated process, characterized in that, The automation process includes a plurality of operation nodes executed by an automation operation system for a sample and an execution order of the plurality of operation nodes, and the method includes: obtaining the execution order of the plurality of operation nodes in the automation process and the corresponding visualization configuration information of each operation node, wherein the visualization configuration information is used to represent the configuration information of the visualization module on the corresponding operation node, and the visualization module in the automation process is used to display the position tracking information of the to-be-tracked sample in the automation process, and the position tracking information is used to indicate the position change of the to-be-tracked sample; According to the execution order and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected in the execution order are displayed, wherein the displayed visualization modules are the visualization modules configured for the plurality of operation nodes.

2. The automated process sample visualization traceability method of claim 1, wherein, The visualization module includes a sample disc template, and the sample disc template includes at least one sample site, and each sample site in the sample disc template represents a single position in a sample placement area of an operation node corresponding to the sample disc template.

3. The automated process sample visualization traceability method of claim 1, wherein, According to the execution order and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected in the execution order are displayed, wherein the displayed visualization modules are the visualization modules configured for the plurality of operation nodes. According to the execution order and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected in the execution order are displayed, wherein the displayed visualization modules are the visualization modules configured for the plurality of operation nodes.

4. The automated process sample visualization traceability method according to any one of claims 1 to 3, characterized in that, After the visualization modules connected in the execution order are displayed according to the execution order and the visualization configuration information corresponding to the plurality of operation nodes, the method further includes: In response to a preview operation, the visualization modules configured for the plurality of operation nodes are displayed in a human-computer interaction interface, and based on preset position information of a preset tracking sample, position tracking information of the preset tracking sample is displayed on the displayed visualization modules in the execution order of the plurality of operation nodes, wherein the preset position information is used to indicate the position of the preset tracking sample in the corresponding visualization module.

5. The automated process sample visualization traceability method of claim 4, wherein, According to the execution order and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected in the execution order are displayed, wherein the displayed visualization modules are the visualization modules configured for the plurality of operation nodes. According to the execution order and the visualization configuration information corresponding to the plurality of operation nodes, the visualization modules connected in the execution order are displayed, wherein the displayed visualization modules are the visualization modules configured for the plurality of operation nodes.

6. The automated process sample visualization traceability method of claim 4, wherein, ​ randomly determining a position of the preset trace sample on each of the visualization modules configured by the plurality of operation nodes to display position trace information of the preset trace sample on the displayed visualization modules.

7. The automated process sample visualization traceability method according to any one of claims 1 to 3, characterized in that, The method further comprises: obtaining sample information of at least one sample, wherein the sample information comprises a position of each sample in the at least one sample in a visualization module corresponding to a first operation node of the automated process; controlling the automated operation system to execute the automated process for the at least one sample based on the sample information, and obtaining historical record information obtained by the execution of the automated process, the historical record information comprising sample position information of each sample in the at least one sample after execution of each operation node in the plurality of operation nodes, the sample position information comprising a position of a sample in a sample placement area corresponding to an operation node; determining a trace sample to be traced in the at least one sample; determining sample position information corresponding to the trace sample to be traced in the historical record information; displaying position trace information of the trace sample to be traced on the displayed visualization modules according to the sample position information corresponding to the trace sample to be traced and in the execution order of the plurality of operation nodes.

8. The automated process sample visualization traceability method of claim 7, wherein, The displaying of the position trace information of the trace sample to be traced on the displayed visualization modules according to the sample position information corresponding to the trace sample to be traced and in the execution order of the plurality of operation nodes comprises: highlighting the positions corresponding to the trace sample to be traced on the visualization modules in sequence according to the execution order of the plurality of operation nodes, and / or connecting the positions corresponding to the trace sample to be traced in adjacent two visualization modules to form a trace line for the trace sample to be traced, wherein the position trace information comprises the highlighted positions and / or the trace line.

9. A sample visualization traceability system for an automated process, characterized in that, The automated process comprises a plurality of operation nodes executed by an automated operation system for a sample and an execution order of the plurality of operation nodes, and a sample visualization trace system of the automated process comprises an obtaining module and a display module, The obtaining module is configured to obtain the execution order of the plurality of operation nodes in the automated process and visualization configuration information corresponding to each operation node, wherein the visualization configuration information is used to represent configuration information of a visualization module on a corresponding operation node, the visualization module in the automated process is used to display position trace information of a trace sample to be traced in the automated process, and the position trace information is used to indicate a position change of the trace sample to be traced. The display module is configured to display visualization modules connected in the execution order according to the execution order and the visualization configuration information corresponding to the plurality of operation nodes, wherein the displayed visualization modules are visualization modules configured by the plurality of operation nodes.

10. An electronic device comprising: A processor and a memory, characterized in that The memory stores computer program instructions, and the computer program instructions are run by the processor to execute the sample visualization trace method of the automated process according to any one of claims 1 to 8.

11. A storage medium having stored thereon program instructions, wherein the program instructions are executable by a machine to cause the machine to perform operations comprising: The program instructions, when executed, perform a sample visualization trace method for an automated process as claimed in any one of claims 1 to 8.

Images