Method and system for controlling multiple laboratory instruments

Abstract

The present invention makes it possible to confirm whether an experimental protocol performed by a plurality of experimental devices is performed as expected. This method for controlling a plurality of experimental devices (121-127) includes a step for controlling the plurality of experimental devices (121-127) on the basis of an experimental protocol (p1) in which the order of a plurality of processes is prescribed, a step for acquiring video whereby processing on an analysis object (Cn1) in one experimental device (122) and conveyance for moving the analysis object (Cn1) from the one experimental device (122) to another experimental device (123) can be confirmed synchronously, and a step for displaying the video.

Description

[Technical Field]

[0001] The present invention relates to a method for controlling multiple laboratory devices. and System Mu Regarding. [Background technology]

[0002] Conventionally, devices for controlling laboratory equipment have been known. For example, Japanese Patent Application Laid-Open No. 2004-317320 (Patent Document 1) discloses a control device for controlling an automatic dispensing device. This control device virtually displays the operating status of the automatic dispensing device, allowing a user to check whether the operating process of the automatic dispensing device is operating correctly as expected. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-317320 Summary of the Invention [Problem to be solved by the invention]

[0004] A single experimental protocol may be executed using multiple experimental devices. In such cases, to confirm whether the experimental protocol is executed as intended by the experimental protocol designer, it is necessary to confirm not only the operation of the experimental device performing a certain process, but also the coordination between the experimental device performing the preceding process and the experimental device performing the subsequent process in two consecutive processes. However, the control device for an automatic pipetting device disclosed in Patent Document 1 does not take into consideration the coordination between the automatic pipetting device and other experimental devices. For example, when a sample container to be analyzed is transferred between multiple devices, if the timing of processes such as reagent injection and incubation in each step of the experimental protocol and the transfer process are not synchronized, the expected results cannot be obtained. However, the timing of the transfer and processing cannot be confirmed simply by simulating whether a sample or reagent is present in the sample container.

[0005] The present invention has been made to solve such problems, and its purpose is to make it possible to confirm whether an experimental protocol executed by multiple experimental devices is executed as expected. [Means for solving the problem]

[0006] A method according to one aspect of the present invention includes the steps of controlling a plurality of experimental devices based on an experimental protocol in which the order of a plurality of processes is specified, acquiring a video that allows the user to view the process of an analysis subject in one of the plurality of experimental devices and the transportation of the analysis subject from one experimental device to another in a synchronized manner, and displaying the video.

[0007] A system according to another aspect of the present invention includes a plurality of experimental apparatuses, a control device, at least one image capture device, and a terminal device. The control device controls the plurality of experimental apparatuses based on an experimental protocol that defines the order of a plurality of processes. The at least one image capture device captures video that allows a user to view a synchronized process of an analysis subject in one of the plurality of experimental apparatuses and a transport of the analysis subject from one experimental apparatus to another. The terminal device displays the video.

[0008] According to another aspect of the present invention, an apparatus includes a memory unit, a display unit, and a control unit. The memory unit stores a simulation program. The control unit executes the simulation program to control a plurality of experimental apparatuses designed in a virtual space based on an experimental protocol that defines the order of a plurality of processes, and displays on the display unit a video that allows a user to check the processing of an analysis subject in one of the plurality of experimental apparatuses and the transfer of the analysis subject from the one experimental apparatus to another, in a synchronized manner. [Effects of the Invention]

[0009] According to the method, system, and device of the present invention, a video is displayed that allows a user to check the processing of an analytical subject in one of multiple experimental devices and the transportation of the analytical subject from one experimental device to another in a synchronized manner, thereby making it possible to check whether the experimental protocol executed by multiple experimental devices is being carried out as expected. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing the configuration of an automatic experiment system according to a first embodiment. [Figure 2] FIG. 2 is a block diagram showing the hardware configuration of the terminal device of FIG. [Figure 3] FIG. 2 is a diagram showing a GUI configuration of an example of an experiment protocol designed in the experiment protocol management program of FIG. 1. [Figure 4]4 is a diagram showing an example of a GUI configuration of the experimental protocol management program of FIG. 1 that displays a video in which the experimental protocol of FIG. 3 is being attempted. [Figure 5] 10 is a diagram showing another example of the GUI configuration of the experimental protocol management program of FIG. 1, which displays a video in which the experimental protocol of FIG. 3 is being attempted. FIG. [Figure 6] 2 is a block diagram showing an example of a hardware configuration of a control device in FIG. 1. FIG. [Figure 7] 2 is a flowchart showing an example of the flow of processing performed in the automated experiment system of FIG. 1. [Figure 8] FIG. 10 is a block diagram showing a configuration of an information processing device according to a second embodiment. [Figure 9] FIG. 9 is a diagram showing a plurality of experimental devices designed in a virtual space by the experimental protocol simulation program of FIG. 8. [Figure 10] FIG. 9 is a block diagram showing a hardware configuration of the information processing device in FIG. 8. [Figure 11] 9 is a flowchart showing an example of the flow of simulation processing of an experimental protocol performed by the computer of FIG. 8. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the drawings. In the following, the same or corresponding parts in the drawings will be designated by the same reference numerals, and their description will not be repeated in principle.

[0012] [Embodiment 1] FIG. 1 is a block diagram showing the configuration of an automated experiment system 1 according to the first embodiment. As shown in FIG. 1, the automated experiment system 1 includes an experiment facility 100 and a terminal device 400. The terminal device 400 includes an input / output unit 430. The input / output unit 430 includes a display 431, a keyboard 432, and a touchpad 433. The terminal device 400 is, for example, a laptop computer, a personal computer, a smartphone, or a tablet. The experiment facility 100 and the terminal device 400 are connected to each other via a network NW. The network NW includes, for example, the Internet, a WAN (Wan Area Network), or a LAN (Lan Area Network). Note that there may be two or more terminal devices connected to the network NW, and there may be two or more automated experiment systems.

[0013] An experiment protocol management program 500 is pre-installed in the terminal device 400. The keyboard 432 and touchpad 433 accept GUI operations by the user on the experiment protocol management program 500. That is, the user of the terminal device 400 selects an automated experiment system in the experiment protocol management program 500 by GUI operations via the keyboard 432 and touchpad 433, and designs an experiment protocol to be executed by the automated experiment system. The experiment protocol specifies the order of multiple processes to be performed by multiple experimental devices included in the automated experiment system selected by the user. The terminal device 400 transmits the experiment protocol designed by the user to the experiment equipment 100.

[0014] The experimental equipment 100 includes a control device 110, multiple experimental devices 120, and cameras 140, 141, 142, 143, 144, 145, 146, and 147 (at least one imaging device). The control device 110 controls the multiple experimental devices 120 to automatically execute an experimental protocol from a terminal device 400. The multiple experimental devices 120 include a robot 121, an incubator 122, a pre-processing device 123, a microplate reader 124, a centrifuge 125, a liquid chromatograph mass spectrometer (LCMS) 126, and a microscope 127.

[0015] The robot 121 moves a culture container Cn1 (e.g., a petri dish, flask, or well plate) containing a sample to the corresponding experimental device for each of the multiple processes according to the sequence of multiple processes defined in the experimental protocol. The culture container Cn1 contains, for example, agar containing cultured cells (analyte). The incubator 122 cultures the cells seeded in the culture container Cn1 while controlling the temperature. The pretreatment device 123 automatically distributes (dispenses) a fixed amount of sample to each of multiple microplates (wells). The microplate reader 124 measures the optical properties of the sample in the microplate (e.g., absorbance measurement and fluorescence intensity measurement). The centrifuge 125 separates the components of the analyte contained in the container Cn2 by centrifugal force. The LCMS 126 separates the analyte contained in the analytical container Cn3 (e.g., a vial or well plate) using liquid chromatography and performs mass spectrometry to separate the separated components of the analyte by mass-to-charge ratio (m / z). The microscope 127 magnifies minute analytes (eg, cells) and allows the analytes to be observed with the naked eye.

[0016] When the culture medium in the culture vessel Cn1 is replaced, a stock vessel or pipette tip containing new culture medium is placed in a predetermined location in the pretreatment device 123. The robot 121 takes out the culture vessel Cn1 stored in the incubator 122. The robot 121 transports the culture vessel Cn1 to the pretreatment device 123 and places it in the specified location.

[0017] The pretreatment device 123 aspirates and removes the culture medium from the culture vessel Cn1, and then washes the culture vessel Cn1. The pretreatment device 123 dispenses new culture medium from a stock container into the culture vessel Cn1. After the pretreatment device 123 has completed dispensing, the robot 121 holds the culture vessel Cn1 and transports it to the incubator 122.

[0018] When the growth condition or state of the cells in the culture vessel Cn1 is to be observed, the culture vessel Cn1 stored in the incubator 122 is taken out by the robot 121. The robot 121 transports the culture vessel Cn1 to the microscope 127 and places the culture vessel Cn1 on the observation stage of the microscope 127. The microscope 127 adjusts the focal length so that the cells to be observed are in focus, and then photographs the cells. After photographing by the microscope 127 is completed, the robot 121 holds the culture vessel Cn1 and transports it to the incubator 122.

[0019] When cell culture medium analysis of the culture vessel Cn1 is performed, an analysis vessel Cn3, a centrifugation vessel Cn2, a standard sample, an organic solvent for protein removal, and the like are placed in a predetermined location in the pretreatment device 123. The robot 121 retrieves the culture vessel Cn1 stored in the incubator 122, transports it to the pretreatment device 123, and places it in the designated location. After the organic solvent is dispensed into the vessel Cn2, the culture medium is dispensed from the culture vessel Cn1 into the vessel Cn2. After the culture medium and the organic solvent are sufficiently stirred, the robot 121 holds the vessel Cn2 and transports it to the centrifuge 125. The centrifuge 125 rotates at a designated speed for a designated time. As a result, the liquid contained in the vessel Cn2 is separated into an organic solvent layer and a culture medium layer. The robot 121 then holds the vessel Cn2 and places it in the designated location in the pretreatment device 123. The pretreatment device 123 dispenses the culture medium supernatant separated in the container Cn2 into an analytical container Cn3, and then dispenses the standard sample into the same container Cn3 as the culture medium supernatant. The robot 121 transports the container Cn3 from the pretreatment device 123 to the LCMS 126 and stores it in the LCMS 126. The LCMS 126 begins automatic analysis of the substance contained in the container Cn3 according to pre-specified analytical conditions.

[0020] The camera 140 photographs the entirety of the multiple experimental apparatuses 120 and outputs a video (first video) including the entirety of the multiple experimental apparatuses 120 to the control device 110. The camera 141 photographs the robot 121 and outputs a video (second video) including the robot 121 to the control device 110. The camera 142 photographs the incubator 122 and outputs a video (second video) including the incubator 122 to the control device 110. The camera 143 photographs the pre-processing device 123 and outputs a video (second video) including the pre-processing device 123 to the control device 110. The camera 144 photographs the microplate reader 124 and outputs a video (second video) including the microplate reader 124 to the control device 110. The camera 145 photographs the centrifuge 125 and outputs a video (second video) including the centrifuge 125 to the control device 110. Camera 146 captures an image of LCMS 126 and outputs a moving image (second moving image) including LCMS 126 to control device 110. Camera 147 captures an image of microscope 127 and outputs a moving image (second moving image) including microscope 127 to control device 110.

[0021] Fig. 2 is a block diagram showing the hardware configuration of the terminal device 400 in Fig. 1. As shown in Fig. 2, the terminal device 400 includes a processor 421, a memory 422 and a hard disk 423 as storage units, a communication interface 424, and an input / output unit 430. These are connected to each other via a bus 440 so as to be able to communicate with each other.

[0022] The hard disk 423 is a non-volatile storage device. For example, the operating system (OS) program 40 and the experiment protocol management program 500 are stored on the hard disk 423. In addition to the data shown in Fig. 2, the hard disk 423 also stores, for example, the settings and outputs of various applications. The memory 422 is a volatile storage device and includes, for example, a DRAM (Dynamic Random Access Memory).

[0023] The processor 421 includes a CPU (Central Processing Unit). The processor 421 loads a program stored in a hard disk 423 into a memory 422 and executes the program. The processor 421 is connected to a network NW via a communication interface 424.

[0024] FIG. 3 is a diagram showing the GUI configuration of an example of an experimental protocol p1 designed in the experimental protocol management program 500 of FIG. 1. As shown in FIG. 3, the experimental protocol p1 includes multiple processes, such as cell culture, liquid dispensing, absorbance measurement, centrifugation, liquid dispensing, and mass analysis. The multiple processes are executed in the following order: cell culture, liquid dispensing, absorbance measurement, centrifugation, liquid dispensing, and mass analysis. When the send button Bn is pressed with the cursor Cr, the experimental protocol p1 is sent to the experimental equipment 100. Note that the experimental protocols that can be designed in the experimental protocol management program 500 may include iterative processes and branching processes.

[0025] During the design process of an experimental protocol using the experimental protocol management program 500, various settings may be made for each of the multiple processes. If an incorrect setting is made during the design process of the experimental protocol such that the process cannot be executed by the experimental equipment (for example, if an unspecified container is referenced in the process), the incorrect setting can be discovered during debugging (or compiling) to determine the formal consistency of the experimental protocol, i.e., whether each of the multiple processes included in the experimental protocol can be executed. However, if an incorrect setting is made such that the process can be executed by the experimental equipment but the result of the process is incorrect (for example, if an incorrect container is specified as the input for the process among multiple containers (reagents) specified in the experimental protocol), the experimental protocol is recognized to be formally consistent, and therefore the incorrect setting cannot be discovered through debugging.

[0026] Furthermore, the experimental conditions of the experimental protocol (for example, the conditions necessary for the cooperation of the multiple experimental devices) can be set to suit the experimental environment of the automated experiment system 1 and the performance of each of the multiple experimental devices 120. It is difficult for the designer of the experimental protocol (the user of the terminal device 400) to actually reproduce the same experimental environment as the automated experiment system 1 and experimental devices equivalent to each of the multiple experimental devices 120. Therefore, it is difficult for the designer of the experimental protocol to confirm the validity of the experimental conditions set in the experimental protocol in an environment other than the automated experiment system 1. If the experimental protocol is executed based on inappropriate experimental conditions, unnecessary costs and time will be spent on the experiment based on the experimental protocol.

[0027] Therefore, in the automated experiment system 1, the experimental protocol being performed by multiple experimental devices 120 is recorded as a video that allows for synchronized viewing of the processing of an analysis target in one of the multiple experimental devices 120 and the transfer of the analysis target from one experimental device to another, and the video is then transmitted to the terminal device 400. A user of the terminal device 400 can verify, from a location remote from the experimental equipment 100, that the experimental conditions of the experimental protocol are appropriate and that the multiple experimental devices are operating in coordination. Note that the user's confirmation of the coordination of the multiple experimental devices by viewing the video does not need to be in real time, but may be after the protocol is implemented. In this case, the user can confirm the video stored in the terminal device 400 by specifying playback at the desired time. Preferably, the video stored in the terminal device 400 is stored in association with information about the corresponding experimental protocol. In this case, the user can easily identify and play the desired video from among the multiple videos for confirming the protocol stored in the terminal device 400. The video may also be stored not only in the terminal device 400 but also in a server computer (not shown).

[0028] 4 is a diagram showing an example of the GUI configuration of the experimental protocol management program 500 of FIG. 1, which displays a video in which the experimental protocol p1 of FIG. 3 is being attempted. As shown in FIG. 4, the experimental protocol management program 500 includes a window 510 showing the entire video, a window 520 showing an enlarged video, a window 530 showing a switching mode for the enlarged video, and a window 540 showing the progress of the experimental protocol p1. Note that the device to which the video in which the experimental protocol is attempted by multiple experimental devices 120 is transmitted from the control device 110 does not have to be the terminal device 400. In other words, the device on which the experimental protocol was designed may be different from the device on which the video is played.

[0029] Referring also to FIG. 1, window 510 displays a video captured by camera 140 in FIG. 1. At least one experimental device that is executing a process based on the experimental protocol transmitted from terminal device 400 is highlighted in window 510. Window 520 displays a video (specific video) captured by one of cameras 141-147. Windows 510 and 520 are arranged side by side. By observing windows 510 and 520 together, it is possible to grasp, at a glance, the overall state of multiple experimental devices 121-127 that are being controlled based on experimental protocol p1, as well as the detailed state of the processes currently being executed.

[0030] Window 530 displays the switching mode of the video displayed in window 520. The switching modes include an automatic switching mode and a manual switching mode. When the automatic switching mode is selected, the video displayed in window 520 is automatically switched to a video captured by a camera capturing an experimental device related to the process being executed. When the manual switching mode is selected, the video displayed in window 520 is switched to a video captured by a camera capturing an experimental device selected in combo box Cb.

[0031] In window 540, a plurality of processes are displayed in accordance with the order of the processes defined in the experimental protocol. The processes being executed are highlighted in window 540. By referring to window 540, the processes being executed can be confirmed.

[0032] Window 520 in Figure 4 displays a video of the timing when "cell culture" (first process) ends and "liquid dispensing" (second process) begins, among the processes specified in experimental protocol p1. At this timing, robot 121 holds culture vessel Cn1 (analysis target) output from incubator 122 (first experimental device) to move it to pretreatment device 123 (second experimental device), which performs "liquid dispensing." By observing window 520, it is possible to confirm whether the analysis target is smoothly transferred between two consecutive processes in experimental protocol p1. Generally, the analysis target may change when transferred between two consecutive processes. For example, if the first process includes a step in which two different reagents are mixed, the mixed reagent is transferred to the second process. In this way, the video also makes it easy to confirm how multiple reagents are divided, combined, and denatured in a series of protocols. While there are conventional technologies that express the flow of multiple samples as a data flow, such as a flow diagram, it is difficult to visually convey how samples are integrated, separated, and organized using data. The present invention allows users to check the flow using video, significantly improving the traceability of sample denaturation.

[0033] The user can change the playback speed while checking the trial state of the experimental protocol. By pausing and slowing down the video at the experimental step that the user wants to focus on, the user can check in detail. Furthermore, by fast-forwarding the playback of processing steps that take several hours, such as cell culture, the review time can be shortened. Furthermore, the video can be played in reverse to check a part of the process in which unexpected behavior was discovered.

[0034] In window 510, the tip of the robot 121 that moves the culture container Cn1 from the incubator 122 to the pre-processing device 123, a part of the incubator 122 that performs "cell culturing," and a part of the pre-processing device 123 that performs "liquid dispensing" are all included in a rectangular display Rc1 and are therefore coordinated. By referring to window 510, it is possible to confirm the experimental equipment that is performing the processing.

[0035] The automatic switching mode is selected in the window 530. The window 520 displays a video from the camera 141 or 142. The window 520 displays the robot 121 holding the culture vessel Cn1 output from the incubator 122.

[0036] In window 540, the ongoing process "dispensing liquid" is highlighted by surrounding the character string "2: Dispensing liquid" with a rectangular display R2. The ongoing process may be highlighted by changing the background color of the character string "2: Dispensing liquid" or the color of the character string itself.

[0037] Fig. 5 is a diagram showing another example of the GUI configuration of the experimental protocol management program 500 of Fig. 1, which displays a video of the experimental protocol p1 of Fig. 3 being attempted. The GUI configuration shown in Fig. 5 differs from the GUI configuration shown in Fig. 4 in that window 540 is removed and a speech bubble Sb is added to window 520. Other than this, the GUI configuration shown in Fig. 5 is the same as the GUI configuration shown in Fig. 4, and therefore a description of the similar configuration will not be repeated.

[0038] 5, the ongoing process is highlighted by displaying the character string “liquid dispensing” representing the ongoing process in a speech bubble Sb in the window 520. The speech bubble Sb is displayed in the window 520 in association with the culture vessel Cn1 or the robot 121.

[0039] The experimental protocol sets the pipette aspiration and discharge speed, the pipette tip position when aspiration and discharge are performed, and the number of pipetting operations required for mixing, all of which are suited to the characteristics of the sample (analysis target) for the pipette aspiration and discharge operations in the pretreatment device 123. The automated experimental system 1 can confirm whether the conditions for the pipette aspiration and discharge operations are set appropriately by checking how the pretreatment device 123 is actually operating in a trial (simulation experiment) of the experimental protocol.

[0040] In the centrifuge 125, the rotation speed and rotation time for centrifugation are set in the experiment protocol. Separation conditions vary depending on the analysis target and the volume of the centrifuge container. The automated experiment system 1 provides the user with a video of the centrifuge 125 actually performing centrifugation, allowing the user to confirm whether the analysis target is being separated as expected.

[0041] Regarding the transport of samples by the robot 121, when the robot 121 transports the container Cn2 after centrifugation, it is necessary to prevent the container Cn2 from being agitated. The automated experiment system 1 makes it possible to check whether separation of the sample is maintained in the container Cn2 even while the container Cn2 is being transported. It is also possible to check whether agitation occurs in the container Cn2 due to an impact when the robot 121 holds the container Cn2 or when the container Cn2 is placed in the desired location.

[0042] The automated experiment system 1 makes it possible to check the state of the culture vessel Cn1 containing cells or microorganisms when it is removed from the incubator 122 and transported to another device, or how the culture vessel Cn1 will be handled in the device to which it is transported. For example, it is possible to check what environment outside the incubator 122 the cells or microorganisms contained in the culture vessel Cn1 will be exposed to and for how long, or whether reagents unrelated to the experiment or dirty pipette tips will pass over the culture vessel Cn1 with its lid removed.

[0043] Since the purpose of a simulation experiment is to confirm the validity of the experimental conditions set in the experimental protocol, it is not necessary to use the same reagents used in the actual experiment. Therefore, by using colored water, for example, as a substitute for reagents in a simulation experiment, the cost required for the simulation experiment can be reduced. Furthermore, when a substitute for a reagent is used, the waiting time set in the experimental protocol for waiting for the reagent to react is not required. Therefore, by setting the simulation experiment to omit this waiting time, the time required for the simulation experiment can be shortened.

[0044] Fig. 6 is a block diagram showing an example of the hardware configuration of the control device 110 of Fig. 1. As shown in Fig. 6, the control device 110 includes a processor 111, a memory 112 and a hard disk 113 as storage units, a communication interface 114 as a communication unit, and an input / output unit 115. These are connected to each other via a bus 116 so as to be able to communicate with each other.

[0045] The hard disk 113 is a non-volatile storage device. For example, the OS program 51 and the automatic experiment management program 52 are stored on the hard disk 113. In addition to the data shown in Fig. 6, the hard disk 113 also stores, for example, the settings and outputs of various applications. The memory 112 is a volatile storage device and includes, for example, a DRAM (Dynamic Random Access Memory).

[0046] The processor 111 includes a CPU (Central Processing Unit). The processor 111 loads programs stored in a hard disk 113 into a memory 112 and executes them to realize various functions of the control device 110. For example, the processor 111 executing the automatic experiment management program 52 controls a plurality of experiment devices 120 based on an experiment protocol received from a terminal device 400. The processor 111 executing the automatic experiment management program 52 also transmits videos captured by the cameras 140 to 147 to the terminal device 400. The processor 111 is connected to a network NW via a communication interface 114.

[0047] FIG. 7 is a flowchart showing an example of the processing flow performed in the automated experiment system 1 of FIG. 1. Hereinafter, each step will be simply referred to as S. As shown in FIG. 7, the terminal device 400 designs an experiment protocol in S101 and proceeds to S102. In S102, the terminal device 400 transmits the experiment protocol of S101 to the control device 110 of the experiment equipment 100. The control device 110 receives the experiment protocol from the terminal device 400 and controls the multiple experiment devices 120 based on the experiment protocol in S111. In addition, in parallel with the execution of the experiment protocol, the control device 110 acquires video of the multiple experiment devices 120 from the cameras 140-147 in S112, records each step of the experiment protocol and the time or frame number at which processing at that step is performed in the video as playback additional data, and transmits the video and playback additional data to the terminal device 400. The terminal device 400 displays the video received from the control device 110 on the display 431 via the experiment protocol management program 500. In the terminal device 400, based on the playback additional data, the video is associated with each step of the experimental protocol using the time or frame number of the step and displayed on the display 431. The user of the terminal device 400 can easily check each step of the experimental protocol that corresponds to each timing of the video of the multiple experimental devices 120.

[0048] As described above, the system and method according to the first embodiment make it possible to check whether an experiment protocol executed by a plurality of experiment devices is being executed as expected.

[0049] [Embodiment 2] In the first embodiment, a system and method were described in which a video of multiple experimental devices actually operating based on an experimental protocol is displayed on a terminal device. In the second embodiment, a system and method are described in which multiple experimental devices designed in a virtual space are used to simulate the execution of an experimental protocol. The configuration of the second embodiment makes it possible to check whether the experimental protocol is executed as expected, as in the first embodiment, and also eliminates the need for multiple experimental devices, reagents, and items required for a real experiment, thereby reducing the cost required for trying out an experimental protocol compared to the first embodiment.

[0050] FIG. 8 is a block diagram showing the configuration of an information processing device 210 according to the second embodiment. As shown in FIG. 8, the information processing device 210 includes an input / output unit 230 and a computer 240. The input / output unit 230 includes a display 231 (display unit), a keyboard 232, and a mouse 233. The display 231, the keyboard 232, and the mouse 233 are connected to the computer 240. The GUI of the experimental protocol simulation program 600 is displayed on the display 231. The keyboard 232 and the mouse 233 accept GUI operations on the experimental protocol simulation program 600 by the user. That is, the user performs desired GUI operations on the experimental protocol simulation program 600 by operating the keyboard 232 or the mouse 233 while referring to the display on the display 231.

[0051] FIG. 9 shows multiple experimental apparatuses 220 designed in the virtual space VS by the experimental protocol simulation program 600 of FIG. 8. As shown in FIG. 9, the multiple experimental apparatuses 220 include a robot 221, an incubator 222, a pre-processing device 223, a microplate reader 224, a centrifuge 225, an LCMS 226, and a microscope 227. The robot 221, the incubator 222, the pre-processing device 223, the microplate reader 224, the centrifuge 225, the LCMS 226, and the microscope 227 have similar functions to the robot 121, the incubator 122, the pre-processing device 123, the microplate reader 124, the centrifuge 125, the LCMS 126, and the microscope 127 of FIG. 1, respectively. The experimental protocol simulation program 600 can design multiple experimental apparatuses for each of multiple systems.

[0052] The experimental protocol simulation program 600 can design experimental protocols for controlling multiple experimental devices designed in the virtual space VS in a manner similar to the experimental protocol management program 500 shown in Fig. 3. The experimental protocol simulation program 600 can display animations of multiple experimental devices operating in the virtual space VS based on experimental protocols in a manner similar to the experimental protocol management program 500 shown in Fig. 4.

[0053] Fig. 10 is a block diagram showing the hardware configuration of the information processing device 210 of Fig. 8. As shown in Fig. 10, the computer 240 includes a processor 241 (controller), a memory 242 and a hard disk 243 as storage units, and a communication interface 244. These are connected via a bus 245 so as to be able to communicate with each other.

[0054] The hard disk 243 is a non-volatile storage device. For example, the OS program 60 and the experiment protocol simulation program 600 are stored on the hard disk 243. In addition to the data shown in Fig. 10, the hard disk 243 also stores, for example, the settings and outputs of various applications. The memory 242 is a volatile storage device and includes, for example, a DRAM (Dynamic Random Access Memory).

[0055] The processor 241 includes a CPU (Central Processing Unit). The processor 241 loads a program stored on a hard disk 243 into a memory 242 and executes it. The experimental protocol simulation program 600 is executed by the processor 241, thereby realizing automatic execution of an experimental protocol by a plurality of experimental devices 220. The processor 241 is connected to a network via a communication interface 244.

[0056] 11 is a flowchart showing an example of the flow of the simulation process of an experimental protocol performed by the computer 240 of FIG. 8. As shown in FIG. 11, the computer 240 designs multiple experimental apparatuses in a virtual space in S201 and proceeds to S202. The computer 240 designs an experimental protocol in S202 and proceeds to S203 and S204. In S203, the computer 240 controls multiple experimental apparatuses 220 in the virtual space VS based on the experimental protocol of S202. In parallel with the execution of the experimental protocol, the computer 240 acquires (generates) video of the multiple experimental apparatuses 220 in the virtual space VS in S204 and displays the video on the display 231 via the experimental protocol simulation program 600 in S205.

[0057] As described above, the device and method of embodiment 2 make it possible to confirm whether an experimental protocol executed by multiple experimental devices is executed as expected, and also to reduce the cost required to test the experimental protocol compared to embodiment 1.

[0058] [Aspect] It will be appreciated by those skilled in the art that the exemplary embodiments described above are examples of the following aspects.

[0059] (Item 1) A method according to one embodiment includes the steps of controlling a plurality of experimental devices based on an experimental protocol that specifies the order of a plurality of processes, acquiring a video that allows the user to view the process of an analysis subject in one of the plurality of experimental devices and the transportation of the analysis subject from one experimental device to another in a synchronized manner, and displaying the video.

[0060] According to the method described in paragraph 1, a video is displayed that allows the processing of the analysis subject in one experimental device and the transportation of the analysis subject from one experimental device to another to be viewed in sync, making it possible to check whether the experimental protocol executed by multiple experimental devices is being executed as expected.

[0061] (Item 2) In the method according to item 1, the step of acquiring the video includes the step of saving the video.

[0062] According to the method described in paragraph 2, the user can view the saved video at any time he or she desires.

[0063] (Item 3) In the method according to item 2, the step of storing the video includes a step of storing the video in association with an experimental protocol.

[0064] The method described in Section 3 makes it easy for a user to identify and play a desired video from among multiple videos for checking stored protocols.

[0065] (Clause 4) In the method described in clause 2 or clause 3, the step of displaying the video includes a step of specifying a video to play from the stored videos, and a step of playing the video when the video is specified.

[0066] According to the method described in paragraph 4, the user can check the saved video by specifying playback.

[0067] (Item 5) In the method according to any one of items 1 to 4, the step of displaying the moving image includes the step of changing the playback speed of the moving image.

[0068] According to the method described in Section 5, users can pause and slow down the video to check the experimental steps they want to focus on, allowing them to check in detail. Also, by fast-forwarding the video, users can shorten the time it takes to check processing steps that take several hours, such as cell culture.

[0069] (Item 6) In the method according to any one of items 1 to 5, the step of displaying the moving image includes the step of playing the moving image in reverse.

[0070] According to the method described in Section 6, it is possible to check a part of the process in which an unexpected user behavior is discovered.

[0071] (Clause 7) The method according to any one of clauses 1 to 6 further includes the steps of recording each step of the experimental protocol and the time or frame number at which processing at that step is performed in the video, and displaying the video on a terminal device in association with the steps using each time or frame number.

[0072] According to the method described in Section 7, the user can easily check each step of the experimental protocol corresponding to each timing of the video of the multiple experimental devices 120.

[0073] (Item 8) In the method according to any one of items 1 to 7, the plurality of processes includes a first process and a second process subsequent to the first process. The plurality of experimental devices includes a first experimental device for performing the first process and a second experimental device for performing the second process. The video includes footage of an analysis subject that has previously undergone the first process being moved from the first experimental device to the second experimental device.

[0074] The method described in Section 8 makes it possible to check whether the analyte is smoothly transferred between two consecutive treatments in an experimental protocol.

[0075] (Item 9) The method according to any one of items 1 to 8, further comprising the step of transmitting the experiment protocol from the terminal device to a control device that controls a plurality of experimental devices. The step of acquiring the video transmits the video to the terminal device.

[0076] According to the method described in paragraph 9, an experimental protocol can be designed on a terminal device that is remote from multiple experimental devices, and it can be confirmed whether the experimental protocol is executed as expected on the terminal device.

[0077] (Item 10) In the method according to any one of items 1 to 8, the plurality of experimental devices are designed in a virtual space.

[0078] According to the method described in item 10, the costs required for testing an experimental protocol can be reduced because the multiple experimental devices, reagents, and items required for an actual experiment are not required.

[0079] (Item 11) In the method according to any one of Items 1 to 10, in the step of acquiring a moving image, a first moving image including a plurality of experimental devices and a plurality of second moving images including each of the plurality of experimental devices are acquired. In the step of displaying the moving images, the first moving image and a specific moving image including at least one specific experimental device among the plurality of second moving images are displayed side by side.

[0080] According to the method described in paragraph 11, by observing the first video and the specific video placed side by side together, it is possible to grasp at a glance the overall state of multiple experimental devices controlled based on the experimental protocol and the detailed state of the processing currently being performed.

[0081] (Item 12) In the method according to item 11, at least one specific laboratory device included in the first moving image is displayed in an emphasized manner in the step of displaying the moving image.

[0082] According to the method described in paragraph 12, it is possible to check the experimental equipment currently performing the process.

[0083] (Item 13) In the method according to item 11 or 12, among the plurality of processes, a process being executed by at least one specific laboratory device is displayed in a highlighted manner in the step of displaying the moving image.

[0084] According to the method described in paragraph 13, the currently executed process can be confirmed. (Item 14) A system according to one embodiment includes multiple experimental devices, a control device, at least one image capture device, and a terminal device. The control device controls the multiple experimental devices based on an experimental protocol that defines the order of multiple processes. The at least one image capture device captures video that allows for synchronized viewing of the processing of an analysis subject in one of the multiple experimental devices and the transportation of the analysis subject from one experimental device to another. The terminal device displays the video.

[0085] According to the system described in paragraph 14, a video is displayed that allows the processing of the analysis subject in one experimental device and the transportation of the analysis subject from one experimental device to another to be viewed in sync, making it possible to confirm whether the experimental protocol executed by multiple experimental devices is being executed as expected.

[0086] (Item 15) An apparatus according to one aspect includes a memory unit, a display unit, and a control unit. A simulation program is stored in the memory unit. The control unit executes the simulation program to control multiple experimental devices designed in a virtual space based on an experimental protocol that defines the order of multiple processes, and displays on the display unit a video that allows users to check the processing of an analysis target in one of the multiple experimental devices and the transportation of the analysis target from one experimental device to another, in a synchronized manner.

[0087] According to the device described in paragraph 15, a video is displayed that allows the processing of the analysis subject in one experimental device and the transportation of the analysis subject from one experimental device to another to be viewed in sync, making it possible to check whether the experimental protocol executed by multiple experimental devices is being executed as expected.

[0088] It should be noted that, with regard to the above-mentioned embodiment 1 and modified examples, it has been planned from the beginning of the application that the configurations described in the embodiments may be appropriately combined, including combinations not mentioned in the specification, within the scope that does not cause inconvenience or contradiction.

[0089] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0090] 1 Automated experiment system, 52 Automated experiment management program, 100 Experimental equipment, 110 Control device, 111, 241, 421 Processor, 112, 242, 422 Memory, 113, 243, 423 Hard disk, 114, 244, 424 Communication interface, 115, 230, 430 Input / output unit, 116, 245, 440 Bus, 121, 221 Robot, 122, 222 Incubator, 123, 223 Pre-processing device, 124, 224 Microplate reader, 125, 225 Centrifuge, 127, 227 Microscope, 140-147 Camera, 210 Information processing device, 231, 431 Display, 232, 432 Keyboard, 233 Mouse, 240 Computer, 400 Terminal device, 433 Touchpad, 500 Experimental protocol management program, 510,520,530,540 windows, 600 experimental protocol simulation program, Cn1 culture vessel, Cn2,Cn3 vessel, NW network, R2,Rc1 rectangular display, VS virtual space, p1 experimental protocol.

Claims

1. A step of controlling a plurality of experimental devices to conduct a simulation experiment based on an experimental protocol in which a sequence of a plurality of processes is defined; a step of acquiring a video that allows a user to synchronously confirm a process performed on an analysis target in one of the plurality of experimental devices and a transport of the analysis target from the one experimental device to another experimental device; displaying the video; A method wherein the mock experiment uses substitutions for reagents specified in the experimental protocol.

2. The method of claim 1 , wherein the step of obtaining the video includes the step of saving the video.

3. The method of claim 2 , wherein the step of storing the video includes a step of storing the video in association with the experimental protocol.

4. The method according to claim 2 or 3, wherein the step of displaying the video includes a step of specifying a video to be played from the stored videos, and a step of playing the video when the video is specified.

5. The method according to any one of claims 1 to 3, wherein the step of displaying the video includes the step of changing the playback speed of the video.

6. The method according to any one of claims 1 to 3, wherein the step of displaying the video includes the step of playing the video in reverse.

7. a step of recording each step of the experimental protocol and the time or frame number at which processing at that step is performed in the video; The method according to any one of claims 1 to 3, further comprising the step of displaying a video on a terminal device by using the time or frame number to associate the video with the step.

8. the plurality of processes includes a first process and a second process subsequent to the first process, the plurality of experimental devices include a first experimental device that executes the first process and a second experimental device that executes the second process; The method according to any one of claims 1 to 3, wherein the video includes footage of an analysis subject that has undergone the first processing being moved from the first experimental device to the second experimental device.

9. The method further includes transmitting the experiment protocol from a terminal device to a control device that controls the plurality of experimental devices; The method according to any one of claims 1 to 3, wherein the step of acquiring the video includes transmitting the video to the terminal device.

10. The method according to any one of claims 1 to 3, wherein the plurality of experimental devices are designed in a virtual space.

11. In the step of acquiring the moving images, a first moving image including the plurality of experimental devices and a plurality of second moving images including each of the plurality of experimental devices are acquired, A method according to any one of claims 1 to 3, wherein in the step of displaying the video, the first video and a specific video among the plurality of second videos that includes the one experimental device are displayed side by side.

12. The method according to claim 11 , wherein the one experimental device included in the first moving image is displayed in an emphasized manner in the step of displaying the moving image.

13. The method according to claim 11 , wherein the process being executed by the one experimental device among the plurality of processes is displayed in an emphasized manner in the step of displaying the moving image.

14. Multiple experimental devices, a control device that controls the plurality of experimental devices to perform a simulation experiment based on an experiment protocol that defines the order of a plurality of processes; At least one imaging device that captures video that allows the user to synchronously confirm the processing of the analysis target in one of the plurality of experimental devices and the transportation of the analysis target from the one experimental device to another experimental device; a terminal device that displays the video; The system wherein the simulated experiments use substitutes for reagents specified in the experimental protocol.

Images