Information processing device, cell processing system, information processing method, and program

Abstract

This invention provides an information processing device that allows editing of the identification results of cells within a culture device. [Solution] The information processing device for use in laser irradiation cell processing according to the present disclosure includes a display unit having a display screen, an acquisition unit that acquires an image including cells in a culture vessel, an identification unit that identifies at least one of target cells and non-target cells in the image, an output unit that outputs the identification data of the image identified by the identification unit and the image including cells in the culture vessel to the display unit for display on the display unit, and an additional editing unit that further adds and edits new identification data to the identification data of at least one of the target cells and non-target cells on the display unit.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, a cell processing system, an information processing method, and a program.

Background Art

[0002] In the expansion culture of cells or the induction of differentiation from undifferentiated cells to differentiated cells using a culture vessel (culture instrument), cells other than the target cells (hereinafter also referred to as "target cells") are generated. For this reason, in the above-mentioned expansion culture and differentiation induction, the target cells are selected by determining the target cells or non-target cells and removing the non-target cells.

[0003] The determination and removal of the target cells are carried out by skilled operators (Patent Document 1). However, the determination and removal operations are troublesome, such as being required to be carried out under a microscope, and there is a problem that the quality of the target cells obtained varies greatly depending on the technical level of the operator.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] After the differentiation induction, the target cells can be recovered, for example, by performing laser treatment on the inside of the culture instrument and removing the non-target cells. However, in the determination of the target cells by visual inspection by the skilled person, it is difficult to evaluate individual cells. For this reason, attempts have been made to identify at least one of the target cells and non-target cells using a computer. 1]

[0006] However, in the computer-based identification process, errors may occur in the identification results, such as misidentifying the target cells as non-target cells and misidentifying the non-target cells as target cells.

[0007] Therefore, this disclosure aims to provide an information processing device capable of editing the identification results of cells in the culture apparatus, a cell processing system including the same, and an information processing method. [Means for solving the problem]

[0008] To achieve the aforementioned objective, the information processing device for use in laser irradiation cell processing according to the present disclosure (hereinafter also referred to as the "information processing device") comprises a display unit having a display screen, An acquisition unit that acquires images including cells in a culture vessel, An identification unit that identifies at least one of the target cell and the non-target cell in the aforementioned image, An output unit outputs the identification data of the image identified by the identification unit and the image including the cells in the culture vessel to the display unit and displays them on the display unit. The display unit includes an additional editing unit that adds and edits identification data to at least one of the identification data for the target cells and the non-target cells.

[0009] The cell processing system of this disclosure comprises the information processing device of this disclosure and The invention includes a laser irradiation device capable of irradiating a culture vessel with a laser, The laser irradiation device irradiates the culture vessel with a laser, thereby changing the state of at least one of the target cells and non-target cells identified in the information processing device.

[0010] The information processing method for use in laser irradiation cell processing as disclosed herein (hereinafter also referred to as the "information processing method") comprises an acquisition step of acquiring an image including cells in a culture vessel, A recognition step of identifying at least one of the target cells and non-target cells in the aforementioned image, An output step which outputs the identification data of the image identified by the above identification step and the image including the cells in the culture vessel to a display unit and displays them, The process includes an additional editing step of adding and editing new identification data to the identification data of at least one of the displayed target cells and non-target cells.

[0011] The program for use in laser irradiation cell processing in this disclosure is a computer program. The acquisition process involves obtaining an image containing cells within a culture vessel, A recognition process that identifies at least one of the target cells and non-target cells in the aforementioned image, Output processing to output the identification data of the image identified by the above identification process and the image including the cells in the culture vessel to a display unit and display them, An additional editing process is performed to add and edit new identification data to the identification data of at least one of the displayed target cells and non-target cells. [Effects of the Invention]

[0012] According to this disclosure, the identification results of cells in the culture apparatus can be edited. [Brief explanation of the drawing]

[0013] [Figure 1] Figure 1 is a block diagram showing an example of a cell processing system in Embodiment 1. [Figure 2] Figure 2 is a block diagram showing the hardware configuration of the control unit of the cell processing system in Embodiment 1. [Figure 3] Figure 3 is a flowchart showing the information processing method and program processing in Embodiment 1. [Figure 4] Figure 4 is a schematic diagram showing an example of the processing of the cell processing system of Embodiment 1. [Figure 5] Figure 5 is a flowchart showing another example of the information processing method in Embodiment 1. [Figure 6]FIG. 6 is a schematic diagram showing another example of the processing of the cell processing system according to Embodiment 1. [Figure 7] FIG. 7 is a block diagram showing an example of the cell processing system according to Embodiment 2. [Figure 8] FIG. 8 is a flowchart showing the processing of the cell processing method and program according to Embodiment 2.

BEST MODE FOR CARRYING OUT THE INVENTION

[0014] <Definition> In this specification, "cell" means a cell or a composition containing cells. The cell may be, for example, a cell, a cell mass composed of cells, a tissue, an organ, etc. The cell may be, for example, a cell or a cell isolated from a living body. As specific examples, the cell may be, for example, pluripotent stem cells such as iPS cells and ES cells, somatic stem cells such as hematopoietic stem cells and neural stem cells; progenitor cells; somatic cells; etc. The cell may be, for example, an undifferentiated cell or a differentiated cell (e.g., an undifferentiated deviated cell).

[0015] In this specification, "observation" means the observation of an object to be observed. The "observation" may be, for example, an observation accompanied by imaging or an observation without imaging.

[0016] In this specification, "cell state" means cell life and death, cell morphology, gene expression of cells, etc. In this specification, "change in cell state" means that cell life and death, cell morphology, gene expression of cells, etc. change. As specific examples, the "change in cell state" may be, for example, cell lethality, induction or suppression of gene expression of cells, etc. The change in gene expression can be carried out, for example, by optogenetic techniques.

[0017] The present disclosure will be described in detail below with reference to the drawings. However, the present disclosure is not limited to the following description. In Figures 1 to 8 below, the same parts are denoted by the same reference numerals, and their descriptions may be omitted. Also, in the drawings, for the sake of explanation, the structure of each part may be shown in a simplified manner, and the dimensional ratios of each part may be shown schematically and may differ from the actual dimensions. Furthermore, unless otherwise specified, each embodiment is combinable with respect to others, and the descriptions thereof can be used accordingly.

[0018] (Embodiment 1) Embodiment 1 relates to an information processing device, a cell processing system, and an information processing method of the present disclosure.

[0019] This embodiment is an example of an information processing device, a cell processing system, and an information processing method. Figure 1 is a schematic diagram of the cell processing system 100 of Embodiment 1. As shown in Figure 1, the cell processing system 100 mainly comprises an observation unit 11, an information processing device called a control unit 12, and a display unit 13. The control unit 12 includes an acquisition unit 121, an identification unit 122, an output unit 123, and an additional editing unit 125. In the cell processing system 100 of Embodiment 1, the control unit 12 is connected to the observation unit 11 and the display unit 13.

[0020] The observation unit 11 is configured to observe and image subjects such as cells in a culture device. The observation unit 11 can utilize, for example, an optical observation device used for observing subjects such as cells. Examples of such optical observation devices include bright-field microscopes, stereomicroscopes, phase-contrast microscopes, differential interference microscopes, polarizing microscopes, fluorescence microscopes, confocal laser microscopes, total internal reflection fluorescence microscopes, and Raman microscopes, with phase-contrast microscopes and fluorescence microscopes being preferred. The optical observation device may be an reflected-type optical observation device or a transmitted-type optical observation device.

[0021] The object to be observed is an object that is observed or imaged by the observation unit 11. In this embodiment, the object to be observed is a culture vessel containing cells, but the object to be observed can be any sample that can be observed by an optical observation device. Examples of the object to be observed include cell culture vessels such as dishes, plates, and flasks (cell culture flasks) containing cells, and slides on which samples are placed.

[0022] The control unit (arithmetic unit, controller) 12 has a configuration similar to that of a personal computer, server computer, workstation, etc. Figure 2 is a block diagram showing an example of the hardware configuration of the control unit 12 (information processing device) in the cell processing system 100. As shown in Figure 2, the control unit 12 includes a central processing unit (CPU) 12a, main memory (main memory device) 12b, auxiliary storage device 12c, video codec 12d, I / O (input-output) interface 12e, GPU 12f, bus 12h, etc. Each component constituting the control unit 12 is connected via the bus 12h by its respective interface (I / F). In the control unit 12, each component is controlled by a controller (system controller, I / O controller, etc.) 12g and operates in a coordinated manner. In the cell processing system 100 of this embodiment, the control unit 12 is equipped with a CPU 12a and a GPU 12f as arithmetic means (processors), but it may be equipped with only one of them.

[0023] The CPU 12a operates in cooperation with other components such as the controller 12g (system controller, I / O controller, etc.). In the control unit 12, which is responsible for the overall control of the control unit 12, the CPU 12a executes the program 127 and other programs of this disclosure, and also reads or writes various types of information. Specifically, in this embodiment, the CPU 12a functions as an acquisition unit 121, an output unit 123, and an additional editing unit 125. The functions of each unit will be described later. The control unit 12 is equipped with the CPU 12a as an arithmetic unit (arithmetic element), but it may also be equipped with other arithmetic units such as a GPU (Graphics Processing Unit) or an APU (Accelerated Processing Unit), or a combination of the CPU and these. The CPU 12a may also function as a unit other than the storage unit in the control unit 12 of other embodiments (for example, a setting unit).

[0024] The main memory 12b is also called the primary memory. When the CPU 12a performs processing, the main memory 12b reads various operational programs, such as the program 127 of this disclosure, which are stored in the auxiliary storage device (storage device) 12c, which will be described later. The CPU 12a then reads and decodes the data from the main memory 12b and executes the program 127 of this disclosure. The main memory 12b is RAM (Random Access Memory). The main memory 12b may further include ROM (Read-Only Memory).

[0025] The auxiliary storage device 12c is also called a so-called auxiliary storage device, for example, in relation to the main memory 12b (main memory). The auxiliary storage device 12c includes an identification device 126 and an operating program including the program 127 of this disclosure. The auxiliary storage device 12c may store data including the identification device 126, etc. The auxiliary storage device 12c includes, for example, a storage medium and a drive for reading and writing to the storage medium. The storage medium is not particularly limited and may be internal or external, for example, an HD (hard disk), FD (floppy disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, memory card, etc., and the drive is not particularly limited. The auxiliary storage device 12c may be, for example, a hard disk drive (HDD) in which the storage medium and the drive are integrated.

[0026] The video codec 12d includes a GPU (Graphics Processing Unit) that generates a screen to be displayed based on drawing instructions received from the CPU 12a and transmits the screen signal to, for example, the display unit (display device) 12 of the cell processing system 100, as well as video memory for temporarily storing screen and image data.

[0027] The I / O interface 12e is a device that communicates with the observation unit 11 and controls them or acquires information such as images. The I / O interface 12e may include a servo driver (servo controller). The I / O interface 12e may also be connected to, for example, an input device 14 outside the cell processing system 100.

[0028] The GPU 12f processes the image (captured image) input from the observation unit 11. The classifier 126 used by the control unit 12 is stored in the auxiliary storage device 12c. Therefore, when the control unit 12 functions as a classifier that identifies target cells and non-target cells in the image, that is, when the control unit 12 assigns a classification to each pixel of the image, the classifier 126 is loaded into the main memory 12b at runtime and decoded by the GPU 12f. For this reason, the GPU 12f functions as a classifier 122.

[0029] Bus 12h can also be connected to external devices. Examples of such external devices include external storage devices (external databases, etc.) and printers. The control unit 12 can be connected to a communication network via a communication device connected to bus 12h, and can be configured to connect to external devices via the communication network.

[0030] The display unit 13 may be a monitor that outputs video (for example, various image display devices such as liquid crystal displays (LCDs) or cathode ray tube (CRT) displays).

[0031] The input device 14 may include a touch panel, trackpad, mouse or other pointing device, keyboard, or push buttons that can be operated by the user's fingers.

[0032] Next, the information processing method of Embodiment 1 using the cell processing system 100 of Embodiment 1 will be described with reference to Figures 3 and 4.

[0033] Figure 3 is a flowchart illustrating the information processing method and program processing of Embodiment 1. As shown in Figure 3, the information processing method of Embodiment 1 includes steps S1 (observation), S2 (imaging), S3 (acquisition), S4 (identification), S5 (output), S6 (display), and S7 (additional editing). In the information processing method of Embodiment 1, steps S1, S2, and S6 are arbitrary steps and may or may not be present. Figures 4(A) to 4(E) are schematic diagrams relating to the images of each step.

[0034] In step S1, the observation unit 11 is used to observe the cells in the culture vessel, which are the subject of observation. In step S1, part or all of the culture vessel is observed. If the observation unit 11 is equipped with an objective lens, in step S1, the observation may be made visible to the user of the cell processing system 100 through the objective lens of the observation unit 11. Alternatively, in step S1, the observation image of the subject of observation obtained using the observation unit 11 may be output to the display unit 13 via the control unit 12, and made visible to the user of the cell processing system 100 via the display unit 13.

[0035] In step S2, the observation unit 11 is used to capture one or more observation images (captured images or images) including the cells in the culture vessel, which are the subject of observation, as shown in Figure 4(A). In step S2, an observation image (image) including the cells in the culture vessel is captured for part or all of the culture vessel. When capturing the entire culture vessel, in step S2, the culture vessel may be divided into multiple fractions according to the field of view of the observation unit 11, and each fraction may be captured to capture the entire culture vessel. In step S2, the observation unit 11 transmits the image to the control unit 12, and the control unit 12 stores it in its auxiliary storage device 12c. In step S2, if multiple images are captured, one image selected by the user or the like may be stored.

[0036] Next, in step S3, the acquisition unit 121 acquires the image stored in the auxiliary storage device 12c. Then, in step S4, the identification unit 122 uses the classifier 126 to identify whether each pixel of the acquired image is a target cell or a non-target cell, as shown in Figure 4(B). The identification unit 122 then associates the identified classification, for example, the classification of a target cell or a non-target cell (identification data), with each pixel. In step S4, if the pixel identified by the identification unit 122 does not correspond to either a target cell or a non-target cell, it may identify it as something other than a target cell or a non-target cell, for example, the culture vessel or the culture medium in the culture vessel. In the cell processing system 100 of Embodiment 1, the classifier 126 uses a classifier capable of identifying the target cell and the non-target cell, but the identification unit 122 may instead use, for example, a classifier capable of identifying the target cell or a classifier capable of identifying the non-target cell. If the identification unit 122 is a classifier capable of identifying the target cells or the non-target cells, the identification unit 122 identifies the target cells or non-target cells in the culture vessel, for example, using the classifier 126. The identification unit 122 can then identify the region where the non-target cells or target cells are present, for example, from the difference between the region where the cells are present in the culture vessel and the region where the target cells or non-target cells are identified. The region where the cells are present can be identified, for example, by binarization processing.

[0037] The classifier 126 can be generated by machine learning using supervised or unsupervised data, depending on the target to be identified by the classifier 126. Specifically, when the classifier 126 is to identify target cells or non-target cells, the classifier 126 can generate images containing the target cells and / or non-target cells as training data using machine learning. For example, the machine learning can use models for semantic segmentation, instance segmentation, or panoptic segmentation, such as U-Net, SegNet, or FCN (Fully Convolutional Network). The number of training data points is not particularly limited and can be set by the user, for example, depending on the determination accuracy of the resulting classifier 126.

[0038] Next, in step S5, the output unit 123 outputs an image including the cells in the culture vessel and the identification data assigned to the image in step S4 to the display unit 13. Then, in step S6, the display unit 13 displays the image including the cells in the culture vessel and the identification data (cell classification). The display unit 13 displays cells assigned different classifications with different displays, such as different colors or different patterns. In step S6, as shown in Figure 4(B), the display unit 13 displays the target cells and the identified cell regions (colonies) (C) based on the identification data of the image. T ) and the cell region identified as an unintended cell (C N ) may also be displayed. In this way, the display of the identification data on the display unit 13 improves user visibility.

[0039] In step S6, the image and the identification data assigned to the image in step S4 are displayed on the display unit 13. The user of the cell processing system 100 of Embodiment 1 can confirm the cell classification (identification data) assigned by the identification unit 122 together with the image by checking the display on the display unit 13. At this time, the user can recognize any errors in the cell classification assigned by the identification unit 122. Examples of such errors include cases where the classification of an unintended cell is assigned to the target cell, where the classification of an unintended cell is assigned to the target cell, or where the classification of neither a target cell nor an unintended cell is assigned to the target cell or an unintended cell. Therefore, the cell processing system 100 of Embodiment 1 includes an input device 14. Thus, in step S7, if the user determines that there is an error in the identification data, the user can edit the identification data by inputting using the input device 14. As an example, in Figure 4(C), the regions indicated by arrows X1 and X2 are regions where target cells and non-target cells exist, respectively, but they are not identified by the identification unit 122. In Figure 4(D), as indicated by arrows Y1 and Y2, the identification data is edited by the user to identify them as target cells and non-target cells. The user input can be, for example, input via keyboard, touch panel, mouse, etc. User input may also be handwritten. The user's editing of the identification data may be performed on a single pixel or on multiple pixels. When the editing of the identification data is performed on multiple pixels, the user specifies, for example, a linear, circular, rectangular, or other polygonal, irregularly shaped region as the editing location (pixel to be edited), and also specifies the classification to be assigned to the editing location.

[0040] As shown in Figure 4(D), when a user edits the identification data using the input device 14, the control unit 12 receives data from the input device 14 as edited data (new identification data), which includes data relating to the edited part of the identification data and data of the classification assigned by the edit.

[0041] Then, in step S7, in response to the input of editing data for the identification data through the user's input device 14, the additional editing unit 125 adds the newly added identification data to the identification data. Specifically, in step S7, based on the editing data, the classification of cells associated with the corresponding pixels is reassigned to the classification specified in the editing data. If the editing shown in Y1 and Y2 of Figure 4(D) is performed, in step S7, for each pixel corresponding to the region indicated by arrow Y1, the classification associated with the pixel is reassigned to the classification of the target cell. Also in step S7, for each pixel corresponding to the region indicated by arrow Y2, the classification associated with the pixel is reassigned to the classification of an unintended cell. Then, the information processing method of this embodiment is terminated.

[0042] (Effects of Embodiment 1) In the cell processing system 100 of Embodiment 1, the identification unit 122 assigns classification (identification data) of target cells or non-target cells to each pixel of the captured image. Then, in the cell processing system 100 of Embodiment 1, the output unit 123 outputs the image and the identification data to the display unit 14 for display. Furthermore, in the cell processing system 100 of Embodiment 1, the user can check the content displayed on the display unit 14, and if there is an error in the identification data, the user can edit the identification data and reflect the edit in the identification unit data. Therefore, according to the cell processing system 100 of Embodiment 1, the identification results of cells in the culture device can be edited. In addition, according to the cell processing system 100 of Embodiment 1, since the user can check and edit the identification results, more accurate identification results can be obtained.

[0043] In the cell processing system 100 of Embodiment 1, the combination of target cells and non-target cells is arbitrary, provided that the two cells are different in scope. For example, the target cells may be iPS cells and the non-target cells may be cells other than iPS cells. Examples of the combination of target cells and non-target cells (in any order) include cells that differentiate from undifferentiated cells (progenitor cells) in a differentiation induction system and combinations of the undifferentiated cells.

[0044] In the cell processing system 100 of Embodiment 1, the identification unit 122 uses a classifier 126 to assign classifications to pixels in the captured image that include target cells and non-target cells. However, the identification method by the identification unit 122 is not limited to this in this disclosure. The identification unit 122 may, for example, use image classification (image segmentation) methods such as supervised classification or unsupervised classification to identify target cells and non-target cells in the captured image, and optionally associate the identified classification with the identified region or pixel.

[0045] Furthermore, while the cell processing system 100 of Embodiment 1 uses a classifier 126 to distinguish between target cells and non-target cells, the identification method by the identification unit 122 is not limited to this in this disclosure. The identification unit 122, for example, identifies the target cells and / or non-target cells from the image by region extraction processing. Examples of the region extraction processing include discriminant analysis methods such as Otsu's binarization, simple thresholding, P-tile binarization; multilevel processing; Snake / Active Contour method, Mean Shift method, Graph Cuts method, Region Growing method; etc. The region extraction processing is preferably binarization, and more preferably Otsu's binarization, because it can suitably extract the region of the cells. In this case, the cell processing system 100 of Embodiment 1 may not include, for example, the classifier 126.

[0046] In the cell processing system 100 of Embodiment 1, the additional editing unit 125 finishes processing after editing the identification data, that is, it finishes in one editing step. The disclosure is not limited thereto, and steps S5 to S7 may be performed multiple times. In this case, the information processing method of Embodiment 1, for example, after the completion of step S7, outputs an image including the cells in the culture vessel and the edited identification data to the display unit 13, and the processing of steps S5 to S7 described above is repeated.

[0047] In the cell processing system 100 of Embodiment 1, after editing the identification data by the additional editing unit 125, a classifier capable of distinguishing at least one of the target cells and the non-target cells may be generated using the image containing the cells in the culture vessel and the edited identification data as training data. The generation of the classifier can be described by referring to the description of the classifier 126. Alternatively, in the cell processing system 100 of Embodiment 1, after editing the identification data by the additional editing unit 125, reinforcement learning may be performed on the classifier 126 using the image containing the cells in the culture vessel and the edited identification data as training data.

[0048] (Modified version of Embodiment 1) The cell processing system of this disclosure is not limited to the form of Embodiment 1, and various modifications are possible. Below, we show how the additional editing unit 125 edits other identification data in the cell processing system 100 of Embodiment 1. In the information processing method of Modification 1, steps S1 to S6 are performed in the same manner as the information processing method of Embodiment 1.

[0049] The cell processing system 100 of Modified Example 1 has a configuration that is generally similar to the cell processing system 100 of Embodiment 1, and its description can be applied accordingly. However, it differs from the cell processing system 100 of Embodiment 1 in that the additional editing unit 125 allows for simpler editing of the identification data. Figure 5 is a flowchart showing the information processing method and program processing of Modified Example 1. As shown in Figure 5, the information processing method of Modified Example 1 includes, in addition to steps S1 to S6 of the information processing method of Embodiment 1, a closed region formation additional editing step as S8.

[0050] The additional editing unit 125 in Modification 1 allows for easy specification of the area to be edited when editing identification data. The additional editing unit 125 in Modification 1 functions to form a closed area in response to user operation from the input device 14. Based on Figure 6, the case in Modification 1 where, for example, a user uses a mouse to form a closed area and edit identification data will be described. As shown in Figure 6(A), first, the user positions the cursor at the editing start point P1 at the editing location (arrow Y3). Next, with the cursor at the start point P1, the user presses the left mouse button and drags the mouse, moving the cursor from the editing start point P1 to the editing end point P2 while being mindful of the shape to be edited, so that the desired trajectory is formed. As shown in Figure 6(A), the additional editing unit 125 receives the user's mouse operation input and displays the movement trajectory of the cursor from the editing start point P1 to the editing end point P2 on the display unit 13 (displayed as a white dotted line in Figure 6(A)). Furthermore, the user releases the mouse drag while the cursor is at the editing end point P2. Upon receiving the drag release input, the additional editing unit 125 forms a straight line L1 between the editing start point P1 and the editing end point P2, as shown in Figure 6(B), and displays it on the display unit 13. As a result, the additional editing unit 125 forms a closed region at the editing location (arrow Y3) by the movement trajectory of the cursor from the editing start point P1 to the editing end point P2, and the straight line L1 formed between the editing start point P1 and the editing end point P2. That is, all pixels in the closed region enclosed by the movement trajectory of the cursor from the editing start point P1 to the editing end point P2, and the straight line L1 connecting the editing start point P1 and the editing end point P2, are designated as a region to be newly added to the identification data. Then, this closed region is added and edited as new identification data to the identification data of target cells or non-target cells, and the results of the addition and editing are reflected in the identification data as edited data.

[0051] Thus, in the cell processing system 100 of the modified example 1, in step S7, the additional editing unit 125 can easily create a closed region and create edited data that is reflected in the identification data by using an input method such as handwriting input using a mouse or the like.

[0052] Then, in step S8, similar to step S7 of the information processing method of Embodiment 1, the additional editing unit 125 adds the editing data obtained in step S8, that is, the editing location indicated by arrow Y3 in Figure 6(B), to the aforementioned identification data as newly added identification data. Then, the information processing method of Modified Example 1 is completed. In Modified Example 1, the user input was performed using a mouse, but it can also be performed using other input means such as a keyboard or touch panel.

[0053] In the information processing method of the cell processing system 100 of Modified Example 1, a closed region can be formed using the trajectory from the start point to the end point of editing, input by the user, and a straight line connecting the start point and the end point of editing, and this can be added to the identification data as newly added identification data. Therefore, in the information processing method of Modified Example 1, when a user specifies a particular region of the identification data, they can easily form a closed region and specify the specific region simply by inputting the trajectory from the start point to the end point of editing. Furthermore, it is possible to prevent only a part of the region, for example, the trajectory input by the user during editing, from being reflected in the identification data as editing data. Therefore, according to the information processing method of Modified Example 1, the editing of the identification result by the user can be reflected more accurately.

[0054] (Embodiment 2) In the cell processing system 100 of Embodiment 1, the identification unit 122 identifies target cells and non-target cells in the image, that is, it assigns classifications of target cells and non-target cells to the image, and the additional editing unit 125 edits the identification data. In the cell processing system 200 of Embodiment 2, an example of performing laser processing on at least one of the target cells and non-target cells using the laser irradiation device with respect to Figure 7 will be described.

[0055] As shown in Figure 7, the cell processing system 200 of Embodiment 2 includes a laser processing unit 15 in addition to the configuration of the cell processing system 100 of Embodiment 1. The control unit 12 is connected to the laser processing unit 15. Furthermore, in the cell processing system 200 of Embodiment 2, the control unit 12 includes a setting unit 136. Except for these points, the configuration of the cell processing system 200 of Embodiment 2 is the same as the configuration of the cell processing system 100 of Embodiment 1, and its description can be applied accordingly.

[0056] In the cell processing system 200 of Embodiment 2, the hardware configuration of the control unit 12 is the same as that of the control unit 12 of Embodiment 1, except that the CPU 12a functions as a setting unit 136, and the explanation therefor can be applied.

[0057] The laser processing unit 15 is capable of irradiating the culture vessel with a laser. By irradiating the culture vessel with a laser, the laser processing unit 15 can use a laser irradiation device that can change the state of at least one of the target cells and non-target cells in the control unit 12. For example, the laser processing unit 15 can employ a configuration similar to that of the laser irradiation means described in International Publication No. 2018 / 146854.

[0058] Next, a cell processing method including the information processing method of Embodiment 2 using the cell processing system 200 of Embodiment 2 will be described.

[0059] Figure 8 is a flowchart showing the processing of a cell processing method and program including the information processing method of Embodiment 2. As shown in Figure 8, the cell processing method including the information processing method of Embodiment 2 includes steps S9 (setting) and S10 (laser processing) in addition to steps S1 to S7 of the information processing method of Embodiment 1.

[0060] First, steps S1 to S7 are performed in the same manner as the information processing method in Embodiment 1.

[0061] Next, in step S9, the setting unit 136 sets the irradiation conditions for the laser irradiated from the laser processing unit 15. Examples of the irradiation conditions include the laser irradiation area, irradiation intensity, and irradiation time. The laser irradiation area may be one of the target cells and the non-target cells, or it may be both the target cells and the non-target cells. The irradiation conditions can be set, for example, according to the change in the state of cells to be caused in at least one of the target cells and the non-target cells.

[0062] In step S10, based on the set laser irradiation conditions, the laser processing unit 115 directly or indirectly irradiates the culture vessel, specifically the cells in the culture vessel, with a laser, thereby changing the state of at least one of the target cells and non-target cells identified by the identification unit 122. In addition, in the cell processing system 200 of Embodiment 2, the control unit 12 may be configured such that, as in the case of Modification 1, the additional editing unit 125 forms a closed region to add and edit new identification data, or, as in the case of Modification, it may be configured to easily create a closed region and create editing data that is reflected in the identification data.

[0063] (Embodiment 3) The program of this embodiment is a program that causes a computer to execute the information processing method disclosed herein. In the program of this embodiment, "processing" can also be said to be, for example, a "procedure" or an "instruction". The program of this embodiment may also be recorded on, for example, a computer-readable storage medium. The storage medium is not particularly limited and includes, for example, random access memory (RAM), read-only memory (ROM), hard disk (HD), solid state drive (SSD), optical disc, floppy disk (FD), and the like.

[0064] While the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure may be made that will be understood by those skilled in the art within the scope of the present disclosure.

[0065] <Note> Some or all of the above embodiments and examples may be described as follows, but are not limited to the following. <Information Processing Device> (Note 1) A display unit having a display screen, An acquisition unit that acquires images including cells in a culture vessel, An identification unit that identifies at least one of the target cell and the non-target cell in the aforementioned image, An output unit outputs the identification data of the image identified by the identification unit and the image including the cells in the culture vessel to the display unit and displays them on the display unit. The display unit includes an additional editing unit that adds and edits new identification data to at least one of the identification data of the target cells and the non-target cells displayed on the display unit, An information processing device used for cell treatment by laser irradiation. (Note 2) The additional editing unit defines the region enclosed by the trajectory from the start point to the end point of editing in the additional identification data and the line connecting the start point to the end point of editing as a closed region, and performs additional editing on the identification data as the additional identification data, as described in Appendix 1. (Note 3) The information processing device according to Appendix 1 or 2, wherein the additional identification data is identification data designated by the user's handwritten input as at least one of the target cells and the non-target cells. (Note 4) The identification unit identifies the target cells and / or non-target cells by region extraction processing, as described in any one of Appendix 1 to 3. (Note 5) The region extraction process is a binarization process, as described in Appendix 4 of the information processing apparatus. (Note 6) The information processing device according to any one of the appendices 1 to 5, wherein the identification unit identifies the target cells and / or non-target cells using an identifier capable of identifying them. <Cell Processing System> (Note 7) An information processing device is provided in one of the appendices 1 to 6, The invention includes a laser irradiation device capable of irradiating a culture vessel with a laser, The laser irradiation device irradiates the culture vessel with a laser to change the state of at least one of the target cells and non-target cells identified in the information processing device. Cell processing system. (Note 8) The system described in Appendix 7, including an optical observation device capable of observing the cells in the culture vessel. <Information Processing Methods> (Note 9) An acquisition process to obtain an image including cells in a culture vessel, A recognition step of identifying at least one of the target cells and non-target cells in the aforementioned image, An output step which outputs the identification data of the image identified by the above identification step and the image including the cells in the culture vessel to a display unit and displays them, The process includes an additional editing step of adding and editing new identification data to the identification data of at least one of the displayed target cells and non-target cells, An information processing method for use in cell treatment by laser irradiation, which is performed by a computer. (Note 10) The information processing method according to Appendix 9, wherein in the additional editing step, the region enclosed by the trajectory from the start point to the end point of editing in the additional identification data and the line connecting the start point to the end point of editing is added to the identification data as the closed region. (Note 11) The information processing method according to Appendix 9 or 10, wherein the additional identification data is identification data designated by the user's handwritten input as at least one of the target cells and the non-target cells. (Note 12) The information processing method according to any one of appendices 9 to 11, wherein the identification step involves identifying the target cells and / or the non-target cells by region extraction. (Note 13) The region extraction process is a binarization process, as described in Appendix 12. (Note 14) The information processing method according to any one of appendices 9 to 13, wherein the identification step involves identifying the target cells and / or non-target cells using a classifier capable of distinguishing them. <Program> (Note 15) On the computer, The acquisition process involves obtaining an image containing cells within a culture vessel, A recognition process that identifies at least one of the target cells and non-target cells in the aforementioned image, Output processing to output the identification data of the image identified by the above identification process and the image including the cells in the culture vessel to a display unit and display them, The system performs an additional editing process to add and edit new identification data to the identification data of at least one of the displayed target cells and non-target cells. A program for use in cell treatment using laser irradiation. (Note 16) The program described in Appendix 15 adds to the identification data as a closed region, comprising the trajectory from the start point to the end point of editing in the identification data to be added, and the region enclosed by the line connecting the start point to the end point of editing. (Note 17) The program according to Appendix 15 or 16, wherein the additional identification data is identification data designated by the user's handwritten input as at least one of the target cells and the non-target cells. (Note 18) The program described in any of appendices 15 to 17 identifies the target cells and / or non-target cells by region extraction in the identification process. (Note 19) The aforementioned region extraction process is a binarization process, as described in the program in Appendix 18. (Note 20) The program according to any one of appendices 15 to 19, wherein the identification process uses a classifier capable of distinguishing the target cells and / or the non-target cells. (Note 21) A computer-readable recording medium containing a program described in any of the appendices 15 to 20. [Explanation of Symbols]

[0066] 11 Observation Department 12 Control Unit 121 Acquisition Department 122 Identification Unit 123 Output section 125 Additional Editorial Team 136 Settings Section 13 Display section 14 Input devices 15 Laser Processing Unit 100, 200 cell processing system

Claims

1. A display unit having a display screen, An acquisition unit that acquires images including cells in a culture vessel, An identification unit that identifies at least one of the target cell and the non-target cell in the aforementioned image, An output unit outputs the identification data of the image identified by the identification unit and the image including the cells in the culture vessel to the display unit and displays them on the display unit. The display unit includes an additional editing unit that adds and edits new identification data to at least one of the identification data of the target cells and the non-target cells displayed on the display unit, An information processing device used for cell treatment by laser irradiation.

2. The information processing apparatus according to claim 1, wherein the additional editing unit defines the region enclosed by the trajectory from the start point to the end point of editing in the additional identification data and the line connecting the start point to the end point of editing as a closed region, and performs additional editing on the identification data as the additional identification data.

3. The information processing apparatus according to claim 1 or 2, wherein the additional identification data is identification data designated by the user's handwritten input as at least one of the target cell and the non-target cell.

4. The information processing apparatus according to any one of claims 1 to 3, wherein the identification unit identifies the target cells and / or the non-target cells by region extraction processing.

5. The information processing apparatus according to claim 4, wherein the region extraction process is a binarization process.

6. The information processing apparatus according to any one of claims 1 to 5, wherein the identification unit identifies the target cells and / or non-target cells using an identifier capable of identifying them.

7. An information processing device according to any one of claims 1 to 6, The invention includes a laser irradiation device capable of irradiating a culture vessel with a laser, The laser irradiation device irradiates the culture vessel with a laser to change the state of at least one of the target cells and non-target cells identified in the information processing device. Cell processing system.

8. The system according to claim 7, further comprising an optical observation device capable of observing the cells in the culture vessel.

9. An acquisition process to obtain an image including cells in a culture vessel, A recognition step of identifying at least one of the target cells and non-target cells in the aforementioned image, An output step which outputs the identification data of the image identified by the above identification step and the image including the cells in the culture vessel to a display unit and displays them, The process includes an additional editing step of adding and editing new identification data to the identification data of at least one of the displayed target cells and non-target cells, An information processing method for use in cell treatment by laser irradiation, which is performed by a computer.

10. On the computer, The acquisition process involves obtaining an image containing cells within a culture vessel, A recognition process that identifies at least one of the target cells and non-target cells in the aforementioned image, Output processing to output the identification data of the image identified by the above identification process and the image including the cells in the culture vessel to a display unit and display them, The system performs an additional editing process to add and edit new identification data to the identification data of at least one of the displayed target cells and non-target cells. A program for use in cell treatment using laser irradiation.

Images