Progress display device and computer-readable program

Abstract

This system provides a progress display that makes it easy to understand the progress of sample analysis. [Solution] The progress display device 1, which displays the progress of processing on a collection of cells used for sample analysis, comprises a display unit 11 and a display control unit 12 that controls the display on the display unit 11. The display control unit 12 causes the display unit 11 to display a progress list showing the progress for at least one sample, associated with each sample, and an analysis field list showing the progress of processing for at least one analysis field set for each sample, associated with each analysis field. Based on monitoring of information generated in relation to the processing or input of such information, the display control unit 12 updates the progress list or the analysis field list.

Description

Technical Field

[0001] The present invention relates to the treatment of cell aggregates used in medical research and diagnostic procedures.

Background Art

[0002] Conventionally, in medical research and biological research, for the purpose of elucidating disease mechanisms, biological mechanisms, drug action mechanisms, etc., single-cell unit analysis of biological specimens such as tissue specimens and cell specimens has been carried out. Regarding multiplex immunostaining analysis, which is one of the methods, a method has been proposed for quantitatively analyzing the expression status of biological substances by using machine learning and image processing on digital images of pathological tissue specimens.

[0003] For example, in Patent Document 1, a technique for identifying individual cells even when the cell density is high is disclosed when performing multiple stainings on a specimen in sequence to determine the cell region. On the other hand, in Patent Document 2, a technique for improving the cooperation between a LIS (Laboratory Information System) and a WSI management system by providing folders such as a preparation folder, a diagnosis folder, a request for additional staining folder, and a sorted folder in a WSI (Whole Slide Image) management system is disclosed.

Prior Art Documents

[0006] However, due to differences in input / output units at each stage, the work units differ from stage to stage, and some stages involve manual work, making it difficult to grasp detailed work progress, including the possibility of rework. In particular, when multiple people perform each stage, work omissions are more likely to occur.

[0007] This invention has been made in view of the above problems, and aims to realize a progress display that allows for easy understanding of the progress of sample analysis. [Means for solving the problem]

[0008] One aspect of the present invention is a progress display device for displaying the progress of processing on a collection of cells used for sample analysis, comprising a display unit and a display control unit for controlling the display on the display unit, wherein the display control unit causes the display unit to display a progress list showing the progress for at least one sample associated with each sample and an analysis field list showing the progress of processing for at least one analysis field set for each sample associated with each analysis field, and the display control unit updates the progress list or the analysis field list based on monitoring of information generated in relation to the processing or input of such information.

[0009] Aspect 2 of the present invention is a progress display device according to aspect 1, wherein the analysis field list includes a plurality of partial lists corresponding to the stages of the processing.

[0010] A third aspect of the present invention is a progress display device according to aspect 1 (or aspect 1 or aspect 2), wherein, in each sample, if the completion time of each process included in the processing is later than the completion time of a later process, the display control unit provides a display in the progress list or the analysis field list to draw attention to the item indicating the later process.

[0011] Aspect 4 of the present invention is a progress display device according to Aspect 1 (which may be any one of Aspects 1 to 3), wherein at least one recipe indicating analysis conditions can be set, and when multiple recipes are set, the analysis field list is created for each of the multiple recipes.

[0012] A fifth aspect of the present invention is a progress display device according to the fourth aspect, wherein the display control unit causes the display unit to display a list of recipes indicating the progress of processing related to at least one recipe.

[0013] Aspect 6 of the present invention is a progress display device according to aspect 5, wherein the recipe list includes the creation time for each of the at least one recipes, and when the creation time for a recipe is updated due to a change in that recipe, the display control unit provides a display in the progress list or the analysis field list that draws attention to an item indicating a process among the processes included in the process that depends on the recipe.

[0014] Aspect 7 of the present invention is a progress display device according to aspect 1 (which may be any one of aspects 1 to 6), further comprising an operation unit for receiving input from an operator, wherein when the operator specifies an item in the progress list that indicates a process related to the operator's work via the operation unit, the display control unit causes the display unit to display a work screen related to that item.

[0015] Aspect 8 of the present invention is a progress display device according to Aspect 1 (which may be any one of Aspects 1 to 7), further comprising an operation unit for receiving input from an operator, wherein when the operator specifies via the operation unit to display an aggregation condition setting screen for setting aggregation conditions for analysis results, the display control unit causes the aggregation condition setting screen to be displayed on the display unit, and the setting of the aggregation conditions includes specifying that a plurality of samples which are at least one sample, or a plurality of analysis fields included in the at least one sample, be divided into a plurality of groups for comparing the results of the sample analysis.

[0016] Aspect 9 of the present invention is a progress display device according to Aspect 1 (which may be any one of Aspects 1 to 7), wherein a plurality of samples that are at least one sample, or a plurality of analysis fields included in the at least one sample, are divided into a plurality of groups for comparing the results of the sample analysis.

[0017] Aspect 10 of the present invention is a progress display device according to any one of aspects 1 to 9, wherein each of the specimens is a pathological tissue specimen.

[0018] Aspect 11 of the present invention is a computer-readable program that causes a computer to display the progress of processing on a collection of cells used for sample analysis on a display unit, wherein the execution of the program by the computer causes the computer to perform the steps of: a) displaying the progress for at least one sample on the display unit as a progress list associated with each sample; b) displaying the progress of processing for at least one analysis field set for each sample on the display unit as an analysis field list associated with each analysis field; and c) updating the progress list or the analysis field list based on monitoring of information generated in work related to the processing or input of such information. [Effects of the Invention]

[0019] According to the present invention, a progress display is realized that allows for easy understanding of the progress of sample analysis. [Brief explanation of the drawing]

[0020] [Figure 1] It is a diagram showing the configuration of a computer that functions as a progress display device. [Figure 2] It is a block diagram showing the functional configuration of the progress display device. [Figure 3] It is a diagram showing an outline of the steps performed in multiple immunostaining analysis. [Figure 4] It is a diagram showing an example of a progress list. [Figure 5] It is a diagram showing an example of a list of analysis fields of view. [Figure 6] It is a diagram showing an example of a list of analysis fields of view. [Figure 7] It is a diagram showing an example of an analysis field of view setting screen. [Figure 8] It is a diagram showing an example of a cell recognition screen. [Figure 9] It is a diagram showing an example of an analysis screen. [Figure 10] It is a diagram showing an example of a recipe list. [Figure 11] It is a diagram showing an example of a collection condition setting screen.

Mode for Carrying Out the Invention

[0021] FIG. 1 is a diagram showing the configuration of a computer 5 that functions as a progress display device according to an embodiment of the present invention. The progress display device is a device that displays the progress of processing on a set of cells used for specimen analysis, and is used, for example, in the field of image cytometry. In the present embodiment, the progress display device is assumed to display the progress of multiple immunostaining analysis, but the use of the progress display device is not limited to such specimen analysis. The progress display device displays a list suitable for the steps included in the specimen analysis process, and facilitates grasping the progress even when analyzing a large number of analysis fields of view of a large number of specimens in one study.

[0022] Computer 5 has the configuration of a general computer system, including a CPU 51, a GPU 52, a ROM 53, a RAM 54, a fixed disk 55, a display 56, an input unit 57, a reader 58, a communication unit 59, and a bus 50. The CPU 51 performs various arithmetic operations. The GPU 52 performs various image processing operations at high speed. The ROM 53 stores basic programs. The RAM 54 stores various information. The fixed disk 55 stores information. The display 56 displays various information such as images.

[0023] The input unit 57 includes a keyboard 57a and a mouse 57b that accept input from the operator. The reader 58 reads information from a computer-readable recording medium 9 such as an optical disk, magnetic disk, magneto-optical disk, or memory card. The display 56, keyboard 57a, mouse 57b, and reader 58 are connected to the bus 50 via an interface (I / F). The communication unit 59 sends and receives signals to and from external devices of the computer 5.

[0024] Bus 50 is a signal circuit that connects the CPU 51, GPU 52, ROM 53, RAM 54, fixed disk 55, display 56, input unit 57, reader 58, and communication unit 59.

[0025] In computer 5, program 91 is read in advance from recording medium 9 via reader 58 and stored in fixed disk 55. Program 91 may also be stored in fixed disk 55 via a network. CPU 51 and GPU 52 perform arithmetic processing using RAM 54 and fixed disk 55 according to the computer-readable program 91. CPU 51 and GPU 52 function as the arithmetic unit in the progress display device. Other configurations besides CPU 51 and GPU 52 that function as the arithmetic unit may also be employed.

[0026] Figure 2 is a block diagram showing the functional configuration of the progress display device 1, which is realized when the computer 5 described above performs calculations and other processing according to program 91. All or part of each functional configuration may be realized by dedicated electrical circuits. Furthermore, these functional configurations may be realized by multiple computers. Program 91 is a program that causes the computer 5 to display the progress of processing on the cell collection used for sample analysis on the display unit 11.

[0027] Of the functional configurations shown in Figure 2, the display unit 11 primarily performs the functions of the display 56 in Figure 1, displaying information to the operator. The display control unit 12 is implemented by the CPU 51, GPU 52, ROM 53, RAM 54, fixed disk 55, and their peripheral configurations, and primarily controls the display on the display unit 11. The display control unit 12 may include other functions. In Figure 2, the functions of the display control unit 12 are shown as processes and functional configurations executed by the display control unit 12, but the details will be described later. The operation unit 13 receives input from the operator and is a function mainly implemented by the input unit 57 in Figure 1.

[0028] The work devices 81 and 82 shown in Figure 2 represent functions that execute processes related to the analysis. Work devices 81 and 82 may be provided as devices independent of the progress display device 1, or they may be functions realized by the computer 5, which is the progress display device 1, through the execution of a dedicated program by the CPU 51, GPU 52, etc. Although Figure 2 illustrates two work devices 81 and 82, the number of work devices may be one or more. In other words, the number of work devices is one or more.

[0029] Figure 3 is a schematic diagram of the process performed in multiplex immunohistochemistry analysis, showing a case where only medically significant areas are selected as the analysis field, rather than the entire specimen image.

[0030] First, specimen data acquired by an external imaging device is input to the progress display device 1 via the communication unit 59 and registered in the progress display device 1 by the operator (step S11). In this embodiment, the specimen data is image data of pathological tissue specimens, but includes normal color image data and image data after multiple types of staining (image data after multiple types of staining obtained by repeatedly staining and destaining) for the same specimen. One or more images represented by image data corresponding to one specimen are hereinafter referred to as a "specimen image group".

[0031] Next, one sample image included in the sample image group is displayed on the display unit 11, and the operator selects at least one region of interest (analysis field) from the sample image, and an image of this at least one region (hereinafter referred to as the "analysis field image") is acquired (step S12). Note that the operation to acquire one analysis field image is, more precisely, equivalent to acquiring an analysis field image of the same location for each sample image in the sample image group, but in terms of setting the analysis field, it is the operation to set one analysis field. The sample image is a relatively large image compared to the analysis field.

[0032] Next, the display control unit 12, in accordance with the operator's operation, extracts cell regions from each of the at least one analysis field images (hereinafter referred to as the "analysis field image group") in the sample image group by processing with the CPU 51 and GPU 52, and acquires cell region extraction images (more precisely, at least one cell region extraction image, hereinafter referred to as the "cell region extraction image group") that show the cell regions (step S13). Furthermore, in accordance with the operator's instructions, the display control unit 12 obtains numerical information such as the number of positive cells under predetermined conditions in each analysis field as analysis results based on the cell region extraction image group (step S14). For example, if a feature quantity, which is a numerical value obtained by quantifying the staining status of each immunostain on a single-cell basis, is above a set threshold, the cell is judged to be positive for that immunostain, and the number of subdivided cells is measured by combining the judgments of multiple stains.

[0033] The analysis results obtained from the analysis field images and cell region extraction images are compiled by the display control unit 12 in units appropriate to the research content (sample units, all samples handled in one study, group units specified based on the degree of disease, etc.) according to the operator's instructions, and the image data is also combined and collected in one folder as the deliverable for one project (step S15).

[0034] Here, due to the differences in input and output units in each of the above processes, the most efficient unit for each process differs. Specifically, in step S12, sample-level data is input and analysis field-level data is output. In steps S13 and S14, analysis field-level data is input and analysis field-level data is output. In step S15, analysis field-level data is input and data in an arbitrarily specified unit is output.

[0035] Furthermore, from the perspective of automated vs. manual processing, the analysis process in step S13 is performed automatically, whereas in step S12, it is necessary to manually set appropriate thresholds according to the research objectives. Thus, depending on the process, the unit of action that can be worked efficiently differs, such as project unit, sample unit, or field of view unit, while being affected by whether or not manual work is performed. As will be described later, the progress display device 1 displays lists at various levels of granularity, i.e., levels of detail of information, making it easy to grasp the progress status and realizing a display that improves work efficiency.

[0036] Furthermore, conditions such as threshold changes frequently occur at various stages, requiring subsequent steps to be repeated. However, when analyzing a large number of fields of view, it is difficult for an operator to keep track of all progress. When multiple people are working on the project, sharing progress becomes difficult, making it easy for tasks to be overlooked. For example, a single project often involves multiple samples, and multiple fields of view are analyzed from each sample, resulting in a total of tens to hundreds of fields of view being analyzed.

[0037] In this situation, if thresholds are changed in other processes after the aggregation in step S15, the output of numerical information obtained for each analysis field (hereinafter also referred to as "export") must be performed again, followed by aggregation and collection of deliverables. Therefore, it is necessary to perform the work while checking a vast amount of information to ensure that the export of all analysis fields and subsequent work have been performed in the latest state. As will be described later, the progress display device 1 can reduce the likelihood of omissions and errors in such rework by highlighting areas that require attention or warnings to the operator.

[0038] Figure 4 shows an example of a progress list 31 displayed on the display unit 11 when the display control unit 12 performs the progress list display step 21 (see Figure 2). The progress list 31 shows the progress for at least one specimen, relating it to each specimen of that at least one specimen. In this embodiment, each specimen is a pathological tissue specimen.

[0039] The example progress list 31 in Figure 4 shows one project containing five samples, and is a list for tracking the progress of each sample. The "Sample Name" column shows "Sample A," "Sample B," "Sample C," "Sample a," and "Sample b." The "Group" column, "Group 1" and "Group 2," indicates that "Sample A," "Sample B," and "Sample C" belong to "Group 1," and "Sample a" and "Sample b" belong to "Group 2."

[0040] Groups are used when aggregating analysis results, and specific examples of groups are provided below. As an example of aggregation in medical research, consider a case where 20 samples are taken from 20 patients with the same disease, and 10 analysis fields are set for each sample (Case 1). In addition, multiple analysis fields are often set for a single sample to reduce variability in analysis results due to differences in the location of the analysis field within each sample.

[0041] In hypothetical case 1, to understand the characteristics of the disease, the data is compiled from all analytical fields (20 samples × 10 analytical fields = 200 analytical fields) of all samples to investigate trends in the types and numbers of cells observed in patients with the target disease. Alternatively, stratification is performed by comparing patients with the same disease (between samples). In this case, 10 analytical fields are compiled for each sample, a group is set up for each sample, and comparisons are made between samples.

[0042] Another example involves taking 10 samples from patients with the same disease before treatment and 10 samples from patients after treatment, and then analyzing 10 analytical fields from each set of samples (Hypothetical Case 2). Each group of 10 samples is considered one group. That is, 100 analytical fields are analyzed for the pre-treatment sample group (10 samples × 10 analytical fields =), and 100 analytical fields are analyzed for the post-treatment sample group (10 samples × 10 analytical fields =). The results are then compiled by sample group, and the analysis results are compared between groups to identify cells that affect the treatment.

[0043] Another example involves collecting samples from 20 patients with the same disease, and analyzing each sample by setting 5 analysis fields for tumor sites and 5 analysis fields for normal sites (Hypothetical Case 3). In other words, 100 analysis fields are analyzed as a group of tumor sites (20 samples × 5 analysis fields =), and 100 analysis fields are analyzed as a group of normal sites (20 samples × 5 analysis fields =). The analysis results are then compiled by site (i.e., by group), and an attempt is made to understand the characteristics unique to tumor sites that are not present in normal sites, in order to develop anticancer drugs that efficiently attack only tumor cells.

[0044] As described above, the grouping of samples or analysis fields is used when summarizing the analysis results in step S15 of Figure 3. Note that while grouping is done at the sample level in Figure 4, grouping at the analysis field level will be discussed later (see Figure 11).

[0045] Figure 4 shows the steps included in the sample analysis process: "Analysis Field Setting," "Cell Recognition," and "Analysis." The "Completed," "In Progress," and "New" labels in each sample row indicate the progress of each step. In the following explanation, the boxes displaying "Completed," "In Progress," "New," and later labels such as "R01," "R02," etc. (see Figure 5) will also be referred to as "cells."

[0046] "Completed" indicates that the corresponding process has been completed without any problems. In Figure 4, the cells for "Completed" are shown in green by the dashed parallel diagonal lines. In Sample A, all processes are "Completed". "In Progress" indicates that the corresponding process has been started but has not been completed. In Figure 4, the cells for "In Progress" are shown in yellow by the dashed parallel diagonal lines. The yellow color draws the operator's attention. In Samples B, C, and a, "Analysis Field Setting" and "Cell Recognition" are "Completed", and "Analysis" is "In Progress". "New" indicates that the corresponding process has not been started. In Figure 4, the cells for "New" are shown in white by the absence of parallel diagonal lines. In Sample b, "Analysis Field Setting" is "In Progress", and "Cell Recognition" and "Analysis" are "New".

[0047] Figure 5 shows an example of the analysis field list 32 displayed on the display unit 11 when the display control unit 12 performs the analysis field list display step 22 (see Figure 2). The analysis field list 32 shows the progress of processing related to at least one analysis field set for each sample, associated with each analysis field. The analysis field list allows for easy understanding of the number of analysis fields set, which are part of the sample to be analyzed, and the progress of work on each analysis field.

[0048] The analysis field list 32 in the example shown in Figure 5 includes the "Analysis Preparation Process" tab and the "Analysis Process" tab, and Figure 5 shows the state where the "Analysis Preparation Process" tab is selected and a partial list of the analysis field list 32 is displayed.

[0049] The "Analysis Field" column shows the identification number of the analysis field set for each sample. For "Sample A," five analysis fields are set (identification numbers) from "R01" to "R05." For "Sample B," three analysis fields are set ("R01" to "R03"). For "Sample C," four analysis fields are set ("R01" to "R04"). For "Sample a," three analysis fields are set ("R01" to "R03"). For "Sample b," four analysis fields are set ("R01" to "R04").

[0050] In "Sample A," "Sample B," "Sample C," and "Sample a," with the exception of "R02" in "Sample C," the cells for each analysis field are green to indicate that the "preparation for analysis" process has been completed. Completion of the "preparation for analysis" process means that cell recognition has been performed. In Figure 5, the dashed parallel diagonal lines indicate that cells for which the "preparation for analysis" process has been completed are green. In "Sample C," "R02" is not subject to analysis, and the corresponding cell is gray, indicated by the dashed parallel diagonal lines. For "Sample b," the analysis fields "R01" to "R04" have not yet undergone the "preparation for analysis" process, i.e., cell recognition has not been performed, and these cells are white, indicated by the absence of parallel diagonal lines.

[0051] Figure 6 shows the state when the "Analysis Process" tab is selected in the Analysis Field List 32 and a partial list of the Analysis Field List 32 is displayed. For "R01" to "R05" of "Sample A", "R01" and "R02" of "Sample B", "R01" of "Sample C", and "R01" and "R03" of "Sample a", the cells for each analysis field are green to indicate that the "Analysis Process" has been completed. In Figure 6, the cells that are green are indicated by dashed parallel diagonal lines to show that the "Analysis Process" has been completed. Completion of the "Analysis Process" means that the recipe, which is the analysis condition described later, has been created and the analysis has been performed according to the recipe. For "R02" of "Sample C", the corresponding cell is gray, indicated by a dashed parallel diagonal line to show that it is not included in the analysis. Such excluded samples are those that were excluded from the analysis after the analysis field was set, for example, due to sample tearing or nonspecific staining.

[0052] For "R03" in "Sample B," "R03" and "R04" in "Sample C," "R02" in "Sample a," and "R01" through "R04" in "Sample b," the "analysis process" has not yet been started, and the absence of parallel diagonal lines indicates that these cells are white. "Analysis process not started" means that no analysis has been performed.

[0053] The "Analysis Preparation Steps" display in the Analysis Field List 32 makes it easy to check the number of analysis fields set for each specimen and whether any cell recognition steps have been omitted. The "Analysis Steps" display makes it easy to check whether any recipes have been applied incorrectly, i.e., whether any analyses have been omitted.

[0054] Next, the linkage between the progress list 31 and the analysis field list 32 controlled by the display control unit 12 will be explained. In the basic operation of the linkage, when the operator selects a cell where the row of a sample and the column of a process intersect in the progress list 31 using a mouse or the like, the work screen for the above process of the above sample is displayed on the display unit 11. When the work screen is closed after the work is completed, the display state of the progress list 31 or the analysis field list 32 is updated. Note that "the display state of the progress list 31 or the analysis field list 32 is updated" includes the case where "the display states of both the progress list 31 and the analysis field list 32 are updated".

[0055] For example, if cell 301 of "Analysis Field Settings" for "Sample b" in Figure 4 is in the "New" (or "In Progress") state, and the operator selects this cell using a mouse or similar device, the analysis field settings screen 33, as illustrated in Figure 7, will be displayed. Immediately after the "New" display, only the tissue image 331 is shown on the analysis field settings screen 33, and the analysis field for sample b is set by the operator specifying the range of analysis fields R01 to R04 using a mouse or similar device. On the analysis field settings screen 33, the operator can add, delete, or move any analysis field (shown as a square in Figure 7).

[0056] When the field of view (CFL) settings are complete and the CFL setting screen 33 is closed, the display control unit 12 generates a data file showing the CFL, and the contents of the analysis preparation process tab in the CFL list 32 are displayed, with CFLs R01 to R04 displayed in the row for sample b. Also, when the progress list 31 is displayed, "Completed" is displayed in cell 301. If the CFL list 32 is displayed during the CFL setting process, only the set CFLs will be displayed, and when the progress list 31 is displayed, "In Progress" is displayed in cell 301. The same applies if the CFL setting is interrupted midway.

[0057] The setting of the analysis field may be a function executed by the CPU 51 or GPU 52 of the progress display device 1, or it may be a function implemented by a computer separate from the progress display device 1 in cooperation with the progress display device 1. These functions correspond to the work devices 81 and 82 shown in Figure 2, and will hereinafter simply be referred to as "work devices". The display control unit 12 monitors the information generated by the work devices (corresponding to the generated information 821 in Figure 2, which here is information indicating the number, position, size, etc., of the analysis field) and updates the progress list 31 or the analysis field list 32 based on the presence or absence and status of the generated information. The display control unit 12 may also update the progress list 31 or the analysis field list 32 based on the input of information from the work devices. The update of the progress list 31 or the analysis field list 32 is performed by the display control unit 12 in Figure 2 executing the update process 24. Note that "input of information from the work devices" includes not only cases where generated information is input from the work devices, but also cases where information indicating that generated information has been generated is input.

[0058] As an example, in Figure 4, when cell 302 of "Sample a" under "Cell Recognition" is in the "New" (or "In Progress") state, and the operator selects the cell using a mouse or similar device, the cell recognition screen 34 shown in Figure 8 is displayed. Immediately after display, the default analysis field is selected, but Figure 8 shows the case where analysis field R03 is selected from list 345 by the operator. The image 341 on the left of the cell recognition screen 34 is the image of the analysis field R03 to be recognized, and the image 342 on the right is the image after cell recognition. In reality, image 341 can be selected from multiple stained images corresponding to each stain, but the explanation is omitted here.

[0059] The operator adjusts the values ​​of various parameters, such as the binarization threshold and edge extraction parameters during cell recognition, via a settings screen displayed separately through the control unit 13, and repeats cell recognition by clicking the cell recognition button 343, or by clicking the result confirmation button 344 to display an overlay image (not shown) in which the recognized image (image 342) is superimposed on the original image (image 341).

[0060] When the operation is completed and the operator closes the cell recognition screen 34, the display control unit 12 generates a data file showing the cell recognition results and displays the contents of the analysis preparation process tab in the analysis field list 32. The cell for analysis field R03 of specimen a is displayed in green to indicate completion of the operation. Furthermore, when the progress list 31 is displayed, if cell recognition is completed for all analysis fields of specimen a, "Completed" is displayed in cell 302. If cell recognition is completed for only some of the analysis fields of specimen a, "In Progress" is displayed in cell 302.

[0061] The cell recognition process may be a function executed by the CPU 51 or GPU 52 of the progress display device 1, or it may be a function realized by a computer separate from the progress display device 1 in cooperation with the progress display device 1. These functions correspond to the work devices 81 and 82 shown in Figure 2. The display control unit 12 monitors the information generated by the work devices (corresponding to the generated information 821 in Figure 2, which here is information on the detailed recognition image) and updates the progress list 31 or the analysis field list 32 based on the presence and status of the generated information. The display control unit 12 may also update the progress list 31 or the analysis field list 32 based on the input of information from the work devices. The update of the progress list 31 or the analysis field list 32 is performed by the display control unit 12 in Figure 2 executing the update process 24.

[0062] As an example, in Figure 4, when cell R03 of "Sample a" under "Analysis" is in the "New" (or "In Progress") state, and the operator selects the cell using a mouse or similar device, the analysis screen 35 shown in Figure 9 is displayed. Immediately after display, the default analysis field is selected, but Figure 9 shows the case where the analysis field R03 is selected from list 352 by the operator. The analysis is performed automatically according to the "recipe," which is the analysis condition set in advance or on the analysis screen 35. If multiple recipes are set, the analysis is performed automatically when the analysis field and recipe are selected. The analysis results are displayed in the center of the analysis screen 35, and the image on the right, 351, is an image that displays the analysis results overlaid on the image of the analysis field.

[0063] The "Stain Name" column on analysis screen 35 indicates that the analysis field contains stained images labeled "Stain 1," "Stain 2," "Stain 3," and "Stain 4." In other words, the "Stain 1," "Stain 2," "Stain 3," and "Stain 4" images in the analysis field constitute the analysis field image group. The "Positive Judgment Threshold" is the threshold for determining stain positivity in each stained image and is a setting included in the recipe. The "Positive Cell Count" is the number of cells judged positive from each stained image.

[0064] The "Combination" section of the analysis screen displays the analysis results for combinations of positive and negative results for multiple stains. The stain combinations are set to subdivide cell types. The "Stain 1+ / Stain 2+" column indicates that the cell is positive for both stain 1 and stain 2, while the "Number of Corresponding Cells" column shows the number of such cells. The "Color" column indicates the color in which the corresponding cells are displayed in image 351 on the right; in Figure 9, the cells are colored red, as indicated by parallel diagonal lines.

[0065] The "Stain 1+ / Stain 2-" column indicates that the cell is positive for stain 1 and negative for stain 2, while the "Number of Corresponding Cells" column shows the number of corresponding cells. The "Color" column shows the color in which the corresponding cells are stained in image 351 on the right; in Figure 9, parallel diagonal lines indicate that the cells are stained blue. The "Stain 1- / Stain 2+" column indicates that the cell is negative for stain 1 and positive for stain 2, while the "Number of Corresponding Cells" column shows the number of corresponding cells. The "Color" column shows the color in which the corresponding cells are stained in image 351 on the right; in Figure 9, parallel diagonal lines indicate that the cells are stained green. The "Combination" conditions are also set in the recipe.

[0066] When the analysis for a specific recipe in a specific field of view is completed and the operator closes the analysis screen 35, the display control unit 12 generates a data file showing the analysis results and displays the contents of the analysis process tab in the field of view list 32. In the example in Figure 9, the cell for field of view R03 of sample a in Figure 8 is displayed in green, indicating that the work is complete. Note that in Figure 9, which is a screen launched from the "recipe02" screen (see reference numeral 323) in Figure 6, "recipe02" is selected as the recipe. Furthermore, when the progress list 31 is displayed, if the analysis for all fields of view of sample a related to the currently used recipe (the recipe selected in the field of view list 32) is complete, "Completed" is displayed in cell 303. If only some of the fields of view have been analyzed, "In Progress" is displayed in cell 303.

[0067] The analysis conditions included in the recipe may be set in advance by the operator via the recipe settings screen, or a new recipe may be automatically generated when the set values ​​(thresholds, staining combinations, etc.) are created or modified on the analysis screen 35. In the latter case, the analysis for the new recipe is automatically performed at the same time as the recipe is set.

[0068] The analysis process may be a function executed by the CPU 51 or GPU 52 of the progress display device 1, or it may be a function implemented by a computer separate from the progress display device 1 in cooperation with the progress display device 1. These functions correspond to the work devices 81 and 82 shown in Figure 2. The display control unit 12 monitors the information generated by the work devices (corresponding to the generated information 821 in Figure 2, which here is the analysis result) and updates the progress list 31 or the analysis field list 32 based on the presence or absence and status of the generated information. The display control unit 12 may also update the progress list 31 or the analysis field list 32 based on the input of information from the work devices. The update of the progress list 31 or the analysis field list 32 is performed by the display control unit 12 in Figure 2 executing the update process 24.

[0069] In the progress list 31 and analysis field list 32 above, the completion of each step included in the analysis process is indicated by text or color, but the completion time may also be included in these displays.

[0070] As described above, in the progress display device 1, when the operator specifies an item (in the above example, a "cell") in the progress list 31 that indicates a process related to the operator's work via the operation unit 13, the display control unit 12 displays the work screen related to that item on the display unit 11. This enables the operator to proceed with the work accurately while referring to the progress display device 1. The "item related to the work" is not limited to a cell; other items may be displayed, or a work screen may be selected from items in a work-related menu.

[0071] In the above description, the progress display device 1 functions as an interface for the operator during work performed by the operator on the work device; however, the work performed by the operator on the work device may be independent of the progress display device 1.

[0072] Figure 10 shows an example of a recipe list 36 displayed on the display unit 11 when the display control unit 12 performs the recipe list display step 23 (see Figure 2). The recipe list 36 displays the progress for each of at least one recipe.

[0073] In the example in Figure 10, three recipes are shown with the "Recipe Name" being "recipe01," "recipe02," and "recipe03." The "Recipe Creation Date and Time" column displays the date and time each recipe was created. The "Created" date and time of a recipe also includes the date and time when the recipe was "modified," or "updated." The export date and time is the time when the analysis according to the recipe of interest has been performed for all analysis fields of the case and the output of results for all analysis fields has been completed. Note that the export of analysis results is performed for each analysis field, and is executed by selecting the analysis field and clicking the export button 321 in Figure 6.

[0074] The "Result Aggregation Date and Time" column in Figure 10 shows the time when the process of aggregating the exported analysis results according to pre-set conditions is completed by clicking the result aggregation button 322 in Figure 6. The recipe menu 323 in Figure 6 is a pull-down menu, and "recipe01," "recipe02," or "recipe03" can be selected. When a recipe is selected, the progress for that recipe is displayed in the analysis field list. In this way, the progress display device 1 allows at least one recipe, each indicating analysis conditions, to be set via the work device, and when multiple recipes are set, an analysis field list 32 (more precisely, an analysis field list related to the analysis) is created for each of the multiple recipes.

[0075] In the recipe list 36 in Figure 10, progress is indicated by coloring each cell. Specifically, the display control unit 12 executes the recipe list display process 23 in Figure 2, causing the display unit 11 to display the recipe list 36, which shows the progress of processing related to at least one recipe. In Figure 10, different colors are represented by different parallel diagonal lines. In the example in Figure 10, the "recipe creation date and time" cell for "recipe01" is green, the "export date and time" cell is red, and the "result summary date and time" cell is red. In "recipe02", the "recipe creation date and time" cell is yellow, the "export date and time" cell is yellow, and the "result summary date and time" cell is white (blank). In "recipe03", the "recipe creation date and time" cell is green, the "export date and time" cell is green, and the "result summary date and time" cell is green.

[0076] A green cell in the "Recipe Creation Date" column indicates that the corresponding recipe has been set up and analyzed across the entire field of view. A yellow cell in the "Recipe Creation Date" column indicates that the analysis according to the corresponding recipe has not been completed in some of the analyzed fields of view.

[0077] A green cell in the "Export Date and Time" column indicates that the export of analysis results has been completed for all fields of view after the creation (or modification) of the corresponding recipe. A yellow cell in the "Export Date and Time" column indicates that the export of analysis results has not been completed for some fields of view. A red cell in the "Export Date and Time" column indicates that the export of analysis results needs to be performed again.

[0078] A green cell in the "Result Aggregation Date and Time" column indicates that the aggregation of analysis results for the corresponding recipe has been completed. A red cell in the "Result Aggregation Date and Time" column indicates that the aggregation needs to be run again.

[0079] To explain the progress display for each of the 36 recipes in Figure 10: In "recipe01," the red indicates that the recipe needs to be changed after the analysis results have been compiled, and the steps from export onwards need to be repeated. In "recipe02," the yellow indicates that the analysis is not yet complete for some of the 19 analysis fields across 5 samples. In "recipe03," the green indicates that the results have been compiled for all analysis fields.

[0080] As previously mentioned, the completion time of each task can also be displayed in the progress list 31 and the analysis field list 32 (not shown in Figures 4 to 6). By displaying the completion time in the progress list 31, the analysis field list 32, and the recipe list 36, the operator can obtain information such as the order in which the tasks were performed and which task was performed most recently. The progress display device 1 displays the information in a way that makes it easy for the operator to recall the order and content of the tasks.

[0081] The progress display device 1 uses a red indicator to signal a warning and draw attention, thereby preventing missed rework. The operation of the display control unit 12 to prompt rework is described below.

[0082] If an additional analysis field is added, the subsequent steps after cell recognition will be prompted to be redone. Adding an analysis field is done, for example, to increase the number of analysis fields, or when analyzing normal areas in addition to tumor areas.

[0083] Adding an analysis field is done on the analysis field setting screen 33 in Figure 7. This ensures that the file generated in the analysis field setting (corresponding to the generated information 821 in Figure 2) has a newer update date than the file generated after cell recognition. When the operator closes the analysis field setting screen, the display control unit 12 compares the update dates of the generated files for each step and updates the display in the progress list 31, etc. In the progress list 31, for the row of the specimen, the corresponding cell for "Analysis Field Setting" becomes "Completed," and the cells for "Cell Recognition" and "Analysis" become "Requires Rework" and turn red. In the analysis field list 32, the added analysis field for the specimen is added and displayed.

[0084] If a staining type is added, the process from the analysis field setting onwards will be prompted to be redone. Adding a staining type is done, for example, when analyzing with 10 stains and then changing to analysis with 11 stains by additionally staining the same sample with a different antibody. It is also done when re-staining and replacing the same sample. For example, if the staining is poor, such as when positive cells are not clearly stained, re-staining and replacement will be performed.

[0085] When a new staining type is added, the operator adds the new stained or re-stained image data to the sample data and re-registers it. This generates a file containing the sample data list and registration date and time (corresponding to the generated information 821 in Figure 2). As a result, the sample data registration date and time becomes newer than the update date and time of the file generated in the analysis field setting. When the operator closes the sample data registration screen, the display control unit 12 compares the sample data registration date and time with the update date and time of the generated file for each process and updates the display status of the progress list 31, etc.

[0086] Specifically, in Progress List 31, all cells for "Analysis Field Settings," "Cell Recognition," and "Analysis" for the corresponding specimen turn red, prompting the operator to redo the process. In Analysis Field List 32, in the "Analysis Preparation Process" and "Analysis Process" lists, all cells for the analysis fields of the corresponding specimen turn red, prompting the operator to redo the process.

[0087] If cell recognition is re-executed, subsequent steps in the analysis process will be prompted to be redone. Re-executing cell recognition is performed, for example, when some cells were not detected and it is necessary to adjust the cell recognition parameters and re-execute the process.

[0088] When cell recognition is repeated, the operator first performs cell recognition on the cell recognition screen 34 in Figure 8, and the file generated by cell recognition (corresponding to the generated information 821 in Figure 2) becomes newer than the update date of the file generated by analysis. When the operator closes the cell recognition operation screen, the display control unit 12 compares the update dates of the generated files for each process and updates the display status of the progress list 31, etc. Specifically, the "Cell Recognition" cell for the corresponding specimen in the progress list 31 becomes "Completed," and the "Analysis" cell turns red, prompting the operator to repeat the process. In the "Analysis Preparation Process" of the analysis field list 32, the analysis field for the corresponding specimen turns green. In the "Analysis Process" of the analysis field list 32, the analysis field for the corresponding specimen turns red, prompting the operator to repeat the process.

[0089] As described above, in each sample, if the completion time of each step included in the analysis process is later than the completion time of a later step, the display control unit 12 adds a warning to the item indicating the later step in the progress list 31 or the analysis field list 32. This prevents omissions of rework.

[0090] If a recipe is modified, subsequent steps in the analysis process will be prompted to be redone. Recipe modifications may occur, for example, by readjusting the positive / negative thresholds set for each stain (see Figure 9), or by adding or editing staining combinations to subdivide the types of cells being analyzed.

[0091] When a recipe is modified, the operator first modifies the recipe while referring to one analysis field. This makes the "Recipe Creation Date and Time" in the recipe list 36 newer than the "Export Date and Time" and "Result Aggregation Date and Time". When the operator closes the recipe modification screen (for example, the screen in Figure 9, but it may also be a dedicated screen for recipe modification), the display control unit 12 compares the update dates and times of the generated files related to each analysis field in the analysis process (corresponding to the generated information 821 in Figure 2) and updates the display status of the progress list 31, etc.

[0092] Specifically, the "Analysis" cell for the corresponding sample in Progress List 31 turns red. The cell for the analysis field of view of the corresponding sample in "Analysis Preparation Process" in Analysis Field of View List 32 remains green, and the cell for the analysis field of view of the corresponding sample in "Analysis Process" in Analysis Field of View List 32 turns green. Furthermore, the "Recipe Creation Date and Time" cell for the corresponding recipe in Recipe List 36 is updated to green (yellow if analysis has not been performed for some analysis fields), and the "Export Date and Time" and "Result Aggregation Date and Time" cells turn red.

[0093] Note that changing the recipe for one analysis field is equivalent to changing the recipe for all analysis fields within the same specimen, and the analysis of other analysis fields may be performed automatically. Of course, the operator may also manually change the recipe for all analysis fields in the corresponding specimen.

[0094] As described above, the recipe list 36 includes the creation time for at least one recipe, and when the operator modifies a recipe and the creation time of that recipe is updated, the display control unit 12 adds a warning display to the progress list 31 or the analysis field list 32 for the item indicating the process that depends on that recipe among the processes included in the process. This prevents the omission of rework caused by recipe changes.

[0095] When the operator exports the results of the entire analysis field for the sample, the "Export Date and Time" of the corresponding recipe becomes newer than the "Recipe Creation Date and Time," and the display control unit 12 updates the display state of the recipe list 36. Specifically, the corresponding cells for "Recipe Creation Date and Time" and "Export Date and Time" in the recipe list 36 turn green, while the cell for "Result Aggregation Date and Time" remains red. This prompts the operator to perform the result aggregation again.

[0096] As described above, the progress display device 1 switches between and displays lists at appropriate levels of granularity, such as the progress list 31, the analysis field list 32, and the recipe list 36. Furthermore, the progress status is color-coded, and the work date and time can also be displayed, improving visibility for the operator. This makes it easier to grasp the necessary tasks.

[0097] Furthermore, the progress list 31 and the analysis field list 32 complement each other's information, creating a configuration that makes it easy to grasp the work status. The progress list 31 shows the work status of each sample in a single project, and the analysis field list 32 makes it easy to grasp the number of analysis fields and the work status of each analysis field. This realizes a progress display that makes it easy to grasp the progress of sample analysis. In addition, rework is highlighted, preventing work from being overlooked. Sharing progress is also made easier.

[0098] The automatic updating of the progress list 31, analysis field list 32, and recipe list 36 described above is performed by the display control unit 12 in Figure 2 executing the update process 24.

[0099] Figure 11 shows the aggregation condition setting screen 37 displayed on the display unit 11 by the aggregation condition setting unit 41 in Figure 2. That is, when the operator specifies the display of the aggregation condition setting screen 37 for setting aggregation conditions via the operation unit 13, the aggregation condition setting unit 41 of the display control unit 12 executes the aggregation condition setting screen display process and displays the aggregation condition setting screen 37 on the display unit 11. The aggregation conditions are the screen for setting the conditions when the aggregation unit 42 in Figure 2 performs aggregation after the analysis results obtained from each analysis field have been exported and saved to a predetermined memory space.

[0100] In Figure 2, the progress display device 1 functions as an aggregation device, but the aggregation device may be implemented by a separate computer from the progress display device 1.

[0101] Setting the aggregation conditions includes specifying that multiple samples, or multiple analysis fields contained in at least one sample (including cases where one analysis field is set for each of the multiple samples), be divided into multiple groups for comparing the results of the sample analysis. In the example in Figure 11, the group names are set in "Group Name Settings". In Figure 11, "Group 1" and "Group 2" are set. Note that "(Add)" is the input field for adding a new group name.

[0102] The "Group Setting Unit" can be specified using radio buttons as either "Sample" or "Analysis Field." If "Sample" is selected, grouping is set at the sample level. In this case, groups can be specified below the cells "Sample A," "Sample B," etc. in the "Sample Name" column. If "Analysis Field" is selected, grouping is set at the analysis field level. In this case, groups can be specified below the cells "R01," "R02," etc. for each sample in the "Analysis Field." The example in Figure 11 shows the case where grouping is set at the analysis field level, and "Group 1" or "Group 2" is set below each analysis field.

[0103] Furthermore, the aggregation conditions also allow you to specify which recipes to include in the aggregation. In the example in Figure 11, "recipe02" and "recipe03" are included in the aggregation, while "recipe01" is excluded. The selection of aggregation recipes is optional.

[0104] The aggregation unit 42 (see Figure 2) of the display control unit 12 aggregates the analysis results of all analysis fields that were analyzed according to the aggregation conditions. In other words, the aggregation unit 42 performs the aggregation process. This yields the aggregation result for one case.

[0105] The progress display device 1 can be modified in various ways. For example, in the above description, the analysis field list 32 is displayed separately as "Preparation for Analysis" and "Analysis," but it may also be displayed as a single list. Furthermore, the "Preparation for Analysis" process includes specimen registration (setting basic information), analysis field setting, and cell recognition, while the "Analysis" process includes gating (setting positive thresholds) and the analysis process itself. However, the analysis field list 32 may be displayed in a way that differs from this division. Generally speaking, it is preferable that the analysis field list 32 be displayed in a form that includes multiple sub-lists corresponding to the processing stage. This makes it easier to grasp the progress for each analysis field.

[0106] In the progress display device 1, the need for rework is highlighted by coloring cells red. However, various other methods can be used to "add a display to highlight notes" for processes that require rework. For example, the intensity of the cell color can be changed, the color of the text indicating the process can be changed to a color that draws attention (e.g., red), the item indicating the process can be made to blink, or a pop-up display can be added to the item.

[0107] In the above embodiment, multiple immunohistochemical staining analysis was given as an example, but the progress display device 1 may be used for other specimen analyses. The specimen does not have to be pathological tissue; it may be a collection of cells other than pathological tissue. For example, a collection of multiple cells separated and present in a liquid can also be used as a specimen. Organoids, spheroids, etc., can also be used as specimens. The specimen is of biological origin.

[0108] The configurations in the above embodiments and each modified example may be combined as appropriate, as long as they do not contradict each other. [Explanation of Symbols]

[0109] 1. Progress display device 5 Computers 11 Display section 12 Display Control Unit 13 Control section 21. Progress List Display Process 22. Analysis field list display process 24 Update process 31 Progress List 32. List of Analysis Fields 33 Analysis field setting screen 34 Cell recognition screen 35 Analysis screen 36 Recipe List 37. Aggregation Condition Setting Screen 91 Programs

Claims

1. A progress display device that shows the progress of processing on a collection of cells used for sample analysis, Display unit and A display control unit that controls the display on the display unit, Equipped with, The display control unit controls the display unit. A progress list showing the progress for at least one sample, associated with each sample, A list of analysis fields showing the processing progress for at least one analysis field set for each sample, associated with each analysis field, Display and A progress display device in which the display control unit updates the progress list or the analysis field list based on monitoring of information generated in connection with the aforementioned process or on input of such information.

2. A progress display device according to claim 1, The aforementioned analysis field list includes a progress display device that includes multiple sub-lists corresponding to the stages of the processing.

3. A progress display device according to claim 1, In each of the aforementioned samples, if the completion time of each process included in the processing is later than the completion time of a later process, the display control unit provides a display in the progress list or the analysis field list that draws attention to the item indicating the later process.

4. A progress display device according to claim 1, Each can have at least one recipe that specifies the analysis conditions, A progress display device that, when multiple recipes are set, creates an analysis field list for each of the multiple recipes.

5. A progress display device according to claim 4, A progress display device comprising the display control unit causing the display unit to display a list of recipes indicating the progress of processing related to at least one recipe.

6. A progress display device according to claim 5, The aforementioned list of recipes includes the creation time for each of the at least one recipes, A progress display device in which, when the creation time of a recipe is updated due to a change in the recipe, the display control unit adds a display in the progress list or the analysis field list that draws attention to the item indicating a process among the processes included in the process that depends on the recipe.

7. A progress display device according to claim 1, It is further equipped with an operating unit that accepts input from the operator, A progress display device in which, when the operator specifies an item in the progress list that indicates a process related to the operator's work via the operation unit, the display control unit displays a work screen related to that item on the display unit.

8. A progress display device according to claim 1, It is further equipped with an operating unit that accepts input from the operator, When the operator specifies, via the operation unit, that the aggregation condition setting screen for setting the aggregation conditions for the analysis results be displayed, the display control unit causes the aggregation condition setting screen to be displayed on the display unit. The setting of the aggregation conditions includes specifying that multiple samples, which are at least one sample, or multiple analytical fields included in at least one sample, be divided into multiple groups for comparing the results of the sample analysis.

9. A progress display device according to claim 1, A progress display device in which multiple samples, which are at least one sample, or multiple analytical fields included in at least one sample, are divided into multiple groups for comparing the results of the sample analysis.

10. A progress display device according to any one of claims 1 to 9, The aforementioned specimens are pathological tissue specimens, and this is a progress display device.

11. A computer-readable program that causes a computer to display the progress of processing on a collection of cells used for sample analysis, The execution of the aforementioned program by the computer means that the computer a) A step of displaying the progress of at least one specimen as a progress list associated with each specimen on the display unit, b) A step of displaying the progress of processing for at least one analysis field set for each sample as an analysis field list shown in relation to each analysis field on the display unit, c) A step of updating the progress list or the analysis field list based on monitoring of information generated in the work related to the processing or input of such information, A program that executes the command.

Images