Progress display device and computer-readable program

Abstract

A progress display device (1) for displaying the progress of processing on a set of cells that are used for specimen analysis comprises a display unit (11) and a display control unit (12) for controlling display on the display unit (11). The display control unit (12) causes the display unit (11) to display a progress list showing the progress related to at least one specimen in association with each specimen, and an analysis field list showing the progress of processing related to at least one analysis field set for each specimen in association with each analysis field. On the basis of monitoring of information generated in relation to the processing or input of the information, the display control unit (12) updates the progress list or the analysis field list.

Description

Progress indicator and computer readable program

[0001] The present invention relates to processing of cell populations for use in medical research and diagnostic procedures. [Reference to Related Applications] This application claims the benefit of priority from Japanese Patent Application JP2024-153810, filed September 6, 2024, the entire disclosure of which is incorporated herein by reference.

[0002] In medical and biological research, single-cell analysis of biological specimens such as tissue and cell specimens has traditionally been performed to elucidate disease mechanisms, biological mechanisms, and drug action mechanisms. One such method is multiplex immunostaining analysis, which uses machine learning and image processing to quantitatively analyze the expression status of biological substances in digital images of pathological tissue specimens.

[0003] For example, Japanese Patent Application Laid-Open Publication No. 2022-37567 discloses a technique for identifying individual cells even when cell density is high when determining the area of ​​cells by sequentially staining a specimen with multiple stains. Meanwhile, International Publication No. 2021 / 039889 discloses a technique for improving collaboration between a laboratory information system (LIS) and a WSI (Whole Slide Image) management system by providing a preparation folder, a diagnosis folder, a request for additional staining folder, a cleared folder, etc. in the WSI management system.

[0004] Incidentally, specimen analysis involves various steps. For example, in multiplex immunostaining analysis, a medically significant portion (hereinafter referred to as the "analysis field") may be selected for analysis rather than the entire specimen image. In this case, steps such as setting the analysis field, cell recognition, analysis, and counting are performed. Here, if the setting portion or setting value (e.g., cell recognition parameters or analysis thresholds) is changed in each step, it becomes necessary to re-perform the related subsequent steps.

[0005] However, because the units of input and output differ for each process, and because some processes involve manual work, it is not easy to grasp the detailed progress of work, including re-execution. In particular, when multiple people carry out each process, it is easy for work to be overlooked.

[0006] The present invention aims to realize a progress display that allows the progress of sample analysis to be easily grasped.

[0007] A first aspect of the present invention is a progress display device that displays the progress of processing for a collection of cells used in specimen analysis, and includes a display unit and a display control unit that controls the display on the display unit, wherein the display control unit displays, on the display unit, a progress list that shows the progress for at least one specimen in association with each specimen, and an analysis field list that shows the progress of processing for at least one analysis field set for each specimen in association with each analysis field, and the display control unit updates the progress list or the analysis field list based on monitoring of information generated in association with the processing or input of the information.

[0008] According to the present invention, a progress display is realized that allows the progress of sample analysis to be easily grasped.

[0009] A second aspect of the present invention is the progress display device of the first aspect, wherein the list of analysis fields of view includes a plurality of partial lists corresponding to stages of the processing.

[0010] Aspect 3 of the present invention is the progress display device of Aspect 1 (which may be Aspect 1 or Aspect 2), wherein, when the completion time of each step included in the processing for each specimen is later than the completion time of a subsequent step, the display control unit displays a notice in the progress list or the analysis field list to draw attention to an item indicating the subsequent step.

[0011] Aspect 4 of the present invention is a progress display device according to aspect 1 (which may be any one of aspects 1 to 3), in which at least one recipe can be set, each of which indicates analysis conditions, and when multiple recipes are set, the list of analysis fields of view is created for each of the multiple recipes.

[0012] A fifth aspect of the present invention is the progress display device of the fourth aspect, wherein the display control unit causes the display unit to display a recipe list showing the progress of processing related to the at least one recipe.

[0013] A sixth aspect of the present invention is a progress display device according to the fifth aspect, wherein the recipe list includes a creation time for each of the at least one recipe, and when the creation time of a recipe is updated due to a change to the recipe, the display control unit displays a warning indication in the progress list or the analysis field list for an item indicating a process that depends on the recipe among the processes included in the processing.

[0014] Aspect 7 of the present invention is a progress display device of aspect 1 (which may be any one of aspects 1 to 6), further comprising an operation unit that accepts input from an operator, and when the operator specifies an item in the progress list via the operation unit that indicates a process related to the operator's work, the display control unit causes the display unit to display a work screen related to the item.

[0015] Aspect 8 of the present invention is a progress display device according to Aspect 1 (which may be any one of Aspects 1 to 7), further comprising an operation unit that accepts input from an operator, wherein when the operator specifies via the operation unit to display a counting condition setting screen for setting counting conditions for analysis results, the display control unit causes the counting condition setting screen to be displayed on the display unit, and the setting of the counting conditions includes specifying to divide a plurality of specimens that are the at least one specimen or a plurality of analysis fields included in the at least one specimen into a plurality of groups for comparing results of the specimen analysis.

[0016] Aspect 9 of the present invention is a progress display device of aspect 1 (which may be any one of aspects 1 to 7), in which a plurality of specimens that are the at least one specimen or a plurality of analysis fields included in the at least one specimen are divided into a plurality of groups for comparing the results of the specimen analysis.

[0017] A tenth aspect of the present invention is the progress display device of any one of the first to ninth aspects, wherein each of the specimens is a pathological tissue specimen.

[0018] An eleventh aspect of the present invention is a computer-readable program that causes a computer to display on a display unit the progress of processing for a collection of cells used in specimen analysis, and execution of the program by the computer causes the computer to execute the following steps: a) display on the display unit the progress for at least one specimen as a progress list associated with each specimen; b) display on the display unit the progress of processing for at least one analysis field set for each specimen as an analysis field list associated with each analysis field; and c) update the progress list or the analysis field list based on monitoring information generated in work related to the processing or input of the information.

[0019] The above and other objects, features, aspects and advantages will become more apparent from the following detailed description of the invention which proceeds with reference to the accompanying drawings.

[0020] FIG. 1 is a diagram showing the configuration of a computer that functions as a progress display device. FIG. 2 is a block diagram showing the functional configuration of the progress display device. FIG. 3 is a diagram showing an outline of steps performed in multiple immunostaining analysis. FIG. 4 is a diagram showing an example of a progress list. FIG. 5 is a diagram showing an example of an analysis field list. FIG. 6 is a diagram showing an example of an analysis field list. FIG. 7 is a diagram showing an example of an analysis field setting screen. FIG. 8 is a diagram showing an example of a cell recognition screen. FIG. 9 is a diagram showing an example of an analysis screen. FIG. 10 is a diagram showing an example of a recipe list. FIG. 11 is a diagram showing an example of a collection condition setting screen.

[0021] FIG. 1 is a diagram showing the configuration of a computer 5 functioning as a progress display device according to one embodiment of the present invention. The progress display device is a device that displays the progress of processing on a group of cells used in specimen analysis, and is used, for example, in the field of image cytometry. In this embodiment, the progress display device displays the progress of multiplex immunostaining analysis, but the use of the progress display device is not limited to such specimen analysis. The progress display device displays a list appropriate for the steps included in the specimen analysis process, making it easy to understand the progress even when analyzing multiple analysis fields of multiple specimens in a single study.

[0022] The computer 5 has a typical computer system configuration including a CPU 51, a GPU 52, a ROM 53, a RAM 54, a fixed disk 55, a display 56, an input unit 57, a reading device 58, a communication unit 59, and a bus 50. The CPU 51 performs various arithmetic processing. The GPU 52 performs various arithmetic processing related to image processing at high speed. The ROM 53 stores basic programs. The RAM 54 stores various information. The fixed disk 55 stores information. The display 56 displays various information such as images.

[0023] The input unit 57 includes a keyboard 57a and a mouse 57b for receiving input from an operator. The reader 58 reads information from a computer-readable recording medium 9 such as an optical disk, a magnetic disk, a magneto-optical disk, or a memory card. The display 56, the keyboard 57a, the mouse 57b, and the reader 58 are connected to the bus 50 via an interface (I / F). The communication unit 59 transmits and receives signals to and from devices external to the computer 5.

[0024] The bus 50 is a signal circuit that connects the CPU 51, the GPU 52, the ROM 53, the RAM 54, the fixed disk 55, the display 56, the input unit 57, the reading device 58, and the communication unit 59.

[0025] In the computer 5, the program 91 is read in advance from the recording medium 9 via the reading device 58 and stored on the fixed disk 55. The program 91 may also be stored on the fixed disk 55 via a network. The CPU 51 and GPU 52 execute arithmetic processing using the RAM 54 and the fixed disk 55 in accordance with the computer-readable program 91. The CPU 51 and GPU 52 function as a calculation unit in the progress display device. Other components that function as a calculation unit may be employed in addition to the CPU 51 and GPU 52.

[0026] 2 is a block diagram showing the functional configuration of the progress display device 1 realized by the computer 5 executing arithmetic processing and the like in accordance with the program 91. All or part of each functional configuration may be realized by a dedicated electric circuit. Furthermore, these functional configurations may be realized by multiple computers. The program 91 is a program that causes the computer 5 to display on the display unit 11 the progress of processing for a collection of cells used in specimen analysis.

[0027] Of the functional components shown in Fig. 2, the display unit 11 mainly functions as the display 56 in Fig. 1 and displays information to the operator. The display control unit 12 is realized by the CPU 51, GPU 52, ROM 53, RAM 54, fixed disk 55, and their peripheral components, and mainly controls the display on the display unit 11. The display control unit 12 may include other functions. In Fig. 2, the functions of the display control unit 12 are shown as steps and functional components executed by the display control unit 12, but details thereof will be described later. The operation unit 13 receives input from the operator and is a function mainly realized by the input unit 57 in Fig. 1.

[0028] The operation devices 81 and 82 shown in Fig. 2 represent functions for executing steps related to analysis processing. The operation devices 81 and 82 may be provided as devices independent of the progress display device 1, or may be functions realized by the computer 5 that is the progress display device 1 when the CPU 51, GPU 52, etc. execute a dedicated program. While Fig. 2 illustrates two operation devices 81 and 82, the number of operation devices may be one or three or more. In other words, the number of operation devices is one or more.

[0029] FIG. 3 is a diagram showing an outline of the steps performed in (processing for) multiplex immunostaining analysis, and shows a case in which a medically significant portion is selected as the analysis field rather than an image of the entire specimen.

[0030] First, specimen data acquired by an external imaging device is input to the progress display device 1 via the communication unit 59 and registered in the progress display device 1 by an operator (step S11). In this embodiment, the specimen data is image data of a pathological tissue specimen, but it also includes normal color image data of the same specimen and image data after multiple types of staining (image data after multiple types of staining obtained by repeating staining and decolorization). One or more images represented by image data corresponding to one specimen will be referred to as a "specimen image group" hereinafter.

[0031] Next, one specimen image included in the specimen image group is displayed on the display unit 11, and the operator selects at least one region (analysis field) of interest from the specimen image, and an image of this at least one region (hereinafter referred to as "analysis field image") is acquired (step S12). Note that the operation of acquiring one analysis field image corresponds to the operation of acquiring analysis field images of the same location for each specimen image in the specimen image group, but as setting of the analysis field, it is an operation of setting one analysis field. The specimen image is an image that is relatively large compared to the analysis field.

[0032] Next, in accordance with the operator's operation, the display control unit 12 extracts cellular regions from at least one analysis field image (hereinafter referred to as the "analysis field image group") in each analysis field in the specimen image group by processing using the CPU 51 and GPU 52, thereby obtaining a cellular region extraction image (more precisely, at least one cellular region extraction image, hereinafter referred to as the "cellular region extraction image group") showing the cellular region (step S13). Furthermore, in accordance with the operator's instructions, the display control unit 12 obtains numerical information, such as the number of positive cells under predetermined conditions in each analysis field, as analysis results based on the cellular region extraction image group (step S14). For example, if a feature value, which is a value obtained by quantifying the staining state of each immunostain on a single cell basis, is equal to or greater than a set threshold, the cell is determined to be positive for that immunostain, and the number of subdivided cells is counted by combining the judgments of multiple stains.

[0033] The analysis results obtained from the analysis field images and cell region extraction images are compiled by the display control unit 12 in units that match the research content (specimen units, all specimens used in one research, groups specified based on the severity of the disease, etc.) in accordance with instructions from the operator, and the image data is also combined and collected in one folder as the deliverables of one project (step S15).

[0034] Here, due to differences in input / output units in each of the above steps, the units in which work can be done efficiently differ for each step. Specifically, in step S12, data is input in specimen units and data is output in analysis field units. In steps S13 and S14, data is input in analysis field units and data is output in analysis field units. In step S15, data is input in analysis field units and data in any specified unit is output.

[0035] Furthermore, in terms of automatic processing and manual work, the analysis process in step S13 is performed automatically, whereas in step S12, appropriate thresholds must be set manually according to the research objectives. Thus, the operational units at which work can be done efficiently, such as per case, per specimen, or per field of view, vary depending on the process, while being influenced by whether or not manual work is required. As will be described later, the progress display device 1 displays lists at various granularities, i.e., with various levels of information detail, allowing for easy understanding of the progress status and realizing a display that improves work efficiency.

[0036] Furthermore, changes to conditions such as thresholds frequently occur at various stages, and in such cases, subsequent processes must be performed again. However, when analyzing a large number of analytical fields, there are limitations to the operator's ability to grasp all of the progress, and when multiple people are working together, it becomes difficult to share progress, making it easy for work to be overlooked. For example, a single project often involves multiple specimens, and multiple analytical fields from one specimen, so a total of tens to hundreds of analytical fields are analyzed.

[0037] In such a situation, if threshold values ​​in other processes are changed after the aggregation in step S15, the numerical information obtained for each analysis field will have to be output again (hereinafter also referred to as "export"), and then aggregation and collection of deliverables will be performed, so the operator will need to check a huge amount of information to ensure that the export of all analysis fields and subsequent work are being carried out in the latest state.As will be described later, the progress display device 1 can reduce omissions and mistakes in such rework by, for example, coloring areas that require the operator's attention or warning.

[0038] 4 is a diagram showing an example of a progress list 31 displayed on the display unit 11 by the display control unit 12 executing the progress list display step 21 (see FIG. 2 ). The progress list 31 shows progress regarding at least one specimen in association with each specimen of the at least one specimen. In this example, each specimen is a pathological tissue specimen.

[0039] The example of the progress list 31 in FIG. 4 shows one project including five specimens, and is a list for understanding the progress of each specimen. The "Specimen Name" column shows "Specimen A," "Specimen B," "Specimen C," "Specimen a," and "Specimen b." The "Group" column shows "Group 1" and "Group 2," indicating that "Specimen A," "Specimen B," and "Specimen C" belong to "Group 1," and "Specimen a" and "Specimen b" belong to "Group 2."

[0040] Groups are used when aggregating analysis results, and specific examples of groups are provided below. As an example of aggregation in medical research, let's assume that 20 specimens taken from 20 patients with the same disease are analyzed by setting 10 analysis fields for each specimen (assumed case 1). Note that multiple analysis fields are often set for one specimen to reduce variability in analysis results depending on the location of the analysis field within each specimen.

[0041] In assumed case 1, in order to understand the characteristics of a disease, the data are compiled for all analytical fields of view of all specimens (20 specimens x 10 analytical fields = 200 analytical fields) to investigate trends in the types and numbers of cells found in patients with the target disease. Alternatively, stratification is performed by comparing between patients with the same disease (between specimens). In this case, data is compiled for every 10 analytical fields per specimen, and a group is created for each specimen, and comparisons are made between specimens.

[0042] As another example, 10 specimens are collected from patients with the same disease before treatment and 10 specimens are collected from patients after treatment, and 10 analytical fields are set for each specimen for analysis (hypothetical case 2). Each group of 10 specimens is treated as one. That is, 100 analytical fields (10 specimens x 10 analytical fields =) are analyzed for the pre-treatment specimen group, and 100 analytical fields (10 specimens x 10 analytical fields =) are analyzed for the post-treatment specimen group. Data are then tallied for each specimen group, and the analysis results are compared between groups to investigate cells that affect treatment.

[0043] In another example, specimens are collected from 20 patients with the same disease, and five analysis fields are set for each tumor site and five analysis fields for each normal site (hypothetical case 3). That is, 100 analysis fields (20 specimens x 5 analysis fields) are analyzed as a group of tumor sites, and 100 analysis fields (20 specimens x 5 analysis fields) are analyzed as a group of normal sites. The analysis results are then compiled by site (i.e., by group), and attempts are made to understand the characteristics of the tumor site alone, which are not present in normal sites, in order to develop anticancer drugs that efficiently attack only tumor cells.

[0044] As described above, the grouping of specimens or analysis fields is used when the analysis results are compiled in step S15 of Fig. 3. Note that although grouping is performed in specimen units in Fig. 4, grouping in analysis fields will be described later (see Fig. 11).

[0045] In Figure 4, "Analysis Field Setting," "Cell Recognition," and "Analysis" indicate steps included in the specimen analysis process. "Complete," "In Work," and "New" in each specimen row indicate the progress of each step. In the following explanation, the frames displaying "Complete," "In Work," "New," and "RO1," "RO2," and the like (see Figure 5) described below are also referred to as "cells."

[0046] "Completed" indicates that the corresponding process has been completed without any problems. In Figure 4, the "Completed" cells are shown in green by adding dashed diagonal lines. For specimen A, all processes are "Completed." "In Work" indicates that the corresponding process has been started but not completed. In Figure 4, the "In Work" cells are shown in yellow by adding dashed diagonal lines. Displaying them in yellow draws the operator's attention. For specimens B, C, and a, "Analysis Field Setting" and "Cell Recognition" are "Completed," and "Analysis" is "In Work." "New" indicates that the corresponding process has not yet been started. In Figure 4, the "New" cells are shown in white by not adding diagonal lines. For specimen b, "Analysis Field Setting" is "In Work," and "Cell Recognition" and "Analysis" are "New."

[0047] 5 is a diagram showing an example of an analysis field list 32 displayed on the display unit 11 as a result of the display control unit 12 executing the analysis field list display step 22 (see FIG. 2). The analysis field list 32 shows the progress of processing for at least one analysis field set for each specimen, in association with each analysis field. The analysis field list allows the number of analysis fields set, which are part of the specimen to be analyzed, and the progress of work for each analysis field to be easily grasped in a list.

[0048] The analysis field list 32 in the example of Figure 5 includes a tab for "analysis preparation process" and a tab for "analysis process," and Figure 5 shows the state in which the tab for "analysis preparation process" is selected and a partial list of the analysis field list 32 is displayed.

[0049] The "Analysis Field" column shows the identification number of the analysis field set for each specimen. Five analysis fields (identification numbers: "R01" to "R05") are set for "Specimen A," three analysis fields (identification numbers: "R01" to "R03") are set for "Specimen B," four analysis fields (identification numbers: "R01" to "R04") are set for "Specimen C," three analysis fields (identification numbers: "R01" to "R03") are set for "Specimen a," and four analysis fields (identification numbers: "R01" to "R04") are set for "Specimen b."

[0050] For "Specimen A," "Specimen B," "Specimen C," and "Specimen a," the cells for each analysis field, except for "R02" of "Specimen C," are green to indicate that the "analysis preparation step" has been completed. Completion of the "analysis preparation step" means that cell recognition has been performed. In Figure 5, cells for which the "analysis preparation step" has been completed are green by adding dashed diagonal lines. To indicate that "R02" of "Specimen C" is not subject to analysis, the corresponding cell is gray by adding dashed diagonal lines. For "Specimen b," the "analysis preparation step" has not yet been started for all of the analysis fields "R01" to "R04," i.e., cell recognition has not been performed, and these cells are white by not adding diagonal lines.

[0051] FIG. 6 shows a state in which the "Analysis Step" tab is selected in the analysis field list 32, displaying a partial list of the analysis field list 32. For "R01" to "R05" of "Specimen A," "R01" and "R02" of "Specimen B," "R01" of "Specimen C," and "R01" and "R03" of "Specimen A," the cells corresponding to each analysis field are green to indicate that the "Analysis Step" has been completed. In FIG. 6, dashed diagonal lines indicate that cells for which the "Analysis Step" has been completed are green. Completion of the "Analysis Step" means that a recipe, which is the analysis conditions described below, has been created and analysis has been performed in accordance with the recipe. To indicate that "R02" of "Specimen C" is not subject to analysis, the corresponding cell is grayed out by dashed diagonal lines. Such non-analysis subjects are excluded from analysis after the analysis field has been set, for example, due to specimen tearing or nonspecific staining.

[0052] For "R03" of "Specimen B," "R03" and "R04" of "Specimen C," "R02" of "Specimen a," and "R01" to "R04" of "Specimen b," the "analysis process" has not yet begun, and these cells are shown as white by not adding parallel diagonal lines. "Analysis process" not yet begun means that analysis has not been performed.

[0053] The display of "Analysis Preparation Step" in the analysis field list 32 makes it easy to check the number of analysis fields set for each specimen and whether there are any omissions in the cell recognition work. The display of "Analysis Step" makes it easy to check whether there are any omissions in the application of the recipe, i.e., any omissions in the analysis.

[0054] Next, the linking of the progress list 31 and the analysis field list 32 under the control of the display control unit 12 will be described. In the basic operation of linking, when the operator selects a cell in the progress list 31 where the row of a specimen intersects with the column of a process using a mouse or the like, a work screen for the process of the specimen is displayed on the display unit 11. When the work screen is closed after the work is completed, the display state of the progress list 31 or the analysis field list 32 is updated. Note that "the display state of the progress list 31 or the analysis field list 32 is updated" includes the case where "the display state of the progress list 31 and the analysis field list 32 is updated."

[0055] For example, when cell 301 of "Analysis Field Setting" for "Specimen b" in FIG. 4 is in the "New" (or "In Progress" state) and the operator selects the cell using a mouse or the like, an analysis field setting screen 33 shown in FIG. 7 is displayed. Immediately after the "New" display is selected, only a tissue image 331 is displayed on the analysis field setting screen 33, and the operator can set the analysis field of specimen b by specifying the range of analysis fields R01 to R04 using a mouse or the like. On the analysis field setting screen 33, the operator can add, delete, or move any analysis field (indicated by a square in FIG. 7).

[0056] When the setting of the analysis field is completed and the analysis field setting screen 33 is closed, a data file indicating the analysis field is generated under the control of the display control unit 12, and the contents of the analysis preparation step tab of the analysis field list 32 are displayed, with analysis fields R01 to R04 being displayed in the row of specimen b. Furthermore, when the progress list 31 is displayed, "Complete" is displayed in cell 301. When the analysis field list 32 is displayed while the analysis field is being set, only the analysis fields that have already been set are displayed, and when the progress list 31 is displayed, "In progress" is displayed in cell 301. The same applies if the setting of the analysis field is interrupted midway.

[0057] Setting the analytical field of view may be a function executed by the CPU 51, GPU 52, etc. of the progress display device 1, or may be a function realized by a computer other than the progress display device 1 in cooperation with the progress display device 1. These functions correspond to the operation devices 81 and 82 shown in FIG. 2 and will be referred to simply as "operation devices" hereinafter. The display control unit 12 monitors information generated by the operation devices (corresponding to the generation information 821 in FIG. 2 , which is information indicating the number, position, size, etc. of the analytical field of view) and updates the progress list 31 or the analysis field of view list 32 based on the presence or status of the generation information. The display control unit 12 may also update the progress list 31 or the analysis field of view list 32 based on information input from the operation device. The progress list 31 or the analysis field of view list 32 is updated by the display control unit 12 executing the update step 24 in FIG. 2. Note that "input of information from the operation device" includes not only the case where generation information is input from the operation device but also the case where information indicating the generation information has been generated is input.

[0058] As a next example, when cell 302 for "cell recognition" of "specimen a" in FIG. 4 is in the "new" (or "in progress") state and the operator selects the cell using a mouse or the like, cell recognition screen 34 shown in FIG. 8 is displayed. Immediately after display, a default analysis field is selected, but FIG. 8 shows a case where analysis field R03 has been selected from list 345 by the operator. Image 341 on the left of cell recognition screen 34 is an image of analysis field R03 to be recognized, and image 342 on the right is the image after cell recognition. Note that in reality, image 341 can be selected from a plurality of stained images corresponding to each stain, but a description of this will be omitted.

[0059] The operator adjusts the binarization threshold and edge extraction parameter values ​​for cell recognition via a setting screen displayed separately via the operation unit 13, and then clicks the cell recognition button 343 to repeat cell recognition, or clicks the result confirmation button 344 to display an overlay image (not shown) in which the recognized image (image 342) is superimposed on the original image (image 341), thereby determining the values ​​of various parameters.

[0060] When the operator closes the cell recognition screen 34 upon completion of the work, a data file showing the cell recognition results is generated under the control of the display control unit 12, and the contents of the analysis preparation step tab in the analysis field list 32 are displayed, with the cell for analysis field R03 of specimen a being displayed in green, indicating that the work is complete. Furthermore, when the progress list 31 is displayed, if cell recognition has been completed for all analysis fields of specimen a, "Completed" is displayed in cell 302, and if cell recognition has been completed for only some of the analysis fields of specimen a, "In progress" is displayed in cell 302.

[0061] The cell recognition process may be a function executed by the CPU 51, GPU 52, etc. of the progress display device 1, or may be a function implemented by a computer separate from the progress display device 1 in cooperation with the progress display device 1. These functions correspond to the operation devices 81 and 82 shown in FIG. 2. The display control unit 12 monitors information generated by the operation devices (corresponding to generated information 821 in FIG. 2, which is information on the detail recognition image in this case) and updates the progress list 31 or the analysis view field list 32 based on the presence or status of the generated information. The display control unit 12 may also update the progress list 31 or the analysis view field list 32 based on information input from the operation device. The progress list 31 or the analysis view field list 32 is updated by the display control unit 12 executing update step 24 in FIG. 2.

[0062] As the next example, when cell R03 of "Analysis" for "Specimen A" in Figure 4 is in the "New" (or "In Progress" state) and the operator selects the cell using a mouse or the like, the analysis screen 35 shown in Figure 9 is displayed. Immediately after display, the default analysis field is selected, but Figure 9 shows a case where analysis field R03 is selected from list 352 by the operator's operation. The analysis is automatically performed according to a "recipe," which is the analysis conditions set in advance or on the analysis screen 35. When multiple recipes are set, the analysis is automatically performed by selecting the analysis field and recipe. The analysis results are displayed in the center of the analysis screen 35, and the image 351 on the right is an image that displays the analysis results superimposed on the image of the analysis field.

[0063] The "Stain Name" column on the analysis screen 35 indicates that the stained images of the analysis field include images of "Stain 1," "Stain 2," "Stain 3," and "Stain 4." In other words, the images of the analysis field of view with "Stain 1," "Stain 2," "Stain 3," and "Stain 4" form a group of analysis field images. The "Positive Determination Threshold" is a threshold for determining whether each stained image is positive, and is a setting value included in the recipe. The "Number of Positive Cells" is the number of cells determined to be positive from the image of each stain.

[0064] The "Combination" on the analysis screen shows the analysis results of combinations of positive and negative stains for multiple stains. Stain combinations are set to subdivide cell types. The "Stain 1+ / Stain 2+" column indicates that the cell is positive for stain 1 and positive for stain 2, and the "Number of Corresponding Cells" column indicates the number of corresponding cells. The "Color" column indicates the color in which the corresponding cells are displayed in the image 351 on the right, and in Figure 9, the cells are colored red, as indicated by the diagonal lines.

[0065] The "Stain 1+ / Stain 2-" column indicates that the cells are positive for stain 1 and negative for stain 2, and the "Number of Corresponding Cells" column indicates the number of corresponding cells. The "Color" column indicates the color with which the corresponding cells are colored in the image 351 on the right, and in FIG. 9, the blue coloring is indicated by the hatched lines. The "Stain 1- / Stain 2+" column indicates that the cells are negative for stain 1 and positive for stain 2, and the "Number of Corresponding Cells" column indicates the number of corresponding cells. The "Color" column indicates the color with which the corresponding cells are colored in the image 351 on the right, and in FIG. 9, the green coloring is indicated by the hatched lines. The "combination" conditions are also items set in the recipe.

[0066] When analysis of a specific recipe for a specific analysis field is completed and the operator closes the analysis screen 35, a data file showing the analysis results is generated under the control of the display control unit 12, and the contents of the analysis process tab in the analysis field list 32 are displayed. In the example of FIG. 9, the cell for analysis field R03 of specimen a in FIG. 8 is displayed in green, indicating completion of the work. Note that in FIG. 9, which is the screen launched from the screen for "recipe02" (see reference numeral 323) in FIG. 6, "recipe02" is selected as the recipe. Furthermore, when the progress list 31 is displayed, if analysis of the currently employed recipe (the recipe selected in the analysis field list 32) for all analysis fields of specimen a has been completed, "Completed" is displayed in cell 303. If analysis of only some analysis fields has been completed, "In Progress" is displayed in cell 303.

[0067] The analysis conditions included in the recipe may be set in advance by the operator via the recipe setting screen, or a new recipe may be automatically generated when setting values ​​(thresholds, staining combinations, etc.) are created or modified on the analysis screen 35. In the latter case, analysis of the new recipe is automatically performed at the same time as the recipe is set.

[0068] The analysis step may be a function executed by the CPU 51, GPU 52, etc. of the progress display device 1, or may be a function implemented by a computer separate from the progress display device 1 in cooperation with the progress display device 1. These functions correspond to the operation devices 81 and 82 shown in FIG. 2. The display control unit 12 monitors information generated by the operation devices (corresponding to generated information 821 in FIG. 2, which is the analysis result in this case), and updates the progress list 31 or the analysis view field list 32 based on the presence or status of the generated information. The display control unit 12 may also update the progress list 31 or the analysis view field list 32 based on information input from the operation device. The progress list 31 or the analysis view field list 32 is updated by the display control unit 12 executing update step 24 in FIG. 2.

[0069] In the progress list 31 and analysis view list 32, the completion of each step included in the analysis process is displayed by characters or colors, but the completion time may also be displayed together with these displays.

[0070] As described above, in the progress display device 1, when the operator specifies an item ("cell" in the above example) indicating a step related to the operator's work in the progress list 31 via the operation unit 13, the display control unit 12 causes the display unit 11 to display a work screen related to that item. This makes it possible to accurately proceed with the work while referring to the progress display device 1. The "item related to the work" is not limited to a cell, but a separate item may be displayed, or a work screen may be selected from an item in a menu related to the work.

[0071] In the above description, the progress display device 1 functions as an interface for the operator when the operator works on the work device, but the work performed by the operator on the work device may be independent of the progress display device 1.

[0072] 10 is a diagram showing an example of a recipe list 36 displayed on the display unit 11 as a result of the display control unit 12 executing the recipe list display step 23 (see FIG. 2 ). The recipe list 36 displays the progress of each recipe of at least one recipe.

[0073] In the example of FIG. 10 , three recipes with "recipe name" "recipe01," "recipe02," and "recipe03" are shown. The "recipe creation date and time" column displays the date and time when each recipe was created. The date and time when a recipe was "created" includes the date and time when the recipe was "changed," i.e., "updated." The export date and time is the time when analysis according to the selected recipe was performed on all analysis views of the job and the output of the results for all analysis views was completed. Note that the analysis results are exported for each analysis view, and are executed by selecting the analysis view and clicking the export button 321 in FIG. 6 .

[0074] The "Results Compilation Date and Time" column in FIG. 10 indicates the time when the process of compiling the exported analysis results according to the preset conditions was completed by clicking the results compilation button 322 in FIG. 6 . The recipe menu 323 in FIG. 6 is a pull-down menu, and "recipe01," "recipe02," or "recipe03" can be selected. When a recipe is selected, the progress related to that recipe is displayed in the analysis view list. In this way, the progress display device 1 allows at least one recipe, each of which indicates analysis conditions, to be set via the operation device. When multiple recipes are set, an analysis view list 32 (more precisely, a list of analysis views related to analysis) is created for each of the multiple recipes.

[0075] In the recipe list 36 of FIG. 10 , progress is displayed by coloring each cell. That is, the display control unit 12 executes the recipe list display step 23 of FIG. 2 to cause the display unit 11 to display the recipe list 36 showing the progress of processing related to at least one recipe. In FIG. 10 , different colors are expressed by using different diagonal lines. In the example of FIG. 10 , the "recipe creation date and time" cell for "recipe01" is green, the "export date and time" cell is red, and the "results compilation date and time" cell is red. The "recipe creation date and time" cell for "recipe02" is yellow, the "export date and time" cell is yellow, and the "results compilation date and time" cell is white (blank). The "recipe creation date and time" cell for "recipe03" is green, the "export date and time" cell is green, and the "results compilation date and time" cell is green.

[0076] A green cell in the "Recipe Creation Date" column indicates that the corresponding recipe has been set and analyzed for all fields of view. A yellow cell in the "Recipe Creation Date" column indicates that analysis according to the corresponding recipe has not been completed for some fields of view.

[0077] A green cell in the "Export Date" column indicates that the export of analysis results has been completed for all fields since the corresponding recipe was created (or modified). A yellow cell in the "Export Date" column indicates that the export of analysis results has not been completed for some fields. A red cell in the "Export Date" column indicates that the export of analysis results needs to be performed again.

[0078] A green cell in the "Results Aggregation Date" column indicates that the analysis results for the corresponding recipe have been aggregated. A red cell in the "Results Aggregation Date" column indicates that aggregation needs to be performed again.

[0079] The progress display in the recipe list 36 in Figure 10 will be explained for each recipe. In "recipe01," the recipe was changed after the analysis results were compiled, and the need to re-do the export and subsequent steps is indicated in red. In "recipe02," analysis has not yet been completed for some of the 19 analysis fields of five specimens is indicated in yellow. In "recipe03," the results have been compiled for all analysis fields and are indicated in green.

[0080] As mentioned above, the completion time of work can also be displayed in the progress list 31 and the analysis view list 32 (not shown in Figures 4 to 6), and by displaying the completion time in the progress list 31, the analysis view list 32, and the recipe list 36, the operator can obtain information such as the order in which the work was performed and which work was performed most recently, and the progress display device 1 displays information that makes it easy for the operator to recall the work order and work content.

[0081] The progress display device 1 displays a red warning to call attention, thereby preventing oversight of rework. The operation of the display control unit 12 to prompt rework will be described below.

[0082] Adding an analysis field prompts rework of the steps after cell recognition. Adding an analysis field is done, for example, to increase the number of analysis fields, or to analyze normal areas in addition to analyzing tumor areas.

[0083] The analysis field is added on the analysis field setting screen 33 in Figure 7. As a result, the file generated by the analysis field setting (corresponding to the generation information 821 in Figure 2) will have a newer update date and time than the file generated after cell recognition. When the operator closes the analysis field setting operation screen, the display control unit 12 compares the update dates and times of the files generated in each process and updates the display of the progress list 31, etc. In the progress list 31, the cell corresponding to "analysis field setting" in the row of the specimen is marked "completed," and the cells for "cell recognition" and "analysis" are marked "rework required" and turn red. In the analysis field list 32, the analysis field added to the specimen is additionally displayed.

[0084] When a staining type is added, the process after setting the analysis field is prompted to be redone. Adding a staining type is done, for example, when, after analysis using 10 stains, the same specimen is additionally stained with a different antibody to change the analysis to 11 stains. It is also done when the same specimen is re-stained and replaced. For example, when the staining is poor, such as when positive cells are not clearly stained, the specimen is re-stained and replaced.

[0085] When a new staining type is added, the operator adds data of new stained images or re-stained images to the specimen data and re-registers them. This generates a file (corresponding to the generation information 821 in Figure 2) with a list of specimen data and the registration date and time. As a result, the specimen data registration date and time becomes newer than the update date and time of the file generated by setting the analysis field of view. Then, when the operator closes the specimen data registration operation screen, the display control unit 12 compares the registration date and time of the specimen data with the update date and time of the generated file for each process, and updates the display status of the progress list 31, etc.

[0086] Specifically, all cells for "analysis field setting," "cell recognition," and "analysis" of the corresponding specimen in the progress list 31 turn red, urging the operator to redo the work. In the analysis field list 32, in the lists of "analysis preparation step" and "analysis step," all cells for the analysis field of the corresponding specimen turn red, urging the operator to redo the work.

[0087] When cell recognition is re-executed, the user is prompted to re-execute the steps after analysis. For example, cell recognition is re-executed when some cells were not detected and the user wants to adjust the cell recognition parameters and re-execute the process.

[0088] When cell recognition is re-performed, the operator first performs cell recognition on the cell recognition screen 34 in FIG. 8 , and the file generated by cell recognition (corresponding to the generation information 821 in FIG. 2 ) becomes newer than the update date and time of the file generated by analysis. When the operator closes the cell recognition operation screen, the display control unit 12 compares the update dates and times of the generated files for each process and updates the display status of the progress list 31, etc. Specifically, the "cell recognition" cell for the corresponding specimen in the progress list 31 becomes "completed," and the "analysis" cell turns red, prompting the operator to re-perform the work. In the "analysis preparation process" in the analysis view field list 32, the analysis view field for the corresponding specimen turns green. In the "analysis process" in the analysis view field list 32, the analysis view field for the corresponding specimen turns red, prompting the operator to re-perform the work.

[0089] As described above, for each specimen, when the completion time of each step included in the analysis process is later than the completion time of the subsequent step, the display control unit 12 displays a warning to the item indicating the subsequent step in the progress list 31 or the analysis field list 32. This prevents omission of rework.

[0090] When a recipe is changed, the user is prompted to redo the steps from analysis onward. Recipe changes are made, for example, when the threshold value for determining whether a sample is positive or negative (see FIG. 9 ) set for each stain is readjusted, or when a stain combination is added or edited to further subdivide the types of cells to be analyzed.

[0091] When a recipe is changed, the operator first changes the recipe while referring to one analysis field. As a result, the "recipe creation date and time" in the recipe list 36 becomes newer than the "export date and time" and the "results aggregation date and time." When the operator closes the recipe change operation screen (for example, the screen in FIG. 9 , but it may also be a screen dedicated to recipe changes), the display control unit 12 compares the update dates and times of the generated files (corresponding to the generation information 821 in FIG. 2 ) related to each analysis field in the analysis process, and updates the display status of the progress list 31, etc.

[0092] Specifically, the "Analysis" cell of the corresponding specimen in the progress list 31 turns red. The cell of the analysis field of the corresponding specimen in the "Analysis preparation step" in the analysis field list 32 remains green, and the cell of the analysis field of the corresponding specimen in the "Analysis step" in the analysis field list 32 turns green. Furthermore, the "Recipe creation date and time" cell of the corresponding recipe in the recipe list 36 is updated to green (yellow if analysis has not been performed on some analysis fields), and the "Export date and time" and "Results aggregation date and time" cells turn red.

[0093] Note that changing the recipe for one analysis field corresponds to changing the recipe for all analysis fields within the same specimen, and analysis of other analysis fields may be performed automatically, although of course the operator may manually change the recipes for all analysis fields of the corresponding specimen.

[0094] As described above, the recipe list 36 includes the creation time of at least one recipe, and when the operator changes a recipe and the creation time of the recipe is updated, the display control unit 12 displays a warning for an item indicating a process that depends on the recipe among the processes included in the process in the progress list 31 or the analysis view list 32. This makes it possible to prevent omission of rework due to a recipe change.

[0095] When the operator exports the results of all the analysis fields of view of the specimen, the "export date and time" of the corresponding recipe becomes newer than the "recipe creation date and time," and the display control unit 12 updates the display state of the recipe list 36. Specifically, the cells corresponding to the "recipe creation date and time" and "export date and time" in the recipe list 36 turn green, and the "results aggregation date and time" cell remains red. This prompts the operator to re-aggregate the results.

[0096] As described above, the progress display device 1 switches between lists at an appropriate granularity, such as the progress list 31, analysis field list 32, and recipe list 36, and further, the progress status is color-coded and the date and time of work can also be displayed, improving visibility for the operator. This makes it easier for the operator to grasp the work that needs to be done.

[0097] Furthermore, the progress list 31 and the analysis field list 32 complement each other's information, making it easy to grasp the work status. The progress list 31 shows the work status of each specimen in one project, while the analysis field list 32 makes it easy to grasp the number of analysis fields and the work status of each individual analysis field. This realizes a progress display that makes it easy to grasp the progress of specimen analysis. Furthermore, attention is drawn to rework, preventing work omissions. Progress is also easily shared.

[0098] The progress list 31, analysis field list 32, and recipe list 36 are automatically updated by the display control unit 12 in FIG. 2 executing the update step 24.

[0099] Fig. 11 is a diagram showing a tally condition setting screen 37 displayed on the display unit 11 by the tally condition setting unit 41 of Fig. 2. That is, when the operator specifies, via the operation unit 13, the display of the tally condition setting screen 37 for setting tally conditions, the tally condition setting unit 41 of the display control unit 12 executes a tally condition setting screen display step to display the tally condition setting screen 37 on the display unit 11. The tally conditions are a screen for setting conditions when the tally unit 42 of Fig. 2 performs tallying after the analysis results obtained from each analysis field of view are exported and saved in a predetermined storage space.

[0100] In FIG. 2, the progress display device 1 has the function of a tallying device, but the tallying device may be realized by a computer separate from the progress display device 1.

[0101] The setting of the aggregation conditions includes specifying the division of multiple specimens or multiple analysis fields contained in at least one specimen (including the case where one analysis field is set for each of multiple specimens) into multiple groups for comparing the results of specimen analysis. In the example of FIG. 11, group names are set in "Group Name Setting." In FIG. 11, "Group 1" and "Group 2" are set. "(Add)" is an input field for adding a new group name.

[0102] For "Group setting unit," "Specimen" or "Analysis field" can be specified using the radio buttons. If "Specimen" is specified, grouping is set by specimen. In this case, groups can be specified under the cells "Specimen A," "Specimen B," etc. in the "Specimen name" column. If "Analysis field" is specified, grouping is set by analysis field. In this case, groups can be specified under the cells "R01," "R02," etc. for each specimen in the "Analysis field." The example in Figure 11 shows a case where grouping is specified by analysis field, and "Group 1" or "Group 2" is set under each analysis field.

[0103] In addition, the recipe to be counted can also be specified as a counting condition. In the example of Figure 11, "recipe02" and "recipe03" are counted in the "counting recipe", and "recipe01" is excluded from the counting. Selection of the counting recipe may be omitted.

[0104] The counting unit 42 (see FIG. 2) of the display control unit 12 counts the analysis results of all the analysis fields that are the analysis targets in accordance with the counting conditions. That is, the counting unit 42 executes the counting step. As a result, the counting result for one case is obtained.

[0105] The progress display device 1 may be modified in various ways. For example, in the above description, the analysis field list 32 is displayed separately in "analysis preparation" and "analysis," but it may also be displayed as a single list. Furthermore, the "analysis preparation" step corresponds to specimen registration (setting basic information), analysis field setting, and cell recognition, while the "analysis" step corresponds to gating (setting a positive threshold) and the analysis process itself, but the analysis field list 32 may be displayed in a different manner. Generally speaking, it is preferable that the analysis field list 32 be displayed in a form including multiple sublists corresponding to the processing stages. This makes it easier to grasp the progress of each analysis field.

[0106] In the progress display device 1, attention to the need for rework is drawn by marking the cell in red, but various other methods may be used to "attach a notice to the process that requires rework." For example, the color of the cell may be changed to a different shade, the color of the text indicating the process may be changed to a color that draws attention (e.g., red), the item indicating the process may be made to blink, or a pop-up display may be added to the item.

[0107] In the above embodiment, multiple immunostaining analysis is given as an example, but the progress display device 1 may also be used for other specimen analyses. The specimen does not have to be pathological tissue, and may be a collection of cells other than pathological tissue. For example, a specimen may be a collection of multiple cells present in a liquid in a separated state. Organoids, spheroids, etc. may also be used as specimens. The specimen is a specimen derived from a living organism.

[0108] The configurations in the above-described embodiment and each modification may be combined as appropriate as long as they are not mutually contradictory.

[0109] While the invention has been particularly depicted and described, it should be understood that the foregoing description is illustrative and not restrictive, and that numerous modifications and variations are possible without departing from the scope of the invention.

[0110] REFERENCE SIGNS LIST 1 Progress display device 5 Computer 11 Display unit 12 Display control unit 13 Operation unit 21 Progress list display process 22 Analysis field list display process 24 Update process 31 Progress list 32 Analysis field list 33 Analysis field setting screen 34 Cell recognition screen 35 Analysis screen 36 Recipe list 37 Aggregation condition setting screen 91 Program

Claims

1. A progress display device that displays the progress of processing for a group of cells used in specimen analysis, comprising: a display unit; and a display control unit that controls display on the display unit, wherein the display control unit causes the display unit to display a progress list showing the progress for at least one specimen in association with each specimen, and an analysis field list showing the progress of processing for at least one analysis field set for each specimen in association with each analysis field, and the display control unit updates the progress list or the analysis field list based on monitoring of information generated in association with the processing or input of the information.

2. A progress display device according to claim 1, wherein the analysis view list includes a plurality of partial lists corresponding to stages of the processing.

3. A progress display device as described in claim 1, wherein, when the completion time of each step included in the processing for each of the specimens is later than the completion time of a subsequent step, the display control unit displays a display in the progress list or the analysis field list to draw attention to the item indicating the subsequent step.

4. A progress display device according to claim 1, wherein at least one recipe, each of which indicates analysis conditions, can be set, and when multiple recipes are set, the analysis view field list is created for each of the multiple recipes.

5. A progress display device according to claim 4, wherein the display control unit causes the display unit to display a list of recipes indicating the progress of processing related to the at least one recipe.

6. A progress display device as described in claim 5, wherein the recipe list includes a creation time for each of the at least one recipe, and when the creation time of a recipe is updated due to a change to the recipe, the display control unit displays a notice in the progress list or the analysis field of view list to draw attention to an item indicating a process that depends on the recipe among the processes included in the processing.

7. A progress display device as claimed in claim 1, further comprising an operation unit that receives input from an operator, wherein when the operator specifies an item in the progress list that indicates a process related to the operator's work via the operation unit, the display control unit causes the display unit to display a work screen related to the item.

8. A progress display device as claimed in claim 1, further comprising an operation unit for receiving input from an operator, wherein when the operator specifies via the operation unit to display a counting condition setting screen for setting counting conditions for analysis results, the display control unit causes the counting condition setting screen to be displayed on the display unit, and the setting of the counting conditions includes a specification to divide multiple specimens that are the at least one specimen or multiple analysis fields included in the at least one specimen into multiple groups for comparing the results of the specimen analysis.

9. A progress display device according to claim 1, wherein a plurality of specimens that are the at least one specimen or a plurality of analysis fields included in the at least one specimen are divided into a plurality of groups for comparing the results of the specimen analysis.

10. A progress display device according to any one of claims 1 to 9, wherein each of the specimens is a pathological tissue specimen.

11. A computer-readable program that causes a computer to display on a display unit the progress of processing for a group of cells used in specimen analysis, wherein execution of the program by the computer causes the computer to execute the following steps: a) display on the display unit the progress for at least one specimen as a progress list associated with each specimen; b) display on the display unit the progress of processing for at least one analysis field set for each specimen as an analysis field list associated with each analysis field; and c) updating the progress list or the analysis field list based on monitoring information generated in work related to the processing or input of the information.

Images