Image display method, computer program, and recording medium

Abstract

To effectively support the work of a user for confirming a result of registration processing between a plurality of dyed images captured by multiple immunostaining a tissue sample with image display.SOLUTION: An image display method according to the present invention comprises the steps of: acquiring an image set including a plurality of dyed images captured by multiple immunostaining a tissue sample and applied to registration processing for performing registration between the dyed images; and displaying on a screen the dyed image included in the image set by switching the dyed images along a prescribed switching rule in a such a state where the result of the registration processing is reflected. In the screen display, an image including at least one dyed image and a graphical user interface for receiving an operation input from a user related to editing of the switching rule, the switching rule is changed and set according to the operation input, and the screen display is performed along the switching rule after the change setting.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a method for displaying stained images captured by multiplex immunostaining of a tissue specimen, and more particularly to a method for displaying stained images including the results of registration processing for aligning the positions of the stained images. [Background technology]

[0002] In recent years, the field of immunohistochemistry has attracted attention for its so-called single-cell analysis, which focuses not only on a specimen as a cell population but also on the individual cells that make up the specimen, and measures the expression levels and locations of biological substances such as proteins and their related substances at the cell level. To this end, image cytometry, which images tissue specimens and analyzes them through image processing, has been put to practical use. In image cytometry-based multiple immunostaining analysis, biological specimens such as tissue sections taken from living organisms or artificially cultured cell tissues are repeatedly stained, imaged, and bleached to obtain multiple specimen images corresponding to multiple stains.

[0003] This technique requires the registration of multiple specimen images, each stained differently, to be cross-referenced. Functions for finding corresponding locations between images in a set of multiple images (an image stack) and calculating the amount of misalignment between them are now being implemented in general image processing software. Patent Document 1, for example, describes a registration technique specifically designed for tissue specimen images. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2015 / 002082 Summary of the Invention [Problem to be solved by the invention]

[0005] In multiple immunostaining, where various staining methods are applied sequentially, the appearance of the staining results varies greatly from stained image to stained image, and there may be combinations where no corresponding parts can be found between images. For this reason, conventional registration processing techniques cannot always correctly align all stained images, which means that registration sometimes fails.

[0006] However, no technology has been established that can automatically determine the success or failure of registration between stained images with different image content, and the task of visually determining success or failure by an expert remains essential. Furthermore, this determination is not easy even for an expert, and the workload increases as the number of staining types increases. For this reason, there is a need for technology that can assist users in checking the results of registration processing and perform this task efficiently. However, no such technology has been proposed to date.

[0007] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an image display method that can effectively assist a user in checking the results of registration processing between multiple stained images obtained by multiplex immunostaining of a tissue specimen. [Means for solving the problem]

[0008] One aspect of the image display method according to the present invention includes the steps of: acquiring an image set including a plurality of stained images obtained by subjecting a tissue specimen to multiple immunostaining and then performing registration processing to align the images with each other; a step of displaying an image including an image window displaying at least one of the stained images and a graphical user interface for receiving an operation input from a user relating to editing of a switching rule when switching and displaying the stained images included in the image set in the image window; and a step of changing the switching rule that determines a combination of the stained images before and after switching in accordance with the operation input received via the graphical user interface; The stained images included in the image set are at the same position within the image window, according to the modified switching rule, and A state in which the results of the registration process are reflected Cut with and a process of switching the screen and displaying it. R .

[0009] Here, the "switching rule" refers to a rule that determines which stained images should be displayed in what order in the above-described screen display. In the present invention, this switching rule can be dynamically changed by a user operation. Furthermore, the registration process is a process performed to correct relative positional deviations between the images, but it may be a process that goes up to the stage of calculating the amount of positional deviation, or may be a process that includes positional correction according to the calculated amount of positional deviation.

[0010] A widely used method involves switching between multiple images with similar content and utilizing the persistence of vision effect to visually confirm the presence or absence of differences between the images and the degree of those changes. However, no practical method has been developed that utilizes this principle to confirm the results of registration processing of multiple immunostained images. The main reason for this is that while this method of confirming similarities and differences using the persistence of vision effect is effective when the differences between images are relatively small, it does not necessarily work effectively for image sets with large differences in content, such as multiple immunostained images.

[0011] It is believed that it would be easier to check for differences between multiple stained images included in an image set if, for example, images with similar image content, more specifically images that explicitly include corresponding portions, were combined and displayed in sequence. However, there is no method for comparing multiple stained images with each other and combining them in an appropriate display order depending on the degree of similarity.

[0012] Therefore, in the invention configured as described above, the rules for switching between the combinations of stained images to be displayed and their arrangement are determined based on operational input from the user, and the focus is on providing a user interface for efficiently performing such operations.

[0013] Specifically, the image set that is switched and displayed includes multiple stained images captured by multiple immunostaining of a tissue specimen, and registration processing has been performed in advance between these stained images. When the stained images are switched and displayed on the screen, the results of the registration processing are reflected in each stained image. In other words, when switching from a currently displayed stained image to the next stained image, the next stained image is displayed in a state in which the relative positional deviation with respect to the previous stained image has been eliminated. By reflecting the results of the registration processing in the switched display in this way, the user can confirm the success or failure of the registration processing by comparing the images before and after switching.

[0014] The combination of images before and after switching can be changed by the user operating a graphical user interface (GUI) displayed together with the stained image. The technique for this can be, for example, the same as the widely used method of rearranging image files displayed in a window.

[0015] In this way, in this invention, the multiple stained images included in the image set are switched and displayed while reflecting the results of the registration process, and a GUI for editing the switching rule is also displayed. When the user changes the switching rule, the images are switched and displayed in accordance with the changed switching rule. Therefore, the user can compare the images, specifically, check the success or failure of the registration process, by combining and switching between the multiple stained images that the user wants to compare. [Effects of the Invention]

[0016] As described above, in the present invention, an image set including multiple stained images obtained by multiple immunostaining and the associated imaging is switched between displays while reflecting the results of registration processing on each stained image. Furthermore, the combination of images before and after switching can be changed by user input via the GUI. These functions effectively support the user's task of checking the results of registration processing between multiple stained images, reducing the user's workload. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a flowchart outlining a process for creating an image set. [Figure 2] FIG. 10 is a diagram showing an example of an image set handled by the present embodiment. [Figure 3] 10 is a flowchart showing an image display process in the present embodiment. [Figure 4] FIG. 10 is a diagram illustrating an example of the configuration of a display image. [Figure 5] FIG. 10 is a diagram illustrating an example of an operation when a display switching button is pressed. [Figure 6] 10A and 10B are diagrams illustrating an example of an operation for determining whether registration processing has been successful. [Figure 7] FIG. 10 is a diagram illustrating an example of an operation on an adoption check box. [Figure 8] 10A and 10B are diagrams illustrating an example of an operation for display order. [Figure 9] 10A and 10B are diagrams illustrating image skip processing during display switching. [Figure 10] FIG. 10 is a diagram illustrating an example of creating one image set from multiple subsets. [Figure 11] FIG. 10 is a diagram showing an example of a display of an integrated image set. DETAILED DESCRIPTION OF THE INVENTION

[0018] The following describes an image display process, which is one embodiment of an image display method according to the present invention. This image display process can be executed by a system including a processor having image processing and logical operation processing functions, an input device for accepting user input, and an image display device, and can be executed, for example, by using a personal computer device having a general hardware configuration. As the input device, for example, a mouse, keyboard, touch pen, etc. can be used, either alone or in appropriate combination. Furthermore, as the image display device, for example, a liquid crystal display device can be used. A touch panel that serves as both an input device and an image display device may also be used.

[0019] The target of this image display processing is an image set including multiple stained images obtained by imaging a tissue specimen after multiple immunostaining and then performing registration processing. This embodiment works particularly effectively for image sets including three or more stained images. The image set is created as follows.

[0020] FIG. 1 is a flowchart showing an outline of the process for creating an image set. First, a tissue specimen to be analyzed is prepared (step S101). The tissue specimen is, for example, a specimen such as tissue excised from a living organism or cultured cells fixed on an appropriate support such as a cover glass. The tissue specimen is stained (step S102), imaged (step S103), and bleached (step S104) using multiple staining methods. This results in multiple stained images of a single tissue specimen stained and imaged using multiple staining methods.

[0021] Between these stained images, misalignment occurs due to repeated bleaching and staining between images and deformation of the specimen itself over time. To correct this misalignment, a registration process is performed (step S105). That is, the amount of relative movement required to properly overlay one image on another is determined as the "registration amount." Various image processing algorithms for registration are in practical use, and the type is not important here. A set of images after registration process in this way is referred to as the "image set" here.

[0022] In multiple immunostaining, some images contain different stained cells, resulting in significantly different shading patterns from other stained images. This can make it difficult to automatically and accurately align all stained images. Therefore, the results of the registration process still require visual confirmation by a user with specialized knowledge. The image display method of this embodiment, described below, supports the user's work from the image display perspective, allowing them to efficiently confirm the results of the registration process. Ultimately, the goal is to create an image set in which all images are successfully registered.

[0023] FIG. 2 is a diagram showing an example of an image set handled by this embodiment. An image stack S including multiple stained images Image001, Image002, Image003, ... is acquired by capturing images of the same region of the same tissue specimen under different staining conditions. Information regarding the registration amount determined as a result of the registration process is assigned to each of these stained images to form an image set. The registration amount can be expressed, for example, by the amount of relative translation or rotation between images required to properly overlay two images.

[0024] Multiple registration processes with different processing conditions, such as different processing algorithms or the same algorithm with different parameter settings, can be applied to a single image stack S. In other words, multiple image sets can be created from a single image stack S. In the following example, two image sets are created corresponding to two processing recipes (Recipe 1 and Recipe 2) that specify the processing contents of the registration process.

[0025] 3 is a flowchart showing the image display process according to this embodiment. This process is realized, for example, by a computer device executing a prepared control program. More specifically, the computer device displays a predetermined image on an image display device in accordance with the control program, and also accepts user input via an input device as needed, changing the display accordingly.

[0026] First, the image set created as described above is acquired (step S201), and the display order of the plurality of stained images is initially set (step S202). The display order at this time is arbitrary. For example, it may be the same as the order of imaging, or may be the result of appropriate sorting based on the results of registration processing. Then, an initial image including the stained image that has been set to be first in the display order is displayed on the screen of the image display device (step S203). In this state, the system waits for an operation input from the user (step S204).

[0027] 4 is a diagram showing an example of the configuration of a displayed image. The displayed image includes a list window W1 showing a list of images that make up the image set, an image window W2 displaying a specified image from the list, and a group of buttons B as a graphical user interface (GUI) for receiving operation input from the user via an input device.

[0028] The list window W1 displays a list of the file names of the stained images included in the acquired image set in the currently set display order. The "SKIP," "CONFIRM," "ACCEPT," "RECIPE," and "BASE" columns are columns for reflecting user operations. Of these, the "RECIPE" column displays information for identifying the registration processing recipe applied to the image set. In this example, it is shown that Recipe 1 was applied. Details of the other columns will be explained later. The image window W2 displays the selected stained image at the appropriate magnification. The SKIP column for image Image001 in the list window W1 is filled in with a dark color, indicating that the image currently displayed in image window W2 is this image, Image001. The display magnification can be changed by user operation.

[0029] Button group B includes display switch buttons ("Up", "Down") for switching the images displayed in image window W2, confirmation buttons ("OK", "NG", and "Pending") for accepting the user's judgment on the results of the registration process, an "Adopt" checkbox for reflecting the image in the adoption window described below, and buttons ("Up", "Down") for changing the display order.

[0030] Returning to FIG. 3, when the user operates any of these buttons (YES in step S204), the subsequent operation differs depending on the operation. Specifically, when the display switching button "Up" is pressed, step S211 is executed. On the other hand, when the display switching button "Down" is pressed, step S212 is executed.

[0031] Similarly, when the confirmation buttons "OK," "NG," and "Pending" are pressed, steps S213, S214, and S215 are executed, respectively. When the "Adopt" checkbox is clicked, step S216 is executed. When the display order buttons "Up" and "Down" are pressed, steps S217 and S218 are executed, respectively.

[0032] FIG. 5 shows an example of the operation that occurs when a display switching button is pressed. As shown in the upper diagram of FIG. 5, assume that, with image Image001 displayed in image window W2, the user presses the "Down" display switching button by operating the mouse, for example. This button is used to display the image that is one image below the image currently displayed in image window W2 in the set display order. Therefore, when this button is pressed, as shown in the lower diagram of FIG. 5, the image in image window W2 switches to image Image002, which is one image below the current image Image001 in the display order (step S212). Accordingly, the dark color in the SKIP column in list window W1 changes from image Image001 to image Image002.

[0033] At this time, the displayed image reflects the results of the registration process. That is, when the image in image window W2 switches from image Image001 to image Image002, position correction is applied to image Image002 to cancel the amount of relative positional deviation between image Image001 and image Image002 determined by the registration process.

[0034] When the "Down" button is pressed again from this state, the image in image window W2 switches to image Image003 (step S212). On the other hand, when the "Up" button is pressed, the image displayed in image window W2 switches from image Image002 to image Image001 (step S211). In this way, the display switching button realizes the function of switching the stained images displayed in image window W2 in the order in which they were displayed in list window W1.

[0035] When the "down" button is pressed while the last stained image in the currently set display order is displayed, the display may be switched to the first stained image in the display order. Conversely, when the "up" button is pressed while the first stained image is displayed, the display may be switched to the last stained image. In this way, it becomes possible to switch and compare stained images that are far apart in the display order.

[0036] When comparing two stained images with different staining conditions, it is sometimes more effective to alternate between the two images rather than displaying them side by side. This is because it makes it possible to evaluate the presence and extent of misalignment between the two images by utilizing the persistence of vision effect. Switching between images that reflect the results of the registration process can assist the user in determining whether the registration process was successful. In other words, the user can confirm the success or failure of the registration process by determining whether they detect any misalignment between the images before and after switching.

[0037] FIG. 6 is a diagram illustrating an example of a user's operation for determining whether the registration process was successful. The user can determine whether the registration process was successful by looking at the images that are switched and displayed. The determination result can be reflected in the data. That is, when it is determined that the registration process was successful, the user presses the confirmation button "OK" as shown in FIG. 6, and "OK" is displayed in the "Confirmation" column for that image displayed in the list window W1. This records that the image is an example of a successful registration process (step S213).

[0038] On the other hand, if a clear misalignment is detected and the user determines that the registration process has failed, the user can press the confirmation button "NG" to record the registration process for that image as a failed case (step S214). At this time, "NG" is displayed in the "Confirmation" column for that image displayed in the list window W1. Images for which the success or failure is unclear can be recorded as "pending" cases (step S215). In this way, it becomes possible, for example, to extract only the pending images and perform a separate confirmation process.

[0039] FIG. 7 is a diagram illustrating an example of a user's operation on the "Adopted" checkbox. By clicking the "Adopted" checkbox, the user can switch between a checked state (hereinafter referred to as the "adopted state") and an unchecked state (hereinafter referred to as the "unadopted state") (step S216). The function of the "adopted" checkbox will be described later. The result of the operation on the checkbox is reflected in the "adopted" column in the list window W1. That is, for images that are in the adopted state, a "○" mark is displayed in the "adopted" column.

[0040] FIG. 8 is a diagram illustrating an example of a user's manipulation of the display order. For example, as shown in the upper diagram of FIG. 8, when the user presses the display order button "Down" while image Image002 is displayed in image window W2, the display order of image Image002 in list window W1 is moved down by one position (step S218), as shown in the lower diagram of FIG. 8, resulting in the order of images Image002 and Image003 being swapped. When the display order button "Up" is pressed, the display order of the image is moved up by one position (step S217). In this way, the display order of stained images can be changed by user manipulation.

[0041] When comparing two images by switching between images, if the images before and after switching contain common features, these can be used as markers to easily determine whether or not there is misalignment. However, in stained images obtained by multiple immunostaining, the shading of the images can vary significantly depending on the staining content, making it often difficult to find any correlation between the images before and after switching. For this reason, in this embodiment, the display order of the stained images can be changed by user operation. This allows the user to select the combination of images displayed before and after switching, allowing the user to create an environment that makes it easier to determine whether or not the image has been successfully switched, for example, by grouping related images together or arranging them in order of least misalignment.

[0042] There is also a need, for example, to use one stained image in the image stack S as a reference image and sequentially compare two or more other stained images with the reference image to perform confirmation work. In this case, too, by sequentially moving the position of the reference image in the display order, confirmation work can be efficiently performed by switching between the displays of other images. For stained images used as reference images in the registration process, a "○" mark is displayed in the "Reference" column of the list window W1. In this example, it is indicated that image Image001 was used as the reference image.

[0043] When checking multiple images by switching between them, if there are images with low relevance between them, it becomes difficult to determine the relevance of the images before and after them. By changing the display order as described above, such images can be prevented from appearing immediately in the series of images being switched. Another method, as explained below, is to exclude some images from being switched between images.

[0044] Figure 9 shows the image skipping process during display switching. As shown in the upper part of Figure 9, the user can exclude specific images from display by checking the "SKIP" column in the list window W1. As shown in the figure, for example, when the "SKIP" column for image Image003 is checked and the user presses the "Down" display switch button, the image displayed in image window W2 switches from image Image002 to image Image004, and the display of image Image003 is skipped. Furthermore, when the "Up" display switch button is pressed in this state, image Image004 switches to image Image002.

[0045] For example, if an image is determined to have failed the registration process, its appearance in the display may actually hinder the confirmation of other images. By excluding such images from the display, the confirmation process can proceed smoothly using the afterimage effect. Images that have been excluded from the display in this way can also be returned to the display list by unchecking them.

[0046] In this way, by switching between the multiple stained images included in an image set while reflecting the results of the registration process between them, it is possible to effectively support the user's confirmation work. By allowing the user to switch between displaying and hiding images and change the display order, the work can be made even more efficient.

[0047] The image set can be a combination of a set of image stacks S and the results of registration processing using a single recipe. It is also possible to use a set of image stacks S and the results of registration processing using multiple recipes. Even between two stained images included in the same image stack S, if the registration processing recipes are different, the calculated registration amount may differ.

[0048] For the purpose of aligning two images, it is desirable to perform the registration process using a recipe that can accurately extract the differences between the images. Therefore, it is convenient to be able to integrate the results of the registration processes using multiple recipes and extract the best result from them. For example, one image stack S and the registration results using one recipe can be combined into one image subset, and multiple image subsets obtained by applying different recipes to the same image stack S can be combined into one image set.

[0049] For example, when considering registration processing between two images, Image001 and Image002, the registration amount determined by Recipe 1 does not necessarily match the registration amount determined by Recipe 2. For this reason, in the above-mentioned image display processing that reflects the results of the registration processing, when, for example, image Image001 is switched to image Image002, the position of image Image002 may differ when the results of the registration processing according to Recipe 1 are reflected and when the results of the registration processing according to Recipe 2 are reflected.

[0050] The recipe with the smaller misalignment with image Image001 can be said to provide better results between these images. By appropriately selecting the combination of previous and next images in the switching display, it is possible to compare the merits of such recipes. Then, by adopting the registration amount that produced the better results among multiple recipes, the accuracy of the registration process for image stack S can be improved.

[0051] When integrating image subsets, if the image sets created for each recipe were integrated as is, as described above, the number of stained images to be checked would increase, significantly increasing the effort required for the checking work. To solve this problem, as will be explained below, it is also possible to construct an image set by collecting only stained images selected by the user from each image subset. Here, it is assumed that multiple image subsets corresponding to multiple recipes are created for a single image stack S.

[0052] FIG. 10 is a diagram showing an example of creating one image set from multiple image subsets. This process can be realized by replacing step S201 in the process of FIG. 3 with the processes of steps S201a to S201c shown in FIG. 10. In step S201a, multiple image subsets are obtained by associating the results of registration processes using different recipes for the same image stack S. Then, of the stained images included in each image subset, only images in the adopted state are collected (step S201b), and an image set consisting of these images is created (step S201c).

[0053] Fig. 11 shows an example of the display of an integrated image set. As shown in the figure, the image display process in Fig. 3 is executed in parallel for each image subset corresponding to a different recipe (recipe 1, recipe 2), and the display for this is performed as an individual window Wd for each recipe on the same screen.

[0054] In the "adoption window" Wi, which shows the integrated image set, images in the adopted state are extracted from each subset and listed in the list window W1. It is more preferable that the results of operations on the screens corresponding to Recipe 1 and Recipe 2 are immediately reflected in the adoption window. In other words, for example, when an image is set to the adopted state on the screen corresponding to Recipe 1, that image is immediately incorporated into the list window W1 in the adoption window Wi.

[0055] In the list window W1 in the adoption window Wi, the numbers "1" and "2" shown in the "Recipe" column indicate that the images were selected from Recipe 1 and Recipe 2, respectively. In this way, even if the stained images are the same, images that have undergone different registration processes are treated as different images within the image set.

[0056] In this way, by simultaneously displaying the individual windows Wd corresponding to different recipes and the adoption window Wi that integrates them, it is possible to proceed with the confirmation work within each recipe and the confirmation work across multiple recipes in parallel. For example, by collecting only images for which the registration process for each recipe was determined to be successful in the adoption window Wi (corresponding to the "integration window" of this invention), it is possible to improve the accuracy of the registration results for this image stack S. This is because it becomes possible to compare the registration results for multiple recipes and select the one with the best results.

[0057] This display can also be used to evaluate registration recipes: the recipe with the most successful images after multiple registration recipes is likely to provide the most effective registration for the image stack S.

[0058] In the above embodiment, the displayed images are switched in response to the user's operation of the display switching button. Alternatively, a display mode that automatically switches images at regular intervals would be useful. For example, when the user wants to grasp the overall trend of the results of the registration process among multiple images, or when the user wants to check the display order after the rearrangement process has progressed to a certain extent, automatic display switching allows the user to check each image in order without taking their eyes off the image window W2.

[0059] Therefore, it is preferable to provide both a display mode in which images are switched by user operation as described above, and a display mode in which images are switched automatically at regular intervals, so that the user can select either mode according to their preference.

[0060] As described above, in the image display method of this embodiment, for an image set including a plurality of stained images that have been registered, each stained image is displayed in a switching manner while reflecting the registration results, thereby effectively supporting the user's task of checking the registration results by utilizing the afterimage effect.

[0061] To effectively utilize the persistence of vision effect, the switching rules that determine the combination of images to be switched and displayed can be changed. In other words, functions such as excluding some images from the switching display and changing the display order can be executed according to user operations. In addition, while switching between images, the user's judgment on the success or failure of the registration process can be recorded. These functions enable the user to perform confirmation work more efficiently and reduce the user's workload.

[0062] The various image processing operations in the above embodiments can be performed using a computer device having a general hardware configuration. In other words, by installing a computer program describing the above operational procedures in a general-purpose computer device, the computer device can function as an execution entity of the present invention.

[0063] The present invention is not limited to the above-described embodiment, and various modifications other than those described above are possible without departing from the spirit of the present invention. For example, the display screen configuration of the above-described embodiment is merely an example, and the layout, names, etc. of windows and buttons are not limited to those described and are arbitrary. Furthermore, for example, a function for simultaneously displaying multiple stained images in the image window may be further provided.

[0064] In addition to the method of operating the display order buttons as described above, the display order in the image window W2 can also be changed by dragging and dropping within the list window W1, for example.

[0065] As described above with reference to specific embodiments, the image display method according to the present invention can be configured to accept, via an operation input, a designation for distinguishing between images to be included and excluded from the multiple stained images to be displayed on the screen. When a user switches between the multiple stained images to review, some of the images may be images that hinder the review of other images, such as images with significantly different shading patterns or images with inappropriate registration results. By being able to exclude such images from the display, the review of other images can be performed more efficiently.

[0066] Furthermore, for example, the system may be configured to accept a designation regarding the order of switching display on the screen display by an operational input. A function for changing the display order of stained images designated by the operational input may be provided. By accepting a change in the display order, it becomes possible for the user to switch and display images that the user wishes to compare with each other in a desired order.

[0067] Furthermore, for example, the first stained image in the display order set in the switching rule may be displayed next to the last stained image in the display order set in the switching rule. With this configuration, it becomes possible to switch between and compare stained images that are far apart in the display order.

[0068] For example, the display mode for switching between stained images may be a mode in which the displayed image is switched in response to a user operation, and a mode in which the displayed image is automatically switched at predetermined time intervals. In the case of switching by user operation, the switching does not occur until the user operates the display, so it is possible to observe one image for any length of time. On the other hand, in the mode in which the display is automatically switched, the user can check multiple images without taking their eyes off the screen. In particular, when comparing images using the afterimage effect, it is useful to be able to avoid moving the line of sight.

[0069] Furthermore, for example, the system can accept user input regarding the result of the registration process for stained images displayed on the screen, thereby providing each stained image with information regarding the user's judgment regarding the result of the registration process.

[0070] Furthermore, for example, the image set may include multiple subsets in which the same set of stained images have been subjected to registration processing under different processing conditions. Even for the same set of stained images, the results may differ if the processing conditions of the registration processing are different. By using an image set including multiple subsets with different processing conditions, it is possible to extract and select from the subsets, for example, those with good results, and use them as the results of the registration processing.

[0071] In this case, a screen display that switches between displaying stained images included in one set of subsets and a screen display that switches between displaying stained images included in multiple sets of subsets can be executed. Furthermore, for example, as windows for displaying stained images, a plurality of individual windows corresponding to each of the multiple subsets and an integrated window that uses the individual windows to integrate and display stained images selected from each subset by a user operation can be provided. This allows for confirmation work within one subset and confirmation work across subsets.

[0072] Furthermore, for example, the image set may be configured so that stained images selected by user input from among the stained images included in multiple subsets are included. When an image set includes multiple subsets, the number of images displayed increases, which may increase the effort required for review. Therefore, if the user is allowed to select the stained images to include in the image set, it becomes possible to configure the image set by collecting only images that the user determines are necessary to review across subsets, thereby improving the efficiency of the review process.

[0073] The present invention can be implemented as a program for causing a computer device to execute each step of the image display method described above, or as a computer-readable recording medium on which the program is non-temporarily recorded. Each step can be realized by a computer device having a general hardware configuration, and by installing the program in an existing computer device, it is possible to add new functions to the computer device. [Industrial Applicability]

[0074] This invention is applicable to applications in fields such as medical and biological research, where the same tissue specimen is stained and photographed multiple times, and the images obtained are then integrated and analyzed. For example, it is suitable for analyzing multiple immunostained tissue specimens on a single cell basis. [Explanation of symbols]

[0075] Image001, Image002, ... Stained images S Image stack W1 List window W2 Image Window Wd Individual Window Wi Recruitment Window (Integrated Window)

Claims

1. A step of acquiring an image set including a plurality of stained images obtained by subjecting a tissue specimen to multiple immunostaining and then performing a registration process to align the images with each other; displaying an image including an image window displaying at least one of the stained images and a graphical user interface for receiving an operation input from a user relating to editing of a switching rule when switching and displaying the stained images included in the image set in the image window; changing the switching rule that determines a combination of the stained images before and after switching, in accordance with the operation input received via the graphical user interface; switching and displaying the stained images included in the image set at the same positions within the image window in accordance with the changed switching rule and in a state that reflects the result of the registration processing; An image display method comprising:

2. 2. The image display method according to claim 1, wherein a specification for distinguishing between stained images to be included and excluded from the target of switching display on the screen is accepted by the operation input, and only the stained images included in the target are switched and displayed.

3. The image display method according to claim 1 , wherein a designation regarding an order of switching display in the screen display is accepted by the operation input, and the stained images are switched and displayed in the designated order.

4. 4. The image display method according to claim 1, wherein the first stained image in the display order set as the switching rule is displayed next to the last stained image in the display order set as the switching rule.

5. 5. The image display method according to claim 1, wherein the stained image switching display mode includes a mode in which the displayed image is switched in response to a user operation and a mode in which the displayed image is automatically switched at predetermined time intervals.

6. 6. The image display method according to claim 1, further comprising the step of receiving an operation input from a user regarding a result determination of the registration process for the stained image displayed on the screen.

7. 7. The image display method according to claim 1, wherein the image set includes a plurality of subsets in which the same set of stained images has been subjected to the registration process under different processing conditions.

8. The image display method according to claim 7 , further comprising: executing the screen display for switching between displaying the stained images included in one set of the subsets; and executing the screen display for switching between displaying the stained images included in a plurality of sets of the subsets.

9. 9. The image display method according to claim 7, wherein the image windows for displaying the stained images include a plurality of individual windows corresponding to the plurality of subsets, and an integrated window for integrating and displaying the stained images selected from the individual subsets by a user operation using the individual windows.

10. The image display method according to claim 7 , wherein one of the stained images included in the plurality of subsets is selected by an operation input from a user and included in the image set.

11. A computer program for causing a computer device to execute the image display method according to any one of claims 1 to 10.

12. A computer-readable recording medium on which the computer program according to claim 11 is non-transitoryly recorded.

Images