Information processing device, information processing method, and program

Abstract

To reduce the workload of a user when creating a cut-out instruction image.SOLUTION: An information processing apparatus according to the embodiment includes a cut-out instruction information acquiring unit, a sample region identifying unit, a correction information acquiring unit, and a cut-out instruction information generating unit. The cut-out instruction information acquisition unit acquires first cut-out instruction information indicating one or more cut-out positions of the sample in a sample image obtained by capturing an image of the sample. The sample region identifying unit identifies at least one sample region in which the sample is depicted on the sample image. The correction information acquiring unit acquires correction information defining a process for correcting the first cut-out instruction information based on the first cut-out instruction information and the sample region. The cut-out instruction information generating unit generates second cut-out instruction information different from the first cut-out instruction information by reflecting the correction information in the first cut-out instruction information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to an information processing device, an information processing method, and a program. [Background technology]

[0002] Conventionally, in the field of pathology and the like, in the process of preparing a slide specimen, a cutting instruction diagram is prepared to indicate the positions at which a specimen is to be sliced. A cutting instruction diagram is generally an image in which the positions at which the specimen is to be sliced ​​are indicated on a photograph of the specimen taken with a digital camera. In recent years, the digitalization of cutting instruction diagrams has progressed, and software is sometimes used to prepare cutting instruction diagrams on a computer using the digital image of the specimen taken with a digital camera without printing it. The positions at which the specimen is to be sliced ​​are indicated by an object such as a plurality of cutting instruction lines, for example.

[0003] In creating such a digitalized cut-out diagram, when a user moves an object such as a plurality of cut-out instruction lines indicating the position to slice the specimen, some of the cut-out instruction lines may be positioned outside the specimen area on the digital image, and the position of the object indicating the cut-out position may be shifted from the appropriate cut-out position. In such a case, the user had to manually delete the cut-out lines positioned outside the specimen area on the digital image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2022-14659 A Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to reduce the workload of a user when creating a cut-out instruction image. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]

[0006] The information processing device according to the embodiment includes a cut-out instruction information acquisition unit, a specimen region identification unit, a correction information acquisition unit, and a cut-out instruction information generation unit. The cut-out instruction information acquisition unit acquires first cut-out instruction information from a cut-out instruction image indicating one or more cut-out positions of the specimen in a specimen image in which the specimen is captured. The specimen region identification unit identifies at least one specimen region in which the specimen is depicted on the specimen image. The correction information acquisition unit acquires correction information that defines a process of correcting the first cut-out instruction information based on the first cut-out instruction information and the specimen region. The cut-out instruction information generation unit generates second cut-out instruction information different from the first cut-out instruction information by reflecting the correction information in the first cut-out instruction information. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of an overall configuration of an information processing system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a sample image according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of a cutout instruction image according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a display form of a first cut-out instruction information group in a state in which the first cut-out instruction information group has been selected as a change target by a user according to the first embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of a state in which the first cut-out instruction information group in FIG. 4 has been changed by a user. [Figure 6]FIG. 6 is a diagram illustrating an example of a marginal area according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of the second cut-out instruction information added to eliminate the marginal area shown in FIG. [Figure 8] FIG. 8 is a diagram showing an example of a jurisdiction area of ​​the first cut-out instruction information according to the first embodiment. [Figure 9] FIG. 9 is a diagram showing an example of a state in which second cut-out instruction information is added to the marginal area in FIG. [Figure 10] FIG. 10 is a diagram showing an example of a cut-out instruction image including a cut-out instruction rectangle according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a state in which second cut-out instruction information is added to the marginal area in FIG. [Figure 12] FIG. 12 is a diagram showing an example of a state in which jurisdiction areas of a plurality of first cut-out instruction information according to the first embodiment overlap. [Figure 13] FIG. 13 is a diagram showing an example of a cut-out instruction image in which a plurality of specimens are depicted according to the first embodiment. [Figure 14] FIG. 14 is a diagram showing an example of a state in which the cut-out lines in the cut-out instruction information in FIG. 13 are divided into sample regions. [Figure 15] FIG. 15 is a diagram illustrating an example of the second cut-out instruction information according to the first embodiment. [Figure 16] FIG. 16 is a flowchart showing an example of the flow of the correction process of the first cut-out instruction information according to the first embodiment. [Figure 17] FIG. 17 is a flowchart showing an example of the flow of the correction information acquisition process according to the first embodiment. [Figure 18] FIG. 18 is a flowchart showing another example of the flow of the correction information acquisition process according to the first embodiment. [Figure 19] FIG. 19 is a diagram showing an example of a slice instructed by the second cut-out instruction information according to the third modification of the first embodiment. [Figure 20]FIG. 20 is a diagram showing an example of a slice instructed by second cut-out instruction information based on modified modification information according to the third modification of the first embodiment. [Figure 21] FIG. 21 is a diagram illustrating an example of an overall configuration of an information processing system according to the second embodiment. As shown in FIG. [Figure 22] FIG. 22 is a diagram showing an example of a cut-out instruction image according to the second embodiment. [Figure 23] FIG. 23 is a diagram showing an example of a state in which the first cut-out instruction information in FIG. 22 has been changed by a user. [Figure 24] FIG. 24 is a diagram illustrating an example of the second cut-out instruction information according to the second embodiment. [Diagram 25] FIG. 25 is a flowchart showing an example of the flow of a process of correcting the first cut-out instruction information according to the second embodiment. [Figure 26] FIG. 26 is a diagram showing an example of a cut-out instruction image in which a plurality of specimens according to the second embodiment are depicted. [Figure 27] FIG. 27 is a diagram illustrating an example of an overall configuration of an information processing system according to the third embodiment. As shown in FIG. [Figure 28] FIG. 28 is a diagram showing an example of a sample image before the first cut-out instruction information according to the third embodiment is set. [Figure 29] FIG. 29 is a diagram showing an example of first cut-out instruction information newly added by a user according to the third embodiment. [Diagram 30] FIG. 30 is a diagram showing an example of a proposed setting image on which the second cut-out instruction information according to the third embodiment is displayed. [Diagram 31] FIG. 31 is a diagram illustrating an example of the second cut-out instruction information according to the third embodiment. [Diagram 32] FIG. 32 is a flowchart showing an example of the flow of a correction process for an extraction instruction image according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, embodiments of an information processing device, an information processing method, and a program will be described in detail with reference to the drawings.

[0009] (First embodiment) Fig. 1 is a diagram showing an example of the overall configuration of an information processing system S according to the first embodiment. As shown in Fig. 1, the information processing system S includes an information processing device 100 and a sample image storage device 200. The information processing system S is installed in, for example, a medical institution such as a hospital, a research institute such as a university, or a testing center.

[0010] The information processing device 100 and the sample image storage device 200 are, for example, a server device or a computer such as a PC (Personal Computer). The information processing device 100 and the sample image storage device 200 are communicatively connected via a network 300 such as an in-hospital LAN (Local Area Network).

[0011] The information processing system S may further include a tissue image storage device that stores digital images of tissue slices cut out from a specimen, an imaging device that captures specimen images or tissue images, a specimen management system, a hospital information system (HIS), a laboratory information system (LIS), and a radiology information system (RIS). Alternatively, the information processing system S may be a part of a hospital information system. The information processing system S may further include terminal devices such as other PCs and tablet terminals.

[0012] 1 illustrates an example in which the information processing device 100 and the sample image storage device 200 are configured by different computers, the information processing device 100 and the sample image storage device 200 may be configured by a single computer. In addition, some or all of the devices that configure the information processing system S may be provided in a cloud environment.

[0013] The specimen image storage device 200 is a device that stores specimen images. In this embodiment, an image of an entire tissue piece that is a pathological specimen (hereinafter simply referred to as a specimen) is referred to as a specimen image. The specimen image is, for example, a digital image of the specimen photographed by a digital camera. Note that the photographing device that photographs the specimen image is not limited to this. For example, the specimen image may be an image photographed by an OCT (Optical Coherence Tomography) device capable of photographing a three-dimensional tomographic image of the specimen, a MicroCT (Computed Tomography) device, a MicroMRI (Magnetic Resonance Imaging) device, an X-ray CT device, an MRI (Magnetic Resonance Imaging) device, or a three-dimensional scanner that acquires a surface point group of the specimen. Note that the specimen image does not have to be an image in the state in which it was photographed, and may be an image that has been processed to make an abnormal area easier to view.

[0014] In this embodiment, the specimen is a part of tissue collected from a patient's body, an animal, etc. For example, the specimen is a tissue fragment such as the mucosa and submucosa of the digestive tract excised by endoscopic mucosal resection (EMR) and endoscopic submucosal dissection (ESD), but is not limited thereto, and may be a tissue fragment excised by laparotomy or the like.

[0015] Such specimens are used to create slide specimens from tissue slices cut from the specimen. For example, a section cut from the specimen tissue slice is prepared as a slide by an engineer or the like, and then photographed at a higher magnification than the specimen image by a WSS (Whole Slide Scanner) or a digital microscope or the like. The photographed image of the slide specimen is called, for example, a tissue image. A WSS is a device that photographs a WSI (Whole Slide Imaging) image, which is a highly accurate digital image of the entire section or a part of the section placed on a glass slide. Note that the photographing method of the slide specimen is not limited to these.

[0016] An image for instructing a position to cut out a tissue slice from a specimen for creating a slide specimen is called a cut-out instruction diagram or cut-out instruction image. A cut-out instruction diagram or cut-out instruction image (hereinafter simply referred to as a cut-out instruction image) is an image on a specimen image in which a position to cut out a tissue slice from the specimen is described. The position to cut out the tissue slice from the specimen is represented by a plurality of cut-out instruction lines or cut-out instruction rectangles. Hereinafter, when there is no distinction between the cut-out instruction lines and the cut-out instruction rectangles, they are called cut-out instruction objects. In this embodiment, the cut-out instruction object and an identifier associated with the cut-out instruction object are called cut-out instruction information. In this embodiment, the cut-out instruction image includes a specimen image and cut-out instruction information related to at least one cut-out position indicating the cut-out position of the specimen on the specimen image. The cut-out instruction image is created, for example, so that a diagnostician instructs a technician or the like on the cut-out position of the tissue slice.

[0017] The information processing device 100 of this embodiment is used when a user such as a diagnostician creates an excision instruction image. In particular, in this embodiment, when the positional relationship between the sample image and the excision instruction information becomes inappropriate due to a change operation such as moving the excision instruction information by the user, the information processing device 100 supports the user by automatically correcting the excision instruction information.

[0018] First, a description will be given of the hardware configuration of the information processing device 100. The information processing device 100 includes, for example, a NW interface 110, a storage circuit 120, an input interface 130, a display 140, and a processing circuit 150.

[0019] The NW interface 110 is connected to the processing circuit 150, and controls the transmission and communication of various data between the information processing device 100 and the sample image storage device 200. The NW interface 110 is realized by a network card, a network adapter, a NIC (Network Interface Controller), or the like.

[0020] The memory circuitry 120 pre-stores various information used by the processing circuitry 150. The memory circuitry 120 also stores various programs. The memory circuitry 120 may also store the sample image acquired from the sample image storage device 200 and the cut-out instruction image.

[0021] The storage circuitry 120 also stores rules regarding the arrangement of cut-out instruction lines or cut-out instruction rectangles in the cut-out instruction image. In this embodiment, these rules are called cut-out instruction information setting rules. The cut-out instruction information setting rules will be described in detail later.

[0022] The input interface 130 is realized by a trackball, a switch button, a mouse, a keyboard, a touch pad that performs an input operation by touching an operation surface, a touch screen in which a display screen and a touch pad are integrated, a non-contact input circuit using an optical sensor, a voice input circuit, etc. The input interface 130 is connected to the processing circuit 150, and converts an input operation received from an operator into an electric signal and outputs it to the processing circuit 150. Note that in this specification, the input interface is not limited to an interface having physical operation parts such as a mouse and a keyboard. For example, an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the information processing device 100 and outputs the electric signal to the processing circuit 150 is also included as an example of the input interface 130.

[0023] The display 140 is a liquid crystal display, an organic electro-luminescence (OEL) display, etc. The input interface 130 and the display 140 may be integrated together. For example, the input interface 130 and the display 140 may be realized by a touch panel.

[0024] The processing circuit 150 is a processor that reads out programs from the storage circuit 120 and executes them to realize functions corresponding to the programs. The processing circuit 150 of this embodiment includes a sample image acquisition function 151, a reception function 152, a cut-out instruction information acquisition function 153, a sample region identification function 154, a correction information acquisition function 155, a cut-out instruction information generation function 156, and a display control function 157. The sample image acquisition function 151 is an example of a sample image acquisition unit. The reception function 152 is an example of a reception unit. The cut-out instruction information acquisition function 153 is an example of a cut-out instruction information acquisition unit. The sample region identification function 154 is an example of a sample region identification unit. The correction information acquisition function 155 is an example of a correction information acquisition unit. The cut-out instruction information generation function 156 is an example of a cut-out instruction information generation unit. The display control function 157 is an example of a display control unit and an output processing unit.

[0025] Here, for example, each processing function of the components of the processing circuit 150, namely, a sample image acquisition function 151, a reception function 152, a cut-out instruction information acquisition function 153, a sample region identification function 154, a correction information acquisition function 155, a cut-out instruction information generation function 156, and a display control function 157, is stored in the storage circuit 120 in the form of a program executable by a computer. The processing circuit 150 is a processor. For example, the processing circuit 150 realizes a function corresponding to each program by reading the program from the storage circuit 120 and executing it. In other words, the processing circuit 150 in a state in which each program has been read has each function shown in the processing circuit 150 of FIG. 1. 1, the processing functions performed by the sample image acquisition function 151, the reception function 152, the cut-out instruction information acquisition function 153, the sample area identification function 154, the correction information acquisition function 155, the cut-out instruction information generation function 156, and the display control function 157 are realized by a single processor, but a plurality of independent processors may be combined to configure the processing circuit 150, and each processor may execute a program to realize the function. Also, in FIG. 1, the single storage circuit 120 is described as storing a program corresponding to each processing function, but a plurality of storage circuits may be distributed and the processing circuit 150 may read out the corresponding program from each storage circuit.

[0026] In the above description, an example has been described in which the "processor" reads out and executes a program corresponding to each function from a storage circuit, but the embodiment is not limited to this. The term "processor" refers to a circuit such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). When the processor is, for example, a CPU, the processor realizes a function by reading out and executing a program stored in a storage circuit. On the other hand, when the processor is an ASIC, instead of storing a program in the storage circuit 120, the function is directly incorporated as a logic circuit in the circuit of the processor. Note that each processor in this embodiment is not limited to being configured as a single circuit for each processor, and may be configured as one processor by combining multiple independent circuits to realize the function. Furthermore, the multiple components in FIG. 1 may be integrated into one processor to realize the function.

[0027] Next, each function of the information processing device 100 will be described.

[0028] The sample image acquisition function 151 acquires a sample image from the sample image storage device 200. The sample image to be acquired is specified, for example, by a user operation accepted by a later-described acceptance function 152. The user of the information processing device 100 is, for example, a pathologist. The sample image may be stored in advance in the memory circuitry 120 and read out by a user operation.

[0029] Fig. 2 is a diagram showing an example of a specimen image 50 according to the first embodiment. As shown in Fig. 2, a specimen 51 is depicted in the specimen image 50. In the example shown in Fig. 2, the specimen 51 is a tissue slice cut out from a patient so as to include an abnormal region 510 such as a tumor. For example, in order to create a slide specimen on which a cross section of the abnormal region 510 can be observed, a user creates an excision instruction image in which an excision position of the specimen 51 is set in the specimen image 50.

[0030] Returning to FIG. 1, the reception function 152 receives various operations by the user via the input interface 130. For example, the reception function 152 receives a user operation to select a sample image 50 acquired from the sample image storage device 200. The reception function 152 also receives a user operation to change cut-out instruction information indicating a position to cut out the sample 51 in the sample image 50. The reception function 152 may also receive a user operation to newly set cut-out instruction information indicating a position to cut out the sample 51 in the sample image 50. The cut-out instruction information may not only be set by the user, but may also be automatically set based on a cut-out position rule. Alternatively, the reception function 152 may receive a user operation to select a cut-out instruction image already generated from the memory circuitry 120.

[0031] In this embodiment, the cut-out instruction information is represented by a cut-out instruction object such as a cut-out instruction line or a rectangle. In this embodiment, the cut-out instruction information before correction set in the cut-out instruction image is called "first cut-out instruction information", and the cut-out instruction information corrected by the cut-out instruction information generating function 156 described later is called "second cut-out instruction information". Generally, a plurality of cut-out instruction information is set for one specimen 51, so the plurality of cut-out instruction information may be collectively referred to as a cut-out instruction information group. Note that a plurality of cut-out instruction information is not necessarily set for one specimen 51. Hereinafter, the term "first cut-out instruction information group" includes one or more first cut-out instruction information. The term "second cut-out instruction information group" includes one or more second cut-out instruction information.

[0032] FIG. 3 is a diagram showing an example of a cut-out instruction image 7 according to the first embodiment. The cut-out instruction image 7 is an image in which a first cut-out instruction information group 6 is superimposed on a specimen image 50 in which a specimen 51 is photographed. In this embodiment, the first cut-out instruction information group 6 may be automatically set according to a predetermined cut-out instruction information setting rule, or may be set in advance by a user. When the first cut-out instruction information group 6 is automatically set, the first cut-out instruction information group 6 may be set by, for example, a cut-out instruction information generating function 156 described later, or may be set by a device other than the information processing device 100.

[0033] 3, the first excision instruction information group 6 includes first excision instruction information 601 to 605. The first excision instruction information 601 to 605 includes excision instruction lines and identifiers indicating excision positions for slicing the specimen 51.

[0034] In the example shown in FIG. 3, the cut-out instruction lines of the first cut-out instruction information 601-605 are dashed straight lines, but the display mode of the first cut-out instruction information 601-605 is not limited to this. For example, the first cut-out instruction information 601-605 and the second cut-out instruction information described later (hereinafter, when the first cut-out instruction information 601-605 and the second cut-out instruction information are not distinguished from each other, they are simply referred to as cut-out instruction information) may be represented by a curve, a broken line, or a rectangle indicating a cut-out range. Furthermore, the cut-out instruction information may be displayed in either a dashed line or a solid line. As shown in FIG. 3, in this embodiment, the first cut-out instruction information 601-605 in a state where no change operation is performed by the user is represented by a dashed line. Note that the first cut-out instruction information 601-605 may be set at equal intervals. Furthermore, the first cut-out instruction information 601-605 may be set to have the same length and the same angle. Also, for example, when the first cut-out instruction information 601 is set, the other first cut-out instruction information 602 to 605 may be automatically set.

[0035] Fig. 4 is a diagram showing an example of a display mode of the first cut-out instruction information group 6 in a state in which the first cut-out instruction information group 6 has been selected by the user as a change target according to the first embodiment. As shown in Fig. 4, in this embodiment, the first cut-out instruction information 601 to 605 selected by the user as a change target is represented by a solid line.

[0036] The identifier is a number or a letter for identifying the cut-out position indicated by each cut-out instruction information. When the tissue slice cut out from the specimen 51 is made into a slide specimen, the identifier is used to associate each tissue slice with the cut-out position of the specimen 51 from which it was cut out. The identifier is displayed, for example, near the cut-out instruction object on the cut-out instruction image 7. In the example shown in FIG. 3, consecutive numbers 1 to 5 are associated as identifiers with the first cut-out instruction information 601 to 605, respectively. In general, consecutive numbers, alphabets, combinations of numbers and alphabets, etc. are used as identifiers. The order of allocation of identifiers to each cut-out instruction information is predetermined, for example, by cut-out instruction information setting rules.

[0037] The cut-out instruction information is also called an annotation. Note that the cut-out instruction information does not necessarily include an identifier, and does not necessarily have to include an identifier.

[0038] Furthermore, the reception function 152 receives a selection operation and a change operation by the user for the first cut-out instruction information group 6. In this embodiment, an operation of individually changing the first cut-out instruction information 601-605 included in the first cut-out instruction information group 6 is not permitted, but a change operation is possible in units of the first cut-out instruction information group 6. Therefore, when the user wishes to change the first cut-out instruction information group 6, the user selects all of the first cut-out instruction information 601-605 included in the first cut-out instruction information group 6 as targets and performs a change operation.

[0039] The change operation of the first cut-out instruction information group 6 is an operation including any of movement, transformation, division, addition, and deletion. In particular, in this embodiment, the change operation of the first cut-out instruction information group 6 is an operation involving any of transformation or movement. Moreover, the movement of the first cut-out instruction information group 6 is, for example, the rotation or translation of the cut-out instruction line or the cut-out instruction rectangle included in the first cut-out instruction information group 6. In this embodiment, the reception function 152 receives a user's operation to move all of the first cut-out instruction information 601-605 collectively, rather than the individual movement of the first cut-out instruction information 601-605 set in one cut-out instruction image 7. Moreover, the transformation of the first cut-out instruction information group 6 includes enlargement, reduction, extension, and shortening.

[0040] Fig. 5 is a diagram showing an example of a state in which the first cut-out instruction information group 6 in Fig. 4 has been changed by a user. In the example shown in Fig. 5, the cut-out instruction line included in the first cut-out instruction information group 6 has been rotated to the right from the state shown in Fig. 4 by a change operation by the user.

[0041] 1, the cut-out instruction information acquisition function 153 acquires first cut-out instruction information indicating one or more cut-out positions of the sample in the sample image 50 obtained by capturing the sample. More specifically, the cut-out instruction information acquisition function 153 acquires first cut-out instruction information 601-605 included in the first cut-out instruction information group 6 from the cut-out instruction image 7.

[0042] In this embodiment, when the first cut-out instruction information 601-605 of the cut-out instruction image 7 is changed by the user, the cut-out instruction information acquisition function 153 acquires the changed first cut-out instruction information 601a-605a. In this embodiment, the user performs a change operation on the entire first cut-out instruction information group 6, so the cut-out instruction information acquisition function 153 acquires, from the cut-out instruction image 7, information specifying the positions and sizes of the cut-out instruction objects included in all of the first cut-out instruction information 601a-605a included in the first cut-out instruction information group 6 changed by the user and the identifiers added to each cut-out instruction object.

[0043] The method of acquiring the first cut-out instruction information 601a-605a by the cut-out instruction information acquisition function 153 is, for example, to read data on the position and size of the first cut-out instruction information 601a-605a associated with the cut-out instruction image 7. Note that the method of acquiring the first cut-out instruction information 601a-605a by the cut-out instruction information acquisition function 153 is not limited to this.

[0044] The specimen area identifying function 154 identifies a specimen area in which at least one specimen 51 is depicted from the specimen image 50 included in the cut-out instruction image 7. In this embodiment, the specimen area is an image area in which the entire specimen 51 is depicted on the specimen image 50. Taking the specimen image 50 shown in FIG. 2 as an example, the specimen area identifying function 154 identifies an area surrounded by the contour line of the entire specimen 51 on the specimen image 50 as the specimen area. In the example shown in FIG. 2, one specimen 51 is depicted in the specimen image 50, but there are also cases in which multiple specimens 51 are depicted in one specimen image 50. The specimen area identifying function 154 identifies at least one specimen area from the specimen image 50 included in the cut-out instruction image 7.

[0045] The specimen region identifying function 154 identifies the specimen region by, for example, rule-based image processing or image segmentation processing using machine learning. Note that the method of identifying the specimen region by the specimen region identifying function 154 is not limited to this.

[0046] 1, the correction information acquisition function 155 acquires correction information that defines a process for correcting the first excision instruction information 601-605, based on the first excision instruction information 601-605 acquired by the excision instruction information acquisition function 153 and the specimen area identified by the specimen area identification function 154. Acquiring correction information includes both generating new correction information and acquiring pre-existing setting information.

[0047] In this embodiment, the correction information acquisition function 155 determines whether the first cut-out instruction information 601-605 is located on the specimen region based on the positional relationship between the first cut-out instruction information group 6 and the specimen region. Then, the correction information acquisition function 155 determines whether the first cut-out instruction information 601-605 is in a state requiring correction, and if so, generates correction information that defines a process for correcting the first cut-out instruction information 601-605.

[0048] The correction information is information that defines a process for correcting the first cut-out instruction information 601-605 that has become inappropriate due to a user operation. The process for correcting the first cut-out instruction information 601-605 is, for example, deformation, movement, division, addition, deletion of cut-out instruction objects included in the first cut-out instruction information 601-605, and reassignment of identifiers included in the first cut-out instruction information 601-605.

[0049] In this embodiment, the correction information includes at least information on any one of deformation, movement, division, addition, and deletion of the cut-out instruction object included in the first cut-out instruction information 601 to 605. The correction information in this embodiment also includes information on assignment of an identifier to the cut-out position of the second cut-out instruction information described below. The specific format of the correction information is not particularly limited, but may be, for example, information that defines the position and size of the cut-out instruction object on the sample image 50 after correction, and an identifier associated with each cut-out instruction object.

[0050] For example, when the user operates the first cut-out instruction information 601-605, some of the cut-out instruction objects included in the first cut-out instruction information 601-605 may be positioned outside the sample region, and may be displaced from the appropriate cut-out position. Furthermore, when the user moves the first cut-out instruction information 601-605, the position of the cut-out instruction objects may change, causing a discrepancy with the numbering rule for the identifier. In this embodiment, when the first cut-out instruction information 601-605 becomes inappropriate, it means that the first cut-out instruction information 601-605 becomes in a state that deviates from the cut-out instruction information setting rule.

[0051] The excision instruction information setting rules are rules that stipulate excision instruction information for excising a tissue piece for a slide specimen from the specimen 51. The excision instruction information setting rules may be stored in the storage circuitry 120 in the form of a database or the like, or may be defined as the contents of processing of a program or the like. In addition, since the excision instruction information setting rules may differ depending on the facility or the like that uses the information processing device 100, the user may be able to change, add, modify, and delete the excision instruction information setting rules. Such operations are accepted by, for example, the reception function 152.

[0052] As specific examples of the cut-out instruction information setting rules, the present embodiment provides the following rules (1) to (9): "(1) The length of the cut-out instruction line that extends beyond the specimen region shall be equal to or less than a first specified length and equal to or greater than a second specified length (0 mm≦second specified length<first specified length)", "(2) The length of the cut-out instruction line on the specimen region shall be equal to or greater than a third specified length", "(3) The size of the portion of the cut-out instruction rectangle that extends beyond the specimen region shall be equal to or greater than a first specified size and equal to or less than a second specified size", "(4) The size of the cut-out instruction rectangle shall be equal to or greater than a third specified size and less than a fourth specified size", and "(5) No cut-out instruction object shall be set outside the specimen region (if the number of cut-out instruction objects is small, (6) The jurisdiction of the cut-out instruction object does not overlap with the jurisdiction of other cut-out instruction objects; (7) The excess area, which is the area of ​​the sample area that does not belong to the jurisdiction of any cut-out instruction object, shall be less than the size specified in Article 5; (8) If one cut-out instruction object is set to multiple sample areas, it shall be divided into individual sample areas; (9) The identifier shall be assigned to a cut-out instruction object whose center of gravity is closest to the top right coordinate of the image, either a smaller number or a letter that is earlier in alphabetical order.

[0053] The above-mentioned cut-out instruction information setting rule is an example, and cut-out instruction information setting rules other than the above may be adopted. In addition, depending on the operation rules of the facility or the like in which the information processing device 100 is used, the above-mentioned cut-out instruction information setting rule may not be used.

[0054] Note that the specific values ​​of the first to third prescribed lengths and the first to fifth prescribed sizes are not particularly limited and may be determined by the operational rules of the facility or the like in which the information processing device 100 is used. The first to fourth prescribed sizes of the cut-out rectangle are determined, for example, by the length of each side of the cut-out rectangle. The fifth prescribed size of the marginal area may be defined by any of the area, width, or vertical and horizontal dimensions of the marginal area. The fifth prescribed size may differ depending on the type of cut-out instruction object and the type of specimen 51.

[0055] The length of the cut-out instruction line and the size of the cut-out rectangle may be specified by actual size or by the number of pixels on the sample image 50. If the reference value set in the cut-out instruction information setting rule is an actual size, the correction information acquisition function 155 converts the size of the cut-out object on the sample image 50 into an actual size and compares it with the reference value set in the cut-out instruction information setting rule. In order to specify the actual length per pixel of the sample image 50, the correction information acquisition function 155 may perform image analysis on an object that serves as a reference for the length, such as a grid drawn in the background of the sample 51 or a ruler photographed together with the sample 51. Alternatively, the correction information acquisition function 155 may specify the actual length per pixel of the sample image 50 from information incorporated in the sample image 50, such as EXIF ​​(Exchangeable Image File Format). The user may also input the actual length per pixel of the sample image 50.

[0056] The above rule (1) specifies that the cutting-out indication line must not extend too far beyond the specimen region, but must extend a certain length. If the "first specified length = second specified length = 0 mm", the rule (1) specifies that the cutting-out indication line must stop at a position where it touches the outline of the specimen region, and must not extend beyond the specimen region. If the "second specified length = 0 mm < first specified length", the rule (1) allows both the cutting-out indication line to stop at a position where it touches the outline of the specimen region, and to extend beyond the specimen region by a length equal to or less than the first specified length.

[0057] Furthermore, the third prescribed size that prescribes the minimum size of the cut-out rectangle in the above rule (4) may be set to the minimum size that allows the cut section to be fixed in formalin.

[0058] In addition, the processing contents for eliminating the violation of the cut-out instruction information setting rules may be associated with each rule. For example, when the first cut-out instruction information 601-605 operated by the user violates the above rule (1), the processing contents for eliminating the violation, "among the cut-out instruction lines included in the first cut-out instruction information 601-605, which extend beyond the specimen region by more than a first specified length, are shortened so that the length of the portion extending beyond the specimen region does not exceed the first specified length," may be stored in the memory circuitry 120 in association with the rule (1). Alternatively, the processing contents for eliminating the violation may be defined in association with each rule in a program for realizing the correction information acquisition function 155.

[0059] The process for eliminating the violation of the rule (2) is to "delete the cut-out instruction line whose length on the specimen region is less than the third specified length." This is because even if a cut-out instruction line is set that is too short, it may be difficult for a technician to cut out the specimen 51 along the cut-out line, or even if the specimen 51 can be cut out along the cut-out line, the size of the cut-out slice may not be suitable for creating a slide specimen. In addition, the rule (2) is also violated when the cut-out instruction object is located outside the specimen region as a result of the first cut-out instruction information 601-605 being moved by the user.

[0060] Even if the length of the cut-out indication line is short, if the length of the cut-out indication line on the specimen area is equal to or greater than the third prescribed length, the cut-out indication line is not deleted due to a violation of rule (2) but is extended to an appropriate length, for example, due to a violation of rule (1). Note that if there is room to extend the cut-out indication line on the specimen area, that is, if the cut-out indication line is extended until it touches the outline of the specimen area, the length of the cut-out indication line on the specimen area can be made equal to or greater than the third prescribed length, the means for resolving the violation of rule (2) may be extension rather than deletion.

[0061] Here, an example of application of the above-mentioned cut-out instruction information setting rule will be described using the first cut-out instruction information 601a to 605a moved by the user shown in Fig. 5 as an example. First, the cut-out instruction line of the first cut-out instruction information 605 is entirely located outside the specimen region, so it violates the above-mentioned rule (2). In this case, the correction information acquisition function 155 generates correction information that defines a process for deleting the first cut-out instruction information 605a.

[0062] Furthermore, the length or size of the portion of the cut-out instruction object that protrudes from the specimen region is not calculated for each cut-out instruction object, but the cut-out instruction information setting rule is applied to each protruding portion. For example, when the cut-out instruction line protrudes from both the left and right sides of the specimen region, the correction information acquisition function 155 determines whether the length from the right end of the cut-out instruction line to the outline of the specimen region and the length from the left end of the cut-out instruction line to the outline of the specimen region each conform to the above rules, and generates correction information that defines the correction process if any of them violate the rules.

[0063] 5, the length of the portion of each of the first cut-out instruction information 601a-604a that protrudes to the left of the specimen region is less than the second specified length. Therefore, the first cut-out instruction information 601a-604a violates the above rule (1). In this case, the correction information acquisition function 155 generates correction information that defines a process for shortening the portion of each of the first cut-out instruction information 601a-604a that protrudes to the left of the specimen region to the first specified length.

[0064] 5, the cut-out instruction lines of the first cut-out instruction information 601a-604a do not reach the contour line on the right side of the specimen region. This also causes the first cut-out instruction information 601a-604a to violate the above rule (1). In this case, the correction information acquisition function 155 generates correction information that defines a process of extending each cut-out instruction line of the first cut-out instruction information 601a-604a so that it extends to the right side of the specimen region by a second specified length. Furthermore, when the "second specified length=0 mm", the correction information acquisition function 155 generates correction information that defines a process of extending each cut-out instruction line of the first cut-out instruction information 601a-604a until it contacts the contour line of the specimen region.

[0065] Moreover, the correction information acquisition function 155 identifies the jurisdiction area of ​​each of all the first cut-out instruction information 601a to 605a included in the cut-out instruction image 7.

[0066] The coverage area of ​​the excision instruction information is the range that can be observed by a section cut out from the specimen 51 at the excision position specified by the excision instruction information when the section is made into a slide preparation.

[0067] The scope of the jurisdiction is determined by the type of the cut-out instruction object and the type of specimen 51. For example, when the cut-out instruction object is a cut-out instruction line, the cross section of the slice cut out by the cut-out instruction line generally becomes the observation surface of the slide specimen. In this case, tissue that is too far from the cross section cannot be observed from the surface of the slide specimen.

[0068] In addition, if the cut-out instruction object is a cut-out instruction rectangle, the inner area enclosed by the cut-out instruction rectangle becomes the area covered by the cut-out instruction rectangle. In this case, the area of ​​the specimen area that is not enclosed by any cut-out instruction rectangle remains without being cut out, and is therefore not subject to slide preparation.

[0069] The type of specimen 51 is, for example, the type of resection by which specimen 51 was excised and the type of organ from which specimen 51 was excised. For example, in the standard of pathological diagnosis in Japan, it is recommended that ESD specimens (tissue pieces such as mucosa and submucosa of digestive organs excised by ESD) be excised at 2 mm intervals. For this reason, if specimen 51 is an ESD specimen and the excision instruction object is an excision instruction line, a range of 2 mm width on both sides of the excision instruction line becomes the jurisdiction area. Note that the above-mentioned specific reference value is an example, and the range of the jurisdiction area is not limited to this. In addition, the correction information acquisition function 155 may acquire the type of specimen 51 from the LIS or the like, or may identify the type of specimen 51 by performing image analysis on the specimen image 50.

[0070] Any excess area of ​​the specimen area that does not belong to any of the areas covered by the cut-out instruction information is not observed in the slide specimen. The above rule (7) is a rule for restricting such excess areas from becoming too large.

[0071] In the example shown in FIG. 5, the first cut-out instruction information 601a-605a is moved upward by the user, so that a spare area that does not belong to the jurisdiction area of ​​any of the first cut-out instruction information 601a-605a exists below the first cut-out instruction information 601a. ​​The size of the spare area is set to be equal to or larger than the fifth specified size. In this case, the first cut-out instruction information 601a-604a violates the above rule (7). The correction information acquisition function 155 generates correction information that adds cut-out instruction information to a position where the spare area becomes equal to or smaller than the fifth specified size, thereby eliminating the violation of the above rule (7). The addition of cut-out instruction information will be described in detail later.

[0072] Furthermore, the modification information acquisition function 155 defines, in the modification information, the reassignment of identifiers in accordance with the above rule (9) for the first cut-out instruction information 601a-604a changed by the user and the cut-out instruction information to be added. Since the first cut-out instruction information 605a is deleted due to a violation of the above rule (2), it is excluded from the targets for identifier reassignment. Note that, regarding the reassignment of identifiers, the modification information acquisition function 155 overwrites the first cut-out instruction information 601a-605a changed by the user, regardless of whether or not there is a violation of the cut-out instruction information setting rule.

[0073] Here, the details of how to deal with the case where the margin area is too large and violates the above rule (7) will be described with reference to Fig. 6 and Fig. 7. Fig. 6 is a diagram showing an example of a margin area 80 according to the first embodiment. Fig. 7 is a diagram showing an example of second cut-out instruction information 910 added to eliminate the margin area 80 shown in Fig. 6.

[0074] In the example shown in Fig. 6, a marginal area 80 exists below an excision instruction line included in the first excision instruction information 601. When a slice is excised from the specimen 51 and prepared as a slide based on the first excision instruction information 601-604 shown in Fig. 6, the tissue included in the marginal area 80 is too far from the cross section of the slice to be observed on the slide.

[0075] The margin area 80 is equal to or larger than the fifth prescribed size, and violates the above rule (7). In this case, as shown in Fig. 7, the correction information acquisition function 155 generates correction information for adding a new cut-out instruction line as second cut-out instruction information 910 below the first cut-out instruction information 601. Specifically, the correction information acquisition function 155 generates correction information for adding, for example, a cut-out instruction line of the same type as the cut-out instruction line of the first cut-out instruction information 601 located closest to the margin area 80, in parallel with the cut-out instruction line located closest to the margin area 80.

[0076] The correction information acquisition function 155 also determines whether the cut-out instruction object added to eliminate the extra area 80 complies with the cut-out instruction information setting rules. If the added cut-out instruction object violates the cut-out instruction information setting rules, the correction information acquisition function 155 changes the correction information so as to eliminate the violation. If it is not possible to add a cut-out instruction object that does not violate the cut-out instruction information setting rules, the correction information acquisition function 155 cancels the elimination of the extra area 80. In this case, it is considered that the state in which the first cut-out instruction information 601 to 605 violates the above rule (7) may be maintained.

[0077] For example, if the length of the added cut-out instruction line on the specimen region is less than the third specified length, the added cut-out instruction line violates the above rule (2). In addition, since the added cut-out instruction object also has a jurisdiction area, if the jurisdiction area of ​​the added cut-out instruction object overlaps with the jurisdiction area of ​​another cut-out instruction object, the added cut-out instruction line violates the above rule (6). If there is no way to resolve such a violation, the correction information acquisition function 155 cancels the addition of the cut-out instruction object.

[0078] Although the second cut-out instruction information 910 is illustrated in Figure 7 for the purpose of explanation, in this embodiment, the correction information acquisition function 155 does not directly generate image data of the cut-out instruction image 7 in which the second cut-out instruction information 910 is added to the sample image 50, but generates information defining the second cut-out instruction information 910 as correction information.

[0079] Moreover, examples of the correction information of the first cut-out instruction information 601 to 605 generated by the correction information acquisition function 155 will be further described with reference to FIGS.

[0080] Fig. 8 is a diagram showing an example of jurisdiction areas 61, 62 of first cut-out instruction information 611, 612 according to the first embodiment. Fig. 9 is a diagram showing an example of a state in which second cut-out instruction information 911, 912 is added to the spare areas 81, 82 in Fig. 8.

[0081] The first cut-out instruction information 611, 612 shown in Fig. 8 is in a state after being changed by a user. The specimen 51 depicted in the specimen image 50 included in the cut-out instruction image 7 shown in Fig. 8 is an ESD specimen. Since it is recommended to cut out the ESD specimen at intervals of 2 mm as described above, the inner areas of the rectangles with a width of 4 mm centered on each cut-out instruction line of the first cut-out instruction information 611, 612 are the areas of responsibility 61, 62 of the first cut-out instruction information 611, 612.

[0082] In the example shown in Fig. 8, marginal areas 81 and 82 exist between jurisdiction area 61 and jurisdiction area 62. When marginal areas 81 and 82 are each equal to or larger than the fifth specified size, modification information acquisition function 155 generates modification information defining the addition of new second cut-out instruction information 911 and 912 parallel to the cut-out instruction lines of first cut-out instruction information 611 and 612 to marginal areas 81 and 82, as shown in Fig. 9. Note that the jurisdictional areas of the second cut-out instruction information 911 and 912 do not overlap with the jurisdictional areas of the originally existing first cut-out instruction information 611 and 612.

[0083] Fig. 10 is a diagram showing an example of a cut-out instruction image 7 including a cut-out instruction rectangle according to the first embodiment. The first cut-out instruction information 651 shown in Fig. 10 is assumed to be in a state after being changed by a user. Fig. 10 shows an example of a jurisdiction area 63 of the first cut-out instruction information 651 including a cut-out instruction rectangle and an identifier.

[0084] If the cut-out rectangle set in the sample image 50 does not satisfy the above rules (3) and (4), the correction information acquisition function 155 generates correction information to move, rotate, or enlarge the cut-out rectangle so that the cut-out rectangle satisfies the above rules (3) and (4). In addition, since the upper limit of the size of the cut-out rectangle is set in the above rule (4), if the margin area 83 becomes too large with only one cut-out rectangle, the correction information acquisition function 155 generates correction information that defines the addition of cut-out instruction information including a new cut-out rectangle.

[0085] FIG. 11 is a diagram showing an example of a state in which the second cut-out instruction information 951-956 is added to the marginal area 83 in FIG. 10. The positions of the cut-out instruction rectangles of the second cut-out instruction information 951-956 are set at positions that do not overlap with the jurisdiction area of ​​the first cut-out instruction information 651 that has been set in advance and the jurisdiction areas of the newly added second cut-out instruction information 951-956. In addition, the correction information acquisition function 155 may set the size of the cut-out instruction rectangles of the second cut-out instruction information 951-956 to a predetermined specified size, for example, a third specified size, or may set the size to the same size as the size of the cut-out rectangle of the first cut-out instruction information 651 after it has been changed by the user. As shown in FIG. 11, the cut-out instruction rectangle may extend beyond the sample image 50.

[0086] 12 is a diagram showing an example of a state in which the jurisdiction areas of a plurality of first cut-out instruction information 652-655 according to the first embodiment overlap. In such a case, the correction information acquisition function 155 generates correction information for deleting cut-out instruction rectangles included in the first cut-out instruction information 652-655 that do not have a unique jurisdiction area on the specimen region. In the example shown in FIG. 12, all specimen regions included in the cut-out rectangle of the first cut-out instruction information 654 are included in the other first cut-out instruction information 652, 653, and 655. Therefore, the correction information acquisition function 155 generates correction information that defines the deletion of the first cut-out instruction information 654.

[0087] A case where multiple specimen regions exist in one cut-out instruction image 7 will be described with reference to Figs. 13 and 14. Fig. 13 is a diagram showing an example of a cut-out instruction image 7 depicting multiple specimens 52, 53 according to the first embodiment. In the example shown in Fig. 13, the first cut-out instruction information group 6a includes only one first cut-out instruction information 613. Note that when there is only one first cut-out instruction information 613, an identifier may not be required.

[0088] When a plurality of specimen regions exist in one cut-out instruction image 7, the correction information acquisition function 155 judges whether or not the first cut-out instruction information 613 is located on the specimen region based on the positional relationship between the first cut-out instruction information group 6a and each specimen region of the specimens 52, 53. Then, the correction information acquisition function 155 identifies the first cut-out instruction information 613 associated with each specimen region. In FIG. 13, the cut-out line of one first cut-out instruction information 613 is set in common to both of the two specimen regions. In such a case, it is regarded as a violation of the above rule (8), and the correction information acquisition function 155 generates correction information for dividing the cut-out line of the first cut-out instruction information 613 for each specimen region.

[0089] Fig. 14 is a diagram showing an example of a state in which the cut-out line of the first cut-out instruction information 613 in Fig. 13 is divided for each specimen region. As shown in second cut-out instruction information 913, 914 in Fig. 14, the cut-out line is divided for each specimen region, so that there is a one-to-one correspondence between the cross section from which the slice is cut out and the cut-out instruction information.

[0090] Next, returning to FIG. 1, the cut-out instruction information generating function 156 generates second cut-out instruction information different from the first cut-out instruction information 601-605, 611, 612, 613 by reflecting the correction information generated by the cut-out instruction information generating function 156 in the first cut-out instruction information 601-605, 611, 612, 613.

[0091] FIG. 15 is a diagram showing an example of second cut-out instruction information 901-905 according to the first embodiment. In this embodiment, the cut-out instruction information generating function 156 generates the second cut-out instruction information 901-905 to which an identifier is assigned by reflecting the modification information on the first cut-out instruction information 601-605. The second cut-out instruction information group 9 shown in FIG. 15 includes the second cut-out instruction information 901-905. The second cut-out instruction information group 9 in FIG. 15 is the first cut-out instruction information group 6 shown in FIG. 4 and modified by the user by the cut-out instruction information generating function 156 and the cut-out instruction information generating function 156. Note that in this embodiment, the cut-out instruction information generating function 156 stores in the storage circuitry 120 the cut-out instruction image 7 in which the first cut-out instruction information group 6 is replaced with the second cut-out instruction information group 9, for example.

[0092] Furthermore, in addition to the above functions, the cut-out instruction information generating function 156 may have a function of automatically generating the first cut-out instruction information 601-605, 611, 612, 613. When the cut-out instruction information generating function 156 has this function, the cut-out instruction information generating function 156 sets the first cut-out instruction information 601-605, 611, 612, 613 based on the cut-out instruction information setting rules (1)-(9) in the sample image 50 acquired from the sample image storage device 200 by the sample image acquisition function 151. The function of generating the first cut-out instruction information 601-605, 611, 612, 613 may be divided into a first cut-out instruction information generating function, and the function of generating the second cut-out instruction information 901-905 may be divided into a second cut-out instruction information generating function.

[0093] 1, the display control function 157 causes various screens to be displayed on the display 140. For example, the display control function 157 causes the display 140 to display a GUI (Graphical User Interface) that allows the user to operate the first cut-out instruction information 601-605, 611, 612, and 613.

[0094] Next, a flow of the process of correcting the first cut-out instruction information 601 to 605, 611, 612, and 613 executed by the information processing apparatus 100 of this embodiment configured as above will be described.

[0095] 16 is a flowchart showing an example of the flow of a process for correcting the first cut-out instruction information 601-605, 611, 612, 613 according to the first embodiment. This flowchart is based on the premise that a cut-out instruction image 7 has already been generated in which the first cut-out instruction information group 6 is set for the sample image 50. In addition, the cut-out instruction image 7 is displayed on a GUI that can be operated by the user.

[0096] First, the reception function 152 receives a user's operation to change the first cut-out instruction information group 6 (S11). In this embodiment, the reception function 152 receives the change operation not for each of the first cut-out instruction information 601 to 605, 611, 612, and 613, but for each of the first cut-out instruction information groups 6.

[0097] Next, the cut-out instruction information acquisition function 153 acquires the first cut-out instruction information group 6 from the cut-out instruction image 7 (S12).

[0098] Then, the specimen area specifying function 154 specifies a specimen area in which the specimen 51 is depicted from the specimen image 50 included in the cut-out instruction image 7 (S13).

[0099] Then, the correction information acquisition function 155 generates correction information based on the first cut-out instruction information 601a-605a acquired by the cut-out instruction information acquisition function 153 and the specimen region identified by the specimen region identification function 154. This process is called a correction information generation process (S14). The contents of the correction information generation process will be described with reference to FIG. 17.

[0100] Next, the cut-out instruction information generating function 156 generates a second cut-out instruction information group 9 based on the correction information by reflecting the correction information in the first cut-out instruction information group 6 (S15).

[0101] Then, the cut-out instruction information generating function 156 replaces the first cut-out instruction information group 6 changed by the user with the generated second cut-out instruction information group 9 (S16). Here, the process of this flowchart ends.

[0102] The content of the correction information generation process in S14 differs depending on the type of the cut-out instruction object. Fig. 17 is a flowchart showing an example of the flow of the correction information generation process according to the first embodiment. The process shown in Fig. 17 is executed when the cut-out instruction object in the first cut-out instruction information group 6 is a cut-out instruction line.

[0103] First, the correction information acquisition function 155 determines whether or not there is an excision instruction line located outside the specimen region that violates the excision instruction information setting rule (5) (S101). If there is no excision instruction line located outside the specimen region (S101 "No"), proceed to the process of S103.

[0104] If there is an excision instruction line located outside the specimen region (S101 "Yes"), the correction information acquisition function 155 creates deletion operation information for the excision instruction line located outside the specimen region (S102).

[0105] Then, the correction information acquisition function 155 determines whether or not there is an excision instruction line that protrudes beyond the first specified length from the specimen region (S103). If there is no excision instruction line that protrudes beyond the first specified length from the specimen region (S103 "No"), proceed to S105.

[0106] If there is an excision instruction line that extends beyond the first specified length from the sample area (S103 "Yes"), the correction information acquisition function 155 creates operation information to shorten the relevant excision instruction line in order to resolve the violation of the excision instruction information setting rule (1) (S104).

[0107] Next, the correction information acquisition function 155 judges whether or not the first cut-out instruction information group 6 changed by the user has any cut-out instruction line that invades the jurisdiction area of ​​a cut-out instruction line in a non-selected state (S105). The non-selected cut-out instruction line is a cut-out instruction line included in the cut-out instruction information other than the first cut-out instruction information 601a-605a changed by the user. For example, when a single cut-out instruction image 7 includes a plurality of first cut-out instruction information 601a-605a, the user may manually move any one of the first cut-out instruction information 601-605, and the moved first cut-out instruction information 601a-605a may invade the jurisdiction area of ​​the other first cut-out instruction information. In such a state, the jurisdiction areas of the cut-out instruction lines overlap with each other, violating the cut-out instruction information setting rule (6). In this embodiment, since the user selects all of the first cut-out instruction information 601 to 605 included in the first cut-out instruction information group 6 collectively, no unselected cut-out instruction lines are generated, and therefore this process may be omitted.

[0108] If there is no cut-out instruction line encroaching into the jurisdiction area of ​​any unselected cut-out instruction line (S105 "No"), the process proceeds to S106.

[0109] If there is an excision instruction line that encroaches on the jurisdiction area of ​​a non-selected excision instruction line (S105 “Yes”), the correction information acquisition function 155 creates operation information to split or shorten the relevant excision instruction line in order to resolve the violation of the excision instruction information setting rule (6) (S106).

[0110] Next, the correction information acquisition function 155 determines whether there is an excision instruction line whose length protruding from the specimen region is less than the first specified length (S107). If there is no excision instruction line whose length protruding from the specimen region is less than the first specified length (S107 "No"), proceed to the process of S109.

[0111] If there is an excision instruction line whose length extending beyond the sample area is less than the first specified length (S107 "Yes"), the correction information acquisition function 155 creates operation information to extend the relevant excision instruction line in order to resolve the violation of the excision instruction information setting rule (1) (S108).

[0112] Furthermore, the correction information acquisition function 155 determines whether or not there is a marginal area 80 on the specimen area that is equal to or larger than a fifth specified size (S109). If there is a marginal area 80 on the specimen area that is equal to or larger than a fifth specified size, the correction information acquisition function 155 generates operation information for adding an excision instruction line to the marginal area 80 in order to resolve the violation of the excision instruction information setting rule (7) (S110). If the marginal area 80 is smaller than the fifth specified size, the loop process of S108 to S110 ends (S111).

[0113] Then, the correction information acquisition function 155 determines whether or not there is an excision instruction line on the specimen region whose length is less than the third specified length (S112). If there is no excision instruction line on the specimen region whose length is less than the third specified length (S112 "No"), proceed to the process of S114.

[0114] If there is an excision instruction line on the sample area whose length is less than the third specified length (S112 "Yes"), in order to resolve the violation of the excision instruction information setting rule (2), the correction information acquisition function 155 performs a process to delete the corresponding excision instruction line (S113).

[0115] Then, the correction information acquisition function 155 reallocates identifiers conforming to the cut-out instruction information setting rule (9) to all the cut-out instruction lines that have not been deleted (S114). The correction information acquisition function 155 saves the various operation information generated in this flowchart and the definition information of the reallocated identifiers as correction information. Then, the process returns to the flowchart of FIG.

[0116] Fig. 18 is a flowchart showing another example of the flow of the correction information generation process according to the first embodiment. The process shown in Fig. 18 is executed when the cut-out instruction object in the first cut-out instruction information group 6 is a cut-out instruction rectangle.

[0117] First, the correction information acquisition function 155 determines whether or not there is an excision instruction rectangle located outside the specimen region (S201). If there is no excision instruction rectangle located outside the specimen region (S201 "No"), the process proceeds to S203.

[0118] If there is an excision instruction rectangle located outside the specimen region (S201 "Yes"), the correction information acquisition function 155 creates deletion operation information for the excision instruction rectangle located outside the specimen region (S202).

[0119] Next, the correction information acquisition function 155 determines whether or not there is an extraction instruction rectangle that invades the jurisdiction area of ​​the non-selected extraction instruction rectangle in the first extraction instruction information group 6 changed by the user (S203). If there is no such extraction instruction rectangle (S203 "No"), the process proceeds to S205.

[0120] If there is an excision instruction rectangle encroaching on the jurisdiction area of ​​a non-selected excision instruction rectangle (S203 "Yes"), the correction information acquisition function 155 creates operation information for dividing or reducing the corresponding excision instruction rectangle (S204).

[0121] Next, the correction information acquisition function 155 determines whether there is an excision instruction rectangle whose size protruding from the specimen region is less than the first specified size (S205). If there is no such excision instruction rectangle (S205 "No"), the process proceeds to S207.

[0122] If there is an excision instruction rectangle whose size protrudes from the sample region and is less than the first specified size (S205 "Yes"), the correction information acquisition function 155 creates operation information for enlarging the corresponding excision instruction rectangle (S206).

[0123] Furthermore, the correction information acquisition function 155 determines whether or not there is a marginal area 80 on the specimen area that is equal to or larger than a fifth specified size (S207). If there is a marginal area 80 on the specimen area that is equal to or larger than a fifth specified size, the correction information acquisition function 155 generates operation information for adding an excision instruction rectangle to the marginal area 80 (S208). Note that the correction information acquisition function 155 may generate operation information for enlarging the excision instruction rectangle. If the marginal area 80 becomes smaller than the fifth specified size, the loop process of S207 to S209 ends (S209).

[0124] Then, the correction information acquisition function 155 determines whether or not there is an excision instruction rectangle whose size on the sample region is less than the third specified size (S210). If there is no such excision instruction rectangle (S210 "No"), the process proceeds to S212.

[0125] If there is an excision instruction rectangle on the sample region whose size is less than the third specified size (S210 "Yes"), the correction information acquisition function 155 performs a process of deleting the corresponding excision instruction rectangle (S211).

[0126] Then, the correction information acquisition function 155 reallocates identifiers conforming to the cut-out instruction information setting rule (9) to all the cut-out instruction rectangles that have not been deleted (S212). The correction information acquisition function 155 saves the various operation information generated in this flowchart and the definition information of the reallocated identifiers as correction information. Then, the process returns to the flowchart of FIG.

[0127] The contents and order of the processes described with reference to FIGS. 17 and 18 are merely examples, and may vary depending on the contents of the cut-out instruction information setting rules.

[0128] In this manner, the information processing device 100 of this embodiment generates correction information defining a process for correcting the first cut-out instruction information 601a-605a, 611, 612, 613 based on the first cut-out instruction information 601a-605a, 611, 612, 613 and the specimen region identified from the specimen image 50, and generates the second cut-out instruction information 901-905, 910-912 by reflecting the correction information. As a result, according to the information processing device 100 of this embodiment, the cut-out instruction information is automatically corrected, thereby reducing the workload of the user when creating the cut-out instruction image 7. For example, in the information processing device 100 of this embodiment, even if a part or all of the first cut-out instruction information 601a to 605a, 611, 612, 613 is displaced from the appropriate position due to a user's movement operation, the user does not need to manually correct each of the first cut-out instruction information 601a to 605a, 611, 612, 613.

[0129] In the information processing device 100 of this embodiment, the modification information includes information on at least one of modification, movement, division, addition, and deletion of the first cut-out instruction information 60a1-605a, 611, 612, 613. By generating such modification information, the information processing device 100 of this embodiment can define an operation for changing the first cut-out instruction information 601a-605a, 611, 612, 613 to a state conforming to the cut-out instruction information setting rule.

[0130] Furthermore, in the information processing device 100 of this embodiment, the correction information includes information regarding assignment of identifiers to the cut-out positions of the second cut-out instruction information 901-905, 910-912. The information processing device 100 of this embodiment generates the second cut-out instruction information 901-905, 910-912 to which identifiers are assigned, by reflecting the correction information in the first cut-out instruction information 601-605, 611, 612, 613. Therefore, the information processing device 100 of this embodiment can reduce the effort required of the user to manually reassign identifiers.

[0131] (Modification 1 of the first embodiment) In the first embodiment described above, the cut-out instruction information generating function 156 replaces all the first cut-out instruction information 601a-605a included in the first cut-out instruction information group 6 changed by the user with the second cut-out instruction information 901-905, but the method of reflecting the modified information is not limited to this. For example, the cut-out instruction information generating function 156 may reset only the points that have been changed between the first cut-out instruction information 601a-605a and the second cut-out instruction information 901-905. According to the information processing device 100 of this modification, in addition to the effect of the first embodiment, the calculation cost and processing time can be reduced by excluding the unchanged first cut-out instruction information 601a-605a from the target of replacement.

[0132] (Modification 2 of the first embodiment) In the first embodiment described above, the specimen region is an image region in which the entire specimen 51 is depicted on the specimen image 50, but the specimen region may be an image region corresponding to the abnormal region 510 of the specimen 51 depicted on the specimen image 50. Taking the specimen image 50 shown in FIG. 2 as an example, the specimen region identifying function 154 may identify, as the specimen region, an area surrounded by the contour line of the abnormal region 510 included in the specimen 51 on the specimen image 50. In addition to the effects of the first embodiment, the information processing device 100 of this modification can prevent omission of a cut-out instruction particularly relating to an abnormal region to be diagnosed.

[0133] (Modification 3 of the first embodiment) The modification information acquisition function 155 of the information processing device 100 of this modification may determine whether the size of the slice instructed by the second cut-out instruction information 901-905 will be less than the specified size before reflecting the modification information. When the modification information acquisition function 155 of this modification determines that the size of the slice will be less than the specified size, it changes the modification information to define the size of the slice as equal to or larger than the specified size. Note that the specified size of the slice is not particularly limited.

[0134] FIG. 19 is a diagram showing an example of slices 501, 502 instructed by the second cut-out instruction information 914 according to the third modification of the first embodiment. When the specimen 51 is sliced ​​at the cut-out position instructed by the second cut-out instruction information 914, the slice 501 of the cut-out slices 501, 502 is smaller than the specified size, and is too small to be made into a slide specimen. In contrast, the slice 502 is equal to or larger than the specified size, and can be made into a slide specimen. In this case, the correction information acquisition function 155 defines an operation such as shortening or dividing the cut-out instruction line in the correction information, so that all slices are equal to or larger than the specified size. Note that making all slices equal to or larger than the specified size includes not only enlarging the slices, but also deleting slices that are too small.

[0135] Fig. 20 is a diagram showing an example of segments 501, 502 instructed by second cut-out instruction information 914 based on modified modification information after the change according to the third modified example of the first embodiment. In the example shown in Fig. 20, the cut-out line of the second cut-out instruction information 914 is shortened, so that the segment 501 disappears and only the segment 502 that is equal to or larger than the specified size remains.

[0136] 19 and 20 show the second cut-out instruction information 914 for the sake of explanation, but the correction information acquisition function 155 determines whether the sizes of all slices indicated by the second cut-out instruction information 914 are less than a specified size before the cut-out instruction information generation function 156 generates the second cut-out instruction information 914. When the correction information acquisition function 155 determines that there are slices less than the specified size, it changes the correction information to make the sizes of all slices indicated by the second cut-out instruction information 914 equal to or greater than the specified size.

[0137] According to the information processing device 100 of this modification, in addition to the effect of the first embodiment, the occurrence of slices that are too small to be sampled is reduced.

[0138] (Fourth Modification of the First Embodiment) In the above embodiment, the correction information acquisition function 155 generates correction information when the first cut-out instruction information 601a-605a changed by the user is in a state requiring correction, but the method of acquiring the correction information is not limited to this. For example, when the first cut-out instruction information 601a-605a is in a state requiring correction, the correction information acquisition function 155 may acquire the correction information from another function in the information processing device 100, the storage circuitry 120, or another device outside the information processing device 100. The source of acquisition of the correction information is not limited to these examples.

[0139] Second embodiment In the above-described first embodiment, the information processing device 100 accepts a change operation not for each of the first cut-out instruction information 601-605, 611, 612, 613 but for each of the first cut-out instruction information groups 6. In this second embodiment, the information processing device 100 accepts a selection by the user of each of the first cut-out instruction information 601-605, 611, 612, 613 included in the first cut-out instruction information group 6 as a target for a change operation.

[0140] 21 is a diagram showing an example of the overall configuration of an information processing system S according to the first embodiment. The information processing system S according to the present embodiment includes an information processing device 100 and a sample image storage device 200, similar to the first embodiment.

[0141] The processing circuit 150 of the information processing device 100 of this embodiment includes a sample image acquisition function 151, a reception function 152a, an excision instruction information acquisition function 153, a sample area identification function 154, a correction information acquisition function 155a, an excision instruction information generation function 156, and a display control function 157.

[0142] The sample image acquisition function 151, the cut-out instruction information acquisition function 153, the sample region identification function 154, the cut-out instruction information generation function 156, and the display control function 157 have the same functions as those in the first embodiment.

[0143] In addition to the functions of the first embodiment, the reception function 152a receives selection of at least one of one or more pieces of first cut-out instruction information included in the cut-out instruction image 7. More specifically, the reception function 152a of this embodiment receives a user operation to individually select a plurality of pieces of first cut-out instruction information 601-605 included in one first cut-out instruction information group 6 as a change target.

[0144] Fig. 22 is a diagram showing an example of a cut-out instruction image 7 according to the second embodiment. In the example shown in Fig. 22, the first cut-out instruction information 601-604 among the first cut-out instruction information 601-605 included in the first cut-out instruction information group 6 are selected by the user as targets of the change operation. Moreover, the first cut-out instruction information 605 is not selected by the user as a target of the change operation.

[0145] Fig. 23 is a diagram showing an example of a state in which the first cut-out instruction information 601 to 604 in Fig. 22 has been changed by a user. As shown in Fig. 23, even if the first cut-out instruction information 601 to 604 is moved by a user's operation, the first cut-out instruction information 605 not selected by the user remains in the same position as in Fig. 22 without being changed.

[0146] In addition to the functions of the first embodiment, the correction information acquisition function 155a of this embodiment generates correction information that defines adjustment, addition, deletion, and reassignment of identifiers of the first excision instruction information 601-604 selected by the user, based on the positional relationship between all of the first excision instruction information 601-605, including the unselected first excision instruction information 605, and the sample area.

[0147] For example, the correction information acquisition function 155a of this embodiment generates correction information that specifies the jurisdiction area of ​​the first cut-out instruction information 601-604 selected by the user to a position and size that does not overlap with the jurisdiction area of ​​the first cut-out instruction information 605 not selected by the user.

[0148] 23, the jurisdiction areas of the first cut-out instruction information 601a-604a moved by the user invade the jurisdiction area of ​​the unselected first cut-out instruction information 605. For this reason, the correction information acquisition function 155a shortens or divides the cut-out lines of the first cut-out instruction information 601a-604a to generate correction information that deletes the parts of the jurisdiction areas of the first cut-out instruction information 601a-604a that overlap with the jurisdiction area of ​​the first cut-out instruction information 605.

[0149] Furthermore, when there is an excision instruction line whose length on the sample region is less than the third specified length by shortening or dividing the excision line of the first excision instruction information 601a to 604a, the correction information acquisition function 155a generates correction information for deleting the excision instruction line. Furthermore, the correction information acquisition function 155a also targets the first excision instruction information 605 that has not been selected by the user with regard to the reassignment of identifiers.

[0150] Fig. 24 is a diagram showing an example of second cut-out instruction information 901a-905a, 906 according to the second embodiment. The second cut-out instruction information 901a-905a shown in Fig. 24 is generated by reflecting the correction information generated by the correction information acquisition function 155a in the first cut-out instruction information 601a-604a by the cut-out instruction information generation function 156.

[0151] 24 is cut-out instruction information in which the cut-out line of the first cut-out instruction information 605 not selected by the user is maintained without change. The identifier of the second cut-out instruction information 906 is reallocated in accordance with the identifiers of the other second cut-out instruction information 901a to 905a.

[0152] Next, a flow of the process of correcting the first cut-out instruction information 601a to 605a executed by the information processing apparatus 100 of this embodiment configured as above will be described.

[0153] FIG. 25 is a flowchart showing an example of the flow of the process of correcting the first cut-out instruction information 601a to 605a according to the second embodiment.

[0154] First, the reception function 152 of this embodiment receives a change operation for each of the first cut-out instruction information 601a to 605a by the user (S21). The process of obtaining the first cut-out instruction information group 6 in S22 and the process of specifying the specimen region in S23 are similar to the processes of S12 and S13 described in FIG.

[0155] Then, the correction information acquisition function 155a of this embodiment generates correction information (S24). The correction information generation process is similar to the flow described in, for example, Fig. 17 and Fig. 18, but in this embodiment, in the processes of S105 to S106 and S203 to S204, if there is an excision instruction line or an excision rectangle that invades the jurisdiction area of ​​a non-selected excision line or excision rectangle, the correction information acquisition function 155a generates correction information that deletes a portion of the jurisdiction area of ​​the first excision instruction information 601a to 604a that overlaps with the jurisdiction area of ​​the first excision instruction information 605 by shortening or dividing the excision line of the first excision instruction information 601a to 604a, as described in Fig. 23 and Fig. 24.

[0156] The generation of the second cut-out instruction information group 9 in S25 and the replacement process in S26 are similar to the processes in S15 and S16 described with reference to Fig. 16. Here, the process of this flowchart ends.

[0157] In this manner, the information processing device 100 of the present embodiment receives a user's selection of each of the first cut-out instruction information 601a-605a, and generates modification information that specifies the jurisdiction area of ​​the first cut-out instruction information 601a-604a selected by the user as the object to be changed at a position and size that does not overlap with the jurisdiction area of ​​the first cut-out instruction information 605 not selected by the user as the object to be changed. As a result, according to the information processing device 100 of the present embodiment, when the user wishes to keep part of each of the first cut-out instruction information 601a-604a, 605 unchanged and change only the other part, it is possible to reduce the influence of the changed first cut-out instruction information 601a-604a on the cut-out instruction of the first cut-out instruction information 605 that is not the object to be changed.

[0158] In addition, in the information processing device 100 of this second embodiment, the reception function 152a may accept a user's operation to select only the first cut-out instruction information 601a to 604a, 605 relating to some of the samples as the target for change, even when multiple samples 51 are present on the cut-out instruction image 7.

[0159] FIG. 26 is a diagram showing an example of the cut-out instruction image 7 in which a plurality of specimens 51 according to the second embodiment are depicted. In the example shown in FIG. 26, two specimens 51 and 52 are depicted in the specimen image 50 included in the cut-out instruction image 7. The first cut-out instruction information 621-625, 626 and 627 are set for these two specimens 51 and 52. In the example shown in FIG. 26, the first cut-out instruction information 626 and 627 set for the specimen 52 is selected by the user, but the first cut-out instruction information 621-625 set for the specimen 51 is not selected by the user. In this case, the user can modify only the first cut-out instruction information 626 and 627 set for the specimen 52 while keeping the cut-out instruction for the specimen 51 unchanged, and can receive support from the information processing device 100 regarding the modification.

[0160] (Third embodiment) In the third embodiment, the information processing device 100 accepts an operation for adding new cut-out instruction information by a user, and adds or changes cut-out instruction information relating to the entire sample region based on the added cut-out instruction information.

[0161] 27 is a diagram showing an example of the overall configuration of an information processing system S according to the first embodiment. The information processing system S according to the present embodiment includes an information processing device 100 and a sample image storage device 200, similar to the first embodiment.

[0162] The processing circuit 150 of the information processing device 100 of this embodiment includes a sample image acquisition function 151, a reception function 152b, a cut-out instruction information acquisition function 153a, a sample region identification function 154, a correction information acquisition function 155a, a cut-out instruction information generation function 156, a display control function 157, and a cut-out instruction image generation function 158. The cut-out instruction image generation function 158 is an example of a setting unit. The display control function 157 is an example of a display control unit and an output processing unit.

[0163] The sample image acquisition function 151, the sample region identification function 154, and the cut-out instruction information generation function 156 have the same functions as those in the first embodiment.

[0164] The reception function 152b of this embodiment receives a user change operation for adding new first cut-out instruction information in addition to the functions of the first embodiment. The reception function 152b also receives a user approval or rejection operation for the second cut-out instruction information proposal generated by the cut-out instruction information generation function 156.

[0165] The cut-out instruction information acquisition function 153a of this embodiment acquires first cut-out instruction information added by a user's operation accepted by the acceptance function 152b, in addition to the functions of the first embodiment.

[0166] The correction information acquisition function 155a of this embodiment generates correction information that defines a process of adding first cut-out instruction information added by a user operation to the cut-out instruction image 7, in addition to the functions of the first embodiment.

[0167] In addition to the functions of the first embodiment, the display control function 157 outputs a proposed setting image in which the second cut-out instruction information generated by the cut-out instruction information generation function 156 is superimposed on the sample image 50 to the display 140. This image is called a proposed setting image because it proposes a setting proposal for the second cut-out instruction information to the user. Note that the method of outputting the proposed setting image is not limited to this, and the cut-out instruction image 7 may be displayed on a display outside the information processing device 100.

[0168] The cut-out instruction image generating function 158 replaces at least one of the first cut-out instruction information set in the cut-out instruction image 7 with the second cut-out instruction information. In this embodiment, the cut-out instruction image generating function 158 sets the second cut-out instruction information approved by the user to the cut-out instruction image 7 based on the user's operation. The cut-out instruction image generating function 158 may generate the cut-out instruction image 7 by replacing all the first cut-out instruction information included in the first cut-out instruction information group 6 with the second cut-out instruction information included in the second cut-out instruction information group 9, or may replace only the second cut-out instruction information whose change is defined in the setting information, and set the first cut-out instruction information whose change is not defined in the setting information to the cut-out instruction image 7 without changing it. In addition, when the addition of the first cut-out instruction information is defined in the correction information, the cut-out instruction image generating function 158 adds the second cut-out instruction information corresponding to the added first cut-out instruction information to the cut-out instruction image 7.

[0169] Here, generation of the second cut-out instruction information according to this embodiment will be described with reference to FIGS.

[0170] Fig. 28 is a diagram showing an example of a sample image 50 before the first cut-out instruction information according to the third embodiment is set. In Fig. 28, cut-out instruction information has not yet been set in the sample image 50. In this embodiment, the sample image 50 in this state is set as an initial state, and the user can add the first cut-out instruction information.

[0171] Fig. 29 is a diagram showing an example of first cut-out instruction information 621 newly added by a user according to the third embodiment. The reception function 152b receives an operation of adding the newly added first cut-out instruction information 621 by the user. The cut-out instruction information acquisition function 153a acquires the first cut-out instruction information 621 added by the user operation received by the reception function 152b. Note that the present invention is not limited to the examples shown in Figs. 28 and 29, and the user may add the first cut-out instruction information 621 to the cut-out instruction image 7 to which one or more pieces of first cut-out instruction information have already been set.

[0172] FIG. 30 is a diagram showing an example of the setting proposal image 70 on which the second cut-out instruction information 921-924 according to the third embodiment is displayed. The second cut-out instruction information 921-924 shown in FIG. 30 is a proposal generated by the cut-out instruction information generating function 156 based on the correction information generated by the correction information acquiring function 155a. At the time shown in FIG. 30, the second cut-out instruction information 921-924 is only displayed on the screen as a proposal and has not yet been set in the cut-out instruction image 7. The display control function 157 outputs the cut-out instruction image 7 shown in FIG. 30 to the display 140, thereby allowing the user to confirm the second cut-out instruction information 921-924. The reception function 152b of this embodiment receives the user's operation of approving or rejecting the second cut-out instruction information 921-924. The display control function 157 may display the first cut-out instruction information 621 added by the user and the second cut-out instruction information 921-924 generated based on the correction information generated by the correction information acquisition function 155a in different display modes in the proposed setting image 70 so that the user can distinguish between them.

[0173] Fig. 31 is a diagram showing an example of second cut-out instruction information 921-924, 931 according to the third embodiment. When the user approves the second cut-out instruction information 921-924 in Fig. 30, the cut-out instruction image generating function 158 sets the second cut-out instruction information 921-924, 931 to the cut-out instruction image 7. Note that since the second cut-out instruction information 931 is unchanged from the first cut-out instruction information 621 added by the user's operation, the cut-out instruction image generating function 158 may use the first cut-out instruction information 621 as it is without replacing it.

[0174] FIG. 32 is a flowchart showing an example of the flow of a correction process for an extraction instruction image according to the third embodiment.

[0175] The process of this flowchart is started when the reception function 152b receives a setting of new first cut-out instruction information 621 to a sample region by a user (S31).

[0176] Next, the cut-out instruction information acquisition function 153a acquires the first cut-out instruction information group 6 including the first cut-out instruction information 621 added by the user operation accepted by the acceptance function 152b (S32). The process of identifying the specimen region in S33 is similar to the process of S13 described in FIG.

[0177] Then, the correction information acquisition function 155a of this embodiment generates correction information (S34). The correction information generation process is similar to the flow described in, for example, Fig. 17 and Fig. 18, but in this embodiment, the correction information acquisition function 155a generates the correction information based on the first cut-out instruction information 621 added in the process of S31 and the specimen region identified in the process of S33.

[0178] The process of generating the second cut-out instruction information group 9 in S35 is similar to the process in S15 described with reference to FIG.

[0179] Then, the display control function 157 of this embodiment causes the display 140 to display a proposed setting image 70 in which the second cut-out instruction information group 9 is reflected in the sample image 50 (S36). The display control function 157 may cause the display 140 to display, together with the proposed setting image 70, a GUI or the like that can receive an approval or rejection operation by the user.

[0180] Then, if the reception function 152b receives the user's approval of the proposed setting image 70 (S36 "Yes"), the cut-out instruction image generation function 158 sets the second cut-out instruction information 921-924, 931 to the cut-out instruction image 7 by replacing the first cut-out instruction information group 6 with the second cut-out instruction information group 9 (S38).

[0181] In this way, the information processing device 100 of this embodiment allows the user to add new first cut-out instruction information 621, so in addition to the effects of the first and second embodiments, the user can perform operations with greater freedom.

[0182] In addition, the information processing device 100 of this embodiment outputs a proposed setting image in which the second cut-out instruction information 921-924 is superimposed on the sample image 50, thereby allowing the user to easily confirm the cut-out position automatically generated by the information processing device 100.

[0183] Furthermore, the information processing device 100 of this embodiment sets the second cut-out instruction information 921-924 to the cut-out instruction image 7 when approval is received from the user, thereby reducing the occurrence of cut-out instruction information being set unintentionally by the user.

[0184] The various data handled in this specification are typically digital data.

[0185] In the above-described embodiment, the case where the specimen image before the cut-out process is performed as the target specimen is described, but the present invention is not limited to this, and the process may be performed on the specimen image of the slice after the cut-out process. For example, the actual cut-out process may deviate from the cut-out instruction image, and in that case, a cut-out instruction image can be created again for the slice after the cut-out process.

[0186] According to at least one of the embodiments described above, it is possible to reduce the workload of the user when creating a cut-out instruction image.

[0187] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0188] 6, 6a First cut-out instruction information group 7 Cut-out instructions image 9 Second cut-out instruction information group 50 Sample images 51,52 Samples 61~63 Area of ​​jurisdiction 70 Setting proposal image 80~83 Marginal area 100 Information processing device 110 Network Interface 120 Memory circuit 130 Input Interface 140 Display 150 Processing circuit 151 Sample image acquisition function 152, 152a, 152b Reception function 153,153a Extraction instruction information acquisition function 154 Specimen area identification function 155,155a Correction information acquisition function 156 Extraction instruction information generation function 157 Display control function 158 Cut-out instruction image generation function 200 Sample image storage device 300 Network 501,502 intercept 510 Abnormal area 601 to 605, 601a to 605a, 611 to 613, 621, 626, 652 to 654 First cut-out instruction information 901, 901a to 905a, 906, 910 to 914, 921 to 924, 931 Second cut-out instruction information S Information Processing System

Claims

1. an extraction instruction information acquisition unit that acquires first extraction instruction information indicating one or more extraction positions of the sample in a sample image obtained by capturing the sample; a specimen region identifying unit for identifying at least one specimen region in which the specimen is depicted on the specimen image; a correction information acquisition unit that acquires correction information that defines a process for correcting the first cut-out instruction information based on the first cut-out instruction information and the sample region; an extracting instruction information generating unit that generates second extracting instruction information different from the first extracting instruction information by reflecting the correction information in the first extracting instruction information; An information processing device comprising:

2. the modification information includes information regarding at least one of modification, movement, division, addition, and deletion of the first cut-out instruction information; The information processing device according to claim 1 .

3. the modification information includes information regarding assignment of an identifier to an extraction position of the second extraction instruction information, the cut-out instruction information generation unit generates the second cut-out instruction information to which the identifier is assigned by reflecting the correction information in the first cut-out instruction information. The information processing device according to claim 1 .

4. a reception unit that receives a user's selection of at least one of the first cut-out instruction information to be changed, the modification information acquisition unit generates modification information that defines a jurisdiction area of ​​the first cut-out instruction information selected by the user as a target to be changed to a position and size that does not overlap with a jurisdiction area of ​​the first cut-out instruction information not selected by the user as a target to be changed. The information processing device according to claim 1 .

5. a reception unit that receives a change operation for at least one of the first cut-out instruction information, the cut-out instruction information generating unit generates the second cut-out instruction information corresponding to the first cut-out instruction information that is the target of the change operation; The information processing device according to claim 1 .

6. the change operation is an operation involving either a deformation or a movement of the first cut-out instruction information, The information processing device according to claim 5 .

7. the change operation is an operation involving the addition of new first cut-out instruction information, The information processing device according to claim 5 .

8. an output processing unit that outputs a setting proposal image in which the second cut-out instruction information is superimposed on the sample image; The information processing device according to claim 5 .

9. a setting unit that replaces at least one piece of first cut-out instruction information set in a cut-out instruction image including one or more pieces of first cut-out instruction information with the second cut-out instruction information, The information processing device according to claim 1 .

10. the setting unit replaces the first cut-out instruction information corrected by the correction information, among the one or more pieces of first cut-out instruction information set in the cut-out instruction image, with the second cut-out instruction information based on the correction information, and when the addition of the first cut-out instruction information is defined in the correction information, adds the second cut-out instruction information corresponding to the added first cut-out instruction information to the cut-out instruction image. The information processing device according to claim 9.

11. The setting unit sets the second cut-out instruction information in the cut-out instruction image based on a user operation. The information processing device according to claim 9 or 10.

12. The specimen region is a region in which an abnormal region of the specimen is depicted. The information processing device according to claim 1 .

13. The modification information acquisition unit determining whether or not the sizes of all slices indicated by the second cut-out instruction information are less than a specified size before reflecting the correction information; when it is determined that there is a segment smaller than a prescribed size, the modification information is changed so that the sizes of all segments indicated by the second segment extraction instruction information are equal to or larger than the prescribed size. The information processing device according to claim 1 .

14. an extracting instruction information acquiring step of acquiring first extracting instruction information indicating one or more extracting positions of the sample in a sample image obtained by capturing the sample; a specimen region identifying step of identifying at least one specimen region in which the specimen is depicted on the specimen image; a correction information acquisition step of acquiring correction information that defines a process of correcting the first cut-out instruction information based on the first cut-out instruction information and the specimen region; an extracting instruction information generating step of generating second extracting instruction information different from the first extracting instruction information by reflecting the correction information in the first extracting instruction information; An information processing method comprising:

15. On the computer, an extracting instruction information acquiring step of acquiring first extracting instruction information indicating one or more extracting positions in a sample image obtained by capturing the sample and in the sample; a specimen region identifying step of identifying at least one specimen region in which the specimen is depicted on the specimen image; a correction information acquisition step of acquiring correction information that defines a process of correcting the first cut-out instruction information based on the first cut-out instruction information and the specimen region; an extracting instruction information generating step of generating second extracting instruction information different from the first extracting instruction information by reflecting the correction information in the first extracting instruction information; A program for executing the above.

Images