Image display system, analysis device, image management device, and program

Abstract

To provide an image display system capable of displaying an analysis result obtained by computer processing of first medical image data with a first slice thickness on a second medical image reconstructed into a second slice thickness different from the first slice thickness.SOLUTION: An image display system: acquires an analysis result obtained by computer processing of first medical image data with a first slice thickness; acquires second medical image data obtained by reconstructing the obtained first medical image data into a second slice thickness different from the first slice thickness; and converts the analysis result of the first medical image data so as to be displayed on a second medical image based on the second medical image data.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an image display system, an analysis device, an image management device, and a program.

Background Art

[0002] Regarding medical images composed of a plurality of slice images such as CT images and MRI images, conventionally, in order to improve the reading efficiency (the thicker the slice thickness, the faster the reading is possible) and reduce the load on the storage capacity, images with a reconstructed thick slice thickness (for example, 5 mm thick) are stored in a PACS (Picture Archiving and Communication System).

[0003] Also, Patent Document 1 describes detecting a lesion candidate region from a CT image by CAD (Computer Aided Diagnosis) and storing the information of the detected lesion candidate region in association with the examination identification number and image number of the slice image of the detection source.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] By the way, in an analysis system that detects a lesion candidate region by computer processing such as CAD or AI (Artificial Intelligence), each system specifies the slice thickness of the input image. Since the analysis accuracy is higher when analyzing a thin slice thickness image (for example, 1 mm thick) as the input image, when analyzing performance is required, the specification is to analyze a thin slice thickness image (for example, 1 mm thick) as the input image.

[0006] However, in an analysis system configured to analyze a thin slice thickness image (e.g., 1 mm thick) as an input image, simply sending only the analysis results (such as the position information and feature quantities of the lesion candidate regions) obtained from the thin slice thickness image (e.g., 1 mm thick) to the PACS cannot associate them with the reconstructed thick slice thickness image (e.g., 5 mm thick). Therefore, the analysis results cannot be displayed on the PACS side.

[0007] Therefore, conventionally, not only the reconstructed thick slice thickness (e.g., 5 mm thick) image was sent to and stored in the PACS, but in addition to the analysis results obtained from the thin slice thickness image (e.g., 1 mm thick), the thin slice thickness image (e.g., 1 mm thick) used for the analysis was sent to the PACS side and stored for a certain period, and the analysis results were displayed on the thin slice thickness image (e.g., 1 mm thick). However, since storing all the thin slice thickness images on the PACS side increases the capacity, they were deleted on a time - limited basis after a certain period.

[0008] However, if the thin slice thickness image used for the analysis is deleted from the PACS, when trying to confirm the analysis results again after deletion, it is necessary to resend the analysis results and the thin slice thickness image (e.g., 1 mm thick) used for the analysis from the analysis system to the PACS, resulting in a problem of reduced work efficiency.

[0009] The present invention has been made in view of the above problems, and an object thereof is to enable an analysis result obtained by computer - processing first medical image data having a first slice thickness to be displayed on a second medical image reconstructed to a second slice thickness different from the first slice thickness.

Means for Solving the Problems

[0010] To solve the above problems, the present invention relating to An image display system A first acquisition means for acquiring an analysis result obtained by computer - processing first medical image data having a first slice thickness, A second acquisition means for acquiring second medical image data obtained by reconstructing the first medical image data into a second slice thickness thicker than the first slice thickness; A conversion means for converting the analysis result of the first medical image data into a form that can be displayed on a second medical image based on the second medical image data; and has and the analysis result includes the instance number of the first medical image data, the conversion means completely replaces the instance number of the analysis result with the instance number of the second medical image data corresponding to the instance number of the analysis result.

[0012] Also, in the present invention relating to the analysis device A first acquisition means for acquiring an analysis result obtained by computer processing of first medical image data having a first slice thickness; A second acquisition means for acquiring second medical image data obtained by reconstructing the first medical image data into a second slice thickness thicker than the first slice thickness; A conversion means for converting the analysis result of the first medical image data into a form that can be displayed on a second medical image based on the second medical image data; and has and the analysis result includes the instance number of the first medical image data, the conversion means completely replaces the instance number of the analysis result with the instance number of the second medical image data corresponding to the instance number of the analysis result.

[0015] Also, the present invention relating to The image management device A first acquisition means for acquiring an analysis result obtained by computer processing of first medical image data having a first slice thickness; A second acquisition means for acquiring second medical image data obtained by reconstructing the first medical image data into a second slice thickness thicker than the first slice thickness; A conversion means for converting the analysis result of the first medical image data into a form that can be displayed on a second medical image based on the second medical image data; and has and the analysis result includes the instance number of the first medical image data, the conversion means completely replaces the instance number of the analysis result with the instance number of the second medical image data corresponding to the instance number of the analysis result.

[0016] Also, the present invention relating toThe program causes a computer to acquire an analysis result obtained by computer processing of first medical image data having a first slice thickness, through a first acquisition function; acquire second medical image data obtained by reconstructing the first medical image data into second slice thickness greater than the first slice thickness, through a second acquisition function; convert the analysis result of the first medical image data into a form that can be displayed on a second medical image based on the second medical image data, through a conversion function; and implement 、 the analysis result includes the instance number of the first medical image data, the conversion function completely replaces the instance number of the analysis result with the instance number of the second medical image data corresponding to the instance number of the analysis result.

Advantages of the Invention

[0018] According to the present invention, it becomes possible to display an analysis result obtained by computer processing of first medical image data having a first slice thickness on a second medical image reconstructed into a second slice thickness different from the first slice thickness.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0020] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the illustrated examples.

[0021] <First Embodiment> 〔Configuration of Image Display System〕 FIG. 1 shows an example of the system configuration of the image display system 100 in the first embodiment. As shown in FIG. 1, the image display system 100 includes a modality 1, a console 2, an analysis device 3, an image server 4, a reading terminal 5, etc., and these are connected via a communication network N such as a LAN (Local Area Network), WAN (Wide Area Network), or the Internet. Each device constituting the image display system 100 conforms to standards such as HL7 (Health Level Seven) and DICOM (Digital Image and Communications in Medicine), and communication between devices is carried out in accordance with HL7 and DICOM. Note that the number of modalities 1, consoles 2, analysis devices 3, reading terminals 5, etc. is not particularly limited.

[0022] Modality 1 is an image generation device such as a CT or MRI. Based on examination order information transmitted from an RIS (Radiology Information System) or the like (not shown), it takes images of the patient's examination target site as the subject to generate medical image data (medical image data consisting of a plurality of slice image data). Modality 1 performs imaging with a first slice thickness and transmits the obtained first medical image data with the first slice thickness to Console 2. The first slice thickness is determined by the hospital side according to the imaging purpose and imaging site, and is set to 1 mm in this embodiment.

[0023] Console 2 is configured with a control unit, a display unit, an operation unit, a communication unit, a storage unit, etc. (not shown), and is an imaging control device that controls imaging in Modality 1. Console 2 outputs imaging conditions and image reading conditions to Modality 1 and acquires the first medical image data taken in Modality 1. Further, Console 2 reconstructs the first medical image data acquired by Modality 1 to generate second medical image data with a second slice thickness thicker than the first slice thickness. The second slice thickness is determined by the hospital side and is set to 5 mm in this embodiment. Then, Console 2 writes additional information (patient information (patient ID, patient name, date of birth, age, gender, height, weight, etc.), examination information (examination ID, examination date and time, type of modality, examination site, referring department, examination purpose, etc.), image identification information (e.g., instance number, UID (Unique ID), etc.), image position information, etc.) in accordance with the DICOM standard to each of the first medical image data and the second medical image data (for example, in the header of the image file of each slice). It transmits the first medical image data and the second medical image data with the additional information attached to Analysis Device 3, and transmits the second medical image data to Image Server 5.

[0024] Here, as shown in FIG. 2, the image position information is composed of an X coordinate, a Y coordinate, and a Z coordinate. The X coordinate is a coordinate indicating the position in the X-axis direction (the width direction of the subject M, the horizontal direction of the medical image) shown in FIG. 2. The Y coordinate is a coordinate indicating the position in the Y-axis direction (the body thickness direction of the subject M, the vertical direction of the medical image) shown in FIG. 2. The Z coordinate is a coordinate indicating the position in the Z-axis direction (the body axis direction of the subject M, the slice direction) shown in FIG. 2. In the accessory information, as the X coordinate and the Y coordinate, predetermined coordinates (for example, the coordinates of the origin (the upper left point of the image)) are written. Also, the instance number is a number indicating which image the slice image data is among a series of first medical image data (or second medical image data). The UID is information for uniquely identifying the slice image data.

[0025] The analysis device 3 performs computer processing-based analysis on the first medical image data transmitted from the console 2 to detect a lesion candidate region, and transmits (outputs) the analysis result to the image server 5. As the computer processing, for example, detection of a lesion candidate region by CAD (Computer Aided Diagnosis) or AI analysis using AI (Artificial Intelligence) for performing image diagnosis and image analysis is used.

[0026] FIG. 3 is a block diagram showing the functional configuration of the analysis device 3. As shown in FIG. 3, the analysis device 3 includes a control unit 31, a storage unit 32, a data acquisition unit 33, a data output unit 34, an operation unit 35, a display unit 36, etc., and each unit is connected by a bus 37.

[0027] The control unit 31 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc., and comprehensively controls the operations of each part of the analysis device 3. Specifically, the CPU reads out various processing programs stored in the program storage unit 321 of the storage unit 32 and expands them in the RAM, and executes various processes according to the programs. By executing the processes on the analysis device 3 side of the sequence shown in FIG. 5, the control unit 31 functions as a first acquisition means, a second acquisition means, a conversion means, and a generation means.

[0028] The storage unit 32 is composed of an HDD (Hard Disk Drive), a semiconductor memory, etc., and includes a program storage unit 321 that stores programs for executing processes on the analysis device 3 side of the sequence shown in FIG. 5 and programs for executing various processes including analysis programs. The storage unit 32 also stores parameters, files, etc. necessary for the execution of the programs stored in the program storage unit 321.

[0029] The data acquisition unit 33 is composed of, for example, a network interface, etc., and is configured to receive data from an external device connected by wire or wirelessly via the communication network N. In this embodiment, the data acquisition unit 33 is composed of a network interface, etc., but it can also be composed of a port, etc. into which a USB memory, an SD card, etc. can be inserted.

[0030] The data output unit 34 is composed of, for example, a network interface, etc., and is configured to output data to an external device connected by wire or wirelessly via the communication network N. In this embodiment, the data output unit 34 is composed of a network interface, etc., but connectors for connecting to external devices, ports for various media such as USB memories, etc. are applicable.

[0031] The operation unit 35 is composed of a keyboard with various keys, a pointing device such as a mouse, or a touch panel attached to the display unit 36. The operation unit 35 enables the user to perform input operations. Specifically, it outputs the operation signals input by key operations on the keyboard, mouse operations, or touch operations on the touch panel to the control unit 31.

[0032] The display unit 36 is configured with a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to the instructions of the display signals input from the control unit 31. Note that the number of monitors is not limited to one, and multiple monitors may be provided.

[0033] The analysis device 3 may be a type of device that outputs the first medical image data and the generated analysis results (analysis result data) to the reading terminal 5, and the doctor checks the analysis results on the reading terminal 5 and determines the analysis results if it is okay, or it may be a gateway type device that directly uses the generated analysis results as the analysis results of the first medical image data without the doctor's confirmation.

[0034] The image server 4 is, for example, a server of a PACS, and is an image management device that stores and manages the second medical image data output from the console 2.

[0035] Figure 4 is a block diagram showing the functional configuration of the image server 4. As shown in Figure 4, the image server 4 is configured with a control unit 41, a storage unit 42, a data acquisition unit 43, a data output unit 44, an operation unit 45, a display unit 46, etc., and each unit is connected by a bus 47.

[0036] The control unit 41 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc., and comprehensively controls the operations of each unit of the image server 4. Specifically, the CPU reads out various processing programs stored in the program storage unit 421 of the storage unit 42 and expands them in the RAM, and executes various processes according to the programs.

[0037] The storage unit 42 is composed of an HDD (Hard Disk Drive), a semiconductor memory, etc., and includes a program storage unit 421 that stores programs for executing various processes including the program for executing the processes on the image server 4 side of the sequence shown in FIG. 5. The storage unit 42 also stores parameters, files, etc. necessary for the execution of the programs stored in the program storage unit 421.

[0038] In addition, the storage unit 42 includes an image DB (Data Base) 422. The image DB 422 is a database for storing the second medical image data transmitted from the console 2 and the analysis results (analysis results by the analysis device 3) converted to be displayable on the second medical image. The image DB 422 has an image management table for storing management information (ancillary information) of the second medical image data stored in the image DB 422. In the image management table, for example, information such as patient information, examination information, image identification information, image position information, and identification information of the analysis results (e.g., the file name of a GSPS (Grayscale Softcopy Presentation State) file) of each slice image data of the second medical image data is stored.

[0039] The data acquisition unit 43 is composed of, for example, a network interface, etc., and is configured to receive data from an external device connected by wire or wirelessly via the communication network N. In this embodiment, the data acquisition unit 43 is composed of a network interface, etc., but it can also be composed of a port, etc. into which a USB memory, an SD card, etc. can be inserted.

[0040] The data output unit 44 is composed of, for example, a network interface or the like, and is configured to output data to an external device connected wired or wirelessly via the communication network N. In the present embodiment, the data output unit 44 is composed of a network interface or the like, but a connector for connecting to an external device, ports for various media such as a USB memory, etc. are applicable.

[0041] The operation unit 45 is composed of a keyboard having various keys, a pointing device such as a mouse, or a touch panel attached to the display unit 46 or the like. The operation unit 45 enables the user to perform input operations. Specifically, it outputs an operation signal input by a key operation on the keyboard, a mouse operation, or a touch operation on the touch panel to the control unit 41.

[0042] The display unit 46 is configured with a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to the instruction of the display signal input from the control unit 41. Note that the number of monitors is not limited to one, and a plurality of monitors may be provided.

[0043] The radiography terminal 5 is, for example, a PACS client (PACS viewer), and is a display device that reads out the second medical image data and the analysis results converted to be displayable on the second medical image from an image server 4 or the like and displays them for radiography. The radiography terminal 5 is configured to include a control unit, a display unit, an operation unit, a communication unit, a storage unit, etc. (not shown).

[0044] 〔Operation of the image display system 100〕 Next, the operation of the image display system 100 will be described. FIG. 5 is a sequence diagram showing the flow from imaging to image display in the image display system 100. Hereinafter, with reference to FIG. 5, the flow from imaging to image display in the image display system 100 will be described.

[0045] First, based on the inspection order information, Modality 1 performs imaging at a first slice thickness (1 mm) to obtain first medical image data (step S1), and transmits the first medical image data to the console 2 (step S2).

[0046] Upon receiving the first medical image data, the console 2 reconstructs the first medical image data to generate second medical image data with a second slice thickness (5 mm) (step S3). Then, the console 2 transmits the first medical image data and the second medical image data to the analysis device 3 (step S4), and transmits the second medical image data to the image server 4 (step S5).

[0047] In the analysis device 3, the control unit 31 acquires the first medical image data and the second medical image data transmitted from the console 2 by the data acquisition unit 33, and analyzes the first medical image data to generate (acquire) an analysis result (step S6). Specifically, the control unit 31, in cooperation with an analysis program (for example, a learned model) stored in the program storage unit 321, analyzes each slice image data of the first medical image data to detect a lesion candidate region, and generates an analysis result including the image identification information (UID, instance number) of the slice image data of the detection source, the image position information (X coordinate, Y coordinate, Z coordinate) of the detected lesion candidate region, the type of lesion, and annotation information. When the same lesion candidate region appears across multiple slice image data, an analysis result is generated for the slice image data (representative slice image data) in which the lesion candidate region appears the largest. The analysis result is generated, for example, in the GSPS format and temporarily stored in the RAM or the storage unit 32 of the control unit 31.

[0048] Next, the control unit 31 of the analysis device 3 generates association information for converting the analysis result of the first medical image data into a form that can be displayed on the second medical image based on the second medical image data, based on the correspondence relationship between the image position information of the first medical image data and the image position information of the second medical image data (step S7).

[0049] As described above, the analysis device 3 generates an analysis result based on the first medical image data with a first slice thickness (1 mm). On the other hand, the image server 4 stores the second medical image data with a second slice thickness (5 mm), and the second medical image data is displayed on the reading terminal 5. The reason for performing the analysis using the first medical image data with a thin slice thickness is that as the slice thickness becomes thinner, it becomes easier to detect fine lesions. Also, the reason for providing the second medical image data with a thick slice thickness for reading is that as the slice thickness becomes thicker, the number of medical image data sheets is smaller, so the reading efficiency is good and the storage capacity to be used can also be small.

[0050] However, since the analysis result of the first medical image data is specified by the instance number and UID of the slice that is the detection source in the first medical image data, annotation information indicating the analysis result cannot be displayed on the second medical image based on the second medical image data (it is not known which slice image data it corresponds to).

[0051] Therefore, in step S7, the control unit 31 generates association information for converting the analysis result of the first medical image data so that it can be displayed on the second medical image based on the second medical image data. For example, the control unit 31 generates the association information as follows in (1) to (5) below. (1) The instance number and image position information are acquired from the attached information of each slice image data of the first medical image data, and the combination of the acquired instance number and image position information is associated with Thin No. n (n: 1... N. N is the number of slice image data) in the order of the instance numbers (see Fig. 6). (2) The instance number and image position information are acquired from the attached information of each slice image data of the second medical image data, and the combination of the acquired instance number and image position information is associated with Thick No. m (m: 1... M. M is the number of slice image data) in the order of the instance numbers (see Fig. 7). (3) Based on the correspondence relationship of the numerical values of the Z coordinates of the image position information of the first medical image data and the image position information of the second medical image data, identify the slice image data (Thick No. m) of the second medical image data that includes the range captured by each slice image data (Thin No. n) of the first medical image data. Thereby, associate the instance number of the slice image data of the first medical image data with the instance number of the slice image data of the second medical image data. For example, if the Z coordinate of the image position information of the slice image data with the instance number = 2 of the first medical image data is -341, the Z coordinate of the image position information of the slice image data with the instance number = 1 of the second medical image data is -340, and the Z coordinate of the image position information of the instance number = 2 is -345, the slice image data with the instance number = 2 of the first medical image data is associated with the slice image data with the instance number = 1 of the second medical image data. (4) Generate association information (see FIG. 8) that associates the Thin No. of the first medical image data with the Thick No. of the second medical image data according to the association in (3). (5) Store the generated association information in the storage unit 32.

[0052] When the generation of the association information is completed, the control unit 31 of the analysis device 3 converts the analysis result of the first medical image data based on the generated association information so that it can be displayed on the second medical image based on the second medical image data (step S8).

[0053] For example, the control unit 31 converts each of the analysis results of the first medical image data so that it can be displayed on the second medical image based on the second medical image data according to the following (1) to (5). (1) Obtain the Thin No. from the instance number of the analysis result of the first medical image data. (2) Refer to the association information and obtain the Thick No. corresponding to the obtained Thin No. (3) Obtain the image identification information of the slice image data of the second medical image data corresponding to the obtained Thick No. Rewrite the image identification information of the analysis result of the first medical image data with the image identification information obtained in (3). Through the processing of this step S8, the analysis result of the first medical image data can be displayed on the second medical image based on the second medical image data.

[0054] Note that when associating the slice image data of the first medical image data with the slice image data of the second medical image data, as shown in FIG. 8, a plurality of slice image data of the first medical image data will be associated with one slice image data of the second medical image data. That is, a plurality of analysis results will be associated with (converted to be displayable on) one slice image data of the second medical image data. However, in this case, the management of the analysis results corresponding to the second medical image data may become complicated. Therefore, the analysis results associated with the same slice image data of the second medical image data may be integrated into one analysis result.

[0055] For example, as shown in FIG. 9, when the slice images of Thin No. 1 to 3 of the first medical image data correspond to the slice image of Thick No. 1 of the second medical image data, the plurality of analysis results of the slice images of Thin No. 1 to 3 are integrated (for example, writing other analysis results into the file of any one of the analysis results) into one analysis result, and the image identification information of the integrated analysis result is replaced with the image identification information of the slice image data of Thick No. 1. Thereby, for example, the analysis result of Thick No. 1 shown in FIG. 9 is one data (file) including the information of the lesion candidate region A1 (image position information, type of lesion, annotation information) detected from Thin No. 1 and the information of the lesion candidate region A2 (image position information, type of lesion, annotation information) detected from Thin No. 2. Thereby, since the slice image data of the second medical image data and the data of the analysis result are associated on a one-to-one basis, the management becomes easy.

[0056] Next, the control unit 31 of the analysis device 3 transmits the analysis result converted for display on the second medical image to the image server 4 by the data output unit 34 (step S9).

[0057] In the image server 4, the control unit 41 acquires the second medical image data transmitted from the console 2 by the data acquisition unit 43, and stores the acquired second medical image data in the image DB 422 (step S10). That is, the control unit 41 stores the slice image data of the acquired second medical image data in the image DB 422, and writes the respective additional information into the image management table.

[0058] Also, in the image server 4, the control unit 41 acquires the analysis result (the analysis result converted for display on the second medical image) transmitted from the analysis device 3 by the data acquisition unit 43, and stores the acquired analysis result in the image DB 422 (step S11). That is, the control unit 41 stores the file of the acquired analysis result in the image DB 422, and writes the identification information (such as the GSPS file name) of the acquired analysis result into the record having the UID included in the analysis result of the image DB 422.

[0059] In the reading terminal 5, when the inspection information or the like of the second medical image data stored in the image DB 422 is specified and the image acquisition request for the specified inspection is transmitted to the image server 4 (step S12), the control unit 41 of the image server 4 reads out the second medical image data of the specified inspection and the corresponding analysis result from the image DB 422, and transmits them to the reading terminal 5 by the data output unit 44 (step S13).

[0060] In the reading terminal 5, when the second medical image data and the analysis result are received from the image server 4, the second medical image based on the received second medical image data is displayed on the display unit, and annotation information indicating the analysis result is added and displayed on the second medical image (step S14). The user observes the displayed second medical image and the analysis result and performs reading.

[0061] The above is the sequence from shooting to image display in the image display system 100. Since the reading terminal 5 is provided with the analysis result converted to be displayable on the second medical image based on the second medical image data, it becomes possible to display the analysis result on the correct slice image of the second medical image.

[0062] <Second Embodiment> Next, a second embodiment of the present invention will be described. In the second embodiment, in the analysis device 3, the above-mentioned association information is generated and output to the image server 4. In the image server 4, an example of converting the analysis result of the first medical image data based on the acquired association information so as to be displayable on the second medical image based on the second medical image data will be described.

[0063] In the second embodiment, the program storage unit 321 of the analysis device 3 stores a program for executing the processing on the analysis device 3 side of the sequence shown in FIG. 10. The control unit 31 executes the processing on the analysis device 3 side of the sequence shown in FIG. 10 in cooperation with the program stored in the storage unit 32. The control unit 31 functions as an output means by executing the processing on the analysis device 3 side of the sequence shown in FIG. 10. Further, the program storage unit 421 of the image server 4 stores a program for executing the processing on the image server 4 side of the sequence shown in FIG. 10. The control unit 41 executes the processing on the image server 4 side of the sequence shown in FIG. 10 in cooperation with the program stored in the storage unit 42. The control unit 41 functions as a first acquisition means, a second acquisition means, a third acquisition means, and a conversion means by executing the processing on the image server 4 side of the sequence shown in FIG. 10. The configuration in the other image display system 100 is the same as that described in the first embodiment, so the description will be incorporated by reference. Hereinafter, the operation in the second embodiment will be described.

[0064] FIG. 10 is a sequence diagram showing the flow from imaging to image display of the image display system 100 in the second embodiment. Hereinafter, with reference to FIG. 10, the flow from imaging to image display of the image display system 100 in the second embodiment will be described.

[0065] First, based on the examination order information, modality 1 performs imaging at a first slice thickness (1 mm) to acquire first medical image data (step S21), and transmits the first medical image data to the console 2 (step S22).

[0066] Upon receiving the first medical image data, the console 2 reconstructs the first medical image data to generate second medical image data with a second slice thickness (5 mm) (step S23). Then, the console 2 transmits the first medical image data and the second medical image data to the analysis device 3 (step S24), and transmits the second medical image data to the image server 4 (step S25).

[0067] In the analysis device 3, the control unit 31 acquires the first medical image data and the second medical image data transmitted from the console 2 by the data acquisition unit 33, and analyzes the first medical image data to generate (acquire) an analysis result (step S26). The process of step S26 is the same as that described in step S6 of FIG. 5, so the description is incorporated by reference.

[0068] Next, the control unit 31 of the analysis device 3 generates association information for converting the analysis result of the first medical image data into a form that can be displayed on the second medical image based on the second medical image data based on the correspondence between the image position information of the first medical image data and the image position information of the second medical image data (step S27). The process of step S27 is the same as that described in step S7 of FIG. 5, so the description is incorporated by reference.

[0069] When the generation of the association information is completed, the control unit 31 of the analysis device outputs the analysis result of the first medical image data and the association information to the image server 4 by the data output unit 34 (step S28).

[0070] In the image server 4, the control unit 41 acquires the second medical image data transmitted from the console 2 by the data acquisition unit 43, and stores the acquired second medical image data in the image DB 422 (step S29). Since the process of step S29 is the same as that of step S10 in FIG. 5, the description thereof is incorporated herein by reference.

[0071] Also, in the image server 4, the control unit 41 acquires the analysis result of the first medical image data and the association information output from the analysis device 3 by the data acquisition unit 43, and based on the acquired association information, converts the analysis result of the acquired first medical image data so that it can be displayed on the second medical image based on the second medical image data (step S30). Since the process of step S30 is the same as that described in step S8 of FIG. 5, the description thereof is incorporated herein by reference.

[0072] Then, the control unit 41 of the image server 4 stores the analysis result converted so as to be displayable on the second medical image in the image DB 422 (step S31). Since the process of step S31 is the same as that described in step S11 of FIG. 5, the description thereof is incorporated herein by reference.

[0073] In the reading terminal 5, when the examination information or the like of the second medical image data stored in the image DB 422 is specified and an image acquisition request for the specified examination is transmitted to the image server 4 (step S32), the control unit 41 of the image server 4 reads out the second medical image data of the specified examination and the corresponding analysis result from the image DB 422, and transmits them to the reading terminal 5 by the data output unit 44 (step S33).

[0074] In the reading terminal 5, when the second medical image data and the analysis result are received from the image server 4, a second medical image based on the received second medical image data is displayed on the display unit, and annotation information indicating the analysis result is added to and displayed on the second medical image (step S34). The user observes the displayed second medical image and the analysis result to perform reading.

[0075] The above is the sequence from imaging to image display in the image display system 100 according to the second embodiment. Since the reading terminal 5 is provided with the analysis result converted to be displayable on the second medical image based on the second medical image data, it is possible to display the analysis result on the correct slice image of the second medical image.

[0076] <Third Embodiment> Next, a third embodiment of the present invention will be described. In the third embodiment, an example will be described in which the image server 4 generates association information and converts the analysis result of the first medical image data so as to be displayable on the second medical image based on the second medical image data.

[0077] In the third embodiment, the console 2 transmits the first medical image data to the analysis device 3 and the second medical image data to the image server 4. Further, a program for executing the processing on the analysis device 3 side of the sequence shown in FIG. 11 is stored in the program storage unit 321 of the analysis device 3. The control unit 31 executes the processing on the analysis device 3 side of the sequence shown in FIG. 11 in cooperation with the program stored in the storage unit 32. In addition, the program storage unit 421 of the image server 4 stores a program for executing the processing on the image server 4 side of the sequence shown in FIG. 11. The control unit 41 executes the processing on the image server 4 side of the sequence shown in FIG. 11 in cooperation with the program stored in the storage unit 42. The control unit 41 functions as a first acquisition unit, a second acquisition unit, a generation unit, and a conversion unit by executing the processing on the image server 4 side of the sequence shown in FIG. 11. The configuration of the other image display system 100 is the same as that described in the first embodiment, so the description is incorporated herein by reference. Hereinafter, the operation in the third embodiment will be described.

[0078] FIG. 11 is a sequence diagram showing the flow from imaging to image display of the image display system 100 in the third embodiment. Hereinafter, with reference to FIG. 11, the flow from imaging to image display of the image display system 100 in the third embodiment will be described.

[0079] First, modality 1 performs imaging at a first slice thickness (1 mm) based on the inspection order information, acquires first medical image data (step S41), and transmits the first medical image data to the console 2 (step S42).

[0080] Upon receiving the first medical image data, the console 2 reconstructs the first medical image data to generate second medical image data with a second slice thickness (5 mm) (step S43). Then, the console 2 transmits the first medical image data to the analysis device 3 (step S44) and transmits the second medical image data to the image server 4 (step S45).

[0081] In the analysis device 3, the control unit 31 acquires the first medical image data transmitted from the console 2 by the data acquisition unit 33, analyzes the acquired first medical image data, and generates (acquires) an analysis result (step S46). The generation of the analysis result in step S46 is the same as that described in step S6 of FIG. 5, so the description is incorporated herein by reference. Then, the control unit 31 transmits the generated analysis result and the attached information of each slice image data of the first medical image data to the image server 4 by the data output unit 34 (step S47).

[0082] In the image server 4, the control unit 41 acquires the second medical image data transmitted from the console 2 by the data acquisition unit 43, and stores the acquired second medical image data in the image DB 422 (step S48). The process of step S48 is the same as that of step S10 in FIG. 5, so the description is incorporated by reference.

[0083] Also, in the image server 4, the control unit 41 acquires the analysis result of the first medical image data and the attached information of each slice image data of the first medical image data transmitted from the analysis device 3 by the data acquisition unit 43, and based on the correspondence relationship between the image position information of the first medical image data and the image position information of the second medical image data, generates association information for converting the analysis result of the first medical image data to be displayable on the second medical image based on the second medical image data (step S49). The generation of the association information in step S49 is the same as that described in step S7 of FIG. 5, so the description is incorporated by reference.

[0084] Next, in the image server 4, the control unit 41 converts the analysis result of the acquired first medical image data to be displayable on the second medical image based on the generated association information (step S50). The process of step S50 is the same as that described in step S8 of FIG. 5, so the description is incorporated by reference.

[0085] Then, the control unit 41 of the image server 4 stores the analysis result converted to be displayable on the second medical image in the image DB 422 (step S51). The process of step S51 is the same as that described in step S11 of FIG. 5, so the description is incorporated by reference.

[0086] In the reading terminal 5, when the inspection information and the like of the second medical image data stored in the image DB 422 are specified and the image acquisition request for the specified inspection is transmitted to the image server 4 (step S52), the control unit 41 of the image server 4 reads out the second medical image data of the specified inspection and the corresponding analysis result from the image DB 422, and transmits them to the reading terminal 5 by the data output unit 44 (step S53).

[0087] In the reading terminal 5, when the second medical image data and the analysis result are received from the image server 4, a second medical image based on the received second medical image data is displayed on the display unit, and annotation information indicating the analysis result is added and displayed on the second medical image (step S54). The user observes the displayed second medical image and the analysis result and performs reading.

[0088] The above is the sequence from imaging to image display in the image display system 100 in the third embodiment. In the reading terminal 5, since the analysis result converted to be displayable on the second medical image based on the second medical image data is provided, the analysis result can be displayed on the correct slice image of the second medical image.

[0089] In the above third embodiment, the image server 4 acquires the additional information of the first medical image data necessary for generating the association information from the analysis device 3, but it may also acquire it from the console 2. Also, although it takes transfer time, the image server 4 may acquire the first medical image data from the analysis device 3 or the console 2.

[0090] <Modification Example> In the above-described first to third embodiments, association information is generated each time the first medical image data and the second medical image data are generated, and the analysis result of the first medical image data is converted based on the association information so as to be displayable on the second medical image based on the second medical image data. However, for example, when the first slice thickness, the second slice thickness, the image position and the imaging range of the first slice image of the first medical image data (for each part) taken in modality 1 are fixed, the generated association information is stored in the storage unit 32 of the analysis device 3 or the storage unit 42 of the image server 4, and based on the stored association information, the control unit 31 of the analysis device 3 or the control unit 41 of the image server 4 converts the analysis result of the first medical image data so as to be displayable on the second medical image based on the second medical image data.

[0091] Alternatively, without generating association information, based on the information of the first slice thickness and the second slice thickness, the analysis result of the first medical image data may be converted so as to be displayable on the second medical image based on the second medical image data. For example, the control unit 31 of the analysis device 3 or the control unit 41 of the image server 4 calculates the image position information of each slice image data of the first medical image data and the second medical image data from the information of the first slice thickness and the second slice thickness and the image position information of the first slice image of the first medical image data or the second medical image data, and based on the calculated image position information, identifies the instance number of the second medical image data corresponding to the instance number of the analysis result of the first medical image data. Then, the image identification information of the analysis result of the first medical image data is rewritten by the image identification information of the slice image data of the identified instance number. Thereby, the analysis result of the first medical image data can be converted so as to be displayable on the second medical image based on the second medical image data.

[0092] Also, the process of converting the analysis result of the first medical image data so as to be displayable on the second medical image based on the second medical image data may be performed by the control unit of the reading terminal 5. For example, in the image server 4, the control unit 41 associates the analysis result of the first medical image data with the association information obtained from the analysis device 3 or generated within the image server 4, and stores the result in the storage unit 42 in association with the second medical image data stored in the image DB 422 (for example, associated by patient information, examination information, etc.). In response to an image acquisition request from the reading terminal 5, the control unit 41 transmits the analysis result of the first medical image data and the association information to the reading terminal 5 together with the second medical image data corresponding to the specified examination information. At the reading terminal 5, based on the association information obtained from the image server 4, the analysis result of the first medical image data is converted so as to be displayable on the second medical image based on the second medical image data, and the analysis result is displayed on the second image based on the second medical image data.

[0093] Alternatively, in the image server 4, the control unit 41 associates the analysis result of the first medical image data with the additional information of each slice image data of the first medical image data, and stores the result in the storage unit 42 in association with the second medical image data stored in the image DB 422 (for example, associated by patient information, examination information, etc.). In response to an image acquisition request from the reading terminal 5, the control unit 41 transmits the analysis result of the first medical image data and the additional information to the reading terminal 5 together with the second medical image data corresponding to the specified examination information. At the reading terminal 5, based on the acquired second medical image data, the analysis result of the first medical image data, and the additional information, the association information is generated, or the instance number of the second image data corresponding to the instance number included in the analysis result of the first medical image data is specified from the first slice thickness and the second slice thickness, and the analysis result of the first medical image data is converted so as to be displayable on the second medical image based on the second medical image data. Note that the process of generating the association information, the process of converting the analysis result of the first medical image data so as to be displayable on the second medical image based on the second medical image data using the association information, and the process of converting the analysis result of the first medical image data so as to be displayable on the second medical image based on the second medical image data without using the association information are the same as those described in the first to third embodiments.

[0094] As described above, in the image display system 100, an analysis result obtained by computer processing of first medical image data with a first slice thickness is acquired, and second medical image data obtained by reconstructing the acquired first medical image data to a second slice thickness different from the first slice thickness is acquired, and the analysis result of the first medical image data is converted to be displayable on a second medical image based on the second medical image data. Therefore, it becomes possible to display the analysis result obtained by computer processing of first medical image data with a first slice thickness on a second medical image reconstructed to a second slice thickness different from the first slice thickness.

[0095] Note that the present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the gist thereof.

[0096] For example, in the above-described embodiment, the case where the analysis result of the first medical image data is acquired in the GSPS format is taken as an example for explanation, but it is not limited thereto, and it may be in the SR (Structured Report) format. Further, the control unit 31 and the control unit 41 may include means for generating embedded image data in which an analysis result (for example, an annotation indicating a lesion candidate region) is embedded in the second medical image data after converting the analysis result of the first medical image data to be displayable on the second medical image based on the second medical image data. That is, a program for realizing a function of converting the analysis result of the first medical image data to be displayable on the second medical image based on the second medical image data in a computer (for example, the control unit 31 and the control unit 41) may include a program for realizing a function of generating embedded image data in which an analysis result (for example, an annotation indicating a lesion candidate region) is embedded in the second medical image data after converting the analysis result of the first medical image data to be displayable on the second medical image based on the second medical image data in the computer. Embedded image data includes, for example, screen capture images. For example, after converting the analysis result of the first medical image data so that it can be displayed on the second medical image based on the second medical image data, an analysis result (for example, an annotation indicating a lesion candidate region) is displayed on the medical image based on the second medical image data on the memory. By generating a screen capture image, embedded image data can be generated. If embedded image data is generated as the analysis result after conversion, the reading terminal 5 can easily display the analysis result. On the other hand, in the case of the GSPS format or the SR format, since it is necessary to superimpose annotation information on the original image according to the user operation, there are the labor of the user operation and the process of superimposing the analysis result on the image.

[0097] Also, in the above embodiment, in FIG. 1, the analysis device 3, the image server 5, and the reading terminal 5 are illustrated as separate and independent devices, but the image server 4 and the reading terminal 5, the analysis device 3 and the image server 4, the analysis device 3, the image server 4, and the reading terminal 5 may be configured as one device. Also, the first acquisition means, the second acquisition means, the third acquisition means, the output means, and the generation means of the image display system of the present invention may be distributed among a plurality of devices.

[0098] Also, in the above description, an example in which a hard disk, a semiconductor non-volatile memory, etc. are used as a computer-readable medium of the program according to the present invention is disclosed, but it is not limited to this example. As other computer-readable media, portable recording media such as CD-ROM can be applied. Also, a carrier wave is applied as a medium for providing the data of the program according to the present invention via a communication line.

[0099] In addition, regarding the detailed configuration and detailed operation of each device constituting the image display system, it can be appropriately changed without departing from the gist of the invention.

Explanation of Reference Numerals

[0100] 1 Modality 2 Console 3 Analysis Device 31 Control Unit 32 Memory Unit 321 Program Memory Unit 33 Data Acquisition Unit 34 Data Output Unit 35 Operation Unit 36 Display Unit 37 Bus 4 Image Server 41 Control Unit 42 Memory Unit 421 Program Memory Unit 43 Data Acquisition Unit 44 Data Output Unit 45 Operation Unit 46 Display Unit 47 Bus 5 Reading Terminal 100 Image Display System

Claims

1. A first acquisition means for acquiring an analysis result obtained by computer processing on first medical image data with a first slice thickness; A second acquisition means for acquiring second medical image data obtained by reconstructing the first medical image data with a second slice thickness thicker than the first slice thickness; A conversion means for converting the analysis result of the first medical image data into a form that can be displayed on a second medical image based on the second medical image data; comprising: The analysis result includes the instance number of the first medical image data; The conversion means completely replaces the instance number of the analysis result with the instance number of the second medical image data corresponding to the instance number of the analysis result; An image display system.

2. An output means for outputting association information for converting the analysis result of the first medical image data into a form that can be displayed on the second medical image; The image display system according to Claim 1, comprising.

3. A third acquisition means for acquiring association information for converting the analysis result of the first medical image data into a form that can be displayed on the second medical image; The image display system according to Claim 1, comprising: The conversion means converts the analysis result into a form that can be displayed on the second medical image based on the association information.

4. A generation means for generating association information for converting the analysis result of the first medical image data into a form that can be displayed on the second medical image based on the correspondence relationship between the image position information of the first medical image data and the image position information of the second medical image data; The image display system according to Claim 1, comprising.

5. A first acquisition means for acquiring an analysis result obtained by computer processing on first medical image data with a first slice thickness; A second acquisition means for acquiring second medical image data obtained by reconstructing the first medical image data with a second slice thickness thicker than the first slice thickness; A conversion means for converting the analysis result of the first medical image data into a form that can be displayed on a second medical image based on the second medical image data; comprising: The analysis result includes the instance number of the first medical image data; The conversion means completely replaces the instance number of the analysis result with the instance number of the second medical image data corresponding to the instance number of the analysis result; An analysis device.

6. Generating means for generating association information for converting the analysis result of the first medical image data into a displayable form on the second medical image based on the correspondence relationship between the image position information of the first medical image data and the image position information of the second medical image data. The analysis device according to claim 5, comprising the above.

7. First acquisition means for acquiring an analysis result obtained by computer processing of first medical image data with a first slice thickness. Second acquisition means for acquiring second medical image data obtained by reconstructing the first medical image data into a second slice thickness thicker than the first slice thickness. Conversion means for converting the analysis result of the first medical image data into a displayable form on a second medical image based on the second medical image data. Comprising the above. The analysis result includes the instance number of the first medical image data. The conversion means completely replaces the instance number of the analysis result with the instance number of the second medical image data corresponding to the instance number of the analysis result. Image management device.

8. Third acquisition means for acquiring association information for converting the analysis result of the first medical image data into a displayable form on the second medical image. The conversion means converts the analysis result into a displayable form on the second medical image based on the association information. The image management device according to claim 7.

9. The conversion means converts the analysis result into a displayable form on the second medical image based on the first slice thickness and the second slice thickness. The image management device according to claim 7.

10. Generating means for generating association information for converting the analysis result of the first medical image data into a displayable form on the second medical image based on the correspondence relationship between the image position information of the first medical image data and the image position information of the second medical image data. The image management device according to claim 7, comprising the above.

11. On a computer A first acquisition function for causing the computer to acquire an analysis result obtained by computer processing of first medical image data with a first slice thickness. A second acquisition function for causing the computer to acquire second medical image data obtained by reconstructing the first medical image data into a second slice thickness thicker than the first slice thickness. A conversion function for causing the computer to convert the analysis result of the first medical image data into a displayable form on a second medical image based on the second medical image data. To be realized. The analysis result includes the instance number of the first medical image data, and the conversion function completely replaces the instance number of the analysis result with the instance number of the second medical image data corresponding to the instance number of the analysis result. Program.

12. The computer is caused to acquire third acquisition means for obtaining association information for converting the analysis result of the first medical image data so as to be displayable on the second medical image, and the conversion function converts the analysis result into a form displayable on the second medical image based on the association information. The program according to claim 11.

13. The computer is caused to generate generation means for generating association information for converting the analysis result of the first medical image data so as to be displayable on the second medical image based on the correspondence relationship between the image position information of the first medical image data and the image position information of the second medical image data. The program according to claim 11.

14. The computer is caused to generate second generation means for generating embedded image data obtained by embedding the analysis result in the second medical image data. The program according to claim 11 or 12.

15. There are a plurality of the analysis results, the first acquisition means acquires the plurality of analysis results, and the conversion function converts the plurality of analysis results of the first medical image data into a form displayable on the second medical image. The program according to claim 11 or 12. ​

Images