Image display device and image display program

Abstract

To improve the visibility when reading a kymographic video in which a plurality of medical images taken dynamically in time series are chronologically played back and displayed.SOLUTION: A image display device (1) is equipped with: an image acquisition unit (14) for acquiring a plurality of medical images (F1, F2) obtained by continuously performing radiography on the same target site along a time axis; and an image playback control unit (11) for chronologically playing back and displaying the plurality of medical images acquired by the image acquisition unit and displaying a stereotaxic standard (MK) at a fixed position on a screen in a way that it is overlapped on the medical images during the playback and display over the plurality of the medical images.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an image display device and an image display program. [Background technology]

[0002] In contrast to the conventional still image capture and diagnosis of radiation (X-rays) using films / screens or photostimulable phosphor plates, attempts have recently been made to capture dynamic images of the area to be diagnosed (hereinafter referred to as the target area) using semiconductor image sensors such as FPDs (flat panel detectors) and apply them to diagnosis. Specifically, by taking advantage of the fast response time of the semiconductor image sensor in reading and erasing image data, pulsed radiation is continuously emitted from the radiation source in time with the reading and erasing timing of the semiconductor image sensor, and multiple images are taken per second to capture the dynamics of the target area.

[0003] For example, when the target area is the lungs or the heart, the dynamics of the chest are captured, and a series of images acquired by the capture are displayed in sequence, allowing the doctor to observe the series of movements of the chest associated with breathing, heartbeat, etc. In addition, various techniques have been proposed for extracting feature information useful for diagnosing the ventilation volume due to breathing from dynamic chest images. For example, a technique is known in which dynamic chest images are taken of the front and sides of the chest, and changes in lung volume are calculated from changes in the lung position and thickness, and this is obtained as the ventilation volume.

[0004] By the way, the presence or absence of adhesions in the lung field is judged by reading dynamic images. This makes it possible to estimate the time required for incising adhesions in advance in the surgical plan, and to estimate the surgical time with high accuracy. To determine whether or not adhesions exist, it is necessary to actually check dynamic video of the lung field and identify areas that are not moving due to adhesions. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-89612 A Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, in order to enable the user to quickly check the results of dynamic imaging and to improve the user's diagnostic efficiency, a display image is generated by superimposing multiple feature points indicating areas that change over time during dynamic imaging onto a single medical image, thereby improving visibility when interpreting the image. However, when interpreting images, it is necessary to interpret not only a single display image but also the dynamic video itself, and the issue of low visibility remains. In particular, when interpreting chest adhesions, it is necessary to identify areas of the lung that have little movement due to the adhesions. However, because the movement of the ribs and the movement of the lungs are independent, there is a problem that the movement of the lungs is easily overlooked due to the movement of the ribs.

[0007] The present invention has been made in consideration of the above-mentioned problems, and has an objective of improving visibility when interpreting dynamic videos in which a plurality of medical images captured in a time series of dynamic images are played back and displayed in chronological order. [Means for solving the problem]

[0008] In order to solve the above problems, the image display device of the present invention comprises: an image acquisition unit that acquires a plurality of medical images obtained by successively performing radiography on the same target region along a time axis; an image playback control unit that is capable of playing back and displaying the plurality of medical images acquired by the image acquisition unit in chronological order, and displaying a localization reference at a fixed position on the screen over the plurality of medical images during the playing back and display; The image reproduction control unit enlarges or reduces the medical image while displaying the medical image on the screen without moving the localization reference.and a function of enlarging or reducing the localization reference together with the medical image. .

[0009] The image display program of the present invention further comprises: The computer of the image display device, an image acquisition unit that acquires a plurality of medical images obtained by successively performing radiography on the same target region along a time axis; An image display program for causing the image display control unit to function as an image display control unit that is capable of displaying the plurality of medical images acquired by the image acquisition unit in chronological order and displaying a localization reference at a fixed position on a screen over the plurality of medical images during the display, the image display control unit comprising: The image reproduction control unit enlarges or reduces the medical image while displaying the medical image on the screen without moving the localization reference. and a function of enlarging or reducing the localization reference together with the medical image. . Effect of the Invention

[0010] According to the present invention, it is possible to improve visibility when interpreting a dynamic video in which a plurality of time-series medical images captured by dynamic imaging are played back and displayed in chronological order. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram showing the main configuration of a medical image system including an image display device according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram of a main part of an image display device according to an embodiment of the present invention. [Diagram 3] FIG. 13 is a diagram showing an example of a monitor screen when dynamic playback is displayed. [Figure 4] FIG. 13 is a diagram showing another example of the monitor screen during dynamic playback display. [Diagram 5] FIG. 13 is a diagram showing an example of a monitor screen for explaining how the position of the localization reference is changed. [Figure 6] FIG. 13 is a diagram showing an example of a monitor screen for explaining how the angle of the localization reference is changed. [Figure 7] FIG. 13 is a diagram showing an example of a monitor screen for explaining how a medical image is enlarged or reduced. [Figure 8] FIG. 13 is a diagram showing an example of a monitor screen for explaining panning of a medical image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of an image display device (image display system) according to the present invention will be described with reference to the drawings. In the following, an image display device will be described, but the image display device also includes an image display system in which each functional unit is installed in a distributed manner in a separate device. In addition, the embodiments described below are subject to various limitations that are technically preferable for implementing the present invention, but the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[0013] The image display device of this embodiment acquires medical images such as radiological dynamic images (hereinafter referred to as "dynamic images") in a medical image system, and displays the acquired medical images such as dynamic images and various It displays information about. First, as a premise, the relationship between a medical image system and an image display device assumed in this embodiment will be described with reference to FIG.

[0014] [Configuration of medical imaging system] FIG. 1 shows an example of the system configuration of a medical image system 100. As shown in FIG. The medical image system 100 is a system installed in a medical facility such as a hospital. As shown in Fig. 1, the medical image system 100 includes an image display device (medical image display device) 1, a medical image capturing device 2, an image management server 3, etc. Each device is connected to be able to transmit and receive data via a communication network N consisting of communication lines such as a LAN (Local Area Network) or a WAN (Wide Area Network). Each device constituting the medical image system 100 conforms to the DICOM (Digital Image and Communications in Medicine) standard, and communication between each device is performed in accordance with the DICOM standard. The number of each device is not particularly limited. For example, various modalities such as a CT (Computed Tomography) device, an MRI (Magnetic Resonance Imaging) device, and a CR (Computed Radiography) device may be provided as the medical imaging device 2. The various modalities may be provided in a plurality of units of one type, or in a plurality of types, each of which may be provided in one unit. The number and combination of units are appropriately determined according to the needs of the facility.

[0015] The image management server 3 is a computer device that accumulates, stores, and manages image data of medical images generated by various modalities (medical imaging device 2) and supplementary information related to the medical images. Medical images include, for example, tomographic images generated by a CT device or an MRI device, and plain X-ray images generated by a CR device. In this embodiment, the medical images include dynamic images obtained when dynamic imaging is performed by the medical imaging device 2.

[0016] Here, "dynamic radiography" refers to continuous radiography of the dynamics of the target area along the time axis. Specifically, radiation is irradiated repeatedly at a predetermined time interval in pulse form from a radiation source (not shown) (pulse irradiation), or is irradiated continuously without interruption at a low dose rate (continuous irradiation), and radiography is performed multiple times in succession to capture the dynamics of the target area like a video. The term "dynamic images" refers to a series of images obtained by such imaging that show the dynamics of the target area.

[0017] The image management server 3 is a medical image database (DB) that is configured with a hard disk, etc. The medical image DB 31 stores data of medical images and supplementary information related to the medical images. The medical images stored in the medical image DB 31 are saved in the DICOM file format that conforms to the DICOM standard. A DICOM file consists of an image section and a header section. The image section contains the actual data of the medical image, and the header section contains additional information about the medical image. It is included.

[0018] The supplementary information includes, for example, patient information, examination information, series information, and detailed image information. The patient information includes various information related to the patient in the medical image, such as patient identification information (for example, a patient ID) for identifying the patient, the patient's name, sex, and date of birth. The examination information includes various information related to the examination, such as examination identification information (eg, examination ID) for identifying the examination, the examination date, and the doctor in charge. The image detail information includes various information related to the image, such as the time when the image was generated, the file path name indicating the storage location of the medical image, examination comments, the measurement position of the lesion, and the measurement results. The series information includes various information regarding the series, such as a series number for identifying a series within the same examination, the type of modality (medical imaging device 2) that generated the medical images included in the series, the examination area, the total number of frames if the medical images are dynamic images, and the frame numbers assigned to each image in the series.

[0019] When an acquisition request is received from the image display device 1 via the communication network N, the image management server 3 reads out medical image data from the medical image DB 31 in response to the request, and transmits the medical image data to the image display device 1.

[0020] [Image display device (image display system)] Further, the image display device 1 (or image display system; the same applies below) in this embodiment will be described in detail. FIG. 2 is a block diagram showing the configuration of the image display device in this embodiment. In this embodiment, as shown in FIG. 2, the image display device 1 is composed of a computer in which a control means 11, a storage means 12, an input means 13, an input / output interface 14, a display means 15, etc. are connected via a bus. The image display device 1 is connected to a communication network N via an input / output interface 14. In this embodiment, the input / output interface 14 is an image acquisition unit that acquires, via the communication network N, medical images obtained by radiography. The input / output interface 14, which is an image acquisition unit, acquires dynamic images obtained by continuously radiographing the dynamics of a target area along a time axis from the image management server 3 (medical image DB 31 held by the image management server 3).

[0021] The image display device 1 may be a general-purpose computer, but it can also be configured as a dedicated device related to medical images. Also, although not shown in the figure, the image display device 1 may be configured as an integrated device that includes a control device such as a console that controls the imaging by the medical image imaging device 2, and an image storage database that stores medical images such as multiple captured frame images. The image display device 1 may be a desktop personal computer, a notebook computer, a tablet terminal device, or a mobile terminal device such as a smartphone.

[0022] The control means 11 includes a CPU (Central Processing Unit) 110, a ROM (Read Only Memory) 111, a RAM (Random Access Memory) 112, and the like. The ROM 111 stores various programs, such as a system program executed by the CPU 110, an image display program that causes each unit to function in order to display an image, and data required for executing these programs. The various programs are stored in the ROM 111 in the form of computer-readable program codes, and the CPU 110 sequentially executes operations in accordance with the program codes. The RAM 112 forms a work area for temporarily storing various programs read from the ROM 111, input or output data, parameters, and the like, during various processes executed and controlled by the CPU 110.

[0023] The storage means 12 is, for example, a non-volatile semiconductor memory or a HDD (Hard Disk Drive). It is configured to store various data and the like. The storage means 12 stores medical images acquired by an input / output interface 14, which is, for example, an image acquisition unit. The input means 13 is composed of, for example, a keyboard, a mouse, a touch panel, etc. The touch panel is integrally formed on the monitor 150 of the display means 15 as described above. In this embodiment, the input means 13 is an input unit that detects and accepts an input action when a user touches or taps an image displayed on the monitor 150. When the input means 13 accepts an input action, it outputs a signal corresponding to the input action to the control means 11.

[0024] In this embodiment, the control means 11 functions as an image reproduction control unit that controls a display means 15 (monitor 150) which is a display unit that displays medical images and will be described later. The control means 11 of this embodiment reproduces and displays the dynamic photographed images in chronological order on the display means 15 (monitor 150) (hereinafter referred to as "dynamic reproduction and display"). The control means 11 executes dynamic playback display at a predetermined frame rate. The control means 11 is capable of displaying the localization reference at a fixed position on the screen so as to be superimposed on a plurality of medical images constituting the dynamic photographed image during the dynamic playback display. FIG. 3 shows an example of dynamic playback display with display of the localization reference MK. The example shown in Fig. 3 is a dynamic imaging image of a lung field. Frame image F1 shown in Fig. 3 is one of a plurality of frame images constituting the dynamic imaging image. Frame image F2 shown in Fig. 3 is one of a plurality of frame images constituting the dynamic imaging image. Frame image F1 and frame image F2 are images separated by a frame number in the time series. For example, frame image F1 may be understood to be the first frame image, and frame image F2 the several tens frame image. Control means 11 starts dynamic playback display based on an operation signal input from input means 13 by a user's operation. Frame image F1 is displayed on monitor 150, and then frame image F2 is displayed, and if there are further frame images, the dynamic playback display continues until the last frame image is displayed.

[0025] As shown in the example of Figure 3, when dynamic playback is displayed, there is movement in the lung fields. On the other hand, the localization reference MK is displayed at a fixed position on the screen 151 of the monitor 150 during the dynamic playback and display as described above. Therefore, by using the localization reference MK as a reference (landmark), the user can recognize the movement of the lung field (movement of the lungs and ribs) and the magnitude of that movement with high visibility. This improves visibility when interpreting dynamic video. For example, when interpreting an adhesion site in the lung, it becomes possible to focus on the movement of the lungs and perform the interpretation without being influenced by the movement of the ribs. It becomes easier to recognize parts that are moving normally and parts that are not moving due to an abnormality such as adhesion.

[0026] The control means 11 can change the display range of the localization reference MK on the screen 151. For example, the control means 11 can set the entire screen 151 as the display range of the localization reference MK, set the display range of the dynamic image as the display range of the localization reference MK as shown in Fig. 3, or set a part of the dynamic image as the display range of the localization reference MK as shown in Fig. 4. This allows the user to select the display range of the localization reference MK, for example, to focus on areas of interest, improving visibility when interpreting images. The display range of the localization reference MK is changed based on an operation signal input from the input means 13 by a user's operation.

[0027] Furthermore, the control means 11 can change the position and angle of the localization reference MK. The control means 11 can move the position of the localization reference MK up and down, for example, as shown in Fig. 5. This allows the user to select the position of the localization reference MK. In Fig. 5, the localization reference MK is shown as a single straight line. In the case of evenly spaced parallel lines as in Figs. 3 and 4, by allowing the position of the localization reference MK to be changed in the same way, the user can select the position of the localization reference MK, improving visibility during interpretation. In addition, the control means 11 can change the angle of the localization reference MK, for example, as shown in FIG. 6. This allows the user to select the angle of the localization reference MK. By placing the localization reference MK at a right angle to the direction of movement of the target area to be observed, the movement of the target area can be made easier to understand. The angle can be set within a range of 360°. The user can select the angle of the localization reference MK, improving visibility during interpretation. The change and setting of the position and angle of the localization reference MK is also performed based on an operation signal input from the input means 13 by a user's operation. Furthermore, the control means 11 can select the position and angle of two parallel straight lines, and can display parallel lines (three or more) at equal intervals including the two straight lines as the localization reference MK. For example, when the user specifies two parallel straight lines passing through the upper and lower ends of the lungs, specifies the angle of the two straight lines, and further specifies the number of parallel lines between the two straight lines, the control means 11 can display parallel lines with the corresponding position, angle, and pitch as the localization reference MK. Note that only one of the position and the angle of the localization reference MK may be made changeable.

[0028] Furthermore, the control means 11 can selectively set one or more of the interval between parallel lines, the number of lines, and the thickness of the lines as shown in FIG. 3 and FIG. This allows the user to select a configuration of parallel lines that is easily visible, improving visibility during image interpretation. Changes to the spacing between parallel lines, the number of lines, and line thickness are also made based on operation signals input from the input means 13 by the user.

[0029] Furthermore, the control means 11 can display the localization reference MK at a fixed position on the screen 151 while zooming in and out and panning the medical image during dynamic playback and display. The control means 11 can display the enlargement and reduction of a medical image, for example, as shown in Fig. 7, and can display the panning of a medical image, as shown in Fig. 8. The enlargement and reduction and panning are also performed based on an operation signal input from the input means 13 by a user's operation. In the case of panning, the localization reference MK does not move relative to the screen 151 even if it moves in a direction that intersects obliquely or perpendicularly with the lines constituting the localization reference MK. In such enlargement / reduction (FIG. 7) and panning (FIG. 8), the localization reference MK is fixed at a fixed position on the screen 151. The localization reference MK does not move, improving visibility during image interpretation. It is also possible to implement only one of the enlargement / reduction and panning. In addition, the zooming in / out and panning of medical images may be possible only while dynamic playback display is stopped. In this case, dynamic playback display is executed in the display range after zooming in / out and / or panning while the display is stopped, if a dynamic playback operation is performed. In addition, the enlargement / reduction and panning of the medical image may be performed during dynamic playback display. For example, the display range may be changed according to a preset enlargement / reduction and / or pan path specification (key frame setting) to perform dynamic playback display, or the display range may be changed according to real-time operations to perform dynamic playback display. In addition, a function may be further provided in which the stereotactic reference MK is fixed with respect to the medical image and the stereotactic reference MK is enlarged / reduced and / or panned integrally with the medical image.

[0030] The present invention can be used not only for chest examinations, but also for examinations such as joint examinations aimed at confirming moving parts. In the above embodiment, the localization reference is shown as an example of one straight line and multiple parallel lines, but the form of the localization reference is not particularly limited, and it is sufficient if it can be a position reference for dynamic photographic images. Other forms of the localization reference include lattice lines, lattice point dots, circles, polygons, and other figures. Furthermore, for the range in which the localization reference overlaps with the dynamic photographed image, the transmittance of the medical image may be set to a value between 0 and 100%. [Explanation of symbols]

[0031] F1 Frame image (medical image) F2 Frame image (medical image) MK localization standard N Communication Network 1 Image display device 2 Medical imaging equipment 3. Image Management Server 11 Control Means 12 Memory means 13 Input methods 14 Input / Output Interface 15 Display means 100 Medical Imaging Systems 110 CPU 150 monitors 151 screens

Claims

1. an image acquisition unit that acquires a plurality of medical images obtained by successively performing radiography on the same target region along a time axis; an image playback control unit that is capable of playing back and displaying the plurality of medical images acquired by the image acquisition unit in chronological order, and displaying a localization reference at a fixed position on the screen over the plurality of medical images during the playing back and display; The image playback control unit of this image display device is capable of selectively executing a function of enlarging or reducing the medical image and a function of enlarging or reducing the localization reference together with the medical image while keeping the localization reference displayed on the screen in the same state without moving it.

2. 2. The image display device according to claim 1, wherein the medical image can be enlarged or reduced only while the reproduction and display are stopped.

3. 3 . The image display device according to claim 1 , wherein the image playback control unit, when the medical image is enlarged or reduced, executes the playback display within the enlarged or reduced display range.

4. 4. The image display device according to claim 1, wherein, when the localization reference is a plurality of parallel lines, the image reproduction control unit does not change the interval between the parallel lines when the medical image is enlarged or reduced.

5. 5. The image display device according to claim 1, wherein the image reproduction control unit is capable of changing a display range on the screen of the localization reference.

6. The image display device according to claim 1 , wherein the image reproduction control unit is capable of changing a position and / or an angle of the localization reference.

7. 7. The image display device according to claim 1, wherein the image reproduction control unit is capable of displaying equally spaced parallel lines as the localization reference.

8. 8. The image display device according to claim 7, wherein the image reproduction control unit is capable of selectively setting any one or more of the interval between the parallel lines, the number of lines, and the line thickness.

9. The computer of the image display device, an image acquisition unit that acquires a plurality of medical images obtained by successively performing radiography on the same target region along a time axis; An image display program for causing the image display control unit to function as an image display control unit that is capable of displaying the plurality of medical images acquired by the image acquisition unit in chronological order and displaying a localization reference at a fixed position on a screen over the plurality of medical images during the display, the image display control unit comprising: The image playback control unit is an image display program that can selectively execute a function of enlarging or reducing the medical image and a function of enlarging or reducing the positioning reference together with the medical image while keeping the positioning reference displayed on the screen in the same state without moving it.

10. 10. The image display program according to claim 9, wherein the medical image can be enlarged or reduced only while the reproduction and display are stopped.

11. 11. The image display program according to claim 9, wherein the image playback control unit, when the medical image is enlarged or reduced, executes the playback display within the enlarged or reduced display range.

12. 12. The image display program according to claim 9, wherein, when the localization reference is a plurality of parallel lines, the image reproduction control unit does not change an interval between the parallel lines when the medical image is enlarged or reduced.

13. 13. The image display program according to claim 9, wherein the image reproduction control section is capable of changing a display range on the screen of the localization reference.

14. 14. The image display program according to claim 9, wherein the image reproduction control unit is capable of changing a position and / or an angle of the localization reference.

15. 15. The image display program according to claim 9, wherein the image reproduction control section is capable of displaying equally spaced parallel lines as the positioning reference.

16. 16. The image display program according to claim 15, wherein the image reproduction control section is operable to selectively set one or more of the interval between the parallel lines, the number of lines, and the line thickness.

Images