Dynamic image analysis device and program
The dynamic image analysis device addresses the challenges of costly and complex pleural adhesion evaluation by using dynamic radiography to measure lung region movement, providing accurate adhesion information with minimal radiation exposure, suitable for general medical facilities.
Patent Information
- Application Number
- JP2021012548
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-01-29
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-01-29
AI Technical Summary
Existing methods for evaluating pleural adhesions, such as CT and ultrasound imaging, are costly, complex, and expose patients to high radiation or require extensive imaging time, making them unsuitable for general medical facilities and preoperative assessments.
A dynamic image analysis device that acquires and analyzes chest images through dynamic radiography to derive pleural adhesion information based on lung region movement, using a derivation unit to determine adhesion presence, strength, and likelihood by measuring movement in a specified direction, with output units displaying this information.
Enables easy and accurate assessment of pleural adhesions with minimal radiation exposure, suitable for general medical facilities, overcoming the limitations of costly and complex imaging technologies.
Smart Images

Figure 0007593147000001 
Figure 0007593147000002 
Figure 0007593147000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a dynamic image analysis device and a program. [Background technology]
[0002] As a technique for evaluating the presence or absence of adhesion between biological tissues and the adhesion site before surgery, for example, Patent Document 1 describes a technique for collecting still images of two time phases, at the time of inspiration and expiration, by a CT device, and evaluating pleural adhesion using the collected still images of the two time phases. In addition, for example, Patent Document 2 describes a technique for calculating a three-dimensional motion vector for each pair of voxels inside and outside the lung surface that are physically close in three-dimensional CT image data (4D data) collected over time, and extracting moving and non-moving parts in the region on the contour line of the lung region based on the smoothness. In addition, for example, Patent Document 3 describes a technique for calculating the motion vector of two structures that are physically and image-positionally close in an ultrasound image, and calculating the degree of adhesion between the two structures. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2016-67832 A [Patent Document 2] JP 2019-180899 A [Patent Document 3] JP 2019-88565 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, CT and 4D-CT are difficult to introduce into general medical facilities due to the cost of the equipment, and the complicated imaging procedures and radiation exposure make them difficult to apply to general preoperative patients. In addition, ultrasound diagnostic equipment does not allow for an overview of the entire subject because it only captures a local area, and capturing the entire subject takes a huge amount of time. In addition, the imaging procedures are difficult. For these reasons, there is also the problem that it is difficult to apply to general preoperative patients.
[0005] The present invention has been made in consideration of the above problems, and has an object to make it possible to easily obtain information regarding pleural adhesions with a small amount of radiation exposure. [Means for solving the problem]
[0006] In order to solve the above problems, the dynamic image analysis device of the invention described in claim 1 comprises: an acquisition unit for acquiring dynamic images of the chest obtained by dynamic radiography; a derivation unit that derives information about pleural adhesion based on a movement amount in a body axis direction of a lung region in the dynamic image; an output unit that outputs the derived information about adhesion; Equipped with.
[0007] The dynamic image analysis device of the invention described in claim 2 comprises: an acquisition unit for acquiring dynamic images of the chest obtained by dynamic radiography; a derivation unit that derives information regarding pleural adhesion based on a movement amount in a specific direction of a lung region in the dynamic image; an output unit that outputs the derived information about adhesion; Equipped with picture, The information about adhesions includes the amount of movement for each small region of the lung region in the dynamic image.
[0008] The invention described in claim 3 is the invention described in claim 2, The derivation unit analyzes the dynamic image to determine a direction of movement of a lung region in the dynamic image as the specific direction, and derives information regarding pleural adhesion based on an amount of movement in the specific direction.
[0009] The invention described in claim 4 is the invention described in claim 2, The derivation unit defines a direction specified by a user operation as the specific direction, and derives information related to pleural adhesion based on an amount of movement in the specific direction.
[0010] The invention described in claim 5 is the invention described in any one of claims 1 to 4, The information regarding adhesion includes at least one of information indicating the presence or absence of adhesion, information indicating the strength of adhesion, and information indicating the likelihood of adhesion.
[0011] The invention described in claim 6 is 1 In the invention described in The information about adhesions includes the amount of movement for each small region of the lung region in the dynamic image.
[0012] The invention described in claim 7 is the invention described in any one of claims 1 to 6, The derivation unit derives information regarding the adhesion for each small region based on the amount of movement for each small region of the lung region in the dynamic image; The output unit outputs information regarding the adhesion for each of the small regions in the dynamic image.
[0013] The invention described in claim 8 is the invention described in claim 7, The information regarding adhesion for each small region includes information as to whether the amount of movement for each small region of the lung region is equal to or smaller than a predetermined threshold value.
[0014] The invention described in claim 9 is the invention described in claim 7, The output unit outputs an image in which a color corresponding to information related to adhesion is added to each of the small regions of the representative frame image of the dynamic image.
[0015] The invention described in claim 10 is the invention described in claim 7, The output unit outputs an image displaying a vector indicating the amount of motion for each small region of a representative frame image of the dynamic image.
[0016] The invention described in claim 11 is the invention described in claim 7, The output unit outputs an image in which a color corresponding to the amount of motion is added to each of the small regions of the representative frame image of the dynamic image.
[0017] The invention described in claim 12 is the invention described in claim 11, the derivation unit derives, for each vertical position of each lung region in the dynamic image, a representative value of the amount of motion for each small region at that vertical position; The output unit outputs an image in which a color corresponding to the representative value for each vertical position of each lung region is applied to a vicinity of each lung region of a representative frame image of the dynamic image.
[0018] The invention described in claim 13 is the invention described in any one of claims 1 to 12, The derivation unit derives information regarding the adhesion for each of the left and right lungs in the dynamic image, The output unit outputs information regarding the adhesion for each of the left and right lungs.
[0019] The invention described in claim 14 is the invention described in claim 13, The information about adhesion derived by the derivation unit for each of the left and right lungs includes a numerical value related to a motion-decreased region where the amount of motion in the lung region is equal to or less than a predetermined threshold value.
[0020] The invention described in claim 15 is the invention described in claim 13 or 14, The information regarding adhesion derived by the derivation unit for each of the left and right lungs includes at least one of the distance between an area in the lung region where the amount of movement is equal to or less than a predetermined first value and an area where the amount of movement is equal to or greater than a second value greater than the first value, or the maximum amount of movement in an area within a predetermined range from an area in the lung region where the amount of movement is equal to or less than a predetermined threshold value.
[0021] The invention described in claim 16 is the invention described in any one of claims 1 to 15, The derivation unit further derives information regarding the adhesion based on an amount of movement of the diaphragm in the dynamic image.
[0022] The invention described in claim 17 is the invention described in any one of claims 1 to 16, The output unit outputs information to warn that the accuracy of the information relating to adhesions is low when the amount of movement of the diaphragm in the dynamic image is equal to or less than a predetermined threshold.
[0023] The invention described in claim 18 is the invention described in any one of claims 2 to 4, When the specific direction is the direction of movement at a specific point of the thorax, the output unit outputs information warning that the accuracy of the information regarding the adhesion is low when the amount of movement of the specific point in the dynamic image is below a predetermined threshold.
[0024] The program of the invention described in claim 19 comprises: Computer, an acquisition unit for acquiring dynamic images of the chest obtained by dynamic radiography; a derivation unit that derives information regarding pleural adhesion based on an amount of movement in a body axis direction of a lung region in the dynamic image; an output unit that outputs the derived information regarding adhesion; Function as.
[0025] The program of the invention according to claim 20 comprises: Computer, an acquisition unit for acquiring dynamic images of the chest obtained by dynamic radiography; a derivation unit that derives information regarding pleural adhesion based on a movement amount in a specific direction of a lung region in the dynamic image; an output unit that outputs the derived information regarding adhesion; Function as 、 The information about adhesions includes the amount of movement for each small region of the lung region in the dynamic image. Effect of the Invention
[0026] According to the present invention, it is possible to easily obtain information regarding pleural adhesions with a small amount of radiation exposure. [Brief description of the drawings]
[0027] [Figure 1] 1 is a diagram showing an overall configuration of a dynamic analysis system according to an embodiment of the present invention. [Diagram 2] 4 is a flowchart showing an imaging control process executed by a control unit of the imaging console of FIG. [Diagram 3] 13 is a flowchart showing adhesion information derivation processing executed by a control unit of the diagnostic console of FIG. [Figure 4] FIG. 2 is a diagram showing a schematic diagram of the movement of the rib cage, diaphragm, and lungs during breathing. [Diagram 5] 4 is a flowchart showing a motion amount MAP creation process executed in step S12 of FIG. 3. [Figure 6] FIG. 6 is a diagram for explaining the pre-processing executed in step S121 of FIG. 5. [Figure 7] FIG. 13 is a diagram for explaining merging of motion vectors. [Figure 8] FIG. 13 is a diagram for explaining a threshold value for determining adhesion. [Figure 9] FIG. 13 is a diagram for explaining an example of calculation of the intrapulmonary area ratio of a region with reduced motion. [Figure 10] This figure shows the non-measurable areas of reduced motion areas (adhesion) based on the combination of diaphragm movement amount and intrapulmonary area rate of reduced motion areas, and the threshold value of intrapulmonary area rate for determining the presence or absence of adhesion according to diaphragm movement amount. [Figure 11] FIG. 13 is a diagram showing an example of an analysis result screen. [Figure 12] FIG. 13 is a diagram showing an example of a summary image indicating the amount of motion for each small region. [Figure 13] FIG. 13 is a diagram showing an example of a summary image showing adhesion strength. [Figure 14]13 is a diagram for explaining a method for specifying the movement direction of the rib cage as a specific direction. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0028] Hereinafter, an embodiment of the present invention will be described with reference to the drawings, however, the scope of the present invention is not limited to the illustrated examples.
[0029] [Configuration of dynamic analysis system 100] First, the configuration of this embodiment will be described. FIG. 1 shows an example of the overall configuration of a dynamic analysis system 100 according to this embodiment. 1, the dynamic analysis system 100 is configured by connecting an imaging device 1 and an imaging console 2 with a communication cable or the like, and connecting the imaging console 2 and a diagnostic console 3 through a communication network NT such as a LAN (Local Area Network). Each device constituting the dynamic analysis system 100 complies with the DICOM (Digital Image and Communications in Medicine) standard, and communication between each device is performed in accordance with DICOM.
[0030] [Configuration of the imaging device 1] The imaging device 1 is an imaging means for imaging periodic (cyclic) dynamics of the chest, such as changes in shape of lung expansion and contraction accompanying respiratory motion, and heartbeat. Dynamic imaging refers to obtaining a plurality of images showing the dynamics of a subject by repeatedly irradiating the subject with pulsed radiation such as X-rays at a predetermined time interval (pulse irradiation) or continuously irradiating the subject with a low dose rate without interruption (continuous irradiation). A series of images obtained by dynamic imaging is called a dynamic image. A dynamic image is a three-dimensional image including a time axis. Each of the plurality of images constituting a dynamic image is called a frame image. In the following embodiment, a case where dynamic imaging of the front of the chest is performed by pulse irradiation will be described.
[0031] The radiation source 11 is disposed at a position facing the radiation detection unit 13 with the subject M in between, and irradiates the subject M with radiation (X-rays) under the control of the radiation irradiation control device 12. The radiation irradiation control device 12 is connected to the imaging console 2, and controls the radiation source 11 based on the radiation irradiation conditions input from the imaging console 2 to perform radiation imaging. The radiation irradiation conditions input from the imaging console 2 include, for example, a pulse rate, a pulse width, a pulse interval, the number of imaging frames per imaging, the value of the X-ray tube current, the value of the X-ray tube voltage, and the type of additional filter. The pulse rate is the number of radiation irradiations per second, and coincides with the frame rate, which will be described later. The pulse width is the radiation irradiation time per radiation irradiation. The pulse interval is the time from the start of one radiation irradiation to the start of the next radiation irradiation, and coincides with the frame interval, which will be described later.
[0032] The radiation detection unit 13 is composed of a semiconductor image sensor such as a flat panel detector (FPD). The FPD has, for example, a glass substrate or the like, and a plurality of detection elements (pixels) are arranged in a matrix at predetermined positions on the substrate. The detection elements (pixels) detect radiation irradiated from the radiation source 11 and transmitted through at least the subject M according to its intensity, and convert the detected radiation into an electrical signal and accumulate the signal. Each pixel is equipped with a switching unit such as a thin film transistor (TFT). There are two types of FPD: an indirect conversion type that converts X-rays into an electrical signal by a photoelectric conversion element via a scintillator, and a direct conversion type that directly converts X-rays into an electrical signal, and either type may be used. The radiation detection unit 13 is disposed opposite the radiation source 11 with the subject M interposed therebetween.
[0033] The reading control device 14 is connected to the imaging console 2. The reading control device 14 controls the switching unit of each pixel of the radiation detection unit 13 based on the image reading conditions input from the imaging console 2, switches the reading of the electrical signals accumulated in each pixel, and acquires image data by reading the electrical signals accumulated in the radiation detection unit 13. This image data is a frame image. The reading control device 14 outputs the acquired frame image to the imaging console 2. The image reading conditions are, for example, a frame rate, a frame interval, a pixel size, an image size (matrix size), etc. The frame rate is the number of frame images acquired per second, and is equal to the pulse rate. The frame interval is the time from the start of acquisition of one frame image to the start of acquisition of the next frame image, and is equal to the pulse interval.
[0034] The radiation irradiation control device 12 and the reading control device 14 are connected to each other and exchange synchronous signals with each other to synchronize the radiation irradiation operation and the image reading operation.
[0035] [Configuration of the imaging console 2] The imaging console 2 outputs radiation irradiation conditions and image reading conditions to the imaging device 1 to control the radiation imaging and radiation image reading operations by the imaging device 1, and also displays dynamic images acquired by the imaging device 1 so that the imaging technician or other person performing the imaging can check the positioning and whether the images are suitable for diagnosis. As shown in FIG. 1, the radiography console 2 is configured to include a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, and a communication unit 25, and each unit is connected by a bus .
[0036] The control unit 21 includes a CPU (Central Processing Unit), a RAM (Random Access Memory The CPU of the control unit 21 reads out the system program and various processing programs stored in the storage unit 22 in response to the operation of the operation unit 23, loads them in the RAM, and executes various processes including an imaging control process described below in accordance with the loaded programs, thereby centrally controlling the operation of each unit of the imaging console 2 and the radiation irradiation operation and reading operation of the imaging device 1.
[0037] The storage unit 22 is composed of a non-volatile semiconductor memory, a hard disk, etc. The storage unit 22 stores various programs executed by the control unit 21, parameters required for executing processes by the programs, data such as processing results, etc. For example, the storage unit 22 stores a program for executing the imaging control process shown in Fig. 2. The storage unit 22 also stores radiation irradiation conditions and image reading conditions in association with the examination target site and imaging direction. The various programs are stored in the form of readable program codes, and the control unit 21 sequentially executes operations in accordance with the program codes.
[0038] The operation unit 23 is configured with a keyboard equipped with cursor keys, numeric input keys, various function keys, etc., and a pointing device such as a mouse, and outputs instruction signals input by key operations on the keyboard or mouse operations to the control unit 21. The operation unit 23 may also be equipped with a touch panel on the display screen of the display unit 24, and in this case, outputs instruction signals input via the touch panel to the control unit 21.
[0039] The display unit 24 is composed of a monitor such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and displays input instructions and data from the operation unit 23 according to instructions of a display signal input from the control unit 21.
[0040] The communication unit 25 includes a LAN adapter, a modem, a TA (Terminal Adapter), etc., and controls data transmission and reception between each device connected to the communication network NT.
[0041] [Configuration of diagnostic console 3] The diagnostic console 3 is a dynamic image analyzer that acquires dynamic images of the chest from the radiography console 2, and calculates and outputs information relating to pleural adhesion based on the acquired dynamic images. As shown in FIG. 1, the diagnostic console 3 comprises a control unit 31, a storage unit 32, an operation unit 33, a display unit , and a communication unit , and each unit is connected by a bus .
[0042] The control unit 31 is composed of a CPU, a RAM, etc. The CPU of the control unit 31 reads out the system program and various processing programs stored in the storage unit 32 in response to the operation of the operation unit 33, expands them in the RAM, and executes various processes including the collusion information derivation process described below according to the expanded programs, thereby centrally controlling the operation of each unit of the diagnostic console 3. The control unit 31 functions as an acquisition unit and a derivation unit by executing the collusion information derivation process.
[0043] The storage unit 32 is composed of a non-volatile semiconductor memory, a hard disk, etc. The storage unit 32 stores various programs, including a program for executing adhesion information derivation processing in the control unit 31, parameters required for executing processing by the programs, or data such as processing results. These various programs are stored in the form of readable program codes, and the control unit 31 sequentially executes operations in accordance with the program codes.
[0044] The operation unit 33 is configured with a keyboard equipped with cursor keys, numeric input keys, various function keys, etc., and a pointing device such as a mouse, and outputs instruction signals input by the user operating the keyboard or the mouse to the control unit 31. The operation unit 33 may also be equipped with a touch panel on the display screen of the display unit 34, and in this case, outputs instruction signals input via the touch panel to the control unit 31.
[0045] The display unit 34 is configured with a monitor such as an LCD or a CRT, and performs various displays according to instructions of a display signal input from the control unit 31. The display unit 34 functions as an output unit.
[0046] The communication unit 35 includes a LAN adapter, a modem, a TA, etc., and controls data transmission and reception between each device connected to the communication network NT.
[0047] [Operation of dynamic analysis system 100] Next, the operation of the dynamic analysis system 100 in this embodiment will be described.
[0048] (Operation of imaging device 1 and imaging console 2) First, the imaging operation performed by the imaging device 1 and the imaging console 2 will be described. 2 shows an imaging control process executed in the control unit 21 of the imaging console 2. The imaging control process is executed by the control unit 21 in cooperation with a program stored in the storage unit 22.
[0049] First, the person performing imaging operates the operation unit 23 of the imaging console 2 to input patient information and examination information of the subject (subject M) (step S1).
[0050] Next, the radiation irradiation conditions are read out from the storage unit 22 and set in the radiation irradiation control device 12, and the image reading conditions are read out from the storage unit 22 and set in the reading control device 14 (step S2).
[0051] Next, the process waits for an instruction to irradiate radiation via operation of the operation unit 23 (step S3). Here, the person performing radiography performs positioning by placing the subject M between the radiation source 11 and the radiation detection unit 13. When preparations for radiography are complete, the person operates the operation unit 23 to input an instruction to irradiate radiation.
[0052] When a radiation irradiation instruction is input by the operation unit 23 (step S3; YES), an imaging start instruction is output to the radiation irradiation control device 12 and the reading control device 14, and dynamic imaging is started (step S4). That is, radiation is irradiated by the radiation source 11 at a pulse interval set in the radiation irradiation control device 12, and frame images are acquired by the radiation detection unit 13. During dynamic imaging, the person performing imaging performs breathing induction, for example, "breathe in," "hold your breath," and "breathe out." Note that the imaging device 1 may be equipped with an audio output unit and a display unit, and when an imaging start instruction is output, breathing induction or breath-holding instructions such as "breathe in," "hold your breath," and "breathe out" may be audibly or displayed.
[0053] When an instruction to end radiation irradiation is inputted by the operation unit 23, the control unit 21 outputs an instruction to end imaging to the radiation irradiation control device 12 and the reading control device 14, and the imaging operation is stopped.
[0054] The frame images acquired by imaging are input sequentially to the imaging console 2, and are stored in the memory unit 22 in association with numbers (frame numbers) indicating the imaging order (step S5), and are also displayed on the display unit 24 (step S6). The imaging operator checks the positioning, etc., from the displayed dynamic images, and judges whether an image suitable for diagnosis has been acquired by imaging (imaging OK) or whether reimaging is necessary (imaging NG). Then, the operator operates the operation unit 23 to input the judgment result.
[0055] When a judgment result indicating that imaging is OK is input by a predetermined operation of the operation unit 23 (step S7; YES), information such as an identification ID for identifying the dynamic image, patient information, examination information, radiation irradiation conditions, image reading conditions, and a number indicating the imaging order (frame number) is added to each of the series of frame images acquired by dynamic imaging (for example, written in the header area of the image data in DICOM format), and transmitted to the diagnostic console 3 via the communication unit 25 (step S8). Then, this process ends. On the other hand, when a judgment result indicating that imaging is NG is input by a predetermined operation of the operation unit 23 (step S7; NO), the series of frame images stored in the memory unit 22 are deleted (step S9), and this process ends. In this case, re-imaging is required.
[0056] (Diagnosis console 3 operation) Next, the operation of the diagnostic console 3 will be described. In the diagnostic console 3, when a series of frame images of dynamic images of the chest are received from the radiography console 2 via the communication unit 35, the adhesion information derivation process shown in Figure 3 is executed in cooperation with the control unit 31 and the program stored in the memory unit 32.
[0057] As shown in Fig. 4, the rib cage (indicated by the symbol T in Fig. 4) and the diaphragm (indicated by the symbol D in Fig. 4) are containers for the soft lungs (indicated by the symbol L in Fig. 4), and when we want to breathe, by moving the rib cage and the diaphragm, the lungs expand and contract due to changes in internal pressure, allowing air to go in and out. In breathing movements, the lungs expand and contract due to the up and down movement of the diaphragm and the expansion and contraction of the rib cage. Generally, the up and down movement of the diaphragm is dominant. Normally, the thorax and the lungs are separated, but when adhesion (pleural adhesion) occurs between the parietal pleura and the pulmonary pleura due to inflammation or other reasons, the thorax and the lungs become strongly attached at that point. Therefore, pleural adhesion can be identified by observing how the lungs move in response to an external force, that is, by observing whether the relative positional relationship between the lungs and the nearby thorax is fixed or not when an external force is applied. However, since dynamic images are transmitted images, the positions of the lungs, thorax, and diaphragm in the depth direction cannot be accurately determined, and the relative positional relationship cannot be accurately grasped, making it difficult to identify adhesion using conventional adhesion identification methods. Therefore, the inventors of the present application analyzed dynamic chest images of people with and without pleural adhesions to measure the amount of movement in the body axis direction of the lung region. As a result, it was found that when there is pleural adhesion, the amount of movement in the body axis direction of the lung region corresponding to the adhesion site is below a certain threshold. That is, it was found that adhesions can be accurately identified even in dynamic images by taking the external force as the movement of the diaphragm, which is the dominant movement of the entire lung during breathing, and measuring the amount of movement as the movement direction of the diaphragm, i.e., the amount of movement in the body axis direction. It was also found that the relative positional relationship between the lungs and the nearby thorax can be replaced by the absolute position of the lung region. This makes it possible to identify adhesions even in dynamic images. Therefore, in the adhesion information derivation process shown in FIG. 3, the amount of movement in the body axis direction of the lung region in the dynamic image is measured and used to derive information about pleural adhesions. In order to measure the movement in the body axis direction, the present invention is not limited to frontal photography, and photography may be performed from a direction roughly perpendicular to the body axis direction, such as from the side or obliquely. In addition, photography is performed in an upright position, where the direction of gravity and the body axis direction coincide, enabling stable measurement, but photography in a sitting or lying position is also acceptable. Although the body axis direction is the head-to-tail direction of a person or animal, there is no need to measure the head-to-tail position precisely, and by capturing an image in the correct posture, it may be processed as being in a predetermined direction of the radiation detection unit 13 (FPD) or image. In addition, if the spine angle is significantly tilted, the body axis direction may be redefined in accordance with the captured image, for example, to correspond to the spine angle.
[0058] The adhesion information derivation process will be described below with reference to FIG. First, the control unit 31 acquires a dynamic image received by the communication unit 35 (step S11). Next, the control unit 31 performs a motion amount MAP creation process on the acquired dynamic image (step S12). The motion amount map creation process is a process of extracting corresponding points for each small lung region between frame images in a dynamic image, and extracting a motion vector for each small lung region from the change in the position of the corresponding points. Note that, in this embodiment, the small region is a pixel, but it may be a pixel block consisting of multiple pixels.
[0059] 5 is a flowchart showing the flow of the motion amount MAP creation process executed in step S12. The motion amount MAP creation process is executed by the control unit 31 in cooperation with a program stored in the storage unit 32. First, the control unit 31 performs pre-processing on the dynamic image (step S121).
[0060] In the pre-processing, the control unit 31 acquires frame images of a section to be analyzed (used to derive information related to pleural adhesion) from the dynamic image.
[0061] For example, the control unit 31 acquires frame images of an expiratory period (e.g., from the maximum inhalation position to the maximum exhalation position) as frame images of a section to be analyzed. The frame images of the expiratory period can be acquired, for example, by recognizing a lung region from each frame image of a dynamic image and extracting frame images in which the area of the recognized lung region is from maximum (maximum) to minimum (minimum). Alternatively, the distance between the lung apex and the diaphragm may be measured from each frame image of a dynamic image, and frame images of a section in which the distance between the lung apex and the diaphragm is from maximum (maximum) to minimum (minimum) may be acquired as frame images of the expiratory period. Alternatively, frame images of a section in which the density (average density) of the lung region of a dynamic image is from maximum (maximum) to minimum (minimum) may be acquired as frame images of the inhalation period. The section to be analyzed may be designated by the user.
[0062] Next, as shown in FIG. 6, the control unit 31 first performs bone suppression processing (BS processing) on each acquired frame image (original image) to recognize bone areas and reduce the signal components of the bone to generate a bone suppression image (BS image), and then performs frequency emphasis processing on the generated BS image to obtain a frequency emphasis image. Here, in each frame image of the dynamic chest image, not only the lungs but also various structures such as ribs are expressed on one image. Therefore, if the corresponding points of the pattern on the image are simply calculated in order to extract the motion vector of the lungs, they will be mixed with the corresponding points of the bones that move differently from the lungs. Therefore, by performing bone weakening processing on the original image, the corresponding points of the lungs can be calculated with high accuracy in the subsequent processing. Furthermore, since the pattern of the lung area visible in the dynamic image is mainly the pulmonary blood vessels and is composed of high-frequency components, and the characteristics of the organs outside the lungs, fat, muscles, etc. appear in the low-frequency components, it is desirable to perform frequency emphasis processing in advance to emphasize specific high-frequency components corresponding to the pulmonary blood vessels. In addition, in order to further weaken the bone pattern on the outer thoracic rim, noise may be added to the outside or boundary of the lung field area. The outside of the lung field area used in this case does not include the longitudinal rib cage and the lower part of the diaphragm where no bone pattern exists.
[0063] Next, the control unit 31 performs optical flow between adjacent frame images in the time direction (hereinafter, between adjacent frame images) for the pre-processed frame images of the section to be analyzed, and calculates motion vectors by finding corresponding points between adjacent frame images for each small region (step S122). For example, a motion vector between adjacent frame images is calculated for each small region using dense optical flow. Note that although the motion vector is calculated between adjacent frame images here, it is also possible to calculate a motion vector with a frame image n frames ahead (n is a positive integer). Also, in order to reduce measurement errors in motion caused by heartbeat, n may be set to the number of frames in one cardiac cycle. Note that the motion vector calculation needs to be performed at least for each small region of the lung region.
[0064] Next, the control unit 31 merges (integrates) the multiple motion vectors obtained in step S122 for each small region (step S123).
[0065] FIG. 7 is a diagram for explaining the merge process of step S123. Here, motion vectors from the start frame to the end frame are calculated. As shown in FIG. 7, in step S123, first, the sum (indicated by a thick arrow in FIG. 7) of the motion vector obtained in step S122 from the start frame (frame 1) and the frame adjacent to the start frame (frame 1+n) and the motion vector obtained from the frame adjacent to the start frame (frame 1+n) and the frame next adjacent to the start frame (frame 2+n) is calculated. Next, the sum of the calculated motion vectors and the sum of the next motion vector is calculated. This is repeated until all of the calculated motion vectors are added. This makes it possible to calculate a motion vector that represents the movement from the start frame image to the end frame image of the analysis target. This motion vector is saved in the vector start coordinates or vector end coordinates. For example, if a representative frame image, which will be described later, is a frame image at the maximum respiratory position, the motion vector can be saved in the vector end coordinates.
[0066] The above-mentioned motion vector calculation method is an example, and the method is not particularly limited as long as the motion vector for each small region from the start frame image to the end frame image of the exhalation period can be calculated. However, during a deep breathing period (about 5 seconds), the positional movement and deformation of the lungs due to breathing are large, so that the appearance of the image changes drastically, and it is very difficult to calculate corresponding points on the image. Therefore, as described above, for example, corresponding points are calculated in short time units, such as between adjacent frame images in the time direction, and motion vectors are calculated, and then the motion vectors are merged, so that the motion vector of the exhalation period can be calculated with high accuracy. As post-processing of the motion vector calculation results, various types of filtering such as Gaussian filtering may be performed to remove noise.
[0067] Then, the control unit 31 calculates the amount of motion in the body axis direction (upward) for each small region based on the calculated motion vector (the length of the motion vector in the body axis direction (upward)), creates a motion amount MAP indicating the amount of motion in the body axis direction for each small region (step S124), and proceeds to step S13 in Fig. 3. When creating the motion amount MAP, the motion vectors for each small region outside the lung field region may be removed as non-targets. The lung field region may be extracted using existing lung field recognition processing.
[0068] In addition, since the dynamic image is a transparent image, multiple structures (mainly pulmonary blood vessels with different movements) may overlap in the depth direction from ventral to dorsal. Therefore, in step S12, the motion vectors of the pulmonary blood vessels overlapping in the depth direction in each small region may be calculated, and the motion amount in the body axis direction (upward direction) that has the smallest motion amount (length of the motion vector in the body axis direction (upward direction)) may be used as the motion amount in the body axis direction of that small region to create a motion amount MAP. For example, after the above-mentioned preprocessing, images are created in which the pulmonary blood vessels running in multiple angular directions are emphasized using multiple Gabor filters with different angles (directions) for the frame images of the section to be analyzed, and a motion vector is calculated for each image in which the pulmonary blood vessels in each angular direction are emphasized by performing the above-mentioned steps S121 to S123. Then, the amount of motion in the body axis direction (upward) (the length of the motion vector in the body axis direction (upward)) is calculated for each small area of the image in which the pulmonary blood vessels in each angular direction are emphasized, and the smallest one for each small area may be used as the amount of motion in the body axis direction for that small area to create a motion amount MAP.
[0069] Returning to FIG. 3, in step S13, the control unit 31 derives information related to pleural adhesion based on the created movement amount MAP (step S13). Information regarding pleural adhesion may be derived for each small region of the dynamic image, or for each of the left and right lungs. Each of these will be described below. In the following description, adhesion refers to pleural adhesion.
[0070] (1) Information on adhesions in each small area The information regarding adhesion for each small region includes, for example, at least one of information indicating the presence or absence of adhesion, information indicating adhesion likelihood (likelihood of adhesion), information indicating adhesion strength, and information indicating the amount of movement in the body axis direction. The information indicating the presence or absence of adhesion is information derived based on the comparison result by comparing the length of the motion vector in the body axis direction (upward) for each small region (i.e., the amount of movement in the body axis direction (upward)) with a predetermined threshold. For example, if the length of the motion vector in the body axis direction is equal to or less than a predetermined threshold, it is determined that there is adhesion, and if it exceeds the predetermined threshold, it is determined that there is no adhesion, and the determination result is used as information indicating the presence or absence of adhesion. The information indicating adhesion strength is information derived based on the comparison results by preparing multiple thresholds for the length of the motion vector in the body axis direction (upward direction), comparing the length of the motion vector in the body axis direction (upward direction) with the multiple thresholds for each small region. For example, a first threshold and a second threshold are set (first threshold>second threshold), and if the length of the motion vector in the body axis direction (upward direction) exceeds the first threshold, it is determined that there is no adhesion, if it exceeds the second threshold but is equal to or less than the first threshold, it is determined that there is weak adhesion, and if it is equal to or less than the second threshold, it is determined that there is strong adhesion, and the determination result is information indicating adhesion strength. The information indicating the adhesion likelihood is information derived for each small region based on the difference between a predetermined threshold and the length of the motion vector in the body axis direction (upward) (see the arrow in FIG. 8). For example, the difference obtained by subtracting the length of the motion vector in the body axis direction (upward) from the predetermined threshold is calculated, and when the calculated difference is 0 or less, the adhesion likelihood is 0, and when the length of the motion vector in the body axis direction (upward) is 0, the adhesion likelihood is 1. The calculated value is used as the information indicating the adhesion likelihood.
[0071] The threshold for deriving the presence or absence of adhesion, adhesion likelihood, and adhesion strength is a value obtained experimentally or empirically, and may be a fixed value (TH1), may be increased as the distance from the apex of the small region increases (TH2), or may be increased as the distance from the apex of the small region x the amount of movement of the diaphragm increases (TH3), as shown in Fig. 8. This is because movement is small near the apex of the lung even if there is no adhesion, and when the movement of the diaphragm is small, the movement of the lung is small even if there is no adhesion. In addition, the adhesion likelihood may be multiplied by a coefficient according to the distance from the apex of the lung, or by a coefficient according to the amount of movement of the diaphragm, for example, to the adhesion likelihood calculated with a fixed threshold.
[0072] Here, as a threshold for determining the presence or absence of adhesion, it is preferable to use a threshold for determining that strong adhesions corresponding to grade 2 or higher in Reference 1 are "adhesion present" (Reference 1; Junko Tokuno et al, "Preoperative detection of pleural adhesions by respiratory dynamic computed tomography", World Journal of Surgical Oncology 15, 2017). Strong adhesions of grade 2 or higher in Reference 1 require advanced techniques to peel off the adhesions during surgery, which increases the risk of bleeding, and it is preferable to perform open chest surgery rather than thoracoscopic surgery in order to improve the workability of the surgery. By providing information on the presence or absence of such strong adhesions to the user, the doctor, it can be used to assist the doctor in selecting a surgical technique. In addition, as a threshold value for determining adhesion strength, it is preferable to use a threshold value that determines, for example, strong adhesions corresponding to grade 2 or higher in Reference 1 as "strong adhesions," band adhesions of grade 1 as "weak adhesions," and grade 0 as "no adhesions." For example, when the thresholds are fixed values, the threshold (first threshold) for determining weak adhesions can be set to 6 mm, and the threshold (second threshold) for determining strong adhesions can be set to 1 mm.
[0073] The information indicating the presence or absence of adhesion and the information indicating the adhesion strength may be derived based on a comparison result between the information indicating the adhesion likelihood and a threshold. For example, when the adhesion likelihood is equal to or greater than a predetermined threshold (different from the threshold of the length of the motion vector in the body axis direction), adhesion is present, and when the adhesion likelihood is below the predetermined threshold, adhesion is not present. The information on adhesion for each small region may be the amount of motion in the body axis direction itself, or may be a result of a motion reduction determination that determines whether the length of the motion vector in the body axis direction is equal to or less than a predetermined threshold. A motion reduction region can be calculated based on the result of the motion reduction determination. When calculating the motion-reduced region, various types of filtering such as a morphological filter may be performed as post-processing to remove minute noise regions.
[0074] In this way, by deriving information indicating the presence or absence of adhesion for each small region in the lung region of the dynamic image, the doctor, who is the user, can grasp whether there is pleural adhesion and, if there is, where the adhesion is. Also, by deriving information indicating the adhesion likelihood for each small region in the lung region of the dynamic image, the doctor can grasp the likelihood of adhesion for each local region of the lung. Also, by deriving information indicating adhesion strength for each small region in the lung region of the dynamic image, the doctor can grasp whether there is pleural adhesion and, if there is, the presence and location of strong adhesion that affects the selection of the surgical technique.
[0075] (2) Information on adhesions between the left and right lungs Information regarding adhesions for the left and right lungs includes, for example, at least one of the following: information indicating the presence or absence of adhesions for the left and right lungs, information indicating the likelihood of adhesion (likelihood of adhesion), information indicating the strength of adhesion, information indicating the area of the area of reduced motion, information regarding the proximity of areas of low motion and areas of high motion, the position of the bottom end of the area of reduced motion, the left-right symmetry of the area of reduced motion, and the presence or absence of reduced motion at a specific position.
[0076] As described above, it is important for a doctor to know in advance whether or not there is adhesion in lung surgery. In particular, in the case of a wide range of areas, the difficulty and time required for the procedure to remove adhesions increases, so there is a high need to select thoracotomy rather than thoracoscopy. Therefore, for each of the left and right lungs, the motion-decreased area is calculated and its intrapulmonary area ratio is calculated, and information indicating the presence or absence of adhesion for each of the left and right lungs is derived based on the calculated intrapulmonary area ratio of the motion-decreased area. For example, for each small area, the length of the motion vector in the body axis direction (upward) is compared with a predetermined threshold, and a small area below the predetermined threshold is determined as a motion-decreased area. Then, if the intrapulmonary area ratio of the motion-decreased area is equal to or greater than the predetermined threshold, it is determined that there is adhesion, and if it is less than the predetermined threshold, it is determined that there is no adhesion, and the determination result is used as information indicating the presence or absence of adhesion for each of the left and right lungs. The threshold for determining the motion-decreased area may be, for example, the same as that used when deriving the information indicating the presence or absence of adhesion for each of the above-mentioned small areas. In addition, the predetermined threshold (threshold of intrapulmonary area ratio) used for adhesion determination for each of the left and right lungs may be, for example, 1 / 3 or 0.5. This is because a typical example of the size of adhesions that needs to be understood before surgery is about one-third of the pleura, and experimental results have shown that cases of large adhesions to date have shown reduced movement of about half of the lung.
[0077] When the diaphragm is moved in an upright position, the upper lung moves little due to the effect of gravity even if there is no adhesion. Therefore, the upper lung (for example, the upper 1 / 3 region of the lung as shown in FIG. 9) may be excluded from the calculation range of the intrapulmonary area ratio of the low-motion region. For example, if the region determined to be the low-motion region in FIG. 9 is the region surrounded by a thick frame, the ratio of the low-motion region in the middle-lower lung region (the finely hatched region in FIG. 9) to the entire middle-lower lung region (the region formed by combining two hatched regions with different intervals in FIG. 9) may be calculated as the intrapulmonary area ratio. In addition, when the position from the lung apex to the diaphragm apex (lower end) is normalized by 0 to 1, if there is a low-motion region in a region equal to or greater than a predetermined threshold value, such as 1 / 3 or more, information on the presence or absence of adhesion for each of the left and right lungs may be derived. This is because adhesion spreads from top to bottom, and if there is adhesion at the lower part, it can be determined that adhesion has spread over a wide area.
[0078] Furthermore, information regarding adhesions for each of the left and right lungs may be derived based on the information regarding adhesions for each of the small regions described above. For example, information on the presence or absence of adhesion for each of the left and right lungs may be derived based on information on the presence or absence of adhesion for each of the small regions.For example, based on information on the presence or absence of adhesion for each of the small regions, the intrapulmonary area ratio of the area with adhesion is calculated for each of the left and right lungs, and if the intrapulmonary area ratio is equal to or greater than a predetermined threshold, it is determined that adhesion exists, and if it is less than the predetermined threshold, it is determined that adhesion does not exist, and the determination result is information indicating the presence or absence of adhesion for each of the left and right lungs.In addition, as the predetermined threshold (threshold of intrapulmonary area ratio) used for determining adhesion for each of the left and right lungs, for example, 1 / 3, 0.5, etc. can be used as described above.
[0079] Also, for example, information on adhesion strength for each of the left and right lungs may be derived based on information indicating adhesion strength for each small region. For example, based on information on adhesion strength for each small region, the intrapulmonary area ratio of the region determined to be strong adhesion, the intrapulmonary area ratio of the region determined to be weak adhesion, and the intrapulmonary area ratio of the region determined to be no adhesion may be calculated for each of the left and right lungs, and the calculation results may be calculated as information on adhesion strength for each of the left and right lungs. Alternatively, if the intrapulmonary area ratio of the region determined to be strong adhesion is equal to or greater than a predetermined threshold, it may be determined that strong adhesion exists, and if the intrapulmonary area ratio of the region determined to be strong adhesion is less than the predetermined threshold and the intrapulmonary area ratio of the region determined to be weak adhesion is equal to or greater than a predetermined threshold, it may be determined that weak adhesion exists, and the determination results may be information on adhesion strength for each of the left and right lungs. As the predetermined threshold (threshold of intrapulmonary area ratio) used for determining adhesion strength for each of the left and right lungs, for example, 1 / 3, 0.5, etc. may be used as described above.
[0080] Also, for example, information regarding the likelihood of adhesion for each of the left and right lungs may be derived based on information indicating the likelihood of adhesion for each small region. Information regarding the likelihood of adhesion for each of the left and right lungs can be calculated, for example, by the following (Equation 1). Likelihood of adhesion for each left and right lung = Average value of (likelihood of adhesion for each small region) (Equation 1) Alternatively, information regarding the likelihood of adhesion for each of the left and right lungs may be obtained by any of the following (Equation 2) to (Equation 4). Likelihood of adhesion for each left and right lung = Maximum value of (likelihood of adhesion for each small region) (Equation 2) Likelihood of adhesion for each left and right lung = Mean value of the square of (likelihood of adhesion for each small region) (Equation 3) Likelihood of adhesion for each left and right lung = Average value of {MAX(0, 1 - log_a (likelihood of adhesion for each small region) )} (Equation 4) For example, when it is desired to reflect a high adhesion likelihood in the adhesion likelihood for each of the left and right lungs even if the adhesion is in a small area, it is preferable to use (Formula 2). Also, for example, when it is desired to reflect the adhesion likelihood of a large area in the adhesion likelihood for each of the left and right lungs, it is preferable to use (Formula 3) or (Formula 4). In (Formula 3) or (Formula 4), the weight can be lowered when the adhesion likelihood for each small area is low. For example, in (Formula 4), by setting low a to, for example, 0.6, it is possible to design it so that it contributes to the calculation of the adhesion likelihood for each of the left and right lungs when the adhesion likelihood for each small area is 0.6 or more.
[0081] Here, as described above, normal lungs move in the body axis direction with the movement of the diaphragm, so the greater the amount of movement of the diaphragm, the greater the amount of movement of the lungs, and the smaller the amount of movement of the diaphragm, the smaller the amount of movement of the lungs. That is, as shown in FIG. 10, in a graph in which the vertical axis is the intrapulmonary area ratio of the region with reduced movement and the horizontal axis is the amount of movement of the diaphragm, in a region with almost no movement of the diaphragm (the amount of movement of the diaphragm is below a threshold indicated by TH in FIG. 10), the amount of movement of the lungs is small regardless of whether adhesion is present or not, and it is not possible to accurately determine whether the lungs are being moved or not. Therefore, it is preferable to calculate the amount of movement of the diaphragm, and when the amount of movement of the diaphragm is below a predetermined threshold TH, output (for example, display on the display unit 34) a warning indicating that the accuracy of the derived information on adhesion is low. For example, it is preferable to output a message such as "Warning: The movement of the diaphragm is small, so the reduction in movement due to adhesion cannot be measured sufficiently." The amount of movement of the diaphragm in Figure 10 is determined by, for example, recognizing the diaphragm from a dynamic image using image processing such as edge detection, and determining the amount of movement of a representative point of the recognized diaphragm (for example, the apex (upper end) of the diaphragm or a point on a certain measurement line (a fixed x-coordinate position (horizontal coordinate position in the image))).
[0082] Furthermore, the threshold value of the intrapulmonary area ratio when determining the presence or absence of adhesions and adhesion strength for each of the left and right lungs may be changed based on the amount of movement of the diaphragm, as shown by curve l in Fig. 10. Specifically, the threshold value is made smaller as the amount of movement of the diaphragm increases. This is because, if there is no adhesion, the greater the amount of movement of the diaphragm, the greater the movement of the lungs, and therefore the area of reduced movement and the area determined to have adhesions become smaller. The intrapulmonary area ratio of the region with reduced motion for each of the left and right lungs may be calculated as information related to adhesion for each of the left and right lungs.
[0083] In addition, the following information may be derived as information regarding adhesions for each of the left and right lungs. - Information about the proximity of small and large moving areas Information on the proximity of a region with a small amount of movement in the body axis direction and a region with a large amount of movement in the body axis direction may be calculated and displayed as information on adhesion for each of the left and right lungs. For example, one method of calculating the information on the proximity is to calculate the distance between a region with a movement amount in the body axis direction less than a predetermined value (first value) (for example, less than 1 cm) and a region with a movement amount in the body axis direction more than a predetermined value (second value) (for example, more than 4 cm) as the distance between the two regions, and since there is a high possibility of adhesion if the distance between the two regions is less than a predetermined threshold (for example, within 3 cm), the distance between the two regions itself or whether the distance between the two regions is less than a predetermined threshold may be derived and output as information on the proximity. As another method, the maximum amount of movement of a neighboring region (for example, a region within a range of 3 cm around the region) of the region with a movement amount in the body axis direction less than a predetermined value (for example, less than 1 mm) is calculated. Since there is a high possibility of adhesion as the maximum amount of movement itself or a determination result of whether the maximum amount of movement is greater than or equal to a predetermined threshold (for example, more than 3 cm) may be output as information on the proximity. Here, it is preferable that the distance between the two regions and the distance defining the vicinity be a distance measured in the body axis direction in both of the above-mentioned two methods. -Lower end position of the motion reduction area For example, the distance from the apex of the lung to the upper end of the diaphragm or the lower end of the lung region is set to 1.0, and the lower end position of the region with reduced motion is calculated as a numerical value expressed as 0 to 1.0. This is because, due to the effect of gravity when the diaphragm is moved in an upright position and the tendency for adhesions to progress from the upper lung, determining the lower end position of the area of reduced movement can be useful in estimating the extent of adhesions. -Symmetry of areas of reduced movement When lung movement is small due to small diaphragm movement, the movement will be small symmetrically on the left and right, but when the lower end positions of the area of reduced movement differ significantly on the left and right (when the area of reduced movement is asymmetric on the left and right), adhesions are thought to be possible. -Whether or not there is a decrease in movement in a specific location (the location of a specific pulmonary blood vessel or bronchus) When there is reduced movement (movement in the axial direction) of pulmonary blood vessels or bronchi (e.g., A3b of the right pulmonary artery) that are anatomically known to be near the pleura, it is believed that that area has become adhered. For example, the right pulmonary artery A3b runs in the X-ray irradiation direction in the chest front image, so it looks round and conspicuous like a pulmonary nodule. Therefore, for example, the right pulmonary artery A3b is recognized by performing circle detection of about 5 mm square using a Hessian filter or the like near the hilum of the right lung in the dynamic image, and if the amount of movement in the body axis direction of the recognized right pulmonary artery A3b (for example, the amount of upward movement during the exhalation period) is equal to or less than a predetermined threshold, it is determined that there is a decrease in movement, and if it exceeds the threshold, it is determined that there is no decrease in movement. Note that the right pulmonary artery A3b is only an example, and other pulmonary blood vessels or bronchi that are anatomically known to be near the pleura may be recognized, for example, at a specific position in the lung region of the dynamic image by a method similar to that of A3b, and if the amount of movement in the body axis direction is equal to or less than a predetermined threshold, it is determined that there is a decrease in movement, and if it exceeds the threshold, it is determined that there is no decrease in movement.
[0084] When the derivation of the information on adhesion is completed, the control unit 31 displays (outputs) the analysis result screen 341 on which the information on adhesion is displayed on the display unit 34 (step S14).
[0085] Fig. 11 is a diagram showing an example of the analysis result screen 341. As shown in Fig. 11, the analysis result screen 341 is provided with a moving image display area 341a, a summary image display area 341b, a diaphragm movement amount display area 341c, and the like.
[0086] In the moving image display area 341a, a dynamic image acquired by imaging is displayed as a moving image. By displaying the dynamic image as a moving image, a doctor can directly observe the movement of the diaphragm and the lungs and their relationship. As described above, in an X-ray image, the lungs are composed of high-frequency components such as pulmonary blood vessels, and the organs outside the lungs, fat, and muscles are characterized by low-frequency components. Therefore, it is desirable to perform image processing for emphasizing specific high-frequency components or image processing for attenuating specific low-frequency components in advance on the dynamic image to be displayed. In addition, an overlay display (indicated by A in FIG. 11) that surrounds the low-motion area derived in step S13 by operating the operation unit 33 can be switched ON / OFF on the dynamic image. By displaying the low-motion area as an overlay, a doctor can observe the adhesion-likeness by concentrating on the difference in movement inside and outside the low-motion area in a contrast manner. Note that, if there is little body movement, there is no problem in using the same display of the low-motion area for all frame images.
[0087] The summary image display area 341b displays a summary image indicating an analysis result derived by analyzing the dynamic image displayed in the moving image display area 341a. As the summary image, for example, as shown in Fig. 12(a), an image (motion amount MAP) is displayed in which a vector indicating the amount of movement in the body axis direction (upward) of each small area of one frame image (representative frame image, for example, a frame image at maximum inspiration position) of the dynamic image is displayed. Fig. 12(a) shows an example in which a vector is mapped (displayed) on the frame image at maximum inspiration position, but the vector may also be displayed on the frame image at maximum expiration position. Note that the amount of movement in all directions may be displayed as a vector, not limited to the body axis direction. Alternatively, as shown in FIG. 12(b), a summary image (motion amount MAP) may be displayed in which a color is added to each small area of the representative frame image according to the amount of movement (vector length) of the small area in the body axis direction (upward direction). For example, a conversion table between the amount of movement and color may be created by multiplying the amount of movement by a predetermined coefficient, with black (R, G, B=0, 0, 0) as the base point, and allocating the value to R, G, or B. For example, it is desirable to separate the colors into positive and negative, such as G for positive amount of movement and B for negative amount of movement, for good visibility. Negative movement often indicates a change in the absolute position of the lungs due to chest breathing, so it may be hidden (remain black). As the amount of movement increases, any of the values of R, G, or B may be increased linearly or nonlinearly. In order to improve the expressiveness, multiple different colors may be allocated, such as allocating an amount of movement of 0 to +1 cm to G: 0 to 255, and allocating an amount of movement of +1 cm to +4 cm to R: 0 to 255 (fixed G=255). Since doctors often use high-resolution monochrome monitors, the amount of movement from 0 to +4 cm may be assigned to 0 to 255 in monochrome (R=G=B). In order to focus on the reduction in movement, it is desirable to increase the ability to express small movements, such as movements of 1 cm or less, within the limited color gamut, and to decrease the ability to express large movements, such as movements of 4 cm or more, by setting them to a fixed value. Although the image is filled with a specified color, it may be displayed in a transparent color. It is desirable to display the MAP of the amount of movement in the body axis direction only in the lung field region, which is the object of observation. This has the effect of making it easier to observe the dynamic image itself outside the lung field, and making it easier to grasp the positional relationship. The lung field region is usually composed of two regions, the right lung and the left lung, but it may also include the medial vein region and the subdiaphragm region. In addition, it is also possible to allow user input, and to adopt the lung field region input by the user. It is preferable that the dynamic image to be displayed is previously subjected to image processing for emphasizing specific high frequency components or image processing for attenuating specific low frequency components, similar to the dynamic image display area 341a. Also, for each vertical position of each lung in the dynamic image, a representative value (e.g., minimum, average, median, or maximum) of the amount of movement in the body axis direction (upward) of the small region present at that vertical position may be calculated, and a vertical gradation bar 342, which is an image in which a color is applied according to the representative value for each vertical position of each lung region, may be displayed near each lung region in the representative frame image. The vertical gradation bar 342 may display the bottom end position of the motion-decreasing region (indicated by E in FIG. 12(b)) in an identifiable manner. Alternatively, as a summary image, as shown in FIG. 12(c), a representative value (e.g., minimum, average, median, or maximum) of the amount of movement in the body axis direction (upward) of a small area present at each vertical position of each lung may be calculated, and a color corresponding to the calculated representative value may be displayed in the form of a strip on the lung area of a representative frame image of the dynamic image.
[0088] In the display method shown in FIG. 12(b), each small region of the representative frame image may be colored according to the adhesion likelihood of the small region instead of the amount of movement in the body axis direction. A vertical gradation bar of adhesion likelihood may also be displayed. Regarding the presence or absence of adhesion (low motion region), as shown in FIG. 13(a), only the region (low motion region) of the representative frame image that is determined to have adhesion may be colored. Regarding the adhesion strength, as shown in FIG. 13(b), only the small region of the representative frame image that is determined to have adhesion may be colored according to the adhesion strength of the small region. In addition to the summary image, information regarding adhesions for the left and right lungs (at least one of the following information may be displayed: presence or absence of adhesions, adhesion strength, adhesion likelihood, adhesion probability, area ratio of areas of reduced motion, lower end position of areas of reduced motion, left-right symmetry of areas of reduced motion, proximity of areas of low motion and areas of high motion, and presence or absence of reduced motion at a specific position). 12(a) to (c) and 13(a) and (b), only one lung is displayed, but in reality both lungs are displayed. Also, which summary image is to be displayed in the summary image display area 341b can be set by the user by operating the operation unit 33.
[0089] In this way, the display of the summary image can display the amount of movement in the body axis direction for each small region of the lung region, the presence or absence of adhesion, adhesion strength, adhesion likelihood, distribution of the motion-reduced region, etc., so that the doctor can easily grasp the distribution of adhesions, and can assist in interpretation, thereby improving the performance and efficiency of interpretation. In addition, if the summary image in which adhesion information is aggregated is transmitted to the PACS in advance, it can be used as a trigger for the doctor to determine whether or not it is necessary to interpret the dynamic image in detail. In addition, by displaying the motion-reduced region and the motion amount map in the body axis direction superimposed on the summary image, it can be visually confirmed that the extraction method of the "motion-reduced region" overlaid on the dynamic image in the video display area 341a is extracted from the motion amount map in the body axis direction, and it is possible to ensure explainability to the doctor.
[0090] In addition, for example, by displaying information regarding pleural adhesions for each of the left and right lungs in the summary image display area 341b, the doctor can easily understand the pleural adhesions for each of the left and right lungs, thereby improving the performance and efficiency of image interpretation.
[0091] In the diaphragm movement amount display area 341c, a graph showing the time change of the movement amount of the diaphragm in the dynamic image (for example, the movement amount of a representative point of the diaphragm) is displayed. On the graph, the playback position 343 of the dynamic image in the video display area 341a is displayed, and the range 344 of the frame image to be analyzed is displayed in a identifiable manner (for example, surrounded). This allows the doctor to compare the frame image being played with the movement of the diaphragm while displaying (playing) the dynamic image as a video. It also makes it possible to grasp the frame image to be analyzed. The position of the representative point used to calculate the movement amount of the diaphragm may be displayed in the dynamic image displayed in the video display area 341a.
[0092] In the above description, an example was described in which the expiratory period of the dynamic image was analyzed, but the inhalation period may be analyzed. In this case, instead of the body axis direction (upward) described above, a motion vector in the body axis direction (downward) is calculated, and information on adhesion is derived and output based on the amount of movement in the body axis direction (downward). Also, analysis may be performed for each of multiple expiratory and inhalation periods.
[0093] (Modification) Modifications of the above embodiment will now be described. Generally, the lungs move mainly in the body axis direction when breathing, so in the above embodiment, the case where adhesion information is derived based on the amount of movement of the lung area in the body axis direction is described as an example, but in rare cases, there are patients whose lungs move in a diagonal direction when breathing. For example, if one lung has a bulla, the left and right lungs become uneven, and there are cases where the lung moves in a diagonal direction at a slight angle from the body axis when breathing. In such a case, it is desirable to derive adhesion information based on the amount of movement in the diagonal direction, which is the movement direction of the lungs. Therefore, the control unit 31 may, for example, analyze the dynamic image to obtain a trend of the movement direction of the lung, and derive information on adhesion based on the amount of movement in the specific direction of the lung region by setting the obtained direction as the specific direction. For example, a motion vector may be obtained for each small region of the frame image in the analysis target section of the dynamic image by optical flow or the like, and the direction in which the most vectors are facing may be set as the movement direction of the lung, and the movement direction of the lung may be set as the specific direction, and information on adhesion may be derived based on the amount of movement in the specific direction in the lung region. Alternatively, the user may specify the movement direction of the lung by operating the operation unit 33, and the specified direction may be set as the specific region, and information on adhesion may be derived based on the amount of movement in the specific direction in the lung region. For example, the dynamic image may be displayed as a video on the display unit 34, and the user may specify the movement direction by the operation unit 33. Alternatively, a motion vector may be obtained for each small region of the frame image in the analysis target section of the dynamic image by optical flow or the like, and the motion vector may be displayed, and the direction in which the vector selected by the operation unit 33 in the lung region is facing may be set as the specific direction. Furthermore, when it is desired to distinguish adhesions in the upper lung field or the apex, the movement direction of the thorax around the lung field to be observed may be set as the specific direction since the movement of the diaphragm in the upper lung field or the apex is small. For example, as shown in FIG. 14, the user designates one point on the external thoracic edge ET of the thorax that moves with breathing as the specific point P, and the movement of the specific point P during inhalation is extracted and the direction of the movement is set as the specific direction. When adhesions are present in the apex, it is observed that the amount of movement in the specific direction is reduced in the apex, and the apex can be detected as a region (region of reduced movement) where the amount of movement in the specific direction is equal to or less than a predetermined threshold. On the other hand, when the amount of movement (in the specific direction) of the specific point P is equal to or less than a predetermined threshold (e.g., 3 mm), it is desirable to output (e.g., display on the display unit 34) information warning that the accuracy of the derived information on adhesion is low since the thorax, which is an external force, has not moved sufficiently. Here, the user designates the specific point P, but instead, the amount of movement of the thorax may be extracted for each of the left and right lungs, and the point with the maximum amount of movement may be set as the specific point P. In addition, the method for deriving information regarding adhesion may be performed by using the body axis direction of the method described in the above embodiment as the above-mentioned specific direction.The derived information on adhesion may then be displayed on the analysis result screen 341.
[0094] In this way, by deriving information about adhesions based on the amount of movement of the lung region in a specific direction, it is possible to accurately derive information about adhesions even for patients whose lungs cannot move in the body axis direction due to disease.
[0095] As described above, the control unit 31 of the diagnostic console 3 in this embodiment acquires dynamic images of the chest obtained by dynamic radiography, derives information regarding pleural adhesions based on the amount of movement of the lung region in the body axis direction in the acquired dynamic images, and displays and outputs the derived information regarding pleural adhesions on the display unit 34. In addition, the control unit 31 of the diagnostic console 3 in a modified example of this embodiment acquires dynamic images of the chest obtained by dynamic radiography, derives information regarding pleural adhesions based on the amount of movement of the lung area in a specific direction in the acquired dynamic images, and displays and outputs the derived information regarding adhesions on the display unit 34. Therefore, since information on pleural adhesions can be obtained using dynamic images of the chest obtained by dynamic radiography, it becomes possible to easily obtain information on pleural adhesions with a small amount of radiation exposure without using conventional 4D-CT, which is difficult to introduce into general medical facilities due to the cost of the equipment and has problems such as complicated imaging procedures and high radiation exposure, or ultrasound diagnostic equipment, which cannot obtain an overview of the subject as a whole because it is a localized image, and which takes a huge amount of time to image the whole body and has difficult imaging techniques.As a result, it becomes possible to easily obtain information on pleural adhesions of patients before surgery with a small amount of radiation exposure without introducing expensive and large-scale equipment in general medical facilities.
[0096] For example, the control unit 31 can include, as the information on pleural adhesion, information indicating the presence or absence of adhesion, information indicating the strength of adhesion, or information indicating the likelihood of adhesion. Therefore, a doctor can grasp the presence or absence of pleural adhesion, the strength of adhesion, and the likelihood of adhesion of a patient.
[0097] In addition, for example, the control unit 31 derives information about adhesions based on the amount of movement of each small region of the lung region in the dynamic image, so that information about pleural adhesions can be derived with high accuracy. Furthermore, by deriving information about adhesions based on the amount of movement of the diaphragm in the dynamic image, information about pleural adhesions can be derived with high accuracy.
[0098] Furthermore, for example, the control unit 31 derives information regarding pleural adhesions for each small region based on the amount of movement for each small region of the lung area in the dynamic image, and outputs and displays the information on the display unit 34, thereby enabling a doctor to easily grasp the distribution of pleural adhesions, thereby improving the performance and efficiency of image interpretation.
[0099] For example, by outputting an image to which colors are added according to information regarding pleural adhesions derived for each small region of the lung area of a representative frame image of a dynamic image, a doctor can grasp the distribution of pleural adhesions at a glance, thereby improving the performance and efficiency of image interpretation.
[0100] Furthermore, for example, by outputting an image that displays a vector indicating the amount of movement in the body axis direction (or a specific direction) for each small region of the lung region in a representative frame image of a dynamic image, a doctor can grasp at a glance the amount of movement in the body axis direction (or a specific direction) for each small region of the lung region, thereby improving the performance and efficiency of image interpretation.
[0101] In addition, by outputting an image in which a color is added according to the amount of movement in the body axis direction (or a specific direction) for each small region of the lung region in a representative frame image of a dynamic image, a doctor can grasp at a glance the amount of movement in the body axis direction (or a specific direction) for each small region of the lung region, thereby improving the performance and efficiency of image interpretation.
[0102] In addition, by deriving a representative value of the amount of movement in the body axis direction (or a specific direction) for each small area at the vertical position of each lung area in the dynamic image, and outputting an image in the vicinity of each lung area in a representative frame image of the dynamic image in accordance with the representative value for each vertical position of each lung area, a doctor can grasp at a glance the amount of movement in the body axis direction (or a specific direction) for each vertical position, thereby improving the performance and efficiency of image interpretation.
[0103] In addition, by deriving information regarding pleural adhesions for each of the left and right lungs in dynamic images and outputting the information regarding the adhesions for each of the left and right lungs, doctors can easily grasp the pleural adhesions for each of the left and right lungs, thereby improving the performance and efficiency of image interpretation.
[0104] In addition, by deriving areas of reduced motion based on the amount of motion for each small region of the lung area in the dynamic image, and overlaying a display indicating the derived areas of reduced motion on the dynamic image to display the dynamic image as a video, doctors can concentrate on observing the differences in movement inside and outside the areas of reduced motion in a comparative manner.
[0105] In addition, when the amount of movement of the diaphragm in the dynamic image is below a predetermined threshold, information is output warning that the accuracy of the information regarding adhesions is low, allowing the doctor to recognize that the accuracy of the information regarding adhesions is low.
[0106] The above-described embodiment and modified examples are merely preferred examples of the present invention, and the present invention is not limited to these.
[0107] For example, in the above embodiment, an example was given of deriving information regarding pleural adhesions based on the amount of movement in the body axis direction or a specific direction of the lung region in a dynamic image of the front of the chest, but information regarding pleural adhesions may also be derived based on the amount of movement in the body axis direction or a specific direction of the lung region in a dynamic image of the lateral chest.
[0108] In the above embodiment, the display unit 34 is used as the output unit and information regarding pleural adhesion is displayed on the display unit 34, but, for example, the output unit may be the communication unit 35, and information regarding pleural adhesion may be output to an external device via the communication unit 35, and the information regarding pleural adhesion may be displayed on the external device. Also, the diagnostic console 3 may be configured to include a printing unit, and information regarding pleural adhesion may be output on paper by the printing unit.
[0109] In the above description, a hard disk, a non-volatile semiconductor memory, or the like is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. As other computer-readable media, a portable recording medium such as a CD-ROM can be used. Furthermore, a carrier wave can be used as a medium for providing data for the program according to the present invention via a communication line.
[0110] In addition, the detailed configuration and operation of each device constituting the mobile radiation imaging apparatus may be modified as appropriate without departing from the spirit and scope of the present invention. [Explanation of symbols]
[0111] 100 Dynamic Analysis System 1. Imaging device 11 Radiation source 12 Radiation exposure control device 13 Radiation detection unit 14 Read control device 2. Shooting console 21 Control section 22 Memory section 23 Control section 24 Display section 25 Communications Department 26 Bus 3 Diagnostic Console 31 Control Unit 32 Storage section 33 Operation section 34 Display section 35 Communications Department 36 Bus
Claims
1. an acquisition unit for acquiring dynamic images of the chest obtained by dynamic radiography; a derivation unit that derives information about pleural adhesion based on a movement amount in a body axis direction of a lung region in the dynamic image; an output unit that outputs the derived information about adhesion; A dynamic image analysis device comprising:
2. an acquisition unit for acquiring dynamic images of the chest obtained by dynamic radiography; a derivation unit that derives information regarding pleural adhesion based on a movement amount in a specific direction of a lung region in the dynamic image; an output unit that outputs the derived information about adhesion; Equipped with A dynamic image analysis device, wherein the information regarding adhesions includes the amount of movement for each small region of the lung region in the dynamic image.
3. The dynamic image analysis device of claim 2, wherein the derivation unit determines the direction of movement of the lung region in the dynamic image as the specific direction by analyzing the dynamic image, and derives information regarding pleural adhesions based on the amount of movement in the specific direction.
4. The dynamic image analyzer according to claim 2 , wherein the derivation unit defines a direction specified by a user operation as the specific direction, and derives information regarding pleural adhesion based on an amount of movement in the specific direction.
5. A dynamic image analysis device according to any one of claims 1 to 4, wherein the information regarding adhesions includes at least one of information indicating the presence or absence of adhesions, information indicating the strength of adhesions, and information indicating the likelihood of adhesions.
6. The dynamic image analysis device according to claim 1 , wherein the information about adhesions includes the amount of movement for each small region of the lung region in the dynamic image.
7. The derivation unit derives information regarding the adhesion for each small region based on the amount of movement for each small region of the lung region in the dynamic image; The dynamic image analysis device according to claim 1 , wherein the output unit outputs information regarding the adhesion for each of the small regions in the dynamic image.
8. The dynamic image analysis device according to claim 7 , wherein the information regarding the adhesion for each small region includes information regarding whether the amount of movement for each small region of the lung region is equal to or smaller than a predetermined threshold value.
9. The dynamic image analysis device according to claim 7 , wherein the output unit outputs an image in which a color corresponding to information related to adhesion is added to each of the small regions of the representative frame images of the dynamic image.
10. The dynamic image analysis device according to claim 7 , wherein the output unit outputs an image displaying a vector indicating the amount of motion for each small region of the representative frame image of the dynamic image.
11. The dynamic image analysis device according to claim 7 , wherein the output unit outputs an image in which a color corresponding to the amount of movement is added for each small region of the representative frame image of the dynamic image.
12. the derivation unit derives, for each vertical position of each lung region in the dynamic image, a representative value of the amount of motion for each small region at that vertical position; The dynamic image analysis device according to claim 11, wherein the output unit outputs an image in which a color is added near each lung region of a representative frame image of the dynamic image according to the representative value for each vertical position of the lung region.
13. The derivation unit derives information regarding the adhesion for each of the left and right lungs in the dynamic image, The dynamic image analyzer according to any one of claims 1 to 12, wherein the output unit outputs information regarding the adhesion for each of the left and right lungs.
14. The dynamic image analyzer according to claim 13 , wherein the adhesion-related information derived by the derivation unit for each of the left and right lungs includes a numerical value related to a motion-decreased region in which the amount of motion in the lung region is equal to or less than a predetermined threshold value.
15. The dynamic image analysis device according to claim 13 or 14, wherein the information regarding adhesion derived by the derivation unit for each of the left and right lungs includes at least one of a distance between a region in the lung region where the amount of movement is equal to or less than a predetermined first value and a region where the amount of movement is equal to or greater than a second value greater than the first value, or a maximum amount of movement in a region within a predetermined range from a region in the lung region where the amount of movement is equal to or less than a predetermined threshold.
16. The dynamic image analyzer according to any one of claims 1 to 15, wherein the derivation unit further derives information regarding the adhesion based on an amount of movement of the diaphragm in the dynamic image.
17. The dynamic image analysis device according to any one of claims 1 to 16, wherein the output unit outputs information warning that the accuracy of the information regarding the adhesions is low when the amount of movement of the diaphragm in the dynamic image is below a predetermined threshold.
18. A dynamic image analysis device as described in any one of claims 2 to 4, wherein when the specific direction is the direction of movement at a specific point of the thorax, the output unit outputs information warning that the accuracy of the information regarding the adhesion is low when the amount of movement of the specific point in the dynamic image is below a predetermined threshold.
19. Computer, an acquisition unit for acquiring dynamic images of the chest obtained by dynamic radiography; a derivation unit that derives information regarding pleural adhesion based on an amount of movement in a body axis direction of a lung region in the dynamic image; an output unit that outputs the derived information regarding adhesion; A program to function as a
20. Computer, an acquisition unit for acquiring dynamic images of the chest obtained by dynamic radiography; a derivation unit that derives information regarding pleural adhesion based on a movement amount in a specific direction of a lung region in the dynamic image; an output unit that outputs the derived information regarding adhesion; Function as a A program, wherein the information about adhesions includes the amount of movement for each small region of the lung region in the dynamic image.
Citation Information
Patent Citations
Medical image processor, and medical image processing method
JP2016067832A
Dynamic image analysis apparatus
JP2018043068A
Image processing apparatus and medical image taking apparatus
JP2019075123A
Analysis device and analysis program
JP2019088565A
Medical image processing apparatus
JP2019180899A
