Medical image processing device, medical image processing method, and medical image processing program

The medical image processing device addresses the challenge of explaining complex medical test results by displaying them alongside a three-dimensional model, allowing for orientation adjustment and pulsation synchronization, thereby improving understanding for non-medical individuals.

JP2024164857APending Publication Date: 2024-11-28GOODMAN CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023080512
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-16
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Medical professionals face challenges in explaining complex medical test results, such as those from radiation, ultrasound, and magnetism, to patients and their families without specialized knowledge.

Method used

A medical image processing device that displays test results alongside a three-dimensional model of the examination target, allowing for orientation adjustment and synchronization with pulsation, enabling easy understanding by non-medical personnel.

Benefits of technology

Facilitates easy comprehension of medical test results by aligning the three-dimensional model with the examination object's orientation and pulsation, enhancing understanding for non-medical individuals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164857000001_ABST
    Figure 2024164857000001_ABST
Patent Text Reader

Abstract

To provide a medical image processing device that enables display of an inspection result in a manner that even a person without medical expert knowledge can easily understand the inspection result, a medical image processing method, and a medical image processing program.SOLUTION: A medical image processing device acquires an inspection result of inspection that has been performed on an inspection target by an inspection device for clinical examination. The medical image processing device acquires a three-dimensional model indicating the inspection target. The medical image processing device displays a display image 7 including a first display region 71 for displaying the inspection result, and a second display region 72 for displaying the three-dimensional model, on a display unit.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a medical image processing apparatus, a medical image processing method, and a medical image processing program. [Background technology]

[0002] The results of examinations performed by examination devices that use radiation, ultrasound, magnetism, etc. to perform clinical examinations provide medical professionals with useful information in various aspects, such as the state of illness, treatment plans, and assessment of treatment effectiveness. Patent Document 1 discloses an ultrasound image processing device. The ultrasound image processing device generates display images, including B-mode images, overlay images, bull's-eye images, and schematic images, based on the results of ultrasound examinations, and displays them on a display unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-157608 A Summary of the Invention [Problem to be solved by the invention]

[0004] There are cases where medical professionals show test results to patients and their families and explain the condition of the patient. In this case, the test results themselves of clinical tests performed using radiation, ultrasound, magnetism, etc., are often difficult to understand without specialized knowledge. For this reason, there is a demand for a medical image processing device that can display test results on a display unit in a manner that allows even those without medical specialized knowledge to easily understand the results.

[0005] An object of the present invention is to provide a medical image processing device, a medical image processing method, and a medical image processing program that are capable of displaying test results in a manner that allows even those without medical expertise to easily understand the results. [Means for solving the problem]

[0006] The medical image processing device according to the first aspect of the present invention is characterized in that it comprises a first acquisition means for acquiring test results obtained by examining an object to be examined using an examination device that performs clinical examinations, a second acquisition means for acquiring a three-dimensional model representing the object to be examined, and a display means for displaying on a display unit a display image including the test results acquired by the first acquisition means and the three-dimensional model acquired by the second acquisition means.

[0007] The medical image processing device displays on a display unit a display image including the test results from the clinical test device and a three-dimensional model showing the test subject. In this case, a third party who views the display image can confirm the test results in association with the test subject. Therefore, the medical image processing device allows a third party to easily understand the test results even if the third party does not have medical expertise.

[0008] In the first aspect, the first acquisition means may further acquire first information indicating an orientation of the inspection object inspected by the inspection device, and the display means may execute a first display process to specify an orientation of the three-dimensional model corresponding to the orientation of the inspection object based on the first information acquired by the first acquisition means, and to display the display image including the three-dimensional model in the specified orientation and the inspection result on the display unit. Since the orientations of the inspection result and the three-dimensional model included in the display image correspond to each other, a third party who views the display image can easily associate the inspection result with the inspection object and confirm it. Therefore, the medical image processing device can make the inspection result easier to be understood by a third party.

[0009] In the first aspect, the display device may include a first reception means for receiving a change operation for changing the orientation of the three-dimensional model, and the display means may execute the first display process when the change operation is not received, and may execute a second display process when the change operation is received by the first reception means, in which the first display process is stopped and the orientation of the three-dimensional model included in the display image is changed based on the received change operation and displayed on the display unit. A medical professional using the medical image processing device can change the orientation of the three-dimensional model included in the display image to a desired orientation and display it on the display unit. In this case, the medical professional can not only associate the examination result with the three-dimensional model to allow a third party to understand it, but also allow a third party to understand the examination target itself shown by the three-dimensional model.

[0010] In the first aspect, a second reception means for receiving a switching operation for switching the display process may be provided, and when the second reception means receives the switching operation during execution of the second display process, the display means may stop the second display process and execute the first display process. By performing a switching operation during execution of the second display process, a medical professional can easily switch the 3D model, which has been changed to a desired orientation, to an orientation corresponding to the examination result.

[0011] In the first aspect, the first acquisition means may further acquire second information indicating a pulsation timing of the test subject, the second acquisition means may acquire the pulsating three-dimensional model, and the display means may display the three-dimensional model pulsating in accordance with the pulsation timing of the test subject on the display unit based on the second information acquired by the first acquisition means. When the test results expand and contract according to the pulsation of the test subject, the medical image processing device may also expand and contract the three-dimensional model in accordance with the test results. In this case, a third person who views the displayed image can confirm the test subject moving in accordance with the pulsation of the test results in association with the test results.

[0012] In a first aspect, the examination device may be an angiography device that performs fluoroscopic imaging using radiation, and the examination result may be an image captured by the fluoroscopic imaging. The medical image processing device can display a display image including the image captured by the angiography device and a three-dimensional model on a display unit.

[0013] In the first aspect, the examination target may be a heart. The medical image processing device may display, on a display unit, a display image including a three-dimensional model of the heart and examination results.

[0014] A medical image processing method according to a second aspect of the present invention includes a first acquisition step of acquiring an inspection result obtained by inspecting an object by an inspection device that performs clinical inspection, a second acquisition step of acquiring a three-dimensional model showing the object, and a display step of displaying a display image including the inspection result acquired by the first acquisition step and the three-dimensional model acquired by the second acquisition step on a display unit. According to the second aspect, the same effect as that of the first aspect is achieved.

[0015] A medical image processing program according to a third aspect of the present invention causes a computer to execute a first acquisition step of acquiring an inspection result obtained by inspecting an object by an inspection device that performs clinical inspection, a second acquisition step of acquiring a three-dimensional model showing the object, and a display step of displaying, on a display unit, a display image including the inspection result acquired by the first acquisition step and the three-dimensional model acquired by the second acquisition step. According to the third aspect, the same effect as that of the first aspect is achieved. [Brief description of the drawings]

[0016] [Figure 1] 1 is a diagram showing an overview of an inspection system 1 and an electrical configuration of a medical image processing device 3. FIG. [Diagram 2] FIG. 7 shows a display image 7A. [Diagram 3] FIG. 7B is a diagram showing a display image 7B. [Figure 4] FIG. 7C shows a display image. [Diagram 5] FIG. 7D is a diagram showing a display image. [Figure 6] 1 is a flowchart showing medical image processing. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] The embodiments of the present invention will be described with reference to the drawings. The drawings are used to explain technical features that the present invention can employ. The configurations of the described devices are merely illustrative examples and are not intended to be limiting.

[0018] <Overview of Inspection System 1> As shown in FIG. 1, the examination system 1 includes an examination device 2 and a medical image processing device 3. The examination device 2 is an angiography examination device that injects a contrast agent into the blood vessels of a subject P to perform fluoroscopic imaging of the examination target, a so-called angiography device. An example of the examination target is the heart. Note that the following description will be given on the assumption that the examination target is the heart, but the examination target in the present invention is not limited to the heart. The medical image processing device 3 acquires the examination results obtained by the examination device 2 and displays them on a display unit 34. The examination device 2 and the medical image processing device 3 are connected to each other so as to be able to communicate with each other via a network N.

[0019] The examination device 2 includes an arm 21 , an arm moving mechanism 21 A, an X-ray generator 22 , an X-ray detector 23 , a bed 24 , a bed moving mechanism 24 A, an injector 25 , an electrocardiograph 26 , and a console device 27 .

[0020] The arm 21 has a C-shape. The arm moving mechanism 21A rotates the arm 21. An X-ray generator 22 is provided at one end of the arm 21, and an X-ray detector 23 is provided at the other end of the arm 21. The X-ray generator 22 and the X-ray detector 23 face each other across a bed 24. A subject P is held on the bed 24. The bed 24 is moved by a bed moving mechanism 24A. The X-ray generator 22 has an X-ray tube. The X-ray tube generates X-rays when a high voltage is applied. The X-ray detector 23 has a plurality of X-ray detection elements. Each of the plurality of X-ray detection elements outputs a signal indicating the intensity of the detected X-rays.

[0021] The injector 25 is a device for injecting a contrast agent into a catheter inserted into the subject P. The electrocardiograph 26 acquires an electrocardiographic waveform of the subject P, and outputs electrocardiographic data in which the acquired electrocardiographic waveform is associated with time information.

[0022] The console device 27 controls the arm moving mechanism 21A to rotate the arm 21, and controls the bed moving mechanism 24A to move the bed 24. The console device 27 controls the X-ray generator 22 to emit X-rays, and acquires a signal output from the X-ray detector 23. The console device 27 visualizes the signal acquired from the X-ray detector 23 at a constant period to generate a captured image. The captured image is generated by expressing the intensity of the X-rays detected by the X-ray detector 23 as shades of gray. The captured image includes a plurality of frames visualized at each period. The console device 27 transmits the generated captured image to the medical image processing device 3 via the network N.

[0023] The console device 27 specifies the positional relationship between the X-ray generator 22 and the X-ray detector 23 connected to the arm 21, and the heart imaged by the examination device 2, based on the control modes of the arm moving mechanism 21A and the bed moving mechanism 24A. The console device 27 further specifies the orientation of the heart, more specifically, the direction in which the X-rays emitted from the X-ray detector 23 are incident on the heart, based on the specified positional relationship. The console device 27 transmits information indicating the specified orientation (hereinafter referred to as "first information") to the medical image processing device 3 via the network N.

[0024] The console device 27 acquires electrocardiogram data output from the electrocardiograph 26. The console device 27 identifies the heartbeat timing based on the acquired electrocardiogram data. The console device 27 transmits information indicating the identified heartbeat timing (hereinafter referred to as "second information") to the medical image processing device 3 via the network N.

[0025] The medical image processing device 3 has a CPU 31, a storage device 32, an input unit 33, a display unit 34, and an interface 35. The CPU 31 controls the overall processing of the medical image processing device 3. The interface 35 is a driver element for communicating with the console device 27 of the inspection device 2 via the network N. For example, the CPU 31 receives the captured image, the first information, and the second information transmitted from the console device 27 via the interface 35. The input unit 33 is a keyboard, a mouse, a touch panel, etc., and accepts input operations from a user. The display unit 34 is a display that displays a display image 7 (see Figs. 2 to 5) described later.

[0026] The storage device 32 stores the medical image processing program executed by the CPU 31, the captured image received from the console device 27, the first information, the second information, a three-dimensional model of the heart, and the like.

[0027] The medical image processing program may be stored in a server or the like connected to the network N. The medical image processing device 3 may receive the medical image processing program from a server or the like via the network N and store it in the storage device 32. Alternatively, the medical image processing device 3 may have a terminal to which a storage medium storing the medical image processing program can be connected. The medical image processing device 3 may read out the medical image processing program stored in the storage medium connected to the terminal and store it in the storage device 32.

[0028] The three-dimensional model is a model expressing the three-dimensional shape of the heart, and more specifically, is a solid model. The three-dimensional model is not limited to a solid model, and may be a wire frame or a surface frame. The three-dimensional model shows the right atrium, right ventricle, left atrium, left ventricle, coronary arteries, etc. of the heart (see Figs. 2 to 5). The three-dimensional model is created and stored in advance with reference to the heart of an ordinary adult. The three-dimensional model of the heart is stored as a video file showing the state of the heart changing between a contracted state and an expanded state so that the pulsating movement of the heart can be displayed on the display unit 34.

[0029] <Display image> 2 to 5, a specific example of the display image 7 displayed on the display unit 34 of the medical image processing device 3 will be described. The display image 7 is used, for example, when a medical professional explains the results of the examination performed by the examination device 2 to a patient or his / her family. However, the present invention is not limited to such a use. The display image 7 includes a first display area 71, a second display area 72, a third display area 73, a fourth display area 74, and a group of operation buttons 75.

[0030] The first display area 71 displays the captured image received from the console device 27. The captured image is displayed as a video by sequentially advancing a plurality of frames one by one. The fourth display area 74 displays the file names of the plurality of frames included in the captured image received from the console device 27. The third display area 73 displays a time series graph of the pulsation timing indicated by the second information received from the console device 27. A dotted line 731 shown in the third display area 73 indicates the time point at which the frame displayed in the first display area 71 was captured in the time series graph.

[0031] The second display area 72 displays a three-dimensional model of the heart stored in the storage device 32. The three-dimensional model of the heart repeatedly expands and contracts, thereby representing the beating of the heart. The beating is synchronized with the beating at the position indicated by the dotted line 731 in the time series graph displayed in the third display area 73. The timing of expansion and contraction of the three-dimensional model of the heart is identified based on the second information received from the console device 27.

[0032] The orientation of the three-dimensional model of the heart displayed in the second display area 72 coincides with the orientation of the captured image displayed in the first display area 71. The orientation of the captured image indicates the orientation of the heart of the subject P when viewed from the X-ray generator 22 (see FIG. 1) of the examination device 2. In other words, the orientation of the three-dimensional model of the heart is set so that the appearance of the heart of the subject P when viewed from the X-ray generator 22 of the examination device 2 coincides with the appearance of the three-dimensional model of the heart displayed in the second display area 72. The orientation of the three-dimensional model of the heart is identified based on the first information received from the console device 27.

[0033] For example, when an examination is performed while the arm 21 of the examination device 2 rotates and the bed 24 moves, and thus the orientation of the captured image displayed in the first display area 71 changes, the orientation of the three-dimensional model displayed in the second display area 72 also changes accordingly, as shown in display image 7A shown in Fig. 2 and display image 7B shown in Fig. 3. Hereinafter, the operation mode in which the captured image in the first display area 71 and the three-dimensional model in the second display area 72 are displayed so that their orientations match is referred to as the "first display mode."

[0034] The operation button group 75 includes a number of operation buttons respectively labeled with "Play," "Stop," "Previous frame," "Next frame," "First frame," "Last frame," "Rotate LAO direction," "Rotate RAO direction," "Rotate CRA direction," "Rotate CAU direction," and "RESET."

[0035] The "Play" button is selected to select a display mode in which multiple frames are displayed in sequence in first display area 71 while being advanced frame by frame. In this case, the captured image is displayed as a video. The "Stop" button is selected to stop the frame-by-frame advancement of multiple frames and cancel the display of the video. In this case, the frame that was displayed in first display area 71 at the time the "Stop" button was selected continues to be displayed as a still image.

[0036] The "First Frame" button is selected when the first frame of the multiple frames of the captured image is to be displayed as a still image in the first display area 71. The "Last Frame" button is selected when the last frame of the multiple frames of the captured image is to be displayed as a still image in the first display area 71.

[0037] Each of the operation buttons "Rotation in LAO direction", "Rotation in RAO direction", "Rotation in CRA direction", and "Rotation in CAU direction" is selected when rotating the 3D model of the heart displayed in the second display area 72. More specifically, it is as follows.

[0038] "LAO rotation" is selected when rotating the 3D heart model in a left anterior oblique direction. "RAO rotation" is selected when rotating the 3D heart model in a right anterior oblique direction. "CRA rotation" is selected when rotating the 3D heart model in a cranio-caudal direction. "CAU rotation" is selected when rotating the 3D heart model in a caudal-cephalic direction.

[0039] When any of the operation buttons "LAO direction rotation", "RAO direction rotation", "CRA direction rotation", or "CAU direction rotation" is selected, the first display mode is canceled. This stops the state in which the orientation of the captured image displayed in the first display area 71 and the orientation of the 3D model of the heart displayed in the second display area 72 change in conjunction with each other. The orientation of the 3D model of the heart is changed independently of the orientation of the captured image in response to the selection of any of the operation buttons. Hereinafter, the operating mode when any of the operation buttons "LAO direction rotation", "RAO direction rotation", "CRA direction rotation", or "CAU direction rotation" is selected is referred to as the "second display mode".

[0040] For example, in the first display mode, when "LAO direction rotation" is selected while the display image 7B shown in Fig. 3 is displayed, the first display mode is stopped and switched to the second display mode. In this case, the three-dimensional model of the heart displayed in the second display area 72 rotates so that it is viewed from the right anterior oblique direction, as in the display image 7C shown in Fig. 4. Also, when "CAU direction rotation" is selected while the display image 7B shown in Fig. 3 is displayed, the three-dimensional model of the heart displayed in the second display area 72 rotates so that it is viewed from the caudal-cranial direction, as in the display image 7D shown in Fig. 5.

[0041] The "RESET" button is selected when the second display mode is to be stopped and the first display mode is to be switched to. For example, in the second display mode, when "RESET" is selected while the display image 7B shown in Fig. 4 or the display image 7D shown in Fig. 5 is displayed, the display mode is switched to a state in which the orientation of the photographed image displayed in the first display area 71 and the orientation of the three-dimensional model of the heart displayed in the second display area 72 change in conjunction with each other so as to match each other (see Figs. 2 and 3).

[0042] <Medical image processing> The medical image processing will be described with reference to Fig. 6. When the CPU 31 of the medical image processing device 3 detects an operation for displaying the display image 7 on the display unit 34 via the input unit 33, the CPU 31 reads out and executes the medical image processing program stored in the storage device 32, thereby starting the medical image processing.

[0043] Before the medical image processing is started, the examination device 2 performs fluoroscopic imaging of the heart of the subject P in advance. Specifically, in the examination device 2, the console device 27 controls the injector 25 to inject a contrast agent into the blood vessels of the subject P. The console device 27 also controls the X-ray generator 22, the X-ray detector 23, the arm moving mechanism 21A, and the bed moving mechanism 24A to start fluoroscopic imaging of the heart. The console device 27 acquires and visualizes a signal output from the X-ray detector 23 to generate a captured image. The console device 27 identifies the orientation of the heart of the subject P based on the control state of the arm moving mechanism 21A and the bed moving mechanism 24A. The console device 27 identifies the heartbeat timing based on electrocardiogram data output from the electrocardiograph 26. After completing the fluoroscopic imaging of the heart, the console device 27 transmits the generated captured image, first information indicating the identified orientation of the heart, and second information indicating the identified beating timing to the medical image processing device 3 via the network N.

[0044] The CPU 31 receives and acquires the captured image, the first information, and the second information transmitted from the console device 27 (S11). The captured image includes a plurality of frames captured periodically. The CPU 31 reads and acquires the three-dimensional model of the heart stored in the storage device 32 (S12).

[0045] The CPU 31 determines whether an operation of selecting any one of the operation buttons "LAO direction rotation", "RAO direction rotation", "CRA direction rotation", or "CAU direction rotation" from the operation button group 75 has been detected via the input unit 33 (S13). If the CPU 31 has not detected an operation of selecting any one of the operation buttons "LAO direction rotation", "RAO direction rotation", "CRA direction rotation", or "CAU direction rotation" (S13: NO), the process proceeds to S14. The CPU 31 executes the following process to display the display image 7 in the first display mode in which the orientations of the captured image in the first display area 71 and the three-dimensional model in the second display area 72 match.

[0046] Based on the first information acquired by the process of S11, the CPU 31 specifies the orientation of the heart of the subject P examined by the examination device 2. The CPU 31 further specifies the orientation of the three-dimensional model that coincides with the specified orientation of the heart (S14).

[0047] The CPU 31 displays the multiple frames included in the captured image acquired in S11 one frame at a time in the first display area 71 (S15). As a result, the captured image is displayed as a moving image in the first display area 71. The CPU 31 displays the file names of the multiple frames included in the captured image acquired in S11 in the fourth display area 74.

[0048] The CPU 31 displays the 3D model of the heart in the second display area 72 in the orientation specified in S14 (S15). The specified orientation of the heart changes in response to a change in the orientation of the heart relative to the X-ray generator 22 and the X-ray detector 23 of the examination device 2. Therefore, in synchronization with a change in the orientation of the captured image displayed in the first display area 71, the orientation of the 3D model of the heart displayed in the second display area 72 also changes.

[0049] Based on the second information acquired in S11, CPU 31 displays a time series graph of the pulsation timing in third display area 73. Furthermore, CPU 31 identifies the pulsation timing corresponding to the frame displayed in first display area 71 based on the second information. CPU 31 adjusts the timing of expansion or contraction of the three-dimensional model of the heart so that the three-dimensional model of the heart pulsates in synchronization with the identified pulsation timing (S15). As a result, the three-dimensional model of the heart displayed in second display area 72 pulsates in accordance with the pulsation timing of the captured image displayed in first display area 71.

[0050] When CPU 31 detects an operation to select the "Stop" button via input unit 33, it continues to display the frame that was displayed in first display area 71 at the time the operation was detected. When CPU 31 detects an operation to select each of the "Previous Frame", "Next Frame", "First Frame", and "Last Frame" buttons via input unit 33, it displays the frame corresponding to the operated operation button in first display area 71. In these cases, the orientation of the three-dimensional model of the heart displayed in second display area 72 is adjusted to match the orientation of the captured image of the frame displayed in first display area 71.

[0051] The CPU 31 determines whether an operation for terminating the display of the display image 7 (for example, an operation for selecting the close button in the upper right corner of the window of the display image 7) has been detected via the input unit 33 (S16). When the CPU 31 determines that an operation for terminating the display of the display image 7 has been detected (S16: YES), the CPU 31 terminates the medical image processing. On the other hand, when the CPU 31 determines that an operation for terminating the display of the display image 7 has not been detected (S16: NO), the process returns to S13.

[0052] When the CPU 31 determines that an operation to select any one of the operation buttons "LAO direction rotation", "RAO direction rotation", "CRA direction rotation", or "CAU direction rotation" from among the operation button group 75 has been detected (S13: YES), the CPU 31 advances the process to S17. The CPU 31 stops the first display mode. The CPU 31 executes the following process to display the display image 7 in the second display mode in which the orientation of the three-dimensional model of the heart displayed in the second display area 72 is changed in response to the selection of the operation button.

[0053] CPU 31 accepts the selected operation button (S17) and specifies the corresponding rotation direction and rotation amount. CPU 31 displays the multiple frames included in the captured image acquired in S11 one frame at a time in first display area 71 (S18). As a result, the captured image is displayed as a moving image in first display area 71. CPU 31 displays the file names of the multiple frames included in the captured image acquired in S11 in fourth display area 74.

[0054] The CPU 31 displays the 3D model of the heart acquired in S12 in the second display area 72 (S18). The orientation of the displayed 3D model of the heart is rotated and changed based on the specified rotation direction and rotation amount (S18). Note that even if the orientation of the captured image displayed in the first display area 71 changes, the orientation of the 3D model of the heart displayed in the second display area 72 does not change and is maintained at the changed orientation.

[0055] The CPU 31 determines whether or not an operation to select the "RESET" button from the group of operation buttons 75 has been detected via the input unit 33 (S19). When the CPU 31 determines that an operation to select the "RESET" button has been detected (S19: YES), the CPU 31 returns the process to S13 to stop the second display mode and display the display image 7 in the first display mode.

[0056] When the CPU 31 determines that an operation to select the "RESET" button among the group of operation buttons 75 has not been detected (S19: NO), the process proceeds to S20. The CPU 31 determines whether an operation to end the display of the display image 7 has been detected via the input unit 33 (S20). When the CPU 31 determines that an operation to end the display of the display image 7 has not been detected (S20: NO), the process returns to S17. On the other hand, when the CPU 31 determines that an operation to end the display of the display image 7 has been detected (S20: YES), the medical image processing ends.

[0057] <Actions and Effects of the Present Embodiment> The medical image processing device 3 displays the display image 7, which includes the photographed image of the heart photographed by the examination device 2 and a three-dimensional model showing the heart, on the display unit 34 (S15, S18). In this case, the subject P and his / her family members (hereinafter referred to as "third parties") who view the display image 7 can confirm the association between the state of the blood vessels included in the photographed image and the blood vessels of the heart shown in the three-dimensional model. Therefore, medical personnel can easily allow third parties who do not have medical expertise to understand the examination results shown by the photographed image.

[0058] CT devices, MRI devices, ultrasound diagnostic devices, etc. are known as examination devices for performing clinical examinations. For example, in a CT device, a cross-sectional image of a specific part of the subject's body is generated by computer analysis of information collected by rotating an X-ray generator 360 degrees around the subject. In an MRI device, a magnetic field is used instead of the X-ray generator in a CT device, and cross-sectional images are generated in the same way as in a CT device. In an ultrasound diagnostic device, the reflected wave of the ultrasound emitted from an ultrasound probe is detected, and the delay time is analyzed by computer to generate an image. In this way, in all cases, a huge amount of computer analysis is required to visualize the examination results in the CT device, MRI device, and ultrasound diagnostic device. For this reason, it takes time before the examination results can be visualized and confirmed.

[0059] On the other hand, the examination device 2 is an angiography examination device, a so-called angiography device, which injects a contrast agent into the blood vessels of the subject P to perform fluoroscopic imaging of the subject. Visualization of examination results in an angiography device can be achieved by directly expressing the intensity of X-rays detected by the X-ray detector 23 as shades of gray. For this reason, the time required for visualization of the examination results themselves is shorter than that of other examination devices. On the other hand, when attempting to realize auxiliary display (for example, simultaneous display of the subject) to facilitate understanding of the examination results in conjunction with the visualization of the examination results themselves, it is also necessary to shorten the time required for this auxiliary display.

[0060] In response to this, the examination device 2 displays a three-dimensional model of the heart, which is the subject of the image, at the same time as displaying the captured image. The three-dimensional model is prepared in advance and stored in the storage device 32. Therefore, the examination device 2 only needs to read out the three-dimensional model from the storage device 32 and display it, which reduces the amount of processing required to display the three-dimensional model. This allows the medical image processing device 3 to reduce the time required from examination by the examination device 2 to displaying the display image 7 including the captured image and the three-dimensional model. Therefore, the medical image processing device 3 allows a third party to quickly view the examination results and auxiliary displays for easily checking the examination results.

[0061] By setting the heart as the object of inspection by the inspection device 2, the medical image processing device 3 can display a display image 7 including a three-dimensional model and a captured image of the heart.

[0062] The medical image processing device 3 identifies the orientation of the three-dimensional model corresponding to the orientation of the heart based on the first information received from the inspection device 2 (S14). The medical image processing device 3 displays the display image 7 including the three-dimensional model and the captured image in the identified orientation on the display unit 34 (S15). In this case, the orientations of the captured image and the three-dimensional model included in the display image 7 match. Therefore, a third party who views the display image 7 can easily confirm the relationship between the heart, which is the subject of the inspection, and the captured image. For example, a third party can easily confirm the relationship between the blood vessels included in the captured image and the blood vessels included in the three-dimensional model showing the heart. Therefore, the medical image processing device 3 can make the third party understand the inspection results more easily.

[0063] When the medical image processing device 3 does not detect an operation to select any one of the operation buttons "LAO direction rotation", "RAO direction rotation", "CRA direction rotation", and "CAU direction rotation" among the operation button group 75 (S13: NO), the medical image processing device 3 continues the first display mode. In the first display mode, the captured image and the three-dimensional model are displayed so that their respective orientations match. On the other hand, when the medical image processing device 3 detects an operation to select any one of the operation buttons "LAO direction rotation", "RAO direction rotation", "CRA direction rotation", and "CAU direction rotation" among the operation button group 75 (S13: YES), the medical image processing device 3 stops the first display mode and displays the display image 7 in the second display mode. In the second display mode, the orientation of the three-dimensional model is changed independently of the captured image in response to the selection of any one of the operation buttons. In this case, the medical staff can change the orientation of the three-dimensional model of the heart included in the display image 7 to a desired orientation and display it on the display unit 34. Therefore, medical staff can not only help a third party understand the captured image by associating it with a three-dimensional model of the heart, but also can easily help a third party understand the heart itself shown by the three-dimensional model.

[0064] When the CPU 31 detects an operation to select the "RESET" button (S19: YES), it stops the second display mode and displays the display image 7 in the first display mode. By operating the "RESET" button while the display image 7 is being displayed in the second display mode, the medical staff can easily switch the 3D model of the heart, which has been changed to a desired orientation, to an orientation corresponding to the captured image.

[0065] The three-dimensional model of the heart displayed in the second display area 72 repeatedly expands and contracts in synchronization with the pulsation timing of the captured image. This shows the pulsation of the heart indicated by the three-dimensional model. In this case, a third party viewing the display image 7 can easily confirm the correspondence between the three-dimensional model of the heart expanding or contracting in synchronization with the pulsation of the captured image and the captured image.

[0066] <Modification> The present invention is not limited to the above-described embodiment, and various modifications are possible. The examination device 2 may be a device that performs examinations using radiation other than X-rays (alpha rays, gamma rays, beta rays, neutron rays, etc.). The examination device 2 is not limited to an angiography device, and may be a device that performs clinical examinations using other methods. For example, the examination device 2 may be a CT device, an MRI device, an ultrasonic diagnostic device, etc. The subject examined by the examination device 2 is not limited to the heart, and may be another organ or a part of the body other than an organ.

[0067] At least a part of the various processes executed by the console device 27 of the inspection device 2 may be executed by the medical image processing device 3 instead of the console device 27. For example, the medical image processing device 3 may directly acquire a signal output from the X-ray detector 23 and generate a captured image by visualizing the signal at a constant period. Also, for example, the medical image processing device 3 may be incorporated in the inspection device 2.

[0068] The medical image processing is not limited to being executed only by the CPU 31 of the medical image processing device 3, but may be distributed and executed by the respective CPUs of multiple devices. For example, the medical image processing may be executed by multiple PCs connected to the network N. The medical image processing may be executed by ASIC, FPGA, etc.

[0069] The medical image processing device 3 may not have a display unit 34. For example, the medical image processing device 3 may transmit data of a display image 7 including a captured image and a three-dimensional model to another terminal device (such as a PC, a tablet terminal, or a smartphone) via the network N. The other terminal device may receive the data of the display image 7 via the network N and display it on its own display unit 34.

[0070] The console device 27 of the examination device 2 may transmit the photographed image, the first information, and the second information to the medical image processing device 3 while performing fluoroscopic photography. The medical image processing device 3 may display the display image 7 on the display unit 34 based on the received photographed image, the first information, and the second information. That is, the examination system 1 may display the display image 7 by the medical image processing device 3 while performing fluoroscopic photography by the examination device 2. In this case, a third party can visually confirm not only the photography results but also the three-dimensional model of the heart while the examination of the subject P is being performed.

[0071] The three-dimensional model stored in the storage device 32 may be generated based on the subject P who is examined by the examination device 2. For example, the three-dimensional model may be generated based on the shape and size of the heart of the subject P that is identified by an examination performed by an MRI device in a CT device.

[0072] Each part of the 3D model of the heart may be distinguishable by color, etc. For example, when an operation of selecting any part of the 3D model of the heart is detected while the display image 7 is being displayed, the medical image processing device 3 may display the selected part in a color different from the colors of the other parts.

[0073] The examination device 2 may perform fluoroscopic imaging by always emitting X-rays from a fixed direction to the subject P. In this case, the medical image processing device 3 only needs to always display the three-dimensional model in a direction corresponding to the imaging direction of the heart, and the direction does not need to be changed.

[0074] In the medical image processing device 3, the method of switching between the first display mode and the second display mode is not limited to the above embodiment. For example, the operation button group 75 may further include a "switch" button. The medical image processing device 3 may switch the display mode when detecting an operation of selecting the "switch" button. The medical image processing device 3 may always display the display image 7 in the first display mode, or may always display the display image 7 in the second display mode. The first display mode and the second display mode may not be switchable.

[0075] The three-dimensional model of the heart does not have to be beating and may be shown as a still image.

[0076] <Other> The CPU 31 performing the process of S11 is an example of the "first acquisition means" of the present invention. The CPU 31 performing the process of S12 is an example of the "second acquisition means" of the present invention. The CPU 31 performing the process of S15 and S18 is an example of the "display means" of the present invention. S15 is an example of the "first display process" of the present invention. S18 is an example of the "second display process" of the present invention. The CPU 31 performing the process of S13 is an example of the "first reception means" of the present invention. The CPU 31 performing the process of S19 is an example of the "second reception means" of the present invention. The process of S11 is an example of the "first acquisition step" of the present invention. The process of S12 is an example of the "second acquisition step" of the present invention. The processes of S15 and S18 are an example of the "display step" of the present invention. [Explanation of symbols]

[0077] 2: Inspection equipment 3: Medical image processing equipment 7: Display image 31 :CPU

Claims

1. A first acquisition means for acquiring test results obtained by testing a test subject using a testing device that performs clinical testing; A second acquisition means for acquiring a three-dimensional model representing the inspection object; a display unit that displays a display image including the inspection result acquired by the first acquisition unit and the three-dimensional model acquired by the second acquisition unit on a display unit; A medical image processing apparatus comprising:

2. The first acquisition means is Further acquiring first information indicating an orientation of the inspection object to be inspected by the inspection device; The display means is The medical image processing device according to claim 1, characterized in that a first display process is executed to identify an orientation of the three-dimensional model corresponding to an orientation of the object to be examined based on the first information acquired by the first acquisition means, and to display on the display unit the display image including the three-dimensional model in the identified orientation and the examination results.

3. a first reception means for receiving a change operation for changing an orientation of the three-dimensional model; The display means is When the change operation is not accepted, the first display process is executed; 3. The medical image processing device according to claim 2, characterized in that, when the change operation is accepted by the first accepting means, the first display process is stopped, and a second display process is executed in which an orientation of the three-dimensional model included in the display image is changed based on the accepted change operation and displayed on the display unit.

4. A second reception means for receiving a switching operation for switching the display process, The display means is 4. The medical image processing apparatus according to claim 3, wherein when the switching operation is accepted by the second accepting means while the second display process is being executed, the second display process is stopped and the first display process is executed.

5. The first acquisition means is Further acquiring second information indicating a pulsation timing of the test subject; The second acquisition means acquires the pulsating three-dimensional model, The display means is 2. The medical image processing apparatus according to claim 1, wherein the three-dimensional model pulsating in accordance with the pulsation timing of the subject is displayed on the display unit based on the second information acquired by the first acquisition means.

6. the examination device is an angiography device that performs fluoroscopic imaging using radiation, The medical image processing apparatus according to claim 1 , wherein the examination result is an image captured by the fluoroscopic imaging.

7. 2. The medical image processing apparatus according to claim 1, wherein the object to be examined is a heart.

8. A first acquisition step of acquiring test results obtained by testing a test subject using a testing device that performs clinical testing; a second acquisition step of acquiring a three-dimensional model representative of the inspection object; a display step of displaying, on a display unit, a display image including the inspection result acquired in the first acquisition step and the three-dimensional model acquired in the second acquisition step; A medical image processing method comprising:

9. A first acquisition step of acquiring test results obtained by testing a test subject using a testing device that performs clinical testing; a second acquisition step of acquiring a three-dimensional model representative of the inspection object; a display step of displaying, on a display unit, a display image including the inspection result acquired in the first acquisition step and the three-dimensional model acquired in the second acquisition step; A medical image processing program that causes a computer to execute the above.

Citation Information

Patent Citations

  • Ultrasonic image processing apparatus

    JP2012157608A