Medical processing device, medical processing method, and medical processing program

Abstract

To provide a medical processing apparatus capable of displaying analysis results related to multiple parts of the heart in a desired layout, with a simple operation.SOLUTION: A medical processing apparatus 20 according to the present embodiment includes an attendant part and a display control unit. The attendant part attaches attendant information including information on the type of multiple parts in the heart that is obtained by the analysis of medical data to the analysis result of each of the parts. The display control unit determines a display position of the analysis result of each of the multiple parts on the basis of the attendant information.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a medical processing device, a medical processing method, and a medical processing program. [Background technology]

[0002] Conventional ultrasound diagnostic devices have the function of analyzing local wall motion for a single cardiac chamber and displaying the analysis results, but conventional ultrasound diagnostic devices do not have the function of analyzing local wall motion for each of multiple cardiac chambers and displaying the analysis results in a unified manner. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-55483 [Patent Document 2] Japanese Patent Application Laid-Open No. 2014-171556 [Patent Document 3] Japanese Patent Application Laid-Open No. 2009-106548 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to provide a medical processing device, a medical processing method, and a medical processing program that are capable of displaying analysis results relating to multiple parts of the heart in a desired layout with simple operations. [Means for solving the problem]

[0005] The medical processing device according to this embodiment includes an attachment unit and a display control unit. The attachment unit attaches attachment information, including information about the type of the region, to the analysis results of each of a plurality of regions in the heart obtained by analyzing medical data. The display control unit determines the display position of the analysis results for each of the plurality of regions based on the attachment information. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a schematic diagram showing the configuration of an ultrasonic diagnostic apparatus according to this embodiment. [Figure 2] FIG. 2 is a flowchart showing an example of a processing flow relating to the additional function in this embodiment. [Figure 3] FIG. 3 is a diagram showing an example of the supplementary information in this embodiment. [Figure 4] FIG. 4 is a flowchart showing an example of the flow of processing related to the display control function in this embodiment. [Figure 5] FIG. 5 is a diagram showing an example of a display of the analysis results of four cavities in this embodiment. [Figure 6] FIG. 6 is a diagram showing another example of displaying the analysis results of four cavities in this embodiment. [Figure 7] FIG. 7 is a diagram showing an example of the layout of the analysis results relating to the comparison of short-axis tomographic images in this embodiment. [Figure 8] FIG. 8 is a diagram showing an example of a layout of an analysis result in which three-dimensional images and two-dimensional images are mixed in this embodiment. [Figure 9] FIG. 9 is a diagram showing an example of the layout of the analysis results relating to the temporal comparison in this embodiment. [Figure 10] FIG. 10 is a diagram showing an example of the layout of the analysis results regarding the comparison between before and after drug loading in the two cavities in this embodiment. [Figure 11] FIG. 11 is a diagram showing an example of the layout of the analysis results regarding the comparison between before and after treatment of two cavities in this embodiment. [Figure 12] FIG. 12 is a diagram showing an example of the layout of the analysis results relating to the comparison of different image aspects of two cavities in this embodiment. [Figure 13] FIG. 13 is a diagram showing an example of the layout of analysis results relating to the comparison of different analysis parameters for two cavities in this embodiment. [Figure 14]FIG. 14 is a diagram showing an example of the layout of analysis results with different image formats in this embodiment. [Figure 15] FIG. 15 is a diagram showing an example of a composite image obtained by combining the analysis results of four cavities in the first modified example of this embodiment. [Figure 16] FIG. 16 is a diagram showing an example of a display in which the analysis results of four cavities are displayed together with a plurality of tabs in the second modified example of this embodiment. [Figure 17] FIG. 17 is a diagram showing a display example in which a plurality of layout images are displayed together with the analysis results in the second modified example of this embodiment. [Figure 18] FIG. 18 is a diagram showing an example of a comparative display of a composite image obtained by combining the analysis results of four cavities in the third modified example of this embodiment. [Figure 19] FIG. 19 is a diagram showing an example of display of the analysis results of four cavities and four valves in the fourth modified example of this embodiment. [Figure 20] FIG. 20 is a diagram showing an example of a composite image obtained by combining the analysis results of four cavities and four valves in the fourth modification of this embodiment. [Figure 21] FIG. 21 is a diagram showing an example of the integrated analysis result LRV when the left ventricle and the right ventricle are selected in the fifth modified example of this embodiment. [Figure 22] FIG. 22 is a diagram showing a display example (tile display) of the four-cavity analysis results and coronary artery images (morphological information) in the ninth modification of this embodiment. [Figure 23] FIG. 23 is a diagram showing an example of a composite image obtained by combining the analysis results of the left ventricle and the right ventricle with morphological information of the coronary arteries in the ninth modification of this embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] The ultrasonic diagnostic apparatus according to this embodiment will be described below with reference to the drawings. In the following description, components having substantially the same configurations are denoted by the same reference numerals, and redundant description will be given only when necessary.

[0008] 1 is a schematic diagram showing the configuration of an ultrasonic diagnostic device 1 according to this embodiment. As shown in FIG. 1, the ultrasonic diagnostic device 1 includes an ultrasonic probe 11, an input interface circuit (input unit) 13, a display (display unit) 15, an electrocardiograph 17, and a device main body 19.

[0009] The ultrasonic probe 11 includes a plurality of piezoelectric transducers, a matching layer provided on the ultrasonic wave emitting surface side of the piezoelectric transducers, and a backing material provided on the back surface side of the piezoelectric transducers. Each of the plurality of piezoelectric transducers generates an ultrasonic wave in response to a drive signal supplied from a transceiver circuit 23 (described later). The ultrasonic probe 11 is, for example, a two-dimensional array probe in which a plurality of piezoelectric transducers are arranged along mutually orthogonal azimuth and elevation directions. The two-dimensional array probe is, for example, a two-dimensional sector probe. Note that the ultrasonic probe 11 is not limited to a two-dimensional array probe capable of three-dimensional scanning, but may also be a mechanical four-dimensional probe. Furthermore, when the ultrasonic probe 11 is a one-dimensional array probe capable of two-dimensional scanning, three-dimensional echo signals are acquired by the operator's operation of swinging the ultrasonic probe 11 in the elevation direction.

[0010] The input interface circuit 13 inputs various instructions, commands, information, selections, and settings from the operator into the ultrasound diagnostic device 1. The input interface circuit 13 may be realized by a trackball, switch buttons, a mouse, a keyboard, a touchpad for inputting operations by touching the operation surface, or a touch panel display in which a display screen and a touchpad are integrated. The input interface circuit 13 converts input operations received from the operator into electrical signals. Note that, in this specification, the input interface circuit 13 is not limited to those equipped with physical operation components such as a mouse and a keyboard. For example, an electrical signal processing circuit that receives electrical signals corresponding to input operations from an external input device provided separately from the ultrasound diagnostic device 1 and outputs the received electrical signals to the device main body 19 is also included as an example of the input interface circuit 13.

[0011] The display 15 displays various images generated by the image generation circuit 29 (described later) and the like. The display 15 has a display circuit that realizes the display of various images. The display 15 also displays a graphical user interface (GUI) that allows the operator to input various setting requests. Note that multiple displays may be connected to the device body 19 of the ultrasound diagnostic device 1.

[0012] The electrocardiograph 17 is connected to the device main body 19 via the communication interface circuit 31. The electrocardiograph 17 acquires an electrocardiogram (ECG) of the subject P as a biological signal of the subject P being ultrasonically scanned. The electrocardiograph 17 outputs the acquired electrocardiogram to the device main body 19.

[0013] The device main body 19 has a transmitting / receiving circuit (transmitting / receiving unit) 23, a B-mode data generating circuit (B-mode data generating unit) 25, a Doppler data generating circuit (Doppler data generating unit) 27, an image generating circuit (image generating unit) 29, a communication interface circuit 31, a memory circuit (memory unit) 33, a control circuit (control unit) 35, and a processing circuit (processing unit) 37.

[0014] The transmission / reception circuit 23 has a pulse generator, a transmission delay circuit, and a pulser circuit, and supplies drive signals to each of the multiple piezoelectric transducers in the ultrasonic probe 11. The pulse generator repeatedly generates rate pulses for forming transmission ultrasonic waves at a predetermined rate frequency fr Hz (period: 1 / fr seconds). The transmission delay circuit focuses the transmission ultrasonic waves into a beam and provides each rate pulse with a delay time required to determine the transmission directivity. The pulser circuit applies voltage pulses as drive signals to each piezoelectric transducer in the ultrasonic probe 11 at a timing based on the rate pulses. As a result, an ultrasonic beam is transmitted to the subject P.

[0015] The transmission / reception circuit 23 further includes a preamplifier, an analog-to-digital (hereinafter referred to as A / D) converter, a reception delay circuit, and an adder. The transmission / reception circuit 23 generates a reception signal based on the reception echo signal generated by each piezoelectric transducer. The preamplifier amplifies the echo signal from the subject P captured via the ultrasonic probe 11 for each channel. The A / D converter converts the amplified reception echo signal into a digital signal. The reception delay circuit imparts a delay time required to determine the reception directivity to the reception echo signal converted into a digital signal. The adder adds multiple echo signals to which a delay time has been imparted. By this addition, the transmission / reception circuit 23 generates a reception signal that emphasizes the reflection component from the direction corresponding to the reception directivity. The overall directivity of the ultrasonic transmission / reception is determined by this transmission directivity and reception directivity. The ultrasonic beam (so-called "ultrasonic scan line") is determined by this overall directivity.

[0016] The transmission / reception circuitry 23 may scan multiple regions of the heart with ultrasound waves according to a scan order set for each region. The multiple regions include, for example, various heart chambers such as the left ventricle, left atrium, right ventricle, and right atrium, and various valves such as the mitral valve (MV), aortic valve (AV), tricuspid valve (TV), and pulmonary valve (PV). For ease of explanation, the regions will be described below as heart chambers. The scan order is, for example, an order in which scanning is performed in the order of the left ventricle, left atrium, right ventricle, and right atrium, and is associated with the regions. The scan order is stored in, for example, the memory circuitry 33. The transmission / reception circuitry 23 generates received signals in time series corresponding to the multiple regions.

[0017] The B-mode data generation circuit 25 has an envelope detector and a logarithmic converter and generates B-mode data based on the received signal. The envelope detector performs envelope detection on the received signal. The logarithmic converter performs logarithmic conversion on the envelope-detected signal, relatively emphasizing weak signals in the envelope-detected signal. The B-mode data generation circuit 25 generates signal values ​​(referred to as B-mode data) for each depth in each scanning line based on the signals emphasized by the logarithmic converter. The B-mode data generation circuit 25 generates volume data corresponding to three-dimensional B-mode data based on two-dimensional B-mode data obtained by two-dimensional scanning or received signals obtained by three-dimensional scanning. For ease of understanding, the following description assumes that the volume data is generated by three-dimensional ultrasound scanning of each of the multiple cardiac chambers of the subject P. In this case, the generated volume data corresponds to each of the multiple cardiac chambers. The multiple cardiac chambers are at least two of the four chambers. The four chambers are the left atrium (LA), left ventricle (LV), right atrium (RA), and right ventricle (RV). Note that the volume data may be generated by ultrasound scanning of the four chambers of the heart of the subject P.

[0018] The Doppler data generation circuit 27 has a mixer, a low-pass filter (hereinafter referred to as LPF), etc., and generates Doppler data based on the received signal. The mixer multiplies the received signal by a reference signal having the frequency f0 of the transmitted ultrasound, generating a signal with a Doppler shift frequency fd component and a signal with a frequency component of (2f0+fd). The LPF removes the high-frequency component (2f0+fd) from the signal output from the mixer. In this way, the Doppler data generation circuit 27 generates Doppler data with a Doppler shift frequency fd component from the received signal.

[0019] The image generation circuit 29 includes a digital scan converter (hereinafter referred to as DSC), an image memory, and the like, none of which are shown. The DSC converts the scan line signal sequence of an ultrasound scan, consisting of B-mode data and Doppler data, into a scan line signal sequence in video format (scan conversion). The image generation circuit 29 combines the scan-converted B-mode data and Doppler data with text information of various parameters, memory, and the like to generate ultrasound image data. Ultrasound image data is data for display. An ultrasound image is an example of a medical image. Ultrasound image data is also an example of medical data. Meanwhile, B-mode data, volume data, and Doppler data are also called raw data. The image memory stores multiple ultrasound images corresponding to a series of frames immediately before a freeze operation is input. The multiple ultrasound images stored in the image memory are used for cine display.

[0020] The communication interface circuitry 31 is connected to an external device such as a medical image storage device via a network. The communication interface circuitry 31 receives volume data of the subject P and the like from the medical image storage device and outputs the data to the memory circuitry 33. The communication interface circuitry 31 transfers various data output from the image generation circuitry 29, the processing circuitry 37, and the like to the external device.

[0021] The memory circuitry 33 is composed of various memories, an HDD (hard disk drive), an SSD (solid state drive), a magnetic disk (e.g., a floppy disk, a hard disk), an optical disk (e.g., a CD-ROM, a DVD), a semiconductor memory, etc. The memory circuitry 33 stores programs related to ultrasound transmission and reception, programs corresponding to various processes executed by the control circuitry 35 and the processing circuitry 37, etc. The memory circuitry 33 stores raw data, ultrasound image data, various data generated and processed by the processing circuitry 37, the scan order, etc.

[0022] The control circuit 35 includes, for example, a processor and a memory as hardware resources. The control circuit 35 functions as the core of the ultrasonic diagnostic apparatus 1. Specifically, the control circuit 35 reads out a control program stored in the memory circuit 33, loads it into the memory, and controls various circuits of the ultrasonic diagnostic apparatus 1 in accordance with the loaded control program.

[0023] The processing circuitry 37 includes, for example, a processor and a memory as hardware resources. Specifically, the processing circuitry 37 reads out a program stored in the storage circuitry 33, expands the program in the memory, and realizes various functions according to the expanded program.

[0024] The processing circuitry 37, which realizes the image processing function 371, executes image processing programs corresponding to various types of image processing. Specifically, the processing circuitry 37 generates a rendering image by performing rendering processing on the volume data. The rendering image is a three-dimensional image such as a surface rendering image or a volume rendering image. The processing circuitry 37 generates a two-dimensional multi-planar reconstruction (MPR) image by performing multi-planar reconstruction (MPR) processing on the volume data. Note that if the volume data has multiple cardiac chambers, the processing circuitry 37 divides the volume data into volume data for each cardiac chamber using a predetermined method such as threshold processing. At this time, the processing circuitry 37 generates a three-dimensional image for each cardiac chamber based on the divided volume data. The processing circuitry 37, which realizes the image processing function 371, corresponds to an image processing unit.

[0025] The processing circuitry 37, which realizes the analysis function 373, obtains analysis results by analyzing time-series medical images (hereinafter referred to as a medical image group) of each heart chamber. The medical image group is, for example, three-dimensional images of the heart chamber in time series or two-dimensional images of the heart chamber in time series. Specifically, the processing circuitry 37 analyzes the wall motion of each heart chamber by applying a predetermined wall motion analysis to the medical image group. The predetermined wall motion analysis is, for example, two-dimensional wall motion tracking (WMT) or three-dimensional WMT, but is not limited to these. By executing an analysis program related to the analysis function 373, the processing circuitry 37 sets, as initial contours, multiple constituent points indicating the contour of the endocardium of the heart wall and multiple constituent points indicating the contour of the epicardium of the heart wall on a medical image corresponding to a predetermined cardiac phase among the medical image group. The initial contours may be set automatically by predetermined image processing or may be set by an operator's instruction via the input interface circuitry 13. The initial contour can be adjusted as appropriate by an instruction from the operator via the input interface circuitry 13. Next, the processing circuitry 37 realizing the analysis function 373 tracks the positions of the constituent points in other medical images included in the medical image group in chronological order, starting from the medical image for which the initial contour was set.

[0026] The processing circuitry 37, which realizes the analysis function 373, calculates the values ​​of various analysis parameters related to the wall motion of the cardiac chamber based on the results of the tracking. Examples of the analysis parameters include various strains, such as longitudinal strain, and the time required for the radial strain of the cardiac chamber to reach a predetermined threshold (hereinafter referred to as the time to peak). The processing circuitry 37 generates segmented surface rendering images, MPR images, polar maps, and the like, in which hues corresponding to the values ​​of the analysis parameters are mapped. A segment is a divided region of the cardiac wall recommended by the American Society of Echocardiography and the American Heart Association. The processing circuitry 37 acquires the images generated by this mapping as the analysis results of the wall motion of each cardiac chamber. The processing circuitry 37 may also generate, as the analysis results, graphs showing the time changes in the values ​​of the analysis parameters for each of multiple segments. The processing circuitry 37 stores the generated analysis results in the memory circuitry 33. When medical data is collected according to the scan order, the processing circuitry 37 analyzes the medical data according to the scan order to obtain the analysis results according to the scan order. The processing circuitry 37 realizing the analysis function 373 corresponds to the analysis unit.

[0027] The term "processor" used in the above description refers to circuits such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)).

[0028] The processor realizes various functions by reading and executing the programs stored in the memory circuitry 33. Note that instead of storing the various programs in the memory circuitry 33, the various programs may be directly incorporated into the circuitry of the processor in the control circuitry 35 or the processing circuitry 37. In this case, the processor realizes various functions by reading and executing the various programs incorporated into the circuitry.

[0029] The overall configuration of the ultrasound diagnostic device 1 of this embodiment has been described above. When the various functions of this ultrasound diagnostic device are realized by a medical processing device, the medical processing device 20 has the components enclosed by the dotted line in FIG. 1. With this configuration, the ultrasound diagnostic device 1 and medical processing device 20 of this embodiment are configured to display the analysis results of cardiac chamber wall motion in a desired layout with simple operations using the auxiliary function 375 and display control function 377 described below. Below, the auxiliary function 375 will be described, followed by the display control function 377.

[0030] The processing circuitry 37, which realizes the additional function 375, attaches additional information, including information about the type of the region, to the analysis results of each of multiple heart regions obtained by analyzing medical data. For example, the processing circuitry 37 generates the additional information based on various information related to the wall motion analysis of the heart chamber. The additional information indicates attributes of the analysis results and includes information entered or selected during the wall motion analysis. The processing circuitry 37 attaches the additional information, including information about the type of heart chamber, to the analysis results of each of multiple heart chambers obtained by analyzing medical images. The processing circuitry 37 stores the analysis results with the attached additional information in the memory circuitry 33. The processing circuitry 37, which realizes the additional function 375 by executing a program related to the additional function 375, corresponds to an additional unit. Note that when medical data is collected according to a scan order, the processing circuitry 37 includes the scan order in the additional information, using the scan order information associated with the region as region type information. In this case, setting the region type is not necessary.

[0031] The processing related to the additional function 375 according to this embodiment will be described in detail below using a flowchart. Fig. 2 is a flowchart showing an example of the flow of processing related to the additional function 375. In Fig. 2, the processing corresponding to the additional function 375 is the processing of steps Sa4 and Sa5.

[0032] Medical images are generated in chronological order by transmitting and receiving ultrasound waves to and from each of the multiple cardiac chambers over a period of one heartbeat or more (step Sa1). Prior to execution of the analysis function 373, the patient ID, cardiac chamber type, image aspect, analysis parameter name, etc. are set. The cardiac chamber type is the name of the cardiac chamber to be analyzed. The image aspect is the type of image onto which a hue corresponding to the value of the analysis parameter is mapped, such as a surface rendering image, an MPR image, or a polar map.

[0033] The processing circuitry 37 realizing the analysis function 373 sets a plurality of configuration points indicating an initial contour in a medical image of a predetermined cardiac phase among medical images along the time series (step Sa2). Here, the predetermined cardiac phase is end diastole, etc. The plurality of configuration points are tracked across a plurality of medical images, and the values ​​of the set analysis parameters are calculated.

[0034] The processing circuitry 37 realizing the analysis function 373 acquires analysis results of the wall motion of the cardiac chambers based on the set image aspect and the calculated values ​​of the analysis parameters (step Sa3). Analysis results are acquired for each cardiac chamber. For example, if the analysis target is two types of cardiac chambers, a first cardiac chamber and a second cardiac chamber, the analysis results acquired in step Sa3 are a first analysis result for the first cardiac chamber and a second analysis result for the second cardiac chamber. That is, the first analysis result is acquired by analyzing a first medical image in time series for the first cardiac chamber among the multiple regions, and the second analysis result is acquired by analyzing a second medical image in time series for the second cardiac chamber among the multiple regions. If time-series medical images (volume data) of the first cardiac chamber and the second cardiac chamber are collected, the first analysis result and the second analysis result are acquired by analyzing this volume data.

[0035] Using various information related to the wall motion analysis of the cardiac chambers, additional information to be attached to each analysis result is generated (step Sa4). The additional information includes information indicating the attributes of the analysis result, such as information on the type of cardiac chamber, information on the cardiac phase, information on the date and time when the medical image was collected, information on the phase of the stress echo when the medical image was collected, information on the progress of treatment for at least one of the multiple cardiac chambers, and information on the image appearance of the analysis result. For example, if the analysis target is two types of cardiac chambers, a first cardiac chamber and a second cardiac chamber, first additional information to be attached to the first analysis result and second additional information to be attached to the second analysis result are generated.

[0036] FIG. 3 is a diagram showing an example of the accompanying information generated by the processing circuitry 37. As shown in FIG. 3, attributes included in the accompanying information include a patient ID, a type of cardiac chamber, acquisition date and time, a stress echo phase, a treatment progress, an image mode, an analysis parameter name, and the like. The acquisition date and time is the date and time when the volume data to be analyzed is acquired. The stress echo phase is the point in time when the volume data is acquired during stress echo implementation, such as before stress, during stress, or after stress. The treatment progress is information indicating, for example, before and after cardiac resynchronization therapy (CRT) treatment of the cardiac chamber. The column for cardiac chamber type in FIG. 3 generally indicates the type of site.

[0037] The generated incidental information is attached to the analysis results and stored in the storage circuitry 33 together with the analysis results (step Sa5). For example, the processing circuitry 37 realizing the incidental function 375 attaches incidental information including information about the type of the heart region to each analysis result obtained by analyzing the medical data. Specifically, the processing circuitry 37 attaches first incidental information including information identifying the first region to a first analysis result corresponding to a first region among the multiple regions, and attaches second incidental information including information identifying the second region to a second analysis result corresponding to a second region among the multiple regions. Various attributes of the incidental information in FIG. 3 may be managed, for example, by private tags or standard tags of Digital Imaging and Communication in Medicine (DICOM). The processing circuitry 37 may generate a management table for uniformly managing the generated incidental information based on the incidental information. The management table links the incidental information attached to the analysis results using various attributes included in the incidental information.

[0038] The processing circuitry 37, which realizes the display control function 377, determines the display positions of the multiple analysis results for each of the multiple regions based on the accompanying information. For example, the processing circuitry 37 displays the first analysis result in a first section of the multiple sections on the screen of the display 15 based on the first accompanying information, and displays the second analysis result in a second section of the multiple sections based on the second accompanying information. Specifically, the processing circuitry 37 determines the display positions (sections) of the analysis results to be displayed in the display area of ​​the display 15 based on the type of cardiac chamber and the anatomical positional relationship of the multiple cardiac chambers in the accompanying information. At this time, the display positions of the analysis results correspond to the anatomical positions of the cardiac chambers. The processing circuitry 37 may further determine the display positions using at least one of the order in which the analysis results were selected by the operator, the storage date of the analysis results, the storage date of the volume data, and the acquisition date and time of the volume data. The processing circuitry 37 may also determine the display positions so that analysis results from different times (phases) are arranged side by side on the left and right of the display area based on attributes in the accompanying information, such as before and after stress in stress echocardiography and before and after treatment. The processing circuitry 37 may determine the display position within the display area of ​​each of the multiple displays. For example, if four displays are arranged adjacently in a grid pattern, the processing circuitry 37 determines which analysis results to place in the display area of ​​each display based on the accompanying information. If the accompanying information includes a scan order, the processing circuitry 37 determines the display position of the analysis results according to the anatomical positional relationship of the parts based on the scan order in the accompanying information. In this case, the analysis results are displayed sequentially at the display positions in synchronization with the cardiac phases according to the scan order, i.e., the order in which the analysis results were generated.

[0039] The processing related to the display control function 377 according to this embodiment will be described in detail below with reference to a flowchart.

[0040] An analysis result comparison mode is activated by an instruction from the operator (step Sb1). The analysis result comparison mode is a mode in which a plurality of analysis results are displayed in the display area of ​​the display 15 in order to compare the plurality of analysis results. In the processing of step Sb1, a program corresponding to the display control function 377 is read from the storage circuitry 33 and executed. At this time, the processing circuitry 37 functions as a display control unit.

[0041] The layout of the analysis results in the display area of ​​the display 15 is determined based on the accompanying information (step Sb2). The layout of the analysis results corresponds to, for example, a template indicating which analysis results should be arranged at which positions in the display area and with what size. As shown in FIG. 3, attributes of the accompanying information related to the layout determination include analysis parameters, image appearance, time information, spatial information, and patient information related to the analysis results. Specifically, the processing circuitry 37 determines multiple layouts using multiple attributes included in the accompanying information for each of the multiple analysis results depending on the purpose of the comparison of the analysis results, such as spatial comparison based on the anatomical positional relationship of the cardiac chambers, temporal comparison, stress echo phase comparison, comparison before and after treatment, comparison of different image appearances, and comparison of different analysis parameters. The multiple layouts correspond to any combination of analysis results useful for various comparisons of analysis results. Note that the layout may be an arrangement of multiple analysis results acquired at different dates and times for one cardiac chamber, or an arrangement of multiple analysis results with different image appearances for one cardiac chamber. The layout may also be determined using the accompanying information and a management table.

[0042] The processing circuitry 37, which realizes the display control function 377, generates thumbnail images (hereinafter referred to as layout images) in which the analysis results are arranged according to the determined layout, and displays a list of the layout images on the display 15 (step Sb3). The content of the layout images is not limited to thumbnails of the analysis results, but may be text information indicating the attributes of the analysis results. Instead of the layout images, the processing circuitry 37 may display on the display 15 a user interface such as a dialog box for inputting the attributes of the analysis results related to various comparisons. At this time, the operator can input, for example, image formats including at least one of two-dimensional images and three-dimensional images as the image formats of the multiple analysis results.

[0043] When a layout image is selected (step Sb4), the processing circuitry 37, which realizes the display control function 377, determines a layout corresponding to the selected layout image. Alternatively, when attributes of the analysis results related to various comparisons are input instead of selecting a layout image, the processing circuitry 37 may determine a layout matching the input attributes from among multiple layouts. The processing circuitry 37 displays the analysis results in the determined layout (step Sb5). The processing circuitry 37 synchronizes and displays the analysis results of multiple cardiac chambers as a moving image based on the cardiac phase in the accompanying information. In this case, if the image format is a surface rendering image, the processing circuitry 37 may control the display 15 to rotate the analysis results in response to an instruction from the operator. Below, a description is given of an example of the display and layout of multiple analysis results in step Sb5.

[0044] FIG. 5 shows an example display (tile display) of analysis results when the cardiac chamber to be analyzed is four and the image format is a surface rendered image. 5RA in FIG. 5 shows a surface rendered image of the right atrium, onto which hues corresponding to the values ​​of the analysis parameters for the right atrium are mapped. 5RV in FIG. 5 shows a surface rendered image of the right ventricle, onto which hues corresponding to the values ​​of the analysis parameters for the right ventricle are mapped. 5LA in FIG. 5 shows a rendered image of the left atrium, onto which hues corresponding to the values ​​of the analysis parameters for the left atrium are mapped. 5LV in FIG. 5 shows a rendered image of the left ventricle, onto which hues corresponding to the values ​​of the analysis parameters for the left ventricle are mapped. Curves indicating segment boundaries are displayed on the four rendered images showing the analysis results. The display positions of the analysis results 5RV, 5RA, 5LV, and 5LA maintain anatomical positional relationships. The display positions of the analysis results 5RV, 5RA, 5LV, and 5LA are not limited to those shown in FIG. 5 and may be associated with, for example, the position of the ultrasound probe. At this time, the analysis results for RV are displayed in the upper left column of display area 5DA in Fig. 5, the analysis results for RA are displayed in the lower left column of display area 5DA, the analysis results for LV are displayed in the upper center column of display area 5DA, and the analysis results for LA are displayed in the lower center column of display area 5DA. The analysis results 5RV, 5RA, 5LV, and 5LA are synchronized and reproduced as a moving image based on the cardiac phase in the accompanying information.

[0045] Graphs 5G1 and 5G2 in FIG. 5 show the time changes in the values ​​of the analysis parameters for each segment. Graphs 5PT in FIG. 5 are bars indicating the cardiac phases of the analysis results 5RV, 5RA, 5LV, and 5LA. Bars 5PT move along the time axes of graphs 5G1 and 5G2 and the electrocardiogram waveform 5ECG in accordance with the cardiac phase of the analysis results in the animated display of the analysis results. Furthermore, when bar 5PT is moved along the horizontal axis of the graph or electrocardiogram waveform in response to an operator's instruction, analysis results 5RV, 5RA, 5LV, and 5LA are displayed as the analysis results corresponding to the position of the moved bar, based on the cardiac phase in the accompanying information and the cardiac phase indicated by the moved bar.

[0046] Figure 6 shows an example display (tile display) of the analysis results when the cardiac chamber to be analyzed is four chambers and the image format is a polar map. Figure 6 differs from Figure 5 in that the image format is a three-dimensional image and a polar map. The polar map displays curves and lines indicating the division of segments.

[0047] FIG. 7 shows an example of the layout of analysis results when the cardiac chamber to be analyzed is four and the image format is a short-axis tomographic image (two-dimensional image). SAX-B in FIG. 7 indicates the display position of a short-axis tomographic image (SAX) of the base of the heart, onto which hues corresponding to the values ​​of the analysis parameters are mapped. SAX-M in FIG. 7 indicates the display position of a short-axis tomographic image of the mid-cavity, onto which hues corresponding to the values ​​of the analysis parameters are mapped. SAX-A in FIG. 7 indicates the display position of a short-axis tomographic image of the apical of the heart, onto which hues corresponding to the values ​​of the analysis parameters are mapped. The analysis result of SAX-A in FIG. 7 is accompanied by, for example, the accompanying information shown in FIG. 3(a). In a blank area 7BK of a display area 7DA in FIG. 7, graphs showing the time-dependent changes in the values ​​of the analysis parameters in the analysis results SAX-B, SAX-A, and SAXM, electrocardiogram waveforms, rendering images showing the cross-sectional positions of the short-axis tomographic images related to the analysis results, and the like are displayed.

[0048] FIG. 8 is a diagram showing an example of the layout of the analysis results when the cardiac chamber to be analyzed is four and the image format of the analysis results is a mixture of three-dimensional images and two-dimensional images. RV3D in FIG. 8 indicates the display position of a rendering image of the right ventricle onto which a hue corresponding to the value of the analysis parameter is mapped. RA2D in FIG. 8 indicates the display position of a cross-sectional image of the right atrium onto which a hue corresponding to the value of the analysis parameter is mapped. LV3D in FIG. 8 indicates the display position of a rendering image of the left ventricle onto which a hue corresponding to the value of the analysis parameter is mapped. LA2D in FIG. 8 indicates the display position of a cross-sectional image of the left atrium onto which a hue corresponding to the value of the analysis parameter is mapped.

[0049] 5 to 8 are used when performing spatial comparison of analysis results. Figures 5 to 8 are examples of layouts of analysis results for spatial comparison of analysis results, and are not limited to these. For example, a layout useful for spatial comparison of analysis results may be determined based on supplementary information, a management table, etc., by combining other cardiac chambers, other image modes, etc. Furthermore, the number of analysis results displayed in one display area is not limited to four.

[0050] Fig. 9 is a diagram showing an example of the layout of four analysis results acquired at different dates and times for one cardiac chamber (left ventricle LV). The layout of the analysis results is determined based on the dates and times of acquisition of medical images used to analyze the wall motion of the cardiac chamber. Fig. 9 is used when comparing analysis results over time.

[0051] FIG. 10 is a diagram showing an example of the layout of analysis results for comparing stress echo phases (before and after drug administration) in two cardiac chambers (left ventricle LV and left atrium LA). As shown in FIG. 10, the display position of the analysis results related to the left ventricle LV is determined to be the lower part of the display area 10DA. The display position of the analysis results related to the left atrium LA is determined to be the upper part of the display area 10DA. The display position of the analysis results related to before drug administration is determined to be the left side of the display area 10DA. The display position of the analysis results related to after drug administration is determined to be the right side of the display area 10DA. As a result, the layout of the analysis results is arranged as shown in FIG. 10. Note that for one cardiac chamber such as the left ventricle LV, four analysis results corresponding to four stress echo phases (before administration, two time phases during administration, after administration, etc.) may be displayed in tiles.

[0052] FIG. 11 is a diagram showing an example of the layout of analysis results for comparing before and after CRT treatment in two cardiac chambers (left ventricle LV and right ventricle RV). As shown in FIG. 11, the display position of the analysis results related to the left ventricle LV is determined to be on the right side of the display area 11DA. The display position of the analysis results related to the right ventricle RV is determined to be on the left side of the display area 11DA. The display position of the analysis results related to before CRT treatment is determined to be in the upper part of the display area 11DA. The display position of the analysis results related to after CRT treatment is determined to be in the lower part of the display area 11DA. As a result, the layout of the analysis results is arranged as shown in FIG. 11.

[0053] FIG. 12 is a diagram showing an example of the layout of analysis results for comparing different image aspects in two cardiac chambers (left ventricle LV and left atrium LA). As shown in FIG. 12, the display position of the analysis results related to the left ventricle LV is determined to be the lower part of the display area 12DA. The display position of the analysis results related to the left atrium LA is determined to be the upper part of the display area 12DA. The display position of the analysis results using a surface rendering image as the image aspect is determined to be the left part of the display area 12DA. The display position of the analysis results using a polar map as the image aspect is determined to be the right part of the display area 12DA. For example, the analysis result in the lower right of FIG. 12 is accompanied by the accompanying information shown in FIG. 3(b). As a result, the layout of the analysis results is arranged as shown in FIG. 12. Note that the combination of image aspects is not limited to a rendering image and a polar map, and other combinations of image aspects may be used.

[0054] FIG. 13 is a diagram showing an example of the layout of analysis results for comparing different analysis parameters in two cardiac chambers (left ventricle LV and left atrium LA). As shown in FIG. 13, the display position of the analysis results related to the left ventricle LV is determined to be the lower part of the display area 13DA. The display position of the analysis results related to the left atrium LA is determined to be the upper part of the display area 13DA. The display position of the analysis results showing the long axis strain is determined to be the left part of the display area 13DA. The display position of the analysis results showing the time to peak is determined to be the right part of the display area 13DA. For example, the analysis result in the upper right of FIG. 13 is accompanied by the accompanying information shown in FIG. 3(c). As a result, the layout of the analysis results is arranged as shown in FIG. 13.

[0055] Fig. 14 is a diagram showing an example of the layout of four analysis results with different image aspects for one cardiac chamber (left ventricle LV). LV 2D 4chView (apical 4-chamber cross-sectional image), LV 2D 3chView (apical left ventricular long-axis cross-sectional image), and LV 2D 2chView (apical 2-chamber cross-sectional image) in Fig. 14 indicate the display positions of analysis results corresponding to the three basic cross sections for the left ventricle LV. LV 3D in Fig. 14 is a three-dimensional analysis result of the left ventricle corresponding to 4LV in Fig. 5, and for example, cross-sectional positions corresponding to the three basic cross sections are superimposed.

[0056] Note that the layouts of the analysis results shown in Figures 5 to 14 are examples and are not limited to these. The thumbnails in Figures 5 to 14 correspond to layout images. When a further selection of a layout image is input (Yes in step Sb6), the process of step Sb5 is executed. The analysis results are displayed until the analysis result comparison mode is ended (step Sb7).

[0057] According to the above-described configuration, the following effects can be obtained. According to the ultrasound diagnostic device 1 and medical processing device 20 of this embodiment, analysis results of each of a plurality of cardiac chambers obtained by analyzing a medical image can be accompanied by additional information including information about the type of cardiac chamber, and the display position of the analysis results can be determined based on the additional information. Furthermore, according to this embodiment, the display position can be determined within the display area of ​​the screen of one display 15 or within the display area of ​​the screens of multiple displays.

[0058] For example, if the analysis results are a first analysis result for a first heart chamber and a second analysis result for a second heart chamber, the first analysis result can be obtained by analyzing a first time-series image (first volume data), and the second analysis result can be obtained by analyzing a second time-series image (second volume data) different from the first time-series image. Alternatively, the first analysis result and the second analysis result can be obtained by analyzing a common time-series image (volume data) for the first and second heart chambers. This allows the analysis results to be analyzed for each heart chamber according to the volume data acquired. Next, first and second auxiliary information are attached to the first and second analysis results, respectively. The display position of the first and second analysis results can be determined based on the first and second auxiliary information, respectively. This allows the multiple analysis results to be arranged and displayed in the display area of ​​the screen of the display 15 according to the type of heart chamber, i.e., the anatomical positional relationship of the multiple heart chambers.

[0059] Furthermore, according to this embodiment, cardiac phase information can be included in the supplementary information, and the analysis results of multiple cardiac chambers can be displayed in a synchronized manner based on the supplementary information. This allows multiple analysis results to be displayed in a synchronized video in accordance with instructions from the operator, thereby improving diagnostic efficiency.

[0060] Furthermore, according to this embodiment, the incidental information includes scan order information associated with the regions as region type information, and the analysis results are obtained according to the scan order by analyzing the medical data collected according to the scan order, and the display position of the analysis results can be determined in accordance with the anatomical positional relationship of the regions based on the scan order in the incidental information. This eliminates the need to set (input) the region type, improves the convenience of the analysis result comparison mode, and improves diagnostic efficiency.

[0061] As described above, according to this embodiment, unified processing using supplementary information of the analysis results, i.e., processing related to the function of unified display of the analysis results, allows the analysis results of the wall motion of the cardiac chamber to be displayed in a desired layout with simple operations. In other words, various inputs are not required when displaying the wall motion analysis results, such as inputs for selecting analysis results with different anatomical positional relationships but the same other attributes, and inputs for selecting analysis results with different temporal relationships but the same other attributes. This reduces the complexity and burden of setting up comparative display of the analysis results. In addition, two-dimensional and three-dimensional analysis results can be displayed together without complex inputs. For these reasons, this embodiment simplifies local wall motion analysis and improves diagnostic efficiency.

[0062] (First Modification) The difference from the above-described embodiment is that when the analysis result includes an image showing the outline of the region to be analyzed, these images corresponding to each of the multiple regions are merged based on the accompanying information by the processing circuitry 37 that realizes the image processing function 371. Specifically, when the analysis result is an image showing the outline of the heart chamber (for example, a surface rendering image) onto which a hue corresponding to the value of the analysis parameter indicating the movement of the heart chamber is mapped, a composite image is generated by merging the analysis results of the multiple heart chambers based on the anatomical positional relationship of the heart chambers.

[0063] The processing circuitry 37, which realizes the image processing function 371, generates a composite image by merging the analysis results of multiple heart chambers based on the anatomical positional relationships of the heart chambers. The generation of the composite image is performed, for example, in response to an instruction from an operator. Specifically, the processing circuitry 37 acquires the coordinates of each of multiple segments of multiple surface rendering images corresponding to the multiple heart chambers. The processing circuitry 37 aligns the multiple surface rendering images, to which hues corresponding to values ​​of analysis parameters indicating the movement of the heart chambers are mapped, based on the coordinates of the segments. The alignment of the multiple surface rendering images can be adjusted as appropriate in response to an instruction from the operator. Note that, if volume data including multiple heart chambers has been generated, the processing circuitry 37 may align the multiple rendering images based on the positions of each heart chamber in the volume data. The processing circuitry 37 displays the generated composite image on the display 15. The processing circuitry 37 may control the display 15 to rotate the composite image around an arbitrary rotation axis in response to an instruction from the operator.

[0064] Furthermore, the processing circuitry 37 may synthesize multiple graphs corresponding to multiple analysis results based on the accompanying information. Specifically, the processing circuitry 37 generates a synthesized graph by synthesizing a time change curve of global strain, which indicates the average strain of the entire myocardium, with a time change curve of the volume of each cardiac chamber, with the cardiac phases being matched.

[0065] The processing circuitry 37 realizing the auxiliary function 375 generates the composite auxiliary information by combining the auxiliary information attached to the multiple analysis results related to the composite image after generating the composite image. The processing circuitry 37 attaches the composite auxiliary information to the composite image and stores it in the memory circuitry 33.

[0066] FIG. 15 is a diagram showing an example of a composite image 15CI obtained by combining surface rendering images based on the four-chamber analysis results shown in FIG. 5. As shown in FIG. 15, four surface rendering images corresponding to the four cavities are aligned and combined to be displayed as a composite image 15CI. At this time, the composite image 15CI is displayed as a moving image in response to an instruction from the operator. A composite graph may also be displayed next to the composite image 15CI. Various graphs and electrocardiogram waveforms may also be displayed together with the composite image 15CI.

[0067] Furthermore, a composite image may be generated for the two-chamber analysis results as shown in Figures 10, 11, and 13. In this case, in Figure 10, a composite image of the LV and LA combined before drug loading is displayed in the left half of the display area, and a composite image of the LV and LA combined after drug loading is displayed in the right half of the display area. In addition, in Figure 11, a composite image of the RV and LV combined before CRT treatment is displayed in the lower half of the display area, and a composite image of the RV and LV combined after CRT treatment is displayed in the upper half of the display area. In Figure 13, a composite image of the long-axis strain combined between the LV and LA is displayed in the left half of the display area, and a composite image of the time to peak combined between the LV and LA is displayed in the right half of the display area.

[0068] According to the above-described configuration, the following effects can be obtained. According to the ultrasound diagnostic device 1 and medical processing device 20 of this modification, when the analysis result is an image (e.g., a surface rendering image) showing the outline of a cardiac chamber to which hues corresponding to values ​​of analysis parameters indicating cardiac chamber motion are mapped, a composite image can be generated as the analysis result by merging the analysis results of multiple cardiac chambers based on the anatomical positional relationships of the cardiac chambers. This allows the composite image to be rotated and displayed around any axis in response to an operator's instruction, allowing the operator to grasp the analysis results of multiple cardiac chambers as a whole. Furthermore, a composite graph can be generated by merging multiple graphs corresponding to multiple analysis results. Therefore, according to this modification, an overall image of multiple analysis results from the analysis of cardiac chamber wall motion can be displayed with simple operations, reducing the burden on the operator and improving diagnostic efficiency.

[0069] (Second Modification) The difference from the above-described embodiment is that the display 15 is controlled to switch between a display position determined based on the type of cardiac chamber and the collection date and time, a display position determined based on the type of cardiac chamber and the phase of stress echo, a display position determined based on the type of cardiac chamber and the progress of treatment, and a display position determined based on the type of cardiac chamber and the image appearance of the analysis results.

[0070] The processing circuitry 37, which realizes the display control function 377, switches between a display position determined based on the type of cardiac chamber and the acquisition date and time, a display position determined based on the type of cardiac chamber and the phase of stress echocardiography, a display position determined based on the type of cardiac chamber and the progress of treatment, and a display position determined based on the type of cardiac chamber and the image format of the analysis results. That is, the processing circuitry 37 controls the display 15 to enable the above switching. Specifically, the processing circuitry 37 generates multiple tabs corresponding to the layout type of the analysis results determined based on the supplementary information. The multiple tabs include, for example, Tile, which displays analysis results corresponding to multiple cardiac chambers in tiles according to their anatomical positional relationships, as shown in FIGS. 5 to 8 and 14; Comp, which displays a time comparison of analysis results for multiple cardiac chambers, as shown in FIGS. 9 to 13; and Merge, which displays a composite image of the analysis results. The multiple tabs may also include a tab (referred to as a reanalysis tab) that displays a screen for re-executing wall motion analysis on volume data for each of the multiple cardiac chambers by resetting the initial contour, etc. Instead of displaying the reanalysis tab, a screen for re-executing wall motion analysis may be displayed in response to a double-click on the displayed analysis result. Furthermore, when there are many combinations (layouts) of display positions of the analysis results corresponding to the tabs, the processing circuitry 37 may generate multiple tabs in a hierarchical manner according to combinations of various attributes included in the supplementary information. In this case, the processing circuitry 37 manages the layouts hierarchically according to the various attributes included in the supplementary information.

[0071] The processing circuitry 37 switches the display position of the analysis results in response to the selection of a tab, and displays the multiple analysis results on the display 15. That is, the processing circuitry 37 controls the display 15 to switch the layout of the analysis results before the selection of a tab to the layout of the analysis results corresponding to the selected tab.

[0072] Fig. 16 is a diagram showing an example of a display in which the Tile tab is selected and the tiled analysis results and graphs for the four cavities are displayed together with multiple tabs. The tabs LV, LA, RV, and RA in Fig. 16 indicate tabs that display a screen for re-executing wall motion analysis. For example, when the Merge tab is selected in Fig. 16, a composite image such as that shown in Fig. 15 is displayed. At this time, the Merge tab is highlighted, and the Tile tab is displayed normally.

[0073] The processing circuitry 37 may display a plurality of layout images together with the analysis results instead of generating tabs. In this case, the analysis results corresponding to the selected layout image are displayed on the display 15.

[0074] Fig. 17 is a diagram showing a display example in which a plurality of layout images are displayed together with analysis results. LV Comp in Fig. 17 is a layout image corresponding to a time comparison of analysis results of the left ventricle LV, for example, as shown in Fig. 9. LV-LA Comp in Fig. 17 is a layout image corresponding to a time comparison of analysis results of the left ventricle LV and the left atrium LA, for example, as shown in Figs. 10, 12, and 13. LV 3D-2D in Fig. 17 is a layout image corresponding to a mixed display of three-dimensional images and two-dimensional images relating to analysis results of the left ventricle LV, for example, as shown in Fig. 14.

[0075] According to the above-described configuration, the following effects can be obtained. The ultrasound diagnostic device 1 and medical processing device 20 of this modification can further include, in the supplementary information, information regarding the acquisition date and time of the medical image, information regarding the stress echo phase at which the medical image was acquired, information regarding the progress of treatment for at least one of the multiple cardiac chambers, and information regarding the image appearance of the analysis results. This allows the display 15 to be controlled to switch between a display position determined based on the type of cardiac chamber and acquisition date and time, a display position determined based on the type of cardiac chamber and the stress echo phase, a display position determined based on the type of cardiac chamber and the progress of treatment, and a display position determined based on the type of cardiac chamber and the image appearance of the analysis results. For example, the display format of the analysis results can be switched depending on the selection of a tab or layout image displayed together with multiple analysis results. This allows multiple analysis results based on the wall motion analysis of the cardiac chamber to be displayed with the simple operation of selecting a tab or layout image. Furthermore, wall motion analysis of the cardiac chamber can be performed again while the analysis results are displayed. This allows wall motion analysis to be easily performed again while the analysis results are displayed.

[0076] As described above, according to this modification, the burden on the operator when displaying the wall motion analysis results in a desired layout can be reduced, and diagnostic efficiency can be improved.

[0077] (Third Modification) This modification is to apply the processing of the second modification to the composite image. The processes executed by the processing circuit 37 in this modification can be understood by appropriately replacing the analysis results of the second modification with those of the composite image, and therefore detailed explanations will be omitted.

[0078] FIG. 18 is a diagram showing an example of a comparative display of a composite image (anatomical-merge) obtained by combining the analysis results of four chambers. As shown in FIG. 18, tab 1, the Comp tab, and the Merge tab are highlighted. When the Tile tab is selected, non-merged analysis results are tiled. Tab 1 is a tab showing a comparative display of composite images obtained by combining four chambers. Tab 2 is a tab showing a comparative display of a left ventricle-left atrial composite image obtained by combining the left ventricle and the left atrium, for example. Tab 3 is a tab showing a comparative display of a right and left ventricle composite image obtained by combining the left ventricle and the right ventricle, for example. Tab 4 is a tab showing a comparative display of a three-chamber composite image obtained by combining the left ventricle, the left atrium, and the right ventricle, for example. As shown in FIG. 18, the tile display, comparative display, etc. of the composite image after merging can be switched depending on the tab selected.

[0079] For example, the processing circuitry 37 generates a two-chamber composite image (a left ventricle-left atrium composite image, a left and right ventricle composite image) by combining two of the four chambers. Next, the processing circuitry 37 controls the display 15 in response to an instruction from the operator to perform a comparative display of the two-chamber composite image, such as before and after stress or before and after treatment. The tile display and comparison display according to this modification are attached to various composite images, and therefore, unlike the tile display and comparison display according to the present embodiment, have a nested structure that is included in the category of composite images.

[0080] According to the above-described configuration, the following effects can be obtained. The ultrasound diagnostic device 1 and medical processing device 20 in this modification can achieve the same effects as the present embodiment and the second modification with respect to the composite image. That is, a tiled display and a comparative display of a composite image that combines multiple analysis results for multiple cardiac chambers can be displayed with a simple operation, which makes wall motion analysis easier, reduces the burden on the operator, and improves the diagnostic efficiency of the analysis results.

[0081] (Fourth Modification) The difference from the above-described embodiment and modified examples is that the multiple parts of the heart to be analyzed include at least one valve among the tricuspid valve, the pulmonary valve, the mitral valve, and the aortic valve.

[0082] The processing circuitry 37 that realizes the auxiliary function 375 sets the patient ID, the type of valve to be analyzed, the image mode, the name of the analysis parameter, etc., prior to executing the analysis function 373. The type of valve is, for example, the valve name, and is input by an operator via the input interface circuitry 13. The processing circuitry 37 includes the information on the set valve in the auxiliary information. The type of valve is entered in the section for type of part corresponding to the section for type of cardiac chamber in the auxiliary information in FIG. 3.

[0083] The processing circuitry 37 realizing the analysis function 373 analyzes the motion of each set valve by applying a predetermined valve motion analysis to a group of medical images for each set valve. The predetermined valve motion analysis is, for example, two-dimensional WMT or three-dimensional WMT. Note that the predetermined valve motion analysis is not limited to WMT, and various techniques such as tissue Doppler imaging may also be used.

[0084] By executing the analysis program for the analysis function 373, the processing circuitry 37 sets, for example, a plurality of constituent points representing the inner contour of the valve and a plurality of constituent points representing the outer contour of the valve as initial contours on a medical image corresponding to a predetermined cardiac phase among the medical image group. The processing circuitry 37 tracks the positions of the constituent points on other medical images included in the medical image group in chronological order, starting from the medical image on which the initial contour was set. Based on the tracking results, the processing circuitry 37 calculates values ​​of various analysis parameters related to valve motion. For example, for the mitral valve, the analysis parameters include diastolic descent rate and systolic anterior movement. The processing circuitry 37 generates, as images showing the analysis results of valve motion, surface rendering images, MPR images, etc., to which hues corresponding to the values ​​of the analysis parameters are mapped.

[0085] The processing circuitry 37, which realizes the display control function 377, determines the display positions (sections) of the analysis results to be displayed in the display area of ​​the display 15 as a layout based on the type of part (type of cardiac chamber and type of valve) in the supplementary information and the anatomical positional relationship of the multiple parts (cardiac chambers and valves). Specifically, the display positions of the analysis results in the layout correspond to the anatomical positions of the cardiac chambers and valves. The processing circuitry 37 displays the analysis results of the valves according to the determined layout.

[0086] FIG. 19 shows an example display (tile display) of analysis results when the analysis target is four cardiac chambers and four valves and the image format is a surface rendering image. Note that the number of valves is not limited to four. 19MV shown in FIG. 19 shows a surface rendering image of the mitral valve on which hues corresponding to the values ​​of the mitral valve analysis parameters are mapped. 19AV shown in FIG. 19 shows a rendering image of the aortic valve on which hues corresponding to the values ​​of the aortic valve analysis parameters are mapped. 19PV shown in FIG. 19 shows a rendering image of the pulmonary valve on which hues corresponding to the values ​​of the pulmonary valve analysis parameters are mapped. 19TV shown in FIG. 19 shows a rendering image of the tricuspid valve on which hues corresponding to the values ​​of the tricuspid valve analysis parameters are mapped. FIG. 19 shows a layout in which the analysis results of the four valves are added to the display example of the four-chamber analysis results shown in FIG. 5 according to the anatomical positional relationship between the four chambers and the four valves.

[0087] As an application example of this modification, it is also possible to apply the processing of the first modification to this modification. For example, when the display example shown in Fig. 19 is displayed on the display 15, the processing circuitry 37 realizing the image processing function 371 generates a composite image in response to an instruction from the operator, for example.

[0088] FIG. 20 is a diagram illustrating an example of a composite image obtained by combining surface-rendered images showing the analysis results of the four chambers and four valves shown in FIG. 19 . As shown in FIG. 20 , eight analysis result images corresponding to the four chambers (left ventricle LV, right ventricle RV, left atrium LA, right atrium RA) and four valves (mitral valve MV, aortic valve AV, pulmonary valve PV, tricuspid valve TV) are aligned at the same cardiac phase. A composite image generated for each cardiac phase through this alignment is displayed on the display 15. Although there are gaps between the four chambers and four valves in FIG. 20 , the four chambers and four valves may be adjacent to each other according to their anatomical positional relationships. In this case, the transparency (or opacity), brightness value, etc. of each of the four chambers and four valves may be adjusted, for example, by an operator using a scroll bar provided at the bottom of the composite image. Although FIG. 20 illustrates four valves as an example, the number of valves displayed is not limited to four.

[0089] According to the above-described configuration, the following effects can be obtained. According to the ultrasound diagnostic device 1 and medical processing device 20 of this modification, the analysis results of at least one of the tricuspid valve, pulmonary valve, mitral valve, and aortic valve at multiple locations can be displayed on the display 15 together with the analysis results of the cardiac chambers in accordance with the anatomical positional relationship based on the supplementary information. Furthermore, according to this modification, a composite image can be displayed with adjustable transparency and brightness values ​​for the four chambers and four valves.

[0090] As described above, according to this modification, by performing unified processing using the accompanying information attached to the analysis results, i.e., processing related to the function of displaying the analysis results in a unified manner, it is possible to display the analysis results of multiple parts of the heart, including multiple heart chambers and multiple valves, while maintaining the anatomical positional relationships, with simple operations. As a result, according to this modification, diagnosis of local wall motion analysis and valve motion analysis of the heart chambers is simplified, and diagnostic efficiency can be improved.

[0091] (Fifth Modification) The difference from the above-mentioned embodiments and variants is that the integrated analysis results are obtained by integrating and analyzing medical data corresponding to adjacent parts selected by the operator from among multiple parts, and the display position of the integrated analysis results is determined based on supplementary information including information on the integration of the adjacent parts.

[0092] The input interface circuit 13 inputs adjacent regions (hereinafter referred to as adjacent regions) from among the multiple regions in response to a selection instruction from the operator. The input of adjacent regions corresponds to grouping the multiple regions. The selection instruction may be input at any time, for example, before the processing of step Sb1 in the flowchart of FIG. 4. For example, if the operator desires an analysis result integrating the left ventricle and the right ventricle to diagnose anomalies such as ventricular septal defect or single ventricle, the left ventricle and the right ventricle are selected from among the multiple regions. Furthermore, if the operator desires an analysis result integrating the left ventricle and the left atrium to diagnose valvular disease related to the mitral valve, the left ventricle and the left atrium are selected from among the multiple regions. Note that the selection of regions is not limited to the above description and can be arbitrarily selected according to the operator's desire.

[0093] The processing circuitry 37 realizing the auxiliary function 375 includes information integrating adjacent regions (hereinafter referred to as region integrated information) in the auxiliary information. When the left ventricle and the right ventricle are selected, the column for the type of cardiac chamber in the auxiliary information in Fig. 3 becomes, for example, "biventricular." When the left ventricle and the left atrium are selected, the column for the type of cardiac chamber in the auxiliary information in Fig. 3 becomes, for example, "left cardiac chamber."

[0094] The processing circuitry 37, which realizes the analysis function 373, integrates medical images of the same cardiac phase in a group of medical images corresponding to adjacent regions into one medical data. The processing circuitry 37 sets an initial contour for the adjacent region. The processing circuitry 37 analyzes the integrated medical data using the initial contour to obtain an integrated analysis result. For example, when the left ventricle and the right ventricle are selected, an analysis result for the entirety of both ventricles, integrating the left ventricle and the right ventricle, is generated as the integrated analysis result. Also, for example, when the left ventricle and the left atrium are selected, an analysis result for the entirety of the left cardiac chamber, integrating the left ventricle and the left atrium, is generated as the integrated analysis result.

[0095] The processing circuitry 37 that realizes the display control function 377 determines the display position (section) of the integrated analysis result on the display 15 based on the part integration information in the supplementary information. The processing circuitry 37 displays the integrated analysis result at the determined display position.

[0096] FIG. 21 is a diagram showing an example of the integrated analysis result LRV when the left ventricle and the right ventricle are selected. As shown in FIG. 21, when the left ventricle and the right ventricle are selected by the operator, the integrated analysis result LRV for both ventricles as a whole, integrating the left ventricle and the right ventricle, is displayed. In FIG. 21, the analysis results of the right atrium RA and the left atrium LA are also shown in addition to the integrated analysis result LRV, but only the integrated analysis result LRV may be displayed. Furthermore, the number of regions to be integrated and analyzed is not limited to two as shown in FIG. 21. For example, the adjacent regions may be a heart chamber and a valve, such as the left ventricle, the mitral valve, and the aortic valve.

[0097] According to the above-described configuration, the following effects can be obtained. According to the ultrasound diagnostic device 1 and medical processing device 20 of this modification, medical data corresponding to adjacent regions selected by the operator from among multiple regions are integrated and analyzed to obtain an integrated analysis result, and the display position of the integrated analysis result can be determined based on the supplementary information including the information on the integration of the adjacent regions. As a result, according to this modification, regions selected by the operator's selection according to their desire, not limited to cardiac anomalies, can be integrated and analyzed.

[0098] As described above, according to this modification, even if at least one of the multiple regions has a malformation, the integrated analysis results can be displayed with a simple operation while maintaining the anatomical positional relationship. As a result, according to this modification, diagnosis of motion analysis at multiple regions of the heart is simplified and diagnostic efficiency can be improved.

[0099] (Sixth Modification) The difference from the above-mentioned embodiment and variant examples is that the part specified by the operator among multiple parts and the parts adjacent to the specified part are identified, and images showing the analysis results corresponding to the identified parts are merged.

[0100] The input interface circuit 13 designates one of the multiple regions in response to an instruction from the operator. The operator may input the region designation at any time, for example, before the processing of step Sb1 in the flowchart of FIG.

[0101] The processing circuitry 37, which realizes the image processing function 371, identifies a designated region (hereinafter referred to as a designated region) and regions adjacent to the designated region. The processing circuitry 37 generates a composite image by merging images showing analysis results corresponding to the identified regions. The processing circuitry 37 displays the composite image on the display 15.

[0102] For example, if the left ventricle is specified, the composite image includes the analysis results of the left ventricle, the right ventricle, the mitral valve, and the aortic valve. In this case, the composite image is, for example, an image in which the analysis results of the mitral valve and the aortic valve are combined with the LRV in FIG. 21.

[0103] According to the above-described configuration, the following effects can be obtained. The ultrasound diagnostic device 1 and medical processing device 20 in this modification can identify a region designated by the operator from among multiple regions and a region adjacent to the designated region, and merge images showing analysis results corresponding to the identified region. As a result, this modification can merge the analysis results of the region focused on by the operator (hereinafter referred to as the region of interest) and the analysis results of regions adjacent to the region of interest, and display them on the display 15. As described above, this modification simplifies diagnosis of motion analysis centered on the region of interest, thereby improving diagnostic efficiency.

[0104] (Seventh Modification) The difference from the above-mentioned embodiment and variant examples is that the additional information includes information regarding the disease name, and based on the additional information, from multiple parts, parts related to the disease name and parts adjacent to the parts related to the disease name are identified, and images showing the analysis results corresponding to the identified parts are merged.

[0105] The input interface circuit 13 inputs the disease name in response to an instruction from the operator. The disease name may be input at any time before the processing of step Sa5 in the flowchart of FIG.

[0106] The processing circuitry 37 that realizes the auxiliary function 375 includes information on the input disease name in the auxiliary information. The processing circuitry 37 incorporates information that associates a site related to the disease name with a site adjacent to the site related to the disease name (hereinafter referred to as disease name-related site information) into the auxiliary information. The disease name information and disease name-related site information are added as new attributes to the auxiliary information in FIG. 3, for example.

[0107] In response to activation of the analysis result comparison mode, the processing circuitry 37, which realizes the display control function 377, controls the display 15 to display, for example, a disease name in a dialog box. When a disease name is specified via the input interface circuitry 13, the processing circuitry 37 identifies, from multiple regions, a region associated with the disease name and a region adjacent to the region associated with the disease name based on the accompanying information. The processing circuitry 37 merges images showing the analysis results corresponding to the identified regions. Note that in this modification, if a disease name is input before the processing of step Sb1, medical data related to the identified regions may be integrated to obtain an integrated analysis result, as in the fifth modification.

[0108] For example, if the disease name is ventricular septal defect, when the disease name is specified via the input interface circuitry 13, the processing circuitry 37 realizing the display control function 377 identifies the left ventricle and the right ventricle. Next, the processing circuitry 37 generates a composite image by aligning an image showing the analysis result of the identified left ventricle with an image showing the analysis result of the identified right ventricle at the same cardiac phase. The composite image corresponds to, for example, the LRV in FIG. 21 .

[0109] According to the above-described configuration, the following effects can be obtained. According to the ultrasound diagnostic device 1 and medical processing device 20 of this modification, the incidental information includes information related to the disease name, so that it is possible to identify, from multiple regions, a region related to the disease name and a region adjacent to the region related to the disease name based on the incidental information, and merge images showing analysis results corresponding to the identified regions. As a result, according to this modification, it is possible to merge analysis results of regions identified according to the name of a cardiac disease and display them on the display 15. As described above, according to this modification, diagnosis of motion analysis for cardiac diseases is simplified and diagnostic efficiency can be improved.

[0110] (Eighth Modification) The difference from the above-described embodiment and variant examples is that the supplementary information includes multiple measurement values ​​measured at a site, and based on the supplementary information, from the multiple sites, sites corresponding to measurement values ​​outside the reference range among the multiple measurement values ​​and sites adjacent to the sites corresponding to measurement values ​​outside the reference range are identified, and images showing the analysis results corresponding to the identified sites are merged.

[0111] The input interface circuit 13 inputs, in response to an operator's instructions, a plurality of measurements for a plurality of parts of the heart in an ultrasound image as measurement items in an echocardiogram, such as the valve orifice area of ​​various valves, the diameter of various cardiac chambers, the wall thickness of various cardiac chambers, and various blood flow velocity waveforms in Doppler data.

[0112] The memory circuitry 33 stores a reference range for each of a plurality of measurement values ​​obtained by a plurality of measurements. The reference range corresponds to, for example, a range within which the measured value is determined to be normal, and is set in advance for each of the plurality of measurements.

[0113] The processing circuitry 37 that realizes the additional function 375 includes the measured measurement value and the name of the measurement item in the additional information corresponding to the measured body part. The measurement value is added as a new attribute in the additional information in FIG. 3, for example. This additional information associates the measurement value with the body part.

[0114] The processing circuitry 37, which realizes the image processing function 371, identifies a measurement value that is outside a reference range among multiple measurement values. The processing circuitry 37 identifies a region corresponding to the identified measurement value and a region adjacent to the region corresponding to the identified measurement value based on the accompanying information. The processing circuitry 37 generates a composite image by merging images showing analysis results corresponding to the identified region (hereinafter referred to as the specific region). The processing circuitry 37 displays the composite image on the display 15.

[0115] For example, if the measurement item corresponding to the measurement value outside the reference range is the aortic valve orifice area and this valve orifice area is outside the reference range, the processing circuitry 37 realizing the image processing function 371 identifies the aortic valve from among the multiple regions based on the accompanying information. Next, the processing circuitry 37 identifies the left ventricle and the left atrium as regions adjacent to the aortic valve. The processing circuitry 37 generates a composite image by merging an image showing the analysis results of the aortic valve, an image showing the analysis results of the left ventricle, and an image showing the analysis results of the left atrium. The processing circuitry 37 displays the composite image on the display 15. Note that in this modification, if a measurement value outside the reference range is identified before the processing of step Sb1, medical data related to the specific region may be integrated to obtain an integrated analysis result as in the fifth modification.

[0116] According to the above-described configuration, the following effects can be obtained. According to the ultrasound diagnostic device 1 and medical processing device 20 of this modification, the incidental information includes multiple measurement values ​​measured at a region, and therefore, based on the incidental information, it is possible to identify a region corresponding to a measurement value outside the reference range among the multiple measurement values ​​and a region adjacent to the region corresponding to the measurement value outside the reference range, and merge images showing analysis results corresponding to the identified regions. As a result, according to this modification, it is possible to merge the analysis results of the region corresponding to the measurement value outside the reference range with the analysis results of the region adjacent to this region, and display them on the display 15. As described above, according to this modification, diagnosis of motion analysis of measurement values ​​in the heart is simplified, and diagnostic efficiency can be improved.

[0117] (Ninth Variation) The difference from the above-described embodiment and modifications is that the display position of medical data (hereinafter referred to as "other medical data") of a region of the heart collected by a modality other than the ultrasound diagnostic apparatus 1 (such as an X-ray diagnostic apparatus, an X-ray computed tomography apparatus, a magnetic resonance imaging apparatus, or a nuclear medicine diagnostic apparatus) is determined based on the accompanying information, and an image of the other medical data is displayed on the display 15 together with the analysis results shown in the present embodiment, the fourth modification, and the like. Hereinafter, for simplicity of explanation, the other medical data is assumed to be coronary artery image data. Note that the other medical data is not limited to coronary artery medical data and may be any data indicating morphological information of other regions of the heart, such as papillary muscles, chordae tendineae, and the conduction system. Furthermore, analysis results of the other medical data (hereinafter referred to as "other analysis results") may be used in addition to or instead of the other medical data. An example of the other analysis results is fractional flow reserve (FFR). Note that the other analysis results are not limited to FFR and may be any data indicating cardiac function information, such as myocardial scintigraphy.

[0118] The communication interface circuitry 31 receives coronary artery data from another modality or image archive via a network. The communication interface circuitry 31 may also receive FFR related to the heart of the subject P from another modality or image archive via a network. Analysis parameters such as FFR may be analyzed using other medical data such as coronary artery data by the processing circuitry 37 that implements the analysis function 373.

[0119] The processing circuitry 37 that realizes the additional function 375 sets the patient ID, the type of coronary artery to be analyzed, the image aspect, the name of the analysis parameter, etc. The type of coronary artery is, for example, the name of the coronary artery, and is set by input by the operator via the input interface circuitry 13 or tag information related to the coronary artery data. The processing circuitry 37 includes the information on the set coronary artery in the additional information. The coronary artery name is, for example, the right coronary artery (RCA), the left coronary artery (LCA), etc.

[0120] The processing circuitry 37, which realizes the display control function 377, determines the display positions (sections) of the analysis results to be displayed in the display area of ​​the display 15 as a layout based on the anatomical positional relationship between the region corresponding to the coronary artery name in the region type of the supplementary information and the region related to the analysis results. Specifically, the display positions of the analysis results in the layout correspond to the anatomical positions of the coronary arteries. The processing circuitry 37 displays morphological images of the coronary arteries, the analysis results of the coronary arteries, etc., together with the analysis results shown in this embodiment and the fourth modified example, etc., according to the determined layout.

[0121] FIG. 22 shows a display example (tile display) of the analysis results of the four cardiac cavities and a coronary artery image (morphological information) when the analysis target is a four-chamber cardiac chamber and the image format is a surface-rendered image. The RCA shown in FIG. 22 is an image of the right coronary artery. The LCA shown in FIG. 22 is an image of the left coronary artery. The images of the right coronary artery and the left coronary artery are displayed by the processing circuitry 37, which realizes the display control function 377, synchronized with the cardiac phases of the analysis results RA of the right atrium, 22RV of the right ventricle, LA of the left atrium, and 22LV of the left ventricle. Instead of the image RCA of the right coronary artery, a surface-rendered image (functional information) of the right coronary artery may be used, in which a hue corresponding to the FFR value is mapped along the right coronary artery. Instead of the image LCA of the left coronary artery, a surface-rendered image (functional information) of the left coronary artery may be used, in which a hue corresponding to the FFR value is mapped along the left coronary artery. FIG. 22 shows a layout in which the morphological information of the coronary arteries is added to the analysis results of the four cavities shown in FIG. 5 in accordance with the anatomical positional relationship between the four cavities and the coronary arteries.

[0122] As an application example of this modification, it is also possible to apply the processing of the first modification to this modification. For example, when the display example shown in Fig. 22 is displayed on the display 15, the processing circuitry 37 realizing the image processing function 371 generates a composite image in response to an instruction from the operator, for example.

[0123] Fig. 23 shows an example of a composite image obtained by combining the analysis results of the left ventricle 22LV and the right ventricle 22RV shown in Fig. 22 with morphological information about the coronary arteries. As shown in Fig. 23, the left ventricle analysis result 23LV and an image of the left coronary artery LCA, and the right ventricle analysis result 23RV and an image of the right coronary artery RCA are registered at the same cardiac phase. A composite image generated for each cardiac phase by this registration is displayed on the display 15. At this time, the transparency, brightness, etc. of the left ventricle analysis result 23LV, the image of the left coronary artery LCA, the right ventricle analysis result 23RV, and the image of the right coronary artery RCA are adjusted by the operator's instructions using scroll bars SBR and SBL provided at the bottom of the composite images 23R and 23L in Fig. 23, respectively.

[0124] According to the above-described configuration, the following effects can be obtained. According to the ultrasound diagnostic device 1 and medical processing device 20 of this modification, the display position of other medical data of the heart collected by other modalities can be determined based on the accompanying information, and images of the other medical data can be displayed on the display 15 together with the analysis results shown in this embodiment and the fourth modification, etc. Furthermore, according to this modification, a composite image of the four valves can be displayed with transparency and brightness values ​​desired by the operator.

[0125] As described above, according to this modification, by performing unified processing using the incidental information attached to the analysis results, i.e., processing related to the function of unified display of the analysis results, it is possible to display the analysis results of multiple parts of the heart together with morphological or functional information of other parts while maintaining the anatomical positional relationship, with a simple operation. As a result, according to this modification, by taking into account the morphological or functional information of other parts, diagnosis of local wall motion analysis of a cardiac chamber, for example, becomes easier, and diagnostic efficiency can be improved.

[0126] As a modification of this embodiment, when the technical concept of the ultrasonic diagnostic apparatus 1 is realized in a medical processing device 20, the process of step Sa1 in the flowchart shown in FIG. 2 becomes "reading out medical images in chronological order from the storage circuitry 33." Note that the process of step Sa1 may also be "acquiring medical images in chronological order from the ultrasonic diagnostic apparatus 1 or a medical image storage device via the communication interface circuitry 31." The medical images described above may also be images collected by other modalities, such as an X-ray computed tomography apparatus or a magnetic resonance imaging apparatus. In addition, the analysis results may be analysis results performed by other modalities, etc.

[0127] In addition, the image processing function 371, analysis function 373, additional function 375, and display control function 377 in this embodiment can also be realized as a medical processing method by installing a program (medical processing program) that executes these functions on a computer such as a workstation and expanding the program in memory. In this case, the medical processing program causes the computer to add additional information, including information about the type of cardiac chamber, to the analysis results of each of the multiple cardiac chambers obtained by analyzing the medical images, and to determine the display position of the analysis results based on the additional information. Furthermore, the program that can cause a computer to execute this method can also be stored on various portable storage media, such as magnetic disks, optical disks, and semiconductor memories, and distributed.

[0128] According to the ultrasound diagnostic device 1 and medical processing device 20 of the embodiment and at least one of the modifications described above, analysis results relating to multiple parts of the heart can be displayed in a desired layout with simple operations.

[0129] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0130] 1...ultrasound diagnostic device, 11...ultrasound probe, 13...input interface circuit, 15...display, 17...electrocardiograph, 19...device main body, 20...medical processing device, 23...transmitting / receiving circuit, 25...B-mode data generation circuit, 27...Doppler data generation circuit, 29...image generation circuit, 31...communication interface circuit, 33...memory circuit, 35...control circuit, 37...processing circuit, 371...image processing function, 373...analysis function, 375...ancillary function, 377...display control function.

Claims

1. a processing unit that acquires three-dimensional images corresponding to the left ventricle, right ventricle, left atrium, and right atrium, respectively, obtained by performing wall motion analysis on time-series images of the left ventricle, right ventricle, left atrium, and right atrium included in the medical data, and associated information including information on the type of cardiac chamber; and an image processing unit that merges the three-dimensional images corresponding to the left ventricle, the right ventricle, the left atrium, and the right atrium so that they are anatomically adjacent to each other based on the supplementary information, and generates a composite image of the heart; a display control unit that synchronizes and displays the composite images including the left ventricle, the right ventricle, the left atrium, and the right atrium as a moving image based on the cardiac phase in the supplementary information; A medical processing device comprising:

2. a storage unit for storing the three-dimensional image and the additional information attached to the three-dimensional image together; Further comprising: The medical processing device of claim 1 .

3. the supplementary information includes information on the name of a disease related to the site, The image processing unit Identifying a region associated with the disease name and a region adjacent to the region associated with the disease name from regions of the left ventricle, right ventricle, left atrium, and right atrium based on the supplementary information; merging the three-dimensional images corresponding to the identified region; The medical processing device according to claim 1 or 2.

4. the supplementary information includes a plurality of measurement values ​​measured at each of the left ventricle, the right ventricle, the left atrium, and the right atrium; The image processing unit Identifying a region corresponding to a measurement value outside a reference range among the plurality of measurement values ​​and a region adjacent to the region corresponding to the measurement value outside the reference range based on the accompanying information; merging the three-dimensional images corresponding to the identified region; The medical processing device according to claim 1 or 2.

5. The supplementary information includes information regarding the collection date and time of the medical data. The medical processing device according to any one of claims 1 to 4.

6. the supplementary information includes information regarding the progress of treatment for at least one of the left ventricle, the right ventricle, the left atrium, and the right atrium; The medical processing device according to any one of claims 1 to 5.

7. The supplementary information includes information regarding an image aspect of the three-dimensional image.

7. The medical processing device of claim 1.

8. the three-dimensional image is an image showing the outline of the left ventricle, the right ventricle, the left atrium, and the right atrium, onto which a color corresponding to a value of an analysis parameter indicating the motion of the left ventricle, the right ventricle, the left atrium, and the right atrium is mapped; The medical processing device of any one of claims 1 to 7.

9. a display control unit that displays the merged three-dimensional image and another merged three-dimensional image side by side; Further provided with 9. The medical processing device of claim 1.

10. the image processing unit merges the three-dimensional images corresponding to the left ventricle, the right ventricle, the left atrium, and the right atrium, respectively, so that the images are anatomically adjacent to each other at the same cardiac phase; 10. The medical processing device of claim 1.

11. Obtaining three-dimensional images corresponding to the left ventricle, right ventricle, left atrium, and right atrium, respectively, obtained by performing wall motion analysis on time-series images of the left ventricle, right ventricle, left atrium, and right atrium included in the medical data, and accompanying information including information on the type of cardiac chamber, and associating the three-dimensional images with the accompanying information; merging the three-dimensional images corresponding to the left ventricle, the right ventricle, the left atrium, and the right atrium, respectively, so that they are anatomically adjacent to each other based on the supplementary information, to generate a composite image of the heart; displaying the composite images including the left ventricle, the right ventricle, the left atrium, and the right atrium in synchronization as a moving image based on the cardiac phase in the supplementary information; A medical treatment method comprising:

12. Computer, a means for acquiring three-dimensional images corresponding to the left ventricle, right ventricle, left atrium, and right atrium, respectively, obtained by performing wall motion analysis on time-series images of the left ventricle, right ventricle, left atrium, and right atrium included in the medical data, and additional information including information on the type of cardiac chamber, and associating the three-dimensional images with the additional information; a means for merging the three-dimensional images corresponding to the left ventricle, the right ventricle, the left atrium, and the right atrium, respectively, so that they are anatomically adjacent to each other based on the supplementary information, to generate a composite image of the heart; a means for displaying the composite images including the left ventricle, the right ventricle, the left atrium, and the right atrium in synchronization as a moving image based on the cardiac phase in the supplementary information; A medical processing program that functions as a

Images