Medical image processing apparatus, ultrasonic diagnostic apparatus, medical image processing method, and storage medium
By generating still and dynamic ultrasound images corresponding to a reference time, and combining time information and shooting conditions, the problem of low image processing efficiency in ultrasound contrast imaging is solved, achieving efficient image processing and diagnostic opinion input.
Patent Information
- Application Number
- CN202511166580.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-08-21
- Filing Date
- 2025-08-20
- Publication Date
- 2026-03-03
AI Technical Summary
In contrast-enhanced ultrasound examinations, doctors need to process a large number of ultrasound images, which leads to excessively long input of diagnostic opinions and report production time, and makes it difficult to efficiently correlate image and time information.
By generating still and dynamic ultrasound images corresponding to a reference time, and combining time information and shooting conditions, image recognition and display control are achieved, simplifying image processing and input of diagnostic opinions.
It improves the efficiency of ultrasound examinations, reduces the time doctors spend on image processing and report preparation, and ensures accurate correlation between images and time information.
Smart Images

Figure CN121587769A_ABST
Abstract
Description
Technical Field
[0001] The embodiments disclosed in this specification and accompanying drawings relate to a medical image processing apparatus, an ultrasound diagnostic apparatus, a medical image processing method, and a program. Background Technology
[0002] Previously, for example, in the differential diagnosis of hepatocellular carcinoma, contrast agents were injected into the patient, and ultrasound imaging of the affected area was performed using a diagnostic ultrasound device. During the ultrasound imaging, the doctor starts a timer when the contrast agent is injected, and after a predetermined time, the ultrasound image is captured. At each pre-set (programmed) timer, or a timer corresponding to the doctor's operation, the ultrasound device establishes a correspondence between the timer's current timing and the ultrasound images (moving images) captured within the specified period. After the ultrasound imaging is completed, the doctor reviews the saved ultrasound images (moving images), determines the ultrasound images (still images) to be added to the report, and saves (re-saves) the determined ultrasound images to the ultrasound device. Then, based on the re-saved ultrasound images (still images) and the corresponding time information, the doctor inputs their diagnostic opinion for the patient and generates a report with the determined (re-saved) ultrasound images (still images) attached.
[0003] However, the number of ultrasound images (moving images and still images) captured during ultrasound imaging examinations is enormous. Therefore, the doctor's task of determining which ultrasound images (still images) should be attached to the report based on a large number of ultrasound images is complex.
[0004] Regarding this, a technique has been proposed that involves setting multiple groups of information corresponding to elapsed time from a reference time, attaching the group information corresponding to the elapsed time to store diagnostic images, and an image display device that displays diagnostic images group by group using the group information. It is believed that by adopting this technique, the examination time for ultrasound contrast imaging can be shortened, particularly the time required for doctors to determine ultrasound images (still images).
[0005] Here, the time it takes to capture the ultrasound image (moving or still image), i.e., the elapsed time from the injection of contrast agent into the patient, is also crucial for diagnosis. Furthermore, in conventional techniques, inputting diagnostic opinions and generating reports requires careful attention to avoid misidentifying the selected ultrasound image (still image), establishing corresponding time information for that image, and associating it with the diagnostic opinion. Therefore, it is argued that conventional techniques have not achieved greater efficiency in the physician's work during ultrasound contrast imaging examinations.
[0006] Existing technical documents
[0007] Patent documents
[0008] Patent Document 1: Japanese Patent No. 5053678 Summary of the Invention
[0009] The technical problem that the invention aims to solve
[0010] The technical problem to be solved by the embodiments disclosed in this specification and accompanying drawings is to present the ultrasound images captured during an ultrasound examination, along with the imaging conditions of the ultrasound images and information related to the ultrasound examination, to the examiner. However, the technical problem to be solved by the embodiments disclosed in this specification and accompanying drawings is not limited to the above-described technical problem. It is also possible to identify other technical problems as those corresponding to the effects of the various structures shown in the embodiments described below.
[0011] Means for solving technical problems
[0012] The medical image processing apparatus of this embodiment includes an image processing unit, an identification unit, and a display control unit. The image processing unit generates, sequentially, an ultrasound still image corresponding to time information representing the elapsed time from a reference time to the time the reflected wave signal is collected, based on the reflected wave signal after an ultrasound signal transmitted to the subject is reflected within the subject's body. It also generates an ultrasound dynamic image including the ultrasound still image during a period corresponding to a pre-determined imaging condition based on the purpose of the ultrasound examination. The identification unit identifies the imaging condition based on the time information corresponding to the ultrasound still image included in the ultrasound dynamic image, and outputs identification information indicating the identified imaging condition. The display control unit associates the ultrasound dynamic image and / or the ultrasound still image, the time information, and the identification information on a display device. The display control unit causes the display device to display the ultrasound image and the time information corresponding to the selected identification information. Attached Figure Description
[0013] Figure 1 This is a diagram illustrating an example of the functional structure of the medical image processing apparatus according to the embodiment, the functional structure of the ultrasound diagnostic apparatus using the medical image processing apparatus according to the embodiment, and an example of the usage environment.
[0014] Figure 2 This is a diagram illustrating an example of a display screen shown by a display device caused by a medical image processing apparatus according to an embodiment.
[0015] Figure 3This is a diagram illustrating an example of an ultrasound image displayed in an image display area included in a display screen displayed by a display device, as shown by a medical image processing apparatus according to an embodiment.
[0016] Figure 4 This is a diagram illustrating an example of phase information displayed in a phase display area of a display screen shown by a medical image processing apparatus according to an embodiment.
[0017] Figure 5 This is a diagram illustrating an example of time information displayed in a time axis region of a display screen shown by a medical image processing apparatus according to an embodiment.
[0018] Figure 6 This diagram schematically illustrates an example of a medical image processing apparatus according to an embodiment providing information for display on a display device.
[0019] Figure 7 This is a flowchart illustrating an example of the processing flow in a medical image processing apparatus according to an embodiment. Detailed Implementation
[0020] Hereinafter, the medical image processing apparatus, ultrasound diagnostic apparatus, medical image processing method, and procedure according to embodiments will be described with reference to the accompanying drawings. The medical image processing apparatus displays ultrasound images captured by the ultrasound diagnostic apparatus and various information related to the ultrasound images. In the following description, the application of the medical image processing apparatus to the ultrasound diagnostic apparatus of the embodiments will be used as an example. For example, the ultrasound diagnostic apparatus transmits an ultrasound signal from an ultrasound probe, and uses the ultrasound probe to detect the ultrasound signal reflected back into the body of the examinee (patient) (reflected wave signal: echo signal), thereby performing an ultrasound examination of the examinee. The ultrasound diagnostic apparatus performs image processing on the reflected wave signal detected by the ultrasound probe, generates an ultrasound image based on the magnitude of the reflected wave signal, etc., and displays the generated ultrasound image on a display device to present it to the examiner (doctor, technician, etc.) performing the ultrasound examination. Thus, the examiner can visually confirm the state of the tissues within the examinee's body. When presenting the ultrasound image generated by the ultrasound diagnostic apparatus to the examinee, the medical image processing apparatus displays various information related to the ultrasound image to make it easier for the examinee to confirm the ultrasound image, thereby enabling a more appropriate ultrasound examination.
[0021] Figure 1This diagram illustrates an example of the functional structure of a medical image processing apparatus according to an embodiment, the functional structure of an ultrasound diagnostic apparatus using the medical image processing apparatus according to an embodiment, and an example of its usage environment. The ultrasound diagnostic apparatus 1, for example, includes a main unit 100, an ultrasound probe 102, an input device 104, and a display device 106. Figure 1 The diagram shows the structure in which the input device 104 and the display device 106 are connected to the main device 100, but the input device 104 and the display device 106 may also be assembled into the main device 100.
[0022] exist Figure 1 For example, an example of the functional structure and operating environment of an ultrasound diagnostic device 1 used in a contrast-enhanced ultrasound examination of the site to be examined, by injecting a contrast agent into the subject for differential diagnosis of hepatocellular carcinoma, is shown. On the other hand, in Figure 1 The illustrations of other components and functional structures in the ultrasound diagnostic apparatus 1 that perform functions unrelated to the ultrasound contrast imaging examination of the subject are omitted. For example, in Figure 1 The diagrams of the input / output circuits and control circuits (control functions) are omitted. These input / output circuits output control signals to enable the ultrasonic probe 102 to send (emit) ultrasonic signals and receive reflected wave signals output by the ultrasonic probe 102. The control circuits control the ultrasonic diagnostic device 1 and the entire main unit 100. These omitted components, functional structures, and operations need only be equivalent to those of existing ultrasonic diagnostic devices. Therefore, detailed descriptions related to the structure and operation of the omitted components and functional structures are omitted.
[0023] The ultrasonic probe 102 is used in contact with or near the body surface of the subject. Under control from the main unit 100, the ultrasonic probe 102 transmits (emits) directional ultrasonic signals to the subject's body, detects reflected wave signals within the subject's body, and outputs these signals to the main unit 100. The ultrasonic probe 102 has multiple ultrasonic transducers. These transducers are, for example, piezoelectric elements such as piezoelectric ceramics. The ultrasonic probe 102 also includes a matching layer disposed on each ultrasonic transducer and a backing material to prevent ultrasonic signals from propagating behind the transducers (towards the opposite side of the subject). The multiple ultrasonic transducers are arranged in any configuration, such as in a single row or two-dimensional arrangement, within the ultrasonic probe 102. The ultrasonic probe 102 can be detached from the main unit 100. The ultrasonic probe 102 and the main unit 100 can be connected via a dedicated cable or via wireless communication.
[0024] The input device 104 receives operations from the examiner on the ultrasound diagnostic device 1 (more specifically, the main device 100) and outputs information (electrical signals) indicating the received operations to the main device 100. The input device 104 may be implemented using, for example, a mouse, keyboard, touch panel, microphone, etc. When the input device 104 is a touch panel, it may be integrated with a terminal device, personal computer (PC), or display device 106 connected to the main device 100. The input device 104 may also be implemented using a terminal device, personal computer, or a display device (e.g., a tablet terminal) capable of wireless communication with the main device 100. In this specification, the input device 104 is not limited to input devices equipped with physical operating components such as a mouse and keyboard. For example, a processing circuit that receives electrical signals corresponding to input operations from a terminal device, personal computer, or an external input device separate from the main device 100 and outputs these electrical signals to the terminal device, personal computer, or main device 100 is also included in the example of the input device 104.
[0025] The display device 106 is, for example, a liquid crystal display (LCD), a CRT (Cathode Ray Tube) display, an organic EL (Electroluminescence) display, etc. The display device 106 displays various information including ultrasound images that are presented to the examiner. Thus, by observing the ultrasound images displayed on the display device 106, the examiner can visually confirm the state of the tissues within the examinee's body. Among the various information displayed on the display device 106 is also information (GUI images) for receiving various input operations from the examiner on the ultrasound diagnostic device 1, i.e., the input device 104 (e.g., an instruction to start acquiring ultrasound images).
[0026] The main unit 100 causes the ultrasonic probe 102 to send (emit) ultrasonic signals, and generates an ultrasonic image (echo image) of still image based on the reflected wave signal detected and output by the ultrasonic probe 102. Then, the main unit 100 generates an ultrasonic dynamic image based on the generated still image (hereinafter referred to as "ultrasonic still image"). The main unit 100 provides a prompt to the inspector by outputting and displaying the generated ultrasonic still image and ultrasonic dynamic image on the display device 106.
[0027] [Structure of the main device]
[0028] The main unit 100 includes, for example, a processing circuit 110. The processing circuit 110 performs processing such as an acquisition function 120, a timing function 130, and a medical image processing function 140. The medical image processing function 140 performs processing such as an image processing function 142, a time phase recognition function 144, a display control function 146, and an information provision function 148.
[0029] The processing circuit 110 executes, for example, a program (software) stored in a memory (storage unit) not shown, via a hardware processor, thereby realizing the respective functions of the acquisition function 120, the timing function 130, and the medical image processing function 140 (including image processing function 142, phase recognition function 144, display control function 146, and information provision function 148). The memory not shown is implemented, for example, by semiconductor memory elements such as ROM (Read Only Memory), RAM (Random Access Memory), flash memory, hard disk drive (HDD), optical disk, etc.
[0030] Hardware processors refer to circuits such as CPUs (Central Processing Units), GPUs (Graphics Processing Units), LSIs (Large Scale Integration), SoCs (System-on-Chips), Application-Specific Integrated Circuits (ASICs), and programmable logic devices (e.g., Simple Programmable Logic Devices (SPLDs), Complex Programmable Logic Devices (CPLDs), and Field Programmable Gate Arrays (FPGAs)). Instead of storing the program in memory (not shown), the program can be directly assembled within the hardware processor's circuitry. In this case, the hardware processor implements its functions by reading and executing the program assembled within the circuitry. Hardware processors are not limited to being single circuits; multiple independent circuits can be combined to form a single hardware processor to implement various functions. Multiple components can also be unified into a single hardware processor to implement various functions. Alternatively, multiple components can be assembled into a dedicated LSI to implement various functions. Here, the program (software) can be pre-stored in a storage device (a storage device with a non-transitory storage medium) constituting semiconductor memory elements such as ROM, RAM, and flash memory, or a storage device such as a hard disk drive, or it can be stored in a removable storage medium (a non-transitory storage medium) such as a DVD or CD-ROM, and installed in a storage device (not shown) provided by the main unit 100 by assembling the storage medium into a drive device provided by the main unit 100. The program (software) can also be pre-downloaded from other computer devices via a network (not shown) and installed in the storage device provided by the main unit 100. The program (software) installed in the storage device provided by the main unit 100 can also be transmitted to the processing circuitry provided by the main unit 100 for execution.
[0031] Acquisition function 120 acquires (collects) the reflected wave signal output by ultrasound probe 102. Acquisition function 120 outputs the acquired reflected wave signal to medical image processing function 140.
[0032] Acquisition function 120 is an example of the "Acquisition Department".
[0033] The timing function 130 is, for example, a timer. The timing function 130 is activated when the examiner performs an input operation to the input device 104 to indicate the start of timing. The examiner uses a reference time (hereinafter referred to as the "reference time") as a reference time during the ultrasound contrast examination to instruct the timing function 130 to start timing. The reference time is, for example, the time at which contrast agent is injected into the subject for performing the ultrasound contrast examination. Therefore, the time counted by the timing function 130 becomes the elapsed time from the start of the ultrasound contrast examination to the time when the acquisition function 120 acquires (collects) the reflected wave signal. The timing function 130 outputs time information indicating the timing to the medical image processing function 140.
[0034] The timing function 130 is an example of a "timing unit".
[0035] The medical image processing function 140 generates an ultrasound still image and an ultrasound dynamic image based on the reflected wave signal output by the acquisition function 120, and outputs and displays the generated ultrasound still image and ultrasound dynamic image on the display device 106.
[0036] The medical image processing function 140 is an example of a "medical image processing device".
[0037] Image processing function 142 generates ultrasound still images sequentially based on the reflected wave signal output by acquisition function 120. At this time, image processing function 142 establishes a correspondence between the time information output by timing function 130 and each generated ultrasound still image. Image processing function 142 sequentially generates an ultrasound dynamic image by summarizing ultrasound still images over a predetermined period. The period for summarizing ultrasound still images (in other words, the capture period of the ultrasound dynamic image) corresponds to the capture conditions predetermined according to the purpose of the ultrasound examination. The period for summarizing ultrasound still images is, for example, pre-programmed with a combination of clinically significant moments, and the program is read and executed by a setting function (not shown), thereby pre-setting the setting function (not shown). The period for summarizing ultrasound still images may be, for example, a period corresponding to a time predetermined in guidelines for ultrasound contrast examinations, or a period specified by the examiner. Phase indicates the condition of the examined body part determined by the elapsed time from a reference time (when the contrast agent is injected into the subject). The period for summarizing ultrasound still images may also be, for example, the period equivalent to one heartbeat of the subject. For example, the start and end times of the ultrasonic dynamic images are set as the period for summarizing the ultrasonic still images. The image processing function 142 sequentially generates an ultrasonic dynamic image that summarizes the ultrasonic still images from the set start time to the end time. The image processing function 142 sequentially outputs the generated ultrasonic dynamic image to the phase recognition function 144 and the display control function 146.
[0038] However, during ultrasound imaging, after a series of images are captured, the examiner reviews the ultrasound motion images and determines the ultrasound still images that should be added when inputting diagnostic opinions and preparing reports. That is, a single ultrasound still image that constitutes the ultrasound motion image is determined. In this case, image processing function 142 extracts (extracts) the determined ultrasound still image from the multiple ultrasound still images included during the period summarizing the ultrasound motion image, generating other ultrasound still images (new ultrasound still images). Image processing function 142 then outputs the determined ultrasound still images again to phase recognition function 144 and display control function 146.
[0039] Image processing function 142 may also be configured to sequentially store the generated ultrasonic dynamic image and ultrasonic still image in a storage unit (not shown) provided in the main device 100, and output a notification indicating this status to the phase recognition function 144 and the display control function 146, respectively. In this case, for example, the phase recognition function 144 reads the ultrasonic dynamic image and ultrasonic still image stored in the storage unit (not shown), which is equivalent to the configuration where the ultrasonic dynamic image and ultrasonic still image generated by image processing function 142 are output to the phase recognition function 144.
[0040] Image processing function 142 can also transmit and store the generated ultrasound dynamic images and ultrasound still images to a storage device (not shown) connected via, for example, a LAN (Local Area Network) constructed within the hospital. The storage device (not shown) is, for example, a storage device included in a database system of a medical image management system (PACS) that manages data such as various medical images and ultrasound images captured in past ultrasound examinations (including contrast ultrasound examinations) of patients.
[0041] Image processing function 142 is an example of an "image processing unit". Phase is an example of a "shooting situation".
[0042] The phase recognition function 144 identifies the phase in ultrasound contrast imaging based on the time information corresponding to each ultrasound still image summarized from the ultrasound dynamic images sequentially output by the image processing function 142, and the time information corresponding to the ultrasound still images output again by the image processing function 142. More specifically, it identifies which phase in ultrasound contrast imaging corresponds to the ultrasound dynamic image, the ultrasound still image, and the ultrasound contrast imaging. When the ultrasound dynamic image and the ultrasound still image are stored in a storage device (not shown) in a database system such as a medical image management system, the phase recognition function 144 can also read the ultrasound dynamic image and the ultrasound still image of the object from the storage device (not shown) and identify the phase of the ultrasound dynamic image and the ultrasound still image. The phase recognition function 144 sequentially outputs information such as the phase name (hereinafter referred to as "phase information") indicating the identified phase to the display control function 146. At this time, the phase recognition function 144 associates the information of the ultrasound dynamic image and the ultrasound still image indicating the identified phase with the phase information and outputs it to the display control function 146. Furthermore, when the phase recognition function 144 identifies the phase of the ultrasonic still image, it associates the information indicating the situation identified from the ultrasonic still image with the phase information and outputs it to the display control function 146.
[0043] The phase recognition function 144 can also establish a correspondence between phase information and ultrasonic dynamic images and ultrasonic still images, that is, sequentially output the ultrasonic dynamic images and ultrasonic still images corresponding to the time information and phase information to the display control function 146. In this case, the output of ultrasonic dynamic images and ultrasonic still images from the image processing function 142 to the display control function 146 can be omitted. The phase recognition function 144 can also be a structure that sequentially stores the ultrasonic dynamic images and ultrasonic still images corresponding to the phase information in a storage unit (not shown) provided in the main device 100, and outputs a notification indicating this situation to the display control function 146. In this case, the display control function 146 reads the ultrasonic dynamic images and ultrasonic still images stored in the storage unit (not shown), which is equivalent to the phase recognition function 144 outputting the ultrasonic dynamic images and ultrasonic still images corresponding to the phase information to the display control function 146.
[0044] The phase recognition function 144 is an example of an "recognition unit". Phase information (including phase name) is an example of "recognition information".
[0045] The display control function 146 associates the ultrasonic dynamic image and ultrasonic still image (including time information) sequentially output by the image processing function 142 with the phase information sequentially output by the phase recognition function 144, presenting this information as image information to the inspector. More specifically, the display control function 146 generates a display image (display screen) including the ultrasonic dynamic image, ultrasonic still image (including time information) output by the image processing function 142, and the phase information output by the phase recognition function 144, and sequentially outputs and displays the generated display image on the display device 106, thereby presenting it to the inspector. At this time, the display control function 146 can also overlay GUI images, etc., onto the display image and display them on the display device 106.
[0046] GUI images may include, for example, operation buttons for the examiner to confirm the ultrasound dynamic images after a series of images in an ultrasound imaging examination and to determine the ultrasound still images to be attached when inputting diagnostic opinions and / or preparing reports; and start buttons for launching other applications that cooperate with the applications used in inputting diagnostic opinions and / or preparing reports. These buttons need only be displayed (configured) in appropriate locations within the display screen.
[0047] Operation buttons include those for functions such as reproducing, stopping, pausing, fast-forwarding, rewinding, and saving (re-saving ultrasound still images) of the ultrasound dynamic image for inspector confirmation. By operating these buttons, the inspector can select a frame of the ultrasound still image that constitutes the ultrasound dynamic image and save (re-save) the selected frame to the main unit 100. At this time, the display control function 146 outputs information indicating the frame of the ultrasound still image selected by the inspector to the image processing function 142. The image processing function 142 then generates a new ultrasound still image from the ultrasound still image shown by the information output by the display control function 146 and outputs it again to the phase recognition function 144 and the display control function 146.
[0048] The start button is used to activate other applications prepared to optimize the operator's work during ultrasound contrast imaging examinations. These other applications include, for example, an opinion input application used when entering diagnostic opinions, a report creation application used when preparing reports based on diagnostic opinions to comply with ultrasound contrast imaging guidelines, and an analysis application used to analyze ultrasound dynamic images and ultrasound still images to obtain diagnostic results. By operating the start button, the operator activates the necessary applications. These applications establish connections between various information, including ultrasound still images obtained by the medical image processing function 140 (medical image processing device), thereby shortening the time required to obtain the ultrasound contrast imaging examination results.
[0049] Display control function 146 is an example of a "display control unit".
[0050] Here, an example of a display image (display screen) generated by display control function 146 and displayed on display device 106 will be described. Figure 2 This is a diagram showing an example of a display screen displayed on the display device 106 by the medical image processing apparatus (medical image processing function 140) according to an embodiment. Figure 2 The display screen DI shown includes an image display area IA, a phase display area PA, and a time axis area TA.
[0051] The image display area IA is a predetermined area of ultrasound dynamic images and ultrasound still images displayed among multiple ultrasound images (ultrasound dynamic images and / or ultrasound still images) output by the image processing function 142 in a series of ultrasound contrast examinations. Figure 2The display screen DI shown illustrates an example of arranging six ultrasonic motion images IM (ultrasonic motion images IM-1 to ultrasonic motion images IM-6) within the image display area IA and displaying them as a single screen. As ultrasonic motion images IM, an ultrasonic still image constituting the first or last frame of the ultrasonic motion image is displayed. The number of ultrasonic motion images and ultrasonic still images displayed (arranged) within the image display area IA is not limited to six; it can be fewer than six (e.g., four) or more than six (e.g., nine). When the number of ultrasonic motion images and ultrasonic still images displayed (arranged) within the image display area IA is greater, it can be switched, for example, by using a scroll bar or page movement. The ultrasonic motion images and ultrasonic still images displayed on the display screen DI are selected (specified) in the phase display area PA. The display control function 146 arranges the individual ultrasonic images (ultrasonic motion images and / or ultrasonic still images) selected (specified) in the phase display area PA in chronological order within the image display area IA. Figure 2 The display screen DI shown illustrates an example of arranging the ultrasonic dynamic images IM-1 to IM-3 in chronological order from the top left to the top right within the image display area IA, and then returning to the bottom left of the image display area IA to arrange the ultrasonic dynamic images IM-4 to IM-6 in chronological order from the bottom left to the bottom right, which is called grating order.
[0052] Corresponding time and phase information are superimposed on each ultrasonic dynamic image and ultrasonic still image displayed in the image display area IA. Figure 3 This is a diagram illustrating an example of an ultrasound image (ultrasound motion image IM) displayed in the image display area IA of the display screen DI shown by the medical image processing apparatus (medical image processing function 140) of the embodiment, which is displayed on the display device 106. Figure 3 In the ultrasound dynamic image IM-1, the phase name "AAAA" is displayed as phase information PI, and the elapsed time (20 seconds) from the reference time (when the contrast agent was injected into the subject) corresponding to the currently displayed frame of the ultrasound dynamic image IM-1 (i.e., the ultrasound still image) is displayed as time information TI. Figure 3 The example shown illustrates how phase information PI and time information TI are superimposed within the ultrasonic dynamic image IM-1. However, the positions where phase information PI and time information TI overlap can be any positions, as long as they can be visually confirmed to correspond to the positions of phase information PI and time information TI in the ultrasonic dynamic image and ultrasonic still image, respectively. For example, it can also be as follows: Figure 2 As shown in the display DI, only the time information TI is superimposed within the image of the ultrasonic motion image IM, and the phase information PI is superimposed outside the image of the ultrasonic motion image IM. That is, either or both of the phase information PI and the time information TI can be superimposed within the image of the ultrasonic motion image or the ultrasonic still image, or they can be superimposed outside the image of the ultrasonic motion image or the ultrasonic still image.
[0053] Image display area IA is an example of an "image display area".
[0054] The phase display area PA is an area that displays phase information output by the phase recognition function 144 during a series of ultrasound contrast imaging examinations. In the phase display area PA, the phase names contained in the phase information identified by the phase recognition function 144 from each ultrasound dynamic image and ultrasound still image are displayed in chronological order. Furthermore, a GUI image for selecting (specifying) the ultrasound dynamic image displayed in the image display area IA is overlaid in the phase display area PA. Figure 2 The display screen DI shown illustrates an example where the phase names of the ultrasound dynamic images IM are displayed sequentially in the phase display area PA, and checkboxes CB corresponding to each phase name are displayed. When the inspector selects (specifies) a phase name via input device 104, the display control function 146 arranges the selected (specified) ultrasound dynamic images IM in chronological order within the image display area IA. Figure 2 The display screen DI shown illustrates an example where an ultrasonic dynamic image of a time phase name is selected (specified) by adding a check mark to the checkbox CB corresponding to the time phase name. As a result, the display control function 146 displays (configures) the ultrasonic dynamic images corresponding to each time phase name for which check marks have been added to the checkbox CB within the time phase display area PA as the selected (specified) ultrasonic dynamic image and ultrasonic still image in the image display area IA of the display screen DI. Figure 2 The display screen DI shown illustrates an example in which the ultrasound dynamic image IM-1 corresponding to the phase name "AAAA", the ultrasound dynamic image IM-2 corresponding to the phase name "BBBB", the ultrasound dynamic image IM-3 corresponding to the phase name "DDDD", the ultrasound dynamic image IM-4 corresponding to the phase name "EEEE", the ultrasound dynamic image IM-5 corresponding to the phase name "FFFF", and the ultrasound dynamic image IM-6 corresponding to the phase name "GGGG" are respectively arranged in the image display area IA.
[0055] As described above, when the phase recognition function 144 identifies the phase of the ultrasonic still image, it associates the information indicating the situation identified from the ultrasonic still image with the phase information. Therefore, in the phase display area PA, the names of each phase contained in the phase information are displayed in chronological order to distinguish ultrasonic dynamic images and ultrasonic still images of the same phase, that is, to distinguish the original dynamic image and the still image re-saved from the original dynamic image. Figure 4 This is a diagram illustrating an example of phase information (phase name) displayed in the phase display area PA included in the display screen DI displayed by the medical image processing apparatus (medical image processing function 140) of the embodiment, which is then displayed on the display device 106. Figure 4 The image shows an example of defining the phase display area PA for a static ultrasound image in the respective ultrasound dynamic image IM-1 (corresponding to phase name "AAAA") and ultrasound dynamic image IM-3 (corresponding to phase name "DDD"). Figure 4 In the image display, after the phase name of the ultrasonic still image determined from each ultrasonic dynamic image IM, a hyphen (-) followed by a number is displayed. In other words, a branch number is appended to the phase name. The branch number can represent, for example, the order determined from the ultrasonic dynamic image IM, the time order within the ultrasonic dynamic image IM, or the frame number of the ultrasonic still image within the ultrasonic dynamic image IM. By using the branch number appended to the phase name, the inspector can distinguish between ultrasonic dynamic images IMs of the same phase and ultrasonic still images determined from those ultrasonic dynamic images IMs. The information used to distinguish between ultrasonic dynamic images IMs of the same phase and ultrasonic still images determined from those ultrasonic dynamic images IMs is not limited to the branch number. For example, any information that can distinguish between ultrasonic dynamic images IMs of the same phase and ultrasonic still images determined from those ultrasonic dynamic images IMs, such as time information of ultrasonic still images within the ultrasonic dynamic image IM, can be used. When an ultrasonic still image is determined from an ultrasonic dynamic image IM, the display control function 146 replaces the ultrasonic dynamic image IM configured in the image display area IA with the determined ultrasonic still image.
[0056] The phase display area PA is an example of an "identification information area". The checkbox CB is an example of an "identification information selection area".
[0057] The time axis region TA represents the entire examination time of an ultrasound contrast imaging examination from the reference time, and within this time axis, it represents the areas where corresponding time information for ultrasound dynamic images and ultrasound still images is established. The time axis region TA displays information indicating at what time during the ultrasound contrast imaging examination the ultrasound dynamic images and ultrasound still images displayed in the image display area IA were captured. That is, the time axis region TA allows visual confirmation of the intervals and time intervals in a series of ultrasound contrast imaging examinations where ultrasound dynamic images and ultrasound still images were generated (captured), as well as the intervals and time intervals where no ultrasound dynamic images or ultrasound still images were generated (captured). Then, the time axis region TA allows visual confirmation of whether the corresponding ultrasound dynamic images and ultrasound still images are displayed in the image display area IA during the intervals and time intervals where they were generated (captured). Figure 2 The display screen DI shown illustrates an example of the time axis region TA when the ultrasound imaging examination time is 420 seconds. The scale of the time axis in the time axis region TA may not be the time (in seconds) shown in the display screen DI. For example, the phase name may be displayed as the scale of the time axis in the time axis region TA at the corresponding position. The display control function 146 enables visual confirmation by differentiating the display methods of the various intervals and timings shown in the time axis region TA (e.g., different colors, patterns (so-called shadows), etc.). Furthermore, the time axis region TA displays a marker indicating the time displayed for the currently selected ultrasound dynamic image or ultrasound still image in the phase display region PA. Figure 2 The display screen DI shows a display time marker TC corresponding to the ultrasonic motion image IM-1 selected in the phase display area PA. When the examiner selects the ultrasonic motion image IM-1 as the motion image, the display control function 146 reproduces the ultrasonic motion image IM-1. That is, it displays each frame (ultrasonic still image) constituting the ultrasonic motion image in chronological order. Then, the display control function 146 moves the position of the display time marker TC sequentially to the position corresponding to the currently displayed frame. When the reproduction of the ultrasonic motion image IM-1 ends, the display control function 146 repeatedly reproduces the ultrasonic motion image IM-1 from the first frame. The display control function 146 can also overlay the GUI image of the operation buttons (reproduce, stop, pause, fast forward, rewind, save (re-save ultrasonic still image), etc.) on the display screen DI to accept the examiner's operation on reproducing the ultrasonic motion image IM-1.
[0058] Figure 5This is a diagram illustrating an example of time information displayed in the time axis region TA of a display screen DI shown on a display device 106 by a medical image processing apparatus (medical image processing function 140) according to an embodiment. Figure 5 In (a), the periods (intervals, timings) during which the ultrasonic motion image and ultrasonic still image displayed in the image display area IA are captured are represented by the image completion display period TSI, the image completion non-display period TSN, and the no-capture period TN. The image completion display period TSI indicates the period during which the ultrasonic motion image displayed in the image display area IA is captured based on the captured (saved) image. The image completion non-display period TSN indicates the period during which the ultrasonic motion image, although captured (saved), is not displayed in the image display area IA. The no-capture period TN indicates the period during which the ultrasonic motion image cannot be displayed in the image display area IA because it was not captured (saved). Figure 5 In (b), the marker RS is re-saved through still images, indicating the timing of capturing the ultrasonic still image (frame) determined in each ultrasonic motion image. Figure 5 In (b), the still image re-save marker RS represents: the timing of the capture of each of the four ultrasonic still images determined from the ultrasonic dynamic images captured during the period of time = 0-60 [sec], the timing of the capture of one ultrasonic still image determined from the ultrasonic dynamic images captured during the period of time = 90-95 [sec], and the timing of the capture of one ultrasonic still image determined from the ultrasonic dynamic images captured during the period of time = 180-185 [sec]. When the display control function 146 replaces the ultrasonic dynamic image IM configured in the image display area IA with the ultrasonic still image corresponding to the still image re-save marker RS, it changes the interval in the time axis area TA corresponding to the ultrasonic dynamic image IM from the image display period TSI after capture to the image non-display period TSN after capture (change display mode), thereby indicating that the ultrasonic dynamic image IM is replaced with an ultrasonic still image.
[0059] The Timeline Region TA is an example of a "Timeline Region".
[0060] Return to Figure 1The information providing function 148 provides the display control function 146 to enable the display device 106 to display various information related to ultrasound contrast imaging, such as the ultrasound still image, the time information corresponding to the ultrasound still image, and the phase information, on the display screen DI. The examiner instructs the provision of various information related to ultrasound contrast imaging (hereinafter referred to as "examination information") via the input device 104. For example, the examiner instructs the provision of examination information by activating the start button on the GUI image to launch an opinion input application, report creation application, etc. The information providing function 148 outputs the examination information to the initiated (instructed) opinion input application, report creation application, etc., as the destination for providing the information.
[0061] Figure 6 This diagram schematically illustrates an example of a medical image processing apparatus (medical image processing function 140) of an embodiment providing information (examination information) for display device 106 to display. Figure 6 For example, by analyzing the application, the possible sites of disease in the subject can be identified within the ultrasound dynamic images IM-3, IM-5, and IM-6 displayed on the display screen DI. Figure 6 (a) shows an example of a location identified by the analysis application, schematically illustrating the reflection of... Figure 6 The scenario shown in (b) is the display screen DI. In this case, the examiner, for example, starts the opinion input application and inputs diagnostic opinions for each ultrasound dynamic image IM. At this time, the information providing function 148 outputs the examination information corresponding to each ultrasound dynamic image IM for which diagnostic opinions were input on the opinion input application to the opinion input application. Figure 6 (b) schematically illustrates a scenario where ultrasound dynamic images IM-3, IM-5, and IM-6 containing diagnostic opinions, along with information such as time and phase information corresponding to these ultrasound dynamic images IM, are output as output information InfO (provided to other collaborative applications such as the opinion input application).
[0062] Information provision function 148 is an example of a "providing department".
[0063] [Processing of Ultrasonic Diagnostic Devices]
[0064] Next, the operation of displaying a display screen DI containing captured ultrasonic dynamic images and ultrasonic still images on the display device 106 and providing the examination information represented by the display screen DI in the ultrasonic diagnostic device 1 will be described. Figure 7This is a flowchart illustrating an example of the processing flow in a medical image processing apparatus (medical image processing function 140) according to an embodiment. The processing in this flowchart is performed when the examinee undergoes an ultrasound contrast examination. In the following description, the information indicating the timing of generating the ultrasound motion image and the length (duration) of the generated ultrasound motion image is preset (programmed) for a setting function not shown.
[0065] When the examinee begins an ultrasound imaging examination using the ultrasound diagnostic device 1, the acquisition function 120 acquires the reflected wave signal output by the ultrasound probe 102 (step S100). The acquisition function 120 outputs the acquired reflected wave signal to the medical image processing function 140. Then, when the examinee instructs the timing to start via input operation on the input device 104, the timing function 130 starts timing (step S102). The timing function 130 outputs the timed information to the medical image processing function 140. Subsequently, the acquisition function 120 repeatedly acquires the reflected wave signal output by the ultrasound probe 102 and outputs the acquired reflected wave signal to the medical image processing function 140, while the timing function 130 repeatedly outputs the timed information to the medical image processing function 140.
[0066] The medical image processing function 140's image processing function 142 generates ultrasound still images sequentially based on the reflected wave signals output by the acquisition function 120, and generates an ultrasound dynamic image by summarizing the ultrasound still images over a pre-set (programmed) period (step S104). The image processing function 142 outputs the generated ultrasound dynamic image to the phase recognition function 144 and the display control function 146 respectively.
[0067] The phase recognition function 144 establishes corresponding time information based on the ultrasonic dynamic images sequentially output by the image processing function 142, and identifies the phase of the ultrasonic dynamic images (step S106). The phase recognition function 144 sequentially outputs the identified phase information to the display control function 146.
[0068] The display control function 146 generates a display image including the ultrasonic dynamic image output by the image processing function 142 and the phase information output by the phase recognition function 144, and outputs and displays the generated display image on the display device 106 (step S108). More specifically, the display control function 146 configures the ultrasonic dynamic image output by the image processing function 142 in the image display area IA, displays the phase name contained in the phase information output by the phase recognition function 144 in the phase display area PA, generates a display image that represents the time information corresponding to the ultrasonic dynamic image in the time axis area TA, and displays it on the display device 106. Thus, the ultrasonic dynamic image captured up to the current time, the time information associated with the ultrasonic dynamic image, and the phase information are sequentially presented to the inspector.
[0069] When the inspector determines (selects) a frame of the ultrasound still image constituting the ultrasound dynamic image (step S110), the display control function 146 outputs information indicating that the frame of the ultrasound still image determined (selected) by the inspector to the image processing function 142. If the inspector does not determine (select) the ultrasound still image from the ultrasound dynamic image, the display control function 146 returns the processing to step S104.
[0070] Image processing function 142 generates a new ultrasound still image from the ultrasound still image shown by the information output by display control function 146 (step S112). Image processing function 142 outputs the generated ultrasound still image to phase recognition function 144 and display control function 146 respectively.
[0071] The phase recognition function 144 establishes corresponding time information based on the still ultrasound image output by the image processing function 142, and identifies the phase of the still ultrasound image (step S114). The phase recognition function 144 outputs the identified phase information to the display control function 146.
[0072] The display control function 146 generates a display image in the display image output to the display device 106, that is, replacing the ultrasonic dynamic image in the ultrasonic dynamic image configured in the image display area IA, in which the inspector has determined (selected) the ultrasonic still image, with the ultrasonic still image output by the image processing function 142. The display control function 146 outputs the generated display image and displays it on the display device 106 (step S116). Thus, the determined (selected) ultrasonic still image, the time information associated with the ultrasonic still image, and the phase information are presented to the inspector.
[0073] When the inspector gives instructions to provide inspection information (step S120), the display control function 146 outputs (provides) the instructed inspection information to the information delivery destination (step S122). When the output (providation) to the inspection information delivery destination is completed, or when there is no instruction from the inspector to provide inspection information, the display control function 146 returns the process to step S104.
[0074] Subsequently, the various components of the medical image processing function 140 are repeatedly processed. More specifically, the image processing function 142 repeatedly performs the following steps in step S104: generating an ultrasound still image based on the reflected wave signal output by the acquisition function 120, generating an ultrasound dynamic image summarizing the ultrasound still image, outputting the generated ultrasound dynamic image to the phase recognition function 144 and the display control function 146, and in step S112: generating an ultrasound still image showing the information output by the display control function 146, and outputting the generated ultrasound still image to the phase recognition function 144 and the display control function 146. The phase recognition function 144 repeatedly performs the following steps in step S106: recognizing the phase based on the time information corresponding to the ultrasound dynamic image, and outputting the recognized phase information to the display control function 146, and in step S114: recognizing the phase based on the time information corresponding to the ultrasound still image, and outputting the recognized phase information to the display control function 146. The display control function 146 repeatedly performs the following steps: in step S108, generating the display image and outputting the generated display image to the display device 106; and in step S116, generating the display image that replaces the ultrasonic dynamic image configured in the image display area IA with an ultrasonic still image and outputting the generated display image to the display device 106. Thus, the ultrasonic dynamic image captured up to the current moment, along with the time information and phase information related to the determined ultrasonic still image, are sequentially presented to the inspector.
[0075] When the examinee finishes the ultrasound contrast examination based on the ultrasound diagnostic device 1, the acquisition function 120 ends the acquisition of the reflected wave signal output by the ultrasound probe 102 and the output of the acquired reflected wave signal to the medical image processing function 140, the timing function 130 stops timing and ends the output of the timed time information to the medical image processing function 140.
[0076] Through this structure and processing, in the ultrasound diagnostic device 1, the medical image processing function 140 within the processing circuit 110 of the main unit 100 generates a still ultrasound image based on the reflected wave signal output by the acquisition function 120, and generates a dynamic ultrasound image that summarizes the still ultrasound images over a pre-set (programmed) period. Further, the medical image processing function 140 identifies the phase in the ultrasound contrast examination based on the corresponding time information established with the generated dynamic ultrasound image. Then, the medical image processing function 140 generates a display image (display screen) that associates the generated dynamic ultrasound image, the corresponding time information, and the identified phase information, and sequentially outputs and displays the generated display image on the display device 106. Thus, the examinee can easily grasp the capturing status and display status of the captured dynamic ultrasound image during the ultrasound contrast examination based on the display image shown on the display device 106. Then, the examiner can confirm the ultrasound dynamic image and easily identify the important ultrasound still images at various time phases of the ultrasound contrast examination from the multiple ultrasound still images contained in the ultrasound dynamic image.
[0077] When the examiner determines the ultrasound still image based on the ultrasound dynamic image, the medical image processing function 140 within the processing circuit 110 of the main unit 100 in the ultrasound diagnostic device 1 extracts (extracts) the determined ultrasound still image from the ultrasound dynamic image and generates a new ultrasound still image. Further, the medical image processing function 140 identifies the phase of the ultrasound contrast examination based on the corresponding time information established with the generated ultrasound still image. Then, the medical image processing function 140 replaces the original ultrasound dynamic image with the generated ultrasound still image, generates a display image (display screen) that associates the corresponding time information established with the ultrasound still image with the identified phase information, and sequentially outputs and displays the generated display image on the display device 106. Thus, the examiner can obtain a diagnostic opinion of the ultrasound contrast examination based on the display image displayed on the display device 106.
[0078] Furthermore, in the ultrasound diagnostic device 1, the medical image processing function 140 within the processing circuit 110 of the main unit 100 provides the examinee with information such as the input of diagnostic opinions and the application programs used for report generation, and provides various information related to the ultrasound contrast examination contained in the displayed images. Thus, the examinee can accurately determine the correlation between the identified ultrasound still images, the corresponding time information established with those still images, and the diagnostic opinions, and can efficiently summarize the results of the ultrasound contrast examination.
[0079] As described above, in the ultrasound diagnostic apparatus of the medical image processing device applied in the embodiment, an ultrasound image (still ultrasound image, moving ultrasound image) based on the reflected wave signal output by the ultrasound probe, and a display image including various information related to ultrasound contrast examination such as time information and phase information of the ultrasound image being captured, are generated and displayed on a display device. Thus, the examinee performing ultrasound contrast examination using the ultrasound diagnostic apparatus of the medical image processing device applied in the embodiment can review the display image (display screen) displayed on the display device, easily identify important ultrasound images (still ultrasound images) during ultrasound contrast examination, and obtain a diagnostic opinion based on the identified ultrasound images. Furthermore, in the ultrasound diagnostic apparatus of the medical image processing device applied in the embodiment, the ultrasound image (still ultrasound image) included in the display image displayed on the display device, and various information related to ultrasound contrast examination such as time information and phase information of the displayed ultrasound image (examination information) are provided to a destination indicated by the examinee. Thus, the examinee performing ultrasound contrast examination using the ultrasound diagnostic apparatus of the medical image processing device applied in the embodiment can efficiently summarize the results of the ultrasound contrast examination.
[0080] In the above embodiments, the case where the medical image processing apparatus of the embodiments generates an ultrasound motion image by summarizing ultrasound still images over a pre-set (programmed) period was described. However, the period for summarizing ultrasound still images into an ultrasound motion image is not limited to a pre-programmed period and can also be indicated by the examiner during an ultrasound contrast examination. For example, the examiner can perform input operations on the input device at various time points, such as when starting and ending the recording of the ultrasound motion image, thereby indicating the start and end time points of the ultrasound motion image each time. In this case, the medical image processing apparatus of the embodiments summarizes the ultrasound still images for the period from the start time point to the end time point of the indicated ultrasound motion image to generate an ultrasound motion image. The operation and processing of the medical image processing apparatus in this case need to be equivalent to the operation and processing of the medical image processing apparatus of the above embodiments. Therefore, detailed descriptions related to the operation and processing of the medical image processing apparatus when generating ultrasound motion images for periods indicated by the examiner each time are omitted.
[0081] In the above embodiments, the case of applying the medical image processing device of the embodiments to the ultrasound diagnostic device of the embodiments has been described as an example, but this is only one example. The medical image processing device of the embodiments may also be implemented as a standalone device, for example, by a computer device such as a personal computer or a server device integrated into a network or cloud computing system. In this case, the medical image processing device implemented as a standalone device establishes a corresponding dynamic ultrasound image by acquiring the elapsed time from the reference time (when the contrast agent is injected into the subject) as time information. Similar to the ultrasound diagnostic device of the above embodiments, it can establish a correlation between the dynamic ultrasound image, the still ultrasound image, the time information, and the phase information and present it to the examiner. The dynamic ultrasound image corresponding to the time information acquired at this time may be information stored in a system composed of other devices or equipment different from the medical image processing device implemented as a standalone device, such as an ultrasound diagnostic device or a database system such as a medical image management system. In this case, the functional structure, operation, and processing of the medical image processing device implemented as a standalone device need only be equivalent to the functional structure, operation, and processing of the medical image processing device of the embodiments applied to the ultrasound diagnostic device of the above embodiments. Therefore, detailed descriptions of the functional structure, operation, and processing related to the medical image processing device being implemented as a separate device are omitted.
[0082] Additionally, the information providing function 148 can also establish a correspondence between various information (examination information) obtained from launching various applications (opinion input application, report generation application, analysis application) and the ultrasound images (ultrasound motion images, ultrasound still images) of each time phase displayed on the display screen DI of the display device 106, and store them in the memory. For example, when the opinion input application and report generation application are based on LI-RADS (Liver Imaging Reporting and Data System), the examiner uses the input device 104 to input opinions on the ultrasound images (ultrasound motion images, ultrasound still images) of each time phase and the categories defined by LI-RADS (e.g., any one of LR-1 (Definitely benign), LR-2 (Probably benign), LR-3 (Intermediate probability), LR-4 (Probably HCC), LR-5 (Definitely HCC), etc.). These categories are indicators representing the state and progression of the lesion. The examiner selects one category from multiple categories. The information providing function 148 can also establish a correspondence between the category input by the inspector and the ultrasound images (ultrasound motion images, ultrasound still images) displayed on the display screen DI of the display device 106, and store them in the memory, in the opinion input screen and report generation screen. Furthermore, if the analysis application is based on LI-RADS, the analysis application can also analyze the ultrasound images (ultrasound motion images, ultrasound still images) of each time phase and output the category defined by LI-RADS as inspection information. In this case, the information providing function 148 can also establish a correspondence between the category obtained by starting the analysis application and the ultrasound images (ultrasound motion images, ultrasound still images) displayed on the display screen DI of the display device 106, and store them in the memory, in the opinion input screen and report generation screen.
[0083] Furthermore, the information providing function 148 can also establish a correspondence between various information (inspection information) obtained by launching various applications (opinion input application, report generation application, analysis application) and ultrasound images (ultrasound motion images, ultrasound still images) stored in the memory at various times. That is, as images corresponding to the inspection information, in addition to the ultrasound images (ultrasound motion images, ultrasound still images) at various times displayed on the display screen DI of the display device 106, it can also include images corresponding to the inspection information. Figure 5 The image shown in (a) is the TSN image during the non-display period after the image has been captured.
[0084] Furthermore, the information providing function 148 can also store various information (inspection information) obtained by launching various applications (opinion input application, report generation application, analysis application) and ultrasound images (ultrasound motion images, ultrasound still images) that are saved back in the memory in a corresponding manner. That is, as images corresponding to the inspection information, in addition to the ultrasound images (ultrasound motion images, ultrasound still images) of each phase displayed on the display screen DI of the display device 106, it can also include images corresponding to the inspection information. Figure 5 The still image shown in (b) is then saved as the image corresponding to the marker RS.
[0085] The implementation methods described above can be performed as follows.
[0086] A medical image processing device, comprising a processing circuitry.
[0087] The processing circuit includes:
[0088] Based on the reflected wave signals after the ultrasound signal sent to the subject is reflected within the subject's body, corresponding still ultrasound images are sequentially generated and constructed using time information representing the elapsed time from a reference time to the time when the reflected wave signal is collected.
[0089] Generate an ultrasound dynamic image that includes the ultrasound still image during a period corresponding to the imaging conditions predetermined according to the purpose of the ultrasound examination.
[0090] The shooting situation is identified by establishing the corresponding time information based on the ultrasonic still image contained in the ultrasonic dynamic image.
[0091] The output represents identification information indicating the identified shooting situation; and
[0092] When displaying the ultrasonic dynamic image and / or the ultrasonic still image in association with the time information and the identification information, the display device displays the ultrasonic image and the time information corresponding to the selected identification information.
[0093] According to at least one embodiment described above, the system includes: an image processing unit (142) that, based on the reflected wave signal after an ultrasound signal sent to a subject is reflected within the subject's body, sequentially generates an ultrasound still image corresponding to time information representing the elapsed time from a reference time (when the contrast agent is injected into the subject) to the time when the reflected wave signal is collected, and generates an ultrasound dynamic image including the ultrasound still image during a period corresponding to a shooting condition (phase) predetermined according to the purpose of the ultrasound examination (ultrasound contrast examination); and an identification unit (144) that identifies the ultrasound still image contained in the ultrasound dynamic image based on the time information corresponding to the ultrasound still image. The system identifies the shooting conditions and outputs identification information indicating the identified shooting conditions (such as the phase name indicating the identified phase); and a display control unit (146) that associates the ultrasonic dynamic image and / or the ultrasonic still image, the time information, and the identification information on a display device (106). The display control unit generates a display image (display screen) that includes the ultrasonic image and the time information corresponding to the selected identification information and displays it on the display device, thereby presenting the ultrasonic image captured in the ultrasonic examination (ultrasound contrast examination) along with the ultrasonic image shooting conditions and information related to the ultrasonic examination to the examiner.
[0094] Some embodiments have been described, but these embodiments are given by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other ways, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the scope of the invention as described in the claims and its equivalents.
[0095] Explanation of reference numerals in the attached figures
[0096] 1: Ultrasonic diagnostic device; 100: Main unit; 102: Ultrasonic probe; 104: Input device; 106: Display device; 110: Processing circuit; 120: Acquisition function; 130: Timing function; 140: Medical image processing function; 142: Image processing function; 144: Timing recognition function; 146: Display control function; 148: Information provision function.
Claims
1. A medical image processing device, wherein, have: The image processing unit generates, sequentially, ultrasound still images corresponding to time information based on the reflected wave signals after the ultrasound signal sent to the subject is reflected within the subject's body, and generates ultrasound dynamic images including the ultrasound still images during a period corresponding to the imaging conditions predetermined according to the purpose of the ultrasound examination. The time information represents the elapsed time from the reference time to the time when the reflected wave signal is collected. The recognition unit identifies the shooting situation based on the time information corresponding to the still ultrasound image contained in the ultrasonic dynamic image, and outputs recognition information indicating the identified shooting situation; and The display control unit associates the ultrasonic dynamic image and / or the ultrasonic still image, the time information, and the identification information on the display device. The display control unit causes the display device to display the ultrasonic image and the time information corresponding to the selected identification information.
2. The medical image processing device according to claim 1, wherein, The display control unit causes the display device to display an identification information area, in which the identification information is arranged and displayed in chronological order of the time the ultrasonic images were captured. The identification information area includes an identification information selection area for selecting the identification information.
3. The medical image processing device according to claim 2, wherein, The display control unit causes the display device to display an image display area, in which multiple ultrasonic images selected in the identification information selection area are arranged and displayed in the order in which the ultrasonic images were captured.
4. The medical image processing device according to claim 3, wherein, The display control unit causes the display device to display a time axis area, in which the time axis represents the entire examination time of the ultrasound examination from the reference time, and the time information representing the time information indicates the capture period of the ultrasound dynamic image and / or the time when the ultrasound image was captured is shown on the time axis.
5. The medical image processing device according to claim 4, wherein, The display control unit displays the time shown in the time axis area in different ways to distinguish the ultrasonic image displayed in the image display area from the ultrasonic image not displayed in the image display area.
6. The medical image processing apparatus according to claim 5, wherein, In the case where any one of the ultrasonic images is identified in the ultrasonic dynamic image displayed in the image display area, The recognition unit outputs recognition information that identifies the shooting situation based on the time information corresponding to the determined ultrasonic image. The display control unit adds a branch number to the identification information of the determined ultrasonic image, and displays the identification information with the added branch number and the identification information selection area in the identification information area. The display control unit replaces the ultrasonic dynamic image displayed in the image display area with the determined ultrasonic image. The display control unit changes the display mode of the time corresponding to the ultrasonic dynamic image shown in the time axis area to the display mode of the time corresponding to the determined ultrasonic image.
7. The medical image processing apparatus according to claim 6, wherein, It also has: The providing unit provides the still image of the ultrasound, the time information of the still image of the ultrasound, and the identification information of the still image of the ultrasound as inspection information in the ultrasound examination.
8. The medical image processing apparatus according to any one of claims 1 to 7, wherein, The reference time is the timing at which the contrast agent is injected into the subject during the ultrasound examination.
9. The medical image processing apparatus according to claim 8, wherein, The shooting situation is a phase in which the condition of the examined part of the subject's body is represented by the elapsed time from the reference time. The identification information is the phase name that represents the identified phase.
10. An ultrasonic diagnostic device, wherein, have: An ultrasound probe sends an ultrasound signal to the subject, detects the reflected wave signal after the ultrasound signal is reflected within the subject's body, and outputs the detected reflected wave signal. The acquisition unit acquires the reflected wave signal output by the ultrasonic probe; The timing unit starts timing according to instructions and outputs time information indicating the timing duration; and A medical image processing apparatus includes: an image processing unit that, based on the reflected wave signal, sequentially generates ultrasound still images corresponding to time information, and generates ultrasound dynamic images including the ultrasound still images within a period corresponding to an imaging condition predetermined according to the purpose of the ultrasound examination, wherein the time information represents the elapsed time from a reference time to the time when the reflected wave signal is collected; an identification unit that identifies the imaging condition based on the time information corresponding to the ultrasound still images included in the ultrasound dynamic images, and outputs identification information representing the identified imaging condition; and a display control unit that associates the ultrasound images of the ultrasound dynamic images and / or the ultrasound still images, the time information, and the identification information and displays them on a display device. The display control unit causes the display device to display the ultrasonic image and the time information corresponding to the selected identification information.
11. A medical image processing method, wherein, Performed by computer: Based on the reflected wave signal after the ultrasound signal sent to the subject is reflected in the subject's body, ultrasound still images corresponding to time information are generated sequentially, and ultrasound dynamic images including the ultrasound still images during a period corresponding to the shooting conditions predetermined according to the purpose of the ultrasound examination are generated. The time information represents the elapsed time from the reference time to the time when the reflected wave signal is collected. The shooting situation is identified based on the time information corresponding to the ultrasonic still image contained in the ultrasonic dynamic image, and identification information representing the identified shooting situation is output. as well as When the ultrasonic dynamic image and / or the ultrasonic still image are associated and displayed, the time information and the identification information are displayed, the display device displays the ultrasonic image and the time information corresponding to the selected identification information.
12. A storage medium storing a program that causes a computer to perform the following steps: Based on the reflected wave signal after the ultrasound signal sent to the subject is reflected in the subject's body, ultrasound still images corresponding to time information are generated sequentially, and ultrasound dynamic images including the ultrasound still images during a period corresponding to the shooting conditions predetermined according to the purpose of the ultrasound examination are generated. The time information represents the elapsed time from the reference time to the time when the reflected wave signal is collected. The shooting situation is identified based on the corresponding time information established between the ultrasonic still image and the ultrasonic dynamic image, and identification information representing the identified shooting situation is output; and When the ultrasonic dynamic image and / or the ultrasonic still image are associated and displayed, the time information and the identification information are displayed, the display device displays the ultrasonic image and the time information corresponding to the selected identification information.
Citation Information
Patent Citations
JP1975053678A