Ultrasound diagnostic apparatus and storage medium

The ultrasound diagnostic device uses annotations to automate parameter setting for subsequent ultrasound images, reducing user workload and ensuring accurate generation of images like color Doppler.

JP2025167317APending Publication Date: 2025-11-07GE PRECISION HEALTHCARE LLC
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
JP2024071812
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-25
Publication Date
2025-11-07

AI Technical Summary

Technical Problem

The process of setting conditions for generating a color Doppler image after an initial ultrasound image requires manual input by the user, placing a heavy workload due to the need to check and adjust parameters based on the previous B-mode image.

Method used

An ultrasound diagnostic device that uses annotations added to the first ultrasound image to automatically set conditions for acquiring a second ultrasound image, such as a color Doppler image, by identifying and applying appropriate parameters based on the annotations.

Benefits of technology

Reduces the user's workload by automatically setting parameters for the second ultrasound image based on annotations, ensuring accurate and efficient generation of images without manual input.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025167317000001_ABST
    Figure 2025167317000001_ABST
Patent Text Reader

Abstract

To provide a technology capable of reducing a workload imposed on the user when, after generating an ultrasound image of an examination site of a subject, another ultrasound image of the same examination site is generated.SOLUTION: With reference to an annotation list including symbols representing annotations and meanings corresponding to the symbols, an apparatus identifies the meaning of an annotation PV (portal vein) added to an ultrasound image 22. The apparatus sets a region of interest 51 at a position corresponding to the portal vein in the ultrasound image 22, sets values of flow velocity parameters V1 and V2 to values suitable for the portal vein, displays a color Doppler image 71 within the region of interest 51 set in the ultrasound image 22, and further displays a PW wave 91.SELECTED DRAWING: Figure 13
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an ultrasound diagnostic device capable of annotating ultrasound images, and a storage medium containing instructions to be executed by the ultrasound diagnostic device. [Background technology]

[0002] In an ultrasound examination, an ultrasound image is generated by scanning an examination region of a subject, and then the same examination region may be scanned again to generate a different type of ultrasound image. For example, an examination region of a subject may be scanned to generate a B-mode image, and then the same examination region may be scanned again to generate a color Doppler image. In this case, the user may set conditions for generating the color Doppler image (e.g., parameter values ​​for adjusting the image quality of the color Doppler image) by referring to organs depicted in the B-mode image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Publication No. 2008-486 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in this case, the user must check the area depicted in the previously acquired B-mode image, etc. The user must also manually input the conditions for generating a color Doppler image. Therefore, there is a problem in that setting the conditions for generating a color Doppler image places a heavy workload on the user.

[0005] Therefore, there is a need for a technology that can reduce the workload imposed on a user when, after generating an ultrasound image of an examination region of a subject, another ultrasound image of the same examination region is to be generated. [Means for solving the problem]

[0006] A first aspect of the present invention is an ultrasound diagnostic device having one or more processors that control operation of the ultrasound diagnostic device to acquire a second ultrasound image of the same examination area as the first ultrasound image based on annotations added to the first ultrasound image.

[0007] A second aspect of the present invention is a non-transitory computer-readable storage medium having instructions stored thereon, the non-transitory computer-readable storage medium comprising: The instructions, when executed by one or more processors, cause the one or more processors to: Controlling the operation of the ultrasound diagnostic device to acquire a second ultrasound image of the same examination region as the first ultrasound image based on the annotation added to the first ultrasound image. A non-transitory computer-readable storage medium that causes the computer to execute the method. [Effects of the Invention]

[0008] In the present invention, the operation of an ultrasound diagnostic device for acquiring a second ultrasound image of the same examination region as the first ultrasound image is controlled based on annotations added to the first ultrasound image. The annotations are added by a user of the ultrasound diagnostic device. Therefore, even if the examination region in the first ultrasound image is difficult for the user to visually recognize when viewing the first ultrasound image, the processor can detect the annotations to identify information about the first ultrasound image (e.g., the examination region). This allows the ultrasound diagnostic device to set conditions suitable for acquiring the second ultrasound image based on the information about the first ultrasound image, thereby reducing the user's workload. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram of an ultrasonic diagnostic device 1. [Figure 2]1 is a diagram illustrating an example of a user interface 10. FIG. [Figure 3] FIG. 2 is a diagram illustrating a flow of the first embodiment. [Figure 4] FIG. 2 is an explanatory diagram of an annotation 31 added to an ultrasound image 21. [Figure 5] FIG. 10 is a diagram showing an example of the flow of step ST20. [Figure 6] FIG. 2 is a schematic diagram of an ultrasound image 22 displayed on a display unit 8. [Figure 7] FIG. 10 is an explanatory diagram of a method for identifying the meaning of an annotation. [Figure 8] FIG. 10 is an explanatory diagram of step ST23. [Figure 9] FIG. 10 is an explanatory diagram of step ST24. [Figure 10] FIG. 2 is a diagram schematically showing a color Doppler image 71 displayed on a display unit 8. [Figure 11] FIG. 10 is a diagram showing an example of the flow of step ST30. [Figure 12] FIG. 2 is a diagram showing an example of a Doppler window 81. [Figure 13] FIG. 10 is an explanatory diagram of step ST32. [Figure 14] FIG. 10 is a diagram illustrating a flow of the second embodiment. [Figure 15] FIG. 2 is a diagram schematically illustrating an ultrasound image 23. [Figure 16] FIG. 10 is a diagram showing an example of the flow of step ST70. [Figure 17] FIG. 10 is an explanatory diagram of step ST73. [Figure 18] FIG. 10 is a diagram showing the positions where the diameter of the aorta was measured. [Figure 19] FIG. 10 is a schematic diagram of an example of a measurement result. [Figure 20] FIG. 10 is a diagram showing an example of the flow of step ST80. [Figure 21] FIG. 2 is a schematic diagram of an ultrasound image 25 displayed on a display unit 8. [Figure 22] FIG. 10 is an explanatory diagram of step ST87. [Figure 23]FIG. 10 is an explanatory diagram of step ST88. [Figure 24] FIG. 2 is a diagram schematically showing a color Doppler image 72 displayed on the display unit 8. [Figure 25] FIG. 10 is an explanatory diagram of step ST90. [Figure 26] FIG. 10 is a schematic diagram of an operation console of an ultrasound diagnostic apparatus 1 according to a third embodiment. [Figure 27] FIG. 11 is an example of a flow diagram of measurement steps in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, a description will be given of an embodiment of the invention, but the present invention is not limited to the following embodiment.

[0011] (First embodiment) FIG. 1 is a block diagram of an ultrasonic diagnostic device 1.

[0012] The ultrasound diagnostic device 1 includes an ultrasound probe 2, a transmit beamformer 3, a transmitter 4, a receiver 5, a receive beamformer 6, a processor 7, a display unit 8, a memory 9, and a user interface 10. The ultrasound diagnostic device 1 is an example of the ultrasound image display system of the present invention.

[0013] The ultrasound probe 2 has a plurality of transducer elements 2a arranged in an array. A transmit beamformer 3 and a transmitter 4 drive the plurality of transducer elements 2a arranged in the ultrasound probe 2, and ultrasound waves are transmitted from the transducer elements 2a. The ultrasound waves transmitted from the transducer elements 2a are reflected inside the subject, and the reflected echoes are received by the transducer elements 2a. The transducer elements 2a convert the received echoes into electrical signals and output these electrical signals as echo signals to the receiver 5. The receiver 5 performs predetermined processing on the echo signals and outputs them to the receive beamformer 6. The receive beamformer 6 performs receive beamforming on the signals received from the receiver 5 and outputs echo data.

[0014] The receive beamformer 6 may be a hardware beamformer or a software beamformer. If the receive beamformer 6 is a software beamformer, the receive beamformer 6 may include one or more processors, including one or more of: i) a graphics processing unit (GPU), ii) a microprocessor, iii) a central processing unit (CPU), iv) a digital signal processor (DSP), or v) another type of processor capable of performing logical operations. The processor(s) constituting the receive beamformer 6 may be separate from or comprised within the processor 7.

[0015] The ultrasound probe 2 may include electrical circuitry for performing all or part of the transmit beamforming and / or receive beamforming. For example, all or part of the transmit beamformer 3, transmitter 4, receiver 5, and receive beamformer 6 may be provided within the ultrasound probe 2.

[0016] The processor 7 controls the transmit beamformer 3, the transmitter 4, the receiver 5, and the receive beamformer 6. The processor 7 is also in electronic communication with the ultrasound probe 2. The processor 7 controls which transducer elements 2a are active and the shape of the ultrasound beam transmitted from the ultrasound probe 2. The processor 7 is also in electronic communication with the display 8. The processor 7 can process the echo data to generate an ultrasound image. The term "electronic communication" can be defined to include both wired and wireless communication. According to one embodiment, the processor 7 can include a central processing unit (CPU). According to other embodiments, the processor 7 can include one or more processors or other electronic components capable of performing processing functions, such as a digital signal processor, a field programmable gate array (FPGA), a graphics processing unit (GPU), or other types of processors. According to other embodiments, the processor 7 can include multiple electronic components capable of performing processing functions. For example, the processor 7 can include two or more electronic components selected from the list of electronic components including a central processing unit, a digital signal processor, a field programmable gate array, and a graphics processing unit.

[0017] The processor 7 may also include a complex demodulator (not shown) for demodulating the RF data. In alternative embodiments, the demodulation may be performed earlier in the processing chain.

[0018] The processor 7 can also generate various ultrasound images (e.g., B-mode images, color Doppler images, M-mode images, color M-mode images, spectral Doppler images, elastography images, TVI images, strain images, strain velocity images, etc.) based on data obtained by processing by the receive beamformer 6. One or more modules can also generate these ultrasound images.

[0019] The image beams and / or image frames may be stored and timing information indicating when the data was acquired in memory. The modules may include, for example, a scan conversion module that performs a scan conversion operation to convert the image frames from coordinate beam space to display space coordinates. A video processor module may be provided that reads the image frames from memory and displays the image frames in real time while a procedure is being performed on the subject. The video processor module may store the image frames in an image memory, and the ultrasound images may be read from the image memory and displayed on a display 8.

[0020] As used herein, the term "image" may broadly refer to both a visible image and data representing a visible image, and the term "data" may include raw data, which is ultrasound data before a scan conversion operation, and image data, which is data after a scan conversion operation.

[0021] The above-mentioned processing tasks handled by the processor 7 may be executed by a plurality of processors.

[0022] Furthermore, when the receive beamformer 6 is a software beamformer, the processing executed by the beamformer may be executed by a single processor or by multiple processors.

[0023] The display unit 8 is, for example, an LED (Light Emitting Diode) display unit, an LCD (Liquid Crystal Display), or an organic EL (Electro-Luminescence) display unit. The display unit 8 displays an ultrasound image.

[0024] The memory 9 is any known data storage medium. In one example, the ultrasound image display system includes a non-transitory storage medium and a transitory storage medium as memory. The ultrasound image display system may also include multiple memories. The non-transitory storage medium is a non-volatile storage medium such as a hard disk drive (HDD) or a read-only memory (ROM). The non-transitory storage medium may include a portable storage medium such as a compact disk (CD) or a digital versatile disk (DVD). The program executed by the processor 7 is stored in the non-transitory storage medium. The transitory storage medium is a volatile storage medium such as a random access memory (RAM).

[0025] The memory 9 stores one or more instructions executable by the processor 7. The one or more instructions cause the processor 7 to perform various operations.

[0026] The processor 7 can also be configured to be connected to the external storage device 15 via a wired or wireless connection. In this case, the instructions to be executed by the processor 7 can be stored in both the memory 9 and the external storage device 15 in a distributed manner.

[0027] The user interface 10 can accept user input. For example, the user interface 10 accepts input of instructions and information from the user. FIG. 2 is a diagram schematically illustrating an example of the user interface 10. The user interface 10 has an operation panel 11. The operation panel 11 includes a keyboard, hard keys, a trackball, a rotary control, soft keys, and the like. The operation panel 11 is provided with, for example, a CF button 12 for setting the ultrasound diagnostic apparatus to a color Doppler mode and a measurement button 13 for setting the ultrasound diagnostic apparatus to a measurement mode. The user interface 10 may also include a touch screen that displays soft keys and the like.

[0028] The ultrasonic diagnostic apparatus 1 is configured as described above.

[0029] When performing an ultrasound examination using the ultrasound diagnostic device 1, an ultrasound image may be generated by scanning an examination region of a subject, and then the same examination region may be scanned again to generate a different type of ultrasound image. For example, an examination region of a subject may be scanned to generate a B-mode image, and then the same examination region may be scanned again to generate a color Doppler image. In this case, the user may set conditions for generating the color Doppler image (e.g., parameter values ​​for adjusting the image quality of the color Doppler image) with reference to organs depicted in the B-mode image.

[0030] However, in this case, the user must check the area depicted in the previously acquired B-mode image, etc. The user must also manually input the conditions for generating a color Doppler image. Therefore, there is a problem in that setting the conditions for generating a color Doppler image places a heavy workload on the user.

[0031] Therefore, the inventors of the present invention have conducted extensive research and have devised a method for solving the above problems. This method will be specifically described below.

[0032] FIG. 3 is a diagram showing a flow of the first embodiment. In step ST10, the user scans the examination site of the subject to obtain an ultrasound image (e.g., a B-mode image) of the examination site and records the obtained ultrasound image. The recorded ultrasound image may be a still image or a moving image obtained by continuously capturing images over a certain period of time. The user then adds an annotation to the obtained ultrasound image. FIG. 4 is an explanatory diagram of an annotation 31 added to an ultrasound image 21. Here, an example is shown in which the user has added "PV" as the annotation 31 to the ultrasound image 21. "PV" stands for portal vein. The user saves the annotation 31 (PV). After saving "PV", the process proceeds to step ST20.

[0033] In step ST20, the user performs the task of acquiring a color Doppler image of the same examination region as the ultrasound image 21 acquired in step ST10. Step ST20 will be described in detail below.

[0034] FIG. 5 is a diagram showing an example of the flow of step ST20. In step ST21, the user operates the probe to rescan the same examination site as the examination site scanned in step ST10, thereby acquiring an ultrasound image 22 different from the ultrasound image 21 acquired in step ST10. FIG. 6 is a schematic diagram of the ultrasound image 22 displayed on the display unit 8 by scanning in step ST21. The display unit 8 may display a real-time ultrasound image 22 (live image) or a still image. When displaying the ultrasound image 22, the processor may also display the annotation PV saved in step ST10. Therefore, the user can confirm that the portal vein is displayed in the ultrasound image 22 by visually checking the annotation PV displayed on the display unit 8. After the ultrasound image 22 is displayed, the user presses the CF button 12 (see FIG. 2) on the user interface 10 to set the ultrasound diagnostic apparatus 1 to the Doppler mode. After setting the Doppler mode, the process proceeds to step ST220.

[0035] In step ST220, the processor controls the operation of the ultrasound diagnostic device 1 so that a color Doppler image is generated. Specifically, the processor controls the operation of the ultrasound diagnostic device 1 so that the position and size of the region of interest are set, and further, parameter values ​​of the color Doppler image are set. Specific processing of step ST220 for generating the region of interest and the color Doppler image will be described below. Note that step ST220 includes steps ST22 to ST24, and each step will be described in order.

[0036] In step ST22, the processor identifies the meaning of the annotation PV.

[0037] FIG. 7 is a diagram illustrating a method for identifying the meaning of an annotation. The processor refers to the annotation list 40 stored in the storage device to identify the meaning of the annotation PV.

[0038] The annotation list 40 includes a "Symbol" column and a "Meaning" column. The "Symbol" column lists characters and marks that users are permitted to use as annotations. FIG. 7 shows characters such as "AORTA," "PV," "KID," "RT," "LT," and "LONG" as examples of symbols permitted to be used as annotations. The "Meaning" column lists the meanings represented by the symbols. For example, "AORTA" represents the artery, "PV" represents the portal vein, "KID" represents the kidney, "RT" represents the right, "LT" represents the left, and "LONG" represents the longitudinal cross section.

[0039] The processor identifies which symbol in the annotation list 40 corresponds to the annotation added to the ultrasound image. In this case, the annotation is "PV," so the processor identifies "PV" from the annotation list 40. The processor then recognizes the meaning associated with "PV." Since "PV" is the portal vein, the processor determines that the annotation PV represents the portal vein. Once the meaning of the annotation has been identified, the process proceeds to step ST23.

[0040] FIG. 8 is an explanatory diagram of step ST23.

[0041] In step ST23, the processor determines the position and size of the region of interest 51 on the ultrasound image 22 based on the meaning (portal vein) represented by the annotation PV identified in step ST22. Specifically, the processor determines the position and size of the region of interest 51 as follows.

[0042] The annotation PV represents the portal vein. In an ultrasound examination, the portal vein is often displayed from the center to the lower side of the ultrasound image 22. Therefore, in this embodiment, when the annotation represents the portal vein, the processor determines the position and size of the region of interest 51 so that the region of interest 51 surrounds the area from the center to the lower side of the ultrasound image 22, as shown in FIG. 8. After determining the position and size of the region of interest 51, the process proceeds to step ST24.

[0043] FIG. 9 is an explanatory diagram of step ST24.

[0044] The processor sets the values ​​of parameters for adjusting the image quality of the color Doppler image. Here, the flow velocity range of the color map 61 representing the flow velocity is considered as the parameter for adjusting the image quality of the color Doppler image.

[0045] The color map 61 shows blood flow approaching the probe in a first color and blood flow away from the probe in a second color. The first color is, for example, red, and the second color is, for example, blue. Differences in blood flow velocity are shown by changes in hue or brightness.

[0046] The color map 61 has two flow velocity parameters V1 and V2 that represent flow velocity ranges. The flow velocity parameter V1 represents the maximum value of blood flow toward the displayed blood vessel, and the flow velocity parameter V2 represents the maximum value of blood flow away from the displayed blood vessel. Note that the flow velocity parameter V1 is represented by a positive value, and the flow velocity parameter V2 is represented by a negative value. The maximum flow velocity values ​​are often determined depending on the type of organ. For example, in the portal vein, V1 is set to 18 cm / s and V2 to -18 cm / s; in the abdominal aorta, V1 is set to 35 cm / s and V2 to -35 cm / s; and in the kidney, V1 is set to 12 cm / s and V2 to -12 cm / s. Therefore, in this embodiment, the processor sets the values ​​of the flow velocity parameters V1 and V2 based on the input annotations. In this case, since the annotation represents the portal vein, the processor sets the flow velocity parameters V1 and V2 to values ​​suitable for the portal vein, i.e., V1=18 cm / s, V2=18 cm / s. After setting the values ​​of the flow velocity parameters, the process proceeds to step ST25.

[0047] In step ST25, the processor creates a color Doppler image that shows differences in blood flow velocity within the region of interest 51 based on the set flow velocity parameter value, and displays the color Doppler image. Figure 10 shows a schematic diagram of a color Doppler image 71 displayed on the display unit 8.

[0048] 10, a color Doppler image 71 is displayed within a region of interest 51 set in an ultrasound image 22 (B-mode image). A color map 61 is also displayed on the display unit 8.

[0049] The gray-filled region 71a within the region of interest 51 represents blood flow approaching the probe, while the black and white dotted region 71b represents blood flow away from the probe. The user can visually recognize the direction and velocity of blood flow within the region of interest 51 by checking which color in the color map 61 corresponds to which color within the region of interest 51 displayed on the display unit 8. While a still image is displayed in FIG. 10 , a video may also be displayed. When a video is displayed, the user can visually confirm how the flow velocity patterns displayed in regions 71a and 71b change over time. The user can also manually adjust the position and size of the region of interest 51 as needed. Therefore, even if the region of interest 51 is misaligned with the portal vein or is too small (or too large), the user can modify the region of interest 51 to the desired position and / or size. When the color Doppler image 71 is displayed, step ST20 ends and the process proceeds to step ST30 (see FIG. 3).

[0050] In step ST30, the pulse Doppler (PW) wave is displayed.

[0051] FIG. 11 is a diagram showing an example of the flow of step ST30. Since step ST30 includes steps ST31 and ST32, each step will be explained below.

[0052] In step ST31, the user sets a Doppler window at a position where the user wants to observe the flow velocity. Fig. 12 shows an example of a Doppler window 81. Fig. 12 shows an example in which the Doppler window 81 is set to the portal vein.

[0053] Once the Doppler window 81 is set, the process proceeds to step ST32.

[0054] In step ST32, the processor creates a pulse Doppler (PW) waveform at the position where the Doppler window 81 is set, and displays the PW wave on the display unit 8 (see FIG. 13).

[0055] FIG. 13 is an explanatory diagram of step ST32.

[0056] When generating the PW wave 91, the processor sets the range of the PW wave 91 based on the annotation information. In this case, since the annotation represents the portal vein, the processor sets the range of the PW wave 91 to a value suitable for the portal vein. Therefore, a range suitable for the portal vein can be automatically set for the amplitude of the PW wave 91, thereby avoiding the aliasing phenomenon of the PW wave 91.

[0057] In the first embodiment, when creating the color Doppler image 71, the processor uses the annotation list 40 to identify that the annotation PV represents the portal vein. Therefore, the processor can set the region of interest 51 at a position that generally corresponds to the portal vein, thereby reducing the burden on the user of setting the region of interest 51. For example, if the position and size of the region of interest 51 automatically set by the processor match the position and size of the region of interest 51 desired by the user, the user is relieved from the task of setting the region of interest 51. Even if the position and size of the region of interest 51 differ from the position and size of the region of interest 51 desired by the user, the region of interest 51 is set at a position that generally corresponds to the portal vein by the processor's automatic setting of the region of interest 51. Therefore, the user can set the region of interest 51 as desired by simply fine-tuning the position and / or size of the region of interest 51, thereby reducing the burden on the user of setting the region of interest 51.

[0058] Furthermore, as described above, since the processor has identified that the annotation PV represents the portal vein, it can set the flow velocity parameters V1 and V2 to values ​​appropriate for the portal vein. This eliminates the need for the user to manually set the flow velocity range, thereby reducing the user's workload.

[0059] Furthermore, when creating a PW wave 91 of the portal vein, the range of the PW wave 91 is set based on the information (portal vein) represented by the annotation PV. Therefore, a range suitable for the portal vein can be automatically set for the amplitude of the PW wave 91, so that the PW wave 91 can be displayed while avoiding aliasing.

[0060] (Second embodiment) In the second embodiment, an example will be described in which a color Doppler image is generated by combining information represented by annotations with an image recognition algorithm.

[0061] FIG. 14 is a diagram showing a flow of the second embodiment. In step ST60, the user scans the examination site of the subject to acquire an ultrasound image of the examination site and records the acquired ultrasound image. The recorded ultrasound image may be a still image or a video acquired by continuously capturing images over a certain period of time. FIG. 15 is a diagram schematically illustrating an ultrasound image 23 acquired by scanning. In this example, an aorta 24 is depicted in the ultrasound image 23. After acquiring the ultrasound image 23, the user adds annotations to the ultrasound image 23. FIG. 15 shows an example in which two annotations 32 and 33 have been added to the ultrasound image 23. The annotation 32 is "AORTA" and the annotation 33 is "LONG." "AORTA" represents the aorta, and "LONG" represents a longitudinal cross section. After adding the annotations 32 and 33, the process proceeds to step ST70.

[0062] In step ST70, the processor measures the diameter of the aorta.

[0063] FIG. 16 is a diagram showing an example of the flow of step ST70.

[0064] In step ST71, the user presses the measurement button 13 (see FIG. 2) on the user interface 10 to set the ultrasonic diagnostic apparatus 1 to the measurement mode. Once the ultrasonic diagnostic apparatus 1 is set to the measurement mode, the process proceeds to step ST720.

[0065] In step ST720, the processor controls the operation of the ultrasound diagnostic apparatus 1 so that the following operations are performed: detecting a measurement region from the ultrasound image 23, measuring the detected measurement region, and storing the measurement results. Specific processing of step ST720 will be described below. Note that step ST720 includes steps ST72 to ST77, and each step will be described in order.

[0066] In step ST72, the processor determines whether or not an annotation has been added to the ultrasound image 23. If an annotation has been added to the ultrasound image 23, the process proceeds to step ST73. On the other hand, if an annotation has not been added to the ultrasound image 23, the process proceeds to step ST74. In this embodiment, since an annotation has been added in step ST60 (see FIG. 14), the process proceeds to step ST73.

[0067] FIG. 17 is an explanatory diagram of step ST73.

[0068] The processor reads the annotations added to the ultrasound image 23 in step ST60. Then, the processor identifies the meaning of the annotations by referring to the annotation list 40 stored in memory. Here, the annotations added to the ultrasound image 23 are "AORTA" and "LONG." First, the processor identifies "AORTA" from the annotation list 40 and recognizes that the meaning associated with "AORTA" is "aorta." The processor also identifies "LONG" from the annotation list 40 and recognizes that the meaning associated with "LONG" is "longitudinal cross section." Therefore, the processor determines that the annotations entered by the user represent "aorta" and "longitudinal cross section." After identifying the meaning of the annotations, the processor proceeds to step ST74.

[0069] In step ST74, the processor analyzes the ultrasound image 23 using an image recognition algorithm. The image recognition algorithm may be an algorithm that uses AI technology (such as a deep learning model) or an algorithm that uses a technology other than AI technology (for example, a segmentation method). After analyzing the ultrasound image 23, the process proceeds to step ST75.

[0070] In step ST75, the processor analyzes the ultrasound image 23 to determine whether or not a measurement region represented by the annotation has been detected from the ultrasound image 23. Here, it determines whether or not the aorta 24 has been detected as the measurement region. If the aorta has been detected, the process proceeds to step ST77.

[0071] On the other hand, if the aorta is not detected or a region other than the aorta is detected, it is possible that the annotation content is incorrect. Therefore, if the aorta is not detected or a region other than the aorta is detected, the process proceeds to step ST76, where the user is notified that the annotation may be incorrect. Upon receiving this notification, the user can check the annotation or, if necessary, rescan the examination region of the subject.

[0072] In this case, the aorta 24 is depicted in the ultrasound image 23, so the processor detects the aorta, and therefore the process proceeds to step ST77.

[0073] In step ST77, the processor measures the diameter of the aorta. FIG. 18 is a diagram showing the position at which the diameter of the aorta is measured. Because the processor has detected the aorta 24 from the ultrasound image 23, it knows the position information of the location where the aorta is located relative to the ultrasound image 23. Therefore, the processor can set any position in the longitudinal direction of the aorta 24 as the measurement position and measure the diameter of the aorta. FIG. 18 shows the state in which the diameter of the aorta is measured with the central part of the longitudinal direction of the aorta 24 as the measurement position. Once the diameter of the aorta is measured, the measurement value M (= M1) is displayed on the display unit 8. Once the measurement value has been measured, the process proceeds to step ST78.

[0074] In step ST78, the processor stores the measurement results based on the annotations. FIG. 19 is a schematic diagram of an example of the measurement results. The measurement results include three items: "measurement site," "measurement cross section," and "measurement value." In FIG. 19, the measurement site is "AORTA," the measurement cross section is "LONG," and the measurement value is "M1." Because the annotations are "AORTA" and "LONG," the processor can recognize that the measurement site is "AORTA" (i.e., the aorta) and the measurement cross section is "LONG" (i.e., the longitudinal cross section). In addition, the processor measured the aortic diameter (M = M1) in step ST77. Therefore, the processor can create measurement results including the measurement site "AORTA," the measurement cross section "LONG," and the measurement value "M1." After creating the measurement results, the processor stores the measurement results in a storage device and ends the measurement step of step ST70.

[0075] In the second embodiment, it is determined in step ST72 that annotations have been added. However, there are cases where annotations have not been added. In this case, the processor determines in step ST72 that annotations have not been added, and therefore proceeds from step ST72 to step ST74, skipping step ST73. Therefore, although the processor cannot use annotation information, it can analyze the ultrasound image 23 using an image recognition algorithm, and therefore can perform aorta measurement based on the analysis results of the ultrasound image 23 and store the measurement results.

[0076] When the measurement is completed, the process proceeds to step ST80 (see FIG. 14).

[0077] In step ST80, the user performs an operation to obtain a color Doppler image 71 of the same examination region as the examination region scanned in step ST60. Step ST80 will be specifically described below.

[0078] FIG. 20 is a diagram showing an example of the flow of step ST80.

[0079] In step ST81, the user operates the probe to rescan the same examination site as the examination site scanned in step ST60, thereby acquiring an ultrasound image 25 different from the ultrasound image 23 obtained in step ST60. FIG. 21 is a schematic diagram of the ultrasound image 25 displayed on the display unit 8 by scanning in step ST81. The display unit 8 may display a real-time ultrasound image 25 (live image) or a still image. When displaying the ultrasound image 25, the processor may also display the annotations "AORTA" and "LONG" saved in step ST60. Therefore, the user can confirm that the aorta is displayed in the ultrasound image 25 by visually checking the annotations "AORTA" and "LONG" displayed on the display unit 8. After the ultrasound image 25 is displayed, the user presses the CF button 12 (see FIG. 2) on the user interface 10 to set the ultrasound diagnostic apparatus 1 to the Doppler mode. After setting the Doppler mode, the process proceeds to step ST820.

[0080] In step ST820, the processor controls the operation of the ultrasound diagnostic apparatus 1 so as to achieve image quality suitable for the color Doppler image, and generates the color Doppler image. Specifically, the processor sets the position and size of the region of interest, and further sets parameter values ​​for the color Doppler image. Specific processing of step ST820 for generating the region of interest and the color Doppler image will be described below. Note that step ST820 includes steps ST82 to ST86, and each step will be described in order.

[0081] In step ST82, the processor determines whether or not annotations have been added to the ultrasound image 23 (see FIG. 15) acquired in step ST60. In this case, the annotations "AORTA" and "LONG" have been added to the ultrasound image 23, so the process proceeds to step ST83.

[0082] In step ST83, the processor identifies the meanings of the annotations "AORTA" and "LONG." The method for identifying the meanings of the annotations is the same as in step ST73, so the explanation will be omitted. The processor determines that the annotations represent "aorta" and "longitudinal cross section." After identifying the meanings of the annotations, the process proceeds to step ST84.

[0083] In step ST84, the processor uses an image recognition algorithm to analyze the ultrasound image 25. After analyzing the ultrasound image 25, the process proceeds to step ST85.

[0084] In step ST85, the processor determines whether or not the aorta has been detected from the ultrasound image 25 by analyzing the ultrasound image 25. If the aorta has been detected, the process proceeds to step ST87.

[0085] On the other hand, if the aorta is not detected, it is possible that the annotation content is incorrect. Therefore, if the aorta is not detected, the process proceeds to step ST86, where the user is notified that the annotation may be incorrect. Upon receiving this notification, the user can check the annotation and, if necessary, rescan the examination region of the subject.

[0086] In this case, the processor detects the aorta because the aorta is depicted in the ultrasound image 25. Therefore, the process proceeds to step ST87.

[0087] FIG. 22 is an explanatory diagram of step ST87.

[0088] The processor analyzes the ultrasound image 25 using an image recognition algorithm and detects the aorta from within the ultrasound image 25. Therefore, the processor can recognize the position information of the location where the aorta is located in the ultrasound image 25, and can set a region of interest 52 at any position on the aorta. Here, the processor determines the position and size of the region of interest 52 so that the region of interest 52 surrounds the central portion of the aorta, as shown in FIG. 22. Furthermore, since the processor recognizes the position information of the location where the aorta is located in the ultrasound image 25, it can also set the tilt of the region of interest 52 so that it follows the direction of the aorta. Once the position and size of the region of interest 52 have been determined, the process proceeds to step ST88.

[0089] FIG. 23 is an explanatory diagram of step ST88.

[0090] The processor sets the values ​​of parameters for adjusting the image quality of the color Doppler image. Here, the flow velocity range of the color map 62 representing the flow velocity is considered as the parameter for adjusting the image quality of the color Doppler image.

[0091] As in the first embodiment, the processor sets the value of the first flow velocity parameter V1 and the value of the second flow velocity parameter V2 based on the annotation. Here, since the annotation represents the aorta, the processor sets V1 and V2 to values ​​suitable for the aorta, i.e., V1=35 cm / s and V2=-35 cm / s. After setting the values ​​of the flow velocity parameters, the process proceeds to step ST89.

[0092] In step ST89, the processor creates a color Doppler image that shows differences in blood flow velocity within the region of interest 52 based on the set flow velocity parameter value, and displays the color Doppler image. Figure 24 shows a schematic diagram of a color Doppler image 72 displayed on the display unit 8. Once the color Doppler image 72 is displayed, step ST80 ends.

[0093] In the second embodiment, it is determined in step ST82 that annotations have been added. However, there are cases where annotations have not been added. In this case, the processor determines in step ST82 that annotations have not been added, and therefore proceeds from step ST82 to step ST84, skipping step ST83. Therefore, although the processor cannot use annotation information, it can analyze the ultrasound image 25 using an image recognition algorithm, thereby detecting the aorta based on the analysis results of the ultrasound image 25 and executing the processes of steps ST87 and ST88.

[0094] Once the color Doppler image 72 is displayed, the process proceeds to step ST90 (see FIG. 14).

[0095] In step ST90, the pulse Doppler (PW) wave is displayed.

[0096] FIG. 25 is an explanatory diagram of step ST90.

[0097] In step ST90, the processor positions the Doppler window 82. Because the processor knows the position information of the aorta, it can set the Doppler window 82 at any position in the aorta. For example, the processor can set the Doppler window 82 in the central portion of the aorta. Then, the processor creates a pulse Doppler (PW) waveform at the position where the Doppler window 82 is set and displays the PW wave 92 on the display unit 8.

[0098] When creating the PW wave 92, the processor sets the range of the PW wave 92 based on the annotation information. In this case, since the annotation represents the aorta, the processor sets the range of the PW wave 92 to a value suitable for the aorta. Therefore, a range suitable for the aorta can be automatically set for the amplitude of the PW wave 92, thereby avoiding the aliasing phenomenon of the PW wave 92.

[0099] The user can fine-tune the position of the Doppler window 82 automatically set by the processor as needed. For example, if the user moves the Doppler window 82 to another position, the processor displays the PW wave 92 corresponding to the new position. Thus, the user can display the PW wave 92 at a desired position in the aorta.

[0100] As described above, in the second embodiment, when the aortic diameter is measured in step ST70, the processor stores the measurement results based on the annotations. The measurement results include three items: "measurement region," "measurement cross section," and "measurement value." The processor can identify the measurement region and measurement cross section from the annotation information, which prevents the user from manually inputting data on the measurement region, measurement cross section, and measurement value, thereby reducing the user's workload.

[0101] Furthermore, in the second embodiment, when generating the color Doppler image 72 in step ST80, the processor identifies the meaning of the annotations "AORTA" and "LONG" and performs image analysis on the ultrasound image 25 using an image recognition algorithm. Therefore, the processor can automatically detect the aorta from the ultrasound image 25. Furthermore, because the processor has detected the aorta from the ultrasound image 25, the processor knows the position information of the location of the aorta in the ultrasound image 25. Therefore, the processor can set the region of interest 52 at any position on the aorta. If the initial position of the region of interest 52 set by the processor matches the desired position considered by the user, the user does not need to adjust the position of the region of interest 52. Therefore, the user can skip the process of setting the region of interest 52 and start the next task.

[0102] Depending on the position where the region of interest 52 is automatically set, the user may wish to adjust the position of the region of interest 52. In this case, the user needs to fine-tune the position of the region of interest 52. However, in the second embodiment, the processor automatically sets the region of interest 52 to surround the central portion of the aorta, so the user can set the region of interest 52 to a desired position simply by moving the region of interest 52 from the central portion of the aorta. Therefore, the user can set the region of interest 52 to a desired position without having to significantly change the position of the region of interest 52, thereby reducing the workload on the user when setting the region of interest 52.

[0103] Furthermore, in the second embodiment, the processor identifies the meaning of the annotation "AROTA" (aorta). Therefore, when analyzing the ultrasound image 25 using an image recognition algorithm, it is possible to avoid misidentifying the aorta depicted in the ultrasound image 25 as another blood vessel. For example, the aorta has a similar morphology to the inferior vena cava (IVC), and it may be difficult to distinguish between the aorta and the IVC using only an image recognition algorithm. However, in the second embodiment, the annotation indicates that the blood vessel depicted in the ultrasound image 25 is the aorta. Therefore, the processor can reliably set the flow velocity parameters V1 and V2 to values ​​appropriate for the aorta, thereby avoiding the flow velocity parameters V1 and V2 from being set to values ​​corresponding to the inferior vena cava (IVC). do.

[0104] Furthermore, when creating a PW wave 92 for the aorta, the range of the PW wave 92 is set based on the annotation information. Therefore, it is possible to avoid setting the range of the vertical axis of the PW wave 92 to a range corresponding to a blood vessel other than the aorta, and therefore it is possible to avoid aliasing of the PW wave 92.

[0105] (Third embodiment) In the second embodiment, an example in which a measurement button is provided on the operation console is shown, but in the third embodiment, an example in which two measurement buttons (a measurement button for manual measurement and a measurement button for automatic measurement) are provided on the operation console is described.

[0106] FIG. 26 is a schematic diagram of an operation console of the ultrasound diagnostic apparatus 1 of the third embodiment. The operation console is provided with a first measurement button 14 and a second measurement button 15.

[0107] The first measurement button 14 is a manual measurement button for the user to perform manual measurement, while the second measurement button is an automatic measurement button 15 for performing automatic measurement.

[0108] A method for performing measurement using the ultrasound diagnostic device 1 equipped with the above two measurement buttons will be described below. Note that the third embodiment differs from the second embodiment in step ST70, but the other steps are the same as those of the second embodiment. Therefore, the measurement steps will be mainly described below.

[0109] FIG. 27 is an example of a flow diagram of the measurement steps in the third embodiment. Steps ST72 and ST73 are the same as those in the flow of the second embodiment shown in Fig. 16, and therefore detailed description thereof will be omitted. The processor determines that the annotations entered by the user are "aorta" and "longitudinal cross section." After identifying the meaning of the annotation, the process proceeds to step ST74.

[0110] In step ST740, the processor predicts the measurement site and measurement item based on the meaning of the annotation. In this embodiment, the annotation is "aorta" and "longitudinal cross section," so the processor predicts the measurement site to be "aorta" and the measurement item to be "aortic diameter." After predicting the measurement site and measurement item, the process proceeds to step ST741.

[0111] In step ST741, the processor confirms with the user whether or not to measure the diameter of the aorta. The processor can confirm with the user by displaying a notification on the display unit 8, for example, "Do you want to measure the diameter of the aorta?" If the user decides to measure the diameter of the aorta, the process proceeds to step ST742 and presses the automatic measurement button 15. When this button is pressed, the processor determines that the diameter of the aorta will be automatically measured. Then, in step ST77, the diameter of the aorta is automatically measured, and in step ST78, the measurement result is automatically saved, and the flow ends.

[0112] On the other hand, if the user decides that he or she wishes to measure a different part of the body rather than the diameter of the aorta, the process proceeds to step ST743, where the user presses the manual measurement button 14. When this button is pressed, the processor determines that automatic measurement will not be performed. The process then proceeds to step ST744, where the user performs manual measurement, and the flow ends.

[0113] In the third embodiment, in step ST741, the user is asked whether or not to measure the diameter of the aorta. Therefore, if the measurement site and measurement item predicted by the processor match the measurement site and measurement item intended by the user, the measurement can be performed automatically by pressing the automatic measurement button. Furthermore, if the measurement site and measurement item predicted by the processor do not match the measurement site and measurement item intended by the user, the measurement can be performed manually by pressing the manual measurement button. Therefore, even if the processor's prediction is incorrect, the measurement intended by the user can be performed. [Explanation of symbols]

[0114] 1. Ultrasound diagnostic equipment 2 Ultrasound probes 2a Vibration element 3 Transmit beamformer 4 Transmitters 5 Receiver 6 Receive beamformer 7 processors 8 Display 9. Memory 10 User Interface 11 Operation panel 12 CF button 13 Measurement button 21, 22, 23, 25 Ultrasound imaging 24 aorta 31, 32, 33 Annotation 40 Annotation List 51, 52 Area of ​​interest 61, 62 Color Map 71, 72 Color Doppler images 71a, 71b area 82 Doppler window 91, 92 PW wave

Claims

1. 1. An ultrasound diagnostic device having one or more processors that control operation of the ultrasound diagnostic device to acquire a second ultrasound image of the same examination site as the first ultrasound image based on annotations added to the first ultrasound image.

2. 2. The ultrasound diagnostic device of claim 1, wherein controlling the operation of the ultrasound diagnostic device includes at least one of adjusting image quality of the second ultrasound image and determining a position and size of a region of interest in the second ultrasound image.

3. the one or more processors determining whether the first ultrasound image is annotated; If the first ultrasound image has annotations added thereto, controlling the operation of the ultrasound diagnostic device to acquire a second ultrasound image of the same examination region as the first ultrasound image based on the annotations and an image recognition algorithm that analyzes the ultrasound image. The ultrasonic diagnostic apparatus according to claim 2 , wherein the ultrasonic diagnostic apparatus executes the above.

4. the one or more processors 4. The ultrasound diagnostic device of claim 3, wherein, if the first ultrasound image is not annotated, the operation of the ultrasound diagnostic device is controlled based on the image recognition algorithm to acquire a second ultrasound image of the same examination area as the first ultrasound image.

5. the ultrasound diagnostic device acquires the first ultrasound image by scanning an examination region of a subject, and then scans the same examination region again to acquire an ultrasound image different from the first ultrasound image; the one or more processors analyzing the other ultrasound image using the image recognition algorithm; determining whether a region represented by the annotation is detected in the other ultrasound image by analyzing the other ultrasound image; If the portion represented by the annotation is detected, determining the position and size of the region of interest; determining a value of a parameter of the second ultrasound image; and generating the second ultrasound image within the region of interest based on the values ​​of the parameters; The ultrasonic diagnostic apparatus according to claim 2 , wherein the ultrasonic diagnostic apparatus executes the above.

6. The ultrasonic diagnostic apparatus according to claim 5 , wherein the second ultrasonic image is a color Doppler image, and the parameter is a flow velocity parameter.

7. The ultrasound diagnostic apparatus of claim 5 , wherein, when the image recognition algorithm detects a region other than the examination region represented by the annotation, the apparatus notifies a user that the annotation may be incorrect.

8. The ultrasound diagnostic apparatus of claim 3 , wherein the one or more processors are configured to identify the meaning of the annotation.

9. the one or more processors The ultrasound diagnostic device of claim 8, wherein the meaning of the annotation added to the first ultrasound image is identified using an annotation list that includes symbols that are permitted to be used as annotations and the meanings that the symbols represent.

10. The ultrasound diagnostic device of claim 3 , wherein the image recognition algorithm uses a deep learning model.

11. The ultrasound diagnostic apparatus according to claim 1 , wherein the annotation includes information representing an examination region.

12. the one or more processors detecting a measurement region from the first ultrasound image; performing a measurement of the detected measurement site; and Save the measurement results The ultrasonic diagnostic apparatus according to claim 2 , wherein the ultrasonic diagnostic apparatus is controlled so that the above-mentioned operation is performed.

13. The ultrasonic diagnostic apparatus according to claim 12 , wherein the measurement result includes a measurement region, a measurement cross section, and a measurement value.

14. the one or more processors determining whether the first ultrasound image is annotated; and If an annotation is added to the first ultrasonic image, a region indicated by the annotation is detected as a measurement region from the first ultrasonic image. The ultrasonic diagnostic apparatus according to claim 12, wherein the ultrasonic diagnostic apparatus executes the above.

15. the one or more processors analyzing the first ultrasound image using an image recognition algorithm; and determining whether a region represented by the annotation is detected from the first ultrasound image by analyzing the first ultrasound image. The ultrasonic diagnostic apparatus according to claim 14, wherein the ultrasonic diagnostic apparatus executes the above.

16. the one or more processors 16. The ultrasound diagnostic device of claim 15, wherein if the part represented by the annotation is not detected from the first ultrasound image, or if a part other than the part represented by the annotation is detected, a user is notified that the annotation may be incorrect.

17. the ultrasonic diagnostic device includes a button for manual measurement and a button for automatic measurement, the one or more processors predicting a measurement item based on the annotation; confirming with the user whether or not to measure the measurement item; and When the automatic measurement button is pressed, it is determined that the measurement item is to be automatically measured, and when the manual measurement button is pressed, it is determined that the measurement item is not to be automatically measured. The ultrasonic diagnostic apparatus according to claim 12, wherein the ultrasonic diagnostic apparatus executes the above.

18. The ultrasonic diagnostic apparatus according to claim 17, wherein the measurement item is a diameter of a blood vessel.

19. The ultrasonic diagnostic apparatus according to claim 1 , wherein the first ultrasonic image is a B-mode image and the second ultrasonic image is a color Doppler image.

20. A non-transitory computer-readable storage medium having instructions stored thereon, comprising: The instructions, when executed by one or more processors, cause the one or more processors to: Controlling the operation of the ultrasound diagnostic device to acquire a second ultrasound image of the same examination region as the first ultrasound image based on the annotation added to the first ultrasound image. A non-transitory computer-readable storage medium that causes the

Citation Information

Patent Citations

  • Ultrasonic diagnostic apparatus

    JP2004105638A

  • Ultrasonograph

    JP2005270421A

  • Ultrasonic diagnostic device and its control method

    JP2008000486A

  • Ultrasonic diagnostic apparatus and ultrasonic diagnostic system

    JP2008142151A

  • Ultrasonic diagnostic apparatus

    JP2012205610A