Ultrasound diagnostic equipment and storage media

Abstract

To provide a technology capable of reducing a workload imposed on the user when, after generating an ultrasound image of an examination site of a subject, another ultrasound image of the same examination site is generated.SOLUTION: With reference to an annotation list including symbols representing annotations and meanings corresponding to the symbols, an apparatus identifies the meaning of an annotation PV (portal vein) added to an ultrasound image 22. The apparatus sets a region of interest 51 at a position corresponding to the portal vein in the ultrasound image 22, sets values of flow velocity parameters V1 and V2 to values suitable for the portal vein, displays a color Doppler image 71 within the region of interest 51 set in the ultrasound image 22, and further displays a PW wave 91.SELECTED DRAWING: Figure 13

Description

Technical Field

[0001] The present invention relates to an ultrasonic diagnostic apparatus capable of adding annotations to ultrasonic images, and a storage medium including instructions executed by the ultrasonic diagnostic apparatus.

Background Art

[0002] In ultrasonic examinations, after an ultrasonic image is generated by scanning an examination site of a subject, the same examination site may be scanned again to generate another type of ultrasonic image. For example, an examination site of a subject may be scanned to generate a B-mode image, and then the same examination site may be scanned again to generate a color Doppler image. In this case, the user may set conditions for generating the color Doppler image (for example, parameter values for adjusting the image quality of the color Doppler image) with reference to organs and the like depicted in the B-mode image.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of Invention

Problem to be Solved by the Invention

[0004] However, in this case, the user needs to perform operations such as confirming the site depicted in the previously acquired B-mode image. In addition, the user also needs to manually input the conditions for generating the color Doppler image. Accordingly, when setting the conditions for generating the color Doppler image, there is a problem that the operational burden on the user increases.

[0005] Accordingly, there is a demand for a technique that can reduce the operational burden on the user when generating another ultrasonic image of the same examination site after generating an ultrasonic image of the examination site of a subject. [Means for solving the problem]

[0006] A first aspect of the present invention is an ultrasound diagnostic device having one or more processors that control the operation of the ultrasound diagnostic device for acquiring a second ultrasound image of the same examination site as the first ultrasound image, based on annotations added to the first ultrasound image.

[0007] A second aspect of the present invention is a non-temporary computer-readable storage medium in which instructions are stored, When the instruction is executed by one or more processors, the one or more processors will: To control the operation of an ultrasound diagnostic device to acquire a second ultrasound image of the same examination site as the first ultrasound image, based on annotations added to the first ultrasound image. It is a non-temporary, computer-readable storage medium that enables execution of [a certain action]. [Effects of the Invention]

[0008] In this invention, the operation of an ultrasound diagnostic device is controlled to acquire a second ultrasound image of the same examination site as the first ultrasound image, based on annotations added to the first ultrasound image. The annotations are added by the user of the ultrasound diagnostic device. Therefore, even if the examination site in the first ultrasound image is difficult to visually recognize when the user views the first ultrasound image, the processor can detect the annotations and identify information about the first ultrasound image (e.g., the examination site). As a result, the ultrasound diagnostic device can set conditions suitable for acquiring the second ultrasound image based on the information about the first ultrasound image, thereby reducing the workload on the user. [Brief explanation of the drawing]

[0009] [Figure 1] This is a block diagram of ultrasound diagnostic device 1. [Figure 2]This is a diagram schematically showing an example of the user interface 10. [Figure 3] This is a diagram showing the flow of the first embodiment. [Figure 4] This is an explanatory diagram of the annotation 31 added to the ultrasound image 21. [Figure 5] This is a diagram showing an example of the flow of step ST20. [Figure 6] This is a schematic diagram of the ultrasound image 22 displayed on the display unit 8. [Figure 7] This is an explanatory diagram of a method for identifying the meaning of an annotation. [Figure 8] This is an explanatory diagram of step ST23. [Figure 9] This is an explanatory diagram of step ST24. [Figure 10] This is a diagram schematically showing the color Doppler image 71 displayed on the display unit 8. [Figure 11] This is a diagram showing an example of the flow of step ST30. [Figure 12] This is a diagram showing an example of the Doppler window 81. [Figure 13] This is an explanatory diagram of step ST32. [Figure 14] This is a diagram showing the flow of the second embodiment. [Figure 15] This is a diagram schematically showing the ultrasound image 23. [Figure 16] This is a diagram showing an example of the flow of step ST70. [Figure 17] This is an explanatory diagram of step ST73. [Figure 18] This is a diagram showing the position where the diameter of the aorta is measured. [Figure 19] This is a schematic diagram of an example of the measurement result. [Figure 20] This is a diagram showing an example of the flow of step ST80. [Figure 21] This is a schematic diagram of the ultrasound image 25 displayed on the display unit 8. [Figure 22] This is an explanatory diagram of step ST87. [Figure 23]This is an explanatory diagram of step ST88. [Figure 24] This is a diagram schematically showing a color Doppler image 72 displayed on the display unit 8. [Figure 25] This is an explanatory diagram of step ST90. [Figure 26] This is a schematic diagram of the operation console of the ultrasonic diagnostic apparatus 1 according to the third embodiment. [Figure 27] This is an example of a flow diagram of measurement steps in the third embodiment. [Mode for Carrying Out the Invention]

[0010] Hereinafter, modes for carrying out the invention will be described, but the present invention is not limited to the following modes.

[0011] (First Embodiment) Figure 1 is a block diagram of the ultrasonic diagnostic apparatus 1.

[0012] The ultrasonic diagnostic apparatus 1 includes an ultrasonic probe 2, a transmission beamformer 3, a transmitter 4, a receiver 5, a reception beamformer 6, a processor 7, a display unit 8, a memory 9, and a user interface 10. The ultrasonic diagnostic apparatus 1 is an example of the ultrasonic image display system of the present invention.

[0013] The ultrasonic probe 2 has a plurality of vibrating elements 2a arranged in an array. The transmission beamformer 3 and the transmitter 4 drive the plurality of vibrating elements 2a arranged in the ultrasonic probe 2, and ultrasonic waves are transmitted from the vibrating elements 2a. The ultrasonic waves transmitted from the vibrating elements 2a are reflected inside the subject, and the reflected echoes are received by the vibrating elements 2a. The vibrating elements 2a convert the received echoes into electrical signals, and output these electrical signals to the receiver 5 as echo signals. The receiver 5 executes predetermined processing on the echo signals and outputs the processed signals to the reception beamformer 6. The reception beamformer 6 executes reception beamforming on the signals received from the receiver 5 and outputs echo data.

[0014] The receiving beamformer 6 may be a hardware beamformer or a software beamformer. If the receiving beamformer 6 is a software beamformer, it may comprise one or more processors, including one or more of the following: i) a graphics processing unit (GPU), ii) a microprocessor, iii) a central processing unit (CPU), iv) a digital signal processor (DSP), or v) another type of processor capable of performing logical operations. The processors comprising the receiving beamformer 6 may be separate processors from processor 7, or they may be part of processor 7.

[0015] The ultrasonic probe 2 may include electrical circuits for performing all or part of the transmit beamforming and / or receive beamforming. For example, all or part of the transmit beamformer 3, transmitter 4, receiver 5, and receive beamformer 6 may be located within the ultrasonic probe 2.

[0016] The processor 7 controls the transmitting beamformer 3, transmitter 4, receiver 5, and receiving beamformer 6. The processor 7 also communicates electronically with the ultrasonic probe 2. The processor 7 controls which of the vibrating elements 2a is active and the shape of the ultrasonic beam transmitted from the ultrasonic probe 2. The processor 7 also communicates electronically with the display unit 8. The processor 7 can process echo data to generate an ultrasonic image. The term "electronic communication" can be defined to include both wired and wireless communication. According to one embodiment, the processor 7 may include a central processing unit (CPU). According to another embodiment, the processor 7 may include other electronic components or one or more processors capable of performing processing functions, such as a digital signal processor, a field-programmable gate array (FPGA), a graphics processing unit (GPU), or other types of processors. According to another embodiment, the processor 7 may include multiple electronic components capable of performing processing functions. For example, the processor 7 may include two or more electronic components selected from a list of electronic components including a central processing unit, a digital signal processor, a field-programmable gate array, and a graphics processing unit.

[0017] The processor 7 may also include a composite demodulator (not shown) for demodulating the RF data. In another embodiment, demodulation can be performed earlier in the processing chain.

[0018] Furthermore, the processor 7 can generate various ultrasound images (e.g., B-mode images, color Doppler images, M-mode images, color M-mode images, spectral Doppler images, elastography images, TVI images, strain images, strain velocity images, etc.) based on the data obtained by processing by the receiving beamformer 6. Additionally, one or more modules can generate these ultrasound images.

[0019] Image beams and / or image frames are stored, and timing information indicating when the data was acquired into memory can be recorded. The module may include, for example, a scan transformation module that performs scan transformation operations to convert image frames from coordinate beam space to display space coordinates. A video processor module may also be provided that reads image frames from memory while a procedure is being performed on a subject and displays the image frames in real time. The video processor module can store image frames in image memory, and ultrasound images are read from image memory and displayed on the display unit 8.

[0020] In this specification, the term "image" can broadly refer to both visible images and data representing visible images. The term "data" may include raw data, which is ultrasound data before scan transformation, and image data, which is data after scan transformation.

[0021] Furthermore, the processing tasks described above, which are handled by processor 7, may be performed by multiple processors.

[0022] Furthermore, if the receiving beamformer 6 is a software beamformer, the processing performed by the beamformer may be carried out by a single processor or by multiple processors.

[0023] The display unit 8 is, for example, an LED (Light Emitting Diode) display unit, an LCD (Liquid Crystal Display), or an organic EL (Electro-Luminescence) display unit. The display unit 8 displays ultrasound images.

[0024] Memory 9 is any known data storage medium. For example, an ultrasound imaging system includes both non-transient and transient storage media as memory. An ultrasound imaging system may also include multiple memories. Non-transient storage media are non-volatile storage media such as HDDs (Hard Disk Drives) and ROMs (Read Only Memory). Non-transient storage media can also include portable storage media such as CDs (Compact Disks) and DVDs (Digital Versatile Disks). Programs executed by processor 7 are stored in non-transient storage media. Transient storage media are volatile storage media such as RAM (Random Access Memory).

[0025] Memory 9 stores one or more instructions that can be executed by the processor 7. These one or more instructions cause the processor 7 to perform various operations.

[0026] Furthermore, the processor 7 can be configured to be connected to the external storage device 15 via a wired or wireless connection. In this case, it is also possible to distribute and store the instructions to be executed by the processor 7 in both the memory 9 and the external storage device 15.

[0027] The user interface 10 can accept user input. For example, the user interface 10 accepts instructions and information input from the user. Figure 2 is a schematic diagram showing an example of the user interface 10. The user interface 10 has an operation panel 11. The operation panel 11 includes a keyboard, hard keys, a trackball, a rotary control, and soft keys, etc. The operation panel 11 is equipped with, for example, a CF button 12 for setting the ultrasound diagnostic device to color Doppler mode and a measurement button 13 for setting the ultrasound diagnostic device to measurement mode. The user interface 10 may also include a touchscreen for displaying soft keys, etc.

[0028] The ultrasound diagnostic device 1 is configured as described above.

[0029] When performing an ultrasound examination using ultrasound diagnostic device 1, after generating an ultrasound image by scanning the examination area of ​​the subject, the same examination area may be scanned again to generate a different type of ultrasound image. For example, the examination area of ​​the subject may be scanned to generate a B-mode image, and then the same examination area may be scanned again to generate a color Doppler image. In this case, the user may set conditions for generating the color Doppler image (for example, parameter values ​​for adjusting the image quality of the color Doppler image) by referring to the organs and other elements depicted in the B-mode image.

[0030] However, in this case, the user needs to perform tasks such as confirming the areas depicted in the previously acquired B-mode image. Furthermore, the user also needs to manually input the conditions for generating the color Doppler image. Therefore, setting the conditions for generating a color Doppler image presents a problem in terms of the increased workload on the user.

[0031] Therefore, the inventor of this application diligently conducted research and devised a method to address the above-mentioned problem. The method is described in detail below.

[0032] Figure 3 shows the flow chart of the first embodiment. In step ST10, the user scans the examination site of the subject to acquire an ultrasound image (e.g., a B-mode image) of the examination site and records the acquired ultrasound image. The recorded ultrasound image may be a still image or a video obtained by continuously taking images over a certain period of time. The user then adds annotations to the acquired ultrasound image. Figure 4 is an explanatory diagram of annotation 31 added to ultrasound image 21. Here, an example is shown in which the user has added "PV" as annotation 31 to ultrasound image 21. "PV" stands for portal vein. The user saves annotation 31 (PV). After saving "PV", the user proceeds to step ST20.

[0033] In step ST20, the user acquires a color Doppler image of the same examination area as the ultrasound image 21 acquired in step ST10. Step ST20 is described in detail below.

[0034] Figure 5 shows an example of the flow of step ST20. In step ST21, the user operates the probe to scan the same examination area scanned in step ST10 again, and acquires an ultrasound image 22 that is different from the ultrasound image 21 obtained in step ST10. Figure 6 is a schematic diagram of the ultrasound image 22 displayed on the display unit 8 after scanning in step ST21. The display unit 8 may display a real-time ultrasound image 22 (live image) or a still image. The processor can also display the annotation PV saved in step ST10 when displaying the ultrasound image 22. Therefore, the user can confirm that the portal vein is displayed in the ultrasound image 22 by visually checking the annotation PV displayed on the display unit 8. After the ultrasound image 22 is displayed, the user presses the CF button 12 (see Figure 2) on the user interface 10 to set the ultrasound diagnostic device 1 to Doppler mode. Once set to Doppler mode, the process proceeds to step ST220.

[0035] In step ST220, the processor controls the operation of the ultrasound diagnostic device 1 so that a color Doppler image is generated. Specifically, the processor controls the operation of the ultrasound diagnostic device 1 so that the position and size of the region of interest are set, and further, the parameter values ​​for the color Doppler image are set. The specific processing of step ST220 for generating the region of interest and the color Doppler image is described below. Note that step ST220 includes steps ST22 to ST24, so each step will be described in order.

[0036] In step ST22, the processor identifies the meaning of the annotation PV.

[0037] Figure 7 is an explanatory diagram of how to identify the meaning of annotations. The processor refers to the annotation list 40 stored in the memory to determine the meaning of the annotation PV.

[0038] Annotation list 40 includes a "Symbol" column and a "Meaning" column. The "Symbol" column lists the characters and marks that users are permitted to use as annotations. Figure 7 shows examples of symbols that are permitted to be used as annotations, such as the characters "AORTA," "PV," "KID," "RT," "LT," and "LONG." The "Meaning" column shows the meaning that the symbol represents. For example, "AORTA" represents an artery, "PV" represents a portal vein, "KID" represents a kidney, "RT" represents the right side, "LT" represents the left side, and "LONG" represents a cross-section along the long axis.

[0039] The processor identifies which symbol in the annotation list 40 corresponds to the annotation attached to the ultrasound image. In this case, the annotation is "PV," so the processor identifies "PV" from the annotation list 40. The processor then recognizes the meaning associated with "PV." Since "PV" is the portal vein, the processor determines that the annotation PV represents the portal vein. Once the meaning of the annotation has been identified, the process proceeds to step ST23.

[0040] Figure 8 is an explanatory diagram of step ST23.

[0041] In step ST23, the processor determines the location and size of the region of interest 51 relative to the ultrasound image 22 based on the meaning (portal vein) represented by the annotation PV identified in step ST22. Specifically, the location and size of the region of interest 51 are determined as follows:

[0042] The annotated PV represents the portal vein. In ultrasound examinations, the portal vein is often displayed in the lower part of the ultrasound image 22, below the central portion. Therefore, in this embodiment, when the annotation represents the portal vein, the processor determines the position and size of the region of interest 51 so that it encloses the lower part of the ultrasound image 22, as shown in Figure 8. Once the position and size of the region of interest 51 are determined, the process proceeds to step ST24.

[0043] Figure 9 is an explanatory diagram of step ST24.

[0044] The processor sets the values ​​of parameters to adjust the image quality of the color Doppler image. Here, we consider the flow velocity range of the color map 61, which represents the flow velocity, as a parameter for adjusting the image quality of the color Doppler image.

[0045] The color map 61 represents blood flow approaching the probe with the first color and blood flow away from the probe with the second color. The first color is, for example, red, and the second color is, for example, blue. Differences in blood flow velocity are represented by changes in hue or brightness.

[0046] The color map 61 has two velocity parameters V1 and V2 that represent the velocity range. Velocity parameter V1 represents the maximum value of blood flow coming toward the displayed blood vessel, and velocity parameter V2 represents the maximum value of blood flow coming away from the displayed blood vessel. Velocity parameter V1 is shown as a positive value, and velocity parameter V2 is shown as a negative value. The maximum velocity is often determined by the type of organ. For example, in the portal vein, it is often set to V1=18cm / s and V2=-18cm / s, in the abdominal aorta, it is often set to V1=35cm / s and V2=-35cm / s, and in the kidney, it is often set to V1=12cm / s and V2=-12cm / s. In this embodiment, the processor sets the values ​​of velocity parameter V1 and velocity parameter V2 based on the input annotation. Here, since the annotation represents a portal vein, the processor sets the velocity parameters V1 and V2 to values ​​appropriate for a portal vein, i.e., V1 = 18 cm / s and V2 = 18 cm / s. After setting the values ​​of the velocity parameters, the process proceeds to step ST25.

[0047] In step ST25, the processor creates a color Doppler image representing the differences in blood flow velocity within the region of interest 51 based on the set flow velocity parameter values, and displays the color Doppler image. Figure 10 schematically shows the color Doppler image 71 displayed on the display unit 8.

[0048] Figure 10 shows a color Doppler image 71 within the region of interest 51 set in the ultrasound image 22 (B-mode image). A color map 61 is also displayed on the display unit 8.

[0049] The gray-filled region 71a within the region of interest 51 represents blood flow approaching the probe, while the black and white dot pattern region 71b represents blood flow away from the probe. By checking which colors in the color map 61 correspond to the colors within the region of interest 51 displayed on the display unit 8, the user can visually recognize the direction and velocity of blood flow within the region of interest 51. Although a still image is displayed in Figure 10, a video may also be displayed. If a video is displayed, the user can visually observe how the velocity patterns displayed in regions 71a and 71b change over time. Furthermore, the user can manually adjust the position and size of the region of interest 51 as needed. Therefore, even if the region of interest 51 is misaligned from the portal vein, or if the size of the region of interest 51 is too small (or too large), the user can correct the region of interest 51 to the position and / or size desired by the user. Once the color Doppler image 71 is displayed, step ST20 ends and the process proceeds to step ST30 (see Figure 3).

[0050] Step ST30 displays the pulsed Doppler (PW) wave.

[0051] Figure 11 shows an example of the flow of step ST30. Since step ST30 includes steps ST31 and ST32, each step will be described.

[0052] In step ST31, the user sets a Doppler window at the location where they want to observe the flow velocity. Figure 12 shows an example of a Doppler window 81. Figure 12 shows an example where the Doppler window 81 is set on the portal vein.

[0053] Once the Doppler window 81 is set, the process proceeds to step ST32.

[0054] In step ST32, the processor creates a pulsed Doppler (PW) waveform at the position where the Doppler window 81 is set, and displays the PW wave on the display unit 8 (see Figure 13).

[0055] Figure 13 is an explanatory diagram of step ST32.

[0056] When the processor creates a PW wave 91, it sets the range of the PW wave 91 based on the annotation information. In this case, since the annotation represents the portal vein, the processor sets the range of the PW wave 91 to a value appropriate for the portal vein. Therefore, since the range appropriate for the portal vein can be automatically set for the amplitude of the PW wave 91, the aliasing phenomenon of the PW wave 91 can be avoided.

[0057] In the first embodiment, when creating a color Doppler image 71, the processor uses the annotation list 40 to identify that the annotation PV represents the portal vein. Therefore, the processor can set the region of interest 51 to a position roughly corresponding to the portal vein, thereby reducing the burden on the user in setting the region of interest 51. For example, if the position and size of the region of interest 51 automatically set by the processor match the position and size of the region of interest 51 desired by the user, the user is relieved of the task of setting the region of interest 51. Even if the position and size of the region of interest 51 differ from the position and size desired by the user, the processor's automatic setting of the region of interest 51 ensures that the region of interest 51 is set to a position roughly corresponding to the portal vein. Therefore, the user can set the region of interest 51 to their desired position and / or size by only fine-tuning its position and / or size, thus reducing the burden on the user in setting the region of interest 51.

[0058] Furthermore, as described above, since the processor identifies that the annotation PV represents a portal vein, it can set the velocity parameters V1 and V2 to values ​​appropriate for the portal vein. Therefore, the user does not need to manually set the velocity range, thus reducing the user's workload.

[0059] Furthermore, when creating a portal vein PW wave 91, the range of the PW wave 91 is set based on the information (portal vein) represented by the annotated PV. Therefore, since a range suitable for the portal vein can be automatically set for the amplitude of the PW wave 91, it is possible to display a PW wave 91 that avoids aliasing.

[0060] (Second embodiment) In the second embodiment, an example of generating a color Doppler image by combining the information represented by annotations with an image recognition algorithm will be described.

[0061] Figure 14 shows the flow chart of the second embodiment. In step ST60, the user scans the examination site of the subject to acquire an ultrasound image of the examination site and records the acquired ultrasound image. The recorded ultrasound image may be a still image or a video obtained by continuously taking images over a certain period of time. Figure 15 is a schematic diagram showing an ultrasound image 23 acquired by scanning. In this case, the aorta 24 is depicted in the ultrasound image 23. After acquiring the ultrasound image 23, the user adds annotations to the ultrasound image 23. Figure 15 shows an example in which two annotations 32 and 33 have been added to the ultrasound image 23. Annotation 32 is "AORTA" and annotation 33 is "LONG". "AORTA" represents the aorta, and "LONG" represents a longitudinal cross-section. After adding annotations 32 and 33, the user proceeds to step ST70.

[0062] In step ST70, the processor measures the diameter of the aorta.

[0063] Figure 16 shows an example of the flow of step ST70.

[0064] In step ST71, the user presses the measurement button 13 (see Figure 2) on the user interface 10 to set the ultrasound diagnostic device 1 to measurement mode. Once the ultrasound diagnostic device 1 is set to measurement mode, the process proceeds to step ST720.

[0065] In step ST720, the processor controls the operation of the ultrasound diagnostic device 1 so that it detects the measurement site from the ultrasound image 23, performs measurement on the detected measurement site, and saves the measurement results. The specific processing of step ST720 is described below. Note that step ST720 includes steps ST72 to ST77, so each step will be explained in order.

[0066] In step ST72, the processor determines whether annotations have been added to the ultrasound image 23. If annotations have been added to the ultrasound image 23, the process proceeds to step ST73. On the other hand, if annotations have not been added to the ultrasound image 23, the process proceeds to step ST74. In this embodiment, since annotations have been added in step ST60 (see Figure 14), the process proceeds to step ST73.

[0067] Figure 17 is an explanatory diagram of step ST73.

[0068] The processor reads the annotations added to the ultrasound image 23 in step ST60. The processor then refers to the annotation list 40 stored in memory to determine the meaning of the annotations. In this case, the annotations added to the ultrasound image 23 are "AORTA" and "LONG". First, the processor identifies "AORTA" from the annotation list 40 and recognizes that the meaning associated with "AORTA" is the aorta. The processor also identifies "LONG" from the annotation list 40 and recognizes that the meaning associated with "LONG" is "long axis section". Therefore, the processor determines that the annotations entered by the user represent "aorta" and "long axis section". After determining the meaning of the annotations, the process proceeds to step ST74.

[0069] In step ST74, the processor analyzes the ultrasound image 23 using an image recognition algorithm. The image recognition algorithm may be an algorithm that utilizes AI technology (such as a deep learning model) or an algorithm that utilizes a technology other than AI technology (for example, a segmentation method). After analyzing the ultrasound image 23, the process proceeds to step ST75.

[0070] In step ST75, the processor analyzes the ultrasound image 23 to determine whether the measurement site indicated by the annotation has been detected in the ultrasound image 23. Here, it determines whether the aorta 24 has been detected as the measurement site. If the aorta is detected, the process proceeds to step ST77.

[0071] On the other hand, if the aorta is not detected, or if a different site is detected, it is possible that there is an error in the annotation. Therefore, if the aorta is not detected, or if a different site is detected, the system proceeds to step ST76 and notifies the user that the annotation may be incorrect. Upon receiving this notification, the user can check the annotation and, if necessary, rescan the examination site of the subject.

[0072] Here, since the aorta 24 is depicted in the ultrasound image 23, the processor detects the aorta. Therefore, the process proceeds to step ST77.

[0073] In step ST77, the processor measures the diameter of the aorta. Figure 18 shows the location where the diameter of the aorta was measured. Since the processor has detected the aorta 24 from the ultrasound image 23, it knows the location information of where the aorta is located relative to the ultrasound image 23. Therefore, the processor can set any position in the longitudinal direction of the aorta 24 as the measurement position and measure the diameter of the aorta. Figure 18 shows how the diameter of the aorta was measured with the central part in the longitudinal direction of the aorta 24 as the measurement position. Once the diameter of the aorta is measured, the measured value M (=M1) is displayed on the display unit 8. After the measurement value is taken, the process proceeds to step ST78.

[0074] In step ST78, the processor saves the measurement results based on the annotations. Figure 19 is a schematic diagram of an example of the measurement results. The measurement results include three items: "measurement site," "measurement cross section," and "measurement value." In Figure 19, the measurement site is "AORTA," the measurement cross section is "LONG," and the measurement value is "M1." Since the annotations are "AORTA" and "LONG," the processor can recognize that the measurement site is "AORTA" (i.e., the aorta) and the measurement cross section is "LONG" (i.e., the longitudinal cross section). The processor also measured the diameter of the aorta (M=M1) in step ST77. Therefore, the processor can create measurement results that include the measurement site "AORTA," the measurement cross section "LONG," and the measurement value "M1." Once the measurement results are created, the processor saves the measurement results to the memory and terminates the measurement step in step ST70.

[0075] In the second embodiment, it is determined in step ST72 that annotation has been added. However, there are cases where annotation has not been added. In this case, in step ST72, the processor determines that annotation has not been added, so it skips step ST73 and proceeds to step ST74. Therefore, although the processor cannot utilize the annotation information, it can analyze the ultrasound image 23 using an image recognition algorithm, and can perform aortic measurement based on the analysis results of the ultrasound image 23 and save the measurement results.

[0076] Once the measurement is complete, proceed to step ST80 (see Figure 14).

[0077] In step ST80, the user acquires a color Doppler image 71 of the same examination area scanned in step ST60. Step ST80 is described in detail below.

[0078] Figure 20 shows an example of the flow of step ST80.

[0079] In step ST81, the user operates the probe to scan the same examination area scanned in step ST60 again, and acquires an ultrasound image 25 that is different from the ultrasound image 23 obtained in step ST60. Figure 21 is a schematic diagram of the ultrasound image 25 displayed on the display unit 8 after scanning in step ST81. The display unit 8 may display a real-time ultrasound image 25 (live image) or a still image. In addition, when the processor displays the ultrasound image 25, it can also display the annotations "AORTA" and "LONG" saved in step ST60. Therefore, the user can confirm that the aorta is displayed in the ultrasound image 25 by looking at the annotations "AORTA" and "LONG" displayed on the display unit 8. After the ultrasound image 25 is displayed, the user presses the CF button 12 (see Figure 2) on the user interface 10 to set the ultrasound diagnostic device 1 to Doppler mode. Once set to Doppler mode, the process proceeds to step ST820.

[0080] In step ST820, the processor controls the operation of the ultrasound diagnostic device 1 to achieve image quality suitable for color Doppler imaging and generates a color Doppler image. Specifically, the processor sets the position and size of the region of interest and also sets the parameter values ​​for the color Doppler image. The specific processing of step ST820 for generating the region of interest and the color Doppler image is described below. Note that step ST820 includes steps ST82 to ST86, so each step will be described in order.

[0081] In step ST82, the processor determines whether annotations have been added to the ultrasound image 23 (see Figure 15) acquired in step ST60. Here, the ultrasound image 23 has the annotations "AORTA" and "LONG" added, so the process proceeds to step ST83.

[0082] In step ST83, the processor identifies the meanings of the annotations "AORTA" and "LONG". The method for identifying the meaning of the annotations is the same as in step ST73, so the explanation is omitted. The processor determines that the annotations represent "aorta" and "long axis cross-section". After identifying the meaning of the annotations, the process proceeds to step ST84.

[0083] In step ST84, the processor analyzes the ultrasound image 25 using an image recognition algorithm. After analyzing the ultrasound image 25, the process proceeds to step ST85.

[0084] In step ST85, the processor analyzes the ultrasound image 25 to determine whether the aorta has been detected from the ultrasound image 25. If the aorta is detected, the process proceeds to step ST87.

[0085] On the other hand, if the aorta is not detected, it is possible that there is an error in the annotation. Therefore, if the aorta is not detected, the system proceeds to step ST86, and the user is notified that the annotation may be incorrect. Upon receiving this notification, the user can check the annotation and, if necessary, rescan the examination site of the subject.

[0086] Here, since the aorta is depicted in ultrasound image 25, the processor detects the aorta. Therefore, the process proceeds to step ST87.

[0087] Figure 22 is an explanatory diagram of step ST87.

[0088] The processor analyzes the ultrasound image 25 using an image recognition algorithm and detects the aorta within the ultrasound image 25. Therefore, the processor can recognize the positional information of the location where the aorta is located relative to the ultrasound image 25, and can set a region of interest 52 at any location on the aorta. Here, as shown in Figure 22, the processor determines the position and size of the region of interest 52 so that it surrounds the central part of the aorta. Also, since the processor recognizes the positional information of the location where the aorta is located relative to the ultrasound image 25, it can also set the inclination of the region of interest 52 to align with the direction of the aorta's course. Once the position and size of the region of interest 52 are determined, the process proceeds to step ST88.

[0089] Figure 23 is an explanatory diagram of step ST88.

[0090] The processor sets the values ​​of parameters to adjust the quality of the color Doppler image. Here, we consider the flow velocity range of the color map 62, which represents the flow velocity, as a parameter for adjusting the quality of the color Doppler image.

[0091] Similar to the first embodiment, the processor sets the values ​​of the first velocity parameter V1 and the second velocity parameter V2 based on the annotation. Here, since the annotation represents the aorta, the processor sets V1 and V2 to values ​​appropriate for the aorta, i.e., V1 = 35 cm / s and V2 = -35 cm / s. After setting the values ​​of the velocity parameters, the process proceeds to step ST89.

[0092] In step ST89, the processor creates a color Doppler image representing the differences in blood flow velocity within the region of interest 52 based on the set flow velocity parameter values, and displays the color Doppler image. Figure 24 schematically shows the color Doppler image 72 displayed on the display unit 8. Once the color Doppler image 72 is displayed, step ST80 is terminated.

[0093] In the second embodiment, it is determined in step ST82 that annotation has been added. However, there are cases where annotation has not been added. In this case, in step ST82, the processor determines that annotation has not been added, so it skips step ST83 and proceeds to step ST84. Therefore, although the processor cannot utilize the annotation information, it can analyze the ultrasound image 25 using an image recognition algorithm, detect the aorta based on the analysis results of the ultrasound image 25, and execute the processes in steps ST87 and ST88.

[0094] Once the color Doppler image 72 is displayed, proceed to step ST90 (see Figure 14).

[0095] Step ST90 displays the pulsed Doppler (PW) wave.

[0096] Figure 25 is an explanatory diagram of step ST90.

[0097] In step ST90, the processor positions the Doppler window 82. Since the processor recognizes the position information of the aorta, it can set the Doppler window 82 at any position on the aorta. For example, the processor can set the Doppler window 82 in the central part of the aorta. The processor then creates a pulsed Doppler (PW) waveform at the position where the Doppler window 82 is set and displays the PW wave 92 on the display unit 8.

[0098] When the processor creates a PW wave 92, it sets the range of the PW wave 92 based on the annotation information. In this case, since the annotation represents the aorta, the processor sets the range of the PW wave 92 to a value appropriate for the aorta. Therefore, since the range appropriate for the aorta can be automatically set for the amplitude of the PW wave 92, the aliasing phenomenon of the PW wave 92 can be avoided.

[0099] Furthermore, the user can fine-tune the position of the Doppler window 82, which is automatically set by the processor, as needed. For example, if the user moves the Doppler window 82 to a different position, the processor will display the PW wave 92 corresponding to that different position. Thus, the user can display the PW wave 92 at a desired position within the aorta.

[0100] As described above, in the second embodiment, when the diameter of the aorta is measured in step ST70, the processor saves the measurement result based on the annotation. The measurement result includes three items: "measurement site," "measurement cross section," and "measurement value." Since the processor can identify the measurement site and measurement cross section from the annotation information, the user is not required to manually input the data for the measurement site, measurement cross section, and measurement value, thereby reducing the user's workload.

[0101] Furthermore, in the second embodiment, when generating a color Doppler image 72 in step ST80, the processor identifies the meanings of the annotations "AORTA" and "LONG" and performs image analysis on the ultrasound image 25 using an image recognition algorithm. Therefore, the processor can automatically detect the aorta from the ultrasound image 25. Also, since the processor has detected the aorta from the ultrasound image 25, it knows the positional information of where the aorta is located in the ultrasound image 25. Therefore, the processor can set a region of interest 52 at any position on the aorta. If the initial position of the region of interest 52 set by the processor matches the desired position considered by the user, the user does not need to adjust the position of the region of interest 52 themselves, and the user can skip the process of setting the region of interest 52 and proceed to the next step.

[0102] Furthermore, depending on the automatically set position of the region of interest 52, the user may want to adjust the position of the region of interest 52. In this case, the user needs to fine-tune the position of the region of interest 52. However, in the second embodiment, since the processor automatically sets the region of interest 52 to surround the central part of the aorta, the user can set the region of interest 52 to the desired position simply by moving it away from the central part of the aorta. Therefore, the user can set the region of interest 52 to the desired position without significantly changing its position, thus reducing the user's workload when setting the region of interest 52.

[0103] Furthermore, in the second embodiment, the processor identifies the meaning of the annotation "AROTA" (aorta). Therefore, when analyzing the ultrasound image 25 using an image recognition algorithm, it is avoided that the aorta depicted in the ultrasound image 25 may be mistakenly recognized as another blood vessel. For example, the aorta and the inferior vena cava (IVC) are morphologically similar, and it can be difficult to distinguish between the aorta and the IVC using only an image recognition algorithm. However, in the second embodiment, the annotation indicates that the blood vessel on the ultrasound image 25 is the aorta. Therefore, the processor can reliably set the flow velocity parameters V1 and V2 to values ​​appropriate for the aorta, thus avoiding the flow velocity parameters V1 and V2 being set to values ​​corresponding to the inferior vena cava (IVC). ru.

[0104] Furthermore, when creating the PW wave 92 for the aorta, the range of the PW wave 92 is set based on the annotation information. Therefore, it is possible to avoid setting the range of the vertical axis of the PW wave 92 to a range corresponding to a blood vessel other than the aorta, thus avoiding the reduction of the PW wave 92 due to aliasing.

[0105] (Third embodiment) In the second embodiment, an example was shown in which a measurement button is provided on the operation console. In the third embodiment, an example will be described in which two measurement buttons (a measurement button for manual measurement and a measurement button for automatic measurement) are provided on the operation console.

[0106] Figure 26 is a schematic diagram of the operating console of the ultrasound diagnostic apparatus 1 according to the third embodiment. The control console is equipped with a first measurement button 14 and a second measurement button 15.

[0107] The first measurement button 14 is a manual measurement button for the user to perform measurements manually. On the other hand, the second measurement button 15 is an automatic measurement button for performing measurements automatically.

[0108] The following describes how to perform measurements using the ultrasound diagnostic device 1 equipped with the two measurement buttons described above. Note that the third embodiment differs from the second embodiment in step ST70, but the other steps are the same as in the second embodiment. Therefore, the following description will mainly focus on the measurement steps.

[0109] Figure 27 is an example of a flowchart of the measurement steps in the third embodiment. Steps ST72 and ST73 are the same as the flow in Figure 16 of the second embodiment, so a detailed explanation is omitted. The processor determines that the annotations entered by the user are "aorta" and "long axis cross-section". After identifying the meaning of the annotations, the process proceeds to step ST74.

[0110] In step ST740, the processor predicts the measurement site and measurement item based on the meaning of the annotation. In this embodiment, the annotations are "aorta" and "long axis cross-section," so the processor predicts the measurement site as "aorta" and the measurement item as "aortic diameter." After predicting the measurement site and measurement item, the process proceeds to step ST741.

[0111] In step ST741, the processor asks the user whether they want to measure the diameter of the aorta. The processor can ask the user this by displaying a notification on the display unit 8, for example, "Do you want to measure the diameter of the aorta?". If the user decides to measure the diameter of the aorta, they proceed to step ST742 and press the automatic measurement button 15. When this button is pressed, the processor decides to automatically measure the diameter of the aorta. Then, in step ST77, the diameter of the aorta is automatically measured, and in step ST78, the measurement result is automatically saved, and the flow ends.

[0112] On the other hand, if the user decides to measure a different part of the body instead of the aorta, they proceed to step ST743 and press the manual measurement button 14. When this button is pressed, the processor decides not to perform automatic measurement. Then, they proceed to step ST744, where the user performs the measurement manually, and the flow ends.

[0113] In the third embodiment, step ST741 confirms with the user whether or not to measure the diameter of the aorta. Therefore, if the measurement site and items predicted by the processor match the measurement site and items intended by the user, the measurement can be performed automatically by pressing the automatic measurement button. If the measurement site and items predicted by the processor do not match the measurement site and items intended by the user, the measurement can be performed manually by pressing the manual measurement button. Therefore, even if the processor's prediction is incorrect, the measurement intended by the user can still be performed. [Explanation of Symbols]

[0114] 1. Ultrasound diagnostic equipment 2. Ultrasound probe 2a Vibration element 3. Transmitting beamformer 4 Transmitter 5 Receiver 6. Receiving beamformer 7 Processors 8 Display 9 memory 10 User Interface 11. Control Panel 12 CF button 13 Measurement button 21, 22, 23, 25 Ultrasound images 24 Aorta 31, 32, 33 Annotations 40 Annotation Lists 51, 52 Areas of Interest 61, 62 Color Map 71, 72 Color Doppler images 71a, 71b area 82 Doppler window 91, 92 PW wave

Claims

1. An ultrasound diagnostic device having one or more processors that control the operation of the ultrasound diagnostic device to acquire a second ultrasound image of a different type from the first ultrasound image, which is of the same examination site as the first ultrasound image, based on annotations attached to the first ultrasound image, wherein the annotations include information representing the examination site.

2. The ultrasound diagnostic apparatus according to claim 1, wherein controlling the operation of the ultrasound diagnostic apparatus includes at least one of adjusting the image quality of the second ultrasound image and determining the position and size of the region of interest of the second ultrasound image.

3. The system has one or more processors that control the operation of an ultrasound diagnostic device for acquiring a second ultrasound image of a different type from the first ultrasound image, which is of the same examination site as the first ultrasound image, based on annotations added to the first ultrasound image. The aforementioned one or more processors are To determine whether annotations have been added to the first ultrasound image, If annotations are added to the first ultrasound image, the operation of the ultrasound diagnostic device is controlled to acquire a second ultrasound image of the same examination site as the first ultrasound image, based on the annotations and an image recognition algorithm for analyzing the ultrasound image. An ultrasound diagnostic device that performs this function.

4. The aforementioned one or more processors are The ultrasound diagnostic apparatus according to claim 3, wherein, if annotations have not been added to the first ultrasound image, the operation of the ultrasound diagnostic apparatus for acquiring a second ultrasound image of the same examination site as the first ultrasound image is controlled based on the image recognition algorithm.

5. The ultrasound diagnostic apparatus according to claim 3, wherein controlling the operation of the ultrasound diagnostic apparatus includes at least one of adjusting the image quality of the second ultrasound image and determining the position and size of the region of interest of the second ultrasound image.

6. The ultrasound diagnostic device acquires a first ultrasound image by scanning the examination area of ​​the subject, and then scans the same examination area again to acquire an ultrasound image different from the first ultrasound image. The aforementioned one or more processors are Using the aforementioned image recognition algorithm, analyze the other ultrasound image. By analyzing the aforementioned other ultrasound image, it is determined whether or not the area represented by the annotation was detected in the aforementioned other ultrasound image. If the region represented by the annotation is detected, the location and size of the region of interest are determined. Determining the values ​​of the parameters of the second ultrasound image, and Based on the values ​​of the aforementioned parameters, the second ultrasound image is generated within the region of interest. The ultrasound diagnostic apparatus according to claim 5, which performs the following.

7. The ultrasound diagnostic apparatus according to claim 6, wherein the second ultrasound image is a color Doppler image and the parameters are flow velocity parameters.

8. The ultrasound diagnostic apparatus according to claim 6, wherein if the image recognition algorithm detects a part other than the part represented by the annotation, the apparatus notifies the user that the annotation may be incorrect.

9. The system has one or more processors that control the operation of an ultrasound diagnostic device for acquiring a second ultrasound image of a different type from the first ultrasound image, which is of the same examination site as the first ultrasound image, based on annotations added to the first ultrasound image. The ultrasound diagnostic apparatus comprises one or more processors that perform the task of determining the meaning of the annotations.

10. The aforementioned one or more processors are The ultrasound diagnostic apparatus according to claim 3 or 9, wherein the meaning of annotations added to the first ultrasound image is identified using an annotation list that includes symbols permitted to be used as annotations and the meanings represented by the symbols.

11. The ultrasound diagnostic apparatus according to claim 3, wherein the image recognition algorithm uses a deep learning model.

12. The ultrasound diagnostic apparatus according to claim 3 or 9, wherein the annotation includes information representing the examination site.

13. The aforementioned one or more processors are To detect the measurement site from the first ultrasound image, Perform measurements on the detected measurement sites, and Save the measurement results. The ultrasound diagnostic apparatus according to claim 2, 3, or 9, which controls the operation of the ultrasound diagnostic apparatus so that the following is performed.

14. The ultrasound diagnostic apparatus according to claim 13, wherein the measurement results include the measurement site, the measurement cross-section, and the measured value.

15. The aforementioned one or more processors are To determine whether annotations have been added to the first ultrasound image, and If annotations are added to the first ultrasound image, the region represented by the annotations is detected from the first ultrasound image as the measurement site. An ultrasound diagnostic apparatus according to claim 13, which performs the following:

16. The aforementioned one or more processors are Using an image recognition algorithm, the first ultrasound image is analyzed. The analysis of the first ultrasound image determines whether the region represented by the annotation was detected in the first ultrasound image. The ultrasound diagnostic apparatus according to claim 15, which performs the following:

17. The aforementioned one or more processors are The ultrasound diagnostic apparatus according to claim 16, wherein if the area represented by the annotation is not detected from the first ultrasound image, or if an area other than the area represented by the annotation is detected, the user is notified that the annotation may be incorrect.

18. The aforementioned ultrasound diagnostic device includes a button for manual measurement and a button for automatic measurement. The aforementioned one or more processors are To predict measurement items based on the aforementioned annotations, Confirm with the user whether or not to measure the aforementioned measurement items, and If the automatic measurement button is pressed, it is determined that the measurement item will be measured automatically; on the other hand, if the manual measurement button is pressed, it is determined that the measurement item will not be measured automatically. An ultrasound diagnostic apparatus according to claim 13, which performs the following:

19. The ultrasound diagnostic apparatus according to claim 18, wherein the measurement item is the diameter of a blood vessel.

20. An ultrasound diagnostic apparatus having one or more processors that control the operation of the ultrasound diagnostic apparatus for acquiring a second ultrasound image of the same examination site as the first ultrasound image, based on annotations added to the first ultrasound image, An ultrasound diagnostic apparatus in which the first ultrasound image is a B-mode image and the second ultrasound image is a color Doppler image.

21. A non-temporary computer-readable storage medium in which instructions are stored, When the instruction is executed by one or more processors, the one or more processors will: To control the operation of an ultrasound diagnostic device to acquire a second ultrasound image of the same examination site as the first ultrasound image, based on annotations added to the first ultrasound image. A non-temporary computer-readable storage medium in which the first ultrasound image is a B-mode image and the second ultrasound image is a color Doppler image.

22. An ultrasound diagnostic device having one or more processors for controlling the operation of the ultrasound diagnostic device to acquire a second ultrasound image of a different type from the first ultrasound image, which is of the same examination site as the first ultrasound image, based on annotations added to the first ultrasound image.

Images