Ultrasound diagnostic device, ultrasound diagnostic program, and ultrasound diagnostic method

Abstract

When using AI technology to annotate and display vascular regions, tissues other than the annotated vascular regions are also displayed with high visibility. [Solution] The ultrasound diagnostic device 1 is equipped with a prevention function that prevents puncture from being performed while information indicating the location of a blood vessel region recognized using a trained model is displayed on the display screen. Specifically, when information indicating the location of a blood vessel region is displayed on the display screen, the device is equipped with a display processing unit 8 that displays a warning to prevent puncture from being performed while information indicating the location of a blood vessel region is displayed on the display screen.

Description

Technical Field

[0001] The present invention relates to an ultrasonic diagnostic apparatus, an ultrasonic diagnostic program, and an ultrasonic diagnostic method.

Background Art

[0002] Conventionally, medical diagnoses based on ultrasonic images of organs and tissues of living tissues have been widely performed. An ultrasonic diagnostic apparatus that generates such an ultrasonic image transmits ultrasonic waves to a living body, receives ultrasonic waves (echoes) reflected by organs and tissues, and forms an image as a cross-sectional image. In recent years, a technique for annotating and displaying a blood vessel region shown in an ultrasonic image using AI technology is known.

[0003] For example, as disclosed in Patent Document 1, a technique for analyzing an ultrasonic image generated by an ultrasonic diagnostic apparatus and highlighting and displaying a recognized blood vessel region is known. Specifically, in Patent Document 1, typical pattern data of a blood vessel region is stored in advance as a template, and the degree of similarity to the pattern data is calculated while searching the ultrasonic image with the template. Then, a location where the degree of similarity is greater than or equal to a threshold value and is maximum is regarded as the presence of a blood vessel region. Furthermore, in addition to template matching, the calculation of the degree of similarity can use machine learning, or a general image recognition method using deep learning, etc.

[0004] In this specification, technologies such as machine learning and deep learning for recognizing a blood vessel region are collectively referred to as AI (Artificial Intelligence).

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] According to the prior art described above, it becomes easier to identify the vascular region, making it useful when inserting devices such as puncture needles and catheters into a patient's blood vessels, or in other words, when performing a puncture. However, there are cases where AI technology misidentifies the vascular region. When AI technology is used to detect blood vessels and then annotate them by superimposing a predetermined color, tissues other than blood vessels located near the blood vessels, such as nerve tissues, may also be annotated. This can make it difficult to see tissues other than blood vessels located near the annotated blood vessels. Therefore, for example, when a medical professional performs a puncture on a patient while viewing an ultrasound image, there is a risk of damaging the patient's nerve tissues.

[0007] The object of the present invention is to provide an ultrasound diagnostic device, an ultrasound diagnostic program, and an ultrasound diagnostic method that can display tissues other than the annotated vascular region with high visibility when annotating the vascular region using AI technology. [Means for solving the problem]

[0008] The aforementioned problem is solved as follows.

[0009] (1) An ultrasound diagnostic device equipped with a prevention function that prevents puncture from being performed while information indicating the location of a vascular region recognized using a trained model is displayed on the screen.

[0010] (2) The ultrasound diagnostic apparatus according to (1), which includes a notification unit that notifies a warning regarding puncture when displaying information indicating the location of the blood vessel region superimposed on the ultrasound image on the display screen, and the notification unit embodies the prevention function.

[0011] (3) The ultrasound diagnostic apparatus according to (2), wherein the notification unit is a display processing unit that displays a warning regarding puncture on the display screen.

[0012] (4) The ultrasound diagnostic apparatus as described in (3), wherein the warning is intended to prevent puncture while displaying information indicating the location of the blood vessel region superimposed on the ultrasound image.

[0013] (5) The ultrasound diagnostic apparatus according to (3) or (4), further comprising a display instruction means for displaying information indicating the location of the blood vessel region superimposed on the ultrasound image, wherein the display processing unit displays the warning on the display unit when the display instruction means is selected.

[0014] (6) The ultrasound diagnostic apparatus according to (3), comprising a selection means for selecting a puncture mode for performing a puncture, and a display processing unit that selectively displays information indicating the location of the blood vessel region on the display screen superimposed on the ultrasound image, wherein the display processing unit embodies the prevention function by displaying the ultrasound image with the information indicating the location of the blood vessel region hidden when the puncture mode is selected.

[0015] (7) The ultrasound diagnostic apparatus according to (1), comprising: a selection means for selecting a puncture mode for performing a puncture; a display processing unit that displays information indicating the location of the blood vessel region on the display screen; and a control unit that receives display instruction information that instructs the display processing unit to display information, wherein the control unit implements the prevention function by disabling the display of the display instruction means for displaying information indicating the location of the blood vessel region when the puncture mode is selected.

[0016] (8) The ultrasound diagnostic apparatus according to (1), comprising: a selection means for selecting a puncture mode for performing a puncture; a display processing unit that displays information indicating the location of the blood vessel region on the display screen; and a control unit that receives display instruction information that instructs the display processing unit to display information, wherein the control unit implements the prevention function by disabling the reception of the display instruction means for displaying information indicating the location of the blood vessel region when the puncture mode is selected.

[0017] (9) The ultrasound diagnostic apparatus according to (2), comprising a selection means for selecting a puncture mode for performing a puncture, and a display processing unit that selectively displays information indicating the location of the blood vessel region on the display screen, wherein the display processing unit embodies the prevention function by displaying on the same screen a B-mode image in which information indicating the location of the blood vessel region is not displayed and a B-mode image in which information indicating the location of the blood vessel region is displayed.

[0018] (10) The ultrasound diagnostic apparatus according to any one of items (7) to (9), wherein the puncture mode is a puncture needle enhancement mode or a puncture guide display mode.

[0019] (11) The ultrasound diagnostic apparatus according to (3), comprising a Doppler display mode which detects blood flow signals using Doppler mode and generates and displays a Doppler image, wherein the display processing unit displays information indicating the location of the blood vessel region on the display screen when the Doppler image is displayed on the display screen, and displays the warning on the display screen.

[0020] (12) The ultrasound diagnostic apparatus according to (3), comprising a Doppler display mode that detects blood flow signals using Doppler mode and generates and displays a Doppler image, wherein when the display processing unit is displaying the Doppler image on the display screen, it does not display information indicating the location of the blood vessel region on the display screen and does not display the warning on the display screen.

[0021] (13) The ultrasound diagnostic apparatus according to (3), comprising a Doppler display mode that detects blood flow signals using Doppler mode and generates and displays a Doppler image, wherein the display processing unit displays information indicating the location of the blood vessel region on the display screen and, when using the Doppler display mode, displays information indicating the location of the blood vessel region superimposed on the Doppler image and displays the warning on the display screen.

[0022] (14) It has a Doppler display mode that detects a blood flow signal using the Doppler mode, generates and displays a Doppler image. When the display processing unit displays information indicating the position of the blood vessel region on the display screen, when using the Doppler display mode, it displays the Doppler image with the information indicating the position of the blood vessel region hidden, and does not display the warning on the display screen. The ultrasonic diagnostic apparatus according to (3).

[0023] (15) When a puncture needle is detected while information indicating the position of the blood vessel region is displayed on the display screen, the ultrasonic diagnostic apparatus according to (1) displays an ultrasonic image with the information indicating the position of the blood vessel region hidden.

[0024] (16) A procedure for causing a computer to superimpose and display information indicating the position of a blood vessel region recognized using a learned model on an ultrasonic image, and a procedure for preventing puncture from being performed while the information indicating the position of the blood vessel region is displayed. An ultrasonic diagnostic program for execution.

[0025] (17) An ultrasonic diagnostic method including a step of superimposing and displaying information indicating the position of a blood vessel region recognized using a learned model on the ultrasonic image, and a step of preventing puncture from being performed while the information indicating the position of the blood vessel region is displayed.

Advantages of the Invention

[0026] According to the present invention, when displaying a blood vessel region annotation using AI technology, tissues other than the annotated blood vessel region can also be displayed with high visibility.

Brief Description of the Drawings

[0027] [Figure 1] It is a block diagram showing the configuration of the ultrasonic diagnostic apparatus of the embodiment. [Figure 2] It is a diagram showing an example of display of the display unit. [Figure 3] It is a diagram showing an example of display when superimposing and displaying information indicating the position of the blood vessel region. [Figure 4] This flowchart explains how the system works when displaying information indicating the location of blood vessel regions overlaid on a surface. [Figure 5] This figure shows an example of the display when the user taps the operation instruction button for puncture mode while information indicating the location of the blood vessel region is superimposed on the B-mode image. [Figure 6] This is a flowchart of the process for hiding information indicating the location of the blood vessel area upon detection of a tap operation of the puncture mode's operation instruction button. [Figure 7] This figure shows the display unit with the operation instruction buttons for the blood vessel display mode deactivated. [Figure 8] This is a flowchart explaining the display processing shown in Figure 7 of the ultrasound diagnostic device. [Figure 9] This figure shows an example of displaying a B-mode image highlighting the puncture needle and a B-mode image superimposed with information indicating the location of the blood vessel region side by side on the same screen in puncture mode. [Figure 10] This is a flowchart explaining the display process shown in Figure 9 of the ultrasound diagnostic device. [Figure 11] This figure shows an example of the display when the blood vessel display mode is operated while the Doppler display mode is active. [Figure 12] This is a flowchart explaining the display process shown in Figure 11 of the ultrasound diagnostic device. [Figure 13] This figure shows other display examples when the blood vessel display mode is operated while the Doppler display mode is active. [Figure 14] This is a flowchart explaining the display processing shown in Figure 13 of the ultrasound diagnostic device. [Figure 15] This diagram illustrates the display control that occurs when an operation command for Doppler display mode is received while blood vessel display mode is being displayed. [Figure 16] This is a flowchart explaining the display processing shown in Figure 15 of the ultrasound diagnostic device. [Figure 17] This diagram illustrates other display examples when the operation command for Doppler display mode is given while the blood vessel display mode is being displayed. [Figure 18]This is a flowchart explaining the display processing shown in Figure 17 of the ultrasound diagnostic device. [Modes for carrying out the invention]

[0028] The ultrasound diagnostic device of this embodiment displays information indicating the location of vascular regions, which has been recognized using a pre-trained machine learning or deep learning AI model from the B (Brightness) mode image of the subject's ultrasound echo, superimposed on the display screen of the B-mode image. The ultrasound diagnostic device also has a prevention function to prevent puncture from being performed in this display state. This allows for high visibility of tissues other than the annotated vascular regions when annotating vascular regions using AI technology. Embodiments of the present invention will be described in detail below with reference to the drawings.

[0029] Figure 1 is a block diagram showing the configuration of the ultrasound diagnostic device 1 according to the embodiment. The ultrasound diagnostic device 1 is configured with an ultrasound probe 101 connected to a main unit 100 via a cable.

[0030] The main body 100 of the ultrasound diagnostic device 1 comprises an operation unit 2, a transmission unit 3, a reception unit 4, a B-mode image generation unit 5, an ROI (Region of Interest) setting unit 6, a Doppler mode image generation unit 7, a display processing unit 8, a control unit 9, a storage unit 10, a display unit 11, and a vascular region recognition unit 12.

[0031] The ultrasonic probe 101 has multiple transducers (piezoelectric converters) 101a arranged in a one-dimensional direction. Each transducer 101a is given a drive signal from the transmitting unit 3 (described later) to generate ultrasound, and the multiple ultrasounds interfere to generate an ultrasonic beam. The ultrasonic beam is irradiated onto the subject. The multiple transducers 101a then receive the reflected ultrasound waves (echoes) from inside the subject, convert them into electrical signals, and output them to the receiving unit 4 (described later).

[0032] The operation unit 2 is a display instruction means that detects user operation instructions and notifies the control unit 9 of a mode command based on the user operation instructions, and is, for example, a touch panel 21. For example, the operation unit 2 notifies the control unit 9, based on the user operation instructions, whether to execute a mode that displays a B-mode image or a mode that superimposes a Doppler mode image on a B-mode image. The B-mode image is an ultrasound image in which the amplitude of the reflected ultrasound waves (echoes) is represented by brightness (luminance), and the Doppler mode image is a color flow mode image.

[0033] Furthermore, the control unit 2 also includes a function to accept input from the user specifying the location of the ROI where the Doppler mode image will be displayed on the B-mode image.

[0034] Here, we assume that Doppler mode images include Doppler mode images with the following display modes: V mode, which displays the velocity and direction of blood flow in color using the blood flow velocity V as a blood flow signal indicating the state of blood flow; P mode, which displays the power of blood flow in color using the blood flow power P as a blood flow signal; and VT mode, which displays the velocity and dispersion of blood flow in color using the blood flow velocity V and the dispersion T as a blood flow signal.

[0035] When the control unit 2 detects a user's instruction to display a Doppler mode image, it also detects an instruction for the display mode described above. The display modes for Doppler mode image display may include T (dispersion) mode, dP (directional power) mode, etc. Thus, the display modes for Doppler mode image display include color Doppler modes (V mode, VT mode, etc.) and power Doppler modes (P mode, etc.).

[0036] Furthermore, the control unit 2 detects a user operation instruction for a puncture mode that highlights the puncture needle inserted with assistance from a puncture adapter or guide in the B-mode image, and notifies the control unit 9 of the mode command.

[0037] Furthermore, the operation unit 2 detects a user operation instruction for a vascular display mode, which overlays information indicating the location of vascular regions, recognized using a pre-trained machine learning or deep learning AI model from the subject's ultrasound B-mode image, onto the display screen of the B-mode image. The operation unit 2 then notifies the control unit 9 of the vascular display mode command as a user operation instruction.

[0038] More specifically, the display processing unit 8 displays instruction buttons on the display unit 11, which displays B-mode images and the like, as described later. The operation unit 2 detects tap operations on the instruction buttons via the touch panel 21 and uses this as a user operation instruction. It goes without saying that the detection of user operation instructions is not limited to the touch panel 21; other detection means may also be used.

[0039] The transmitting unit 3 transmits a high-voltage drive signal at a predetermined timing to the transducer 101a of the ultrasonic probe 101 in order to irradiate the subject with an ultrasonic beam.

[0040] When displaying a color Doppler image, the transmitting unit 3, under the control of the control unit 9, performs a transmission process for Doppler mode to display a blood flow image, in addition to the transmission process for displaying a B-mode image. In this case, the transmitting unit 3 performs, for example, alternating between B-mode scanning and Doppler mode scanning.

[0041] In Doppler mode scanning, the ultrasonic beam is repeatedly transmitted n times in the same direction (same line) while simultaneously transmitting the ultrasonic beam in all directions (all lines) of the ROI set by the ROI setting unit 6. n is, for example, 16 or more times, and this number of repetitions is called the ensemble number. In addition, the transmitting unit 3 specifies additional information for transmission processing for B-mode images or transmission processing for Doppler mode images during the transmission process and supplies this additional information to the receiving unit 4.

[0042] The receiving unit 4 amplifies the analog electrical signal converted based on the ultrasonic reflected waves (echoes) received by the ultrasonic probe 101, performs A / D conversion, and generates a digital received signal by performing phase addition.

[0043] Furthermore, the receiving unit 4 acquires additional information from the transmitting unit 3, and if the acquired additional information is additional information for B-mode images, it supplies the received signal to the B-mode image generation unit 5. If the acquired additional information is additional information for Doppler-mode images, it supplies the received signal to the Doppler-mode image generation unit 7. Hereinafter, the received signal for B-mode image generation will be referred to as the "B-mode received signal," and the received signal for Doppler-mode image generation will be referred to as the "Doppler-mode received signal."

[0044] The B-mode image generation unit 5, under the control of the control unit 9, performs envelope detection, logarithmic compression, and other operations on the B-mode received signal input from the receiving unit 4, and converts the brightness by adjusting the dynamic range and gain to generate B-mode image data, which is then output to the display processing unit 8.

[0045] The ROI setting unit 6, under the control of the control unit 9, sets the region of interest (ROI) of the Doppler mode image in the transmission unit 3 and the display processing unit 8 according to the ROI specification information entered by the user via the operation unit 2.

[0046] The Doppler mode image generation unit 7, under the control of the control unit 9, generates Doppler mode image data in response to the Doppler mode received signal input from the receiving unit 4 and outputs it to the display processing unit 8.

[0047] The display processing unit 8 overlays Doppler mode image data and information indicating the location of blood vessel regions onto the B-mode image data and displays it on the display unit 11. In the B-mode image display mode, the display processing unit 8 displays the B-mode image generated by the B-mode image generation unit 5 on the display unit 11.

[0048] Furthermore, in the Doppler mode display mode, the display processing unit 8 overlays the Doppler mode image generated by the Doppler mode image generation unit 7 onto the B-mode image generated by the B-mode image generation unit 5 at the selected ROI position using the overlay display unit 81, and displays it on the display unit 11.

[0049] The warning processing unit 82 is a processing unit that displays warning information on the display unit 11 in order to prevent puncture from being performed while information indicating the location of the blood vessel region is superimposed on the display screen of the B-mode image. Further details will be described later. Furthermore, the system is not limited to displaying warning information by the warning processing unit 82; warnings regarding puncture may also be given by means of sound, for example.

[0050] The control unit 9 sets the operation of each processing unit of the main unit 100 and controls the overall operation of the main unit 100. In particular, the mode selection means 91 of the control unit 9 controls the display processing unit 8 to display setting buttons for display modes and operation types on the display unit 11. For example, the setting buttons include a button to set the mode for Doppler image display, which detects blood flow signals using Doppler mode and generates and displays Doppler images, and a setting button for the puncture mode, which highlights the puncture needle in the B-mode image to assist in puncture. There is also a setting button for the vascular region display mode, which overlays information indicating the location of the vascular region in the B-mode image.

[0051] The operation unit 2 then detects the user tapping a setting button displayed on the display unit 11 via the touch panel 21 provided on the display unit 11, and notifies the mode selection means 91 of the user's operation instruction corresponding to the setting button. The mode selection means 91 sets the operation content of each processing unit according to the notified user operation instruction, such as Doppler image display, puncture mode, or vascular region display mode.

[0052] In the above explanation, the operation unit 2 detects when a user taps a setting button for the display mode or operation type displayed on the display unit 11. However, a physical operation switch corresponding to the setting button displayed on the display unit 11 may also be provided, so that the operation unit 2 detects the user's switch operation.

[0053] The memory unit 10 stores ultrasonic image data, gain matrix, frame rate, etc. The ultrasonic image data includes B-mode image data, Doppler-mode image data, and composite image data.

[0054] The display unit 11 is a so-called monitor display, such as an LCD (Liquid Crystal Display) or EL (Electro Luminescence) display, that displays the display image data output from the display processing unit 8. A transparent touch panel 21 is superimposed on the display surface of the display unit 11 so that the user's tap operation of the setting button can be detected. Alternatively, the user's operation instructions may be given by a mouse click or the like on the setting button instead of a tap operation.

[0055] The vascular region recognition unit 12 is a processing unit that, when the vascular region display mode is set, recognizes (determines) vascular regions in the B-mode image generated by the B-mode image generation unit 5 using, for example, a trained model that has been trained on training data using a convolutional neural network.

[0056] The vascular region recognized by the trained model is notified to the display processing unit 8 as information indicating the location of the vascular region. The information indicating the location of the vascular region is, for example, an outline figure of the vascular region, or a figure filled with a predetermined color (for example, red) inside the outline, and includes location information in the B-mode image. Alternatively, the information indicating the location of the vascular region may also be the coordinate position information of the pixel determined to be a vascular region in the B-mode image. The display processing unit 8 overlays the information indicating the location of the vascular region notified to the vascular region recognition unit 12 onto the B-mode image using the overlay display unit 81.

[0057] More specifically, the main unit 100 of the ultrasound diagnostic apparatus 1 in this embodiment is realized by an information processing device (computer) that is configured to include a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disk Drive), and other large-capacity recording media.

[0058] The CPU reads the diagnostic program stored in ROM or HDD, loads it into RAM, and implements the functions of each part of the main unit 100 according to the loaded program. RAM forms a work area that temporarily stores various programs executed by the CPU and data related to these programs. The ultrasound diagnostic program may be stored in the form of computer-readable program code and supplied on a recording medium, or it may be supplied by being transmitted over a network.

[0059] Figure 1 shows an example in which the ultrasound diagnostic device 1 of the embodiment consists of a main unit 100 equipped with a display unit 11 that displays reflected ultrasound waves (echoes) and an ultrasound probe 101. However, the embodiment is not limited to this, and each processing unit of the main unit 100 may be provided on a network as an ultrasound diagnostic device, and the ultrasound probe 101 and the display unit 11 may be connected to the ultrasound diagnostic device via the network.

[0060] Figure 2 shows an example of the display on the display unit 11. The display unit 11 in Figure 2 displays display image data in which vascular region information 112 indicating the location of vascular regions is superimposed on a B-mode image 111. The vascular region information 112 is displayed as an outline figure of the vascular region, or as a figure filled with a predetermined color inside the outline. The predetermined color is, for example, red.

[0061] Furthermore, the display unit 11 displays buttons that the user can tap to instruct and set the operation of the ultrasound diagnostic device 1, acting as the operation unit 2. The B button 113 is a button for setting the display mode of B-mode images. The Doppler button 114 is a button for setting the Doppler display mode, which overlays a color Doppler image onto the B-mode image.

[0062] Furthermore, the blood vessel button 116 is a button that instructs the display mode for blood vessels, which superimposes information indicating the location of the blood vessel region recognized from the B-mode image onto the B-mode image. The puncture button 115 is a button that instructs the display mode for puncture, which highlights the puncture needle. In other words, the blood vessel button 116 is a display instruction means for displaying information indicating the location of the blood vessel region. Note that in Figure 2, only the buttons related to the operation of the ultrasound diagnostic device 1 of the embodiment described below are shown, and the display of other buttons is omitted.

[0063] Next, we will explain the operation when the user taps the blood vessel button 116, which is an operation instruction button for the blood vessel display mode, and the ultrasound diagnostic device 1 overlays information indicating the location of the blood vessel region recognized from the B-mode image onto the ultrasound image.

[0064] Figure 3 shows an example of a display where information indicating the location of blood vessel regions is superimposed. The user taps the blood vessel button 116 to indicate the blood vessel display mode, and the ultrasound diagnostic device 1 detects the tap via the touch panel 21 using the operation unit 2. The display processing unit 8 then superimposes blood vessel region information 112 onto the B-mode image 111 and displays it on the display unit 11, as shown in Figure 3. Furthermore, while displaying the B-mode image 111, the ultrasound diagnostic device 1 displays a warning message 117 to prevent puncture. This warning regarding puncture might read, "Turn off the display of blood vessel regions before puncture."

[0065] The operation of the ultrasound diagnostic device 1 is explained by the flowchart in Figure 4. The flowchart in Figure 4 shows the processing of one frame of the reflected ultrasound wave (echo). Note that in Figure 4, an off-page connector symbol is shown at the beginning of step S41, which is connected to the flowchart in Figure 10, which will be described later. As will be explained in detail later, the same processing as in Figure 4 is performed during the processing in Figure 10.

[0066] In step S41, the B-mode image generation unit 5 generates B-mode image data based on the reflected ultrasound waves (echoes).

[0067] In step S42, the control unit 9 determines whether or not the system is in vascular display mode based on the detection of a tap of the vascular button 116 on the touch panel 21 of the operation unit 2, which indicates the vascular display mode. If the system is in vascular display mode (Yes in step S42), the process proceeds to step S43. If the system is not in vascular display mode (No in step S42), the process proceeds to step S47.

[0068] In step S43, the vascular region recognition unit 12 recognizes the vascular region in the B-mode image generated in step S41 using the trained model, and outputs the recognized vascular region to the display processing unit 8 as information indicating the location of the vascular region.

[0069] In step S44, the overlay display unit 81 of the display processing unit 8 superimposes information indicating the vascular region recognized by the trained model onto the B-mode image and displays it on the display unit 11.

[0070] In step S45, the warning processing unit 82 of the display processing unit 8 generates a warning message related to puncture.

[0071] In step S46, the display processing unit 8 displays the warning message generated in step S45 on the display unit 11, and the process shown in Figure 4 is completed.

[0072] In step S47, the display processing unit 8 displays the B-mode image generated in step S41 on the display unit 11, and then terminates the process shown in Figure 4.

[0073] Next, we will explain the operation when the ultrasound diagnostic device 1 is displaying vascular region information 112 superimposed on the B-mode image 111 on the display unit 11, and the user taps the puncture button 115 to indicate the display of puncture mode, which highlights the puncture needle.

[0074] Figure 5 shows an example of how it would look in this case. When the ultrasound diagnostic device 1 detects a tap operation of the blood vessel button 116, which indicates the blood vessel display mode displayed on the display unit 11, via the touch panel 21 of the operation unit 2, it superimposes blood vessel region information 112 onto the B-mode image 111 and displays it on the display unit 11. Subsequently, when the ultrasound diagnostic device 1 detects a tap operation of the puncture button 115, which indicates the display of the puncture mode that highlights the puncture needle, displayed on the display unit 11, it hides the blood vessel region information 112. The ultrasound diagnostic device 1 also hides any warning messages related to puncture.

[0075] As a result, the vascular region information 112 disappears, allowing tissues other than the annotated vascular region to be displayed with high visibility. In other words, using vascular highlighting during puncture carries the risk of misidentification of vascular regions due to mishighlighting, and reduced visibility of B-mode images due to the superimposition of vascular regions, but this can be avoided.

[0076] Figure 6 is a flowchart of the process of hiding the vascular region information 112 upon detection of a tap operation of the puncture button 115, which instructs the display of the puncture mode described in Figure 5. The flowchart in Figure 6 is a modified version of the flowchart that explains the operation when superimposing information indicating the location of vascular regions onto a B-mode image, with the processing steps S61 to S63 added. Here, we will explain the added processing steps S61 to S63.

[0077] In step S61, the control unit 9 detects a tap operation of the puncture button 115, which is instructed by the mode selection means 91 to display the puncture mode, and determines whether or not it is in puncture mode. If it is in puncture mode (No in step S61), the process proceeds to step S43. If it is not in puncture mode (Yes in step S61), the process proceeds to step S62.

[0078] In step S62, the control unit 9 controls the blood vessel region recognition unit 12 to stop the blood vessel region recognition process, and also controls the warning processing unit 82 to stop the process of generating a warning message related to puncture.

[0079] In step S63, the display processing unit 8 deactivates the blood vessel button 116 that instructs the blood vessel display mode, thereby disabling the operation instruction for the blood vessel display mode.

[0080] Then, in step S64, the B-mode image generation unit 5 sets the B-mode image to highlight the puncture needle. After step S64, the process proceeds to step S47, where the B-mode image generation unit 5 generates a B-mode image in highlight mode for the puncture needle, and the display processing unit 8 displays this B-mode image on the display unit 11. At this time, information indicating the vascular region is not displayed.

[0081] In the above, the process described in step S61 in which the control unit 9 determines whether or not there is an operation instruction for puncture mode and stops the superimposed display of information indicating the blood vessel region. In connection with this, instead of determining whether or not there is an operation instruction for puncture mode by detecting a tap operation of the puncture button 115 that instructs the display of puncture mode, a puncture needle recognition process is performed in the B-mode image. Furthermore, the display of information indicating the location of the blood vessel region may be canceled when a puncture needle is detected. That is, if a puncture needle is detected while information indicating the location of the blood vessel region is displayed on the display screen, the display of the information indicating the location of the blood vessel region is canceled.

[0082] The above described how information indicating the location of a vascular region is displayed when a puncture mode operation instruction is given while information indicating the vascular region is being displayed. Next, we will explain what happens when a puncture mode operation instruction is given when information indicating the vascular region is not being displayed.

[0083] Figure 7 shows the state when the user taps the puncture button 115 to indicate the puncture mode, while only the B-mode image 111 is displayed on the display unit 11. In this case, the ultrasound diagnostic device 1 deactivates the vascular button 116, which indicates the vascular display mode, making it unselectable and disabling the operation instruction for the vascular display mode.

[0084] Figure 8 is a flowchart illustrating the process of the ultrasound diagnostic device 1 in Figure 7. The flowchart in Figure 8 is an expanded version of the flowchart in Figure 4 that explains the operation when superimposing information indicating the location of vascular regions, with the addition of steps S81 to S84. Here, we will explain the added steps S81 to S84.

[0085] In step S81, the control unit 9 detects a tap operation of the puncture button 115, which is instructed by the mode selection means 91 to display the puncture mode, and determines whether or not it is in puncture mode. If it is in puncture mode (No in step S81), the process proceeds to step S41. If it is not in puncture mode (Yes in step S81), the process proceeds to step S82.

[0086] In step S82, the control unit 9 deactivates the blood vessel button 116 that instructs the blood vessel display mode on the display unit 11, thereby disabling the operation instruction for the blood vessel display mode.

[0087] In step S83, the B-mode image is set to highlight the puncture needle, and the process proceeds to step S41 to generate the B-mode image.

[0088] In step S84, the B-mode image generation unit 5 generates a B-mode image based on the reflected ultrasound waves (echoes), and proceeds to step S47. In step S47, the display processing unit 8 displays this B-mode image on the display unit 11.

[0089] As a result, when the puncture mode is selected, the control unit 9 disables the selection of the blood vessel button 116, which instructs the blood vessel display mode for displaying information indicating the location of the blood vessel region. As a result, the blood vessel region information 112 is not displayed, and the ultrasound diagnostic device 1 can display tissues other than the annotated blood vessel region with high visibility.

[0090] The above describes an example in which the ultrasound diagnostic device 1 does not superimpose information indicating the location of the vascular region onto the B-mode image in puncture mode. Next, Figure 9 illustrates another example of how information indicating the location of the vascular region in puncture mode is handled.

[0091] Figure 9 shows an example in which the ultrasound diagnostic device 1 displays a B-mode image highlighting the puncture needle and a B-mode image superimposed with information indicating the location of the vascular region on the same screen in puncture mode. In this case, unlike Figure 7, it is possible to display information indicating the location of the vascular region using the vascular display mode even in puncture mode.

[0092] More specifically, when the ultrasound diagnostic device 1 is displaying only the B-mode image 111 on the display unit 11, and the user taps the puncture button 115 to indicate the puncture mode, the ultrasound diagnostic device 1 displays the B-mode image 111 of the puncture mode. Then, when the ultrasound diagnostic device 1 detects the user tapping the vascular button 116 to indicate the vascular display mode, it displays the B-mode image 111 with the puncture needle highlighted and the B-mode image 111 with the vascular region information 112 superimposed on it side by side on the same screen. This allows for high visibility of tissues other than the annotated vascular region when annotating the vascular region using AI.

[0093] Figure 10 is a flowchart illustrating the process of the ultrasound diagnostic device 1 in Figure 9.

[0094] In step S101, the control unit 9 determines whether or not it is in puncture mode by checking whether or not it has detected a tap operation of the puncture button 115 that instructs the display of the puncture mode via the mode selection means 91. If it is not in puncture mode (No in step S101), the process proceeds to the blood vessel display mode process described in Figure 4. If it is in puncture mode (Yes in step S101), the process proceeds to step S102.

[0095] In step S102, the control unit 9 sets the B-mode image to highlight mode for the puncture needle. In step S103, the B-mode image generation unit 5 generates a B-mode image in which the puncture needle is highlighted.

[0096] In step S105, the control unit 9 determines whether or not the system is in vascular display mode based on the detection of a tap of the vascular button 116 on the touch panel 21 of the operation unit 2, which indicates the vascular display mode. If the system is in vascular display mode (Yes in step S105), the process proceeds to step S106. If the system is not in vascular display mode (No in step S105), the process proceeds to step S109.

[0097] In step S106, the vascular region recognition unit 12 recognizes (determines) vascular regions in the B-mode image generated in step S103 using the trained model, and outputs the recognized vascular regions to the display processing unit 8 as information indicating the location of the vascular regions.

[0098] In step S107, the overlay display unit 81 of the display processing unit 8 superimposes the information indicating the vascular region notified in step S106 onto the B-mode image and displays it on one side of the display unit 11.

[0099] In step S108, the display processing unit 8 displays the puncture-enhanced B-mode image generated in step S104 in parallel on the other side of the display unit 11, and then terminates the process.

[0100] In step S109, the display processing unit 8 displays the puncture-enhanced B-mode image generated in step S104 on the display unit 11 and terminates the process.

[0101] In the above explanation, highlighting the puncture needle, which has been inserted with the assistance of a puncture adapter or guide, in the B-mode image was described as the puncture mode. Alternatively, a puncture guide display mode, which displays the puncture needle guide in the B-mode image, may be used as the puncture mode, and the same processing may be performed. Since the display of the puncture needle guide is not obstructed by information indicating the vascular region and thus its visibility is not reduced, tissues other than the annotated vascular region can also be displayed with high visibility.

[0102] The above describes the operation of the display processing unit 8 during a puncture procedure in combination with the vascular display mode and the puncture mode. Among the display modes related to blood vessels in the ultrasound diagnostic device 1 is the Doppler display mode, which uses Doppler mode to detect blood flow signals, generates a Doppler image 118, and superimposes it on the B-mode image 111. The operation of the display processing unit 8 during a puncture procedure in the vascular display mode and the Doppler display mode will be described below.

[0103] More specifically, Doppler display mode is a technology that uses Doppler modes (color, power, etc.) to detect blood flow signals and visualize blood flow. Ultrasound diagnostic device 1 displays blood flow velocity using color Doppler mode or blood flow strength using power Doppler mode. Users can understand the state of blood flow, such as the direction, velocity, and strength of blood flow, from these Doppler images.

[0104] There may be discrepancies between the blood flow image displayed in Doppler mode and the information indicating the location of vascular regions displayed in vascular display mode. Therefore, by performing the display control described below, the ultrasound diagnostic device 1 can display tissues other than the annotated vascular regions with high visibility.

[0105] Figure 11 shows an example of the display when the ultrasound diagnostic device 1 is displaying a Doppler display mode, which superimposes a Doppler image 118 onto a B-mode image 111, and the user taps the vascular button 116 to indicate the vascular display mode. The Doppler display mode is assumed to be activated in response to the user tapping the Doppler button 114 to set the Doppler display mode.

[0106] When the user taps the vascular button 116 to indicate the vascular display mode, and the operation unit 2 detects the tap via the touch panel 21, the ultrasound diagnostic device 1 superimposes vascular region information 112 onto the B-mode image 111 and displays it on the display unit 11. Furthermore, the ultrasound diagnostic device 1 displays a warning message 117a on the display unit 11 to prevent puncture. For example, this warning regarding puncture might say, "The Doppler mode and the vascular display mode may not match."

[0107] Figure 12 is a flowchart illustrating the processing of the ultrasound diagnostic device 1 in Figure 11. The flowchart in Figure 12 shows the processing of one frame of the reflected ultrasound wave (echo) after the Doppler display mode is activated in response to the user tapping the Doppler button 114 to set the Doppler display mode.

[0108] In step S121, the B-mode image generation unit 5 generates data for the B-mode image 111 based on the reflected ultrasound waves (echoes).

[0109] In step S122, the Doppler mode image generation unit 7 generates Doppler mode image data as a Doppler image 118 based on the reflected ultrasound waves (echoes).

[0110] In step S123, the control unit 9 determines whether or not it has detected a tap operation of the blood vessel button 116 that instructs the blood vessel display mode via the mode selection means 91, and determines whether or not there is an instruction to operate the blood vessel display mode. If there is no instruction to operate (No in S123), proceed to step S128; if there is an instruction to operate (Yes in S123), proceed to step S124.

[0111] In step S124, the vascular region recognition unit 12 recognizes (determines) vascular regions in the B-mode image generated in step S121 using the trained model, and notifies the display processing unit 8 of the recognized vascular regions as vascular region information 112.

[0112] In step S125, the overlay display unit 81 of the display processing unit 8 superimposes the vascular region information 112 notified in step S124 and the Doppler mode image (Doppler image 118) generated in step 122 onto the B-mode image generated in step S121, and displays it on the display unit 11.

[0113] In step S126, the warning processing unit 82 of the display processing unit 8 generates a warning message related to puncture.

[0114] In step S127, the display processing unit 8 displays the warning message generated in step S126 on the display unit 11 and terminates the process.

[0115] In step S128, the B-mode image generated in step S121 and the Doppler-mode image (Doppler image 118) generated in step S122 are superimposed and displayed on the display unit 11, and the process ends.

[0116] Next, Figure 13 illustrates another display example when the user taps the blood vessel button 116 to indicate the blood vessel display mode while the Doppler display mode is being displayed. In Figure 13, as in Figure 11, the Doppler display mode is assumed to be activated in response to the user tapping the Doppler button 114 to set the Doppler display mode.

[0117] Even if the user taps the vascular button 116 to indicate the vascular display mode, and the operation unit 2 of the ultrasound diagnostic device 1 detects the tap via the touch panel 21, the vascular region information 112 is not superimposed on the B-mode image 111. Furthermore, the ultrasound diagnostic device 1 does not display a warning message 117 to prevent puncture. In other words, while the Doppler display mode is displayed, the ultrasound diagnostic device 1 disables the function of the vascular display mode, which superimposes the vascular region information 112 onto the B-mode image 111.

[0118] Figure 14 is a flowchart illustrating the processing of the ultrasound diagnostic device 1 in Figure 13. The flowchart in Figure 14 shows the processing of one frame of the reflected ultrasound wave (echo) after the Doppler display mode is activated in response to the user tapping the Doppler button 114 to set the Doppler display mode.

[0119] In step S141, the B-mode image generation unit 5 generates a B-mode image 111 based on the reflected ultrasound waves (echoes).

[0120] In step S142, the Doppler mode image generation unit 7 generates a Doppler mode image as a Doppler image 118 based on the reflected ultrasound waves (echoes).

[0121] In step S143, the control unit 9 determines whether or not the user is in vascular display mode based on the detection of a tap of the vascular button 116, which is used by the operation unit 2 to indicate the vascular display mode. If the user is in vascular display mode (No in step S143), the process proceeds to step S145. If the user is not in vascular display mode (Yes in step S143), the process proceeds to step S144.

[0122] In step S144, the vascular region recognition unit 12 recognizes (determines) vascular regions in the B-mode image generated in step S41 using the trained model, and notifies the display processing unit 8 of the recognized vascular regions as vascular region information 112.

[0123] In step S145, the Doppler mode image (Doppler image 118) generated in step S122 is superimposed on the B-mode image generated in step S121, displayed on the display unit 11, and the process ends.

[0124] In the above configuration, even if vascular region information 112 is obtained in response to an operation instruction for the vascular display mode, it is not superimposed on the B-mode image 111, nor is a warning displayed. However, the vascular button 116 that instructs the vascular display mode may be deactivated to prevent the user from giving operation instructions.

[0125] Figures 11 to 14 explained the display control when an operation command for the vascular display mode is received while the Doppler display mode is being displayed. Next, we will explain the display control when an operation command for the Doppler display mode is received while the vascular display mode is being displayed.

[0126] Figure 15 shows an example of the display when the Doppler button 114, which sets the Doppler display mode, is tapped while the ultrasound diagnostic device 1 is displaying the vascular display mode, which superimposes vascular region information 112 onto the B-mode image 111. The vascular display mode is assumed to be activated in response to the tapping of the vascular button 116, which instructs the user to activate the vascular display mode.

[0127] When the user taps the Doppler button 114 to set the Doppler display mode, and the ultrasound diagnostic device 1 detects the tap via the touch panel 21 on the control unit 2, it displays a superimposed ultrasound echo image by adding the Doppler image 118 to the B-mode image 111. Furthermore, while displaying the image, the ultrasound diagnostic device 1 displays a warning message 117a to prevent puncture. This warning regarding puncture may, for example, state, "The Doppler mode and the vascular display mode may not match."

[0128] Figure 16 is a flowchart illustrating the process of the ultrasound diagnostic device 1 in Figure 15. In step S161, the B-mode image generation unit 5 generates a B-mode image 111 based on the reflected ultrasound waves (echoes).

[0129] In step S162, the vascular region recognition unit 12 recognizes (determines) vascular regions in the B-mode image generated in step S161 using the trained model, and notifies the display processing unit 8 of the recognized vascular regions as vascular region information 112.

[0130] In step S163, the control unit 9 determines whether or not the Doppler display mode is active based on the detection of a tap of the Doppler button 114 on the touch panel 21 of the operation unit 2, which sets the Doppler display mode. If the Doppler display mode is not active (No in step S163), the process proceeds to step S168. If the Doppler display mode is active (Yes in step S163), the process proceeds to step S164.

[0131] In step S164, the Doppler mode image generation unit 7 generates a Doppler mode image as a Doppler image 118 based on the reflected ultrasound waves (echoes).

[0132] In step S165, the overlay display unit 81 of the display processing unit 8 superimposes the vascular region information 112 notified in step S162 and the Doppler mode image (Doppler image 118) generated in step 164 onto the B-mode image generated in step S161 and displays it on the display unit 11.

[0133] In step S166, the warning processing unit 82 of the display processing unit 8 generates a warning message 117 related to puncture. In step S167, the display processing unit 8 displays the warning message 117 generated in step S166 on the display unit 11 and terminates the process.

[0134] In step S168, the B-mode image generated in step S161 and the Doppler-mode image (Doppler image 118) generated in step S164 are superimposed and displayed on the display unit 11, and the process ends.

[0135] Next, Figure 17 illustrates another display example when the user taps the Doppler button 114 to set the Doppler display mode while the blood vessel display mode is being displayed. In Figure 17, as in Figure 15, the blood vessel display mode is assumed to be activated in response to the user tapping the blood vessel button 116 to indicate the blood vessel display mode.

[0136] When the user taps the Doppler button 114 to set the Doppler display mode, and the ultrasound diagnostic device 1 detects the tap via the touch panel 21 on the control unit 2, it hides the vascular region information 112 that was superimposed on the B-mode image 111. If the ultrasound diagnostic device 1 was displaying a warning message related to puncture, it hides the warning message. Then, the ultrasound diagnostic device 1 displays an ultrasound echo display image with the Doppler image 118 superimposed on the B-mode image 111. In other words, the ultrasound diagnostic device 1 discontinues the vascular display mode and switches to the Doppler display mode.

[0137] Figure 18 is a flowchart illustrating the process of the ultrasound diagnostic device 1 in Figure 16.

[0138] In step S181, the B-mode image generation unit 5 generates a B-mode image 111 based on the reflected ultrasound waves (echoes).

[0139] In step S182, the vascular region recognition unit 12 recognizes (determines) vascular regions in the B-mode image generated in step S181 using the trained model, and notifies the display processing unit 8 of the recognized vascular regions as vascular region information 112.

[0140] In step S183, the display processing unit 8 determines whether or not the display is in Doppler mode based on the detection of a tap of the Doppler button 114 on the touch panel 21 of the operation unit 2, which sets the Doppler display mode. If the display is in Doppler mode (No in step S183), the process proceeds to step S184. If the display is not in Doppler mode (Yes in step S183), the process proceeds to step S185.

[0141] In step S184, the overlay display unit 81 of the display processing unit 8 superimposes the B-mode image generated in step S181 with the information indicating the vascular region notified in step S182 and displays it on the display unit 11, thus ending the process shown in Figure 18.

[0142] In step S185, in order to hide the vascular region information 112, the information indicating the location of the vascular region notified in step S182 is deleted.

[0143] In step S186, the Doppler mode image generation unit 7 generates a Doppler mode image as a Doppler image 118 based on the reflected ultrasound waves (echoes).

[0144] In step S187, the overlay display unit 81 of the display processing unit 8 superimposes the Doppler mode image (Doppler image 118) generated in step 186 onto the B-mode image generated in step S181, displays it on the display unit 11, and ends the process shown in Figure 18.

[0145] The present invention is not limited to the embodiments described above, and various modifications are included. The embodiments described above are described in detail for the purpose of clearly illustrating the present invention, and are not necessarily limited to those having all the configurations described. Furthermore, it is possible to replace parts of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment.

[0146] The original claims of the application are transcribed below. [1] An ultrasound diagnostic device equipped with a prevention function that prevents puncture from being performed while information indicating the location of a vascular region recognized using a trained model is displayed on the screen. [2] The ultrasound diagnostic apparatus according to [1], which includes a notification unit that notifies a warning regarding puncture when displaying information indicating the location of the blood vessel region superimposed on the ultrasound image on the display screen, thereby realizing the prevention function. [3] The ultrasound diagnostic apparatus according to [2], wherein the notification unit is a display processing unit that displays a warning regarding puncture on the display screen. [4] The aforementioned warning is a warning to prevent puncture while displaying information indicating the location of the blood vessel region superimposed on the ultrasound image, as described in [3]. [5] The system includes a display instruction means for displaying information indicating the location of the blood vessel region superimposed on the ultrasound image, The ultrasonic diagnostic apparatus according to [3] or 4, wherein the display processing unit displays the warning on the display unit when the display instruction means is selected. [6] A selection method for selecting a puncture mode for performing a puncture, The system includes a display processing unit that selectively displays information indicating the location of the blood vessel region on the display screen, superimposed on the ultrasound image. The ultrasound diagnostic apparatus according to [3], wherein the display processing unit, when the puncture mode is selected, displays the ultrasound image with the information indicating the location of the blood vessel region hidden, thereby realizing the prevention function. [7] A selection method for selecting a puncture mode for performing a puncture, A display processing unit that displays information indicating the location of the blood vessel region on the display screen, The system includes a control unit that receives display instruction information that instructs the display processing unit to display information, The ultrasound diagnostic apparatus according to [1], wherein the control unit implements the prevention function by disabling the display of a display instruction means for displaying information indicating the location of the blood vessel region when the puncture mode is selected. [8] A selection method for selecting a puncture mode for performing a puncture, A display processing unit that displays information indicating the location of the blood vessel region on the display screen, The system includes a control unit that receives display instruction information that instructs the display processing unit to display information, The ultrasound diagnostic apparatus according to [1], wherein the control unit implements the prevention function by disabling the acceptance of a display instruction means for displaying information indicating the location of the blood vessel region when the puncture mode is selected. [9] A selection method for selecting a puncture mode for performing a puncture, The system includes a display processing unit that selectively displays information indicating the location of the blood vessel region on the display screen, The ultrasound diagnostic apparatus according to [2], wherein the display processing unit, when the puncture mode is selected, implements the prevention function by displaying a B-mode image in which information indicating the location of the blood vessel region is not displayed and a B-mode image in which information indicating the location of the blood vessel region is displayed on the same screen.

[10] The ultrasound diagnostic apparatus according to any one of items [7] to [9], wherein the puncture mode is either a puncture needle enhancement mode or a puncture guide display mode.

[11] It features a Doppler display mode that detects blood flow signals using Doppler mode, generates Doppler images, and displays them. The display processing unit, The ultrasound diagnostic apparatus according to [3], which, when the Doppler image is displayed on the display screen, displays information indicating the location of the blood vessel region on the display screen and displays the warning on the display screen.

[12] It features a Doppler display mode that detects blood flow signals using Doppler mode, generates Doppler images, and displays them. The display processing unit, The ultrasound diagnostic apparatus according to [3], wherein when the Doppler image is displayed on the display screen, information indicating the location of the vascular region is not displayed on the display screen, and the warning is not displayed on the display screen.

[13] It features a Doppler display mode that detects blood flow signals using Doppler mode, generates Doppler images, and displays them. The display processing unit, The ultrasound diagnostic apparatus according to [3], wherein, when information indicating the location of the vascular region is displayed on the display screen, the Doppler display mode is used, the Doppler display mode is used, and the information indicating the location of the vascular region is displayed superimposed on the Doppler image, and the warning is displayed on the display screen.

[14] It features a Doppler display mode that detects blood flow signals using Doppler mode, generates Doppler images, and displays them. The display processing unit, The ultrasound diagnostic apparatus according to [3], wherein, when the display screen is showing information indicating the location of the vascular region, the Doppler display mode is used, the information indicating the location of the vascular region is hidden and the Doppler image is displayed, and the warning is not displayed on the display screen.

[15] The ultrasound diagnostic apparatus according to [1], which, when a puncture needle is detected while information indicating the location of the blood vessel region is displayed on the display screen, hides the information indicating the location of the blood vessel region and displays an ultrasound image.

[16] On the computer, A procedure for overlaying information indicating the location of a vascular region recognized using a trained model onto an ultrasound image. A procedure to prevent puncture from being performed while information indicating the location of the aforementioned vascular region is displayed. An ultrasound diagnostic program to perform the operation.

[17] The steps include: superimposing information indicating the location of a vascular region recognized using a trained model onto the ultrasound image; A step to prevent puncture from being performed while information indicating the location of the aforementioned vascular region is displayed, Ultrasound diagnostic methods including [Explanation of Symbols]

[0147] 1. Ultrasound diagnostic equipment 2 Operation unit (display instruction means) 3. Transmitter 4. Receiving Unit 5. B-mode image generation unit 6 ROI setting section 7. Doppler mode image generation unit 8 Display Processing Unit 81 Overlay display section 82 Warning Processing Unit 9. Control Unit 91 Mode Selection Means 10. Memory Department 11. Representation Section 12. Department of Vascular Awareness 100 body 101 Ultrasonic Probe

Claims

1. An ultrasound diagnostic device equipped with a prevention function that prevents puncture from being performed while information indicating the location of a vascular region recognized using a trained model is displayed on the screen.

2. The ultrasound diagnostic apparatus according to claim 1, which includes a notification unit that notifies a warning regarding puncture when displaying information indicating the location of the blood vessel region superimposed on the ultrasound image on the display screen, and the notification unit embodies the prevention function.

3. The ultrasound diagnostic apparatus according to claim 2, wherein the notification unit is a display processing unit that displays a warning regarding puncture on the display screen.

4. The ultrasound diagnostic apparatus according to claim 3, wherein the warning is intended to prevent puncture while displaying information indicating the location of the blood vessel region superimposed on the ultrasound image.

5. The system includes a display instruction means for displaying information indicating the location of the blood vessel region superimposed on the ultrasound image, The ultrasonic diagnostic apparatus according to claim 3 or 4, wherein the display processing unit displays the warning on the display unit when the display instruction means is selected.

6. A selection method for selecting a puncture mode for performing a puncture, The system includes a display processing unit that selectively displays information indicating the location of the blood vessel region on the display screen, superimposed on the ultrasound image. The ultrasound diagnostic apparatus according to claim 3, wherein the display processing unit, when the puncture mode is selected, displays the ultrasound image while hiding the information indicating the location of the blood vessel region, thereby realizing the prevention function.

7. A selection method for selecting a puncture mode for performing a puncture, A display processing unit that displays information indicating the location of the blood vessel region on the display screen, The system includes a control unit that receives display instruction information that instructs the display processing unit to display information, The ultrasound diagnostic apparatus according to claim 1, wherein the control unit implements the prevention function by disabling the display of the display instruction means for displaying information indicating the location of the blood vessel region when the puncture mode is selected.

8. A selection method for selecting a puncture mode for performing a puncture, A display processing unit that displays information indicating the location of the blood vessel region on the display screen, The system includes a control unit that receives display instruction information that instructs the display processing unit to display information, The ultrasound diagnostic apparatus according to claim 1, wherein the control unit implements the prevention function by disabling the acceptance of a display instruction means for displaying information indicating the location of the blood vessel region when the puncture mode is selected.

9. A selection method for selecting a puncture mode for performing a puncture, The system includes a display processing unit that selectively displays information indicating the location of the blood vessel region on the display screen, The ultrasound diagnostic apparatus according to claim 2, wherein the display processing unit, when the puncture mode is selected, implements the prevention function by displaying on the same screen a B-mode image in which information indicating the location of the blood vessel region is not displayed and a B-mode image in which information indicating the location of the blood vessel region is displayed.

10. The ultrasound diagnostic apparatus according to any one of claims 7 to 9, wherein the puncture mode is a puncture needle enhancement mode or a puncture guide display mode.

11. It features a Doppler display mode that detects blood flow signals using Doppler mode, generates Doppler images, and displays them. The display processing unit, The ultrasound diagnostic apparatus according to claim 3, wherein when the Doppler image is displayed on the display screen, information indicating the location of the blood vessel region is displayed on the display screen, and the warning is displayed on the display screen.

12. It features a Doppler display mode that detects blood flow signals using Doppler mode, generates Doppler images, and displays them. The display processing unit, The ultrasound diagnostic apparatus according to claim 3, wherein when the Doppler image is displayed on the display screen, information indicating the location of the blood vessel region is not displayed on the display screen, and the warning is not displayed on the display screen.

13. It features a Doppler display mode that detects blood flow signals using Doppler mode, generates Doppler images, and displays them. The display processing unit, The ultrasound diagnostic apparatus according to claim 3, wherein, when information indicating the location of the blood vessel region is displayed on the display screen, the Doppler display mode is used, the information indicating the location of the blood vessel region is displayed superimposed on the Doppler image, and the warning is displayed on the display screen.

14. It features a Doppler display mode that detects blood flow signals using Doppler mode, generates Doppler images, and displays them. The display processing unit, The ultrasound diagnostic apparatus according to claim 3, wherein, when information indicating the location of the vascular region is displayed on the display screen, the Doppler display mode is used, the information indicating the location of the vascular region is hidden and the Doppler image is displayed, and the warning is not displayed on the display screen.

15. The ultrasound diagnostic apparatus according to claim 1, wherein when a puncture needle is detected while information indicating the location of the blood vessel region is displayed on the display screen, the information indicating the location of the blood vessel region is hidden and an ultrasound image is displayed.

16. On the computer, A procedure for overlaying information indicating the location of a vascular region recognized using a trained model onto an ultrasound image. A procedure to prevent puncture from being performed while information indicating the location of the aforementioned vascular region is displayed. An ultrasound diagnostic program to perform the operation.

17. The steps include: superimposing information indicating the location of a vascular region recognized using a trained model onto the ultrasound image; A step to prevent puncture from being performed while information indicating the location of the aforementioned vascular region is displayed, Ultrasound diagnostic methods including

Images