Ultrasonic diagnostic apparatus, ultrasonic diagnostic program, and ultrasonic diagnostic method

Abstract

To display tissues other than an annotated blood vessel region with high visibility when performing annotation display of the blood vessel region using an AI technique.SOLUTION: An ultrasonic diagnostic apparatus 1 has a prevention function for preventing puncture from being performed in a state in which information indicating a position of a blood vessel region recognized using a learned model is displayed on a display screen. Specifically, there is provided a display processing unit 8 that displays a warning for preventing puncture while displaying the information indicating the position of the blood vessel region on the display screen in a case where the information indicating the position of the blood vessel region is displayed on the display screen.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an ultrasonic diagnostic apparatus, an ultrasonic diagnostic program, and an ultrasonic diagnostic method. [Background technology]

[0002] Conventionally, medical diagnoses based on ultrasound images of organs and tissues in living bodies have been widely performed. Ultrasound diagnostic devices that generate these ultrasound images transmit ultrasound waves into living bodies, receive ultrasound waves (echoes) reflected by organs and tissues, and visualize them as cross-sectional images. In recent years, a technology has become known that uses AI technology to annotate blood vessel regions shown on ultrasound images.

[0003] For example, as disclosed in Patent Document 1, a technology is known in which an ultrasound image generated by an ultrasound diagnostic device is analyzed and a recognized vascular region is highlighted and displayed. In detail, Patent Document 1 describes a method in which typical pattern data of a vascular region is stored in advance as a template, and the ultrasound image is searched using the template to calculate the similarity to the pattern data. The location where the similarity is equal to or greater than a threshold and is at its maximum is considered to be the location where the vascular region exists. Furthermore, Patent Document 1 also describes that the similarity can be calculated using general image recognition methods using machine learning or deep learning, in addition to template matching.

[0004] In this specification, technologies such as machine learning and deep learning for recognizing vascular regions are collectively referred to as AI (Artificial Intelligence). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2023-026610 Summary of the Invention [Problem to be solved by the invention]

[0006] The above-mentioned prior art makes it easy to grasp blood vessel regions, which is useful when inserting an insert such as a puncture needle or catheter into a subject's blood vessel, i.e., when performing a procedure called puncture. However, there are cases where the AI ​​technology is used to incorrectly recognize blood vessel regions. When annotating blood vessels detected using AI technology by superimposing a specific color on them, tissues other than the blood vessels located near the blood vessels, such as nerve regions, may also be annotated. This may make it difficult to see tissues other than the blood vessels located near the annotated blood vessels. Therefore, for example, when a medical professional punctures a patient while looking at an ultrasound image, there is a risk that the patient's nerve regions may also be injured.

[0007] An object of the present invention is to provide an ultrasound diagnostic device, an ultrasound diagnostic program, and an ultrasound diagnostic method that, when annotating vascular regions using AI technology, can also display tissues other than the annotated vascular regions with high visibility. [Means for solving the problem]

[0008] The above problem is solved as follows.

[0009] (1) An ultrasound diagnostic device equipped with a function to prevent punctures from being performed while information indicating the location of a blood vessel region recognized using a trained model is displayed on the display screen.

[0010] (2) An ultrasound diagnostic device as described in (1) that is provided with an alarm unit that issues a warning regarding puncture when information indicating the position of the vascular region is displayed on the display screen superimposed on an ultrasound image, and that embodies the prevention function by the alarm unit.

[0011] (3) The ultrasound diagnostic device according to (2), wherein the notification unit is a display processing unit that displays a warning regarding puncture on the display screen.

[0012] (4) The ultrasound diagnostic device according to (3), wherein the warning is a warning to prevent puncture while displaying information indicating the position of the vascular region superimposed on the ultrasound image.

[0013] (5) An ultrasound diagnostic device as described in (3) or (4), which is provided with a display instruction means for displaying information indicating the position of the vascular region superimposed on the ultrasound image, and the display processing unit displays the warning on the display unit when the display instruction means is selected.

[0014] (6) An ultrasound diagnostic device according to (3), comprising a selection means for selecting a puncture mode for puncturing, and a display processing unit for selectively displaying information indicating the position of the vascular region on the display screen superimposed on the ultrasound image, wherein the display processing unit embodies the prevention function by displaying the ultrasound image in a state where the information indicating the position of the vascular region is not displayed when the puncture mode is selected.

[0015] (7) An ultrasound diagnostic device as described in (1), comprising: a selection means for selecting a puncture mode for puncturing; a display processing unit for displaying information indicating the position of the vascular region on the display screen; and a control unit for receiving display instruction information for instructing the information to be displayed by the display processing unit, wherein the control unit embodies the prevention function by disabling the display instruction means for displaying the information indicating the position of the vascular region when the puncture mode is selected.

[0016] (8) An ultrasound diagnostic device as described in (1), comprising: a selection means for selecting a puncture mode for puncturing; a display processing unit for displaying information indicating the position of the vascular region on the display screen; and a control unit for accepting display instruction information that instructs the information to be displayed by the display processing unit, wherein the control unit embodies the prevention function by disabling acceptance of the display instruction means for displaying the information indicating the position of the vascular region when the puncture mode is selected.

[0017] (9) An ultrasound diagnostic device according to (2), comprising a selection means for selecting a puncture mode for puncturing and a display processing unit for selectively displaying information indicating the position of the vascular region on the display screen, wherein the display processing unit embodies the prevention function by displaying, on the same screen when the puncture mode is selected, a B-mode image without information indicating the position of the vascular region and a B-mode image with information indicating the position of the vascular region.

[0018] (10) The ultrasound diagnostic device according to any one of (7) to (9), wherein the puncture mode is a puncture needle enhancement mode or a puncture guide display mode.

[0019] (11) The ultrasound diagnostic device described in (3) is provided with a Doppler display mode that detects blood flow signals using a Doppler mode to generate and display a Doppler image, and the display processing unit displays information indicating the position of the vascular region on the display screen when the Doppler image is displayed on the display screen, and displays the warning on the display screen.

[0020] (12) The ultrasound diagnostic device described in (3) is provided with a Doppler display mode that detects blood flow signals using a Doppler mode and generates and displays a Doppler image, and when the Doppler image is displayed on the display screen, the display processing unit does not display information indicating the position of the vascular region on the display screen and does not display the warning on the display screen.

[0021] (13) The ultrasound diagnostic device according to (3), further comprising a Doppler display mode for detecting blood flow signals using a Doppler mode to generate and display a Doppler image, wherein the display processing unit, when using the Doppler display mode while information indicating the position of the vascular region is being displayed on the display screen, displays the information indicating the position of the vascular region superimposed on the Doppler image and displays the warning on the display screen.

[0022] (14) The ultrasound diagnostic device according to (3), further comprising a Doppler display mode for detecting blood flow signals using a Doppler mode to generate and display a Doppler image, wherein when the display processing unit uses the Doppler display mode while information indicating the position of the vascular region is displayed on the display screen, the display processing unit displays the Doppler image without displaying the information indicating the position of the vascular region, and does not display the warning on the display screen.

[0023] (15) The ultrasound diagnostic device described in (1), wherein when a puncture needle is detected while information indicating the position of the vascular region is displayed on the display screen, the information indicating the position of the vascular region is not displayed and an ultrasound image is displayed.

[0024] (16) An ultrasound diagnostic program for causing a computer to execute the steps of superimposing information indicating the position of a vascular region recognized on an ultrasound image using a trained model on the ultrasound image, and the steps of preventing punctures from being performed while the information indicating the position of the vascular region is displayed.

[0025] (17) An ultrasound diagnostic method including the steps of: superimposing information indicating the position of a vascular region recognized on an ultrasound image using a trained model on the ultrasound image; and preventing puncture from being performed while the information indicating the position of the vascular region is displayed. [Effects of the Invention]

[0026] According to the present invention, when vascular region annotations are displayed using AI technology, tissues other than the annotated vascular region can also be displayed with high visibility. [Brief explanation of the drawings]

[0027] [Figure 1] 1 is a block diagram showing the configuration of an ultrasound diagnostic apparatus according to an embodiment; [Figure 2] FIG. 4 is a diagram illustrating a display example of a display unit. [Figure 3] 10A and 10B are diagrams illustrating an example of a display in which information indicating the position of a blood vessel region is superimposed and displayed. [Figure 4] 10 is a flowchart illustrating an operation when information indicating the position of a blood vessel region is superimposed and displayed. [Figure 5] FIG. 10 is a diagram showing an example of a display when the user taps the operation instruction button for the puncture mode while information indicating the position of a blood vessel region is superimposed on a B-mode image. [Figure 6] 10 is a flowchart of a process for hiding information indicating the position of a blood vessel region upon detection of a tap operation on an operation instruction button for the puncture mode. [Figure 7] FIG. 10 is a diagram showing the display unit with the operation instruction button for the blood vessel display mode inactivated. [Figure 8] 8 is a flowchart illustrating the display process of FIG. 7 of the ultrasonic diagnostic device. [Figure 9] FIG. 10 is a diagram showing an example in which a B-mode image in which a puncture needle is highlighted and a B-mode image in which information indicating the position of a blood vessel region is superimposed are displayed side by side on the same screen in the puncture mode. [Figure 10] 10 is a flowchart illustrating the display process of FIG. 9 of the ultrasonic diagnostic device. [Figure 11] FIG. 10 is a diagram showing a display example when the blood vessel display mode is operated during display in the Doppler display mode. [Figure 12] 12 is a flowchart illustrating the display process of the ultrasonic diagnostic device shown in FIG. 11. [Figure 13] 10A and 10B are diagrams showing other display examples when the blood vessel display mode is operated during display in the Doppler display mode. [Figure 14] 14 is a flowchart illustrating the display process of the ultrasonic diagnostic apparatus shown in FIG. 13. [Figure 15] 10A and 10B are diagrams illustrating display control when an instruction to operate the Doppler display mode is given during display in the blood vessel display mode. [Figure 16] 16 is a flowchart illustrating the display process of FIG. 15 of the ultrasonic diagnostic apparatus. [Figure 17] 10A and 10B are diagrams illustrating another example of display when an operation instruction for the Doppler display mode is given during display in the blood vessel display mode. [Figure 18]18 is a flowchart illustrating the display process of FIG. 17 of the ultrasonic diagnostic apparatus. DETAILED DESCRIPTION OF THE INVENTION

[0028] An ultrasound diagnostic device according to an embodiment displays information indicating the position of a vascular region recognized from a B-mode (brightness) image of an ultrasound echo of a subject using a trained machine learning or deep learning AI model, superimposed on the display screen of the B-mode image. The ultrasound diagnostic device also includes a function to prevent punctures from being performed in this display state. This allows for highly visible display of tissues other than the annotated vascular region when annotating the vascular region using AI technology. Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0029] FIG. 1 is a block diagram showing the configuration of an ultrasonic diagnostic apparatus 1 according to an embodiment. The ultrasonic diagnostic device 1 is configured by connecting an ultrasonic probe 101 to a main body 100 via a cable.

[0030] The main body 100 of the ultrasound diagnostic device 1 includes an operation unit 2, a transmission unit 3, a reception unit 4, a B-mode image generation unit 5, a ROI (Region Of Interest) setting unit 6, a Doppler mode image generation unit 7, a display processing unit 8, a control unit 9, a memory unit 10, a display unit 11, and a vascular region recognition unit 12.

[0031] The ultrasonic probe 101 has a plurality of transducers (piezoelectric conversion elements) 101a arranged in a one-dimensional direction. A drive signal is applied to each of the transducers 101a from the transmitting unit 3 (described later), and the transducers 101a generate ultrasonic waves, and the plurality of ultrasonic waves interfere with each other to generate an ultrasonic beam. The ultrasonic beam is irradiated onto the subject. The plurality of transducers 101a then receive reflected waves (echoes) of the ultrasonic waves from inside the subject, convert them into electrical signals, and output them to the receiving unit 4 (described later).

[0032] The operation unit 2 is a display instruction means, such as a touch panel 21, that detects an operation instruction from the user and notifies the control unit 9 of a mode command based on the operation instruction from the user. For example, the operation unit 2 notifies the control unit 9 of which mode to execute, a mode for displaying a B-mode image or a mode for displaying a Doppler mode image superimposed on a B-mode image, based on the operation instruction from the user. A B-mode image is an ultrasound image in which the amplitude of reflected ultrasound waves (echoes) is represented by brightness (luminance), and a Doppler mode image is a color flow mode image.

[0033] The operation unit 2 also includes a function of accepting a user's input specifying the position of an ROI on a B-mode image where a Doppler mode image is to be displayed.

[0034] Here, Doppler mode images include V mode, which displays the blood flow velocity and direction in color using blood flow velocity V as a blood flow signal indicating the state of blood flow; P mode, which displays the power of blood flow in color using blood flow power P as a blood flow signal; and VT mode, which displays the blood flow velocity and variance in color using blood flow velocity V and variance T as a blood flow signal.

[0035] When the operation unit 2 detects a user's operation instruction for Doppler mode image display, it also detects an instruction for the above-mentioned display mode. Display modes for Doppler mode image display may include T (dispersion) mode, dP (directional power) mode, etc. Thus, display modes for Doppler mode image display include color Doppler mode (V mode, VT mode, etc.) and power Doppler mode (P mode, etc.).

[0036] Furthermore, the operation unit 2 detects a user operation instruction for a puncture mode in which the puncture needle inserted with the aid of the puncture adapter or guide is highlighted in the B-mode image, and notifies the control unit 9 of the mode command.

[0037] The operation unit 2 also detects a user operation instruction for a blood vessel display mode in which information indicating the position of a blood vessel region recognized from a B-mode image of an ultrasound echo of the subject using a trained AI model of machine learning or deep learning is superimposed on the display screen of the B-mode image.The operation unit 2 then notifies the control unit 9 of a blood vessel display mode command as the user operation instruction.

[0038] More specifically, the display processing unit 8 displays instruction buttons on the display unit 11 that displays a B-mode image or the like, which will be described later. The operation unit 2 detects a tap operation on the instruction button using the touch panel 21, and regards this as an operation instruction from the user. It goes without saying that the detection of the operation instruction from the user is not limited to the touch panel 21, and other detection means may also be used.

[0039] The transmitter 3 transmits a high-voltage drive signal at a predetermined timing to the transducer 101a of the ultrasonic probe 101 in order to irradiate the subject with an ultrasonic beam.

[0040] When displaying a color Doppler image, the transmitter 3 performs transmission processing for Doppler mode to display a blood flow image in addition to transmission processing for displaying a B-mode image under the control of the controller 9. In this case, the transmitter 3 alternately performs, for example, B-mode scanning and Doppler mode scanning.

[0041] In Doppler mode scanning, an ultrasonic beam is repeatedly transmitted n times in the same direction (same line), and the ultrasonic beam is transmitted in all directions (all lines) of the ROI set by the ROI setting unit 6. n is a dozen or so, for example, 16, and this number of repetitions is called the ensemble number. In addition, the transmitting unit 3 specifies additional information for transmission processing for B-mode images or transmission processing for Doppler mode images during transmission processing, and supplies this additional information to the receiving unit 4.

[0042] The receiving unit 4 amplifies and A / D converts the analog electrical signal converted based on the reflected wave (echo) of the ultrasonic wave received by the ultrasonic probe 101, and generates a digital received signal by performing phasing addition.

[0043] The receiving unit 4 also acquires additional information from the transmitting unit 3, and if the acquired additional information is additional information for a B-mode image, it supplies the received signal to the B-mode image generating unit 5. If the acquired additional information is additional information for a Doppler mode image, it supplies the received signal to the Doppler mode image generating unit 7. Hereinafter, a received signal for generating a B-mode image will be referred to as a "B-mode received signal," and a received signal for generating a Doppler mode image will be referred to as a "Doppler mode received signal."

[0044] Under the control of the control unit 9, the B-mode image generation unit 5 performs envelope detection, logarithmic compression, etc. on the B-mode received signal input from the receiving unit 4, adjusts the dynamic range and gain, and performs brightness conversion to generate B-mode image data, which is output to the display processing unit 8.

[0045] Under the control of the control unit 9, the ROI setting unit 6 sets a region of interest (ROI) of the Doppler mode image in the transmission unit 3 and the display processing unit 8 according to ROI designation information input by the user via the operation unit 2.

[0046] Under the control of the control unit 9 , the Doppler mode image generating unit 7 generates Doppler mode image data in response to the Doppler mode reception signal input from the receiving unit 4 , and outputs the data to the display processing unit 8 .

[0047] The display processing unit 8 performs processing to display on the display unit 11 the Doppler mode image data and information indicating the position of the blood vessel region superimposed on the B mode image data. In the B-mode image display mode, the display processing unit 8 displays the B-mode image generated by the B-mode image generating unit 5 on the display unit 11.

[0048] In addition, in the Doppler mode image display mode, the display processing unit 8 superimposes the Doppler mode image generated by the Doppler mode image generation unit 7 at the position of the ROI selected on the B mode image generated by the B mode image generation unit 5 using the overlay display unit 81 and displays it on the display unit 11.

[0049] The warning processing unit 82 is a processing unit for displaying warning information on the display unit 11 to prevent puncture from being performed in a state where information indicating the position of a blood vessel region is displayed superimposed on the display screen of a B-mode image. Details will be described later. It should be noted that the warning processing unit 82 is not limited to displaying warning information, and may instead issue a warning regarding puncturing by voice, for example, and is not limited thereto.

[0050] The control unit 9 sets the operation details of each processing unit of the main body 100 and controls the overall operation of the main body 100. In particular, the mode selection means 91 of the control unit 9 controls the display processing unit 8 to display setting buttons for display modes and operation types on the display unit 11. For example, the setting buttons are a button for setting a Doppler image display mode in which a blood flow signal is detected using a Doppler mode to generate and display a Doppler image, and a button for setting a puncture mode in which the puncture needle is highlighted on a B-mode image to assist puncture. Another setting button is a button for setting a vascular region display mode in which information indicating the position of a vascular region is overlaid on a B-mode image.

[0051] Then, the operation unit 2 detects a tap by the user on a setting button displayed on the display unit 11 using the touch panel 21 provided on the display unit 11, and notifies the mode selection means 91 of the user's operation instruction corresponding to the setting button. The mode selection means 91 sets the operation content of each processing unit in accordance with the notified user's operation instruction, such as Doppler image display, puncture mode, or vascular region display mode.

[0052] In the above, it has been explained that the operation unit 2 detects when the user taps on a setting button for a display mode or an operation type displayed on the display unit 11, but it is also possible to provide a physical operation switch corresponding to the setting button displayed on the display unit 11, and have the operation unit 2 detect the switch operation by the user.

[0053] The storage unit 10 stores ultrasound image data, a gain matrix, a frame rate, etc. The ultrasound image data includes B-mode image data, Doppler mode image data, composite image data, etc.

[0054] The display unit 11 is a so-called monitor display such as an LCD (Liquid Crystal Display) or an EL (Electro Luminescence) display that displays the display image data output from the display processing unit 8. A transparent touch panel 21 is superimposed on the display surface of the display unit 11 so that a user's tapping action on a setting button can be detected. Note that instead of the user's tapping action on the setting button, the user may issue an operation instruction by clicking the setting button with a mouse, for example.

[0055] The vascular region recognition unit 12 is a processing unit that recognizes (determines) a vascular region in a B-mode image generated by the B-mode image generation unit 5 when the vascular region display mode is set, using a trained model in which, for example, a convolutional neural network is trained using training data.

[0056] The vascular region recognized by the trained model is notified to the display processing unit 8 as information indicating the position of the vascular region. The information indicating the position of the vascular region is, for example, a contour figure of the vascular region or a figure inside the contour filled in a predetermined color (for example, red), and includes position information in the B-mode image. The information indicating the position of the vascular region may also be information on the coordinate position of a pixel determined to be a vascular region in the B-mode image. The display processing unit 8 superimposes the information indicating the position of the vascular region notified to the vascular region recognition unit 12 on the B-mode image using the overlay display unit 81.

[0057] More specifically, the main body 100 of the ultrasound diagnostic apparatus 1 of the embodiment is realized by an information processing device (computer) that is configured with a large-capacity recording medium such as a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and HDD (Hard Disk Drive).

[0058] The CPU reads out a diagnostic program stored in the ROM or HDD, loads it into the RAM, and implements the functions of each part of the main body 100 in accordance with the loaded program. The RAM forms a work area for temporarily storing various programs executed by the CPU and data related to these programs. The ultrasound diagnostic program may be stored in the form of computer-readable program code and supplied from a recording medium, or may be transmitted and supplied via a network.

[0059] 1 shows an example in which the ultrasonic diagnostic device 1 of the embodiment is configured from a main body 100 provided with a display unit 11 that displays reflected waves (echoes) of ultrasonic waves, and an ultrasonic probe 101. However, the present invention is not limited to this, and each processing unit of the main body 100 may be provided on a network as an ultrasonic diagnostic device, and the ultrasonic probe 101 and the display unit 11 may be connected to the ultrasonic diagnostic device via the network.

[0060] FIG. 2 is a diagram showing an example of a display on the display unit 11. As shown in FIG. 2 displays display image data in which vascular region information 112 indicating the position of a vascular region is superimposed on a B-mode image 111. The vascular region information 112 is displayed as a contour figure of the vascular region or a figure in which the inside of the contour is filled in a predetermined color. The predetermined color is, for example, red.

[0061] Furthermore, the display unit 11 displays buttons that the user taps to instruct or set the operation of the ultrasound diagnostic apparatus 1 as the operation unit 2. The B button 113 is a button for setting the display mode of the B-mode image. The Doppler button 114 is a button for setting the Doppler display mode in which a color Doppler mode image is superimposed on a B-mode image.

[0062] Furthermore, the blood vessel button 116 is a button for instructing a blood vessel display mode in which information indicating the position of a blood vessel region recognized from a B-mode image is superimposed on the B-mode image. The puncture button 115 is a button for instructing a puncture mode display in which the puncture needle is highlighted. In other words, the blood vessel button 116 is a display instruction means for displaying information indicating the position of a blood vessel region. Note that FIG. 2 shows only buttons related to the operation of the ultrasound diagnostic apparatus 1 of the embodiment described below, and other buttons are omitted.

[0063] Next, we will explain the operation when the user taps the blood vessel button 116, which is the operation instruction button for the blood vessel display mode, and the ultrasound diagnostic device 1 superimposes information indicating the position of the blood vessel region recognized from the B-mode image on the ultrasound image.

[0064] FIG. 3 is a diagram showing a display example in which information indicating the position of a blood vessel region is superimposed and displayed. The user taps the blood vessel button 116 to instruct the blood vessel display mode, and the ultrasound diagnostic device 1 detects the tap on the touch panel 21 of the operation unit 2. As a result, the display processing unit 8 superimposes blood vessel region information 112 on the B-mode image 111 and displays it on the display unit 11, as shown in FIG. 3. Furthermore, the ultrasound diagnostic device 1 displays a warning message 117 to prevent puncture while displaying the B-mode image 111. This warning regarding puncture may be, for example, "Please turn off the display of the blood vessel region when puncturing."

[0065] The operation of the ultrasound diagnostic device 1 will be described with reference to the flowchart in Figure 4. The flowchart in Figure 4 shows the processing of one frame of reflected ultrasound waves (echoes). Note that in Figure 4, an off-page connector symbol is shown at the beginning of step S41, which connects to the flowchart in Figure 10, which will be described later. As will be described in detail later, the same processing as in Figure 4 is performed during the processing in Figure 10.

[0066] In step S41, the B-mode image generating unit 5 generates B-mode image data based on the reflected waves (echoes) of the ultrasonic waves.

[0067] In step S42, the control unit 9 determines whether the blood vessel display mode is active based on the detection of a tap on the blood vessel button 116, which instructs the blood vessel display mode on the touch panel 21 of the operation unit 2. If the blood vessel display mode is active (Yes in step S42), the process proceeds to step S43. If the blood vessel display mode is not active (No in step S42), the process proceeds to step S47.

[0068] In step S43, the vascular region recognition unit 12 recognizes the vascular region in the B-mode image generated in step S41 using the trained model, and outputs the recognized vascular region to the display processing unit 8 as information indicating the position of the vascular region.

[0069] In step S44, the overlay display unit 81 of the display processing unit 8 superimposes information indicating the vascular region recognized by the trained model onto the B-mode image and displays it on the display unit 11.

[0070] In step S45, the warning processing unit 82 of the display processing unit 8 generates a warning message regarding the puncture.

[0071] In step S46, the display processing unit 8 displays the warning message generated in step S45 on the display unit 11, and the processing in FIG. 4 ends.

[0072] In step S47, the display processing unit 8 displays the B-mode image generated in step S41 on the display unit 11, and then ends the processing of FIG.

[0073] Next, we will explain the operation when the user taps the puncture button 115, which instructs the display of a puncture mode that highlights the puncture needle, while the ultrasound diagnostic device 1 is displaying vascular region information 112 superimposed on the B-mode image 111 on the display unit 11.

[0074] FIG. 5 is a diagram showing a display example in this case. When the ultrasonic diagnostic device 1 detects, via the touch panel 21 of the operation unit 2, a tap operation on the blood vessel button 116 by the user to instruct the blood vessel display mode displayed on the display unit 11, the ultrasonic diagnostic device 1 superimposes blood vessel region information 112 on the B-mode image 111 and displays it on the display unit 11. Thereafter, when the ultrasonic diagnostic device 1 detects a tap operation on the puncture button 115 by the user to instruct the display unit 11 to display a puncture mode in which the puncture needle is highlighted, the ultrasonic diagnostic device 1 hides the blood vessel region information 112. The ultrasonic diagnostic device 1 also hides the warning message regarding puncture.

[0075] This causes the vascular region information 112 to disappear, allowing tissues other than the annotated vascular region to be displayed with high visibility. In other words, when highlighting blood vessels is used during puncture, there is a risk of misidentifying the vascular region due to erroneous highlighting, or of reduced visibility of the B-mode image due to the superimposed display of the vascular region, but this can be avoided.

[0076] FIG. 6 is a flowchart of the process of hiding the vascular region information 112 upon detection of a tap operation on the puncture button 115 that instructs the display of the puncture mode described in FIG. 6 is a flowchart illustrating the operation when information indicating the position of a blood vessel region is superimposed on a B-mode image, and the processing of steps S61 to S63 has been added. Here, the processing of the added steps S61 to S63 will be described.

[0077] In step S61, control unit 9 determines whether the mode is the puncture mode based on detection of a tap operation on puncture button 115, which instructs mode selection means 91 to display the puncture mode. If the mode is the puncture mode (No in step S61), the process proceeds to step S43. If the mode is not the puncture mode (Yes in step S61), the process proceeds to step S62.

[0078] In step S62, the control unit 9 controls the vascular region recognition unit 12 to stop the recognition process of the vascular region, and controls the warning processing unit 82 to stop the generation process of the warning message regarding the puncture.

[0079] In step S63, the display processing unit 8 deactivates the blood vessel button 116 that instructs the blood vessel display mode, thereby invalidating the operation instruction for the blood vessel display mode.

[0080] Then, in step S64, the B-mode image generation unit 5 sets the B-mode image to a puncture needle highlight display mode. After step S64, the process proceeds to step S47, where the B-mode image generation unit 5 generates a B-mode image in the puncture needle highlight display mode, and the display processing unit 8 displays this B-mode image on the display unit 11. At this time, information indicating the blood vessel region is not displayed.

[0081] The above describes the process in step S61 in which the control unit 9 determines whether or not there is an instruction to operate the puncture mode and stops the superimposed display of information indicating the vascular region. In relation to this, instead of determining whether or not there is an instruction to operate the puncture mode by detecting a tap operation on the puncture button 115 that instructs the display of the puncture mode, a puncture needle recognition process may be performed on the B-mode image. Then, when the puncture needle is detected, the display of the information indicating the position of the vascular region may be canceled. That is, when the puncture needle is detected while the information indicating the position of the vascular region is displayed on the display screen, the display of the information indicating the position of the vascular region is canceled.

[0082] The above describes the display of information indicating the position of a blood vessel region when an instruction to operate the puncture mode is given while information indicating the blood vessel region is being displayed. Next, we will describe the case where an instruction to operate the puncture mode is given when information indicating the blood vessel region is not being displayed.

[0083] 7 is a diagram showing a state in which the user taps the puncture button 115, which instructs the display of the puncture mode, when only the B-mode image 111 is displayed on the display unit 11. In this case, the ultrasound diagnostic device 1 inactivates the blood vessel button 116, which instructs the blood vessel display mode, making it unselectable and invalidating the operation instruction for the blood vessel display mode.

[0084] FIG. 8 is a flowchart illustrating the processing of the ultrasonic diagnostic apparatus 1 in FIG. The flowchart in Fig. 8 is obtained by adding steps S81 to S84 to the flowchart illustrating the operation when information indicating the position of a blood vessel region is superimposed and displayed in Fig. 4. Here, the added steps S81 to S84 will be described.

[0085] In step S81, control unit 9 detects a tap operation on puncture button 115, which instructs mode selection means 91 to display the puncture mode, and determines whether the puncture mode is selected. If the puncture mode is selected (No in step S81), the process proceeds to step S41. If the puncture mode is not selected (Yes in step S81), the process proceeds to step S82.

[0086] In step S82, the control unit 9 deactivates the blood vessel button 116 for instructing the blood vessel display mode of the display unit 11, thereby invalidating the operation instruction for the blood vessel display mode.

[0087] In step S83, the B-mode image is set to a puncture needle highlight display mode, and the process proceeds to step S41 to generate a B-mode image.

[0088] In step S84, the B-mode image generating unit 5 generates a B-mode image based on the reflected waves (echoes) of the ultrasound, and the process proceeds to step S47. In step S47, the display processing unit 8 displays this B-mode image on the display unit 11.

[0089] As described above, when the puncture mode is selected, the control unit 9 disables the selection of the blood vessel button 116, which instructs the blood vessel display mode for displaying information indicating the position of the blood vessel region. As a result, the blood vessel region information 112 is not displayed, and the ultrasound diagnostic device 1 can also display tissues other than the annotated blood vessel region with high visibility.

[0090] The above describes an example in which the ultrasound diagnostic apparatus 1 does not superimpose information indicating the position of a blood vessel region on a B-mode image in the puncture mode. Next, another example of how the information indicating the position of a blood vessel region is handled in the puncture mode will be described with reference to FIG. 9.

[0091] 9 is a diagram showing an example in which the ultrasound diagnostic device 1 displays, side by side on the same screen, a B-mode image in which the puncture needle is highlighted and a B-mode image in which information indicating the position of a blood vessel region is superimposed. In this case, unlike FIG. 7, it is possible to display information indicating the position of a blood vessel region in the blood vessel display mode even in the puncture mode.

[0092] In more detail, when the user taps on the puncture button 115 to instruct the display of the puncture mode while only the B-mode image 111 is displayed on the display unit 11, the ultrasound diagnostic device 1 displays the B-mode image 111 in the puncture mode. Then, when the ultrasound diagnostic device 1 detects the user tapping on the blood vessel button 116 to instruct the blood vessel display mode, the ultrasound diagnostic device 1 displays the B-mode image 111 with the puncture needle highlighted and the B-mode image 111 with the blood vessel region information 112 superimposed on it side by side on the same screen. This makes it possible to display tissues other than the annotated blood vessel region with high visibility when annotating a blood vessel region using AI.

[0093] FIG. 10 is a flowchart illustrating the processing of the ultrasonic diagnostic apparatus 1 in FIG.

[0094] In step S101, control unit 9 determines whether the puncture mode is selected by determining whether mode selection unit 91 has detected a tap operation on puncture button 115, which commands the display of the puncture mode. If the puncture mode is not selected (No in step S101), the process proceeds to the process for the blood vessel display mode described in Figure 4. If the puncture mode is selected (Yes in step S101), the process proceeds to step S102.

[0095] In step S102, the control unit 9 sets the B-mode image to a puncture needle highlight display mode. In step S103, the B-mode image generating unit 5 generates a B-mode image in which the puncture needle is highlighted.

[0096] In step S105, the control unit 9 determines whether the blood vessel display mode is selected based on the detection of a tap on the blood vessel button 116, which indicates the blood vessel display mode, on the touch panel 21 of the operation unit 2. If the blood vessel display mode is selected (Yes in step S105), the process proceeds to step S106. If the blood vessel display mode is not selected (No in step S105), the process proceeds to step S109.

[0097] In step S106, the vascular region recognition unit 12 recognizes (determines) the vascular region in the B-mode image generated in step S103 using the trained model, and outputs the recognized vascular region to the display processing unit 8 as information indicating the position of the vascular region.

[0098] In step S107, the overlay display unit 81 of the display processing unit 8 displays the information indicating the vascular region notified in step S106 on one side of the display unit 11, superimposed on the B-mode image.

[0099] In step S108, the display processing unit 8 displays the puncture-enhanced B-mode image generated in step S104 in parallel on the other side of the display unit 11, and the process ends.

[0100] In step S109, the display processing unit 8 displays the puncture-enhanced B-mode image generated in step S104 on the display unit 11, and the process ends.

[0101] In the above, the puncture mode was described as highlighting the puncture needle inserted with the aid of a puncture adapter or guide in a B-mode image. Alternatively, the puncture mode may be a puncture guide display mode that displays a puncture needle guide in a B-mode image, and similar processing may be performed. Since the puncture needle guide display is not obstructed by information indicating a blood vessel region and visibility is not reduced, tissues other than the annotated blood vessel region can also be displayed with high visibility.

[0102] The above describes the operation of the display processing unit 8 during puncture treatment in a combination of the blood vessel display mode and the puncture mode. The display modes related to blood vessels in the ultrasound diagnostic device 1 include a Doppler display mode in which a blood flow signal is detected using the Doppler mode to generate a Doppler image 118 and display it superimposed on the B-mode image 111. The following describes the operation of the display processing unit 8 during puncture treatment in the blood vessel display mode and the Doppler display mode.

[0103] Specifically, the Doppler display mode is a technique for detecting blood flow signals using a Doppler mode (color, power, etc.) to visualize the blood flow. The ultrasound diagnostic device 1 displays the velocity of the blood flow using the color Doppler mode, and the strength of the blood flow using the power Doppler mode. These Doppler images allow the user to understand the state of the blood flow, such as the direction, velocity, and strength of the blood flow.

[0104] There may be discrepancies between the blood flow image displayed in the Doppler display mode and the information indicating the position of the vascular region displayed in the vascular display mode. For this reason, the ultrasound diagnostic device 1 performs the display control described below, so that tissues other than the annotated vascular region can also be displayed with high visibility.

[0105] 11 is a diagram showing a display example in which the user taps the blood vessel button 116 to instruct the blood vessel display mode while the ultrasound diagnostic device 1 is displaying a Doppler display mode in which a Doppler image 118 is superimposed on a B-mode image 111. The Doppler display mode is assumed to be activated in response to the user tapping the Doppler button 114 to set the Doppler display mode.

[0106] When the user taps the blood vessel button 116 to instruct the blood vessel display mode and the operation unit 2 detects the tap via the touch panel 21, the ultrasound diagnostic device 1 superimposes blood vessel region information 112 on the B-mode image 111 and displays a warning message 117a to prevent puncture on the display unit 11. For example, this warning regarding puncture may read, "The Doppler mode and the blood vessel display mode may not match."

[0107] Fig. 12 is a flowchart explaining the processing of the ultrasound diagnostic apparatus 1 in Fig. 11. The flowchart in Fig. 12 shows the processing of one frame of reflected ultrasound waves (echoes) after the Doppler display mode is activated in response to a user tapping the Doppler button 114 that sets the Doppler display mode.

[0108] In step S121, the B-mode image generating unit 5 generates data of the B-mode image 111 based on the reflected waves (echoes) of the ultrasonic waves.

[0109] In step S122, the Doppler mode image generating unit 7 generates Doppler mode image data as the Doppler image 118 based on the reflected waves (echoes) of the ultrasound.

[0110] In step S123, the control unit 9 determines whether or not an operation instruction for the blood vessel display mode has been made by determining whether or not a tap operation on the blood vessel button 116, which instructs the blood vessel display mode, has been detected by the mode selection means 91. If no operation instruction has been made (No in S123), the process proceeds to step S128, and if an operation instruction has been made (Yes in S123), the process proceeds to step S124.

[0111] In step S124, the vascular region recognition unit 12 recognizes (determines) the vascular region in the B-mode image generated in step S121 using the trained model, and notifies the display processing unit 8 of the recognized vascular region as vascular region information 112.

[0112] In step S125, the overlay display unit 81 of the display processing unit 8 superimposes the vascular region information 112 notified in step S124 and the Doppler mode image (Doppler image 118) generated in step S122 on the B-mode image generated in step S121, and displays the result on the display unit 11.

[0113] In step S126, the warning processing unit 82 of the display processing unit 8 generates a warning message regarding the puncture.

[0114] In step S127, the display processing unit 8 displays the warning message generated in step S126 on the display unit 11, and the process ends.

[0115] In step S128, the B-mode image generated in step S121 and the Doppler mode image (Doppler image 118) generated in step S122 are superimposed and displayed on the display unit 11, and the process ends.

[0116] Next, another display example when the user taps the blood vessel button 116 to instruct the blood vessel display mode while the Doppler display mode is displayed will be described with reference to Fig. 13. In Fig. 13, as in Fig. 11, it is assumed that the Doppler display mode is activated in response to the user tapping the Doppler button 114 that sets the Doppler display mode.

[0117] Even if the user taps the blood vessel button 116 to instruct the blood vessel display mode and the operation unit 2 of the ultrasound diagnostic device 1 detects the tap via the touch panel 21, the blood vessel region information 112 is not superimposed on the B-mode image 111. Furthermore, the ultrasound diagnostic device 1 does not display a warning message 117 to prevent puncture. In other words, the ultrasound diagnostic device 1 disables the function of the blood vessel display mode that superimposes and displays the blood vessel region information 112 on the B-mode image 111 while the Doppler display mode is being displayed.

[0118] Fig. 14 is a flowchart for explaining the processing of the ultrasound diagnostic apparatus 1 in Fig. 13. The flowchart in Fig. 14 shows the processing of one frame of reflected ultrasound waves (echoes) after the Doppler display mode is activated in response to the user tapping the Doppler button 114 that sets the Doppler display mode.

[0119] In step S141, the B-mode image generating unit 5 generates a B-mode image 111 based on the reflected waves (echoes) of the ultrasonic waves.

[0120] In step S142, the Doppler mode image generating unit 7 generates a Doppler mode image as the Doppler image 118 based on the reflected waves (echoes) of the ultrasound.

[0121] In step S143, the control unit 9 determines whether or not the blood vessel display mode is selected based on the detection of a tap on the blood vessel button 116, which indicates the blood vessel display mode by the user, via the operation unit 2. If the blood vessel display mode is selected (No in step S143), the process proceeds to step S145. If the blood vessel display mode is not selected (Yes in step S143), the process proceeds to step S144.

[0122] In step S144, the vascular region recognition unit 12 recognizes (determines) the vascular region in the B-mode image generated in step S41 using the trained model, and notifies the display processing unit 8 of the recognized vascular region as vascular region information 112.

[0123] In step S145, the Doppler mode image (Doppler image 118) generated in step S122 is superimposed on the B mode image generated in step S121, and the image is displayed on the display unit 11, and the process ends.

[0124] In the above, even if the vascular region information 112 is obtained in response to an operation instruction for the vascular display mode, it is not superimposed on the B-mode image 111 and no warning is displayed. However, the vascular button 116 that instructs the vascular display mode may be inactivated so that the user cannot issue an operation instruction.

[0125] 11 to 14, the display control when an instruction to operate the blood vessel display mode is given while the Doppler display mode is being displayed has been explained. Next, the display control when an instruction to operate the Doppler display mode is given while the blood vessel display mode is being displayed will be explained.

[0126] 15 is a diagram showing a display example when the Doppler button 114 for setting the Doppler display mode is tapped while the ultrasound diagnostic device 1 is displaying the blood vessel display mode in which blood vessel region information 112 is superimposed on a B-mode image 111. The blood vessel display mode is assumed to be activated in response to a tap on the blood vessel button 116 that instructs the blood vessel display mode.

[0127] When the user taps the Doppler button 114 to set the Doppler display mode and the operation unit 2 detects the tap via the touch panel 21, the ultrasound diagnostic device 1 displays a display image of an ultrasound echo in which a Doppler image 118 is added and superimposed on a B-mode image 111. Furthermore, while displaying the display image, the ultrasound diagnostic device 1 displays a warning message 117a to prevent puncture. This warning regarding puncture may be, for example, "The Doppler mode and the blood vessel display mode may not match."

[0128] FIG. 16 is a flowchart illustrating the processing of the ultrasonic diagnostic apparatus 1 in FIG. In step S161, the B-mode image generating unit 5 generates a B-mode image 111 based on the reflected waves (echoes) of the ultrasonic waves.

[0129] In step S162, the vascular region recognition unit 12 recognizes (determines) the vascular region in the B-mode image generated in step S161 using the trained model, and notifies the display processing unit 8 of the recognized vascular region as vascular region information 112.

[0130] In step S163, the control unit 9 determines whether or not the Doppler display mode is selected based on the detection of a tap on the Doppler button 114 that sets the Doppler display mode on the touch panel 21 of the operation unit 2. If the Doppler display mode is not selected (No in step S163), the process proceeds to step S168, and if the Doppler display mode is selected (Yes in step S163), the process proceeds to step S164.

[0131] In step S164, the Doppler mode image generating unit 7 generates a Doppler mode image as the Doppler image 118 based on the reflected waves (echoes) of the ultrasound.

[0132] In step S165, the overlay display unit 81 of the display processing unit 8 superimposes the vascular region information 112 notified in step S162 and the Doppler mode image (Doppler image 118) generated in step S164 on the B-mode image generated in step S161, and displays the result on the display unit 11.

[0133] In step S166, the warning processing unit 82 of the display processing unit 8 generates a warning message 117 regarding puncturing. In step S167, the display processing unit 8 displays the warning message 117 generated in step S166 on the display unit 11, and the process ends.

[0134] In step S168, the B-mode image generated in step S161 and the Doppler mode image (Doppler image 118) generated in step S164 are superimposed and displayed on the display unit 11, and the process ends.

[0135] Next, another display example when the user taps the Doppler button 114 to set the Doppler display mode while the blood vessel display mode is displayed will be described with reference to Fig. 17. In Fig. 17, similar to Fig. 15, it is assumed that the blood vessel display mode is activated in response to the user tapping the blood vessel button 116 that indicates the blood vessel display mode.

[0136] When the user taps the Doppler button 114 to set the Doppler display mode and the operation unit 2 detects the tap via the touch panel 21, the ultrasound diagnostic device 1 hides the vascular region information 112 that has been superimposed on the B-mode image 111. If a warning message regarding puncture has been displayed, the ultrasound diagnostic device 1 hides the warning message. Then, the ultrasound diagnostic device 1 displays a display image of the ultrasound echo in which the Doppler image 118 is superimposed on the B-mode image 111. In other words, the ultrasound diagnostic device 1 stops the vascular display mode and switches to the Doppler display mode.

[0137] FIG. 18 is a flowchart illustrating the processing of the ultrasonic diagnostic apparatus 1 in FIG.

[0138] In step S181, the B-mode image generating unit 5 generates a B-mode image 111 based on the reflected waves (echoes) of the ultrasonic waves.

[0139] In step S182, the vascular region recognition unit 12 recognizes (determines) the vascular region in the B-mode image generated in step S181 using the trained model, and notifies the display processing unit 8 of the recognized vascular region as vascular region information 112.

[0140] In step S183, the display processing unit 8 determines whether or not the Doppler display mode is selected based on the detection of a tap on the Doppler button 114 that sets the Doppler display mode on the touch panel 21 of the operation unit 2. If the Doppler display mode is selected (No in step S183), the process proceeds to step S184. If the Doppler display mode is not selected (Yes in step S183), the process proceeds to step S185.

[0141] In step S184, the overlay display unit 81 of the display processing unit 8 superimposes the B-mode image generated in step S181 on the information indicating the vascular region notified in step S182, and displays them on the display unit 11, thereby completing the processing of Figure 18.

[0142] In step S185, in order to hide the vascular region information 112, the information indicating the position of the vascular region notified in step S182 is erased.

[0143] In step S186, the Doppler mode image generating unit 7 generates a Doppler mode image as the Doppler image 118 based on the reflected waves (echoes) of the ultrasound.

[0144] In step S187, the overlay display unit 81 of the display processing unit 8 superimposes the Doppler mode image (Doppler image 118) generated in step S186 on the B-mode image generated in step S181, displays it on the display unit 11, and the processing of Figure 18 is terminated.

[0145] The present invention is not limited to the above-described examples, and includes various modifications. The above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. [Explanation of symbols]

[0146] 1. Ultrasound diagnostic equipment 2 Operation unit (display instruction means) 3. Transmitter 4. Receiving section 5 B-mode image generation unit 6 ROI setting section 7 Doppler mode image generation unit 8 Display processing section 81 Overlay display section 82 Warning processing section 9 Control Unit 91 Mode selection means 10 Storage section 11 Display section 12 Blood vessel region recognition unit 100 units 101 Ultrasonic probe

Claims

1. An ultrasound diagnostic device equipped with a function to prevent punctures from being performed while information indicating the position of a blood vessel region recognized using a trained model is displayed on the display screen.

2. 2. The ultrasound diagnostic device according to claim 1, further comprising a notification unit that issues a warning regarding puncture when information indicating the position of the vascular region is displayed on the display screen superimposed on the ultrasound image, and the prevention function is realized by the notification unit.

3. The ultrasonic diagnostic apparatus according to claim 2 , wherein the notification unit is a display processing unit that displays a warning regarding puncture on the display screen.

4. The ultrasound diagnostic device according to claim 3 , wherein the warning is a warning to prevent puncture while displaying information indicating the position of the blood vessel region superimposed on the ultrasound image.

5. a display instruction means for displaying information indicating the position of the blood vessel region superimposed on the ultrasound image, The ultrasonic diagnostic apparatus according to claim 3 , wherein the display processing unit displays the warning on the display unit when the display instruction means is selected.

6. a selection means for selecting a puncture mode for puncturing; a display processing unit that selectively displays information indicating the position of the blood vessel region on the display screen by superimposing the information on the ultrasound image; 4. The ultrasound diagnostic apparatus according to claim 3, wherein, when the puncture mode is selected, the display processing unit displays the ultrasound image in a state where information indicating the position of the blood vessel region is not displayed, thereby realizing the prevention function.

7. a selection means for selecting a puncture mode for puncturing; a display processing unit that displays information indicating the position of the blood vessel region on the display screen; a control unit that receives display instruction information that instructs the display processing unit to display information; 2. The ultrasound diagnostic apparatus according to claim 1, wherein the control unit embodies the prevention function by disabling display of a display instruction unit for displaying information indicating the position of the blood vessel region when the puncture mode is selected.

8. a selection means for selecting a puncture mode for puncturing; a display processing unit that displays information indicating the position of the blood vessel region on the display screen; a control unit that receives display instruction information that instructs the display processing unit to display information; 2. The ultrasound diagnostic apparatus according to claim 1, wherein the control unit embodies the prevention function by disabling acceptance of a display instruction means for displaying information indicating the position of the blood vessel region when the puncture mode is selected.

9. a selection means for selecting a puncture mode for puncturing; a display processing unit that selectively displays information indicating the position of the blood vessel region on the display screen; 3. The ultrasound diagnostic apparatus according to claim 2, wherein, when the puncture mode is selected, the display processing unit embodies the prevention function by displaying, on the same screen, a B-mode image without information showing the position of the vascular region and a B-mode image with information showing the position of the vascular region.

10. The ultrasound diagnostic apparatus according to claim 7 , wherein the puncture mode is a puncture needle enhancement mode or a puncture guide display mode.

11. a Doppler display mode in which a blood flow signal is detected using a Doppler mode to generate and display a Doppler image; The display processing unit 4. The ultrasound diagnostic apparatus according to claim 3, wherein, when the Doppler image is displayed on the display screen, information indicating the position of the blood vessel region is displayed on the display screen, and the warning is displayed on the display screen.

12. a Doppler display mode in which a blood flow signal is detected using a Doppler mode to generate and display a Doppler image; The display processing unit 4. The ultrasound diagnostic apparatus according to claim 3, wherein, when the Doppler image is displayed on the display screen, information indicating the position of the vascular region is not displayed on the display screen, and the warning is not displayed on the display screen.

13. a Doppler display mode in which a blood flow signal is detected using a Doppler mode to generate and display a Doppler image; The display processing unit 4. The ultrasound diagnostic apparatus according to claim 3, wherein, when the Doppler display mode is used while the information indicating the position of the vascular region is displayed on the display screen, the information indicating the position of the vascular region is displayed superimposed on the Doppler image, and the warning is displayed on the display screen.

14. a Doppler display mode in which a blood flow signal is detected using a Doppler mode to generate and display a Doppler image; The display processing unit 4. The ultrasound diagnostic apparatus according to claim 3, wherein, when the Doppler display mode is used while the information indicating the position of the vascular region is displayed on the display screen, the Doppler image is displayed without displaying the information indicating the position of the vascular region, and the warning is not displayed on the display screen.

15. 2. The ultrasound diagnostic device according to claim 1, wherein, when a puncture needle is detected while the information indicating the position of the blood vessel region is displayed on the display screen, the information indicating the position of the blood vessel region is not displayed and an ultrasound image is displayed.

16. On the computer, a step of superimposing information indicating the position of a blood vessel region recognized on an ultrasound image using the trained model on the ultrasound image; a step of preventing puncture from being performed while the information indicating the position of the blood vessel region is displayed; Ultrasound diagnostic program for executing the above.

17. a step of superimposing and displaying information indicating the position of a vascular region recognized on an ultrasound image using the trained model on the ultrasound image; a step of preventing puncture from being performed while the information indicating the position of the blood vessel region is displayed; An ultrasound diagnostic method comprising:

Images