Ultrasonic diagnostic apparatus, ultrasonic diagnostic program, and ultrasonic diagnostic method

Abstract

To provide an ultrasonic diagnostic apparatus, an ultrasonic diagnostic program, and an ultrasonic diagnostic method capable of displaying tissues other than an annotated blood vessel region with high visibility when performing annotation display of the blood vessel region using artificial intelligence.SOLUTION: An ultrasonic diagnostic apparatus 1 includes a display unit 11 in which information indicating a position of a blood vessel region recognized by using a learned model is displayed, and operation means 2 for changing transmissivity of the information indicating the position of the blood vessel region. In more detail, the transmissivity can be changed by the operation means while a B mode image on which information indicating the position of the blood vessel region is superposed is displayed in real time.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an ultrasonic diagnostic apparatus, an ultrasonic diagnostic program, and an ultrasonic diagnostic method. [Background technology]

[0002] Medical diagnoses based on ultrasound images of organs and tissues in living bodies have been widely performed. Ultrasound diagnostic devices that generate these ultrasound images transmit ultrasound waves into living bodies, receive echoes reflected from the organs and tissues, and visualize them as cross-sectional images. In recent years, a technique has become known that uses artificial intelligence to annotate blood vessel regions shown on ultrasound images.

[0003] For example, as disclosed in Patent Document 1, a technology is known in which an ultrasound image generated by an ultrasound diagnostic device is analyzed and a recognized vascular region is highlighted and displayed. In detail, Patent Document 1 describes a method in which typical pattern data of a vascular region is stored in advance as a template, and the ultrasound image is searched using the template to calculate the similarity to the pattern data. The location where the similarity is equal to or greater than a threshold and is at its maximum is considered to be the location where the vascular region exists. Furthermore, Patent Document 1 also describes that the similarity can be calculated using general image recognition methods using machine learning or deep learning, in addition to template matching.

[0004] In this specification, technologies such as machine learning and deep learning for recognizing vascular regions are collectively referred to as AI (Artificial Intelligence). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2023-026610 Summary of the Invention [Problem to be solved by the invention]

[0006] The above-mentioned prior art makes it easy to grasp blood vessel regions, which is useful when inserting an insert such as a puncture needle or catheter into a subject's blood vessel, i.e., when performing a procedure called puncture. However, there are cases where the artificial intelligence incorrectly recognizes blood vessel regions. Therefore, when blood vessels detected by artificial intelligence are annotated by superimposing a predetermined color, it may be difficult to see tissues other than the blood vessel region located near the annotated blood vessel region due to misrecognition, or structures with similar shapes on the image, such as nerves, may be annotated. Therefore, for example, when a medical professional punctures a patient while looking at an ultrasound image, there is a risk that the patient's nerve region may also be damaged.

[0007] An object of the present invention is to provide an ultrasound diagnostic device, an ultrasound diagnostic program, and an ultrasound diagnostic method that, when annotating and displaying a vascular region using artificial intelligence, can also display tissues other than the annotated vascular region with high visibility. [Means for solving the problem]

[0008] The above problem is solved as follows.

[0009] (1) An ultrasound diagnostic device comprising: a display unit that displays information indicating the position of a vascular region recognized using a trained model; and an operating means for changing the transparency of the information indicating the position of the vascular region.

[0010] (2) The ultrasound diagnostic apparatus according to (1), wherein the display unit includes the operation means on a display screen.

[0011] (3) The ultrasound diagnostic device according to (1), wherein the information indicating the position of the vascular region is semi-transparent color information superimposed on the ultrasound image.

[0012] (4) The ultrasound diagnostic device according to (1), wherein the transparency can be changed by the operating means during real-time display of a B-mode image on which information indicating the position of the vascular region is superimposed.

[0013] (5) The ultrasound diagnostic device described in (1), wherein the information indicating the position of the vascular region is color information in which the vascular region recognized using the trained model is painted in a predetermined color.

[0014] (6) The ultrasound diagnostic device described in (1), wherein the information indicating the position of the vascular region is color information that displays the boundary region of the vascular region recognized using the trained model in a frame shape.

[0015] (7) The ultrasound diagnostic device described in (1), wherein the display unit displays information indicating the position of the nerve area recognized using the trained model, and further includes an operating means for changing the transparency of the information indicating the position of the nerve area.

[0016] (8) The ultrasound diagnostic device described in (1), wherein the display unit simultaneously displays information indicating the position of the nerve region recognized using a trained model and information indicating the position of the vascular region, and the transparency of the information indicating the position of the vascular region and the transparency of the information indicating the position of the nerve region can be changed independently.

[0017] (9) The ultrasound diagnostic device described in (8), wherein the display unit simultaneously displays information indicating the position of the nerve region recognized using a trained model and information indicating the position of the vascular region, and further includes a first operating means that enables the transparency of the information indicating the position of the vascular region to be changed, and a second operating means that enables the transparency of the information indicating the position of the nerve region to be changed.

[0018] (10) The ultrasound diagnostic device described in (1), wherein the display unit simultaneously displays information indicating the position of the nerve region recognized using a trained model and information indicating the position of the vascular region, and further includes an operating means that enables the transparency of the information indicating the position of the vascular region to be changed and the transparency of the information indicating the position of the nerve region to be changed.

[0019] (11) The ultrasound diagnostic device according to (7), which displays either the information indicating the position of the blood vessel region or the information indicating the position of the nerve region with priority.

[0020] (12) The ultrasound diagnostic device described in (1), wherein the display unit is capable of simultaneously displaying information indicating the position of the muscle tissue region recognized by the trained model, information indicating the position of the nerve region recognized by the trained model, and information indicating the position of the vascular region.

[0021] (13) The ultrasound diagnostic device according to (12), wherein the transparency of the information indicating the position of the muscle tissue region is changeable.

[0022] (14) The ultrasound diagnostic device according to (1), further comprising a control unit that, when the transmittance is set to a predetermined threshold or higher and an end instruction is given, detects the end instruction and controls to change the transmittance to a value equal to or lower than the predetermined threshold.

[0023] (15) The ultrasound diagnostic device according to (1), further comprising a notification unit that notifies when the transmittance is set to a predetermined threshold or higher.

[0024] (16) The ultrasonic diagnostic device according to (1), further comprising a setting unit that sets the maximum value of the transmittance setting range to a predetermined threshold or less.

[0025] (17) The ultrasound diagnostic device according to claim 1, wherein the color whose transparency can be changed is displayed at a transparency equal to or lower than a predetermined threshold when displaying information indicating the position of the blood vessel region is started.

[0026] (18) The ultrasound diagnostic device described in (1), wherein color Doppler display can be enabled while live scanning in B mode is performed and information indicating the position of the vascular region is displayed, and an overlay of information indicating the position of the vascular region is simultaneously displayed.

[0027] (19) The ultrasound diagnostic device according to (18), wherein the color Doppler display can be terminated while information indicating the position of the vascular region is displayed by performing a live scan in B mode.

[0028] (20) An ultrasound diagnostic program for causing a computer to execute the steps of: changing the transparency of information indicating the position of a vascular region recognized using a trained model; and displaying the information indicating the position of the vascular region.

[0029] (21) An ultrasound diagnostic method including: a step in which an ultrasound diagnostic device changes the transparency of information indicating the position of a vascular region recognized using a trained model; and a step in which the ultrasound diagnostic device displays the information indicating the position of the vascular region. [Effects of the Invention]

[0030] According to the present invention, it is possible to grasp the vascular region using artificial intelligence, while also displaying tissues other than the highlighted vascular region with high visibility. [Brief explanation of the drawings]

[0031] [Figure 1] 1 is a block diagram showing the configuration of an ultrasound diagnostic apparatus according to an embodiment; [Figure 2] FIG. 4 is a diagram illustrating a display example of a display unit. [Figure 3A] 10A and 10B are diagrams illustrating the shape of information indicating the position of a blood vessel region or a nerve region. [Figure 3B] 10A and 10B are diagrams showing other shapes of information indicating the position of a blood vessel region or a nerve region. [Figure 3C] 10A and 10B are diagrams showing other shapes of information indicating the position of a blood vessel region or a nerve region. [Figure 3D] 10A and 10B are diagrams showing other shapes of information indicating the position of a blood vessel region or a nerve region. [Figure 4A] FIG. 10 is a diagram showing a setting button configured as a spin button for updating transparency. [Figure 4B] FIG. 10 is a diagram showing a setting button for updating the transparency configured by a slider. [Figure 5] 10 is a flowchart illustrating an operation of superimposing and displaying information indicating the position of a blood vessel region. [Figure 6]FIG. 10 is a diagram showing a display unit that displays information indicating the position of a blood vessel region and information indicating the position of a nerve region superimposed on a B-mode image. [Figure 7] 10 is a flowchart illustrating an operation for simultaneously superimposing and displaying information indicating the positions of a blood vessel region and a nerve region on a B-mode image. [Figure 8] 10 is a flowchart illustrating an operation of preferentially displaying one of information indicating the position of a blood vessel region and information indicating the position of a nerve region. DETAILED DESCRIPTION OF THE INVENTION

[0032] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. An ultrasound diagnostic device according to an embodiment recognizes information indicating the position of a vascular region from a B-mode (brightness) image of an ultrasound echo of a subject using a trained model based on machine learning or deep learning. The ultrasound diagnostic device then displays the recognized information indicating the position of the vascular region on a display unit, superimposed on the B-mode image, to highlight the vascular region. Furthermore, the ultrasound diagnostic device includes an operating unit for changing the transparency of the information indicating the position of the vascular region superimposed on the display unit, thereby adjusting the visibility of the underlying B-mode image. This allows tissues other than the highlighted vascular region to be displayed with high visibility. Hereinafter, a B-mode image may be referred to as an ultrasound echo image.

[0033] Specifically, by increasing the transparency of the information indicating the position of the vascular region after determining the position of the vascular region, the visibility of the B-mode image is improved, making it easier to see damage to tiny blood vessels. Furthermore, the ultrasound diagnostic device of this embodiment has the advantages of not interfering with the confirmation of bleeding around blood vessels and the visualization of intravascular plaque, and suppressing the overlooking of veins that are significantly deformed by the pressure of the probe. Furthermore, a gate is set in B-mode for display in Doppler mode. In this case, if the information indicating the position of the vascular region is highlighted, it can be difficult to set the gate. However, by increasing the transparency of the information indicating the position of the vascular region, the visibility of the B-mode image is improved, thereby resolving the gate setting problem.

[0034] In the following explanation, transparency is one of the color information items set in image data, etc., and refers to the degree to which an image is transparent and the information behind it is visible. For example, a semi-transparent image with a transparency set to a predetermined value can be displayed so that the background can be seen through it. Furthermore, transparency includes the concept of color saturation. However, transparency and color saturation have an inverse relationship, and the higher the transparency, the lower the color saturation. For example, when transparency is 100, the color saturation is 0.

[0035] FIG. 1 is a block diagram showing the configuration of an ultrasonic diagnostic apparatus 1 according to an embodiment. The ultrasonic diagnostic device 1 is configured by connecting an ultrasonic probe 101 to a main body 100 via a cable.

[0036] The main body 100 of the ultrasound diagnostic device 1 includes an operation unit 2, a transmission unit 3, a reception unit 4, a B-mode image generation unit 5, a ROI (Region Of Interest) setting unit 6, a C-mode image generation unit 7, a display processing unit 8, a control unit 9, a memory unit 10, a display unit 11, and a region recognition unit 12.

[0037] The ultrasound probe 101 has a plurality of transducers (piezoelectric conversion elements) 101a arranged in a one-dimensional direction. A drive signal is applied to each of the transducers 101a from a transmission unit 3 (described later), which generates ultrasound waves, and the plurality of ultrasound waves interfere with each other to generate an ultrasound beam. The ultrasound beam is irradiated onto the subject. The plurality of transducers 101a then receive reflected ultrasound waves (echoes) from inside the subject, convert them into electrical signals, and output them to a reception unit 4 (described later).

[0038] The operation unit 2 is a display instruction means that detects an operation instruction from the user and notifies the control unit 9 of a mode command based on the operation instruction from the user. For example, the operation unit 2 notifies the control unit 9 of which mode to execute, a mode for displaying a B-mode image or a mode for displaying a C-mode image superimposed on the B-mode image, based on the operation instruction from the user. A B-mode image is an ultrasound image in which the amplitude of reflected ultrasound is represented by brightness (luminance), and a C-mode image is a color flow mode image.

[0039] The operation unit 2 also includes a function of accepting a user's input specifying the position of an ROI where a C-mode image is to be displayed on a B-mode image.

[0040] Here, C-mode images include V mode, which displays the blood flow velocity and direction in color using blood flow velocity V as a blood flow signal indicating the state of blood flow; P mode, which displays the power of blood flow in color using blood flow power P as a blood flow signal; and VT mode, which displays the blood flow velocity and variance in color using blood flow velocity V and variance T as a blood flow signal.

[0041] When the operation unit 2 detects a user's operation instruction for C-mode image display, it also detects an instruction for the above-mentioned display mode. The display mode for C-mode image display may include T (dispersion) mode, dP (directional power) mode, etc. Thus, the display mode for C-mode image display includes color Doppler mode (V mode, VT mode, etc.) and power Doppler mode (P mode, etc.).

[0042] Furthermore, the operation unit 2 detects a user operation instruction for a puncture mode in which the puncture needle inserted with the aid of the puncture adapter or guide is highlighted in the B-mode image, and notifies the control unit 9 of the mode command.

[0043] The operation unit 2 also detects a user operation instruction for a blood vessel display mode in which information indicating the position of a blood vessel region recognized from a B-mode image of an ultrasound echo of the subject using a trained AI model of machine learning or deep learning is superimposed on the display screen of the B-mode image.The operation unit 2 then notifies the control unit 9 of a blood vessel display mode command as the user operation instruction.

[0044] Furthermore, the operation unit 2 detects a user operation instruction for a nerve display mode in which information indicating the position of a nerve region recognized from a B-mode image of an ultrasound echo of the subject using a trained AI model of machine learning or deep learning is superimposed on the display screen of the B-mode image.The operation unit 2 then notifies the control unit 9 of a nerve display mode command as the user operation instruction.

[0045] More specifically, the display processing unit 8 displays instruction buttons on the display unit 11 that displays a B-mode image or the like, which will be described later. The operation unit 2 detects a tap operation on the instruction button using the touch panel 21, and regards this as an operation instruction from the user. It goes without saying that the detection of the operation instruction from the user is not limited to the touch panel 21, and other detection means may also be used.

[0046] The transmitter 3 transmits a high-voltage drive signal at a predetermined timing to the transducer 101a of the ultrasonic probe 101 in order to irradiate the subject with an ultrasonic beam.

[0047] When displaying a color Doppler image, the transmitter 3 performs transmission processing for displaying a B-mode image as well as C-mode transmission processing for displaying a blood flow image under the control of the controller 9. In this case, the transmitter 3 alternately performs, for example, B-mode scanning and C-mode scanning.

[0048] In C-mode scanning, ultrasonic beams are repeatedly transmitted n times in the same line direction, while transmitting the ultrasonic beams in all directions (all lines) of the ROI set by the ROI setting unit 6. n is a dozen or so, such as 16, and this number of repetitions is called the ensemble number. In addition, the transmitting unit 3 specifies additional information for transmission processing for B-mode images or transmission processing for C-mode images during transmission processing, and outputs this additional information to the receiving unit 4.

[0049] The receiving unit 4 amplifies and A / D converts the analog electrical signal converted based on the reflected ultrasonic waves (echoes) received by the ultrasonic probe 101, and generates a digital received signal by performing phasing addition.

[0050] The receiving unit 4 also acquires additional information from the transmitting unit 3, and if the acquired additional information is additional information for a B-mode image, it outputs a received signal to the B-mode image generating unit 5. If the acquired additional information is additional information for a C-mode image, it outputs the received signal to the C-mode image generating unit 7. Hereinafter, a received signal for generating a B-mode image will be referred to as a "B-mode received signal," and a received signal for generating a C-mode image will be referred to as a "C-mode received signal."

[0051] Under the control of the control unit 9, the B-mode image generation unit 5 performs envelope detection, logarithmic compression, etc. on the B-mode received signal input from the receiving unit 4, adjusts the dynamic range and gain, and performs brightness conversion to generate B-mode image data, which is output to the display processing unit 8.

[0052] Under the control of the control unit 9, the ROI setting unit 6 sets a region of interest (ROI) of the C-mode image in the transmission unit 3 and the display processing unit 8 according to ROI designation information input by the user via the operation unit 2.

[0053] Under the control of the control unit 9 , the C-mode image generation unit 7 generates C-mode image data in response to the C-mode reception signal input from the reception unit 4 , and outputs the C-mode image data to the display processing unit 8 .

[0054] The display processing unit 8 displays the B-mode image data on the display unit 11 by superimposing the C-mode image data and information indicating the position of the blood vessel region on the B-mode image data. In the B-mode image display mode, the display processing unit 8 displays the B-mode image generated by the B-mode image generating unit 5 on the display unit 11.

[0055] In addition, in the C-mode image display mode, the display processing unit 8 superimposes the C-mode image generated by the C-mode image generation unit 7 at the position of the ROI selected on the B-mode image generated by the B-mode image generation unit 5 using the overlay display unit 81 and displays it on the display unit 11.

[0056] The control unit 9 sets the operation of each processing unit of the main body 100 and controls the overall operation of the main body 100. In particular, the mode selection means 91 of the control unit 9 controls the display processing unit 8 to display setting buttons for display modes and operation types on the display unit 11. For example, the setting buttons include a button for setting the display board for B-mode images and a button for setting a Doppler image display mode in which blood flow signals are detected using Doppler mode to generate and display Doppler images. The setting buttons also include a setting button for a puncture mode in which the puncture needle is highlighted on the B-mode image to assist puncture, and a setting button for a blood vessel region display mode in which information indicating the position of the blood vessel region is overlaid on the B-mode image. The setting buttons also include a setting button for a nerve region display mode in which information indicating the position of the nerve region is overlaid on the B-mode image.

[0057] Then, the operation unit 2 detects a tap by the user on a setting button displayed on the display unit 11 using the touch panel 21 provided on the display unit 11, and notifies the mode selection means 91 of the user operation instruction corresponding to the setting button. The mode selection means 91 sets the operation content of each processing unit according to the notified user operation instruction, such as B-mode image display, Doppler image display, puncture mode, blood vessel region display mode, or nerve region display mode.

[0058] In the above, it has been explained that the operation unit 2 detects when the user taps the setting button for the display mode or operation type displayed on the display unit 11, but it is also possible to provide physical operation switches corresponding to the operation content of each processing unit so that the operation unit 2 detects user operations.

[0059] The storage unit 10 stores ultrasound image data, a gain matrix, a frame rate, etc. The ultrasound image data includes B-mode image data, C-mode image data, composite image data, etc.

[0060] The display unit 11 is a so-called monitor display such as an LCD (Liquid Crystal Display) or an EL (Electro Luminescence) display that displays the display image data output from the display processing unit 8. A transparent touch panel 21 is superimposed on the display surface of the display unit 11 so that a user's tapping action on a setting button can be detected. Note that instead of the user's tapping action on the setting button, the user may issue an operation instruction by clicking the setting button with a mouse, for example.

[0061] When the blood vessel region display mode is set, the region recognition unit 12 is a processing unit that recognizes (determines) a blood vessel region in the B-mode image generated by the B-mode image generation unit 5 using a trained model in which, for example, a convolutional neural network is trained using teacher data. Also, when the nerve region display mode is set, the region recognition unit 12 is a processing unit that recognizes (determines) a nerve region in the B-mode image generated by the B-mode image generation unit 5 using a trained model in which, for example, a convolutional neural network is trained using teacher data.

[0062] That is, the region recognition unit 12 has a trained model for recognizing vascular regions and a trained model for recognizing nerve regions, and recognizes (determines) vascular regions and nerve regions in B-mode images in response to user operation instructions.

[0063] The region recognition unit 12 outputs the vascular region and nerve region that it has recognized to the display processing unit 8 as information indicating the position of the vascular region or nerve region. The information indicating the position of the vascular region and nerve region is, for example, a contour figure of the region or a figure in which the inside of the contour is filled in a predetermined color (for example, red), and includes position information of the region in the B-mode image. The information indicating the position of the region may also be information on the coordinate position of a pixel determined to be a vascular region in the B-mode image. The display processing unit 8 causes the overlay display unit 81 to superimpose the information indicating the position of the region output from the region recognition unit 12 onto the B-mode image and display it on the display unit 11.

[0064] The transparency update unit 82 is a processing unit that updates the transparency of the superimposed information in real time when the information indicating the position of the blood vessel region and the information indicating the position of the nerve region recognized (determined) by the region recognition unit 12 are superimposed on the B-mode image. For example, the transparency update unit 82 improves the visibility of the B-mode image behind the superimposed information by updating the transparency of the semi-transparent information to a high value. The transparency update unit 82 may be configured to update the transparency separately for the information indicating the position of the blood vessel region and the information indicating the position of the nerve region, or may update the transparency in common.

[0065] Although details will be described later, the display processing unit 8 displays a spin button or a slider for setting the transparency on the display unit 11. Then, the transparency update unit 82 updates the transparency based on operation information of the user on the spin button or slider detected by the touch panel 21.

[0066] More specifically, the main body 100 of the ultrasound diagnostic apparatus 1 of the embodiment is realized by an information processing device (computer) that is configured with a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and a large-capacity recording medium such as an HDD (Hard Disk Drive).

[0067] The CPU reads out an ultrasound diagnostic program stored in the ROM or HDD, loads it into the RAM, and implements the functions of each part of the main body 100 in accordance with the loaded program. The RAM forms a work area for temporarily storing various programs executed by the CPU and data related to these programs. The ultrasound diagnostic program may be stored in the form of computer-readable program code and supplied to the ultrasound diagnostic device 1 via a recording medium, or may be transmitted to the ultrasound diagnostic device 1 via a network.

[0068] 1 shows an example in which the ultrasound diagnostic device 1 of the embodiment is configured from a main body 100 provided with a display unit 11 that displays reflected ultrasound waves (echoes), and an ultrasound probe 101. However, the present invention is not limited to this, and each processing unit of the main body 100 may be implemented in a server on a network as an ultrasound diagnostic device, and the ultrasound probe 101 and display unit 11 may be connected to the ultrasound diagnostic device via the network.

[0069] FIG. 2 is a diagram showing an example of a display on the display unit 11. As shown in FIG. 2, vascular region information 112 indicating the position of the vascular region is superimposed on a B-mode image 111 and displayed on the display unit 11. The vascular region information 112 is a contour figure of the vascular region, or a figure obtained by filling the inside of the contour with a predetermined color (for example, red). The display unit 11 also displays a setting button 119 for updating the transparency of the vascular region information 112 in real time. That is, the display processing unit 8 superimposes the vascular region information 112 indicating the position of the vascular region on the B-mode image 111 and displays it on the display unit 11.

[0070] Furthermore, the display unit 11 displays buttons that the user taps to instruct or set the operation of the ultrasound diagnostic apparatus 1 as the operation unit 2. The B button 113 is a button for setting the display mode of a B-mode image. The Doppler button 114 is a button for setting the color Doppler display mode in which a color Doppler image is superimposed on a B-mode image.

[0071] Furthermore, display unit 11 displays a blood vessel button 116, a puncture button 115, and a nerve button 117. Note that Fig. 2 only displays buttons related to the operation of ultrasound diagnostic apparatus 1 of the embodiment described below, and does not display other buttons.

[0072] The blood vessel button 116 is a display instruction means for instructing a blood vessel display mode in which blood vessel region information 112 recognized from a B-mode image is superimposed on a B-mode image. The puncture button 115 is a display instruction means for instructing the display of the puncture mode in which the puncture needle is highlighted. The nerve button 117 is a display instruction means for instructing a nerve display mode in which nerve region information 118 (not shown) recognized from the B-mode image is superimposed on the B-mode image. That is, the display processing unit 8 displays the B button 113 , the Doppler button 114 , the blood vessel button 116 , the puncture button 115 , and the nerve button 117 on the display unit 11 .

[0073] Next, the shapes of the vascular region information 112 and the nerve region information 118 will be described with reference to Figures 3A to 3D. Hereinafter, information indicating the position of a vascular region or a nerve region will be referred to as information indicating position. In the description, the information indicating position is shown as an ellipse, but this is only for the purpose of illustration. The shape of the information indicating position is the outline figure of the region recognized (determined) by the region recognition unit 12, or a figure containing the region.

[0074] In FIG. 3A, the information indicating the position is in a state where the outline figure or the figure containing the area is filled with a color having a predetermined transparency.

[0075] In Figure 3B, the information indicating the position shows the outline figure or the figure containing the area filled with a color having a lower transparency than that of Figure 3A. In other words, because the transparency is lower than that of Figure 3A, the white paper behind it is shown in dark gray.

[0076] In Figure 3C, the information indicating the position is a contour figure or a figure containing an area, and the contour line is displayed in a color with a predetermined transparency, i.e., the color information is displayed in a frame shape so that the boundary area (periphery) of the recognized vascular area can be recognized. In this case, the inside of the contour or frame is transparent so that the B-mode image behind it can be seen. The boundary area of ​​the vascular area is the peripheral area, and in this case, the ultrasound diagnostic device 1 forms the annotation in a frame shape.

[0077] In the information indicating the position of FIG. 3C, the line width of the outline (frame line) is set according to the transparency. In particular, it is preferable to make the line width of the outline (frame line) thicker as the transparency increases. This makes the outline (frame line) easily visible even when the transparency is high.

[0078] 4A and 4B, the configuration of the setting button for updating the transparency of the information indicating the position of the blood vessel region or the information indicating the position of the nerve region in real time will be described. The setting button for updating the transparency may be provided separately for the information indicating the position of the blood vessel region and the information indicating the position of the nerve region, or may be provided in common (shared) on the display unit 11.

[0079] 4A shows a setting button for updating the transparency, which is configured as a spin button. The spin button has a minus sign on the left to decrease the value and a plus sign on the right to increase the value. When the user taps the minus sign, the transparency decreases, and when the user taps the plus sign, the transparency increases.

[0080] 4B shows a setting button configured with a slider for updating the transparency. The transparency can be increased or decreased by a user operation of tapping and sliding the bar.

[0081] The transparency update unit 82 sets the maximum value of the transparency setting range set by operating the spin button or slider to a predetermined threshold or less. This prevents the information indicating the position of the blood vessel region or the information indicating the position of the nerve region superimposed on the B-mode image from becoming completely transparent, preventing the recognized region from being overlooked.

[0082] When the user sets the transparency to a predetermined threshold or higher and ends the diagnosis, the transparency update unit 82 resets the transparency to a predetermined threshold or lower when the diagnosis is resumed and the blood vessel region display mode or the nerve region display mode is executed. That is, the transparency update unit 82 does not save the transparency changed by the user's operation of the setting button in response to an end instruction, but sets the transparency to a predetermined initial value (a value lower than the predetermined threshold) in response to a start instruction such as starting the diagnosis or turning on the power.

[0083] For example, if you change the transparency to 100% and then finish, and then highlight the vascular or nerve region again, the highlighting will not be visible at 100% transparency, which could lead to the mistaken belief that there is no vascular or nerve region; however, this mistake can be suppressed by resetting the transparency to a predetermined threshold or below.

[0084] The transparency update unit 82 may reset the transparency to a value below a predetermined threshold and set it to a predetermined color tone when displaying information indicating the position of the vascular region or nerve region after the transparency has been changed.

[0085] The transparency update unit 82 may also include a notification unit that notifies the user that the transparency has been changed beyond a predetermined value when the user operates the setting button to set the transparency to a predetermined threshold or higher. This allows the user to recognize that the information indicating the position of the vascular region or nerve region has been set beyond a certain transparency state. Consider a case where the transparency is set to 100% when a predetermined highlighting is performed again. Even if the user then presses the vascular highlighting button or muscle highlighting button, the blood vessels or muscles will not be displayed, preventing the next operator from determining that there are no blood vessels or muscles. Furthermore, it is advisable to always start up the ultrasound diagnostic device 1 in a state where sufficient color is displayed, which will prevent the next operator from determining that there are no blood vessels or muscles.

[0086] The notification unit may, for example, display a pop-up window stating that the transparency has been changed beyond the predetermined value, or may warn that the transparency has exceeded the predetermined value by highlighting or blinking the setting button.

[0087] Next, we will explain the operation of superimposing information indicating the position of the vascular region on the B-mode image by tapping the blood vessel button 116 when the user taps the B button 113 (see Figure 2) for setting the display mode of the B-mode image and the ultrasound diagnostic device 1 is displaying the B-mode image on the display unit 11, as shown in Figure 2.

[0088] 5 is a flowchart showing the processing of one frame of reflected ultrasound (echo) in the ultrasound diagnostic device 1. The control unit 9 of the ultrasound diagnostic device 1 repeats the processing of FIG. 5 at predetermined intervals.

[0089] In step S51, the B-mode image generating unit 5 generates a B-mode image based on the reflected ultrasound.

[0090] In step S52, the display processing unit 8 determines whether the blood vessel display mode is selected based on the detection of a tap on the blood vessel button 116, which indicates the blood vessel display mode, on the touch panel 21 of the operation unit 2. If the blood vessel display mode is selected (Yes in step S52), the process proceeds to step S53. If the blood vessel display mode is not selected (No in step S52), the process proceeds to step S57.

[0091] In step S53, the region recognition unit 12 recognizes (determines) the vascular region in the B-mode image generated in step S51 using the trained model, and notifies the display processing unit 8 of the recognized vascular region as information indicating the position of the vascular region.

[0092] In step S54, the operation unit 2 detects whether or not the user has tapped the transparency setting button 119 for the blood vessel region on the touch panel 21. If the user has tapped, the transparency update unit 82 of the display processing unit 8 sets (updates) the transparency of the information indicating the position of the blood vessel region in response to the tapping operation by the user.

[0093] In step S55, the overlay display unit 81 of the display processing unit 8 superimposes the B-mode image and information indicating the position of the vascular region reflecting the transparency set (updated) by the transparency update unit 82, and displays it on the display unit 11, thereby completing the processing.

[0094] In step S57, the display processing unit 8 displays the B-mode image generated in step S51 on the display unit 11, and the process ends. The B-mode image generated in step S51 does not have the vascular region information 112 superimposed thereon.

[0095] As described above, the ultrasound diagnostic device 1 detects the transparency setting for each frame of the B-mode image, thereby superimposing information indicating the position of the vascular region in real time and making it possible to change the transparency of the information indicating the position of the vascular region. This makes it possible to suppress a decrease in the visibility of the B-mode image that is transmitted through the vascular region, and to grasp the condition behind the vascular region.

[0096] In the flowchart of FIG. 5, the transparency setting is detected for each frame of the B-mode image. However, the transparency setting process in step S54 may be thinned out within an allowable range for changes in the transparency of the information indicating the position of the vascular region.

[0097] 5, when the ultrasound diagnostic device 1 superimposes only information indicating the position of a blood vessel region on a B-mode image, the region recognition unit 12 does not need to have a trained model for recognizing a nerve region. Also, it is not necessary to display the nerve button 117 shown in FIG. 2 on the display unit 11, and it is not necessary for the operation unit 2 to detect a user operation of the nerve button 117.

[0098] Conversely, the ultrasound diagnostic device 1 may superimpose only information indicating the position of the nerve region on the B-mode image instead of information indicating the position of the blood vessel region. In this case, the ultrasound diagnostic device 1 does not need a trained model for recognizing the blood vessel region and processing related to the blood vessel button 116.

[0099] Next, an embodiment will be described in which the ultrasound diagnostic device 1 superimposes information indicating the position of a blood vessel region and information indicating the position of a nerve region on a B-mode image, and the transparency of the information indicating the position of the blood vessel region and the information indicating the position of the nerve region can be changed.

[0100] FIG. 6 shows the display unit 11 in which the ultrasound diagnostic device 1 displays a B-mode image 111 in response to a user tapping the B button 113, and then detects the user tapping the blood vessel button 116 and the nerve button 117, and displays blood vessel region information 112 and nerve region information 118 indicating the position of the nerve region superimposed on the B-mode image 111.

[0101] The display unit 11 is provided with a vascular region transparency setting button 119 and a nerve region transparency setting button 120, which allow the transparency of the vascular region information 112 and nerve region information 118 to be changed in real time in response to user operation.

[0102] FIG. 7 is a flowchart illustrating the operation of simultaneously superimposing information indicating the positions of the blood vessel region and the nerve region on a B-mode image.

[0103] First, in step S51 and steps S53 to S55, the display processing unit 8 superimposes the B-mode image and vascular region information 112 indicating the position of the vascular region reflecting the transmittance, and displays them on the display unit 11. Details of each step are the same as those in FIG. 5, and therefore will not be described here.

[0104] In step S71, the region recognition unit 12 recognizes (determines) the nerve region in the B-mode image generated in step S51 using the trained model, and notifies the display processing unit 8 of the recognized nerve region as nerve region information 118 indicating the position of the nerve region.

[0105] In step S72, the operation unit 2 detects whether or not the user has tapped the nerve region transparency setting button 120 on the touch panel 21. If the user has tapped, the transparency update unit 82 of the display processing unit 8 sets (updates) the transparency of the nerve region information 118 in response to the user's tap.

[0106] In step S73, the overlay display unit 81 of the display processing unit 8 displays information indicating the position of the nerve region, reflecting the transparency set in step S72, on the display unit 11 in an overlaid manner, and the process ends.

[0107] As described above, the ultrasound diagnostic device 1 simultaneously displays information indicating the positions of the blood vessel region and the nerve region superimposed on the B-mode image, but the information indicating the position of the blood vessel region and the information indicating the position of the nerve region may overlap. In this case, adjusting the transparency may not improve the visibility of the B-mode image behind them.

[0108] When the information indicating the positions of the blood vessel region and the nerve region overlaps as described above, it is possible to display either the information indicating the position of the blood vessel region or the information indicating the position of the nerve region with priority.

[0109] "Preferential display" refers to displaying one of multiple pieces of information, when there is a plurality of pieces of information indicating the position of a tissue region recognized using a trained model, if the multiple pieces of information recognize the same region. For example, when there is information indicating the position of a blood vessel region and information indicating the position of a nerve region, if the ultrasound diagnostic device 1 recognizes the same region on the image as the blood vessel region information and the nerve region information, it displays either the blood vessel region information or the nerve region information.

[0110] FIG. 8 is a flowchart illustrating the operation of preferentially displaying either the information indicating the position of the blood vessel region or the information indicating the position of the nerve region.

[0111] In step S81, the B-mode image generating unit 5 generates B-mode image data based on the reflected ultrasound waves (echoes).

[0112] In step S82, the display processing unit 8 recognizes the vascular region, obtains information indicating the position of the vascular region, and sets the transparency. Specifically, the region recognition unit 12 recognizes (determines) the vascular region in the B-mode image generated in step S81 using the trained model, and notifies the display processing unit 8 of the recognized vascular region as information indicating the position of the vascular region. Furthermore, the operation unit 2 detects whether or not the user has tapped the vascular region transparency setting button 119 on the touch panel 21. Then, if the user has tapped, the transparency update unit 82 of the display processing unit 8 sets (updates) the transparency of the information indicating the position of the vascular region in accordance with the user's tap operation.

[0113] In step S83, the display processing unit 8 recognizes the nerve region, obtains information indicating the position of the nerve region, and sets the transparency. Specifically, the region recognition unit 12 recognizes (determines) the nerve region in the B-mode image generated in step S81 using the trained model, and notifies the display processing unit 8 of the recognized nerve region as information indicating the position of the nerve region. Furthermore, the operation unit 2 detects whether or not the user has tapped the nerve region transparency setting button 120 on the touch panel 21. Then, if the user has tapped, the transparency update unit 82 of the display processing unit 8 sets (updates) the transparency of the information indicating the position of the nerve region in accordance with the user's tap operation.

[0114] In step S84, the display processing unit 8 determines whether the center of gravity positions of the information indicating the position of the blood vessel region and the information indicating the position of the nerve region are the same by determining whether the difference between the center of gravity positions is equal to or less than a predetermined value. If the difference between the center of gravity positions is equal to or less than the predetermined value, it is determined that the center of gravity positions are the same (Yes), and the process proceeds to step S85. If the difference between the center of gravity positions is greater than the predetermined value, it is determined that the center of gravity positions are not the same (No), and the process proceeds to step S88.

[0115] The display processing unit 8 may determine whether or not there is overlap based on whether or not the size of the area where the information indicating the position of the blood vessel region and the information indicating the position of the nerve region overlap is equal to or greater than a predetermined value as a determination condition in step S84.

[0116] In step S85, the display processing unit 8 determines whether the priority of the information indicating the positions of the blood vessel region and the nerve region is higher than that of the nerve region. If the priority of the blood vessel region is higher than that of the nerve region (Yes in step S85), the process proceeds to step S86. If the priority of the blood vessel region is lower than that of the nerve region (No in step S85), the process proceeds to step S87.

[0117] In step S86, the overlay display unit 81 of the display processing unit 8 superimposes the B-mode image and information indicating the position of the vascular region reflecting the transparency set (updated) by the transparency update unit 82 and displays them on the display unit 11, and the processing of Figure 8 is terminated.

[0118] In step S87, the overlay display unit 81 of the display processing unit 8 superimposes the B-mode image and information indicating the position of the nerve area reflecting the transparency set (updated) by the transparency update unit 82 and displays them on the display unit 11, and the processing of Figure 8 is terminated.

[0119] In step S88, the overlay display unit 81 of the display processing unit 8 superimposes the B-mode image and information indicating the position of the vascular region reflecting the transparency set (updated) by the transparency update unit 82 and displays them on the display unit 11, and the processing proceeds to step S89.

[0120] In step S89, the overlay display unit 81 of the display processing unit 8 superimposes information indicating the position of the nerve area reflecting the transparency set in step S83 and displays it on the display unit 11, and the processing of Figure 8 is terminated.

[0121] As described above, the region recognition unit 12 has trained models for recognizing vascular regions and nerve regions, and recognizes vascular regions and nerve regions in B-mode images in response to a user's operation instruction for the vascular region display mode or the nerve region display mode.

[0122] In addition, the region recognition unit 12 has a trained model for recognizing muscle tissue regions, and is configured to recognize blood vessel regions, nerve regions, and muscle tissue regions in B-mode images. Furthermore, the display unit 11 is provided with a muscle tissue button, which is a display instruction means for instructing a muscle tissue display mode in which information indicating the position of the muscle tissue region is superimposed. The display processing unit 8 may then superimpose at least one of the information indicating the position of the blood vessel region, the information indicating the position of the nerve region, and the information indicating the position of the muscle tissue region on the B-mode image.

[0123] Furthermore, a setting button is provided that enables changing the transparency of the information indicating the position of the muscle tissue region, and a transparency update unit 82 sets the transparency of the information indicating the position of the muscle tissue region according to the setting of the setting button. Then, an overlay display unit 81 may be configured to superimpose the B-mode image and the information indicating the position of the muscle tissue region that reflects the transparency.

[0124] Next, the relationship between the color Doppler display that operates by tapping the Doppler button 114 (see FIGS. 2 and 6) and the function of changing the transparency of the information indicating the position of the blood vessel region will be described.

[0125] When the user taps the blood vessel button 116, the ultrasound diagnostic device 1 displays blood vessel region information 112, the transparency of which can be changed, superimposed on the B-mode image 111 using the overlay display unit 81. Thereafter, in response to the user's tap operation on the Doppler button 114, the ultrasound diagnostic device 1 displays a C-mode image superimposed on the B-mode image 111 using the overlay display unit 81. This display mode is called color Doppler display.

[0126] That is, while information indicating the position of a vascular region is being displayed by a live scan in B mode, the ultrasound diagnostic device 1 can enable the color Doppler display and simultaneously superimpose the information display indicating the position of the vascular region on the C-mode image. As a result, even if the information indicating the position of the vascular region and the color Doppler display overlap, the user can easily view the color Doppler display by increasing the transparency of the vascular region information 112.

[0127] Furthermore, the ultrasound diagnostic device 1 may be configured to terminate the color Doppler display while performing a live scan in B mode and displaying information indicating the position of the blood vessel region.

[0128] Here, the display when the ultrasound diagnostic device 1 detects a tap on the puncture button 115 (see FIG. 2) that instructs the display of the puncture mode that highlights the puncture needle and displays the puncture mode will be described.

[0129] The ultrasound diagnostic device 1 allows the user to change the transparency of the vascular region information 112 or nerve region information 118 superimposed on the B-mode image in puncture mode. This ensures high visibility of the B-mode image behind the vascular region information 112 or nerve region information 118. This allows the user to easily grasp the vascular region or nerve region and visually recognize the puncture needle on the B-mode image, allowing for an optimal puncture procedure.

[0130] When information indicating the location of blood vessel regions recognized using a trained model is superimposed on a B-mode image for emphasis, there is also the issue of the accuracy of blood vessel region recognition, and the blood vessel portion and its surrounding area may be highlighted. Therefore, in reality, there are nerves near the blood vessels. In other words, there is a possibility that nerves are located in the area near the blood vessels.

[0131] When the information is displayed opaquely and highlighted, the nerves may be hidden and not be visible. However, in the ultrasound diagnostic device 1 described above, the information indicating the position of the blood vessel region is displayed semi-transparently and highlighted, so the nerves are not hidden and not visible.

[0132] Furthermore, if opaque highlighting is used, the tissue regions in the B-mode image will be hidden and the boundaries of the recognized tissues will be obscured, making it difficult to know whether the recognition is correct. However, ultrasound diagnostic device 1 uses semi-transparent highlighting, which makes it possible to visually recognize the boundaries of the tissues in the B-mode image, allowing users to know whether the recognition is correct.

[0133] According to this embodiment, when information indicating the position of a vascular region is superimposed on a B-mode image and displayed in real time, the transparency of the information indicating the position of the vascular region is changed in real time by operating the operation unit 2 to change the transparency. When performing a live scan in B-mode and displaying a B-mode image in real time, the ultrasound diagnostic device 1 is capable of displaying live annotations of blood vessels using artificial intelligence. The ultrasound diagnostic device 1 displays a live annotation overlay, and can change the transparency while highlighting blood vessels live.

[0134] Furthermore, the present invention is not limited to the above-described examples, and includes various modified examples. The above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. [Explanation of symbols]

[0135] 1. Ultrasound diagnostic equipment 2 Operation unit (operation means) 3. Transmitter 4. Receiving section 5 B-mode image generation unit 6 ROI setting section 7 C-mode image generation unit 8 Display processing section 81 Overlay display section 82 Transparency update section 9 Control Unit 91 Mode selection means 10 Storage section 11 Display section 12 Area recognition part 100 units 101 Ultrasonic probe

Claims

1. a display unit that displays information indicating the position of a blood vessel region recognized using the trained model; and An ultrasonic diagnostic device comprising an operation means for changing the transparency of the information indicating the position of the blood vessel region.

2. The ultrasonic diagnostic apparatus according to claim 1 , wherein the display unit includes the operation means on a display screen.

3. The ultrasonic diagnostic apparatus according to claim 1 , wherein the information indicating the position of the blood vessel region is semi-transparent color information superimposed on the ultrasonic image.

4. During real-time display of a B-mode image on which information indicating the position of the blood vessel region is superimposed, 2. The ultrasonic diagnostic apparatus according to claim 1, wherein the transmittance is changeable by the operating means.

5. The ultrasound diagnostic device according to claim 1 , wherein the information indicating the position of the vascular region is color information in which the vascular region recognized using the trained model is painted in a predetermined color.

6. The ultrasound diagnostic device according to claim 1 , wherein the information indicating the position of the vascular region is color information that displays a border region of the vascular region recognized using the trained model in a frame shape.

7. The ultrasound diagnostic device according to claim 1, wherein the display unit displays information indicating the position of a nerve area recognized using a trained model, and the device further comprises an operation means for changing the transparency of the information indicating the position of the nerve area.

8. the display unit simultaneously displays information indicating the position of the nerve region recognized using the trained model and information indicating the position of the blood vessel region; The ultrasonic diagnostic apparatus according to claim 1 , wherein the transparency of the information indicating the position of the blood vessel region and the transparency of the information indicating the position of the nerve region can be changed independently.

9. the display unit simultaneously displays information indicating the position of the nerve region recognized using the trained model and information indicating the position of the blood vessel region; 9. The ultrasound diagnostic apparatus according to claim 8, further comprising: a first operation means for changing a transparency of the information indicating the position of the blood vessel region; and a second operation means for changing a transparency of the information indicating the position of the nerve region.

10. the display unit simultaneously displays information indicating the position of the nerve region recognized using the trained model and information indicating the position of the blood vessel region; 2. The ultrasound diagnostic apparatus according to claim 1, further comprising an operation means for changing a transparency of the information indicating the position of the blood vessel region and for changing a transparency of the information indicating the position of the nerve region.

11. The ultrasonic diagnostic apparatus according to claim 7 , wherein either the information indicating the position of the blood vessel region or the information indicating the position of the nerve region is displayed with priority.

12. 2. The ultrasound diagnostic device of claim 1, wherein the display unit is capable of simultaneously displaying information indicating the position of a muscle tissue region recognized by a trained model, information indicating the position of a nerve region recognized by the trained model, and information indicating the position of the blood vessel region.

13. The ultrasonic diagnostic device according to claim 12, wherein the transparency of the information indicating the position of the muscle tissue region is changeable.

14. 2. The ultrasonic diagnostic apparatus according to claim 1, further comprising: a control unit that, when the transmittance is set to a predetermined threshold or more and an end instruction is given, detects the end instruction and controls to change the transmittance to a predetermined threshold or less.

15. The ultrasonic diagnostic apparatus according to claim 1 , further comprising a notification unit that notifies when the transmittance is set to a predetermined threshold or higher.

16. The ultrasonic diagnostic apparatus according to claim 1 , further comprising a setting unit that sets the maximum value of the transmittance setting range to a predetermined threshold or less.

17. The ultrasonic diagnostic apparatus according to claim 1 , wherein the color with variable transparency is displayed at a transparency equal to or lower than a predetermined threshold when displaying information indicating the position of the blood vessel region is started.

18. 2. The ultrasound diagnostic device according to claim 1, wherein color Doppler display can be enabled while information indicating the position of the vascular region is displayed by live scanning in B-mode, and an overlay of information display indicating the position of the vascular region is simultaneously displayed.

19. 19. The ultrasonic diagnostic apparatus according to claim 18, wherein the color Doppler display can be terminated while information indicating the position of the blood vessel region is displayed by performing a live scan in B mode.

20. On the computer, a step of changing the transparency of information indicating the position of a blood vessel region recognized using the trained model; a step of displaying information indicating the position of the blood vessel region; Ultrasound diagnostic program for executing the above.

21. a step in which the ultrasound diagnostic device changes the transparency of information indicating the position of a blood vessel region recognized using the trained model; a step of displaying information indicating the position of the vascular region by the ultrasound diagnostic device; An ultrasound diagnostic method comprising:

Images