Ultrasound diagnostic device, ultrasound image display method, and program

Abstract

The objective is to provide an ultrasound diagnostic device, an ultrasound display method, and a program that improve safety. [Solution] The ultrasound diagnostic device comprises an ultrasound probe, a generation unit, a display unit, and a control unit. The ultrasound probe transmits and receives ultrasound waves. The generation unit generates an ultrasound image based on the ultrasound data obtained by transmitting and receiving ultrasound waves. The display unit displays the ultrasound image. The control unit simultaneously displays the tip portion image 402 of the position of the puncture needle tip in the blood vessel displayed on the ultrasound image, arterial identification information 432, and vein identification information 433 in a single ultrasound image. The arterial identification information 432 and vein identification information 433 indicate the distinction between arteries and veins in the blood vessel.

Description

Technical Field

[0001] The present invention relates to an ultrasonic diagnostic apparatus, an ultrasonic image display method, and a program.

Background Art

[0002] Conventionally, ultrasonic diagnosis can obtain an ultrasonic image of the heart or fetus through a simple operation of applying an ultrasonic probe to the body surface or body cavity of a patient's subject. Moreover, ultrasonic diagnosis is highly safe and can be repeatedly performed. An ultrasonic diagnostic apparatus used for such ultrasonic diagnosis is known.

[0003] The ultrasonic diagnostic apparatus has, as image modes, a B (Brightness) mode and a color Doppler mode (hereinafter referred to as C mode). The B-mode image is a tomographic image composed of pixels representing the state of the subject with the reflected ultrasonic wave (echo) as the luminance value of the reception energy. The C-mode image is a tomographic image representing the flow velocity change of the blood flow in the blood vessels of the subject in color.

[0004] In addition, a technique for guiding the insertion (puncture) of a puncture needle into a predetermined anatomical tissue (hereinafter referred to as tissue) by displaying an ultrasonic image of a subject using an ultrasonic diagnostic apparatus is known. The puncture needle is punctured into the tissue of a living body such as a patient to collect a part of the tissue or inject a drug. The puncture of the puncture needle may be performed in such a way as to avoid piercing a blood vessel or to pierce a blood vessel (intervention). Intervention is a general term for a treatment method in which a puncture needle is inserted into a blood vessel through a hole opened in the skin.

[0005] Blood vessels consist of veins and arteries. Veins are located superficially in the body and are firm enough to collapse when compressed from the outside. Similarly, arteries are firmer and do not collapse easily when compressed. When puncturing a vein during interventional vein puncture, there is a risk that the tip of the puncture needle may not remain inside the blood vessel but be inserted too far. If inserted too far, it can pass through the opposite blood vessel wall, leading to a serious accident. Therefore, it is necessary to distinguish between arteries and veins. In particular, in the deeper parts of the body, veins are less likely to collapse even when compressed from the outside, so it is necessary to distinguish between arteries and veins using ultrasound imaging.

[0006] Currently, it is possible to determine whether a blood vessel is an artery or a vein based on the direction of blood flow obtained from C-mode images and the relative positions of the heart and periphery when visually observing the patient's body. However, C-mode images obscure the blood flow within the vessels, making it difficult to recognize the position of the puncture needle even when it is present within the vessel due to the color distortion. In other words, when puncture is performed using C-mode images, arteries and veins can be identified, but the image of the puncture needle is also obscured. As a result, it becomes impossible to determine the location of the tip of the puncture needle, which can lead to serious accidents. Therefore, during interventions, the image mode is usually switched from C-mode to B-mode, and the puncture needle is inserted by referring to the B-mode image. When puncture is performed using B-mode images, it is possible to determine the location of the puncture needle.

[0007] Furthermore, an ultrasound diagnostic device is known that displays B-mode and C-mode images side-by-side during needle insertion (see Patent Document 1). [Prior art documents] [Patent Documents]

[0008] [Patent Document 1] Japanese Patent Publication No. 2011-229837 [Overview of the project] [Problems that the invention aims to solve]

[0009] However, simply displaying B-mode and C-mode images side-by-side requires the operator to shift their gaze from side to side. This poses a significant risk during real-time punctures, which require precise technique.

[0010] The object of the present invention is to provide an ultrasound diagnostic apparatus, an ultrasound image display method, and a program that improve safety. [Means for solving the problem]

[0011] To solve the above problems, the ultrasound diagnostic apparatus of the invention described in claim 1 is An ultrasonic probe that transmits and receives ultrasonic waves, A generation unit that generates an ultrasonic image based on ultrasonic data obtained by transmitting and receiving ultrasonic waves, A display unit for displaying the ultrasound image, The system includes a control unit that simultaneously displays on the display unit the position of the tip of the puncture needle within the blood vessel and the distinction between arteries and veins in the blood vessel, as shown in the ultrasound image, in a single ultrasound image.

[0012] The invention described in claim 2 is an ultrasound diagnostic apparatus described in claim 1, The control unit displays the generated ultrasound image using information on the position of the tip of the puncture needle within the blood vessel displayed in the ultrasound image and information distinguishing between arteries and veins in the blood vessel.

[0013] The invention described in claim 3 is an ultrasound diagnostic apparatus described in claim 1, The control unit displays the first ultrasound image using ultrasound image data generated from information on the position of the tip of the puncture needle within the blood vessel displayed in the ultrasound image, and ultrasound image data generated using information that distinguishes between arteries and veins in the blood vessel.

[0014] The invention described in claim 4 relates to the ultrasound diagnostic apparatus described in claim 2 or 3, A Doppler data generation unit that generates Doppler data from the aforementioned ultrasonic data, The system comprises at least one of the following generation units: a B-mode data generation unit that generates B-mode data from the aforementioned ultrasonic data, and a B-mode data generation unit that generates B-mode data from the aforementioned ultrasonic data. The control unit either displays the tip position information and the color Doppler image generated using the Doppler data simultaneously in a single ultrasound image, or displays the B-mode data information and the distinction between arteries and veins in the blood vessels simultaneously in a single ultrasound image.

[0015] The invention described in claim 5 is an ultrasound diagnostic apparatus according to claim 1, A Doppler data generation unit that generates Doppler data from the aforementioned ultrasonic data, The system includes a B-mode data generation unit that generates B-mode data from the aforementioned ultrasonic data, The control unit displays the single ultrasound image as a video using the Doppler data and the B-mode data.

[0016] The invention described in claim 6 is an ultrasound diagnostic apparatus according to claim 1, The control unit switches between a mode that displays the position of the tip of the puncture needle within the blood vessel in an identifiable manner, and a mode that displays the distinction between arteries and veins in the blood vessel in an identifiable manner.

[0017] The invention described in claim 7 is an ultrasound diagnostic apparatus described in claim 1, An acquisition unit that acquires structural information of blood vessels from the aforementioned ultrasound data, A first determination unit that determines that it is a blood vessel from the aforementioned structural information, It comprises a second determination unit that determines whether the blood vessel is an artery or a vein based on information characteristic of the blood vessel, The control unit distinguishes between arteries and veins in the blood vessels based on the determination result from the second determination unit.

[0018] The invention described in claim 8 is an ultrasound diagnostic apparatus described in claim 7, The acquisition unit acquires the structural information of the blood vessels. Analysis using machine learning-trained models, Pattern recognition of a luminal object, Doppler signals from blood vessels, Pulsations from blood vessels, It is acquired based on any one of the information.

[0019] The invention according to claim 9 is the ultrasonic diagnostic apparatus according to claim 7, The second determination unit, Information on the thickness and hardness of the blood vessel wall of the blood vessel, Information on the blood flow velocity based on the Doppler signal from the blood vessel, Information on the pulsation intensity from the blood vessel, Based on any one of the information, it determines whether the blood vessel is an artery or a vein.

[0020] The invention according to claim 10 is the ultrasonic diagnostic apparatus according to claim 7, The control unit, On the B-mode image, at least one of an artery and a vein is displayed as a blood vessel image, Distinguishing the artery and the vein by the color of the annotation, Distinguishing by the color of the blood vessel wall of the blood vessel, Distinguishing by displaying character information on the blood vessel, By making at least one of the distinctions, the artery and the vein of the blood vessel are distinguished.

[0021] The invention according to claim 11 is the ultrasonic diagnostic apparatus according to claim 7, The range for acquiring the structural information of the blood vessel from the image is an area on the extension of the advancing direction in which the puncture needle penetrates.

[0022] The ultrasonic image display method of the invention according to claim 12 is An ultrasonic probe that transmits and receives ultrasonic waves, A generation unit that generates an ultrasonic image based on the ultrasonic data obtained by the transmission and reception of the ultrasonic waves, A display unit that displays the ultrasonic image, and is an ultrasonic image display method of an ultrasonic diagnostic apparatus including A control step that simultaneously displays the position of the tip of the puncture needle within the blood vessel and the distinction between arteries and veins in the blood vessel, as shown in the ultrasound image, in a single ultrasound image. Includes.

[0023] The program of the invention described in claim 13 is An ultrasonic probe that transmits and receives ultrasonic waves, A generation unit that generates an ultrasonic image based on ultrasonic data obtained by transmitting and receiving ultrasonic waves, A computer for an ultrasound diagnostic apparatus, which includes a display unit for displaying the ultrasound image, A control unit that displays on the display unit the position of the tip of the puncture needle within the blood vessel and the distinction between arteries and veins in the blood vessel, which are displayed in the ultrasound image, in a single ultrasound image. To make it function as such. [Effects of the Invention]

[0024] According to the present invention, it is possible to provide an ultrasound diagnostic apparatus, an ultrasound image display method, and a program that improve safety. [Brief explanation of the drawing]

[0025] [Figure 1] This is a schematic diagram showing an ultrasound diagnostic apparatus according to the first embodiment of the present invention. [Figure 2] This is a block diagram showing the functional configuration of an ultrasound diagnostic device. [Figure 3] This is a flowchart showing the first ultrasound image display process. [Figure 4] The composite image screen is shown in the diagram. [Figure 5] This is a flowchart showing the second ultrasound image display process. [Figure 6] This diagram shows the switching between the B-mode image screen and the C-mode image screen. [Figure 7] This is a flowchart showing the third ultrasound image display process. [Figure 8] This is a diagram showing a B-mode image screen. [Figure 9] This is a diagram showing a B-mode image screen. [Figure 10] This is a diagram showing a B-mode image screen. [Figure 11] This is a diagram showing a B-mode image screen. [Modes for carrying out the invention]

[0026] The advantages and features provided by one or more embodiments of the present invention will be better understood from the following detailed description and accompanying drawings. However, these drawings are for illustrative purposes only and are not intended to define any limitations of the invention. Embodiments of the present invention will be described below with reference to the drawings. However, the scope of the invention is not limited to the disclosed embodiments.

[0027] (First Embodiment) A first embodiment of the present invention will be described with reference to Figures 1 to 4. First, the configuration of the ultrasound diagnostic apparatus 100 of this embodiment will be described with reference to Figures 1 and 2. Figure 1 is a schematic diagram showing the ultrasound diagnostic apparatus 100 of this embodiment. Figure 2 is a block diagram showing the functional configuration of the ultrasound diagnostic apparatus 100.

[0028] The ultrasound diagnostic device 100 is installed in medical facilities such as hospitals. As shown in Figure 1, the ultrasound diagnostic device 100 comprises an ultrasound diagnostic device body 1, an ultrasound probe 2, and a puncture needle 3. The ultrasound diagnostic device body 1 has an operation unit 11 and a display unit 17. The ultrasound probe 2 is connected to the ultrasound diagnostic device body 1. The ultrasound probe 2 transmits ultrasound (transmitting ultrasound) into the subject and receives reflected ultrasound waves (reflected ultrasound: echo) reflected from within the subject. The subject is the living body of a patient, etc. (not shown). The ultrasound probe 2 has an ultrasound probe body 21, a cable 22, and a connector 23. The ultrasound probe body 21 is the head part of the ultrasound probe 2 and transmits and receives ultrasound. The cable 22 is connected to the ultrasound probe body 21 and the connector 23. The cable 22 carries the drive signal for the ultrasound probe body 21 and the ultrasound reception signal. Connector 23 is a plug connector that connects to the connector (not shown) of the receptacle on the ultrasound diagnostic device body 1.

[0029] The ultrasound diagnostic device body 1 is connected to the ultrasound probe body 21 via a connector 23 and a cable 22. The ultrasound diagnostic device body 1 transmits an electrical drive signal to the ultrasound probe body 21, causing the ultrasound probe body 21 to transmit ultrasound to the subject. The ultrasound probe body 2 generates a received signal, which is an electrical signal, in response to the reflected ultrasound from within the subject that is received by the ultrasound probe body 21. Based on the received signal generated by the ultrasound probe body 2, the ultrasound diagnostic device body 1 images the internal state of the subject as ultrasound image data.

[0030] The ultrasonic probe body 21 has a transducer 211 (Figure 2) at its tip. The transducer 211 is arranged in a one-dimensional array, for example, in the azimuth direction (scanning direction). The transducer 211 may also be arranged in a two-dimensional array. The number of transducers 211 can be set arbitrarily. In this embodiment, a linear scanning electronic scan probe is used as the ultrasonic probe 2. However, the ultrasonic probe 2 may be either an electronic scanning or a mechanical scanning type. The ultrasonic probe 2 may also be a linear scanning, sector scanning, or convex scanning type. Communication between the ultrasonic diagnostic device body 1 and the ultrasonic probe 2 may be wireless instead of wired communication via cable 22. This wireless communication may be UWB (Ultra Wide Band), etc.

[0031] Furthermore, the ultrasound probe body 21 has an orientation mark 212 on its housing. The orientation mark 212 is an orientation mark on the ultrasound probe 2 side and corresponds to the orientation mark 41 (Figure 4, etc.) on the displayed ultrasound image. The orientation mark 212 is a protrusion located on one end of the longitudinal direction of the arranged transducer 211 on the housing of the ultrasound probe body 21. The orientation mark 212 allows the operator, such as a doctor or technician, to recognize whether the left or right side of the transducer 211 in the longitudinal direction corresponds to the left or right side of the displayed ultrasound image. The operator can recognize whether the position of the orientation mark 212 is on the cardiac side or the peripheral side of the subject. Therefore, by referring to the orientation mark 41, the operator can recognize which side of the ultrasound image is on the cardiac side.

[0032] The display unit 17 has a display panel such as an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display, or an inorganic EL display. The display unit 17 displays display information such as ultrasonic image data on the display panel.

[0033] The operation unit 11 is a control panel or the like that receives various operation inputs from the operator. The operation unit 11 has operation elements such as push buttons, encoders, lever switches, joysticks, trackballs, keyboards, touchpads, and multifunction switches.

[0034] The puncture needle 3 is a hollow, elongated needle-shaped instrument that is inserted into a patient or other subject freehand at a predetermined angle by the operator. The puncture needle 3 can be replaced with needles of appropriate thickness, length, and tip shape depending on the site of sample collection or the type and amount of medication to be injected. The puncture needle 3 may also be attached to the ultrasound probe 2 by an adapter. The operator inserts the puncture needle 3 into the subject while observing the ultrasound image displayed by the ultrasound diagnostic device 100.

[0035] As shown in Figure 2, the ultrasound diagnostic device body 1 comprises an operation unit 11, a transmission unit 12, a reception unit 13, an image generation unit 14, an image processing unit 15, a display control unit 16, a display unit 17, a control unit 18, and a storage unit 19. The image generation unit 14 functions as a generation unit. The control unit 18 functions as a control unit, an acquisition unit, a first decision unit, and a second decision unit.

[0036] The operation unit 11 receives various operation inputs from the operator and outputs the operation signals to the control unit 18. The operation unit 11 may be integrally formed with the display screen of the display unit 17 and may include a touchscreen that receives touch input from the operator.

[0037] The transmitting unit 12, in accordance with the control of the control unit 18, supplies a drive signal, which is an electrical signal, to the ultrasonic transducer 2 to generate transmitted ultrasonic waves to the ultrasonic transducer 2. The transmitting unit 12 includes, for example, a clock generation circuit, a delay circuit, and a pulse generation circuit. The clock generation circuit generates a clock signal that determines the transmission timing and transmission frequency of the drive signal. The delay circuit sets a delay time for each individual path corresponding to each transducer 211 and delays the transmission of the drive signal by the set delay time. The delay circuit focuses the transmitted beam, which is composed of transmitted ultrasonic waves, by this delay. The pulse generation circuit generates a pulse signal as a drive signal at a predetermined period. The transmitting unit 12 generates transmitted ultrasonic waves by driving a continuous portion (for example, 64) of the multiple (for example, 192) transducers 211 arranged in the ultrasonic transducer 2. Then, each time the transmitting unit 12 generates transmitted ultrasonic waves, it scans by shifting the driven transducer 211 in the azimuth direction (scanning direction).

[0038] The receiving unit 13 receives the received signal, which is an electrical signal, from the ultrasonic transducer 2 according to the control of the control unit 18. The receiving unit 13 includes, for example, an amplifier, an A / D conversion circuit, and a phase-correcting summing circuit. The amplifier amplifies the received signal at a preset amplification factor for each individual path corresponding to each transducer 211. The A / D conversion circuit converts the amplified received signal from analog to digital (A / D conversion). The phase-correcting summing circuit adjusts the phase of the A / D converted received signal by applying a delay time to each individual path corresponding to each transducer 211, and then adds these together (phase-correcting summing) to generate sound line data.

[0039] The image generation unit 14 includes a B-mode image generation unit 141 and a C-mode image generation unit 142. The B-mode image generation unit 141 functions as a B-mode data generation unit. The C-mode image generation unit 142 functions as a Doppler data generation unit. The B-mode image generation unit 141 performs envelope detection processing, logarithmic compression, etc., on the sound line data from the receiving unit 13, in accordance with the control unit 18. The B-mode image generation unit 141 performs brightness conversion by adjusting the dynamic range and gain through this process. The B-mode image generation unit 141 generates B-mode image data consisting of pixels having brightness values ​​as received energy through this brightness conversion. In other words, the B-mode image data represents the strength of the received signal in terms of brightness.

[0040] The C-mode image generation unit 142 generates C-mode image data from the sound line data from the receiving unit 13, in accordance with the control of the control unit 18. The C-mode image generation unit 142 includes, for example, a quadrature detection circuit, a corner turn control unit, an MTI (Moving Target Indication) filter, a correlation calculation unit, a data conversion unit, a noise reduction spatial filter unit, an interframe filter, and a C-mode image conversion unit.

[0041] The quadrature detection circuit, under the control of the control unit 18, quadrature detects the C-mode received signal (sound line data) input from the receiving unit 13. The quadrature detection circuit calculates the phase difference between the color Doppler mode received signal acquired by quadrature detection and the reference signal, and obtains (complex) Doppler signals I and Q. The corner turn control unit, under the control of the control unit 18, arranges the Doppler signals I and Q input from the quadrature detection circuit. The arrangement is in the depth direction from the ultrasound probe to the subject and in the ensemble direction of the number of sampling counts n in ultrasound transmission and reception, for each acoustic line. The corner turn control unit stores the arranged Doppler signals I and Q in memory (not shown) and reads out the Doppler signals I and Q in the ensemble direction for each depth. The received signal (Doppler signals I and Q) contains not only the blood flow signal component necessary for C-mode image generation, but also unnecessary information such as blood vessel walls and tissues (clutter component). The MTI filter, in accordance with the control of the control unit 18, filters the Doppler signals I and Q input from the corner turn control unit to remove clutter components.

[0042] The correlation calculation unit calculates the real part D and imaginary part N of the average value S of the autocorrelation calculation in the Doppler signal from the Doppler signals I and Q from the MTI filter, according to the control of the control unit 18. The Doppler signals I and Q are complex Doppler signals z. The average value S of the autocorrelation calculation in the Doppler signal is the average value of the phase difference vector. The data conversion unit calculates the blood flow components from the Doppler signals I and Q from the MTI filter, and the real part D and imaginary part N of the average value S of the autocorrelation calculation, according to the control of the control unit 18. The blood flow components are blood flow velocity, power, and dispersion.

[0043] The noise reduction spatial filter unit filters the power, blood flow velocity, and dispersion calculated by the data conversion unit, according to the control of the control unit 18. The inter-frame filter filters the blood flow components from the noise reduction spatial filter unit between frames, according to the control of the control unit 18. The inter-frame filter selects the blood flow components that constitute the C-mode image from the noise reduction spatial filter unit. The inter-frame filter filters the selected blood flow components to smooth the changes between frames and leave an afterimage. The C-mode image conversion unit, according to the control of the control unit 18, color maps the blood flow components from the inter-frame filter and converts them into C-mode image data to generate it. For example, in C-mode image data corresponding to blood flow velocity, blood flow flowing toward the ultrasound probe 2 is represented in red. In C-mode image data, blood flow flowing away from the probe is represented in blue.

[0044] The image processing unit 15 has an image memory unit 151. The image memory unit 151 is composed of a semiconductor memory such as DRAM (Dynamic Random Access Memory). The image processing unit 15 processes the B-mode image data and C-mode image data input from the image generation unit 14 according to the control unit 18 and stores them in the image memory unit 151 on a frame-by-frame basis. The image processing unit 15 outputs the ultrasonic image data stored in the image memory unit 151 to the display control unit 16 at predetermined intervals, one frame at a time.

[0045] In this embodiment, the image processing unit 15 performs an enhancement process to highlight the tip portion of the puncture needle 3 in B-mode image data obtained by scanning a subject including the puncture needle 3. The image processing unit 15 performs appropriate processing on the B-mode image data to extract and identify the tip portion image of the puncture needle 3. The image processing unit 15 enhances the extracted tip portion image of the puncture needle 3 as tip position information. The enhancement of the tip portion image is, for example, by increasing its brightness. As a method for identifying the tip position of the puncture needle 3, for example, the method described in Japanese Patent Publication No. 6123458 is used. In this method, the image processing unit 15 generates motion evaluation information that indicates the evaluation of motion by taking the difference and correlation between frames from B-mode image data of multiple frames. The image processing unit 15 calculates the movement speed of the tip of the puncture needle 3, detects the tip position of the puncture needle 3 from the movement speed of the tip of the puncture needle 3 and the motion evaluation information, and identifies the position of the puncture needle 3 including the tip portion. Alternatively, the subsequent tip position may be estimated based on the movement history of the tip of the puncture needle 3, the tip position may be detected based on the estimated position, and the position of the puncture needle 3 including the tip may be identified. Alternatively, a method may be used in which a contour is detected and selected from the first contour candidates obtained by input from the operator via the control unit 11. In this method, the position of the puncture needle 3 including the tip is identified using the selected contour and the aforementioned estimated position as a reference.

[0046] Alternatively, the tip portion image of the puncture needle 3 may be generated using a pre-trained machine learning model. This pre-trained model is trained using B-mode image data of the puncture needle scanned within the subject and the tip position information of the puncture needle as training data. This pre-trained model is stored, for example, in the memory unit 19, and when B-mode image data of the puncture needle 3 scanned within the subject is input, it outputs the tip position information of the puncture needle 3 in the B-mode image.

[0047] Furthermore, the image processing unit 15 performs image processing by combining B-mode image data and C-mode image data from the same time period to generate a single composite image data as ultrasound image data.

[0048] The display control unit 16, in accordance with the control unit 18, performs processing such as coordinate transformation on the ultrasonic image data input from the image processing unit 15 and converts it into an image signal for display. The display control unit 16 outputs the image signal to the display unit 17.

[0049] The display unit 17 displays an ultrasound image based on the image signal output from the display control unit 16 on the display panel, in accordance with the control of the control unit 18. The display unit 17 also displays various display information input from the control unit 18 on the display panel.

[0050] The control unit 18 includes, for example, a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory). The control unit 18 reads various processing programs stored in the ROM, loads them into the RAM, and controls various parts of the ultrasound diagnostic device 100 in cooperation with the CPU and the loaded programs. The ROM is composed of non-volatile memory such as semiconductors. The ROM stores a system program corresponding to the ultrasound diagnostic device 100, various processing programs that can be executed on the system program, and various data such as gamma tables.

[0051] In particular, the ROM stores the first ultrasound image display program. The first ultrasound image display program is a program for executing the first ultrasound image display process, which will be described later. The first ultrasound image display process generates and displays composite image data consisting of B-mode image data including tip position information indicating the tip position of the puncture needle 3, and C-mode image data including blood flow images. This program is stored in RAM in the form of computer-readable program code. The CPU sequentially executes operations according to the program code in RAM. RAM forms a work area that temporarily stores various programs executed by the CPU and data related to these programs.

[0052] The memory unit 19 is a memory unit such as an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores information such as ultrasonic image data in a writable and readable format.

[0053] Next, the operation of the ultrasound diagnostic device 100 will be explained with reference to Figures 3 and 4. Figure 3 is a flowchart of the first ultrasound image display process. Figure 4 shows the composite image screen 400.

[0054] An ultrasound diagnostic device 100 is set up in the examination room of a medical facility. The operator, such as a doctor or technician, and the patient to be treated are already in the examination room. The operator performs the intervention on the patient, who is a living organism, for example, placed on an examination table, using a puncture needle 3. To do this, the operator places the ultrasound probe 2 on the surface of the patient.

[0055] In the ultrasound diagnostic device 100, the operator inputs an instruction to execute the first ultrasound image display process via the operation unit 11. Triggered by this input, the control unit 18 executes the first ultrasound image display process according to the first ultrasound image display program stored in the ROM.

[0056] As shown in Figure 3, first, the control unit 18 controls the transmitting unit 12, the receiving unit 13, and the B-mode image generation unit 141 to generate one frame of B-mode image data (step S11). The control unit 18 controls the transmitting unit 12, the receiving unit 13, and the C-mode image generation unit 142 to generate one frame of C-mode image data (step S12). The B-mode image data from step S11 and the C-mode image data from the immediately following step S12 are assumed to be from the same time.

[0057] The control unit 18 controls the image processing unit 15 to perform image processing on the B-mode image data generated in step S11 to generate tip position information of the puncture needle 3 (step S13). The tip position information in step S13 consists of a tip portion image and a tip highlighting image that indicate the tip position of the puncture needle 3. The tip portion image is an image of the puncture needle 3 in the B-mode image that shows and enhances (increases the brightness of) the tip position. In step S13, the image processing unit 15 detects the tip position of the puncture needle 3 in the B-mode image and highlights the tip portion image of that tip position. The tip highlighting image is an image that clearly indicates the tip position of the puncture needle 3 over a wide area.

[0058] The control unit 18 controls the image processing unit 15 to combine the B-mode image data generated in step S13 and the C-mode image data generated in step S12 (step S14). The B-mode image data generated in step S13 is B-mode image data that includes tip position information. In step S14, the control unit 18 generates a combined image data of one frame through this combination.

[0059] The control unit 18 controls the display control unit 16 to display the composite image of the composite image data together with the orientation mark 41 on the display unit 17 (step S15). The orientation mark 41 is positioned at the left or right edge of the composite image, corresponding to the orientation mark 212.

[0060] The control unit 18 receives a termination instruction from the operator via the operation unit 11 and determines whether to terminate or not (step S16). If not to terminate (step S16; NO), the process proceeds to step S11. By repeating steps S11 to S16, the composite image data is displayed as a live image, which is a real-time video. If to terminate (step S16; YES), the first ultrasound image display process ends.

[0061] Referring to Figure 4, a composite image screen 400 as an example of what is displayed in the first ultrasound image display processing will be explained. Here, puncture is performed using the parallel method. The parallel method is a method of puncturing the puncture needle 3 on a plane that includes the azimuthal arrangement of the transducers 211. The composite image screen 400 has a composite image 401 and an orientation mark 41. The composite image 401 has vascular images 404, 405, blood flow images 406, 407, and a puncture needle image 42. The vascular images 404 and 405 are cross-sectional images of different blood vessels of the subject, parallel to the long axis (axial direction). The puncture needle image 42 is a B-mode image showing the puncture needle 3. The puncture needle image 42 has a tip portion image 402 and a tip indication image 403 as tip position information. The tip portion image 402 is a B-mode image positioned and enhanced on the tip portion of the puncture needle 3. The tip indication image 403 is, for example, a circular image showing the tip portion of the puncture needle 3 centered on it.

[0062] The composite image 401 is an ultrasound image of the composite image data, which is a composite of a B-mode image and a C-mode image. The orientation mark 41 is located, for example, at the left edge of the composite image 401 and corresponds to the orientation mark 212. When the orientation mark 212 is on the cardiac side or peripheral side of the subject, the operator can visually identify the cardiac side and peripheral side of the composite image 401 from the orientation mark 41 of the composite image 401.

[0063] Blood flow images 406 and 407 are images showing the direction and velocity of blood flow in the subject in C-mode imaging, respectively. Blood flow image 406 shows the blood flow in vascular image 404, for example, showing red (blood flow direction toward ultrasound probe 2). Blood flow image 407 shows the blood flow in vascular image 404, for example, showing blue (blood flow direction away from ultrasound probe 2). The orientation mark 41 and blood flow image 406 allow the operator to visually confirm that the blood vessels in vascular image 404 are arteries with blood flow direction from the heart to the periphery. The orientation mark 41 and blood flow image 407 allow the operator to visually confirm that the blood vessels in vascular image 405 are veins with blood flow direction from the periphery to the heart.

[0064] The tip-revealing image 403 has a larger area than the tip-part image 402. Therefore, even if the tip-part image 402 is hidden by the blood flow images 406 and 407, the operator can still visually confirm the tip position of the puncture needle 3 using the tip-revealing image 403. Furthermore, it is preferable that the composite image 401 is generated such that the tip-part image 402 and the tip-revealing image 403 are always superimposed in front of the blood flow images 406 and 407.

[0065] Without the orientation mark 41, it would be unclear which side of the composite image 401 is the cardiac side and which is the peripheral side. However, at least the blood flow images 406 and 407 can be seen to be different colors from each other. Therefore, the operator can recognize that one of the blood vessels in the vascular images 404 and 405 is an artery and the other is a vein.

[0066] As described above, according to this embodiment, the ultrasound diagnostic apparatus 100 comprises an ultrasound probe 2, an image generation unit 14, a display unit 17, and a control unit 18. The ultrasound probe 2 transmits and receives ultrasound waves. The image generation unit 14 generates ultrasound image data based on the received signals (sound line data) obtained by transmitting and receiving ultrasound waves. The display unit 17 displays the ultrasound image data. The control unit 18 displays tip position information and blood flow images 406, 407 on the display unit 17 so that they can be simultaneously identified in a single composite image 401. The tip position information consists of a tip portion image 402 and a tip-revealing image 403. The blood flow images 406, 407 indicate the distinction between arteries and veins in blood vessels.

[0067] As described in Patent Document 1, the parallel display of B-mode and C-mode images on a single screen increases the amount of information. Therefore, operators are prone to confusion and hesitation. This is especially likely to occur during real-time puncture or when the operator is inexperienced. In this embodiment, the tip position information of the B-mode image and the blood flow images 406 and 407 of the C-mode image are mixed on the image and displayed simultaneously in a single composite image 401 for identification. This eliminates operator confusion and improves the safety of the ultrasound diagnostic device 100 during vascular puncture using the puncture needle 3. Furthermore, since the tip position information and blood flow images 406 and 407 indicating the position of the blood vessel are automatically detected, the burden on the operator is reduced.

[0068] Furthermore, the control unit 18 displays a single composite image 401 generated using the tip portion image 402, the tip-revealing image 403, and the blood flow images 406 and 407. This allows the operator to simultaneously identify the tip position information of the puncture needle 3 within the blood vessel displayed on the ultrasound image, and the distinction between arteries and veins in the blood vessel, all within a single composite image 401.

[0069] Furthermore, the control unit 18 displays a single composite image 401 using B-mode image data and C-mode image data. The B-mode image data is generated with an image 402 of the tip portion of the puncture needle 3 inside the blood vessel and an image 403 showing the tip, as displayed in the B-mode image. The C-mode image data is generated with blood flow images 406 and 407. More specifically, the ultrasound diagnostic device 100 includes a C-mode image generation unit 142 and a B-mode image generation unit 141. The C-mode image generation unit 142 generates C-mode image data from the received signal. The B-mode image generation unit 141 generates B-mode image data from the received signal. The control unit 18 displays the image 402 of the tip portion of the puncture needle 3, the image 403 showing the tip, and the C-mode image simultaneously in a single composite image 401 so that they can be identified. Furthermore, the control unit 18 displays the B-mode image and the blood flow images 406 and 407 simultaneously in a single composite image 401 so that they can be identified. Therefore, the operator can simultaneously identify the tip position information of the puncture needle 3 inside the blood vessel displayed in the B-mode image, and the distinction between arteries and veins in the blood vessel, all within a single composite image 401.

[0070] Furthermore, the control unit 18 uses C-mode data and B-mode data to display a single composite image data as a video. Therefore, in real-time puncture, the operator can simultaneously identify the tip position information of the puncture needle 3 inside the blood vessel and the distinction between arteries and veins in a single composite image 401.

[0071] (Second Embodiment) A second embodiment of the present invention will be described with reference to Figures 5 and 6. Figure 5 is a flowchart showing the second ultrasonic image display process. Figure 6 is a diagram showing the switching between the B-mode image screen 410 and the C-mode image screen 420.

[0072] As with the first embodiment, the apparatus configuration of this embodiment uses an ultrasound diagnostic apparatus 100. However, the ROM of the control unit 18 stores a second ultrasound image display program instead of the first ultrasound image display program. The second ultrasound image display program is a program for executing the second ultrasound image display process, which will be described later.

[0073] Next, the operation of the ultrasound diagnostic device 100 will be explained with reference to Figures 5 and 6. Similar to the first ultrasound image display process, the ultrasound diagnostic device 100 receives an instruction from the operator to execute the second ultrasound image display process via the operation unit 11. Triggered by this input, the control unit 18 executes the second ultrasound image display process according to the second ultrasound image display program stored in the ROM.

[0074] Steps S21 and S22 are the same as steps S11 and S14 of the first ultrasound image display process in Figure 3, respectively. However, in step S22, a tip position indication image is not generated as tip position information. However, a tip position indication image may be generated. The control unit 18 controls the display control unit 16 to display the B-mode image of the B-mode image data on the display unit 17 together with the orientation mark 41 (step S23). The B-mode image data displayed in step S23 includes the tip position information generated in step S22. Step S24 is the same as step S16 in Figure 3.

[0075] If the process does not terminate (step S24; NO), the control unit 18 determines whether a predetermined time t1 has elapsed since the start of the previous B-mode image display (step S25). The predetermined time t1 is the display switching time between the B-mode image and the C-mode image. Approximately simultaneous means switching and displaying with a difference of the predetermined time t1 (for example, 0.1 seconds). For example, at a display frame rate of 15fps, the tip portion image 402 and the blood flow images 406, 407 are displayed on the display unit 17 approximately simultaneously so that they can be identified simultaneously in a pair of ultrasound images within a time difference of 1 frame (approximately 0.067 seconds). If the predetermined time t1 has not elapsed (step S25; NO), the process proceeds to step S21. If the predetermined time t1 has elapsed (step S25; YES), the control unit 18 executes step S26. Step S26 is the same as step S12 in Figure 3.

[0076] The control unit 18 controls the display control unit 16 to display the C-mode image of the C-mode image data on the display unit 17 together with the orientation mark 41 (step S27). Step S28 is the same as step S24. If the process is completed (step S24 or S28; YES), the second ultrasound image display process is completed. If the process is not completed (step S28; NO), the control unit 18 executes step S29. Step S29 is the same as step S25. If the predetermined time t1 has not elapsed (step S29; NO), the process proceeds to step S26. If the predetermined time t1 has elapsed (step S29; YES), the process proceeds to step S21.

[0077] Referring to Figure 6, the switching between the B-mode image screen 410 and the C-mode image screen 420, as an example of what is displayed in the second ultrasound image display processing, will be explained. The B-mode image screen 410 has a B-mode image 411 and an orientation mark 41. The B-mode image 411 has a puncture needle image 42 and blood vessel images 404 and 405. The puncture needle image 42 has a tip portion image 402 as tip position information. The C-mode image screen 420 has a C-mode image 421 and an orientation mark 41. The puncture needle image 42 has a tip portion image 402 as tip position information. The C-mode image 421 has blood flow images 406 and 407.

[0078] The B-mode image screen 410 and the C-mode image screen 420 are switched and displayed at predetermined time intervals t1. Therefore, the frame in which the tip portion image 402 of the puncture needle 3 on the B-mode image screen 410 is hidden by the blood flow images 406 and 407 on the C-mode image screen 420 is not displayed. Thus, by switching the display, the operator can clearly see that the tip portion image 402 is being punctured inside the blood vessels in the blood vessel images 404 and 405. At the same time, the operator can clearly see that the blood vessels in the blood vessel images 404 and 405 are arteries and veins, respectively, using the orientation mark 41 and the blood flow images 406 and 407.

[0079] As described above, according to this embodiment, the control unit 18 displays the tip portion image 402 and the blood flow images 406 and 407 on the display unit 17 so that they can be simultaneously identified in a set of ultrasound images. The tip portion image 402 is the tip position information of the puncture needle 3 in the blood vessel displayed in the B-mode image. The blood flow images 406 and 407 indicate the distinction between arteries and veins in the blood vessel. Here, "displaying simultaneously" includes displaying them approximately simultaneously, as in this embodiment. "Approximately simultaneously" includes switching between displays with a predetermined time difference (e.g., ** seconds).

[0080] Therefore, in this embodiment, the tip position information of the B-mode image and the blood flow images 406 and 407 of the C-mode image are mixed in time and displayed simultaneously in a single set of ultrasound images for identification. This eliminates confusion for the operator and improves the safety of the ultrasound diagnostic device 100 when puncturing blood vessels using the puncture needle 3. In addition, since the tip position information and the blood flow images 406 and 407 indicating the position of the blood vessel are detected automatically, the burden on the operator is reduced.

[0081] Furthermore, the control unit 18 displays a set of ultrasound images generated using the tip portion image 402 and the blood flow images 406 and 407. This allows the operator to simultaneously identify the tip position information of the puncture needle 3 within the blood vessel and the distinction between arteries and veins in the blood vessel, all within a single set of ultrasound images.

[0082] Furthermore, the control unit 18 displays a set of ultrasound images using B-mode image data and C-mode image data. The B-mode image data is generated with an image 402 of the tip portion of the puncture needle 3 inside the blood vessel displayed in the B-mode image. The C-mode image data is generated with blood flow images 406 and 407. Therefore, the operator can simultaneously identify the tip position information of the puncture needle 3 inside the blood vessel displayed in the B-mode image, and the distinction between arteries and veins in the blood vessel, all within a single set of ultrasound images. The set of ultrasound images consists of a B-mode image 411 and a C-mode image 421.

[0083] Furthermore, the control unit 18 displays the tip position information of the puncture needle 3 and the C-mode image in a single set of ultrasound images so that they can be identified simultaneously. In addition, the control unit 18 displays the B-mode image and the blood flow images 406 and 407 in a single set of ultrasound images so that they can be identified simultaneously. As a result, the operator can simultaneously identify the tip position information of the puncture needle 3 in the blood vessel displayed in the B-mode image, and the distinction between arteries and veins in the blood vessel, all within a single set of ultrasound images.

[0084] Furthermore, the control unit 18 switches between displaying a B mode, which allows for the identification of the tip position of the puncture needle 3 within the blood vessel, and a C mode, which allows for the identification of whether the blood vessel is an artery or a vein. Therefore, in real-time puncture, the operator can simultaneously identify the tip position information of the puncture needle 3 within the blood vessel and the distinction between arteries and veins in a single set of ultrasound images.

[0085] (Third embodiment) A third embodiment of the present invention will be described with reference to Figures 7 to 11. Figure 7 is a flowchart of the third ultrasonic image display process. Figure 8 is a diagram showing the B-mode image screen 430. Figure 9 is a diagram showing the B-mode image screen 440. Figure 10 is a diagram showing the B-mode image screen 450. Figure 11 is a diagram showing the B-mode image screen 460.

[0086] As with the first embodiment, the apparatus configuration of this embodiment uses an ultrasound diagnostic apparatus 100. However, the ROM of the control unit 18 stores a third ultrasound image display program instead of the first ultrasound image display program. The third ultrasound image display program is a program for executing the third ultrasound image display process, which will be described later.

[0087] Next, the operation of the ultrasound diagnostic device 100 will be explained with reference to Figures 7 to 11. Similar to the first ultrasound image display process, the ultrasound diagnostic device 100 receives an instruction from the operator via the operation unit 11 to execute the third ultrasound image display process. Triggered by this input, the control unit 18 executes the third ultrasound image display process according to the third ultrasound image display program stored in the ROM.

[0088] Steps S31 and S32 are the same as steps S11 and S14 of the first ultrasound image display processing in Figure 3, respectively. However, in step S32, an image indicating the tip position as tip position information is not generated. However, an image indicating the tip position may be generated. The control unit 18 obtains structural information showing the structure of blood vessels from the B-mode image data generated in step S31 by the image processing unit 15 (step S33).

[0089] In step S33, the control unit 18 acquires structural information of blood vessels using analysis information from a trained model, pattern recognition information of tubular objects, Doppler signal information from blood vessels, or pulsation information from blood vessels. Analysis information using a trained model is acquired using a trained model that has been previously trained using B-mode image data including blood vessels and structural information of said blood vessels as training data. This trained model is stored, for example, in the memory unit 19, and when B-mode image data including blood vessels is input, it analyzes and outputs structural information of said blood vessels. The control unit 18 inputs the B-mode image data generated in step S31 into the trained model and acquires the analysis result as structural information of the blood vessels of the subject.

[0090] The pattern recognition information for tubular objects is recognition information that recognizes the short-axis image of a blood vessel (a cross-sectional image perpendicular to the axial direction of the blood vessel) as a tubular object. Pattern recognition of tubular objects is performed by recognizing the image pattern of B-mode image data using comparison image data of tubular objects to which structural information is associated. The control unit 18 uses the comparison image data of the tubular object to perform pattern recognition on the short-axis image of the blood vessel in the B-mode image data generated in step S31. The control unit 18 acquires the recognition result as structural information of the blood vessel of the subject.

[0091] The Doppler signal information from the blood vessels is the color Doppler signal information corresponding to the blood vessels included in the B-mode image. In step S31, the control unit 18 generates C-mode image data at the same time using the C-mode image generation unit 142, along with the B-mode image data. The control unit 18 acquires structural information of the blood vessels based on the blood flow velocity and other factors of the C-mode image data corresponding to the blood vessels included in the B-mode image.

[0092] The information about pulsation from blood vessels is the information about the pulsation of blood vessels contained in the B-mode images of the video. The control unit 18 performs image analysis on multiple frames of B-mode image data, including the B-mode image data generated in step S31, to determine the pulsation of the blood vessels contained therein. Based on the pulsation information obtained from the analysis, the control unit 18 acquires structural information of the blood vessels.

[0093] The area from which structural information of blood vessels is acquired from the B-mode image data is preferably the region that lies on the extension of the direction of travel of the puncture needle 3.

[0094] The control unit 18 determines, based on the acquired structural information of the blood vessels, whether or not the B-mode image of the B-mode image data generated in step S31 contains blood vessels (step S34). If there are no blood vessels (step S34; NO), the control unit 18 controls the display control unit 16 to display the B-mode image of the B-mode image data on the display unit 17 (step S35). The B-mode image data displayed in step S35 includes the tip position information generated in step S32. Step S36 is the same as step S16 in Figure 3. If the process is to terminate (step S36; YES), the third ultrasound image display process is terminated. If the process is not to terminate (step S36; NO), the process proceeds to step S31.

[0095] If a blood vessel is present (step S34; YES), the control unit 18 determines whether the blood vessel is an artery or a vein (step S37). In step S37, the control unit 18 determines whether the blood vessel is an artery or a vein based on information characteristic of the blood vessel, such as information on the thickness and stiffness of the blood vessel wall, information on blood flow velocity from the Doppler signal from the blood vessel, or information on the pulsation intensity from the blood vessel.

[0096] Information on the thickness and stiffness of the blood vessel walls is contained in the B-mode image. The control unit 18 performs image analysis on the B-mode image data generated in step S31 to measure the thickness of the blood vessel walls. Alternatively, the control unit 18 calculates the ultrasonic reflectance from the B-mode image data generated in step S31, or generates elastography image data by transmitting and receiving ultrasonic waves. The control unit 18 obtains the stiffness of the blood vessel walls from the ultrasonic reflectance or elastography image data. Arteries have relatively thick blood vessel walls and relatively stiff blood vessel walls. Veins have relatively thin blood vessel walls and relatively soft blood vessel walls. For example, arteries and veins can be distinguished using thresholds for the thickness and stiffness of the blood vessel walls.

[0097] The blood flow velocity information from the Doppler signal from the blood vessels is the blood flow velocity information from the color Doppler signal in the blood vessels included in the B-mode image. In step S31, the control unit 18 generates C-mode image data at the same time using the C-mode image generation unit 142 along with the B-mode image data. The control unit 18 acquires the blood flow velocity from the C-mode image data corresponding to the blood vessels included in the B-mode image. Arteries have a relatively high blood flow velocity. Veins have a relatively low blood flow velocity. For example, arteries and veins can be distinguished by discrimination using a threshold for the blood flow velocity of the blood vessels.

[0098] The information on pulsation intensity from blood vessels is the information on the pulsation intensity of blood vessels contained in the B-mode images of the video. The control unit 18 performs image analysis on the pulsation intensity of the blood vessels contained in the B-mode image data of multiple frames, including the B-mode image data generated in step S31. The control unit 18 obtains the pulsation intensity information from the analysis results. Arteries have a relatively strong pulsation intensity. Veins have a relatively weak pulsation intensity. For example, arteries and veins can be distinguished by discrimination using a threshold for the pulsation intensity of blood vessels.

[0099] The control unit 18 generates arteriovenous identification information (step S38) based on the determination result of the arteries and veins of the blood vessel in step S37, using the image processing unit 15. The arteriovenous identification information is an image placed near the blood vessel to identify the arteries and veins of that blood vessel.

[0100] The control unit 18 displays B-mode image data, including the tip position information from step S32 and the arteriovenous identification information from step S38, on the display unit 17 (step S39). The process then proceeds to step S36.

[0101] Referring to Figures 8 to 11, B-mode image screens 430, 440, 450, and 460, which are examples of images displayed in the third ultrasound image display processing, will be explained. As shown in Figure 8, B-mode image screen 430 has a B-mode image 431. The B-mode image 431 has a puncture needle image 42, blood vessel images 404 and 405, and arterial identification information 432 and vein identification information 433 as arteriovenous identification information. The puncture needle image 42 has a tip portion image 402 as tip position information. The arterial identification information 432 is positioned along the outside of the blood vessel in the blood vessel image 404, which is a long-axis view, and is an image that indicates that the blood vessel is an artery. The color of the arterial identification information 432 is, for example, red, but is not limited to this. The vein identification information 433 is positioned along the outside of the blood vessel in the blood vessel image 405, which is a long-axis view, and is an image that indicates that the blood vessel is a vein. The color of the vein identification information 433 is, for example, blue, but is not limited to this.

[0102] As shown in Figure 9, the B-mode image screen 440 has a B-mode image 441. The B-mode image 441 has a puncture needle image 42, blood vessel images 404 and 405, and arteriovenous identification information, including arterial identification information 442, vein identification information 443, and text information 444 and 445. The arterial identification information 442 is an arrow image that is placed near the outside of the blood vessel in the long-axis view of the blood vessel image 404 and serves as annotation to indicate that the blood vessel is an artery. The arrow points to the blood vessel image 404. The color of the arterial identification information 442 is, for example, red, but is not limited to this. The text information 444 is placed near the arterial identification information 442 and is text information that indicates that the blood vessel pointed to by the arterial identification information 442 is an artery. The vein identification information 443 is an arrow image that is placed near the outside of the blood vessel in the long-axis view of the blood vessel image 405 and serves as annotation to indicate that the blood vessel is a vein. The arrow points to the blood vessel image 405. The color of the vein identification information 443 is, for example, red, but is not limited to this. The character information 445 is placed near the vein identification information 443 and is character information indicating that the blood vessel pointed to by the vein identification information 443 is a vein.

[0103] As shown in Figure 10, the B-mode image screen 450 has a B-mode image 451. The B-mode image 451 has a puncture needle image 42, vascular images 408 and 409, and arteriovenous identification information, namely arterial identification information 452 and vein identification information 453. The vascular images 408 and 409 are short-axis images of different blood vessels of the subject, respectively. The arterial identification information 452 is positioned along the outside of the blood vessel in the short-axis vascular image 408 and is an image indicating that the blood vessel is an artery. The color of the arterial identification information 452 is, for example, red, but is not limited to this. The vein identification information 453 is positioned along the outside of the blood vessel in the short-axis vascular image 409 and is an image indicating that the blood vessel is a vein. The color of the vein identification information 453 is, for example, blue, but is not limited to this.

[0104] As shown in Figure 11, the B-mode image screen 460 has a B-mode image 461. The B-mode image 461 has a puncture needle image 42, blood vessel images 408 and 409, and arteriovenous identification information, including arterial identification information 462, vein identification information 463, and text information 464 and 465. The arterial identification information 462 is an arrow image that is placed near the outside of the blood vessel in the short-axis view of the blood vessel image 408 and serves as an annotation to indicate that the blood vessel is an artery. The arrow points to the blood vessel image 408. The color of the arterial identification information 462 is, for example, red, but is not limited to this. The text information 464 is placed near the arterial identification information 462 and is text information that indicates that the blood vessel pointed to by the arterial identification information 462 is an artery. The vein identification information 463 is an arrow image that is placed near the outside of the blood vessel in the short-axis view of the blood vessel image 409 and serves as an annotation to indicate that the blood vessel is a vein. The arrow points to the blood vessel image 409. The color of the vein identification information 463 is, for example, red, but is not limited to this. The text information 465 is placed near the vein identification information 463 and is text information that indicates that the blood vessel pointed to by the vein identification information 463 is a vein.

[0105] As described above, according to this embodiment, the control unit 18 displays the tip portion image 402, arterial identification information 432-462, and vein identification information 433-463 on the display unit 17 so that they can be simultaneously identified in a single B-mode image 431-461. The tip portion image 402 is information on the tip position of the puncture needle 3 within the blood vessel displayed in the B-mode image. The arterial identification information 432-462 and vein identification information 433-463 are arteriovenous identification information that indicates the distinction between arteries and veins in the blood vessel.

[0106] Therefore, in this embodiment, the tip position information and arteriovenous identification information of the B-mode image are mixed on the image and displayed simultaneously in a single B-mode image for identification. This eliminates confusion for the operator and improves the safety of the ultrasound diagnostic device 100 when puncturing blood vessels with the puncture needle 3. Furthermore, since the ultrasound diagnostic device 100 automatically detects the tip position information and arteriovenous identification information and displays the distinction between arteries and veins, the burden on the operator is reduced. Moreover, unlike C-mode images, the blood vessel is not filled in to indicate the direction of blood flow, so the operator can easily recognize the puncture needle 3 inserted into the blood vessel in the B-mode image.

[0107] Furthermore, the control unit 18 acquires structural information of blood vessels from the received signal. The control unit 18 determines from the structural information that it is a blood vessel. Based on information characteristic of blood vessels, the control unit 18 determines whether the blood vessel is an artery or a vein. Based on the determination result, the control unit 18 distinguishes between arteries and veins. Therefore, by automatically detecting the presence or absence of blood vessels and distinguishing between arteries and veins, the burden on the operator can be reduced.

[0108] Furthermore, the control unit 18 acquires structural information of blood vessels through analysis using a pre-trained model developed through machine learning, pattern recognition of tubular objects, Doppler signals from blood vessels, or information on pulsation from blood vessels. Therefore, the presence or absence of blood vessels can be detected accurately and easily. When using information from analysis using a pre-trained model developed through machine learning, structural information of blood vessels can be distinguished in B-mode images regardless of the signal quality for detecting arteries and veins.

[0109] Furthermore, the control unit 18 determines whether a blood vessel is an artery or a vein based on information about the thickness and stiffness of the blood vessel wall, information about blood flow velocity from the Doppler signal from the blood vessel, or information about the pulsation intensity from the blood vessel. This allows for accurate and easy detection of whether a blood vessel is an artery or a vein.

[0110] Furthermore, the control unit 18 displays at least one of arteries and veins on the B-mode images 431-461 in the vascular image. Alternatively, the control unit 18 distinguishes arteries and veins using the colors of artery identification information 442,462 and vein identification information 443,463 as annotations. Alternatively, the control unit 18 distinguishes arteries and veins using the colors of artery identification information 432,452 and vein identification information 433,453 placed outside the vessel wall. Alternatively, the control unit 18 displays text information 444-465 on the vessel. The control unit 18 distinguishes arteries and veins in the vascular system using these methods. As a result, the operator can accurately and easily distinguish between arteries and veins in the vascular system.

[0111] Furthermore, the range from which structural information of blood vessels is acquired from B-mode images 431 to 461 is the region along the extension of the direction of travel of the puncture needle 3. Therefore, the operator's attention can be drawn only to the region of interest along the extension of the direction of travel of the puncture needle 3. In addition, since structural information of blood vessels in the entire region is not acquired, the processing load on the ultrasound diagnostic device 100 can be reduced.

[0112] The above description discloses an example in which ROM is used as a computer-readable medium for the program according to the present invention, but the invention is not limited to this example. Other computer-readable mediums that can be used include non-volatile memory such as flash memory and portable recording media such as CD-ROM. Furthermore, carrier waves can also be used in the present invention as a medium for providing program data according to the present invention via a communication line.

[0113] The above descriptions of embodiments are merely examples of the ultrasound diagnostic apparatus, ultrasound image display method, and program according to the present invention, and are not limited thereto. For example, the first to third embodiments may be combined as appropriate.

[0114] Furthermore, in the first and second embodiments, the C-mode image was displayed in the same entire area as the B-mode image, but the configuration is not limited to this. The C-mode image may be displayed only in the region of interest within the entire area. The position and size of the region of interest are set, for example, according to the input of the operator via the operation unit 11.

[0115] While embodiments of the present invention have been described and illustrated in detail, the disclosed embodiments are for illustrative and illustrative purposes only and are not limiting. The scope of the present invention should be interpreted by the terms of the appended claims. [Explanation of symbols]

[0116] 100 Ultrasound diagnostic equipment 1. Ultrasound diagnostic device main unit 11 Control section 12 Transmitter 13 Receiving Unit 14 Image generation unit 15 Image Processing Unit 151 Image memory section 16 Display Control Unit 17 Display section 18 Control Unit 19 Memory section 2 Ultrasonic probe 21 Ultrasonic probe body 211 oscillator 212 Orientation Mark 22 Cables 23 Connectors

Claims

1. An ultrasonic probe that transmits and receives ultrasonic waves, A generation unit that generates an ultrasonic image based on ultrasonic data obtained by transmitting and receiving ultrasonic waves, A display unit for displaying the ultrasound image, An ultrasound diagnostic apparatus comprising: a control unit that simultaneously displays on the display unit the position of the tip of a puncture needle within a blood vessel and the distinction between arteries and veins in the blood vessel, as shown in the ultrasound image, in a single ultrasound image.

2. The ultrasound diagnostic apparatus according to claim 1, wherein the control unit displays the generated ultrasound image using information on the position of the tip of the puncture needle in the blood vessel displayed in the ultrasound image and information on distinguishing between arteries and veins in the blood vessel.

3. The ultrasound diagnostic apparatus according to claim 1, wherein the control unit displays the first ultrasound image using ultrasound image data generated from information on the position of the tip of a puncture needle in a blood vessel displayed in the ultrasound image, and ultrasound image data generated using information that distinguishes between arteries and veins in the blood vessel.

4. A Doppler data generation unit that generates Doppler data from the aforementioned ultrasonic data, The system comprises at least one of the following generation units: a B-mode data generation unit that generates B-mode data from the aforementioned ultrasonic data, and a B-mode data generation unit that generates B-mode data from the aforementioned ultrasonic data. The ultrasound diagnostic apparatus according to claim 2 or 3, wherein the control unit simultaneously displays the tip position information and a color Doppler image generated using the Doppler data in a single ultrasound image so that they can be identified, or simultaneously displays the B-mode data information and the distinction between arteries and veins of the blood vessels in a single ultrasound image so that they can be identified.

5. A Doppler data generation unit that generates Doppler data from the aforementioned ultrasonic data, The system includes a B-mode data generation unit that generates B-mode data from the aforementioned ultrasonic data, The ultrasound diagnostic apparatus according to claim 1, wherein the control unit displays the single ultrasound image as a video using the Doppler data and the B-mode data.

6. The ultrasound diagnostic apparatus according to claim 1, wherein the control unit switches between displaying a mode that allows for the identification of the tip position of the puncture needle within the blood vessel and a mode that allows for the identification of the distinction between arteries and veins in the blood vessel.

7. An acquisition unit that acquires structural information of blood vessels from the aforementioned ultrasound data, A first determination unit that determines that it is a blood vessel from the aforementioned structural information, It comprises a second determination unit that determines whether the blood vessel is an artery or a vein based on information characteristic of the blood vessel, The ultrasound diagnostic apparatus according to claim 1, wherein the control unit distinguishes between arteries and veins of the blood vessels based on the determination result of the second determination unit.

8. The acquisition unit acquires the structural information of the blood vessels. Analysis using machine learning-trained models, Pattern recognition of tubular objects, Doppler signals from blood vessels, Pulsation from blood vessels, The ultrasound diagnostic apparatus according to claim 7, which obtains information using any one of the following pieces of information.

9. The second determination unit described above is: Information on the thickness and stiffness of the blood vessel wall, Information on blood flow velocity from the aforementioned blood vessels via Doppler signals, Information on pulsation intensity from the aforementioned blood vessel, The ultrasound diagnostic device according to claim 7, which determines whether the blood vessel is an artery or a vein based on any one of the pieces of information.

10. The control unit, Displaying at least one of the arteries and veins in the vascular image on the B-mode image, The aforementioned arteries and veins are distinguished by the color of the annotations, Distinguishing them by the color of the blood vessel wall, Distinguishing them by displaying textual information on the aforementioned blood vessels, The ultrasound diagnostic apparatus according to claim 7, which distinguishes between arteries and veins of the blood vessels by making at least one distinction of the following.

11. The ultrasound diagnostic apparatus according to claim 7, wherein the range from which structural information of the blood vessel is acquired from the image is a region that lies on the extension of the direction of travel in which the puncture needle enters.

12. An ultrasonic probe that transmits and receives ultrasonic waves, A generation unit that generates an ultrasonic image based on ultrasonic data obtained by transmitting and receiving ultrasonic waves, An ultrasound diagnostic apparatus comprising a display unit for displaying the ultrasound image, wherein the method for displaying the ultrasound image is as follows: A control step that simultaneously displays the position of the tip of the puncture needle within the blood vessel and the distinction between arteries and veins in the blood vessel, as shown in the ultrasound image, in a single ultrasound image. An ultrasound image display method including

13. An ultrasonic probe that transmits and receives ultrasonic waves, A generation unit that generates an ultrasonic image based on ultrasonic data obtained by transmitting and receiving ultrasonic waves, A computer for an ultrasound diagnostic apparatus, which includes a display unit for displaying the ultrasound image, A control unit that displays on the display unit the position of the tip of the puncture needle within the blood vessel and the distinction between arteries and veins in the blood vessel, which are displayed in the ultrasound image, in a single ultrasound image. A program designed to function as such.

Images