Ultrasound diagnostic device and method for controlling the ultrasound diagnostic device

Abstract

In an ultrasonic diagnostic device and a control method for an ultrasonic diagnostic device according to the present invention, a panoramic image generation unit generates a panoramic image from ultrasonic images or ultrasonic image data of multiple frames included in the same tomographic plane and formed as a result of moving an ultrasonic probe. A non-display region detection unit detects whether or not, in the panoramic image, there is any non-display region that is not being displayed on a display screen. A blood vessel detection unit detects blood vessels within the panoramic image. In the case when the presence of a non-display region is detected and the presence of blood vessels within the non-display region is detected, a notification unit issues a message. This configuration allows a user to easily discern the condition of the blood vessels within the non-display region of the panoramic image when performing blood vessel puncturing while observing the panoramic image.

Description

[Technical Field]

[0001] The present invention relates to an ultrasonic diagnostic apparatus having a function of generating and displaying a panoramic image from a plurality of frames of ultrasonic images, and a method for controlling the ultrasonic diagnostic apparatus. [Background technology]

[0002] When performing vascular puncture using an ultrasound diagnostic device, the following procedure is performed: a blood vessel of a size and depth suitable for puncturing and placing a catheter is searched for in the ultrasound image displayed on the monitor; the presence of surrounding tissues such as nerves, arteries, and organs around the blood vessel is carefully observed and analyzed to determine whether the puncture needle can be safely inserted into the blood vessel, and whether there is a lesion, thrombus, etc.; and if it is determined that the puncture needle can be safely inserted into the blood vessel, the puncture needle is actually inserted.

[0003] When searching for a blood vessel of a suitable size and depth for catheter insertion and placement, the user (examiner) of an ultrasound diagnostic device must select one blood vessel from the many blood vessels present in the ultrasound image. However, since the display screen of most monitors is rectangular and the vertical length differs from the horizontal length, conventional ultrasound diagnostic devices display ultrasound images so that they fit within the display screen.

[0004] For example, as shown in FIG. 12A, when a horizontally long ultrasound image 74 is enlarged to fit within the display screen 72 of the horizontally long monitor 41, and then the monitor 41 is changed to a vertically long position by the user, it has been common to reduce the size of the ultrasound image 74 so that it fits within the display screen 72 of the vertically long monitor 41 without changing the aspect ratio of the ultrasound image 74, as shown in FIG. 12B.

[0005] Here, prior art documents that serve as references for the present invention include ultrasonic imaging devices that perform various processes depending on the orientation of the monitor, such as those disclosed in Patent Documents 1 to 3.

[0006] Patent document 1 describes an ultrasound imaging device that detects rotation within the display screen of a flat panel display unit from position information measured by a position sensor, and optimizes the image information displayed on the display screen of the display unit in accordance with this rotation. Patent Document 2 describes an ultrasonic diagnostic device that detects a change in the posture of a housing and controls the generation of an ultrasonic image in response to this change in the posture of the housing. Patent document 3 describes an ultrasound diagnostic device that detects the posture or posture change of the device body and changes the content of the image displayed on the display screen of the portable device body based on the posture or posture change of the device body. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-323925 [Patent Document 2] Japanese Patent Application Laid-Open No. 2010-057562 [Patent Document 3] Japanese Patent Application Laid-Open No. 2013-165923 Summary of the Invention [Problem to be solved by the invention]

[0008] For example, if you want to observe an ultrasound image over a wider area than the width of one frame of ultrasound image, you need to move the ultrasound probe in the width direction while generating ultrasound images sequentially, and then generate a panoramic image from multiple frames of ultrasound images.

[0009] However, when a user enlarges a panoramic image to check the blood vessels during vascular puncture, only a portion of the enlarged panoramic image can be displayed in real time. As a result, while the user can easily check the blood vessels in the display area of ​​the panoramic image that is displayed on the display screen, the user cannot grasp the condition of the blood vessels in the non-display area that is not displayed on the display screen.

[0010] Therefore, an object of the present invention is to provide an ultrasound diagnostic device and a control method for an ultrasound diagnostic device that allows a user to easily grasp the condition of blood vessels in the non-display area of ​​a panoramic image when performing vascular puncture while observing the panoramic image. [Means for solving the problem]

[0011] In order to achieve the above object, the present invention provides an ultrasonic probe, an ultrasound image generating unit that generates an ultrasound image from ultrasound image data obtained by transmitting and receiving ultrasound beams to and from an examination point of a subject using an ultrasound probe; a panoramic image generating unit that generates a panoramic image from a plurality of frames of ultrasound image data or ultrasound images included in the same tomographic plane formed by moving the ultrasound probe; a monitor having a display screen; a display control unit that displays a panoramic image on a display screen; a non-display area detection unit that detects whether or not there is a non-display area that is not displayed on the display screen in the panoramic image; a blood vessel detection unit that detects blood vessels in a panoramic image; An ultrasonic diagnostic device is provided that includes a notification unit that notifies a message when it is detected that there is a non-display area and that there is a blood vessel in the non-display area.

[0012] Here, it is preferable that the panoramic image generation unit generates a panoramic image from multiple frames of ultrasound image data or ultrasound images generated by moving the ultrasound probe in the width direction of the transducer array of the ultrasound probe along the body surface while the ultrasound probe is in contact with the body surface at the examination point.

[0013] Furthermore, it is preferable that the panoramic image generation unit generates a panoramic image from multiple frames of ultrasound image data or ultrasound images generated by moving the ultrasound probe in a direction from the body surface toward the inside of the body at the examination location or from the inside of the body toward the body surface while the ultrasound probe is in contact with the body surface at the examination location.

[0014] The panoramic image generator performs image analysis on the ultrasound image data or the ultrasound images of the plurality of frames, and generates a panoramic image from the ultrasound image data or the ultrasound images of the plurality of frames based on the results of the image analysis. The non-display area detection unit preferably detects whether or not there is a non-display area by aligning the panoramic image with the ultrasound image of the current frame based on the result of the image analysis.

[0015] The ultrasound probe also includes a motion sensor that detects motion of the ultrasound probe. The panoramic image generator performs image analysis on the ultrasound image data or the ultrasound images of the plurality of frames, and generates a panoramic image from the ultrasound image data or the ultrasound images of the plurality of frames based on the result of the image analysis and the movement of the ultrasound probe. The non-display area detection unit preferably detects whether or not there is a non-display area by aligning the panoramic image with the ultrasound image of the current frame based on the result of the image analysis and the movement of the ultrasound probe.

[0016] Preferably, the panoramic image generator generates the panoramic image from a plurality of frames of ultrasound image data or ultrasound images generated within a certain period from the present to the past.

[0017] Furthermore, it is preferable that the panoramic image generator generates a panoramic image from a plurality of frames of ultrasound image data or ultrasound images generated within one examination period for examining an examination location.

[0018] Furthermore, it is preferable that the panoramic image generator generates the panoramic image from a plurality of frames of ultrasound image data or ultrasound images generated within one contact period during which the ultrasound probe is brought into contact with the body surface at the examination location.

[0019] In addition, it is preferable that the panoramic image generation unit updates the panoramic image using the ultrasound image data or ultrasound image of the current frame when the ultrasound image data or ultrasound image of the current frame is ultrasound image data or ultrasound image within the same tomographic plane as the panoramic image.

[0020] Furthermore, when a blood vessel is detected in the non-display area, the notification unit preferably notifies a message indicating the direction of the blood vessel in the non-display area.

[0021] Furthermore, it is preferable that the notification unit notify a message instructing the panoramic image to be displayed in a reduced size when a blood vessel is detected in the non-display area.

[0022] In addition, it is preferable that the notification unit notify a message instructing the user to change the depth setting of the ultrasound image when it detects that there is a hidden area in a portion of the lower depth direction of the panoramic image.

[0023] The monitor can be rotated between portrait and landscape orientation. Equipped with a posture sensor that detects whether the monitor is in portrait or landscape orientation, It is preferable that the notification unit notifies a message instructing the user to change the orientation of the monitor between portrait and landscape orientations when the monitor is detected to be in a portrait orientation and a non-display area is detected in part of the width of the panoramic image, or when the monitor is detected to be in a landscape orientation and a non-display area is detected in part of the depth of the panoramic image.

[0024] Furthermore, it is preferable that the notification unit notify a message instructing the user to move the ultrasound probe in the direction of the blood vessel in the non-display area.

[0025] Furthermore, it is preferable that the notification unit not notify a message when it detects that a blood vessel is present in the display area but not in the non-display area.

[0026] Also, a condition setting unit is provided for setting conditions for the blood vessel to be punctured, When blood vessels are detected in the display area and the non-display area, the notification unit preferably notifies a message based on a result of comparing the blood vessels in the display area and the non-display area with the condition.

[0027] Furthermore, it is preferable that the notification unit notify a message when a blood vessel is not detected in the display area but a blood vessel is detected in the non-display area.

[0028] Furthermore, it is preferable that the notification unit notify a message indicating that no blood vessels are detected when no blood vessels are detected in the display area or the non-display area.

[0029] The present invention also provides a method for detecting an ultrasound wave from ultrasound image data obtained by transmitting and receiving an ultrasound beam to and from an examination point of a subject using an ultrasound probe, the method comprising: a step in which a panoramic image generating unit generates a panoramic image from a plurality of frames of ultrasound image data or ultrasound images included in the same tomographic plane formed by moving the ultrasound probe; a step of causing a display control unit to display a panoramic image on a display screen of a monitor; a step in which a non-display area detection unit detects whether or not there is a non-display area in the panoramic image that is not displayed on the display screen; a step of detecting blood vessels in the panoramic image by a blood vessel detection unit; The present invention provides a method for controlling an ultrasound diagnostic device, the method including a step in which, when it is detected that there is a non-display area and that there is a blood vessel in the non-display area, a notification unit notifies a message. [Effects of the Invention]

[0030] In the present invention, when a non-display area of ​​a panoramic image that is not displayed on the display screen is detected and when blood vessels are detected within this non-display area, a message is issued. Thus, according to the present invention, the user can easily grasp the condition of the blood vessels within the non-display area by displaying the blood vessels within the non-display area in accordance with the content of the message, thereby enabling safe and reliable vascular puncture. [Brief explanation of the drawings]

[0031] [Figure 1] 1 is a block diagram illustrating the configuration of an ultrasonic diagnostic apparatus according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating a configuration of a transmission / reception circuit according to an embodiment. [Figure 3] FIG. 2 is a block diagram illustrating a configuration of an ultrasound image generating unit according to an embodiment. [Figure 4] FIG. 2 is a block diagram illustrating a configuration of a notification processing unit according to an embodiment. [Figure 5] 1 is a flowchart illustrating an embodiment of the operation of an ultrasound diagnostic device when generating an ultrasound image. [Figure 6] 1 is a flowchart of one embodiment showing the operation of an ultrasound diagnostic device when a user searches for a blood vessel in an ultrasound image when performing vascular puncture. [Figure 7] FIG. 10 is a conceptual diagram illustrating a display screen in a panoramic blood vessel detection mode according to an embodiment. [Figure 8] FIG. 10 is a conceptual diagram illustrating a display screen in a blood vessel detection mode according to an embodiment. [Figure 9] FIG. 1 is a block diagram of an embodiment showing an operation mode switching sequence. [Figure 10] FIG. 10 is a conceptual diagram of an embodiment in which a non-display area occurs in a panoramic image. [Figure 11] FIG. 10 is a conceptual diagram of an embodiment in which a non-display area occurs in a panoramic image. [Figure 12A]FIG. 1 is a conceptual diagram showing a state in which a horizontally long ultrasound image is displayed so as to fit within the display screen of a monitor in a horizontal orientation. [Figure 12B] FIG. 10 is a conceptual diagram showing a state in which a horizontally long ultrasound image is reduced and displayed so as to fit within the display screen of a monitor in a vertical orientation. DETAILED DESCRIPTION OF THE INVENTION

[0032] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The ultrasonic diagnostic apparatus and the method for controlling the ultrasonic diagnostic apparatus of the present invention will be described in detail below based on preferred embodiments shown in the accompanying drawings.

[0033] Figure 1 is a block diagram showing the configuration of an embodiment of an ultrasonic diagnostic apparatus according to the present invention. The ultrasonic diagnostic apparatus shown in Figure 1 is a handheld type ultrasonic diagnostic apparatus, and includes an ultrasonic probe 1 and a device main body 3 connected to the ultrasonic probe 1. The ultrasonic diagnostic apparatus of this embodiment is realized by the ultrasonic probe 1, the handheld type device main body 3, and an ultrasonic diagnosis application program that runs on the device main body 3.

[0034] The ultrasonic probe 1 scans an examination location on a subject with an ultrasonic beam and outputs sound ray signals corresponding to an ultrasound image of the examination location. As shown in Fig. 1, the ultrasonic probe 1 includes a transducer array 11, a transmission / reception circuit 13, a motion sensor 17, and a battery 15. The transducer array 11 and the transmission / reception circuit 13 are bidirectionally connected, and the transmission / reception circuit 13 and the motion sensor 17 are connected to a device control unit 47 of the device main body 3, which will be described later.

[0035] The transducer array 11 has a plurality of ultrasound transducers arranged one-dimensionally or two-dimensionally. Each of these transducers transmits ultrasound waves in accordance with a drive signal supplied from the transmission / reception circuit 13, and receives reflected waves from the subject and outputs an analog reception signal. Each vibrator is constructed using an element in which electrodes are formed on both ends of a piezoelectric body made of, for example, a piezoelectric ceramic such as PZT (Lead Zirconate Titanate), a polymer piezoelectric element such as PVDF (Poly Vinylidene Di Fluoride), or a piezoelectric single crystal such as PMN-PT (Lead Magnesium Niobate-Lead Titanate).

[0036] The transmission / reception circuit 13, under the control of the device control unit 47, causes the transducer array 11 to transmit ultrasonic beams and generates acoustic ray signals by performing reception focusing processing on reception signals output from the transducer array 11 that have received ultrasonic echoes. As shown in Fig. 2, the transmission / reception circuit 13 has a pulser 51 connected to the transducer array 11, and an amplifier 53, an AD (Analog-to-Digital) converter 55, and a beamformer 57 that are connected in series from the transducer array 11 in this order.

[0037] The pulser 51 includes, for example, a plurality of pulse generators, and performs a transmission focusing process in which the delay amount of each drive signal is adjusted and supplied to the plurality of transducers in the transducer array 11 so that the ultrasonic waves transmitted from the plurality of transducers form an ultrasonic beam based on the transmission delay pattern selected by the device control unit 47. When this transmission focusing process applies a pulsed or continuous wave voltage to the electrodes of the transducers in the transducer array 11, the piezoelectric material expands and contracts, and pulsed or continuous wave ultrasonic waves are generated from each transducer, and an ultrasonic beam is formed from the composite wave of these ultrasonic waves.

[0038] The transmitted ultrasonic beam is reflected by an object such as a part of the subject, and propagates toward the transducer array 11 of the ultrasonic probe 1. Each transducer constituting the transducer array 11 expands and contracts upon receiving the ultrasonic echo propagating toward the transducer array 11 in this manner, generating received signals which are electrical signals, and outputs these received signals to the amplifier unit 53.

[0039] The amplifier 53 amplifies the signals input from each transducer constituting the transducer array 11 and transmits the amplified signals to the AD converter 55. The AD converter 55 converts the analog signals transmitted from the amplifier 53 into digital received data and outputs the received data to the beamformer 57.

[0040] The beam former 57 performs a reception focusing process in which each piece of reception data converted by the AD conversion unit 55 is delayed and added in accordance with the sound speed or sound speed distribution set based on the reception delay pattern selected by the device control unit 47. By this reception focusing process, each piece of reception data converted by the AD conversion unit 55 is phased and added, and a sound ray signal in which the focus of the ultrasonic echo is narrowed is generated.

[0041] The motion sensor 17 detects the motion of the ultrasonic probe 1 under the control of the device control unit 47 . The motion sensor 17 is not particularly limited as long as it can detect the movement or position of the ultrasonic probe 1, but examples include an acceleration sensor that detects the movement of the ultrasonic probe 1, a gravity sensor that detects gravity, and a gyro sensor that detects the rotation of the ultrasonic probe 1.

[0042] The battery 15 is built into the ultrasonic probe 1 and supplies power to each circuit of the ultrasonic probe 1.

[0043] Next, the device main body 3 generates and displays an ultrasound image of the examination location of the subject based on the sound ray signals generated by the ultrasound probe 1. The device main body 3 is, for example, a handheld terminal device such as a smartphone or a tablet PC (Personal Computer), and includes an ultrasound image generation unit 31, a posture sensor 33, a notification processing unit 35, a mode switching unit 37, a monitor 41, a display control unit 43, an input device 45, and a device control unit 47, as shown in FIG.

[0044] The ultrasonic image generating unit 31 is connected to the transmission / reception circuit 13 of the ultrasonic probe 1, and a notification processing unit 35 and a mode switching unit 37 are respectively connected to the ultrasonic image generating unit 31. A notification processing unit 35 and a display control unit 43 are respectively connected to the attitude sensor 33. The notification processing unit 35 is connected to the mode switching unit 37, and the mode switching unit 37 is sequentially connected to the display control unit 43 and the monitor 41. A device control unit 47 is connected to the ultrasonic image generating unit 31, the attitude sensor 33, the notification processing unit 35, the mode switching unit 37, and the display control unit 43, and the device control unit 47 is connected to the input device 45.

[0045] The ultrasonic probe 1 and the device main body 3 are connected wirelessly via wireless communication such as Wi-Fi (Wireless Fidelity), or are connected via wired communication such as a USB (Universal Serial Bus) cable.

[0046] The ultrasonic image generating unit 31 generates an ultrasonic image (ultrasonic image signal) of the examination point of the subject from ultrasonic image data, in this embodiment, sound ray signals, obtained by transmitting and receiving ultrasonic beams to and from the examination point of the subject using the ultrasonic probe 1 (more precisely, the transducer array 11), under the control of the device control unit 47. As shown in Fig. 3, the ultrasonic image generating unit 31 has a configuration in which the signal processing unit 21, the DSC 23, and the image processing unit 25 are connected in series.

[0047] In addition, the ultrasonic image data may be any signal or data up to the point where an ultrasonic image is generated, and the ultrasonic image generation unit 31 may generate an ultrasonic image from the signal or data up to the point where an ultrasonic image is generated from the received signal as ultrasonic image data.

[0048] The signal processing unit 21 generates image information data corresponding to an ultrasound image based on the sound ray signals generated by the transmitting / receiving circuit 13. More specifically, the signal processing unit 21 performs signal processing on the sound ray signals generated by the beam former 57 of the transmitting / receiving circuit 13, for example, correcting for attenuation caused by the propagation distance in accordance with the depth of the position where the ultrasound is reflected, and then performs envelope detection processing to generate image information data representing tomographic image information regarding tissues within the subject.

[0049] A DSC (Digital Scan Converter) 23 raster-converts the image information data generated by the signal processing unit 21 into an image signal that conforms to the scanning method of a normal television signal.

[0050] The image processing unit 25 performs various image processing on the image signal input from the DSC 23, such as brightness correction, tone correction, sharpness correction, image size correction, refresh rate correction, scanning frequency correction, and color correction, in accordance with the display format of the monitor 41, to generate an ultrasound image, and outputs the processed ultrasound image to the display control unit 43.

[0051] The monitor (display unit) 41 has a rectangular display screen, and its orientation can be changed to a portrait orientation where the display screen is vertically long or a landscape orientation where the display screen is horizontally long by the user rotating the device main body 3 90 degrees around an axis perpendicular to the display screen, and various information is displayed under the control of the display control unit 43. The monitor 41 is not particularly limited, but examples thereof include an LCD (Liquid Crystal Display) and an organic EL (Electro-Luminescence) display.

[0052] Under the control of the device control unit 47, the orientation sensor 33 detects the orientation (orientation) of the monitor 41, and in this embodiment, whether the orientation (orientation) of the device main body 3 is portrait or landscape. The attitude sensor 33 is not particularly limited as long as it can detect the orientation of the monitor 41, but examples include an acceleration sensor that detects the movement of the device main body 3, a gravity sensor that detects gravity, and a gyro sensor that detects the rotation of the device main body 3.

[0053] The notification processing unit 35 performs various processes for providing notifications regarding blood vessels under the control of the device control unit 47. As shown in FIG. 4 , the notification processing unit 35 has a panoramic image generation unit 61, a non-display area detection unit 63, a blood vessel detection unit 65, a notification unit 67, and a condition setting unit 69.

[0054] The panoramic image generating unit 61 is connected to the ultrasound image generating unit 31, and the non-display area detecting unit 63 and the blood vessel detecting unit 65 are connected to the panoramic image generating unit 61. The non-display area detecting unit 63 is connected to the orientation sensor 33, and the blood vessel detecting unit 65 is connected to the non-display area detecting unit 63. The non-display area detecting unit 63, the blood vessel detecting unit 65, and the condition setting unit 69 are each connected to the notification unit 67. The panoramic image generating unit 61, the blood vessel detecting unit 65, and the notification unit 67 are each connected to the mode switching unit 37.

[0055] The panoramic image generating unit 61 generates a panoramic image from a plurality of frames of ultrasound images included in the same tomographic plane formed by moving the ultrasound probe 1.

[0056] For example, the panoramic image generating unit 61 can generate a panoramic image from multiple frames of ultrasound images generated by moving the ultrasound probe 1 in contact with the body surface at the examination point along the body surface in the width direction of the transducer array 11 of the ultrasound probe 1, in other words, in the arrangement direction of the transducer array 11 of the ultrasound probe 1 corresponding to the width direction of the ultrasound image.

[0057] In addition, the panoramic image generating unit 61 can generate a panoramic image from multiple frames of ultrasound images generated by pressing the body surface of the subject's examination location and moving the probe 1 in a direction from the body surface toward the inside of the body at the examination location, or by releasing the pressure on the body surface and moving the probe 1 in a direction from the inside of the body toward the body surface.

[0058] The same cross-sectional plane is one cross-sectional plane formed by moving the ultrasonic probe 1; in other words, it does not include two or more different cross-sectional planes formed by moving the ultrasonic probe 1. A panoramic image is generated from at least two frames of ultrasound images with different observation ranges. The observation range is the range of the examination point included in ultrasound images generated at different positions within the same cross-sectional plane of the human body (examination area) by moving the ultrasound probe 1.

[0059] The panoramic image generator 61 may generate a panoramic image from a plurality of frames of ultrasound images as in the present embodiment, or may generate a panoramic image from a plurality of frames of ultrasound image data prior to the generation of the ultrasound image. In other words, the panoramic image generator 61 may generate a panoramic image from a plurality of frames of ultrasound image data or ultrasound images. The same applies to the following description of the panoramic image generator 61.

[0060] The non-display area detection unit 63 detects whether or not there is a non-display area that is not displayed on the display screen of the monitor 41 in the panoramic image generated by the panoramic image generation unit 61 .

[0061] The non-display area is the area of ​​the panoramic image that is not displayed on the display screen of the monitor 41 when the panoramic image is displayed on the display screen. In contrast, the area of ​​the panoramic image that is displayed on the display screen is called the display area.

[0062] In the case of a panoramic blood vessel detection mode, which will be described later, the blood vessel detection unit 65 analyzes the panoramic image to detect blood vessels in the panoramic image.

[0063] The blood vessel detection unit 65 detects, for example, short-axis images of all blood vessels in the panoramic image. A short-axis image of a blood vessel is an image of a cross section of the blood vessel cut in a cross section direction perpendicular to the running direction of the blood vessel. Therefore, the short-axis image of a blood vessel represents the area of ​​the cross section of the blood vessel in the cross section direction (blood vessel area).

[0064] The blood vessel detection method is not particularly limited as long as it can detect blood vessels in a panoramic image. The blood vessel detection unit 65 can use various methods for detecting short-axis images of blood vessels from a panoramic image, such as a method using a blood vessel determination model based on machine learning or a method using template matching, as image analysis processing to detect blood vessels in a panoramic image. Blood vessels can also be detected by measuring blood flow using the Doppler method.

[0065] Note that the blood vessel detection unit 65 may detect blood vessels in the panoramic image, and more specifically, blood vessels in the non-display area, when the non-display area detection unit 63 detects that there is a non-display area. This eliminates the need to perform unnecessary blood vessel detection processing when there is no non-display area detected, thereby reducing the processing time and cost involved.

[0066] In addition, the blood vessel detection unit 65 may detect blood vessels in each panoramic image, or may detect blood vessels in each panoramic image once for each of multiple panoramic images, or may calculate the average value of the blood vessels detected from multiple panoramic images.

[0067] Furthermore, in a blood vessel detection mode described later, the blood vessel detection unit 65 detects blood vessels in an ultrasound image. In this case, the blood vessel detection unit 65 operates in the same manner as when detecting blood vessels in a panoramic image, except that it detects blood vessels in an ultrasound image instead of a panoramic image.

[0068] When the non-display area detection unit 63 detects that there is a non-display area and the blood vessel detection unit 65 detects that there is a blood vessel in the non-display area, the notification unit 67 notifies various messages regarding the blood vessel.

[0069] The notification unit 67 is not particularly limited, but for example, under the control of the display control unit 43, it may display various messages on the monitor 41 or output these messages as audio from a speaker (not shown). The notification unit 67 may also notify the user that a message is available by vibrating the device main body 3 using a vibrator (not shown). Furthermore, the notification unit 67 may perform two or more of these in combination.

[0070] The condition setting unit 69 sets the conditions for the blood vessel to be punctured.

[0071] The conditions are not particularly limited, but may be at least one of the upper and lower thresholds for the diameter of the blood vessel to be punctured (for example, xx [mm] or more, yy [mm] or less, etc.), the upper and lower thresholds for the depth of the blood vessel to be punctured, the upper and lower thresholds for the distance between the blood vessel to be punctured and the organs surrounding the blood vessel to be punctured (arteries that cannot be punctured, the heart, etc.), and the presence or absence of disease (thrombus, edema, etc.) in the blood vessel to be punctured and the blood vessels surrounding the blood vessel to be punctured.

[0072] The diameter of the blood vessel to be punctured, the depth of the blood vessel to be punctured, the distance between the blood vessel to be punctured and the surrounding organs, and the presence or absence of disease in the blood vessels surrounding the blood vessel to be punctured can be detected, for example, by image analysis.

[0073] The condition setting unit 69 may change the conditions in response to an instruction from the user. In other words, the user can change the conditions set in the condition setting unit 69.

[0074] Under the control of the device control unit 47, the mode switching unit 37 switches the operation mode of the ultrasound diagnostic device among a normal mode, a blood vessel detection mode, and a panoramic blood vessel detection mode.

[0075] The normal mode is a mode in which an ultrasound image other than a panoramic image is displayed. In the normal mode, the display control unit 43 displays an ultrasound image, but the blood vessel detection unit 65 does not detect blood vessels in the ultrasound image, and the notification unit 67 does not notify a message. The blood vessel detection mode is a mode for detecting blood vessels in an ultrasound image that is not a panoramic image. In the blood vessel detection mode, the display control unit 43 displays an ultrasound image, the blood vessel detection unit 65 detects blood vessels in the ultrasound image, and, if necessary, highlights the blood vessel area, but the notification unit 67 does not notify a message. The panoramic blood vessel detection mode is a mode for detecting blood vessels in a panoramic image. In the panoramic blood vessel detection mode, the display control unit 43 displays a panoramic image, the blood vessel detection unit 65 detects blood vessels in the panoramic image, and the notification unit 67 displays (notifies) a message as necessary.

[0076] The display control unit 43, under the control of the device control unit 47, causes the monitor 41 to display various types of information.

[0077] For example, the display control unit 43 displays an ultrasound image or a panoramic image on the display screen of the monitor 41 based on the orientation of the monitor 41. When the monitor 41 is in a landscape orientation, for example, the ultrasound image is displayed in a portrait orientation on the display screen of the monitor 41 in a landscape orientation. On the other hand, when the monitor 41 is in a portrait orientation, the ultrasound image is displayed in a portrait orientation on the display screen of the monitor 41 in a portrait orientation. In this way, the ultrasound image is always displayed in a portrait orientation on the display screen of the monitor 41, whether the monitor 41 is in a landscape orientation or a portrait orientation. Furthermore, when the monitor 41 is changed from a landscape orientation to a portrait orientation, or from a portrait orientation to a landscape orientation, the ultrasound image is rotated 90 degrees around an axis perpendicular to the display screen, and is always displayed in a portrait orientation on the display screen of the monitor 41. The same applies to panoramic images.

[0078] The input device 45 receives various instructions input by the user. The input device 45 is not particularly limited, but may include, for example, various buttons and a touch panel that is provided on the display screen of the monitor 41 and allows the user to input various instructions by touching the panel.

[0079] The device control unit 47 controls each part of the ultrasonic probe 1 and the device main body 3 based on a pre-stored program and user instructions input from the input device 45 .

[0080] In this embodiment, the ultrasound image generating unit 31, the notification processing unit 35, the mode switching unit 37, the display control unit 43, and the device control unit 47 are configured by a processor 49.

[0081] Next, the operation of the ultrasonic diagnostic apparatus when generating an ultrasonic image will be described with reference to the flowchart of FIG.

[0082] When generating an ultrasound image, first, under the control of the device control unit 36, the transmission / reception circuit 13 starts transmitting ultrasound while the ultrasound probe 1 is in contact with the examination point of the subject, and a sound ray signal is generated (step S1).

[0083] That is, in accordance with the drive signal from the pulser 51, ultrasonic beams are transmitted from the plurality of transducers of the transducer array 11 to the examination location of the subject. The ultrasonic echo from the inspection point based on the ultrasonic beam transmitted from the pulser 51 is received by each transducer of the transducer array 11, and a received signal, which is an analog signal, is output from each transducer of the transducer array 11 that receives the ultrasonic echo. The received signal output from each transducer of the transducer array 11 is amplified by the amplifier 53 and AD converted by the AD converter 55 to obtain received data. Then, the beamformer 57 performs reception focus processing on this reception data, thereby generating sound ray signals.

[0084] Next, under the control of the device control unit 36, the ultrasound image generation unit 31 generates an ultrasound image of the examination location of the subject based on the sound ray signals generated by the beamformer 57 of the transmission / reception circuitry 13 (step S2).

[0085] That is, the sound ray signals generated by the beam former 57 are subjected to various signal processing by the signal processing unit 21, and image information data representing tomographic image information relating to tissues within the subject is generated. The image information data generated by the signal processing unit 21 is then raster converted by the DSC 23, and further subjected to various image processing by the image processing unit 25, thereby generating an ultrasound image.

[0086] Subsequently, under the control of the device control unit 36, the display control unit 43 performs predetermined processing on the ultrasound image generated by the image processing unit 25 and displays it on the monitor 34 (step S3).

[0087] Next, with reference to the flowchart shown in FIG. 6, the operation of the ultrasound diagnostic apparatus when a user searches for a blood vessel within a panoramic image when performing vascular puncture will be described.

[0088] The user can switch between the operating modes: normal mode, vessel detection mode, and panoramic vessel detection mode.

[0089] Fig. 7 is a conceptual diagram showing an embodiment of a display screen in the panoramic blood vessel detection mode. The entire horizontally long panoramic image is displayed in a reduced size in the upper left of the display screen shown in Fig. 7, and a mode switching button is displayed in the lower left of the display screen. A partial area of ​​the panoramic image is displayed in an enlarged size from the center to the right of the display screen, and a message is displayed (notified) at the bottom of this partial area saying, "Even better blood vessels are located to the right."

[0090] In the panoramic blood vessel detection mode, a partial area of ​​the enlarged panoramic image is displayed surrounded by a dashed frame, and an area of ​​the entire panoramic image corresponding to this partial area is displayed surrounded by a dashed frame, as shown in Fig. 7. This allows the user to easily understand which area of ​​the entire panoramic image is being displayed by checking the position of the dashed frame displayed on the entire panoramic image.

[0091] Fig. 8 is a conceptual diagram of one embodiment showing a display screen in blood vessel detection mode. A mode switching button is displayed in the lower left of the display screen shown in Fig. 8. An enlarged ultrasound image is displayed from the center to the right of the display screen.

[0092] The mode switching button displays the current operating mode. In the normal mode, the mode switching button displays "Normal." In the panoramic blood vessel detection mode, as shown in FIG. 7, the mode switching button displays "Panorama Blood Vessel Detection," and in the blood vessel detection mode, as shown in FIG. 8, the mode switching button displays "Blood Vessel Detection." Therefore, the user can easily understand the operating mode by checking the display of the mode switching button.

[0093] Each time the user presses the mode switching button by, for example, a touch operation, the operation mode is switched among the normal mode, the blood vessel detection mode, and the panoramic blood vessel detection mode by the mode switching unit 37. For example, as shown in Fig. 9, each time the user presses the mode switching button, the operation mode is switched sequentially from the normal mode to the blood vessel detection mode, from the blood vessel detection mode to the panoramic blood vessel detection mode, and from the panoramic blood vessel detection mode to the normal mode.

[0094] For example, when a user performs vascular puncture while observing a panoramic image, the user selects the panoramic blood vessel detection mode by a touch operation, and in response, the mode switching unit 37 switches to the panoramic blood vessel detection mode.

[0095] Next, the user holds the monitor 41 in a portrait or landscape orientation, and with the ultrasound probe 1 in contact with the body surface of the subject at the examination point, moves the transducer array 11 of the ultrasound probe 1 in the width direction along the body surface to search for the blood vessel (vein) to be punctured. Alternatively, the user holds the monitor 41 in a portrait or landscape orientation, places the ultrasound probe 1 in contact with the surface of the subject's body at the examination point, and moves the probe in a direction from the surface of the body toward the inside of the body at the examination point, or from the inside of the body toward the body surface, searching for the blood vessel to be punctured.

[0096] In response to this, the ultrasound image generating unit 31 sequentially generates ultrasound images including short-axis images of blood vessels at the examination point of the subject, as described above (step S11). Next, the display control unit 43 sequentially displays the ultrasound images on the display screen of the monitor 41 based on the orientation of the monitor 41 (step S12). In the panoramic blood vessel detection mode, when multiple frames of ultrasound images are generated in step S11, a panoramic image can be generated by combining these multiple frames of ultrasound images. Therefore, in step S12, it is not essential to display the ultrasound images on the display screen of the monitor 41, and this may be performed as needed.

[0097] Meanwhile, the notification processing unit 35 performs various processes for notifying messages related to blood vessels.

[0098] That is, the panoramic image generating unit 61 generates a panoramic image from a plurality of frames of ultrasound images included in the same tomographic plane formed by moving the ultrasound probe 1 (step S13). Next, the display control unit 43 displays the panoramic image on the display screen of the monitor 41 (step S14). Meanwhile, the non-display area detection unit 63 detects whether or not there is a non-display area in the panoramic image that is not displayed on the display screen (step S15). Furthermore, the blood vessel detection unit 65 detects blood vessels in the panoramic image (step S16). In this case, the blood vessels in the display area detected by the blood vessel detection unit 65 may be highlighted by the display control unit 43. Then, when it is detected that there is a non-display area and that a blood vessel is present in this non-display area, the notification unit 67 notifies a message regarding this blood vessel (step S17).

[0099] In this way, when the ultrasound diagnostic device detects that there is a non-displayed area in a panoramic image that is not displayed on the display screen and that a blood vessel is present in this non-displayed area, a message regarding the blood vessel is notified. This allows the user to easily understand the condition of the blood vessel in the non-displayed area by displaying the blood vessel in the non-displayed area according to the content of the message, thereby enabling safe and reliable vascular puncture.

[0100] Next, a case where a non-display area occurs in a panoramic image will be described.

[0101] 10 and 11 are conceptual diagrams of an embodiment in which a non-display area occurs in a panoramic image, in which a panoramic image 71 is indicated by a dashed line and a display screen 72 is indicated by a solid line.

[0102] 10, the monitor 41 is in a portrait orientation, and the landscape-oriented panoramic image 71 is enlarged and displayed without changing the aspect ratio of the panoramic image 71 until the size in the depth direction matches the size in the vertical direction of the display screen 72. In this example, non-display areas are generated on both sides of the width direction of the panoramic image 71 due to the difference between the aspect ratio of the display screen 72 and the aspect ratio of the panoramic image 71, etc.

[0103] 11, the monitor 41 is in a landscape orientation, and the vertically long panoramic image 71 is enlarged and displayed without changing the aspect ratio of the panoramic image 71 until the width of the image matches the left-right size of the display screen 72. In this example, due to the difference between the aspect ratio of the display screen 72 and the aspect ratio of the panoramic image 71, a non-display area is generated in part of the lower depth of the panoramic image 71.

[0104] As described above, not limited to the examples of FIGS. 10 and 11, there are various cases in which non-display areas occur in a panoramic image depending on the difference between the aspect ratio of the display screen and the aspect ratio of the panoramic image.

[0105] Next, a method for generating a panoramic image will be described.

[0106] The panoramic image generator 61 can perform image analysis on a plurality of frames of ultrasound image data or ultrasound images, and generate a panoramic image from the plurality of frames of ultrasound image data or ultrasound images based on the results of the image analysis.

[0107] For example, when the frame rate is high, such as 30 frames per second, even if the user moves the ultrasound probe 1 at high speed when observing a panoramic image, it is likely that the ultrasound images of adjacent frames will contain common parts (identical parts).

[0108] In response to this, the panoramic image generation unit 61 detects common parts in the ultrasound images of adjacent frames based on the results of image analysis, and by aligning and superimposing these common parts, it is possible to sequentially synthesize the ultrasound images of multiple frames to generate a panoramic image. In this case, the non-display area detection unit 63 can detect whether there is a non-display area in the panoramic image by aligning the panoramic image with the ultrasound image (live image) of the current frame based on the results of image analysis.

[0109] Alternatively, the panoramic image generation unit 61 can perform image analysis on multiple frames of ultrasound image data or ultrasound images, and generate a panoramic image from the multiple frames of ultrasound image data or ultrasound images based on the results of the image analysis and the movement of the ultrasound probe 1 detected by the motion sensor 17.

[0110] That is, the panoramic image generation unit 61 detects common parts in the ultrasound images of adjacent frames based on the results of image analysis and the movement of the ultrasound probe 1, and by aligning and superimposing these common parts, it is possible to sequentially synthesize ultrasound image data or ultrasound images of multiple frames to generate a panoramic image. In this case, the non-display area detection unit 63 can detect whether there is a non-display area in the panoramic image by aligning the panoramic image with the ultrasound image of the current frame based on the results of image analysis and the movement of the ultrasound probe 1.

[0111] By combining multiple frames of ultrasound images by taking into account the movement of the ultrasound probe 1 in addition to the results of image analysis, it is possible to combine multiple frames of ultrasound images more accurately than by combining multiple frames of ultrasound images based solely on the results of image analysis.

[0112] Next, the ultrasound images used to generate the panoramic image will be described.

[0113] For example, if the current ultrasound image frame is frame N and a panoramic image is generated from ultrasound images from frame 1 to frame N, various examples of ultrasound image frames used to generate the panoramic image include N frames from frame 1 to N, N-1 frames from frame 1 to N-1, odd-numbered frames from frame 1, 3, 5, ..., N-1, etc.

[0114] In this way, the panoramic image generator 61 can generate a panoramic image from a plurality of frames of ultrasound image data or ultrasound images generated within a certain period from the present to the past.

[0115] The fixed period is not particularly limited, but for example, the panoramic image generation unit 61 can generate a panoramic image from multiple frames of ultrasound image data or ultrasound images generated within a single examination period for examining the examination area.

[0116] An examination period is the period from the start to the end of one examination. This examination period may include a period when the ultrasound probe 1 is removed from the epidermis of the examination site of the subject and then brought back into contact with the epidermis, i.e., a period when the ultrasound probe 1 is not in contact with the epidermis of the examination site. For example, from the viewpoint of the continuity of ultrasound images, ultrasound images taken after being removed from the epidermis for several seconds and then brought back into contact with the epidermis may be used to generate a panoramic image without any problems, but ultrasound images taken after being removed from the epidermis for several minutes or hours and then brought back into contact with the epidermis should not be used to generate a panoramic image. In other words, it is desirable that the panoramic image generator 61 generates a panoramic image from multiple frames of ultrasound image data or ultrasound images generated within a single contact period during which the ultrasound probe 1 is in contact with the body surface at the examination location.

[0117] Next, updating of the panoramic image will be described.

[0118] The number of ultrasound image frames used when updating the panoramic image may or may not be fixed.

[0119] The panoramic image generator 61 may continuously update the panoramic image for each frame of the ultrasound image. For example, the panoramic image generator 61 generates a panoramic image using ultrasound images of frames 1, 2, and 3 among ultrasound images generated in the order of frames 1, 2, 3, 4, and so on, and then sequentially updates the panoramic image using ultrasound images of frames 2, 3, 4, frames 3, 4, 5, and so on.

[0120] Furthermore, the panoramic image generator 61 may update the panoramic image every certain number of frames of the ultrasound image. For example, when updating the panoramic image every 60 frames of the ultrasound image, the panoramic image generator 61 generates the panoramic image using the ultrasound images of frames 1, 2, and 3 among the ultrasound images generated in the order of frames 1, 2, 3, 4, and so on, and then sequentially updates the panoramic image using, for example, ultrasound images of frames 61, 62, 63, frames 121, 122, 123, and so on.

[0121] Furthermore, if the ultrasound image data or ultrasound image of the current frame is ultrasound image data or ultrasound image within the same tomographic plane as the panoramic image, in other words, if there is a common portion between the ultrasound image data or ultrasound image of the current frame and the panoramic image, the panoramic image generating unit 61 may use the ultrasound image data or ultrasound image of the current frame to update the panoramic image in a patchwork manner, for example, by aligning and overlaying the common portion.

[0122] In this case, for each frame of ultrasound image, if the ultrasound image data or ultrasound image of the current frame is not ultrasound image data or ultrasound image within the same tomographic plane, the panoramic image generation unit 61 does not use the ultrasound image data or ultrasound image of the current frame, but if the ultrasound image data or ultrasound image of the current frame is ultrasound image data or ultrasound image within the same tomographic plane, the panoramic image is updated sequentially in a patchwork manner by sequentially combining the ultrasound image data or ultrasound image of the current frame with the panoramic image.

[0123] The size of the updated panoramic image is not fixed, but corresponds to the maximum range of movement of the user when creating the panoramic image. For example, if the user moves the ultrasound probe 1 left and right along the body surface while the ultrasound probe 1 is in contact with the body surface of the subject at the examination location, the size of the updated panoramic image corresponds to the range from the left end to the right end of the movement.

[0124] Next, the notification of a message by the notification unit 67 will be described.

[0125] When a blood vessel is detected in the non-display area, the notification unit 67 may notify a message indicating the direction of the blood vessel in the non-display area. 10, there are non-display areas on both sides of the width of the panoramic image 71, and blood vessels 73 are present in the non-display area on the right side. In this case, the notification unit 67 notifies a message such as "There are blood vessels on the outer right side of the display screen." This allows the user to know that there is a blood vessel 73 on the outer right side of the display screen 72, and accordingly, the user can display and confirm this blood vessel 73.

[0126] The notification unit 67 may also notify a message instructing a specific operation for displaying blood vessels in a non-display area in a display area of ​​a panoramic image displayed on the display screen.

[0127] To explain this by taking a specific example, when a blood vessel is detected in the non-display area, the notification unit 67 may notify a message instructing that the panoramic image be displayed in a reduced size. 11, there is a hidden area in a part of the lower depth direction of the panoramic image 71, and blood vessels 73 are present in this lower hidden area. In this case, the notification unit 67 notifies a message such as "There are still blood vessels in the depth direction, so you can see the blood vessels by zooming out."

[0128] Furthermore, when it is detected that there is a non-display area in a part of the lower depth direction of the panoramic image, the notification unit 67 may notify a message instructing to change the depth setting of the ultrasound image. In the example shown in FIG. 11, the notification unit 67 notifies a message such as "By changing the depth setting, you can visualize blood vessels at deeper positions."

[0129] The notification unit 67 may issue a message instructing the user to change the orientation of the monitor between portrait and landscape orientations when it is detected that the monitor 41 is in a portrait orientation and that there is a non-display area in part of the width of the panoramic image, or when it is detected that the monitor 41 is in a landscape orientation and that there is a non-display area in part of the depth of the panoramic image.

[0130] In the example shown in Figure 11, when the panoramic image is displayed in a reduced size or the depth setting of the ultrasound image is changed, the entire panoramic image may be displayed in a smaller size depending on the orientation of the monitor 41, the aspect ratio of the panoramic image, etc.

[0131] 11, if the virtual rectangular area from the top of the panoramic image to blood vessels 73 in the non-display area is horizontally long, the horizontally long virtual rectangular area can be displayed larger by reducing and displaying the horizontally long virtual rectangular area in the display area of ​​monitor 41 in a horizontally long orientation, rather than displaying the horizontally long virtual rectangular area in the display area of ​​monitor 41 in a vertically long orientation. Therefore, in this case, it is better not to change the orientation of monitor 41 to horizontal.

[0132] 11, if the virtual rectangular area from the top of the panoramic image to blood vessels 73 in the non-display area is vertically long, the vertically long virtual rectangular area can be displayed larger by reducing and displaying the vertically long virtual rectangular area in the display area of ​​monitor 41 in a vertically long orientation, rather than reducing and displaying the vertically long virtual rectangular area in the display area of ​​monitor 41 in a horizontally long orientation. Therefore, in this case, it is better to change the orientation of monitor 41 to a vertically long orientation.

[0133] In this way, if changing the orientation of the monitor 41 allows the virtual rectangular area to be displayed larger than reducing the display of the panoramic image or changing the depth setting, the notification unit 67 prioritizes changing the orientation of the monitor 41 over reducing the display of the panoramic image or changing the depth setting, and notifies the user with a message such as "Please rotate the monitor before reducing the display or changing the depth setting."

[0134] The notification unit 67 may issue a message instructing the user to move the ultrasound probe 1 in the direction of the blood vessel in the non-display area. For example, as shown in Fig. 10, when a blood vessel 73 is present in the non-display area on the right side, the notification unit 67 notifies a message such as "Move the probe to the right to display the blood vessel on the right side." Also, as shown in Fig. 11, when a blood vessel 73 is present in the non-display area on the bottom side, the notification unit 67 notifies a message such as "Move the probe downward to display the blood vessel on the bottom side."

[0135] The notification unit 67 may notify a message based on the detection result of blood vessels in the panoramic image, that is, blood vessels in the display area and the non-display area.

[0136] For example, if blood vessels are detected in the display area but not in the non-display area, the notification unit 67 does not notify a message. In this case, the display control unit 43 may highlight the blood vessels in the display area.

[0137] Furthermore, when blood vessels are detected in the display area and the non-display area, notification unit 67 compares the blood vessels in the display area and the non-display area with the conditions for the blood vessels to be punctured set in condition setting unit 69, and issues a message based on the comparison result. For example, notification unit 67 issues a message regarding whether the blood vessels in the non-display area are better or worse than the blood vessels in the display area as the conditions for the blood vessels to be punctured. For example, when blood vessels in better condition than those in the display area are found in the non-display area to the right, the notification unit 67 notifies the user with a message such as "There are blood vessels in even better condition to the right," as shown in Fig. 7. Furthermore, when blood vessels in worse condition than those in the display area are found in the non-display area, the notification unit 67 notifies the user with a message such as "The blood vessels in the display screen are in better condition," or "The conditions are poor, but there are blood vessels outside the display screen, so please check them."

[0138] In addition, if the notification unit 67 does not detect the presence of blood vessels in the display area but detects the presence of blood vessels in the non-display area, it will notify a message regarding blood vessels in the same way as if it detects the presence of a non-display area and also detects the presence of blood vessels in the non-display area.

[0139] Furthermore, when no blood vessels are detected in the display area or the non-display area, the notification unit 67 notifies a message such as "No blood vessels found" indicating that no blood vessels are detected.

[0140] The present invention is not limited to handheld ultrasonic diagnostic devices, but can also be applied to stationary ultrasonic diagnostic devices or portable ultrasonic diagnostic devices in which the device main body 3 is realized by a laptop-type terminal device. Stationary or portable ultrasonic diagnostic devices are equipped with a monitor whose orientation can be changed to portrait or landscape by the user rotating it 90 degrees, and the orientation sensor 33 is built into the monitor and detects whether the orientation (orientation) of the monitor is landscape or portrait.

[0141] Furthermore, as shown in FIG. 1, the device main body 3 may be provided with an ultrasonic image generating unit 31, but this is not limited thereto, and the entire ultrasonic image generating unit 31 or only the signal processing unit 21 may be provided on the ultrasonic probe 1 side.

[0142] In the device of the present invention, the hardware configuration of the processing unit that performs various processes, such as the transmission / reception circuit 13, ultrasound image generation unit 31, notification processing unit 35, display control unit 43, and device control unit 47, may be dedicated hardware or various processors or computers that execute programs.

[0143] Various types of processors include CPUs (Central Processing Units), which are general-purpose processors that execute software (programs) and function as various processing units, programmable logic devices (PLDs), which are processors whose circuit configuration can be changed after manufacture, such as FPGAs (Field Programmable Gate Arrays), and dedicated electrical circuits, such as ASICs (Application Specific Integrated Circuits), which are processors with circuit configurations designed specifically for performing specific processes.

[0144] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types, for example, a combination of multiple FPGAs, or a combination of an FPGA and a CPU, etc. Also, multiple processing units may be configured with one of the various processors, or two or more of the multiple processing units may be combined into one processor.

[0145] For example, as typified by server and client computers, one processor is configured by combining one or more CPUs and software, and this processor functions as multiple processing units. Another form is the use of a processor that realizes the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip, as typified by system-on-chip (SoC).

[0146] Furthermore, the hardware configuration of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements.

[0147] The method of the present invention can be implemented by, for example, a program that causes a computer to execute each step. Also, a computer-readable recording medium on which this program is recorded can be provided.

[0148] Although the present invention has been described in detail above, the present invention is not limited to the above-described embodiments, and various improvements and modifications may be made without departing from the spirit and scope of the present invention. [Explanation of symbols]

[0149] 1 Ultrasound probe, 3 Device body, 11 Transducer array, 13 Transmitting / receiving circuit, 15 Battery, 17 Motion sensor, 21 Signal processing unit, 23 DSC, 25 Image processing unit, 31 Ultrasound image generation unit, 33 Posture sensor, 35 Notification processing unit, 37 Mode switching unit, 41 Monitor, 43 Display control unit, 45 Input device, 47 Device control unit, 49 Processor, 51 Pulser, 53 Amplification unit, 55 AD conversion unit, 57 Beamformer, 61 Panoramic image generation unit, 63 Non-display area detection unit, 65 Blood vessel detection unit, 67 Notification unit, 69 Condition setting unit, 71 Panoramic image, 72 Display screen, 73 Blood vessel, 74 Ultrasound image.

Claims

1. an ultrasound probe; an ultrasonic image generating unit that generates an ultrasonic image from ultrasonic image data obtained by transmitting and receiving ultrasonic beams to and from an examination point of a subject using the ultrasonic probe; a panoramic image generating unit that generates a panoramic image from a plurality of frames of ultrasound image data or ultrasound images included in the same tomographic plane formed by moving the ultrasound probe; a monitor having a display screen; a display control unit that displays the panoramic image on the display screen; a non-display area detection unit that detects whether or not there is a non-display area in the panoramic image that is not displayed on the display screen; a blood vessel detection unit that detects blood vessels in the panoramic image; an alarm unit that issues a message when it is detected that there is a non-display area and that there is a blood vessel in the non-display area.

2. 2. The ultrasound diagnostic device according to claim 1, wherein the panoramic image generator generates the panoramic image from the plurality of frames of ultrasound image data or ultrasound images generated by moving the ultrasound probe in a width direction of a transducer array of the ultrasound probe along the body surface while the ultrasound probe is in contact with the body surface of the examination area.

3. 2. The ultrasound diagnostic device according to claim 1, wherein the panoramic image generator generates the panoramic image from the plurality of frames of ultrasound image data or ultrasound images generated by moving the ultrasound probe in a direction from the body surface toward the inside of the body at the examination location or from the inside of the body toward the body surface while the ultrasound probe is in contact with the body surface at the examination location.

4. the panoramic image generator performs image analysis on the plurality of frames of ultrasound image data or ultrasound images, and generates the panoramic image from the plurality of frames of ultrasound image data or ultrasound images based on a result of the image analysis; 4. The ultrasound diagnostic device according to claim 1, wherein the non-display area detection unit detects whether the non-display area exists by aligning the panoramic image with the ultrasound image of a current frame based on a result of the image analysis.

5. the ultrasound probe includes a motion sensor that detects motion of the ultrasound probe; the panoramic image generator performs image analysis on the plurality of frames of ultrasound image data or ultrasound images, and generates the panoramic image from the plurality of frames of ultrasound image data or ultrasound images based on a result of the image analysis and a movement of the ultrasound probe; 4. The ultrasound diagnostic device according to claim 1, wherein the non-display area detection unit detects whether or not the non-display area exists by aligning the panoramic image with the ultrasound image of a current frame based on the result of the image analysis and the movement of the ultrasound probe.

6. The ultrasound diagnostic device according to claim 1 , wherein the panoramic image generator generates the panoramic image from the plurality of frames of ultrasound image data or ultrasound images generated within a certain period from the present to the past.

7. The ultrasound diagnostic device according to claim 6 , wherein the panoramic image generator generates the panoramic image from the plurality of frames of ultrasound image data or ultrasound images generated within one examination period for examining the examination location.

8. 8. The ultrasound diagnostic device according to claim 7, wherein the panoramic image generator generates the panoramic image from the plurality of frames of ultrasound image data or ultrasound images generated within a single contact period during which the ultrasound probe is brought into contact with the body surface of the examination location.

9. 9. The ultrasound diagnostic device according to claim 1, wherein the panoramic image generator updates the panoramic image using the ultrasound image data or ultrasound image of the current frame when the ultrasound image data or ultrasound image of the current frame is ultrasound image data or ultrasound image in the same tomographic plane as the panoramic image.

10. 10. The ultrasound diagnostic device according to claim 1, wherein the notification unit, when detecting a blood vessel in the non-display area, notifies a message indicating a direction of the blood vessel in the non-display area.

11. 11. The ultrasound diagnostic device according to claim 1, wherein the notification unit notifies a user of a message instructing the user to reduce the size of the panoramic image when a blood vessel is detected in the non-display area.

12. 11. The ultrasound diagnostic device according to claim 1, wherein the notification unit notifies a user of a message instructing the user to change a depth setting of the ultrasound image when the non-display area is detected to be in a lower portion of the panoramic image in the depth direction.

13. The monitor can be changed in orientation between portrait and landscape orientation, a posture sensor for detecting whether the monitor is in a portrait or landscape orientation; 11. The ultrasound diagnostic device according to claim 1, wherein the notification unit notifies a message instructing the user to change the orientation of the monitor between portrait and landscape orientations when it is detected that the monitor is in a portrait orientation and that the non-display area is present in a portion of the width direction of the panoramic image, or when it is detected that the monitor is in a landscape orientation and that the non-display area is present in a portion of the depth direction of the panoramic image.

14. The ultrasound diagnostic device according to claim 1 , wherein the notification unit notifies a user of a message instructing the user to move the ultrasound probe in a direction toward a blood vessel in the non-display area.

15. 15. The ultrasound diagnostic device according to claim 1, wherein the notification unit does not notify the message when a blood vessel is detected in a display area of ​​the panoramic image displayed on the display screen, but a blood vessel is not detected in the non-display area.

16. a condition setting unit for setting conditions for a blood vessel to be punctured; 16. The ultrasound diagnostic device according to claim 1, wherein, when blood vessels are detected in a display area and a non-display area of ​​the panoramic image, the notification unit notifies the message based on a result of comparing the blood vessels in the display area and the non-display area with the condition.

17. 17. The ultrasound diagnostic device according to claim 1, wherein the notification unit notifies the message when a blood vessel is not detected in a display area displayed on the display screen, but a blood vessel is detected in the non-display area of ​​the panoramic image.

18. 18. The ultrasound diagnostic device according to claim 1, wherein the notification unit notifies a message indicating that no blood vessels are detected when no blood vessels are detected in the display area or the non-display area of ​​the panoramic image displayed on the display screen.

19. an ultrasound image generating unit generating an ultrasound image from ultrasound image data obtained by transmitting and receiving an ultrasound beam to and from an examination point of a subject using an ultrasound probe; a step in which a panoramic image generating unit generates a panoramic image from a plurality of frames of ultrasound image data or ultrasound images included in the same tomographic plane formed by moving the ultrasound probe; a display control unit causing the panoramic image to be displayed on a display screen of a monitor; a non-display area detection unit detecting whether or not there is a non-display area in the panoramic image that is not displayed on the display screen; a blood vessel detection unit detecting blood vessels in the panoramic image; a step of an alarm unit notifying a message when the presence of the non-display area is detected and a blood vessel is detected within the non-display area.

Images