Ultrasonic diagnostic device, ultrasonic image display method, and program

Abstract

To shorten a time required for a workflow of puncturing a nerve region by reducing the number of operation steps of a user.SOLUTION: An ultrasonic diagnostic device includes: image generation means; first reception means; and a display part. The image generation means detects a nerve region N1 from a normal image I1 and generates a nerve emphasizing image I2 by which the nerve region N1 can be identified. The first reception means receives an input operation of a nerve emphasizing button B1. In a state that the nerve emphasizing image I2 is not displayed in the display part, an input operation of a single nerve emphasizing button B1 is received by the first reception means. In this case, the display part displays the normal image I1 and the nerve emphasizing image I2 simultaneously.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an ultrasound diagnostic apparatus, an ultrasound image display method, and a program. [Background technology]

[0002] Conventionally, there has been known an ultrasonic diagnostic apparatus that uses an ultrasonic probe to irradiate ultrasonic waves into the inside of a subject, receives and analyzes the reflected waves, and displays an ultrasonic image of the inside of the subject. The subject is, for example, a living body of a patient.

[0003] Also, a technology is known in which an ultrasound diagnostic device is used to display ultrasound images of a subject to guide the puncture of a puncture needle into a specific anatomical tissue (hereinafter referred to as tissue). Image analysis and AI (Artificial Intelligence) technology are used to detect and recognize tissues in ultrasound images. For example, nerves and their surrounding tissue structures as tissues to be punctured are confirmed before puncturing. At this time, a function (nerve highlighting function) is known that detects and highlights nerve areas to assist users such as doctors.

[0004] There is also known a technique for identifying and displaying targets in a subject. For example, an ultrasound diagnostic device is known that calculates the likelihood distribution of targets from a B (Brightness) mode image using a discrimination model trained by machine learning (see Patent Document 1).

[0005] Also, an ultrasound image diagnostic device is known that has a plurality of classifiers for identifying identification objects, and changes and uses the classifiers in response to user operation input to identify identification objects in an ultrasound image (see Patent Document 2).

[0006] Moreover, a typical ultrasonic diagnostic device has a function of switching between a single-screen display of an ultrasonic image and a dual-screen display in which two ultrasonic images are displayed side by side. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Patent Publication No. 2021-58232 [Patent Document 2] Patent Publication No. 2022-172565 Summary of the Invention [Problem to be solved by the invention]

[0008] The procedure for puncturing the nerve region will now be described. When puncturing the nerve region, it is recommended that the original ultrasound image, as well as the nerve-weighted image, be referred to when confirming the tissue, and that the nerve-weighted image not be displayed when puncturing.

[0009] The operation input unit of the ultrasound diagnostic device has at least a screen number switching button for switching between single screen display and dual screen display, and a nerve emphasis button for turning on / off nerve emphasis image display. First, in the state of single screen live display of a B-mode image, the user presses the screen number switching button to switch to dual screen live display of a B-mode image. The user presses the nerve emphasis button to switch to dual screen live display of a B-mode image and a nerve emphasis image, and observes the tissue at the puncture site.

[0010] The user presses the nerve emphasis button again to return to the dual-screen live display of B-mode images. The user presses the screen number change button again to return to the single-screen live display of B-mode images and then begins the puncture. This required pressing the button four times before the puncture could begin, making the operation cumbersome.

[0011] An object of the present invention is to reduce the number of operations by the user and shorten the time required for the workflow of puncturing a nerve area. [Means for solving the problem]

[0012] In order to solve the above problem, the ultrasonic diagnostic apparatus according to the invention described in claim 1 comprises: an image generating means for detecting a nerve region from a first ultrasound image and generating a second ultrasound image in which the nerve region can be identified; A first receiving means for receiving an input operation; The display unit is configured to simultaneously display the first ultrasound image and the second ultrasound image when a single input operation is accepted by the first accepting means while the second ultrasound image is not being displayed.

[0013] The invention described in claim 2 is the ultrasonic diagnostic apparatus described in claim 1, When the first ultrasonic image and the second ultrasonic image are displayed simultaneously and the single input operation is accepted by the first accepting means, the display unit displays the first ultrasonic image and hides the second ultrasonic image.

[0014] The invention described in claim 3 is the ultrasonic diagnostic apparatus described in claim 1 or 2, A second reception means for receiving an input operation is provided, When a single input operation is accepted by the second accepting means while the first ultrasonic image and the second ultrasonic image are simultaneously displayed, the display unit makes the first ultrasonic image invisible and displays the second ultrasonic image.

[0015] The invention described in claim 4 is the ultrasonic diagnostic apparatus described in claim 1 or 2, The display device is provided with a setting means capable of setting in advance whether, when a single input operation is accepted by the first accepting means while the first ultrasonic image is being displayed and the second ultrasonic image is not being displayed, the first ultrasonic image and the second ultrasonic image are simultaneously displayed on the display unit, or the first ultrasonic image is not displayed and the second ultrasonic image is displayed on the display unit.

[0016] The invention described in claim 5 is the ultrasonic diagnostic apparatus described in claim 1 or 2, A third reception means for receiving an input operation is provided, When an input operation is accepted by the third accepting means while the first ultrasound image is being displayed and the second ultrasound image is not being displayed, the display unit switches the first ultrasound image to the second ultrasound image and displays it.

[0017] The invention described in claim 6 is the ultrasonic diagnostic apparatus described in claim 1 or 2, When the ultrasound image is frozen and displayed, When an input operation is accepted by the first accepting means while the first ultrasonic image and the second ultrasonic image are being displayed, the display unit switches the displayed second ultrasonic image to the first ultrasonic image while maintaining the display of the displayed first ultrasonic image.

[0018] The invention described in claim 7 is the ultrasonic diagnostic apparatus described in claim 6, The display unit switches the displayed second ultrasound image to the first ultrasound image at the same display position.

[0019] The invention described in claim 8 is the ultrasonic diagnostic apparatus described in claim 6, When an input operation is received by the first receiving means while the first ultrasound image that is maintained in display and the first ultrasound image that has been switched and displayed are both displayed, the display unit switches the first ultrasound image that has been switched and displayed to a second ultrasound image while maintaining the display of the first ultrasound image that is maintained in display.

[0020] The ultrasonic image display method according to the invention of claim 9 comprises: an image generating step of detecting a nerve region from the first ultrasound image and generating a second ultrasound image in which the nerve region can be identified; a first reception step for receiving an input operation; The method includes a display process of simultaneously displaying the first ultrasound image and the second ultrasound image when a single input operation is accepted by the first accepting process while the second ultrasound image is not being displayed.

[0021] The program of the invention according to claim 10 comprises: Computer, an image generating means for detecting a nerve region from the first ultrasound image and generating a second ultrasound image in which the nerve region can be identified; a display unit that simultaneously displays the first ultrasonic image and the second ultrasonic image when a single input operation is accepted by a first accepting unit that accepts an input operation while the second ultrasonic image is not being displayed; Function as. Effect of the Invention

[0022] According to the present invention, the number of operations required by the user can be reduced, and the time required for the workflow of puncturing a nerve area can be shortened. [Brief description of the drawings]

[0023] [Figure 1] 1 is a schematic diagram of an ultrasonic diagnostic apparatus according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing the functional configuration of the ultrasound diagnostic apparatus. [Diagram 3] 1A is a diagram showing a displayable area in a single screen display, and FIG. 1B is a diagram showing a displayable area in a dual screen display. [Figure 4] 13 is a flowchart showing a first image display process. [Diagram 5] 13A to 13C are diagrams showing display images and operation buttons in a first image display process. [Figure 6] 11 shows the display image when the number of screens is changed. [Figure 7] 13 is a flowchart showing a second image display process. [Figure 8] 13 is a flowchart showing a third image display process. [Figure 9] 13A to 13C are diagrams showing display images and operation buttons in a first image display process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] Hereinafter, first to third embodiments of the present invention will be described in detail in order with reference to the drawings, however, the scope of the invention is not limited to the illustrated examples.

[0025] (First embodiment) A first embodiment of the present invention will be described with reference to Fig. 1 to Fig. 4. First, the device configuration of this embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a schematic diagram of an ultrasonic diagnostic device 100 of this embodiment. Fig. 2 is a block diagram showing the functional configuration of the ultrasonic diagnostic device 100.

[0026] The ultrasound diagnostic device 100 is installed in a medical facility such as a hospital. As shown in FIG. 1, the ultrasound diagnostic device 100 includes an ultrasound diagnostic device main body 1, an ultrasound probe 2, and a puncture needle 3. The ultrasound diagnostic device main body 1 includes an operation input unit 11 and a display unit 17. The ultrasound probe 2 is connected to the ultrasound diagnostic device main body 1. The ultrasound probe 2 transmits ultrasound (transmitted ultrasound) into a subject, and receives reflected waves of the ultrasound reflected in the subject (reflected ultrasound: echo). The subject is a living body of a patient (not shown). The ultrasound probe 2 includes an ultrasound probe main body 21, a cable 22, and a connector 23. The ultrasound probe main body 21 is a header part of the ultrasound probe 2, and transmits and receives ultrasound. The cable 22 is connected to the ultrasound probe main body 21 and the connector 23. The cable 22 is a cable through which a drive signal for the ultrasound probe main body 21 and a reception signal of ultrasound flow. The connector 23 is a plug connector for connecting to a receptacle connector (not shown) of the ultrasonic diagnostic apparatus main body 1 .

[0027] The ultrasound diagnostic device body 1 is connected to the ultrasound probe body 21 via a connector 23 and a cable 22. The ultrasound diagnostic device body 1 transmits an electric drive signal to the ultrasound probe body 21, causing the ultrasound probe body 21 to transmit ultrasound to the subject. The ultrasound probe 2 generates a reception signal, which is an electric signal, in response to the reflected ultrasound from within the subject and received by the ultrasound probe body 21. The ultrasound diagnostic device body 1 images the internal state of the subject as ultrasound image data based on the reception signal generated by the ultrasound probe 2.

[0028] The ultrasonic probe body 21 has a transducer 2a (FIG. 2) at the tip side. The transducers 2a are arranged in a one-dimensional array in the azimuth direction (scanning direction), for example. The transducers 2a may be arranged in a two-dimensional array. The number of transducers 2a can be set arbitrarily. In the present embodiment, a linear scanning electronic scan probe is adopted as the ultrasonic probe 2. However, the ultrasonic probe 2 may be either an electronic scanning type or a mechanical scanning type. The ultrasonic probe 2 may be either a linear scanning type, a sector scanning type, or a convex scanning type. The ultrasonic diagnostic device body 1 and the ultrasonic probe 2 may be configured to communicate wirelessly instead of by wire via a cable 22. This wireless communication is UWB (Ultra Wide Band) or the like.

[0029] The puncture needle 3 is a treatment tool having a hollow long needle shape, which is inserted (punctured) into a subject such as a patient at an angle determined by a user such as a doctor or an engineer by freehand. The puncture needle 3 can be replaced with one having an appropriate thickness, length, and tip shape according to the part of the subject to be sampled or the type and amount of a drug to be injected. In this embodiment, the part (tissue) to be sampled or a drug to be injected by the puncture needle 3 is a nerve or its surrounding tissue as a target. The puncture needle 3 may be configured to be attached to the ultrasound probe 2 by an adapter. The user inserts the puncture needle 3 into the subject while observing the ultrasound image displayed by the ultrasound diagnostic device 100.

[0030] As shown in Fig. 2, the ultrasound diagnostic device main body 1 includes an operation input unit 11, a transmission unit 12, a reception unit 13, an image generation unit 14, an image processing unit 15, a display control unit 16, a display unit 17, a control unit 18, and a storage unit 19. The operation input unit 11 functions as a first reception means, a second reception means, and a third reception means. The image processing unit 15 functions as an image generation means. The display unit 17 and the control unit 18 function as a display unit. The control unit 18 functions as a setting means.

[0031] The operation input unit 11 accepts input of data such as a command to start a diagnosis from a user such as a doctor or an engineer, and personal information of a subject. The operation input unit 11 has operation elements such as various switches, buttons, a trackball, a mouse, a keyboard, a touch pad, and a multifunction switch for performing this input. The operation input unit 11 accepts operation input from the user via each operation element, and outputs the operation signal to the control unit 18.

[0032] In particular, the operation input unit 11 has a nerve emphasis button B1 (FIG. 5) and a screen number switching button B2 (FIG. 6). The nerve emphasis button B1 is a button that accepts a pressing input for turning on and off the activation of a nerve emphasis function described later. The screen number switching button B2 is a button that accepts a pressing input for switching from a dual-screen display of ultrasound images to a single-screen display described later.

[0033] The operation input unit 11 may be configured to include a touch panel that receives touch input from the user and outputs the touch operation information to the control unit 18. In this case, hard keys such as the nerve emphasis button B1 and the screen number switching button B2 may be configured to be soft keys displayed on the display unit 17.

[0034] The transmitting unit 12 supplies a driving signal, which is an electric signal, to the ultrasonic probe 2 under the control of the control unit 18, to cause the ultrasonic probe 2 to generate a transmission ultrasonic wave. The transmitting unit 12 includes, for example, a clock generating circuit, a delay circuit, and a pulse generating circuit. The clock generating circuit generates a clock signal that determines the transmission timing and transmission frequency of the driving signal. The delay circuit sets a delay time for each individual path corresponding to each transducer 2a, and delays the transmission of the driving signal by the set delay time. The delay circuit focuses a transmission beam formed by the transmission ultrasonic wave by the delay. The pulse generating circuit generates a pulse signal as a driving signal at a predetermined period. The transmitting unit 12 generates a transmission ultrasonic wave by driving, for example, a continuous part (for example, 64 pieces) of a plurality of transducers 2a (for example, 192 pieces) arranged in the ultrasonic probe 2. Then, the transmitting unit 12 scans by shifting the driven transducer 2a in the azimuth direction (scanning direction) every time a transmission ultrasonic wave is generated.

[0035] The receiving unit 13 receives a received signal, which is an electrical signal, from the ultrasonic probe 2 under the control of the control unit 18. The receiving unit 13 includes, for example, an amplifier, an A / D conversion circuit, and a phasing and summing circuit. The amplifier amplifies the received signal by a preset amplification factor for each individual path corresponding to each transducer 2a. The A / D conversion circuit performs analog-to-digital conversion (A / D conversion) of the amplified received signal. The phasing and summing circuit adjusts the time phase by providing a delay time for each individual path corresponding to each transducer 2a to the A / D converted received signal, and adds these (phasing and summing) to generate sound ray data.

[0036] The image generating unit 14 performs envelope detection processing, logarithmic compression, and the like on the sound ray data from the receiving unit 13 under the control of the control unit 18, and performs luminance conversion by adjusting the dynamic range and gain. The image generating unit 14 generates B-mode image data consisting of pixels having luminance values ​​as reception energy through the luminance conversion. In other words, the B-mode image data represents the strength of the reception signal by luminance. The image generating unit 14 may be configured to generate image data of other image modes than B-mode, such as color Doppler mode.

[0037] The image processing unit 15 has an image memory unit 15a. The image memory unit 15a is composed of a semiconductor memory such as a dynamic random access memory (DRAM). The image processing unit 15 stores the B-mode image data transmitted from the image generating unit 14 in the image memory unit 15a in units of frames in accordance with the control of the control unit 18. The B-mode image data in units of frames is sometimes referred to as ultrasonic image data. The image processing unit 15 transmits the ultrasonic image data stored in the image memory unit 15a to the display control unit 16 for one frame at a time at predetermined time intervals in accordance with the control of the control unit 18.

[0038] The image processor 15 also has a nerve emphasis function for identifying and highlighting nerve regions of the subject by color for target identification in the B-mode image of the B-mode image data. By using the nerve emphasis function, the image processor 15 generates nerve-emphasized image data in which the nerve regions are emphasized from the B-mode image data. The highlight color of the nerve regions is a color other than black and white in the B-mode image, for example, yellow. However, it is not limited to yellow.

[0039] The nerve enhancement function may use a method that uses machine learning. For example, machine learning using training data having nerve regions is applied in advance to a classifier that identifies nerve regions from B-mode image data. The classifier is, for example, a convolutional neural network (CNN). The training data is ultrasound image data and ground truth data in which nerve regions in the ultrasound image are labeled with 1. The image processing unit 15 uses the trained classifier to identify nerve regions from B-mode image data, and colors the identified nerve regions to generate nerve-enhanced image data. The trained classifier is stored in the storage unit 19.

[0040] The method of using machine learning for the nerve enhancement function is not limited to the above. For example, as described in Patent Document 1, a method using a classifier that calculates a likelihood indicating the likelihood of a target (nerve) from B-mode image data may be used. The image processing unit 15 uses the trained classifier to generate a likelihood distribution of nerves from the B-mode image data, and adds color information (hue, saturation, brightness) to the B-mode image data according to the likelihood distribution. The image processing unit 15 generates nerve-enhanced image data in which nerves with high likelihood are emphasized with color information.

[0041] In addition, the nerve enhancement function may be configured to use other methods such as image analysis, other than the method using machine learning. For example, the image processing unit 15 may be configured to extract feature points of the nerve region from the B-mode image data, and to identify the nerve region using the extracted feature points to generate nerve-enhanced image data.

[0042] The display control unit 16 performs processes such as coordinate conversion on the B-mode image data and nerve-weighted image data input from the image processing unit 15 under the control of the control unit 18, and converts the data into an image signal for display. The display control unit 16 outputs the image signal to the display unit 17.

[0043] The display unit 17 has a display device such as an LCD (Liquid Crystal Display), an organic EL (Electronic Luminescence) display, an inorganic EL display, a plasma display, etc. The display unit 17 displays display information input from the control unit 18 in accordance with the control of the control unit 18. The display unit 17 also displays an ultrasound image or the like on the display screen in accordance with a display signal of image data input from the display control unit 16 under the control of the control unit 18.

[0044] The control unit 18 includes, for example, a central processing unit (CPU), a read only memory (ROM), and a random access memory (RAM). The control unit 18 reads out various processing programs stored in the ROM, expands them in the RAM, and controls each part of the ultrasonic diagnostic device 100 in cooperation with the expanded programs and the CPU. The ROM is composed of a non-volatile memory such as a semiconductor. The ROM stores a system program corresponding to the ultrasonic diagnostic device 100, various processing programs executable on the system program, and various data such as a gamma table. In particular, the ROM stores a first image display program for executing a first image display process described later. These programs are stored in the RAM in the form of computer-readable program codes. The CPU sequentially executes operations according to the program codes on the RAM. The RAM forms a work area for temporarily storing various programs executed by the CPU and data related to these programs.

[0045] The storage unit 19 is a storage unit such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores information such as ultrasound image data in a writable and readable manner. In particular, the storage unit 19 stores a trained classifier of the above-mentioned nerve enhancement function and preset data.

[0046] The preset data is a set of multiple parameters such as the size and brightness of an ultrasound image. The user can freely name the preset data using the medical department, the observation area, the patient's body shape, etc. The user can select and specify the preset data to be used from multiple preset data before examining (examining) the patient. In particular, each preset data includes screen setting information indicating whether to display one screen or two screens by default when the nerve enhancement function is activated in the first image display process. The single screen display is a method of displaying a B-mode image as a single screen. The two-screen display is a display method in which a B-mode image and a nerve enhancement image are arranged side by side in the left-right direction as two screens. The two-screen display may also be a display in which a B-mode image and a nerve enhancement image are arranged side by side in the top-bottom direction as two screens.

[0047] Here, the displayable area of ​​an ultrasound image in the single screen display and the dual screen display will be described with reference to Fig. 3(a) and Fig. 3(b). Fig. 3(a) is a diagram showing a displayable area 170a in the single screen display. Fig. 3(b) is a diagram showing a displayable area 170b in the dual screen display.

[0048] 3(a), in a single screen display of a B-mode image using the ultrasound probe 2, a displayable area 170a of the B-mode image can be displayed on the display unit 17. The displayable area 170a includes at least an ultrasound image 171 to be displayed.

[0049] As shown in FIG. 3(b), in a dual-screen display of a B-mode image using an ultrasound probe 2, a displayable area 170b of two ultrasound images can be displayed on the display unit 17. In FIG. 3(b), the ultrasound probes 2 are also illustrated as being aligned in the left-right direction because the displayable area 170b is used as a reference. However, in reality, the two ultrasound probes 2 on the drawing are at the same position. The displayable area 170b is a dual-screen display in which a left image 171L shown by a solid line and a right image 171R shown by a solid line are aligned in the left-right direction. The displayable area 170a and the displayable area 170b are the same size.

[0050] The B-mode image generated by the left ultrasound probe 2 includes a left image 171L and a dashed line parting portion 172L at both left and right ends. The B-mode image generated by the right ultrasound probe 2 includes a right image 171R and a dotted line parting portion 172R at both left and right ends. The parting portions 172L and 172R are not displayed because they do not fit within the displayable area 170b. In this way, in the case of dual screen display, the ultrasound image data obtained from the ultrasound probe 2 may not be displayed in its entirety and may be cut off on the display unit 17. In dual screen display with the nerve emphasis function enabled, only the nerve emphasis image may be displayed instead of the B-mode image of the original image by pressing the screen number switching button B2. This makes it possible to observe all areas during the examination even if they are cut off by the dual image display.

[0051] In addition, when the nerve emphasis function is enabled, whether to display two screens or display one screen may be saved and applied as screen setting information in the ultrasound diagnostic device 100. For example, since there is a high possibility that both ends of an image are cut off when the display depth is shallow, the screen setting information may be saved and applied in association with preset data of an observation site. As a result, when using preset data for observing an observation site at a shallow display depth that is not cut off, a single screen display setting is used. When using preset data for observing an observation site at a deep depth, a dual screen display setting is used. This allows the user to observe an ultrasound image with a setting suitable for the purpose. More specifically, the preset data for an observation site corresponding to a normal display depth (such as the abdomen) includes screen setting information in which dual screen display is enabled. The preset data for an observation site corresponding to a shallow depth (such as the neck) includes screen setting information in which single screen display is enabled.

[0052] In addition, when various types of ultrasound probes 2 are associated with each preset data, the preset data to be used may be automatically selected depending on the type of ultrasound probe 2 connected to the ultrasound diagnostic device main body 1.

[0053] Next, the operation of the ultrasound diagnostic apparatus 100 of this embodiment will be described with reference to Fig. 4 to Fig. 6. Fig. 4 is a flow chart showing the first image display process. Fig. 5 is a diagram showing the display image and operation buttons in the first image display process. Fig. 6 shows the display image when the number of screens is switched.

[0054] In the ultrasound diagnostic device 100, it is assumed that a learned classifier for the nerve emphasis function is stored in advance in the storage unit 19. A user such as a doctor uses the ultrasound diagnostic device 100 to examine (test) a patient who is scheduled to have a puncture performed on a target nerve or its surrounding tissue. The user places the ultrasound probe 2 appropriately on the patient's subject.

[0055] In the ultrasonic diagnostic apparatus 100, a user inputs an instruction to execute a first image display process and a selection of preset data in the storage unit 19 via the operation input unit 11. The instruction triggers the control unit 18 to execute the first image display process in accordance with the first image display program in the ROM.

[0056] As shown in Fig. 3, the control unit 18 controls the transmission unit 12, the reception unit 13, the image generation unit 14, the image processing unit 15, and the display control unit 16 to start generating normal image data (step S11). The normal image data is normal (without nerve highlighting) B-mode image data. In step S11, the control unit 18 displays the generated normal image data live on the display unit 17 in a single screen (single screen display and live display). In step S11, for example, after the start of observation in Fig. 5, a normal image I1 in which the nerve region is not highlighted is displayed.

[0057] The control unit 18 determines whether or not the user has pressed the nerve highlighting button B1 of the operation input unit 11 (step S12). If the nerve highlighting button B1 has not been pressed (step S12; NO), the process proceeds to step S12. If the nerve highlighting button B1 has been pressed (step S12; YES), the control unit 18 activates the nerve highlighting display function of the image processing unit 15 (step S13). By activating the nerve highlighting display function, the image processing unit 15 starts generating normal image data and nerve highlighting image data that highlights the nerve area.

[0058] The control unit 18 refers to the screen setting information of the selected and input preset data and determines whether or not dual screen display is enabled (step S14). If dual screen display is enabled (step S14; YES), the control unit 18 displays the generated normal image data and nerve-enhanced image data live on the display unit 17 in dual screen (step S15). In step S15, for example, after the nerve-enhanced button B1 in FIG. 5 is pressed for the first time, the normal image I1 and the nerve-enhanced image I2 are displayed live on dual screen. In FIG. 5, the emphasized nerve region N1 of the nerve-enhanced image I2 is illustrated as a mesh region of white lines. The normal image I1 and the nerve-enhanced image I2 are the same live images in B mode, except for the nerve region N1.

[0059] The control unit 18 determines whether or not the user has pressed the screen count switching button B2 of the operation input unit 11 (step S16). If the screen count switching button B2 has been pressed (step S16; YES), the control unit 18 displays the generated nerve-enhanced image data live on the display unit 17 in a single screen (step S17). In step S17, for example, after the screen count switching button B2 in FIG. 6 is pressed, the nerve-enhanced image I2 is displayed live on a single screen. If the single-screen display is enabled (step S14; NO), the process proceeds to step S17.

[0060] The control unit 18 determines whether or not the user has pressed the nerve highlight button B1 of the operation input unit 11 (step S18). If the screen number switching button B2 has not been pressed (step S16; NO), the process proceeds to step S18. If the nerve highlight button B1 has not been pressed (step S18; NO), the process proceeds to step S16. In steps S11 to S18, the user observes the nerve as a target and its surrounding tissue.

[0061] When the nerve highlight button B1 is input (step S18; YES), the control unit 18 ends the nerve highlight display function of the image processing unit 15 (step S19). Step S19 ends the generation of nerve highlight image data by the image processing unit 15. The control unit 18 displays the generated normal image data live on the display unit 17 in full screen (step S20), and ends the first image display process. In step S20, for example, after the second pressing of the nerve highlight button B1 in FIG. 5, the normal image I1 is displayed live on full screen. The user refers to the normal image I1 displayed live on full screen and inserts the puncture needle 3 into the target nerve or its surrounding tissue.

[0062] As described above, according to this embodiment, the ultrasound diagnostic device 100 includes an image generating means (image processing unit 15), a first receiving means (operation input unit 11), and a display unit (display unit 17, control unit 18). The image generating means detects a nerve region N1 from a normal image I1 as a first ultrasound image, and generates a nerve-enhanced image I2 as a second ultrasound image in which the nerve region N1 can be identified. The first receiving means receives an input operation of a nerve-enhanced button B1. In a state in which the nerve-enhanced image I2 is not displayed, a single input operation of the nerve-enhanced button B1 is received by the first receiving means. In this case, the display unit simultaneously displays the normal image I1 and the nerve-enhanced image I2.

[0063] Therefore, the normal image I1 and the nerve-enhanced image I2 can be displayed simultaneously by inputting a single nerve-enhanced button B1, which requires fewer steps than conventional methods. This reduces the number of steps required by the user, and shortens the time required for the workflow of puncturing the nerve area. Note that "simultaneously" displaying the normal image I1 and the nerve-enhanced image I2 does not matter if the display start timings are different, as long as there is a state / display period in which they are displayed simultaneously.

[0064] In a state in which the normal image I1 and the nerve-enhanced image I2 are simultaneously displayed, the first reception means receives an input operation of a single nerve-enhanced button B1. In this case, the display unit displays the normal image I1 and does not display the nerve-enhanced image I2. Therefore, the workflow of puncturing the nerve region can be completed simply by inputting the nerve-enhanced button B1.

[0065] The ultrasound diagnostic device 100 includes a second reception means (operation input unit 11). The second reception means receives an input operation of a screen number switching button B2. When a single input operation is received by the second reception means in a state in which a normal image I1 and a nerve-weighted image I2 are simultaneously displayed, the display unit makes the normal image I1 invisible and displays the nerve-weighted image I2. Therefore, when the normal image I1 and the nerve-weighted image I2 are displayed on two screens during an actual examination and it is not possible to display all of the ultrasound images, the display can be changed to display a larger area of ​​the nerve-weighted image I2.

[0066] The ultrasound diagnostic device 100 includes a setting means (control unit 18). In a state where the normal image I1 is displayed and the nerve-enhanced image I2 is not displayed, the first reception means receives an input operation of a single nerve-enhanced button B1. In this case, the setting means simultaneously displays the normal image I1 and the nerve-enhanced image I2 on the display unit. Alternatively, the setting means hides the normal image I1 and displays the nerve-enhanced image I2 on the display unit. The setting means can set either one of these as screen setting information in advance. For this reason, the display can be changed according to the purpose, such as normally displaying two screens and displaying one screen when the settings are such that all of the ultrasound images cannot be displayed. The settings such that all of the ultrasound images cannot be displayed are, for example, settings of preset data for an observation site at a shallow depth.

[0067] (Second embodiment) A second embodiment of the present invention will be described with reference to Fig. 7. Fig. 7 is a flowchart showing a second image display process.

[0068] In the above-described first embodiment, the operation input unit 11 has one type of nerve highlight button B1. In the present embodiment, the operation input unit 11 has two types of nerve highlight buttons.

[0069] As the device configuration of this embodiment, an ultrasound diagnostic device 100 is used as in the first embodiment. However, the operation input unit 11 has a first nerve emphasis button and a second nerve emphasis button (both not shown) instead of the nerve emphasis button B1. The first nerve emphasis button is a button that accepts a press input to turn on and off the activation of the nerve emphasis function, and also accepts an input to specify a two-screen display of a normal image and a nerve emphasis image when the function is activated. The second nerve emphasis button is a button that accepts a press input to turn on and off the activation of the nerve emphasis function, and also accepts an input to specify a single-screen display of a nerve emphasis image when the function is activated.

[0070] Moreover, in place of the first image display program, a second image display program for executing a second image display process, which will be described later, is stored in the ROM of the control unit 18.

[0071] Next, the operation of ultrasound diagnostic device 100 of this embodiment will be described with reference to Fig. 7. In ultrasound diagnostic device 100, it is assumed that a learned classifier for the nerve emphasis function is stored in storage unit 19 in advance.

[0072] In the ultrasound diagnostic device 100, a user inputs an instruction to execute the second image display process and a selection of preset data in the storage unit 19 via the operation input unit 11. The instruction triggers the control unit 18 to execute the second image display process according to the second image display program in the ROM. Here, it is assumed that the preset data does not include screen setting information.

[0073] As shown in FIG. 7, step S31 is the same as step S11 of the first image display process in FIG. 4. The control unit 18 determines whether or not the user has pressed the first nerve highlighting button of the operation input unit 11 (step S32). If the first nerve highlighting button has been input (step S32; YES), the process proceeds to step S33. Steps S33 and S34 are the same as steps S13 and S15 in FIG. 4. The control unit 18 determines whether or not the user has pressed the first nerve highlighting button of the operation input unit 11 (step S35). If the first nerve highlighting button has not been input (step S35; NO), the process proceeds to step S35.

[0074] If the first nerve emphasis button has not been pressed (step S32; NO), the control unit 18 determines whether or not the user has pressed the second nerve emphasis button (step S36). If the second nerve emphasis button has not been pressed (step S36; NO), the process proceeds to step S32. If the second nerve emphasis button has been pressed (step S36; NO), the process proceeds to step S37.

[0075] Steps S37 and S38 are the same as steps S13 and S17 in Fig. 4. The control unit 18 determines whether or not the user has pressed the second nerve emphasis button of the operation input unit 11 (step S39). If the second nerve emphasis button has not been pressed (step S39; NO), the process proceeds to step S39.

[0076] When the first nerve emphasis button is input (step S35; YES), or when the second nerve emphasis button is input (step S39; YES), the process proceeds to step S40. Steps S40 and S41 are similar to steps S19 and S20 in FIG.

[0077] As described above, according to this embodiment, ultrasound diagnostic device 100 includes a third reception means (operation input unit 11). The third reception means receives input operations of a first nerve emphasis button and a second nerve emphasis button. In a state in which normal image I1 is displayed but nerve emphasis image I2 is not displayed, the third reception means receives input operations of the second nerve emphasis button. In this case, the display unit (display unit 17, control unit 18) switches from normal image I1 to nerve emphasis image I2 for display. Therefore, by making it possible to input by pressing the second nerve emphasis button (and first nerve emphasis button), the user can select a display mode according to the situation.

[0078] (Third embodiment) A third embodiment of the present invention will be described with reference to Fig. 8 and Fig. 9. Fig. 8 is a flowchart showing a third image display process. Fig. 9 is a diagram showing a display image and operation buttons in the third image display process.

[0079] The first embodiment described above is configured to display normal image data and nerve-enhanced image data live during puncture with the puncture needle 3. The present embodiment is configured to display normal image data and nerve-enhanced image data live, and to freeze and display the normal image data and nerve-enhanced image data upon a freeze operation.

[0080] As the device configuration of this embodiment, an ultrasound diagnostic device 100 is used as in the first embodiment. However, the operation input unit 11 has a freeze button B3 (FIG. 9) in addition to the nerve emphasis button B1. The freeze button B3 is a button that accepts a press input of a freeze instruction during live display of ultrasound image data. Also, a third image display program for executing a third image display process described later is stored in the ROM of the control unit 18 in place of the first image display program.

[0081] Next, the operation of ultrasound diagnostic device 100 of the present embodiment will be described with reference to Figures 8 and 9. In ultrasound diagnostic device 100, it is assumed that a learned classifier for the nerve emphasis function is stored in storage unit 19 in advance.

[0082] In the ultrasound diagnostic device 100, a user inputs an instruction to execute the third image display process and a selection of preset data in the storage unit 19 via the operation input unit 11. The instruction triggers the control unit 18 to execute the third image display process according to the third image display program in the ROM. Here, it is assumed that the preset data does not include screen setting information.

[0083] As shown in Fig. 8, step S51 is similar to step S11 of the first image display process in Fig. 4. In step S51, for example, after the start of observation in Fig. 9, a normal image I11 is displayed.

[0084] Steps S52, S53, and S54 are similar to steps S12, S13, and S15 of the first image display process in Fig. 4. In step S54, for example, after the nerve emphasis button B1 in Fig. 9 is pressed for the first time, a normal image I11 and a nerve emphasis image I12 are live-displayed on two screens.

[0085] Steps S55, S56, and S57 are the same as steps S18, S19, and S20 of the first image display process in Fig. 4. If the nerve highlight button B1 has not been pressed (step S55; NO), the control unit 18 determines whether or not the user has pressed the freeze button B3 of the operation input unit 11 (step S58). If the freeze button B3 has not been pressed (step S58; NO), the process proceeds to step S55.

[0086] When the freeze button B3 is input (step S58; YES), the control unit 18 displays the generated normal image data and nerve-enhanced image data in a dual-screen freeze display on the display unit 17 (step S15). In step S15, for example, after the freeze button B3 in FIG. 5 is pressed, a normal image I13 and a nerve-enhanced image I14 are displayed in a dual-screen freeze display. The dual-screen freeze display is a dual-screen display of two frozen still images of ultrasound images taken at the same time. The normal image I13 is a normal image based on the normal image data of the still image at the time the freeze button B3 is pressed. The nerve-enhanced image I14 is a nerve-enhanced image based on the nerve-enhanced image data of the still image at the time the freeze button B3 is pressed.

[0087] Steps S60 and S61 are similar to steps S18 and S19 in Fig. 4. If the nerve emphasis button B1 has not been pressed (step S60; NO), the process proceeds to step S60.

[0088] The control unit 18 displays the normal image data being displayed in step S59 live on two screens (step S62), and ends the third image display process. In step S62, for example, after the second pressing of the nerve highlighting button B1 in FIG. 9, the normal image I13 is frozen and displayed on one screen. The user refers to the normal image I13 frozen and displayed on two screens, and inserts the puncture needle 3 into the target nerve region or its surrounding tissue. In addition, the display positions of the normal image I13 and the nerve highlighting image I14 after pressing the freeze button B3 are the same as the display positions of the two normal images I13 on the left and right after pressing the nerve highlighting button B1 for the first time.

[0089] As described above, according to the present embodiment, the first ultrasound image (normal image I13) and the second ultrasound image (nerve-enhanced image I14) are displayed in a two-screen freeze display. In this state, the first operation means accepts an input operation of the nerve-enhanced button B1. In this case, the display unit (display unit 17, control unit 18) switches the displayed nerve-enhanced image I14 to the normal image I13 while maintaining the display of the displayed normal image I13. The display unit displays the two normal images I13 in a two-screen freeze display. Therefore, the display of the nerve-enhanced image I14 can be released while keeping the two-screen freeze display. Therefore, the line of sight between the nerve-enhanced image I14 and the normal image I13 does not change, making it easy to confirm the nerve region and its surrounding tissue as the target.

[0090] The display unit switches the displayed nerve-enhanced image I14 to the normal image I13 at the same display position. Therefore, the line of sight between the nerve-enhanced image I14 and the normal image I13 does not change at all, making it easier to confirm the nerve region and its surrounding tissue as the target.

[0091] In addition, a configuration may be adopted in which an input operation of the nerve emphasis button B1 is accepted in a state in which the normal image I13 that is maintained in display and the switched normal image I13 are displayed. In this case, the display unit switches the switched normal image I13 to the nerve emphasis image I14 while maintaining the display of the normal image I13 that is maintained in display. This makes it easier to confirm the nerve area and its surrounding tissue as the target by switching multiple times between the nerve emphasis image I14 and the normal image I13 without changing the line of sight.

[0092] In the above description, an example has been disclosed in which the ROM of the control unit 18 is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. As other computer-readable media, non-volatile memories such as flash memories and portable recording media such as CD-ROMs can be applied. In addition, carrier waves can also be applied to the present invention as a medium for providing data for the program according to the present invention via a communication line.

[0093] The description of the above embodiment is merely an example of the ultrasound diagnostic device, ultrasound image display method, and program according to the present invention, and is not limited thereto. For example, at least two of the above embodiments may be appropriately combined.

[0094] In addition, the first and second embodiments are examples of live display of ultrasound image data, but the present invention is not limited to this. The configurations of the first and second embodiments may be applied to display of ultrasound image data of a still image.

[0095] Additionally, the detailed configuration and operation of the ultrasound diagnostic apparatus 100 in the above-described embodiment may also be modified as appropriate without departing from the spirit of the present invention. [Explanation of symbols]

[0096] 100 Ultrasound diagnostic equipment 1. Ultrasound diagnostic device body 11 Operation input section 12 Transmitter 13 Receiving section 14 Image Generation Unit 15 Image processing section 15a Image memory section 16 Display control section 17 Display 18 Control Unit 19 Memory section 2 Ultrasonic probe 21 Ultrasonic probe body 2a Transducer 22 Cable 23 Connector

Claims

1. an image generating means for detecting a nerve region from a first ultrasound image and generating a second ultrasound image in which the nerve region can be identified; A first receiving means for receiving an input operation; a display unit that simultaneously displays the first ultrasound image and the second ultrasound image when a single input operation is accepted by the first accepting means while the second ultrasound image is not being displayed.

2. 2. The ultrasound diagnostic device of claim 1, wherein when the first ultrasound image and the second ultrasound image are simultaneously displayed and the single input operation is accepted by the first accepting means, the display unit displays the first ultrasound image and does not display the second ultrasound image.

3. A second reception means for receiving an input operation is provided, 3. The ultrasound diagnostic device according to claim 1, wherein when the first ultrasound image and the second ultrasound image are simultaneously displayed and a single input operation is accepted by the second accepting means, the display unit makes the first ultrasound image non-displayable and displays the second ultrasound image.

4. 3. The ultrasound diagnostic device according to claim 1, further comprising: a setting unit that can set in advance whether, when a single input operation is accepted by the first accepting unit in a state in which the first ultrasound image is displayed and the second ultrasound image is not displayed, the first ultrasound image and the second ultrasound image are simultaneously displayed on the display unit, or the first ultrasound image is not displayed and the second ultrasound image is displayed on the display unit.

5. A third reception means for receiving an input operation is provided, 3. The ultrasound diagnostic device according to claim 1, wherein the display unit switches the first ultrasound image to the second ultrasound image when an input operation is accepted by the third accepting means while the first ultrasound image is being displayed and the second ultrasound image is not being displayed.

6. When the ultrasound image is frozen and displayed, 3. The ultrasound diagnostic device according to claim 1, wherein when an input operation is accepted by the first accepting means while the first ultrasound image and the second ultrasound image are being displayed, the display unit switches the displayed second ultrasound image to the first ultrasound image while maintaining the display of the displayed first ultrasound image.

7. The ultrasonic diagnostic apparatus according to claim 6 , wherein the display unit switches the displayed second ultrasonic image to a first ultrasonic image at the same display position.

8. 7. The ultrasound diagnostic device according to claim 6, wherein when an input operation is accepted by the first accepting means while the first ultrasound image maintained in the display and the first ultrasound image switched and displayed are being displayed, the display unit maintains the display of the first ultrasound image maintained in the display and switches the first ultrasound image displayed in the switched display to a second ultrasound image.

9. an image generating step of detecting a nerve region from the first ultrasound image and generating a second ultrasound image in which the nerve region can be identified; a first receiving step of receiving an input operation; a display step of simultaneously displaying the first ultrasonic image and the second ultrasonic image when a single input operation is accepted by the first accepting step while the second ultrasonic image is not being displayed.

10. Computer, an image generating means for detecting a nerve region from the first ultrasound image and generating a second ultrasound image in which the nerve region can be identified; a display unit that simultaneously displays the first ultrasound image and the second ultrasound image when a single input operation is accepted by a first accepting unit that accepts an input operation while the second ultrasound image is not being displayed; A program to function as a

Images