Ultrasound diagnostic device, ultrasound diagnostic program, and information display method for ultrasound diagnostic device

Abstract

To make a measurement item feasible as a user desires.SOLUTION: An ultrasonic diagnostic apparatus includes: an ultrasonic probe for transmitting and receiving an ultrasonic wave to a subject; a generation part for generating ultrasonic image data on the basis of reception signals obtained from an observation area; a measurement item estimation part for estimating a measurement item candidate that can be measured or cannot be measured; and a display part for displaying a measurement item candidate.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an ultrasonic diagnostic apparatus, an ultrasonic diagnostic program, and an information display method for an ultrasonic diagnostic apparatus. [Background technology]

[0002] BACKGROUND ART Ultrasound diagnostic devices are known that transmit and receive ultrasonic waves to and from a subject such as a living organism using an ultrasonic probe, and generate diagnostic ultrasonic image data based on signals obtained from ultrasonic echoes resulting from reflection of the ultrasonic waves.

[0003] In recent years, ultrasound diagnostic equipment has been using AI (Artificial Intelligence) technology to automatically recognize target organs and tissues from ultrasound image data and to perform automatic measurements using the recognition results, and AI technology is being used for a variety of purposes.

[0004] For example, Patent Document 1 describes using AI technology to estimate candidate measurement conditions for ultrasound image data, determine measurement conditions from the estimated candidate measurement conditions, and perform measurements on the ultrasound image data based on the determined measurement conditions.

[0005] Furthermore, Patent Document 2 describes using AI technology to determine whether an ultrasound cross-sectional image is an image of a target cross-section, and if it is determined that the cross-sectional image is an image of the target cross-section, a predetermined measurement process is performed on the image of the determined target cross-section. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2022-47609 [Patent Document 2] Japanese Patent Application Publication No. 2019-154654 Summary of the Invention [Problem to be solved by the invention]

[0007] In Patent Documents 1 and 2, AI technology is used to estimate candidate measurement conditions and determine the measurement conditions, or to determine that the cross-sectional image is an image of the target cross-section, and then measurement is automatically performed using the determined measurement conditions and the determined cross-sectional image, and the measurement results are displayed.

[0008] However, when multiple measurement items exist for a region displayed in a cross-sectional image, a measurement other than the one desired by the user may be performed. For example, when a user wishes to measure the major axis of a fetus's abdomen using a cross-sectional image, the circumference may be measured instead.

[0009] An object of the present invention is to provide an ultrasonic diagnostic apparatus, an ultrasonic diagnostic program, and an information display method for an ultrasonic diagnostic apparatus that can perform measurement items desired by a user. [Means for solving the problem]

[0010] The ultrasonic diagnostic apparatus according to the present invention comprises: an ultrasonic probe for transmitting and receiving ultrasonic waves to and from a subject; a generating unit that generates ultrasound image data based on a received signal obtained from the observation region; a measurement item estimation unit that estimates measurable or non-measurable measurement item candidates in the observation region based on the received signals or the ultrasound image data; a display unit that displays the measurement item candidates; Equipped with 、 The measurement item candidate is a candidate for an item indicating measurement of the length of a predetermined portion within the observation area, or measurement of the area of ​​a predetermined portion within the observation area. do.

[0011] The ultrasonic diagnostic apparatus according to the present invention comprises: an ultrasonic probe for transmitting and receiving ultrasonic waves to and from a subject; a generating unit that generates ultrasound image data based on a received signal obtained from the observation region; a designation unit for designating a measurement item in the observation area; an estimation unit that estimates whether the specified measurement item is measurable based on the received signal or the ultrasound image data; a display unit that displays information on whether measurement is possible or not; Equipped with 、 The measurement item is an item indicating measurement of the length of a predetermined portion within the observation area, or measurement of the area of ​​a predetermined portion within the observation area. do.

[0012] The ultrasound diagnostic program according to the present invention comprises: On the computer, a transmission / reception process for transmitting and receiving ultrasonic waves to and from the subject using an ultrasonic probe; A generation process for generating ultrasound image data based on a received signal obtained from the observation region; a measurement item estimation process for estimating measurable or non-measurable measurement item candidates in the observation region based on the received signals or the ultrasound image data; a display process for displaying the measurement item candidates; Run 、 The measurement item candidate is a candidate for an item indicating measurement of the length of a predetermined portion within the observation area, or measurement of the area of ​​a predetermined portion within the observation area. do.

[0013] The ultrasound diagnostic program according to the present invention comprises: On the computer, a transmission / reception process for transmitting and receiving ultrasonic waves to and from the subject using an ultrasonic probe; A generation process for generating ultrasound image data based on a received signal obtained from the observation region; a designation process for designating a measurement item in the observation area; an estimation process for estimating whether the specified measurement item is measurable based on the received signal or the ultrasound image data; a display process for displaying information on whether or not measurement is possible on a display unit; Run 、 The measurement item is an item indicating measurement of the length of a predetermined portion within the observation area, or measurement of the area of ​​a predetermined portion within the observation area. do.

[0014] The information display method for an ultrasound diagnostic apparatus according to the present invention comprises: An ultrasound probe transmits and receives ultrasound to and from the subject, generating ultrasound image data based on received signals obtained from the observation region; Estimating measurable or non-measurable measurement item candidates in the observation region based on the received signals or the ultrasound image data; Display the measurement item candidates death, The measurement item candidate is a candidate for an item indicating measurement of the length of a predetermined portion within the observation area, or measurement of the area of ​​a predetermined portion within the observation area. do.

[0015] The information display method for an ultrasound diagnostic apparatus according to the present invention comprises: An ultrasound probe transmits and receives ultrasound to and from the subject, generating ultrasound image data based on received signals obtained from the observation region; Specify the measurement items of the observation area, Estimating whether the specified measurement item is measurable based on the received signal or the ultrasound image data; The information on whether measurement is possible or not is displayed on the display unit. death, The measurement item is an item indicating measurement of the length of a predetermined portion within the observation area, or measurement of the area of ​​a predetermined portion within the observation area. do. [Effects of the Invention]

[0016] According to the present invention, it is possible to carry out measurement items desired by the user. [Brief explanation of the drawings]

[0017] [Figure 1] FIG. 1 is a block diagram showing an example of the main components of an ultrasonic diagnostic apparatus according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating an example of an information display method for the ultrasonic diagnostic apparatus shown in FIG. [Figure 3] FIG. 3 is a diagram illustrating an example of an AI technique used in the measurability estimation unit of the ultrasound diagnostic apparatus shown in FIG. [Figure 4] Figure 4 is an example of a training dataset used in the AI ​​technology shown in Figure 3. [Figure 5] FIG. 5 is a diagram showing an example of a display image and measurement item candidates displayed on the display unit of the ultrasound diagnostic apparatus shown in FIG. [Figure 6]FIG. 6 is a diagram showing another example of a display image and measurement item candidates displayed on the display unit of the ultrasound diagnostic apparatus shown in FIG. [Figure 7] FIG. 7 is a diagram showing another example of a display image and measurement item candidates displayed on the display unit of the ultrasound diagnostic apparatus shown in FIG. [Figure 8] FIG. 8 is a diagram showing another example of a display image and measurement item candidates displayed on the display unit of the ultrasound diagnostic apparatus shown in FIG. [Figure 9] FIG. 9 is a block diagram showing another example (modification 1) of the main parts of an ultrasonic diagnostic apparatus according to an embodiment of the present invention. [Figure 10] FIG. 10 is a block diagram illustrating an example of an information display method of the ultrasonic diagnostic apparatus shown in FIG. DETAILED DESCRIPTION OF THE INVENTION

[0018] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0019] [Ultrasound diagnostic equipment] An ultrasonic diagnostic apparatus according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an example of the main parts of an ultrasonic diagnostic apparatus 1 according to this embodiment.

[0020] The ultrasound diagnostic device 1 is used to visualize the shape, properties, or dynamics of biological tissue inside a subject such as a living organism as an ultrasound image and perform image diagnosis.

[0021] 1, the ultrasonic diagnostic device 1 includes a device main body 10, an ultrasonic probe (ultrasonic probe in the present invention) 20, etc. In the ultrasonic diagnostic device 1, the ultrasonic probe 20 is connected to the device main body 10 via a cable, but may also be connected to the device main body 10 via wireless communication.

[0022] [Device body] As shown in FIG. 1, the device main body 10 includes an operation input unit 11, a transmission unit 12, a reception unit 13, an image generation unit 14, a display unit 15, a control unit 16, a storage unit 17, and the like.

[0023] The operation input unit 11 is a user interface that allows a user (e.g., a medical professional such as a doctor or a laboratory technician) to perform input operations, converting the input operations performed by the user into operation signals and inputting them to the control unit 16. The operation input unit 11 is composed of, for example, a control panel having multiple keys (buttons), a keyboard, a mouse, etc. When a touch panel display is used as the display unit 15, the touch panel portion functions as part of the operation input unit 11 and detects, for example, touch inputs for selecting measurement items, which will be described later.

[0024] The operation input unit 11 allows the user to perform input operations such as operations during measurement by the ultrasound diagnostic device 1, operations during diagnosis, and operations for information to be displayed on the display unit 15, for example.

[0025] The transmitter 12 is a transmission circuit that generates a voltage pulse, which is a drive signal, and outputs it to each acoustic element of the ultrasonic probe 20. The transmitter 12 sets the voltage amplitude, pulse width, and timing of the voltage pulse for each channel (each acoustic element).

[0026] For example, the transmission unit 12 changes the delay time of the voltage pulse supplied to each acoustic element so that the ultrasonic waves output from each acoustic element are focused on a focal point set within the subject (delay processing).

[0027] Furthermore, the transmitting unit 12 drives the acoustic elements in sequence by switching channels, thereby scanning the inside of the subject with ultrasound.

[0028] The receiving unit 13 is a receiving circuit that receives and processes reception signals generated by each acoustic element when ultrasonic echoes are received due to reflection of ultrasonic waves.

[0029] The receiving unit 13 amplifies the received signal of each channel, performs A / D conversion, and adds a delay time to the A / D converted received signal. At this time, the receiving unit 13 adds a delay time so that the phases of the received signals generated by ultrasonic echoes from a focus set inside the subject are aligned (delay processing). As a result, the receiving unit 13 combines the received signals of multiple channels into one (hereinafter referred to as a "phased sum signal"). The receiving unit 13 then performs filter processing on the phased sum signal and outputs it to the image generating unit 14.

[0030] The image generator 14 performs a process of generating image data of an ultrasound image (hereinafter referred to as ultrasound image data) that becomes two-dimensional frame data based on the phased addition signal (received data) output from the receiver 13. The image generator 14 generates ultrasound image data such as a B-mode image, a Doppler image (a color Doppler image, a pulsed Doppler image, a continuous wave Doppler image, a tissue Doppler image, etc.), an M-mode image, an elastography image, etc., depending on the scanning mode. Measurement items, which will be described later, relate to the observation areas of these image data.

[0031] The image generation unit 14 generates ultrasound image data after performing, for example, logarithmic compression processing, detection processing, FFT analysis processing, etc. The processing for generating ultrasound image data in the image generation unit 14 may be similar to well-known processing, and therefore, a description thereof will be omitted here. The generated ultrasound image data may be stored in, for example, the storage unit 17.

[0032] Furthermore, the image generating unit 14 converts the ultrasound image data generated by the image generating unit 14 into a display signal corresponding to the display unit 15, and outputs the signal as a display image. The image generating unit 14 also converts measurement item candidates (described later) into a display signal corresponding to the display unit 15, and outputs the signal.

[0033] The display unit 15 is configured with, for example, a liquid crystal display, an organic EL display, a CRT display, a touch panel display, or the like. The display unit 15 displays the display image input from the image generation unit 14 as an ultrasound image. Note that the display unit 15 is not limited to being fixed to the device main body 10, and may be an external display connected to the device main body 10 by a wire, a tablet connected to the device main body 10 wirelessly, or the like.

[0034] The control unit 16 is a so-called computer, and although not shown, includes a CPU (Central Processing Unit) as a calculation / control device, a ROM (Read Only Memory) and a RAM (Random Access Memory) as main storage devices, and the like.

[0035] The ROM stores programs and setting data. The CPU reads out a program corresponding to the processing content from the ROM, loads it into the RAM, and executes the loaded program to centrally control the operation of each functional block of the ultrasound diagnostic apparatus 1. In other words, the control unit 16 controls the operation input unit 11, the transmission unit 12, the reception unit 13, the image generation unit 14, and the display unit 15 according to their respective functions, thereby controlling the ultrasound diagnostic apparatus 1 as a whole.

[0036] In this embodiment, the control unit 16 has a measurement item estimation unit 161 and a measurement unit 163 in addition to a control block that controls each unit.

[0037] The measurement item estimation unit 161 estimates measurable or non-measurable measurement item candidates, for example, based on data received from the receiving unit 13. Here, the measurement items that are the measurement item candidates are measurement items of the observation area of ​​the subject, and include the area and length of the observation area, as well as, for example, the perimeter, the imaging site, the imaging range, and the periodicity of the movement of the imaging subject. The measurement item estimation unit 161 will be described in detail later.

[0038] The measurement unit 163 measures measurement items in the observation area of ​​the subject. The measurement unit 163 has measurement processing (e.g., measurement programs) corresponding to each measurement item. The measurement unit 163 has an automatic measurement mode and a manual measurement mode, and when the measurement item estimation unit 161 can estimate measurable measurement item candidates, it operates in the automatic measurement mode and, for example, performs measurement of the selected measurement item.

[0039] On the other hand, if the measurement item estimation unit 161 cannot estimate measurable measurement item candidates, or can only estimate non-measurable measurement item candidates, the measurement unit 163 can be switched to manual measurement mode, for example, by a user operation. In this case, if the automatic measurement mode remains, even if the non-measurable measurement item is measurable, the accuracy may be low and the measurement accuracy may not be guaranteed. Therefore, by switching to manual measurement mode and having the user specify the measurement item of the observation area, the measurement unit 163 performs measurement of the specified measurement item. In this case, for example, the accuracy of the measurement can be improved by the user specifying the part to be measured.

[0040] The memory unit 17 is a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory, and stores the ultrasound image data generated by the image generation unit 14 and the measurement results measured by the measurement unit 163.

[0041] The transmitting unit 12, receiving unit 13, image generating unit 14, measurement item estimating unit 161, and measuring unit 163 described above may be configured as dedicated or general-purpose hardware (electronic circuits) according to each process, and realize each function in cooperation with the control unit 16.

[0042] For example, the transmitter 12, receiver 13, image generator 14, measurement item estimation unit 161, and measurement unit 163 are configured with hardware such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), and a PLD (Programmable Logic Device). Examples of PLDs include FPGAs (Field Programmable Gate Arrays). When the transmitter 12, receiver 13, image generator 14, measurement item estimation unit 161, and measurement unit 163 are configured with a DSP, PLD, or the like, they have processing programs for those components.

[0043] The transmission unit 12, reception unit 13, image generation unit 14, measurement item estimation unit 161, and measurement unit 163 may be configured so that the processing of each unit is executed by a CPU or a GPU (Graphics Processing Unit). In this case, the CPU or GPU has a processing program for executing the processing of each unit.

[0044] [Ultrasound probe] The ultrasonic probe 20 is, for example, a convex probe, a linear probe, a sector probe, a three-dimensional probe, etc. Although not shown, the ultrasonic probe 20 includes a plurality of acoustic elements, etc. Each acoustic element is, for example, a piezoelectric element that can convert an electrical signal into a mechanical vibration and vice versa, and can transmit and receive ultrasonic waves.

[0045] The ultrasonic probe 20 converts the voltage pulses output from the transmitting unit 12 into ultrasonic waves, transmits them into the subject, receives ultrasonic echoes reflected from within the subject, and outputs the received signals to the receiving unit 13. As described above, the ultrasonic probe 20 scans the subject with ultrasonic waves by sequentially driving the acoustic elements through channel switching. Then, based on the received signals, the image generating unit 14 generates ultrasonic image data that becomes two-dimensional frame data.

[0046] [Method for displaying information on an ultrasound diagnostic device] The ultrasound diagnostic device 1 has the above-described configuration. When a user brings the ultrasound probe 20 into contact with the surface (epidermis) of a subject, the ultrasound diagnostic device 1 acquires ultrasound image data from inside the subject using the ultrasound probe 20, the transmitter 12, and the receiver 13. Then, the ultrasound diagnostic device 1 generates a display image, for example, a cross-sectional image, based on the acquired ultrasound image data using the image generator 14, and displays it on the display 15 as an ultrasound image.

[0047] The ultrasound image data is generated as two-dimensional frame data, and real-time display is possible by displaying display images corresponding to the frame data in real time in chronological order. Furthermore, the ultrasound diagnostic device 1 can measure, for example, the major axis and circumference of the abdomen of a fetus by performing measurements on the received data input from the receiving unit 13, the ultrasound image data generated by the image generating unit 14, the display image, etc. in response to user operations.

[0048] However, for example, when there are multiple measurement items for a region displayed in a display image such as a cross-sectional image, measurements may be performed that are different from the measurement items desired by the user.

[0049] Therefore, in this embodiment, the measurement item estimation unit 161 in the control unit 16 estimates candidate measurement items that are measurable or non-measurable in the observation area, and the display unit 15 displays the candidate measurement items for the observation area. Because the display unit 15 displays the candidate measurement items for the observation area, the user can select a desired measurement item from the candidate measurement items, and the control unit 16 can use the measurement unit 163 to measure the selected desired measurement item.

[0050] The display and selection of such measurement item candidates and the measurement of the selected measurement item will be described with reference to Fig. 2. Fig. 2 is a block diagram for explaining an example of an information display method of the ultrasound diagnostic device 1.

[0051] In the ultrasound diagnostic device 1, received data acquired using the ultrasound probe 20, the transmitting unit 12, and the receiving unit 13 is input to the image generating unit 14. The input received data is generated by the image generating unit 14 into ultrasound image data and a display image, and the display image, for example, a cross-sectional image, is output to the display unit 15, which displays the display image in real time.

[0052] At this time, when the measurement item estimation unit 161 is activated by a user operation, it uses the data received from the receiving unit 13 as input data to estimate measurable or non-measurable measurement item candidates. Since this processing is performed in real time in accordance with the displayed image, it is desirable to estimate the measurement item candidates using the received data. Note that, depending on the processing capacity of the control unit 16 (when the processing capacity is high), the ultrasound image data generated by the image generation unit 14 or the displayed image may be used to estimate the measurement item candidates. The measurement item candidates estimated by the measurement item estimation unit 161 are output to the display unit 15, and the display unit 15 displays the measurement item candidates in real time.

[0053] The display unit 15 displays candidate measurement items in real time along with the display image. For example, as shown in FIG. 2, three candidate measurement items, "Measurement A," "Measurement B," and "Measurement C," are displayed on the display unit 15. When the user selects a desired measurement item from "Measurement A," "Measurement B," or "Measurement C," the measurement unit 163 is activated and measurement of the selected measurement item is performed. For example, when the user selects "Measurement A," the measurement unit 163 is activated and measurement of the selected "Measurement A" is performed.

[0054] Here, estimation in the measurement item estimation unit 161 will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a diagram illustrating an example of an AI technique used in the measurement item estimation unit 161 of the ultrasound diagnostic device 1. Fig. 4 is an example of a training data set used in the AI ​​technique shown in Fig. 3.

[0055] The measurement item estimation unit 161 performs estimation using AI technology. The measurement item estimation unit 161 is, for example, a trained model or classifier using a neural network, and the trained model or classifier is, for example, a model trained by associating ultrasound images (cross-sectional images) with measurement item candidates (see FIGS. 3 and 4).

[0056] The trained model here is a model trained by associating ultrasound images (cross-sectional images) with candidate measurement items, but it may also be a model trained by associating received data or ultrasound image data with candidate measurement items.

[0057] In this embodiment, the neural network has an input layer, a hidden layer, an output layer, and a Softmax activation function.

[0058] The input layer is a layer that propagates information such as ultrasound images to the hidden layer. The hidden layer is a layer that extracts the features of the information. The output layer is a layer that determines the probability of the label to be classified. The Softmax activation function converts the label output value into a value that ranges from 0 (0%) to 1 (100%) and where the sum of the output values ​​of all labels is 1 (100%).

[0059] In a neural network, the weights and thresholds of the neurons in the hidden layer and output layer are adjusted by learning so that the labels of the information in the input correct data match the labels of the output results.

[0060] In the above-mentioned neural network, for example, as shown in Figure 4, learning is performed using a training dataset consisting of N pieces of correct answer data, each set consisting of an ultrasound image and a measurement item that can be measured in that image with a probability of 1 (100%).

[0061] For example, when an ultrasound image generated by the image generation unit 14 is input to the neural network that has undergone such learning, the probability for each measurement item for the input ultrasound image is output, as shown in Fig. 3. In the example shown in Fig. 3, the probability of measurement A is 80%, and it can be estimated as a measurable measurement item candidate, and the probabilities of measurements C and D are 2% and 1%, respectively, and they can be estimated as non-measurable measurement item candidates.

[0062] In this way, the measurement item estimation unit 161 estimates measurable or non-measurable measurement item candidates. In other words, the measurement item estimation unit 161 can automatically estimate measurable measurement items as measurement item candidates. Then, the display unit 15 displays the measurement item candidates in real time together with the display image, as shown in FIG.

[0063] At this time, the measurement item estimation unit 161 estimates that measurement items with a predetermined probability or higher are measurable, and outputs the measurement items as candidate measurement items to the display unit 15. For example, as shown in Fig. 3, if the probabilities of Measurement A, Measurement B, Measurement C, and Measurement D are 80%, 17%, 2%, and 1%, respectively, and it is estimated that 80% or more of the measurement items are measurable, the measurement item estimation unit 161 outputs Measurement A as a candidate measurement item to the display unit 15. In this case, the display unit 15 displays Measurement A, which is a measurement item with a predetermined probability or higher, as a candidate measurement item.

[0064] Furthermore, when there are multiple measurement items with a predetermined probability or higher, the measurement item estimation unit 161 outputs the multiple measurement items as candidate measurement items to the display unit 15. In this case, the display unit 15 displays, for example, Measurement A and Measurement B, which are measurement items with a predetermined probability or higher, as candidate measurement items, as shown in Fig. 2. In this case, the display unit 15 may display the candidate measurement items from left to right in descending order of probability, as shown in Fig. 2, or may display the candidate measurement items from top to bottom in descending order of probability, as shown in Fig. 5.

[0065] Furthermore, the display unit 15 may be configured to display a predetermined number of measurement items in descending order of probability, as shown in Fig. 6. In the example shown in Fig. 6, the predetermined number is three, and if the probabilities of Measurement A, Measurement B, Measurement C, and Measurement D are 80%, 17%, 2%, and 1%, respectively, as shown in Fig. 3, the top three Measurements A, B, and C are displayed from top to bottom in descending order of probability. In this case, the display unit 15 may display the order of probability together with the measurement items.

[0066] Furthermore, the display unit 15 may display a predetermined number of measurement items that are measurement items with a predetermined probability or higher in descending order of probability.

[0067] Furthermore, as shown in FIG. 7, the display unit 15 may display the probability of each measurement item together with the measurement item.

[0068] Furthermore, the display unit 15 may change the display mode of the measurement items according to the probability of the measurement items, as well as the measurement items, as shown in Fig. 8. For example, the display unit 15 may change the color of the area in which the measurement items are displayed or the color of the measurement items themselves according to the probability of the measurement items, so that the user can visually identify measurement items with high probabilities. For example, in the example shown in Fig. 8, the area in which measurement A, which has a high probability, is displayed is brightened, and the areas in which measurements B and C, which have low probabilities, are displayed are darkened, so that the user can visually identify measurement A, which has a high probability.

[0069] In this way, the display unit 15 displays the measurement item candidates in real time so that the user can visually recognize measurement items with high probability.

[0070] The user checks the measurement item candidates displayed on the display unit 15 and selects the desired measurement item. For example, as shown in FIG. 2, if the desired measurement item is measurement A, the user selects measurement A using, for example, a control panel or touch panel. An operation signal resulting from this selection is input to the control unit 16 via the operation input unit 11, and the control unit 16 activates the measurement unit 163. Specifically, the control unit 16 activates the measurement process (e.g., a measurement program) for measurement A in the measurement unit 163, and while displaying the display image on the display unit 15 in real time, performs measurement A on the display image in real time, and displays the measurement results in real time.

[0071] If the measurement item estimation unit 161 cannot estimate a measurable measurement item candidate, or can only estimate an unmeasurable measurement item candidate, it will display on the display unit 15 that measurement is not possible or that the ultrasound image is unsuitable for measurement.

[0072] As described above, in the ultrasound diagnostic device 1 of this embodiment, the measurement item estimation unit 161 in the control unit 16 estimates measurable or non-measurable measurement item candidates, thereby automatically estimating measurable measurement item candidates, and the display unit 15 displays the measurement item candidates. Because the display unit 15 displays the measurement item candidates for the observation area, the user can select a desired measurement item from the measurement item candidates, and the control unit 16 can use the measurement unit 163 to immediately measure the selected desired measurement item.

[0073] Currently, many ultrasound diagnostic devices are equipped with multiple automatic measurements that utilize AI technology. However, because organ / tissue recognition requires a large computational load, it is difficult to simultaneously run AI engines corresponding to multiple measurement items and perform automatic measurement in real time. In contrast, this embodiment uses AI technology to estimate measurement item candidates, so the computational load is smaller than when AI engines corresponding to multiple measurement items are simultaneously run, enabling automatic measurement in real time.

[0074] Furthermore, the operation input unit 11 has a limited number of operation buttons, and a touch panel display has a limited number of operation buttons that can be displayed on the display unit 15. Therefore, even if a desired automatic measurement is to be performed by operating a button from among multiple built-in automatic measurements, it cannot be performed immediately, which increases the examination time and the burden on the patient and user. In contrast, in this embodiment, the measurement item estimation unit 161 automatically estimates measurable measurement item candidates, and the display unit 15 displays the measurement item candidates. Therefore, the user can immediately perform automatic measurement by selecting the desired measurement item from the displayed measurement item candidates. As a result, the examination time can be shortened and the burden on the patient and user can be reduced.

[0075] Furthermore, in the past, desired measurement items were searched for from a menu in which many measurement items were defined for each observation site. In contrast, in this embodiment, the measurement item estimation unit 161 automatically estimates measurable measurement item candidates, and the display unit 15 displays the measurement item candidates. Therefore, there is no need to search for the desired measurement item, shortening the examination time and reducing the burden on the patient and user.

[0076] <Variation 1> FIG. 9 is a block diagram showing another example of the main parts of the ultrasound diagnostic apparatus 1A according to the embodiment of the present invention.

[0077] In this modification, the ultrasound diagnostic device 1A has the same configuration as the ultrasound diagnostic device 1 shown in Fig. 1, except for the measurability estimation unit 162. Therefore, a description of the configuration of the ultrasound diagnostic device 1A that overlaps with that of the ultrasound diagnostic device 1 will be omitted.

[0078] In this modification, ultrasound diagnostic device 1A has a measurability estimation unit 162 instead of measurement item estimation unit 161 in ultrasound diagnostic device 1 shown in Fig. 1. Also, in this modification, operation input unit 11 functions as a designation unit that designates a measurement item.

[0079] The measurability estimation unit 162 (estimation unit in the present invention) estimates whether or not a measurement item designated using the operation input unit 11 is measurable in the observation area. In other words, unlike the present embodiment described above, it does not estimate measurement item candidates, but estimates whether or not the designated measurement item is measurable.

[0080] The estimation in the measurability estimation unit 162 is similar to that in the above-described measurement item estimation unit 161, and estimation is performed using AI technology. Specifically, as an example, the measurability estimation unit 162 is also a trained model or classifier using a neural network, similar to the measurement item estimation unit 161. Furthermore, similar to the measurement item estimation unit 161, this trained model or classifier is also a model trained by associating ultrasound images (cross-sectional images) with measurement item candidates (see FIGS. 3 and 4).

[0081] In this modification, the measurability estimation unit 162 in the control unit 16 estimates whether or not a measurement item designated by the user (desired by the user) is measurable in the observation area, and the display unit 15 displays information on whether or not the designated measurement item is measurable. Since the display unit 15 displays information on whether or not the designated measurement item is measurable, the user can select a desired measurement item based on the information, and the control unit 16 can measure the selected measurement item using the measurement unit 163.

[0082] Here, the display of information about measurement items, selection, and measurement of selected measurement items in this modified example will be described with reference to Fig. 10. Fig. 10 is a block diagram illustrating an example of an information display method of the ultrasound diagnostic apparatus 1A shown in Fig. 9.

[0083] In the ultrasonic diagnostic device 1A, reception data acquired using the ultrasonic probe 20, the transmitting unit 12, and the receiving unit 13 is also input to the image generating unit 14. The input reception data is generated by the image generating unit 14 into ultrasonic image data and a display image, and the display image, for example, a cross-sectional image, is output to the display unit 15, which displays the display image in real time.

[0084] At this time, the measurability estimation unit 162 is activated by a user operation, and at least one measurement item is input (specified) by the user. The measurability estimation unit 162 uses the data received from the receiving unit 13 as input data to estimate whether the specified measurement item is measurable in the observation area. Since this processing is also performed in real time in accordance with the displayed image, it is desirable to estimate whether the specified measurement item is measurable using the received data. Depending on the processing capacity of the control unit 16 (if the processing capacity is high), it may be possible to estimate whether the specified measurement item is measurable using ultrasound image data or a display image generated by the image generation unit 14. Information on whether the measurement item is measurable, for example, probability information, estimated by the measurement item estimation unit 161, is output to the display unit 15, and the display unit 15 displays the measurement item and probability information in real time.

[0085] Measurement items and probability information are also displayed in real time along with the display image on the display unit 15. For example, as shown in Fig. 10, three measurement items, "Measurement A," "Measurement B," and "Measurement C," are designated and displayed on the display unit 15. In this case, probability information is also displayed on the display unit 15 along with the measurement items.

[0086] The user refers to the probability information along with the measurement items and selects the desired measurement item from the specified measurement items, which activates the measurement unit 163 and executes the measurement of the selected measurement item. For example, when the user selects "Measurement A," the measurement unit 163 activates and executes the measurement of the selected "Measurement A."

[0087] To estimate whether a specified measurement item is measurable, the trained model using the neural network described above is used to obtain the measurement item and its probability as probability information.

[0088] In this way, the measurability estimation unit 162 estimates whether the specified measurement item is measurable. Then, the display unit 15 displays the probability indicating the measurability of the measurement item in real time, along with the display image and the measurement item, as shown in Fig. 10.

[0089] The user checks the measurement items and probabilities indicating the measurability of the measurement items displayed on the display unit 15 and selects the desired measurement item. For example, as shown in FIG. 10, if the desired measurement item is measurement A, the user selects measurement A using, for example, a control panel or touch panel. An operation signal resulting from this selection is input to the control unit 16 via the operation input unit 11, and the control unit 16 activates the measurement unit 163. Specifically, the control unit 16 activates the measurement process (e.g., a measurement program) for measurement A in the measurement unit 163, and while displaying the display image on the display unit 15 in real time, performs measurement A on the display image in real time, and displays the measurement results in real time.

[0090] If the measurability estimation unit 162 estimates that the specified measurement item is not measurable, it displays on the display unit 15 that the measurement is not possible or that the ultrasound image is not suitable for measurement.

[0091] As described above, in the ultrasonic diagnostic apparatus 1A of this modification, the measurability estimation unit 162 in the control unit 16 estimates whether a measurement item specified by the user is measurable in the observation area, and the display unit 15 displays information on whether the specified measurement item is measurable. Since the display unit 15 displays the measurement item and information on whether it is measurable, the user can select a desired measurement item from the measurement items, and the control unit 16 can use the measurement unit 163 to immediately measure the selected desired measurement item.

[0092] Furthermore, the ultrasound diagnostic apparatus 1A of this modified example also uses AI technology to estimate whether a measurement item is measurable or not, so the computational load is smaller than when AI engines corresponding to multiple measurement items are run simultaneously, and automatic measurement is possible in real time.

[0093] Furthermore, in the ultrasound diagnostic device 1A of this modification, the measurability estimation unit 162 estimates whether the specified measurement item is measurable, and the display unit 15 displays information indicating whether the specified measurement item is measurable. Therefore, the user can immediately perform automatic measurement by selecting the desired measurement item from the displayed measurement items. As a result, the examination time can be shortened, and the burden on the patient and the user can be reduced.

[0094] Also in the ultrasound diagnostic apparatus 1A of this modification, the measurability estimation unit 162 estimates whether or not a specified measurement item is measurable, and the display unit 15 displays information on whether or not the specified measurement item is measurable. Therefore, there is no need to search for the desired measurement item, which shortens the examination time and reduces the burden on the patient and user.

[0095] The above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be carried out in various forms without departing from the gist or main features thereof.

[0096] For example, the measurement item estimation unit 161 and the measurability estimation unit 162 use a neural network as an example of AI technology, but other AI technology may also be used. [Explanation of symbols]

[0097] 1. 1A Ultrasound diagnostic equipment 10. Device body 11 Operation input section 12 Transmitter 13 Receiving unit 14 Image generation unit 15 Display 16 Control Unit 161 Measurement Item Estimation Section 162 Measurability Estimation Section 163 Measurement Department 17 Memory section 20 Ultrasound Probe

Claims

1. an ultrasonic probe for transmitting and receiving ultrasonic waves to and from a subject; a generating unit that generates ultrasound image data based on a received signal obtained from the observation region; a measurement item estimation unit that estimates measurable or non-measurable measurement item candidates in the observation region based on the received signals or the ultrasound image data; a display unit that displays the measurement item candidates; Equipped with An ultrasound diagnostic apparatus, wherein the measurement item candidate is a candidate item indicating measurement of the length of a predetermined portion within the observation region, or measurement of the area of ​​a predetermined portion within the observation region.

2. The display unit displays the measurement item candidates in real time.

2. The ultrasonic diagnostic apparatus according to claim 1.

3. The generating unit generates the ultrasound image data in real time, the measurement item estimation unit estimates the measurement item candidates in real time for the received signals or the ultrasound image data generated in real time; 3. The ultrasonic diagnostic apparatus according to claim 1.

4. the measurement item estimation unit estimates the probability that the measurement item candidate is measurable; 3. The ultrasonic diagnostic apparatus according to claim 1.

5. The display unit Displaying measurement item candidates whose probability is equal to or greater than a predetermined probability or a predetermined number of measurement item candidates in descending order of probability, a predetermined number of candidate measurement items are displayed in descending order of probability, the candidate measurement items being those whose probability is equal to or greater than a predetermined probability; 5. The ultrasonic diagnostic apparatus according to claim 4.

6. The ultrasound image data is data relating to at least one of a B-mode image, a Doppler image, an M-mode image, and an elastography image, The Doppler images include color Doppler images, pulsed Doppler images, continuous wave Doppler images, and tissue Doppler images.

3. The ultrasonic diagnostic apparatus according to claim 1.

7. an operation input unit for selecting the measurement item candidates displayed on the display unit; 3. The ultrasonic diagnostic apparatus according to claim 1.

8. the display unit has a touch panel, and the touch panel functions as the operation input unit and detects a touch input for selecting a measurement item candidate displayed on the display unit.

8. The ultrasonic diagnostic apparatus according to claim 7.

9. The operation input unit has a control panel equipped with keys for selecting measurement item candidates displayed on the display unit.

8. The ultrasonic diagnostic apparatus according to claim 7.

10. the measurement item estimation unit is a model trained by associating the received signal with the measurement item candidate, or a model trained by associating an ultrasound image with the measurement item candidate; 3. The ultrasonic diagnostic apparatus according to claim 1.

11. When the measurement item estimation unit cannot estimate a measurable measurement item candidate or can only estimate an unmeasurable measurement item candidate, it displays that the image is unmeasurable or that the image is unsuitable for measurement.

3. The ultrasonic diagnostic apparatus according to claim 1.

12. a measurement unit that measures the measurement item of the observation area even when the measurement item estimation unit cannot estimate a measurable measurement item candidate or can only estimate an unmeasurable measurement item candidate; 3. The ultrasonic diagnostic apparatus according to claim 1.

13. an ultrasonic probe for transmitting and receiving ultrasonic waves to and from a subject; a generating unit that generates ultrasound image data based on a received signal obtained from the observation region; a designation unit for designating a measurement item in the observation area; an estimation unit that estimates whether the specified measurement item is measurable based on the received signal or the ultrasound image data; a display unit that displays information on whether measurement is possible or not; Equipped with An ultrasound diagnostic apparatus, wherein the measurement item is an item indicating measurement of a length of a predetermined portion within the observation region, or measurement of an area of ​​a predetermined portion within the observation region.

14. the display unit displays the information on whether measurement is possible or not in real time. The ultrasonic diagnostic apparatus according to claim 13.

15. The generating unit generates the ultrasound image data in real time, the estimation unit estimates in real time whether the specified measurement item is measurable for the received signal or the ultrasound image data generated in real time.

15. The ultrasonic diagnostic apparatus according to claim 13 or 14.

16. the estimation unit estimates a probability as to whether the measurement item is measurable or not; 15. The ultrasonic diagnostic apparatus according to claim 13 or 14.

17. The display unit Displaying the measurement items whose probability is equal to or greater than a predetermined probability or a predetermined number of measurement items in descending order of the probability as information on whether or not the measurement is possible; a predetermined number of measurement items in descending order of probability, the measurement items having a probability equal to or greater than a predetermined probability, are displayed as information on whether or not the measurement is possible; 17. The ultrasonic diagnostic apparatus according to claim 16.

18. The measurement items include at least one of measurement items related to a B-mode image, a Doppler image, an M-mode image, and an elastography image; The Doppler images include color Doppler images, pulsed Doppler images, continuous wave Doppler images, and tissue Doppler images.

15. The ultrasonic diagnostic apparatus according to claim 13 or 14.

19. the estimation unit is a classifier trained by associating the received signal with the measurement item, or a classifier trained by associating an ultrasound image with the measurement item, 15. The ultrasonic diagnostic apparatus according to claim 13 or 14.

20. When the specified measurement item is estimated to be unmeasurable, the estimation unit displays that the measurement is unmeasurable or that the ultrasound image is unsuitable for measurement.

15. The ultrasonic diagnostic apparatus according to claim 13 or 14.

21. a measurement unit that enables measurement of the measurement item in the observation area even when the estimation unit estimates that the specified measurement item is not measurable; 15. The ultrasonic diagnostic apparatus according to claim 13 or 14.

22. On the computer, a transmission / reception process for transmitting and receiving ultrasonic waves to and from the subject using an ultrasonic probe; A generation process for generating ultrasound image data based on a received signal obtained from the observation region; a measurement item estimation process for estimating measurable or non-measurable measurement item candidates in the observation region based on the received signals or the ultrasound image data; a display process for displaying the measurement item candidates; Execute An ultrasound diagnostic program, wherein the measurement item candidate is a candidate item indicating measurement of the length of a predetermined portion within the observation region, or measurement of the area of ​​a predetermined portion within the observation region.

23. The display process displays the measurement item candidates in real time. The ultrasound diagnostic program according to claim 22.

24. The generation process generates the ultrasound image data in real time, the measurement item estimation process estimates the measurement item candidates in real time for the received signals or the ultrasound image data generated in real time; 24. The ultrasound diagnostic program according to claim 22 or 23.

25. the measurement item estimation process estimates a probability as to whether the measurement item candidate is measurable; 24. The ultrasound diagnostic program according to claim 22 or 23.

26. The display process includes: Displaying measurement item candidates whose probability is equal to or greater than a predetermined probability or a predetermined number of measurement item candidates in descending order of probability, a predetermined number of candidate measurement items are displayed in descending order of probability, the candidate measurement items being those whose probability is equal to or greater than a predetermined probability; 26. The ultrasound diagnostic program according to claim 25.

27. The ultrasound image data is data relating to at least one of a B-mode image, a Doppler image, an M-mode image, and an elastography image, The Doppler images include color Doppler images, pulsed Doppler images, continuous wave Doppler images, and tissue Doppler images.

24. The ultrasound diagnostic program according to claim 22 or 23.

28. the display process detects an input for selecting the displayed measurement item candidates by an operation input unit.

24. The ultrasound diagnostic program according to claim 22 or 23.

29. the display process detects a touch input for selecting the displayed measurement item candidate using a touch panel as the operation input unit.

29. The ultrasound diagnostic program according to claim 28.

30. the display process detects an input for selecting the displayed measurement item candidates using a control panel having keys as the operation input unit.

29. The ultrasound diagnostic program according to claim 28.

31. The measurement item estimation process is a model trained by associating the received signal with the measurement item candidate, or a model trained by associating an ultrasound image with the measurement item candidate.

24. The ultrasound diagnostic program according to claim 22 or 23.

32. In the measurement item estimation process, when a measurable measurement item candidate cannot be estimated or only an unmeasurable measurement item candidate can be estimated, it displays that measurement is not possible or that the ultrasound image is unsuitable for measurement.

24. The ultrasound diagnostic program according to claim 22 or 23.

33. a measurement process for measuring the measurement item of the observation area even if the measurement item estimation process cannot estimate a measurable measurement item candidate or can only estimate an unmeasurable measurement item candidate; causing the computer to execute 24. The ultrasound diagnostic program according to claim 22 or 23.

34. On the computer, a transmission / reception process for transmitting and receiving ultrasonic waves to and from the subject using an ultrasonic probe; A generation process for generating ultrasound image data based on a received signal obtained from the observation region; a designation process for designating a measurement item in the observation area; an estimation process for estimating whether the specified measurement item is measurable based on the received signal or the ultrasound image data; a display process for displaying information on whether or not measurement is possible on a display unit; Execute An ultrasound diagnostic program, wherein the measurement item is an item indicating measurement of the length of a predetermined portion within the observation region, or measurement of the area of ​​a predetermined portion within the observation region.

35. the display processing displays the information on whether or not the measurement is possible in real time.

35. The ultrasound diagnostic program according to claim 34.

36. The generation process generates the ultrasound image data in real time, the estimation process estimates in real time whether the specified measurement item is measurable for the received signal or the ultrasound image data generated in real time; 36. The ultrasound diagnostic program according to claim 34 or 35.

37. the estimation process estimates a probability of whether the measurement item is measurable or not; 36. The ultrasound diagnostic program according to claim 34 or 35.

38. The display process includes: Displaying the measurement items whose probability is equal to or greater than a predetermined probability or a predetermined number of measurement items in descending order of the probability as information on whether or not the measurement is possible; a predetermined number of measurement items in descending order of probability, the measurement items having a probability equal to or greater than a predetermined probability, are displayed as information on whether or not the measurement is possible; 38. The ultrasound diagnostic program according to claim 37.

39. The measurement items include at least one of measurement items related to a B-mode image, a Doppler image, an M-mode image, and an elastography image; The Doppler images include color Doppler images, pulsed Doppler images, continuous wave Doppler images, and tissue Doppler images.

36. The ultrasound diagnostic program according to claim 34 or 35.

40. the estimation process is performed using a classifier trained by associating the received signal with the measurement item, or a classifier trained by associating the ultrasound image with the measurement item.

36. The ultrasound diagnostic program according to claim 34 or 35.

41. When the specified measurement item is estimated to be unmeasurable, the estimation process displays that the measurement is unmeasurable or that the ultrasound image is unsuitable for measurement.

36. The ultrasound diagnostic program according to claim 34 or 35.

42. a measurement process that enables measurement of the measurement item in the observation area even when the specified measurement item is estimated to be unmeasurable by the estimation process; causing the computer to execute 36. The ultrasound diagnostic program according to claim 34 or 35.

43. An ultrasound probe transmits and receives ultrasound to and from the subject, generating ultrasound image data based on received signals obtained from the observation region; Estimating measurable or non-measurable measurement item candidates in the observation region based on the received signals or the ultrasound image data; Display the measurement item candidates, The measurement item candidate is a candidate item indicating measurement of the length of a predetermined portion within the observation area or measurement of the area of ​​a predetermined portion within the observation area. A method for displaying information in an ultrasound diagnostic device.

44. An ultrasound probe transmits and receives ultrasound to and from the subject, generating ultrasound image data based on received signals obtained from the observation region; Specify the measurement items of the observation area, Estimating whether the specified measurement item is measurable based on the received signal or the ultrasound image data; The information on whether or not measurement is possible is displayed on a display unit, The measurement item is an item indicating measurement of the length of a predetermined portion within the observation area, or measurement of the area of ​​a predetermined portion within the observation area. A method for displaying information in an ultrasound diagnostic device.

Images