Ultrasound diagnostic device and image processing device

Abstract

To improve accuracy in measurement using an ultrasonic image.SOLUTION: An ultrasonic diagnostic apparatus includes a detection unit, an estimation unit and an output unit. The detection unit detects a first rectangle including a measurement part from an ultrasonic image. The estimation unit estimates a measurement point for measuring the measurement part on the basis of positional information of the first rectangle. The output unit outputs information relating to the measurement point.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to an ultrasound diagnostic apparatus and an image processing apparatus. [Background technology]

[0002] Ultrasound images are used to check the development of a fetus. For example, an ultrasound diagnostic device can measure parameters such as the fetal biparietal diameter (BPD), head circumference (HC), abdominal circumference (AC), femur length (FL), and humerus length (HL) by using ultrasound images.

[0003] Here, when measuring parameters such as BPD, HC, AC, FL, and HL, a method is known in which a measurement point for measuring a measurement region is estimated by image processing based on brightness. However, in this method, if there is a part in the ultrasound image that is brighter than the contour of the actual measurement region, the measurement point may be estimated based on the bright part. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-115559 A Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to improve the accuracy of measurements using ultrasonic images. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0006] The ultrasound diagnostic device according to the present embodiment includes a detection unit, an estimation unit, and an output unit. The detection unit detects a first rectangle that contains a measurement region from an ultrasound image. The estimation unit estimates measurement points for measuring the measurement region based on position information of the first rectangle. The output unit outputs information about the measurement points. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an ultrasonic diagnostic apparatus according to this embodiment. [Diagram 2] FIG. 2 is a diagram for explaining problems that arise when measuring a measurement site. [Diagram 3] FIG. 3 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Figure 4] FIG. 4 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Diagram 5] FIG. 5 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Figure 6] FIG. 6 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Figure 7] FIG. 7 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Figure 8] FIG. 8 is a flowchart showing the procedure of processing by the ultrasonic diagnostic apparatus according to this embodiment. [Figure 9] FIG. 9 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Figure 10] FIG. 10 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Figure 11]FIG. 11 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Figure 12] FIG. 12 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment. [Figure 13] FIG. 13 is a block diagram showing an example of the configuration of a trained model generation device in this embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an ultrasonic diagnostic device and an image processing device according to an embodiment will be described with reference to the accompanying drawings. Note that the embodiment is not limited to the following embodiment. Furthermore, the contents described in one embodiment are, in principle, also applicable to other embodiments.

[0009] Fig. 1 is a block diagram showing an example of the configuration of an ultrasonic diagnostic device 1 according to this embodiment. As shown in Fig. 1, the ultrasonic diagnostic device 1 according to this embodiment includes a device main body 100, an ultrasonic probe 101, an input device 102, and a display 103. The ultrasonic probe 101, the input device 102, and the display 103 are each connected to the device main body 100.

[0010] The ultrasonic probe 101 transmits and receives ultrasonic waves (ultrasonic scan). For example, the ultrasonic probe 101 is brought into contact with the body surface of the subject P (for example, the abdomen of a pregnant woman) and transmits and receives ultrasonic waves to and from a region including at least a part of a fetus in the uterus of the pregnant woman. The ultrasonic probe 101 has a plurality of piezoelectric transducers. The plurality of piezoelectric transducers are piezoelectric elements having a piezoelectric effect that converts between an electric signal (pulse voltage) and mechanical vibration (vibration caused by sound), and generate ultrasonic waves based on a drive signal (electrical signal) supplied from the device body 100. The generated ultrasonic waves are reflected by a mismatched surface of acoustic impedance in the subject P and are received by the plurality of piezoelectric transducers as reflected wave signals (electrical signals) including components scattered by scatterers in tissues. The ultrasonic probe 101 sends the reflected wave signals received by the plurality of piezoelectric transducers to the device body 100.

[0011] In this embodiment, the ultrasonic probe 101 may be any type of ultrasonic probe, such as a 1D array probe having multiple piezoelectric transducers arranged one-dimensionally in a predetermined direction, a 2D array probe in which multiple piezoelectric transducers are arranged two-dimensionally in a lattice pattern, or a mechanical 4D probe in which multiple piezoelectric transducers arranged one-dimensionally mechanically oscillate to scan a three-dimensional region.

[0012] The input device 102 includes a mouse, keyboard, buttons, a panel switch, a touch command screen, a foot switch, a wheel, a trackball, a joystick, etc., and accepts various setting requests from the operator of the ultrasound diagnostic apparatus 1 and transfers the accepted setting requests to the device main body 100.

[0013] The display 103 displays a GUI (Graphical User Interface) for the operator of the ultrasound diagnostic apparatus 1 to input various setting requests using the input device 102, and displays ultrasound image data generated in the device body 100. The display 103 also displays various messages to notify the operator of the processing status of the device body 100. The display 103 is an example of a "display unit."

[0014] The device body 100 is a device that generates ultrasonic image data based on a reflected wave signal received by the ultrasonic probe 101. The ultrasonic image data generated by the device body 100 may be two-dimensional ultrasonic image data generated based on a two-dimensional reflected wave signal, or may be three-dimensional ultrasonic image data generated based on a three-dimensional reflected wave signal.

[0015] 1, the device main body 100 includes, for example, a transmission / reception circuit 110, a B-mode processing circuit 120, a Doppler processing circuit 130, an image processing circuit 140, an image memory 150, a storage circuit 160, and a control circuit 170. The transmission / reception circuit 110, the B-mode processing circuit 120, the Doppler processing circuit 130, the image processing circuit 140, the image memory 150, the storage circuit 160, and the control circuit 170 are connected to each other so as to be able to communicate with each other. The device main body 100 is also connected to a network 2 within the hospital.

[0016] The transmission / reception circuit 110 controls the transmission of ultrasonic waves by the ultrasonic probe 101. For example, the transmission / reception circuit 110 applies the above-mentioned drive signal (drive pulse) to the ultrasonic probe 101 at a timing to which a predetermined transmission delay time is added for each transducer based on an instruction from the control circuit 170. As a result, the transmission / reception circuit 110 causes the ultrasonic probe 101 to transmit an ultrasonic beam in which ultrasonic waves are focused into a beam shape.

[0017] The transmission / reception circuit 110 also controls the reception of the reflected wave signal by the ultrasonic probe 101. As described above, the reflected wave signal is a signal that is generated when the ultrasonic wave transmitted from the ultrasonic probe 101 is reflected by the body tissue of the subject P. For example, the transmission / reception circuit 110 performs an addition process by giving a predetermined delay time to the reflected wave signal received by the ultrasonic probe 101 based on an instruction from the control circuit 170. This enhances the reflected component from the direction corresponding to the reception directivity of the reflected wave signal. Then, the transmission / reception circuit 110 converts the reflected wave signal after the addition process into an in-phase signal (I signal, I: In-phase) and a quadrature signal (Q signal, Q: Quadrature-phase) of the baseband. Then, the transmission / reception circuit 110 sends the I signal and the Q signal (hereinafter referred to as IQ signal) to the B-mode processing circuit 120 and the Doppler processing circuit 130 as reflected wave data. The transmission / reception circuitry 110 may convert the reflected wave signal after the addition process into an RF (Radio Frequency) signal and then send it to the B-mode processing circuitry 120 and the Doppler processing circuitry 130. The IQ signal and the RF signal are signals (reflected wave data) that include phase information.

[0018] The B-mode processing circuit 120 performs various signal processing on the reflected wave data generated from the reflected wave signal by the transmission / reception circuit 110. The B-mode processing circuit 120 performs logarithmic amplification, envelope detection processing, and the like on the reflected wave data received from the transmission / reception circuit 110 to generate data (B-mode data) in which the signal strength of each sample point (observation point) is expressed as luminance brightness. The B-mode processing circuit 120 sends the generated B-mode data to the image processing circuit 140.

[0019] The B-mode processing circuit 120 also executes signal processing for performing harmonic imaging that visualizes harmonic components. Contrast harmonic imaging (CHI) and tissue harmonic imaging (THI) are known as harmonic imaging. In addition, for contrast harmonic imaging and tissue harmonic imaging, known scan methods include amplitude modulation (AM), phase modulation (PM) called the "Pulse Subtraction method" and the "Pulse Inversion method," and AMPM, which combines AM and PM to obtain both the effects of AM and PM.

[0020] The Doppler processing circuit 130 extracts motion information based on the Doppler effect of a moving object at each sample point in the scanning region from the reflected wave data generated by the transmission / reception circuit 110 from the reflected wave signal, and generates the data as Doppler data. Here, the motion information of the moving object is information such as the average speed, variance value, and power value of the moving object, and the moving object is, for example, blood flow, tissue such as the heart wall, and contrast agent. The Doppler processing circuit 130 sends the generated Doppler data to the image processing circuit 140.

[0021] For example, when the moving object is a blood flow, the motion information of the blood flow is information (blood flow information) such as the average velocity, variance, power, etc. of the blood flow. The blood flow information is obtained, for example, by the color Doppler method.

[0022] In the color Doppler method, first, ultrasonic waves are transmitted and received multiple times on the same scanning line, and then, using an MTI (Moving Target Indicator) filter, signals in a specific frequency band are passed through for signals representing the data string of reflected wave data at the same position (same sample point), and signals in other frequency bands are attenuated. In other words, signals (clutter components) originating from stationary tissue or slow-moving tissue are suppressed. In this way, a blood flow signal related to blood flow is extracted from the signal representing the data string of reflected wave data. Then, in the color Doppler method, blood flow information such as the average velocity, variance, and power of the blood flow are estimated from the extracted blood flow signal, and the estimated blood flow information is generated as Doppler data.

[0023] The image processing circuit 140 performs generation processing of image data (ultrasonic image data) and various image processing for image data. For example, the image processing circuit 140 generates two-dimensional B-mode image data in which the intensity of the reflected wave is expressed by brightness from the two-dimensional B-mode data generated by the B-mode processing circuit 120. The image processing circuit 140 also generates two-dimensional Doppler image data in which blood flow information is visualized from the two-dimensional Doppler data generated by the Doppler processing circuit 130. The two-dimensional Doppler image data is velocity image data representing the average velocity of the blood flow, variance image data representing the variance value of the blood flow, power image data representing the power of the blood flow, or image data that combines these. The image processing circuit 140 generates color Doppler image data in which blood flow information such as the average velocity, variance value, and power of the blood flow are displayed in color, or generates Doppler image data in which one piece of blood flow information is displayed in grayscale, as the Doppler image data.

[0024] Here, the image processing circuit 140 generally converts (scan converts) a scan line signal sequence of ultrasonic scanning into a scan line signal sequence of a video format represented by a television or the like, and generates ultrasonic image data for display. Specifically, the image processing circuit 140 generates ultrasonic image data for display by performing coordinate conversion according to the ultrasonic scanning form of the ultrasonic probe 101. In addition to scan conversion, the image processing circuit 140 also performs various image processing, such as image processing (smoothing processing) for regenerating an average brightness image using multiple image frames after scan conversion, and image processing (edge ​​enhancement processing) using a differential filter in the image. In addition, the image processing circuit 140 combines character information of various parameters, scales, body marks, etc. with the ultrasonic image data.

[0025] That is, the B-mode data and the Doppler data are ultrasonic image data before the scan conversion process, and the data generated by the image processing circuit 140 is ultrasonic image data for display after the scan conversion process. The B-mode data and the Doppler data are also called raw data. The image processing circuit 140 generates two-dimensional ultrasonic image data for display from the two-dimensional ultrasonic image data before the scan conversion process.

[0026] Furthermore, the image processing circuit 140 generates three-dimensional B-mode image data by performing coordinate conversion on the three-dimensional B-mode data generated by the B-mode processing circuit 120. Also, the image processing circuit 140 generates three-dimensional Doppler image data by performing coordinate conversion on the three-dimensional Doppler data generated by the Doppler processing circuit 130.

[0027] Furthermore, the image processing circuit 140 performs rendering processing on the volume image data in order to generate various two-dimensional image data for displaying the volume image data on the display 103. The rendering processing performed by the image processing circuit 140 includes, for example, processing for performing multi-planar reconstruction (MPR) to generate MPR image data from the volume image data. The rendering processing performed by the image processing circuit 140 includes, for example, volume rendering (VR) processing for generating two-dimensional image data reflecting information of a three-dimensional image. The rendering processing performed by the image processing circuit 140 includes, for example, surface rendering (SR) processing for generating two-dimensional image data in which only surface information of a three-dimensional image is extracted.

[0028] The image processing circuit 140 stores the generated image data and image data that has been subjected to various image processing in the image memory 150. The image processing circuit 140 may also generate information indicating the display position of each image data, various information for assisting the operation of the ultrasound diagnostic device 1, and supplementary information related to diagnosis such as patient information together with the image data, and store them in the image memory 150.

[0029] Moreover, the image processing circuit 140 according to this embodiment executes an image generating function 141, a detecting function 142, an estimating function 143, and a display control function 144. The detecting function 142 is an example of a detecting unit. The estimating function 143 is an example of an estimating unit. The display control function 144 is an example of an output unit.

[0030] Here, the processing functions executed by the image generation function 141, the detection function 142, the estimation function 143, and the display control function 144, which are components of the image processing circuit 140 shown in Fig. 1, are recorded in the storage circuit 160, for example, in the form of a program executable by a computer. The image processing circuit 140 is a processor that realizes a function corresponding to each program by reading each program from the storage circuit 160 and executing it. In other words, the image processing circuit 140 in a state in which each program has been read has each function shown in the image processing circuit 140 in Fig. 1. The processing contents of the image generation function 141, the detection function 142, the estimation function 143, and the display control function 144 executed by the image processing circuit 140 will be described later.

[0031] In FIG. 1, the processing functions performed by the image generation function 141, the detection function 142, the estimation function 143, and the display control function 144 are described as being realized in a single image processing circuit 140. However, a processing circuit may be formed by combining a plurality of independent processors, and each processor may execute a program to realize a function.

[0032] The term "processor" used in the above description means a circuit such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). When the processor is a CPU, for example, the processor realizes a function by reading and executing a program stored in the memory circuit 60. On the other hand, when the processor is an ASIC, for example, instead of storing a program in the memory circuit 60, the program is directly incorporated in the circuit of the processor. Note that each processor in this embodiment is not limited to being configured as a single circuit for each processor, and may be configured as one processor by combining multiple independent circuits to realize its function. Furthermore, the multiple components in FIG. 1 may be integrated into one processor to realize its function.

[0033] The image memory 150 and the memory circuit 160 are, for example, semiconductor memory elements such as a random access memory (RAM) or a flash memory, or storage devices such as a hard disk or an optical disk.

[0034] The image memory 150 is a memory that stores image data such as B-mode image data and Doppler image data generated by the image processing circuit 140 as ultrasound image data. The image memory 150 can also store image data such as B-mode data generated by the B-mode processing circuit 120 and Doppler data generated by the Doppler processing circuit 130 as ultrasound image data. The ultrasound image data stored in the image memory 150 can be called up by the operator after diagnosis, for example, and becomes ultrasound image data for display via the image processing circuit 140.

[0035] The memory circuitry 160 stores various data such as control programs for transmitting and receiving ultrasound, processing images, and displaying images, diagnostic information (e.g., patient ID, doctor's findings, etc.), diagnostic protocols, and various body marks. The data stored in the memory circuitry 160 can be transferred to an external device via an interface unit (not shown). Examples of the external device include a PC (Personal Computer) used by a doctor performing image diagnosis, storage media such as CDs and DVDs, and printers. The memory circuitry 160 does not need to be built into the ultrasound diagnostic device 1 as long as the ultrasound diagnostic device 1 can access the memory circuitry 160 on the network 2.

[0036] The memory circuit 160 also stores the trained model 400. The trained model 400 is a model generated by learning using ultrasound image data obtained when an ultrasound scan was previously performed and learning data that indicates a region including a measurement site in the ultrasound image data. Examples of the learning include learning using AI (Artificial Intelligence) based on a neural network and machine learning. Through the learning, the trained model 400 is functionalized to receive input of ultrasound image data as input data and output output data indicating a result of detecting a region including a measurement site in the ultrasound image data. Here, examples of the measurement site include the head, abdomen, thigh, and upper arm of a fetus. The use and generation of the trained model 400 will be described later.

[0037] The control circuit 170 controls the overall processing of the ultrasound diagnostic apparatus 1. Specifically, the control circuit 170 controls the processing of the transmission / reception circuit 110, the B-mode processing circuit 120, the Doppler processing circuit 130, the image processing circuit 140, etc., based on various setting requests input by the operator via the input device 102 and various control programs and various data read from the storage circuitry 160.

[0038] The transmission / reception circuit 110, B-mode processing circuit 120, Doppler processing circuit 130, image processing circuit 140, and control circuit 170, etc., built into the device main body 100 may be configured by hardware such as a processor (CPU (Central Processing Unit), MPU (Micro-Processing Unit), integrated circuit, etc.), but may also be configured by software modularized programs.

[0039] In the ultrasound diagnostic device 1 configured as above, for example, for the purpose of checking the growth of a fetus in the uterus of a pregnant woman, the ultrasound probe 101 transmits and receives ultrasound (ultrasound scan) to an area including a part of the fetus (measurement site) in the uterus of the pregnant woman, and the image processing circuit 140 generates an ultrasound image in which the area including the measurement site is imaged based on the scan result. For example, instead of manual measurement using a caliper, the ultrasound diagnostic device 1 automatically detects measurement sites such as the fetal head and abdomen from the ultrasound image, and estimates measurement points for measuring parameters such as the fetal head diameter (BPD), fetal head circumference (HC), abdominal circumference (AC), femur length (FL), and humerus length (HL). In addition, the ultrasound diagnostic device 1 can calculate an estimated fetal weight (EFW) by using the parameters measured using the above measurement points.

[0040] The above has described the overall configuration of the ultrasound diagnostic device 1 according to this embodiment. With this configuration, the ultrasound diagnostic device 1 according to this embodiment can improve the accuracy of measurements using ultrasound images.

[0041] For example, when measuring parameters such as BPD, HC, AC, FL, and HL, a method is known in which measurement points for measuring a measurement site are estimated by image processing based on brightness. Specifically, when measuring parameters such as BPD, HC, and AC from an ultrasound image, the contour of a measurement site such as the head or abdomen is approximated by an ellipse, and a high-brightness area of ​​an ellipse shape is detected in the ultrasound image based on the brightness value, thereby estimating measurement points for measuring the measurement site. In this case, the measurement points are the end points of the long axis and the end points of the short axis of the ellipse. Similarly, when measuring parameters such as FL and HL from an ultrasound image, a rod-shaped area corresponding to a measurement site such as the femur or humerus is detected in the ultrasound image based on the brightness value, and measurement points for measuring the measurement site are estimated. In this case, the measurement points are both end points of the rod-shaped area. However, when applying this method, the following problems arise.

[0042] FIG. 2 is a diagram for explaining problems when measuring a measurement site. For example, when measuring HC from an ultrasound image, as shown in FIG. 2, an ellipse HC100 that approximates the contour of the measurement site is detected using brightness, and measurement points P101 to P103 for measuring the measurement site are estimated. However, if there is a part in the ultrasound image that is brighter than the contour of the actual measurement site represented by the ellipse HC100, the measurement point may be estimated due to the bright part. For example, as shown in FIG. 2, if there is a part that is brighter than the contour represented by the ellipse HC100 and the ellipse HC200 is detected so as to include the part, a point P201 located outside the measurement site is estimated as the measurement point. In this way, when detecting a measurement site based on brightness, there is a possibility that the correct measurement point will not be estimated due to a high-brightness part other than the measurement site, and therefore it may not be possible to accurately measure parameters such as BPD, HC, AC, FL, and HL.

[0043] Therefore, in the ultrasound diagnostic device 1 according to this embodiment, the detection function 142 detects a first rectangle that contains the measurement part from the ultrasound image. The estimation function 143 estimates measurement points for measuring the measurement part based on position information of the first rectangle. The display control function 144 outputs information about the measurement points.

[0044] In the following, each of the image generating function 141, the detecting function 142, the estimating function 143, and the display control function 144 will be described with reference to FIGS.

[0045] 3 to 7 are diagrams for explaining the processing by the image processing circuit 140 of the ultrasound diagnostic device 1 according to this embodiment. For example, FIGS. 3 to 7 are explanatory diagrams for a case where the ultrasound diagnostic device 1 measures the abdominal circumference (AC) of a fetus by using an ultrasound image. In this case, the measurement site is the abdomen of the fetus. FIG. 8 is a flowchart showing the procedure of processing by the ultrasound diagnostic device 1 according to this embodiment. FIG. 8 shows a flowchart explaining the overall operation (image processing method) of the ultrasound diagnostic device 1, and explains which step of the flowchart each component corresponds to.

[0046] 8 is a step performed by the ultrasonic probe 101. In step S101, the ultrasonic probe 101 performs an ultrasonic scan. Specifically, the ultrasonic probe 101 is brought into contact with the body surface of the subject P (the abdomen of the pregnant woman), performs an ultrasonic scan on an area including a part of the fetus (measurement site) in the uterus of the pregnant woman, and collects reflected wave signals from the area as a result of the ultrasonic scan.

[0047] 8 is a step in which the image processing circuitry 140 calls and executes a program corresponding to the image generating function 141 from the storage circuitry 160. In step S102, the image generating function 141 generates an ultrasound image.

[0048] 3 based on the reflected wave signal obtained by the ultrasonic probe 101. The ultrasonic image 200 is ultrasonic image data obtained by imaging an area including a measurement site. Here, the image generating function 141 may generate the ultrasonic image 200 by generating B-mode image data using the B-mode data generated by the B-mode processing circuit 120, or may generate the ultrasonic image 200 using the ultrasonic image data stored in the image memory 150.

[0049] 8 is a step in which the image processing circuitry 140 calls and executes a program corresponding to the detection function 142 from the storage circuitry 160. In step S103, the detection function 142 detects a first bounding box that includes the measurement region from the ultrasound image 200.

[0050] Specifically, the detection function 142 first detects a measurement site from the ultrasound image 200 using the trained model 400 read from the storage circuit 160. The trained model 400 receives ultrasound image data as input data, and outputs output data that is a result of detecting a measurement site in the ultrasound image data. For example, the trained model 400 outputs a rectangle that contains an ellipse that approximates the contour of the abdomen, which is the measurement site, as output data. Such a rectangle is also called a bounding box (circumscribed rectangle). The detection function 142 inputs the ultrasound image 200 to the trained model 400, and detects a first bounding box 210 as shown in FIG. 4 as a bounding box that indicates the position and size of the abdomen of the fetus, the contour of which is approximated by an ellipse, and that contains the abdomen of the fetus. The first bounding box 210 is an example of a "first rectangle."

[0051] Furthermore, the detection function 142 detects a predetermined structure from the ultrasound image 200 using the trained model 400. The trained model 400 receives ultrasound image data as input data, and outputs output data that is a result of detecting a predetermined structure in the ultrasound image data. When the measurement site is the abdomen of the fetus, the predetermined structure is the fetal spine. For example, as shown in FIG. 4, the detection function 142 inputs the ultrasound image 200 to the trained model 400, detects the spine 202, and outputs it as output data.

[0052] Here, the estimation function 143 estimates provisional measurement points for measuring the abdomen of the fetus based on the position information of the first bounding box 210. For example, as shown in Fig. 4, the estimation function 143 estimates points 211 to 213 where an ellipse approximating the contour of the abdomen of the fetus is inscribed in the first bounding box 210 as provisional measurement points. The measurement points 211 to 213 become the end points of the major axis and the end points of the minor axis of the ellipse inscribed in the first bounding box 210, and become the midpoints of the long sides and the midpoints of the short sides of the first bounding box 210.

[0053] 8 is a step in which the image processing circuitry 140 calls up a program corresponding to the detection function 142 from the storage circuitry 160 and executes the program. In step S104, the detection function 142 detects the orientation of the measurement portion based on the position information of the first bounding box 210 and the position information of a predetermined structure.

[0054] Specifically, first, as shown in FIG. 4, the detection function 142 detects a line segment L210 that connects the center C210 of the first bounding box 210 and the center of the fetal spine 202, which is a predetermined structure, in the ultrasound image 200. Next, the detection function 142 detects the direction of the line segment L210 as the direction of the fetal abdomen, which is the measurement site. In the example shown in FIG. 4, the direction of the line segment L210 is inclined by an angle θ clockwise or counterclockwise with respect to the vertical or horizontal direction of the screen on which the ultrasound image 200 is displayed. The vertical and horizontal directions of the screen on which the ultrasound image 200 is displayed correspond to the column and row directions of the pixels of the ultrasound image 200, respectively. For example, as shown in FIG. 4, the direction of the line segment L210 is inclined by an angle θ counterclockwise with respect to the vertical direction of the screen on which the ultrasound image 200 is displayed.

[0055] 8 is a step in which the image processing circuitry 140 calls and executes a program corresponding to the detection function 142 from the storage circuitry 160. In step S105, the detection function 142 performs a process of determining whether or not the measurement portion detected in step S104 is tilted.

[0056] As described above, the direction of line segment L210 detected by detection function 142 can be regarded as the orientation of the abdomen of the fetus, which is the measurement site. For example, the abdomen depicted in ultrasound image 200 can be regarded as tilted counterclockwise by angle θ, based on the vertical direction of the screen on which ultrasound image 200 is displayed. In this case, in the determination process of step S105, detection function 142 determines that the measurement site detected in step S104 is tilted (step S105; Yes).

[0057] 8 is a step in which the image processing circuitry 140 calls up a program corresponding to the detection function 142 from the storage circuitry 160 and executes it. In step S106, the detection function 142 performs a rotation process on the ultrasound image 200 based on the orientation of the measurement region detected in step S104. Specifically, the detection function 142 performs the rotation process so that the direction of the line segment L210 is aligned with the vertical or horizontal direction of the screen on which the ultrasound image 200 is displayed.

[0058] By performing the rotation process, the front-back direction of the abdomen of the fetus, which is the measurement site, is likely to become the vertical or horizontal direction of the screen, and the left-right direction is likely to become the horizontal or vertical direction of the screen. In other words, by performing the rotation process, the long or short axis of the ellipse detected as the contour of the abdomen is likely to become the vertical or horizontal direction of the screen on which the ultrasound image 200 is displayed. Furthermore, by performing such a rotation process, it is likely that one side of the bounding box is likely to become the vertical or horizontal direction of the screen on which the ultrasound image 200 is displayed.

[0059] 5, the detection function 142 performs a rotation process so that the direction of the line segment L210 coincides with the vertical direction of the screen on which the ultrasound image 200 is displayed. That is, the direction of the line segment L210 is tilted counterclockwise by an angle θ with respect to the vertical direction of the screen on which the ultrasound image 200 is displayed, so the detection function 142 rotates the ultrasound image 200 clockwise by the angle θ.

[0060] 8 is a step in which the image processing circuitry 140 calls up a program corresponding to the detection function 142 from the storage circuitry 160 and executes the program. In step S107, the detection function 142 detects a second bounding box that includes the measurement region from the ultrasound image 200 after the rotation process executed in step S106.

[0061] Specifically, the detection function 142 inputs the ultrasound image 200 after the rotation process into the trained model 400, thereby detecting a second bounding box 220 as shown in Fig. 5 as a bounding box that indicates the position and size of the fetal abdomen whose contour is approximated by an ellipse and contains the fetal abdomen. In this case, the bounding box is changed from the first bounding box 210 to the second bounding box 220. For example, the second bounding box 220 is an example of a "second rectangle."

[0062] 8 is a step in which the image processing circuitry 140 calls up a program corresponding to the estimation function 143 from the storage circuitry 160 and executes the program. In step S108, the estimation function 143 estimates measurement points for measuring the abdomen of the fetus based on the position information of the second bounding box 220.

[0063] 5, the estimation function 143 estimates points 221-223 where an ellipse 224 approximating the contour of the abdomen of the fetus is inscribed in the second bounding box 220 as measurement points. The points 221-223 become the end points of the major axis and the end points of the minor axis of the ellipse 224, and become the midpoints of the long sides and the midpoints of the short sides of the second bounding box 220. In this case, the estimation function 143 updates the measurement points 211-213 based on the position information of the first bounding box 210 to the measurement points 221-223 based on the position information of the second bounding box 220 as measurement points for measuring the abdomen of the fetus.

[0064] In the determination process of step S105, when the direction of the line segment L210 detected by the detection function 142 is the vertical or horizontal direction of the screen on which the ultrasound image 200 is displayed, based on the vertical or horizontal direction of the screen on which the ultrasound image 200 is displayed, the abdomen depicted in the ultrasound image 200 can be considered not to be tilted. In this case, the detection function 142 determines that the measurement site detected in step S104 is not tilted (step S105; No), and steps S106 and S107 are not executed, and step S108 is executed. That is, the detection function 142 does not perform a rotation process on the ultrasound image 200, and in step S108, the estimation function 143 sets the measurement points 211 to 213 based on the position information of the first bounding box 210 as the measurement points for measuring the abdomen of the fetus.

[0065] 8 is a step in which the image processing circuitry 140 calls and executes a program corresponding to the display control function 144 from the storage circuitry 160. In step S109, the display control function 144 causes information relating to the measurement points 221 to 223 to be output on the screen.

[0066] For example, the display control function 144 displays on the display 103 an image in which marks indicating the positions of the measurement points 221 to 223 are drawn on the ultrasound image 200 before the rotation process is performed, as information on the measurement points 221 to 223. Specifically, first, the display control function 144 draws marks indicating the positions of the measurement points 221 to 223 on the ultrasound image 200 after the rotation process, as shown in FIG. 5. Here, the ultrasound image 200 on which the marks indicating the positions of the measurement points 221 to 223 are drawn is an image obtained by rotating the ultrasound image 200 shown in FIG. 4 clockwise by an angle θ. Therefore, as shown in FIG. 6, the display control function 144 rotates the ultrasound image 200 on which the marks indicating the positions of the measurement points 221 to 223 are drawn counterclockwise by an angle θ. At this time, as shown in FIG. 7, an image in which the marks indicating the positions of the measurement points 221 to 223 are drawn on the ultrasound image 200 before the rotation process is displayed on the display 103. Moreover, on the display 103, an ellipse 224, whose major and minor axes correspond to the measurement points 221 to 223, is displayed superimposed on the image.

[0067] Here, when the display control function 144 displays the image shown in FIG. 7 on the display 103 as information related to the measurement points 221 to 223, the display control function 144 may notify the operator that the measurement points 221 to 223 have been estimated. For example, the input device 102 or the display 103 may be provided with a lamp such as an LED (Light Emitting Diode), and the display control function 144 may turn on the lamp to notify the operator that the measurement points 221 to 223 have been estimated, and then display the image shown in FIG. 7 on the display 103. For example, the display control function 144 may display a message on the display 103 to the effect that the measurement points 221 to 223 have been estimated, and then display the image shown in FIG. 7 on the display 103. For example, the display 103 may have a speaker (not shown), and the display control function 144 may output a predetermined sound such as a beep, and then display the image shown in FIG. 7 on the display 103.

[0068] It should be noted that the mark displayed on the image shown in Fig. 7 can be changed by the operator. For example, the operator can move the mark displayed on the image by operating the input device 102.

[0069] This allows the estimation function 143 to measure the abdominal circumference (AC) of the fetus by using the ultrasound image 200 and the measurement points 221 to 223. For example, the estimation function 143 measures the perimeter of an ellipse 224 formed by the measurement points 221 to 223 in the ultrasound image 200 as AC.

[0070] In this manner, in the ultrasound diagnostic device 1 according to the present embodiment, the detection function 142 detects the first bounding box 210 that includes the measurement part from the ultrasound image 200, and the estimation function 143 estimates the measurement points for measuring the measurement part based on the position information of the first bounding box 210. Specifically, the detection function 142 detects a predetermined structure together with the first bounding box 210 from the ultrasound image 200. Next, the detection function 142 performs a rotation process on the ultrasound image 200 based on the position information of the predetermined structure and the position information of the first bounding box 210, and detects the second bounding box 220 that includes the measurement part from the ultrasound image 200 that has been rotated. Next, the estimation function 143 updates the measurement points 211 to 213 based on the position information of the first bounding box 210 to the measurement points 221 to 223 based on the position information of the second bounding box 220 as the measurement points for measuring the measurement part. Then, the display control function 144 causes information regarding the measurement points 221 to 223 to be output.

[0071] As a result, in the ultrasound diagnostic device 1 according to this embodiment, instead of detecting an ellipse that fits the contour of the measurement part based on a high-luminance area and estimating the measurement points, a bounding box that contains the entire measurement part is detected and the measurement points are estimated, improving the accuracy of measurement using the ultrasound image 200. Also, in the ultrasound diagnostic device 1 according to this embodiment, since the measurement points are estimated from the entire measurement part by using a bounding box, the measurement points can be estimated more efficiently than estimating measurement points one by one, which are difficult to show features.

[0072] In addition, although not limited to detection using the trained model 400, in part detection, the part can be detected at a more accurate position if the posture of the part to be detected is not tilted. In this embodiment, the measurement part is detected by a bounding box, a predetermined structure capable of estimating the posture of the measurement part is detected, and the image of the detection target is rotated so that one side of the bounding box containing the measurement part is in the vertical or horizontal direction. Then, in this embodiment, the detection process of the bounding box is performed again from the image after the rotation process, so that the part can be detected at a more accurate position, and as a result, the estimation accuracy of the measurement point can be improved.

[0073] In the above-described embodiment, the case of measuring the abdominal circumference (AC) of a fetus has been described, but this is not limited thereto, and this embodiment can also be applied to measuring parameters such as the fetal head diameter (BPD), fetal head circumference (HC), femur length (FL), and humerus length (HL).

[0074] First, a case where parameters such as BPD and HC are measured will be described. Fig. 9 is a diagram for explaining processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment, and is an explanatory diagram for measuring parameters such as BPD and HC.

[0075] For example, after steps S101 and S102 are executed, in step S103, the detection function 142 detects a first bounding box that contains the measurement site from the ultrasound image. Specifically, the detection function 142 inputs the ultrasound image 500 to the trained model 400 to detect a first bounding box 510 as shown in FIG. 9 as a bounding box that indicates the position and size of the fetal head whose contour is approximated by an ellipse and contains the fetal head. In addition, the detection function 142 inputs the ultrasound image 500 to the trained model 400 to detect a predetermined structure. For example, when the measurement site is the fetal head, the predetermined structure is the fetal septum pellucidum 502. Here, the estimation function 143 estimates a tentative measurement point for measuring the fetal head based on the position information of the first bounding box 510. For example, as shown in FIG. 9, the estimation function 143 estimates points 511 to 514 where an ellipse approximating the contour of the fetus's head is inscribed in a first bounding box 510 as tentative measurement points.

[0076] In step S104, the detection function 142 detects the orientation of the measurement site based on the position information of the first bounding box 510 and the position information of the predetermined structure. Specifically, the detection function 142 first detects a line segment L510 connecting the center C510 of the first bounding box 510 and the center of the fetal cavity septum pellucidum 502, which is the predetermined structure, in the ultrasound image 500, as shown in FIG. 9. Next, the detection function 142 detects the direction of the line segment L510 as the orientation of the fetal head, which is the measurement site. For example, when the vertical or horizontal direction of the screen on which the ultrasound image 500 is displayed is used as a reference, the direction of the line segment L510 is the horizontal direction of the screen on which the ultrasound image 500 is displayed.

[0077] In step S105, the detection function 142 performs a process of determining whether or not the measurement portion detected in step S104 is tilted.

[0078] In the determination process of step S105, when the direction of the line segment L510 detected by the detection function 142 is the vertical or horizontal direction of the screen on which the ultrasound image 500 is displayed, based on the vertical or horizontal direction of the screen on which the ultrasound image 500 is displayed, the head depicted in the ultrasound image 500 can be considered not to be tilted. In this case, the detection function 142 determines that the measurement site detected in step S104 is not tilted (step S105; No), and the processes of steps S106 and S107 are not executed, and the process of step S108 is executed. That is, the detection function 142 does not perform a rotation process on the ultrasound image 500, and in step S108, the estimation function 143 sets the measurement points 511 to 514 based on the position information of the first bounding box 310 as the measurement points for measuring the fetal head.

[0079] In step S109, the display control function 144 causes the display 103 to display an image in which marks indicating the positions of the measurement points 511-514 are depicted on the ultrasound image 500 as information relating to the measurement points 511-514.

[0080] This allows the estimation function 143 to measure HC by using the ultrasound image 500 and the measurement points 511 to 514. For example, the estimation function 143 measures the perimeter of an ellipse formed by the measurement points 511 to 514 in the ultrasound image 500 as HC.

[0081] This allows the estimation function 143 to measure HC by using the ultrasound image 500 and the measurement points 511 to 514. For example, the estimation function 143 measures the perimeter of an ellipse formed by the measurement points 511 to 514 in the ultrasound image 500 as HC.

[0082] Furthermore, the estimation function 143 can measure the BPD by using the ultrasound image 500 and the measurement points 513 and 514. For example, the estimation function 143 measures the length of a line segment connecting the measurement point 513 and the measurement point 514 in the ultrasound image 500 as the BPD.

[0083] In addition, in the determination process of step S105, if the detection function 142 determines that the measurement part detected in step S104 is tilted (step S105; Yes), the following processes of steps S106 to S109 are executed.

[0084] First, in step S106, the detection function 142 performs a rotation process on the ultrasound image 500 based on the orientation of the measurement site detected in step S104. Specifically, the detection function 142 performs the rotation process so that the direction of the line segment L510 becomes the vertical or horizontal direction of the screen on which the ultrasound image 500 is displayed. Next, in step S107, the detection function 142 detects a second bounding box that contains the measurement site from the ultrasound image 500 after the rotation process executed in step S106. Specifically, the detection function 142 inputs the ultrasound image 500 after the rotation process into the trained model 400, thereby detecting a second bounding box that indicates the position and size of the fetal head whose outline is approximated by an ellipse and that contains the fetal head.

[0085] Next, in step S108, the estimation function 143 estimates measurement points for measuring the fetal head based on the position information of the second bounding box. Specifically, the estimation function 143 estimates points where an ellipse approximating the contour of the fetal head is inscribed in the second bounding box as the measurement points. In this case, the estimation function 143 updates the measurement points 511 to 514 based on the position information of the first bounding box 510 to the measurement points based on the position information of the second bounding box as the measurement points for measuring the fetal head. Then, in step S109, the display control function 144 causes the display 103 to display an image in which marks indicating the positions of the updated measurement points are depicted in the ultrasound image 500 as information on the measurement points.

[0086] In step S103, for example, when the measurement site is the fetal head, the predetermined structure is the fetal cavum septum pellucidum 502, but the present invention is not limited to this.

[0087] For example, as shown in FIG. 10, when the measurement site is the fetal head, the predetermined structure may be the fetal tetrageminal cistern 503. In this case, in step S104, first, as shown in FIG. 10, the detection function 142 detects a line segment L510 connecting the center C510 of the first bounding box 510 and the center of the fetal tetrageminal cistern 503, which is the predetermined structure, in the ultrasound image 500. Next, the detection function 142 detects the direction of the line segment L510 as the direction of the fetal head, which is the measurement site. Then, the processing from step S105 onwards is performed. For example, when the measurement site is not tilted (step S105; No), the ultrasound image 500 is not rotated, and the measurement points 511 to 514 are estimated from the position information of the first bounding box 310 (step S108), and information about the measurement points 511 to 514 is displayed on the display 103 (step S109). On the other hand, the measurement site is tilted (step S105; Yes), so a rotation process is performed on the ultrasound image 500 (step S106), and a second bounding box containing the measurement site is detected from the ultrasound image 500 after the rotation process (step S107). Then, a measurement point is estimated from the position information of the second bounding box (step S108), and information about the measurement point is displayed on the display 103 (step S109). In the example shown in FIG. 10, even when the predetermined structure is the fetal tetrageminal cistern 503, the orientation of the fetal head can be detected in the same way as when the predetermined structure is the cavum septum pellucidum 502.

[0088] Also, for example, as shown in FIG. 11, when the measurement site is the fetal head, the predetermined structure may be the fetal cavum septum pellucidum 502 and tetrageminal cistern 503. In this case, in step S104, first, as shown in FIG. 11, the detection function 142 detects a line segment L510 connecting the center C510 of the first bounding box 510 and the center of the fetal cavum septum pellucidum 502 and tetrageminal cistern 503, which are the predetermined structures, in the ultrasound image 500. Next, the detection function 142 detects the direction of the line segment L510 as the orientation of the fetal head, which is the measurement site. Then, the processes from step S105 onwards are performed. For example, if the measurement region is not tilted (step S105; No), the ultrasound image 500 is not rotated, and the measurement points 511-514 are estimated from the position information of the first bounding box 310 (step S108), and information about the measurement points 511-514 is displayed on the display 103 (step S109). On the other hand, if the measurement region is tilted (step S105; Yes), the ultrasound image 500 is rotated (step S106), and a second bounding box containing the measurement region is detected from the ultrasound image 500 after the rotation process (step S107). Then, the measurement points are estimated from the position information of the second bounding box (step S108), and information about the measurement points is displayed on the display 103 (step S109). In the example shown in FIG. 11, the specified structures are the fetal cavum septum pellucidum 502 and tetrageminal cisterna 503, and therefore the orientation of the fetal head can be detected more accurately than when the specified structures are either the cavum septum pellucidum 502 or tetrageminal cisterna 503.

[0089] Next, a case where FL is measured will be described. Fig. 12 is a diagram for explaining the processing by the image processing circuit of the ultrasonic diagnostic apparatus according to this embodiment, and is an explanatory diagram for the case where FL is measured.

[0090] For example, after steps S101 and S102 are executed, in step S103, the detection function 142 detects a first bounding box that contains the measurement site from the ultrasound image. Specifically, when ultrasound image data is input, the learned model 400 outputs a bounding box that circumscribes a rod-shaped area corresponding to the femur, which is the measurement site, as output data. The detection function 142 inputs an ultrasound image 600 to the learned model 400, and detects a first bounding box 610 as shown in FIG. 12 as a bounding box that indicates the position and size of the fetal femur approximated to a rod-shaped area and contains the fetal femur. Here, when the measurement site is the femur or the humerus, the detection function 142 does not execute steps S104 to S107.

[0091] In step S108, the estimation function 143 estimates measurement points for measuring the fetal thigh based on the position information of the first bounding box 610. For example, as shown in Fig. 12, the estimation function 143 estimates points 611 and 612 where a rod-shaped region corresponding to the fetal thigh is inscribed in the first bounding box 610 as measurement points. The measurement points 611 and 612 correspond to both ends of the femur.

[0092] In step S109, the display control function 144 causes the display 103 to display, as information relating to the measurement points 611 and 612, an image in which marks indicating the positions of the measurement points 611 and 612 are depicted on the ultrasound image 600.

[0093] This allows the estimation function 143 to measure FL by using the ultrasound image 600 and the measurement points 611 and 612. For example, the estimation function 143 measures the length of the line segment connecting the measurement points 611 and 612 in the ultrasound image 600 as FL.

[0094] Similarly, when measuring HL, for example, steps S101 to S103, S108, and S109 are executed, whereby the estimation function 143 measures the length of a line segment connecting two measurement points in an ultrasound image as HL.

[0095] Here, the process of generating the trained model 400 through machine learning will be described.

[0096] The trained model 400 is generated, for example, by a device (hereinafter, referred to as a trained model generation device) separate from the ultrasound diagnostic device 1 and stored in the ultrasound diagnostic device 1 (for example, stored in the memory circuitry 160). Here, the trained model generation device may be realized by the ultrasound diagnostic device 1, and, for example, the trained model 400 may be generated by the ultrasound diagnostic device 1 (for example, the estimation function 143) and stored in the memory circuitry 160. Below, an example will be described in which the trained model 400 is generated by the trained model generation device and stored in the ultrasound diagnostic device 1.

[0097] Fig. 13 is a block diagram showing an example of the configuration of a trained model generation device 300 in this embodiment. As shown in Fig. 13, the trained model generation device 300 includes an input device 302, a display 303, an image processing circuit 340, and a memory circuit 360. The trained model generation device 300 is used as a viewer that generates a trained model 400.

[0098] The input device 302 has a mouse, a keyboard, a button, a panel switch, a touch command screen, a foot switch, a wheel, a trackball, a joystick, etc., and accepts various setting requests from an operator of the trained model generation device 300 and transfers the accepted various setting requests to the image processing circuit 340. The display 303 is a monitor viewed by the operator of the trained model generation device 300.

[0099] The image processing circuit 340 controls the overall processing of the trained model generation device 300. For example, the image processing circuit 340 executes a training data acquisition function 341 and a trained model generation function 342, as shown in FIG.

[0100] The storage circuitry 360 is, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. Here, each processing function executed by the learning data acquisition function 341 and the learned model generation function 342, which are components of the image processing circuitry 340, is recorded in the storage circuitry 360 in the form of a program executable by a computer, for example. The image processing circuitry 340 is a processor that reads each program from the storage circuitry 360 and executes it to realize a function corresponding to each program. The storage circuitry 360 also stores the learning program as an algorithm of a neural network.

[0101] In the process of generating the trained model 400, first, the training data acquisition function 341 of the trained model generation device 300 acquires a plurality of data sets obtained when an ultrasound scan was previously performed. Each of the plurality of data sets includes ultrasound image data collected when an ultrasound scan was previously performed on a measurement site, and training data representing a region in the ultrasound image data that includes the measurement site. Note that, since the neural network algorithm learns from experience, the data sets used for training do not need to be of the same subject.

[0102] The trained model generation function 342 of the trained model generation device 300 uses the training program 502 read from the storage circuitry 160 to train a pattern of training data from a plurality of data sets. At this time, the trained model generation function 342 generates a trained model 400 that is functionalized to receive input data (ultrasound image data) and output output data indicating the result of detecting an area including a measurement site in the ultrasound image data. For example, the generated trained model 400 is stored in the ultrasound diagnostic device 1 (stored in the storage circuitry 160). The trained model 400 in the storage circuitry 160 can be read by, for example, the detection function 142 of the ultrasound diagnostic device 1.

[0103] In a process using the trained model 400, the detection function 142 of the ultrasound diagnostic device 1 receives ultrasound image data as input data. Then, using the trained model 400 read from the storage circuitry 160, the detection function 142 detects an area including a measurement site from the ultrasound image 200, which is ultrasound image data, and outputs output data that is the detection result.

[0104] In this embodiment, the case where the trained model 400 is used has been described, but the trained model 400 may not be used. For example, in this embodiment, a measurement site such as the abdomen may be detected by image processing using brightness, and then a bounding box containing the measurement site may be detected. In such a case, in this embodiment, the measurement site may not be detected as a figure that fits the measurement site such as an ellipse, but may be detected as a site surrounded by an arbitrary curve. In addition, in this embodiment, a predetermined structure may also be detected by image processing using brightness without using the trained model 400.

[0105] (Other embodiments) The embodiment is not limited to the above-mentioned embodiment. For example, the image processing circuit 140 may be a workstation installed separately from the ultrasound diagnostic device 1. In this case, the workstation has a processing circuit similar to the image processing circuit 140 and executes the above-mentioned processing.

[0106] In addition, each component of each device illustrated in the embodiment is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to that illustrated, and all or a part of it can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc. Furthermore, each processing function performed by each device can be realized in whole or in any part by a CPU and a program analyzed and executed by the CPU, or can be realized as hardware using wired logic.

[0107] The display method described in the above embodiment can be realized by executing a prepared image processing program on a computer such as a personal computer or a workstation. This image processing program can be distributed via a network such as the Internet. This image processing program can also be recorded on a non-transitory computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, or a DVD, and executed by being read out from the recording medium by a computer.

[0108] According to at least one of the embodiments described above, it is possible to improve the accuracy of measurements using ultrasonic images.

[0109] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention.

[0110] Regarding the above embodiment, the following supplementary notes are disclosed as one aspect and optional features of the invention. (Appendix 1) a detection unit that detects a first rectangle including a measurement region from an ultrasound image; an estimation unit that estimates a measurement point for measuring the measurement portion based on position information of the first rectangle; an output unit that outputs information regarding the measurement points; An ultrasound diagnostic device comprising: (Appendix 2) The detection unit is Detecting a predetermined structure together with the first rectangle from the ultrasound image; performing a rotation process on the ultrasound image based on position information of the predetermined structure and position information of the first rectangle; A second rectangle including the measurement region is detected from the ultrasound image that has been subjected to the rotation process; The estimation unit updates the measurement point based on the position information of the first rectangle to a measurement point based on the position information of the second rectangle, The output unit may output information about a measurement point based on position information of the second rectangle. (Appendix 3) The detection unit may perform the rotation process so that a direction of a line segment connecting the specified structure and a center of the first rectangle is in a vertical or horizontal direction of a screen on which the ultrasound image is displayed. (Appendix 4) When the direction of the line segment is the vertical or horizontal direction of a screen on which the ultrasound image is displayed, the detection unit does not need to perform the rotation process. (Appendix 5) When the detection unit approximates the contour of the measurement site with an ellipse, the detection unit may perform the rotation process so that the major axis or minor axis of the ellipse is aligned with the vertical or horizontal direction of a screen on which the ultrasound image is displayed. (Appendix 6) When the contour of the measurement region is approximated by a rectangle, the detection section may perform the rotation process so that one side of the rectangle is in the vertical or horizontal direction of a screen on which the ultrasound image is displayed. (Appendix 7) The output unit may cause a display unit to display an image in which a mark indicating the position of the measurement point is depicted on the ultrasound image. (Appendix 8) The output unit may cause a display unit to display an image in which a mark indicating a position of the measurement point is depicted on the ultrasound image before the rotation process is performed. (Appendix 9) When the measurement site is the abdomen of the fetus, the predetermined structure may be the spine of the fetus. (Appendix 10) When the measurement site is the fetal head, the predetermined structure may be at least one of the fetal cavity septum pellucidum and the cisternae tetrageminae. (Appendix 11) a detection unit that detects a first rectangle including a measurement region from an ultrasound image; an estimation unit that estimates a measurement point for measuring the measurement portion based on position information of the first rectangle; an output unit that outputs information regarding the measurement points; An image processing device comprising: [Explanation of symbols]

[0111] 142 Detection Function 143 Estimated Function 144 Display control function 210 First bounding box 221~223 Measurement points 510 First bounding box 511~513 Measurement points 610 First bounding box 611~613 Measurement points

Claims

1. a detection unit that inputs an ultrasound image of a subject to a trained model trained using an ultrasound image and a contour of a measurement part in the ultrasound image, and outputs, as a first rectangle, a circumscribing rectangle that includes the measurement part in the ultrasound image of the subject output by the trained model and circumscribing the contour of the measurement part; an estimation unit that estimates, based on position information of the first rectangle, a plurality of points at which an ellipse that approximates a contour of the measurement portion is inscribed in the first rectangle as a plurality of measurement points for measuring the measurement portion; an output unit that outputs information about the measurement points; Equipped with The estimation unit measures the measurement part using the plurality of measurement points. Ultrasound diagnostic equipment.

2. a detection unit that inputs an ultrasound image of a subject to a trained model trained using an ultrasound image and a contour of a measurement part in the ultrasound image, and outputs, as a first rectangle, a circumscribing rectangle that includes the measurement part in the ultrasound image of the subject output by the trained model and circumscribing the contour of the measurement part; an estimation unit that estimates, based on position information of the first rectangle, a plurality of points at which an ellipse that approximates a contour of the measurement portion is inscribed in the first rectangle as a plurality of measurement points for measuring the measurement portion; an output unit that outputs information about the measurement points; Equipped with The detection unit is Detecting a predetermined structure from an ultrasound image of the subject using the trained model; performing a rotation process on the ultrasound image of the subject based on position information of the predetermined structure and position information of the first rectangle; A second rectangle including the measurement region is detected from the ultrasound image that has been subjected to the rotation process; the estimation unit updates, as the plurality of measurement points, measurement points based on position information of the first rectangle to measurement points based on position information of the second rectangle; The output unit outputs information about a measurement point based on position information of the second rectangle. Ultrasound diagnostic equipment.

3. the detection unit performs the rotation process so that a direction of a line segment connecting the predetermined structure and a center of the first rectangle coincides with a vertical direction or a horizontal direction of a screen on which an ultrasound image of the subject is displayed. The ultrasonic diagnostic apparatus according to claim 2 .

4. the detection unit does not perform the rotation process when the direction of the line segment is the vertical or horizontal direction of a screen on which the ultrasound image of the subject is displayed. The ultrasonic diagnostic apparatus according to claim 3.

5. When the contour of the measurement region is approximated by an ellipse, the detection unit performs the rotation process so that the major axis or the minor axis of the ellipse is aligned with the vertical direction or the horizontal direction of a screen on which an ultrasound image of the subject is displayed. The ultrasonic diagnostic apparatus according to any one of claims 2 to 4.

6. When the contour of the measurement region is approximated by a rectangle, the detection unit performs the rotation process so that one side of the rectangle is in the vertical or horizontal direction of a screen on which an ultrasound image of the subject is displayed. The ultrasonic diagnostic apparatus according to any one of claims 2 to 4.

7. the output unit causes a display unit to display an image in which marks indicating the positions of the plurality of measurement points are depicted in an ultrasound image of the subject. The ultrasonic diagnostic apparatus according to any one of claims 1 to 6.

8. The output unit causes a display unit to display an image in which marks indicating the positions of the plurality of measurement points are depicted on an ultrasound image before the rotation process is performed. The ultrasonic diagnostic apparatus according to any one of claims 2 to 6.

9. When the measurement site is the abdomen of the fetus, the predetermined structure is the spine of the fetus. The ultrasonic diagnostic apparatus according to any one of claims 2 to 6 and 8.

10. When the measurement site is the head of the fetus, the predetermined structure is at least one of the cavity septum pellucidum and the cistern of the fetus. The ultrasonic diagnostic apparatus according to any one of claims 2 to 6 and 8.

11. a detection unit that inputs an ultrasound image of a subject to a trained model trained using an ultrasound image and a contour of a measurement part in the ultrasound image, and outputs, as a first rectangle, a circumscribing rectangle that includes the measurement part in the ultrasound image of the subject output by the trained model and circumscribing the contour of the measurement part; an estimation unit that estimates, based on position information of the first rectangle, a plurality of points at which an ellipse that approximates a contour of the measurement portion is inscribed in the first rectangle as a plurality of measurement points for measuring the measurement portion; an output unit that outputs information regarding the measurement points; Equipped with The estimation unit measures the measurement part using the plurality of measurement points. Image processing device.

Images