Ultrasonic diagnostic device, ultrasonic diagnostic method, and ultrasonic diagnostic program

Abstract

To provide an ultrasonic diagnostic device capable of recognizing an object of interest from an ultrasonic image and capable of performing enlarged display of the ultrasonic image and switching of display forms according to a result of the recognition of the object of interest.SOLUTION: An ultrasonic diagnostic device includes: a display unit for displaying an ultrasonic image acquired by an ultrasonic probe; a recognition unit for analyzing the ultrasonic image and recognizing a predetermined region of interest; a determination unit for determining an enlarged display region of the ultrasonic image on the basis of a result of the recognition by the recognition unit; and a display control unit for switching display forms of the ultrasonic image displayed in the display unit between live display and still image display on the basis of the result of the recognition by the recognition unit.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an ultrasound diagnostic apparatus, an ultrasound diagnostic method, and an ultrasound diagnostic program. [Background technology]

[0002] Ultrasound examination (echo examination) is used to diagnose the gestational sac in the uterus and to measure the crown rump length (CRL) of the fetus within the gestational sac.

[0003] In this regard, Patent Document 1 below discloses a technique for identifying an object of interest in an ultrasound image by applying a machine learning classifier. The technique of Patent Document 1 applies a machine learning classifier to identify the object of interest, enlarges the object of interest, and re-acquires an ultrasound image. This configuration makes it possible to quickly identify the object of interest and acquire a high-resolution ultrasound image of the object of interest. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6297085 Summary of the Invention [Problem to be solved by the invention]

[0005] When performing CRL measurement, the area corresponding to the gestational sac and the area corresponding to the fetus are recognized from the ultrasound image displayed live on the display unit of the ultrasound diagnostic device. When both the area corresponding to the gestational sac and the area corresponding to the fetus are recognized, these areas are enlarged and the ultrasound image is switched from live display to still image display.

[0006] On the other hand, if an area corresponding to the gestational sac can be recognized from the ultrasound image displayed live on the display unit of the ultrasound diagnostic device but an area corresponding to the fetus cannot be recognized, it is desirable that only the area corresponding to the gestational sac is enlarged and the live display is continued for further diagnosis, etc. Also, if an area corresponding to the gestational sac cannot be recognized from the ultrasound image displayed live on the display unit of the ultrasound diagnostic device, it is desirable that the ultrasound image is not enlarged and the live display is continued as is.

[0007] Therefore, in ultrasound examinations used for CRL measurement, etc., it is necessary to enlarge the ultrasound image and switch the display format (live display / still image display) depending on the recognition result of the object of interest.

[0008] The present invention has been made in view of the above-mentioned problems, and therefore, an object of the present invention is to provide an ultrasound diagnostic device, an ultrasound diagnostic method, and an ultrasound diagnostic program that are capable of recognizing an object of interest from an ultrasound image and enlarging and displaying the ultrasound image or switching the display format in accordance with the recognition result of the object of interest. [Means for solving the problem]

[0009] The above object of the present invention can be achieved by the following means.

[0010] (1) An ultrasound diagnostic device having a display unit that displays an ultrasound image acquired by an ultrasound probe, a recognition unit that analyzes the ultrasound image and recognizes a predetermined region of interest, a determination unit that determines an enlarged display area of ​​the ultrasound image based on the recognition result by the recognition unit, and a display control unit that switches the display format of the ultrasound image displayed on the display unit between live display and still image display based on the recognition result by the recognition unit.

[0011] (2) The ultrasound diagnostic apparatus according to (1) above, further comprising a measurement unit that calculates a measurement value for the region of interest based on a recognition result by the recognition unit.

[0012] (3) The ultrasound diagnostic device according to (1) or (2) above, wherein, when the recognition unit recognizes the region of interest, the display control unit causes the display unit to display a still ultrasound image, and when the recognition unit does not recognize the region of interest, the display control unit causes the display unit to display a live ultrasound image.

[0013] (4) In the ultrasound diagnostic device described in (1) or (2) above, when the region of interest is recognized by the recognition unit, the determination unit determines a region including the region of interest as an enlarged display region, and the display control unit causes the display unit to display an ultrasound image of the enlarged display region as a still image.

[0014] (5) The ultrasound diagnostic device according to (1) or (2) above, wherein the recognition unit recognizes a plurality of the regions of interest, and the determination unit determines the enlarged display region based on the plurality of regions of interest.

[0015] (6) The ultrasound diagnostic apparatus according to (1) or (2) above, further comprising a setting unit that sets a margin in the enlarged display area.

[0016] (7) In the ultrasound diagnostic device described in (2) above, when the region of interest is recognized by the recognition unit, the determination unit determines a region including the region of interest as an enlarged display region, the display control unit displays the ultrasound image of the enlarged display region as a still image on the display unit, the recognition unit analyzes the ultrasound image of the enlarged display region displayed as a still image on the display unit to re-recognize the region of interest, and the measurement unit calculates the measurement value based on the re-recognition result by the recognition unit.

[0017] (8) An ultrasound diagnostic apparatus according to (1) or (2) above, further comprising a memory unit that stores a learning model that has learned the relationship between the ultrasound image and the region of interest, and the recognition unit recognizes the region of interest using the learning model.

[0018] (9) An ultrasound diagnostic device according to (1) or (2) above, wherein the ultrasound image is an ultrasound image of the inside of the abdomen of a mammal, and the region of interest includes at least one of a region corresponding to a gestational sac and a region corresponding to a fetus.

[0019] (10) The ultrasound diagnostic device described in (9) above, wherein, when the recognition unit recognizes both the area corresponding to the gestational sac and the area corresponding to the fetus, the display control unit causes the display unit to display a still ultrasound image, and when the recognition unit recognizes the area corresponding to the gestational sac but does not recognize the area corresponding to the fetus, the display control unit causes the display unit to display a live ultrasound image.

[0020] (11) An ultrasound diagnostic device as described in (9) above, wherein, when both an area corresponding to the gestational sac and an area corresponding to the fetus are recognized, the determination unit determines an area including the area corresponding to the gestational sac as the enlarged display area, and the display control unit causes the display unit to display an ultrasound image of the enlarged display area as a still image.

[0021] (12) The ultrasound diagnostic device described in (11) above, wherein the determination unit determines the size of the enlarged display area based on the area corresponding to the gestational sac, and determines the display position of the enlarged display area based on the area corresponding to the fetus.

[0022] (13) The ultrasound diagnostic device described in (12) above, wherein the region corresponding to the fetus includes a region corresponding to the fetus's head and a region corresponding to the fetus's buttocks, and the determination unit determines the midpoint between the region corresponding to the head and the region corresponding to the buttocks as the display center position of the enlarged display region.

[0023] (14) In the ultrasound diagnostic device described in (9) above, when the recognition unit recognizes an area corresponding to the gestational sac but does not recognize an area corresponding to the fetus, the determination unit determines an area including the area corresponding to the gestational sac as the enlarged display area, and the display control unit causes the display unit to display live an ultrasound image of the enlarged display area.

[0024] (15) The ultrasound diagnostic device described in (9) above, wherein the region corresponding to the fetus includes a region corresponding to the fetal head and a region corresponding to the fetal buttocks, and when the recognition unit recognizes the region corresponding to the gestational sac, the determination unit determines the region including the region corresponding to the gestational sac as the enlarged display region, and when both the region corresponding to the head and the region corresponding to the buttocks are recognized, the display control unit displays the ultrasound image of the enlarged display region as a still image on the display unit, and when at least one of the region corresponding to the head and the region corresponding to the buttocks is not recognized, the display control unit displays the ultrasound image of the enlarged display region live on the display unit.

[0025] (16) An ultrasound diagnostic method used in an ultrasound diagnostic device having a display unit that displays an ultrasound image acquired by an ultrasound probe, the ultrasound diagnostic method comprising: a step (a) of analyzing the ultrasound image and recognizing a predetermined region of interest; a step (b) of determining an enlarged display region of the ultrasound image based on the recognition result in the step (a); and a step (c) of switching the display format of the ultrasound image displayed on the display unit between live display and still image display based on the recognition result in the step (a).

[0026] (17) An ultrasound diagnostic program executed in an ultrasound diagnostic device having a display unit that displays an ultrasound image acquired by an ultrasound probe, the ultrasound diagnostic program causing the ultrasound diagnostic device to execute the following steps: (a) analyzing the ultrasound image and recognizing a predetermined region of interest; (b) determining an enlarged display region of the ultrasound image based on the recognition result in (a); and (c) switching the display format of the ultrasound image displayed on the display unit between live display and still image display based on the recognition result in (a). [Effects of the Invention]

[0027] According to the present invention, an object of interest (region of interest) is recognized from an ultrasound image, and the ultrasound image can be enlarged and the display format can be switched depending on the recognition result of the object of interest. [Brief explanation of the drawings]

[0028] Advantages and features provided by one or more embodiments of the present invention will be more fully understood from the following detailed description and the accompanying drawings, which are for purposes of illustration only and are not intended to define the limits of the invention. [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an ultrasound diagnostic apparatus. [Figure 2] FIG. 2 is a diagram illustrating the contents stored in a storage unit. [Figure 3] FIG. 1 is a diagram for explaining a learning model. [Figure 4] 10 is a flowchart showing the procedure of ultrasound diagnosis processing. [Figure 5] FIG. 10 is a diagram for explaining image analysis processing using a learning model. [Figure 6] FIG. 10 is a diagram for explaining image enlargement processing of an ultrasound image. [Figure 7] FIG. 10 is a diagram for explaining image enlargement processing of an ultrasound image. [Figure 8] FIG. 10 is a diagram showing an example of an ultrasound image displayed as an enlarged still image. [Figure 9] FIG. 10 is a diagram for explaining a CRL measurement process. [Figure 10] FIG. 10 is a diagram showing an example of a result display screen. [Figure 11] 10A and 10B are diagrams for explaining ultrasonic diagnostic processing according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0029] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings, but the scope of the present invention is not limited to the disclosed embodiments.

[0030] 1 is a diagram showing the schematic configuration of an ultrasound diagnostic device 1 according to one embodiment of the present invention. Note that the following description will be given taking as an example a case where the ultrasound diagnostic device 1 according to this embodiment is used for transvaginal ultrasound examination.

[0031] 1, the ultrasound diagnostic device 1 includes an ultrasound probe 10 and a device main body 20. The ultrasound probe 10 and the device main body 20 are connected via a cable.

[0032] The ultrasonic probe 10 transmits ultrasonic waves to the subject and receives the reflected waves. The ultrasonic probe 10 converts the received reflected waves into electrical signals and outputs them to the device main body 20.

[0033] The device main body 20 has a control unit 21, a memory unit 22, a transmission / reception unit 23, an ultrasound image generation unit 24, a display unit 25, and an operation unit 26. The control unit 21, the memory unit 22, the transmission / reception unit 23, the ultrasound image generation unit 24, the display unit 25, and the operation unit 26 are electrically connected to each other.

[0034] The control unit 21 is configured with a CPU (Central Processing Unit) and memories such as RAM (Random Access Memory) and ROM (Read Only Memory), and controls the above-mentioned units and performs various arithmetic processing according to programs.

[0035] The storage unit 22 is configured by a hard disk drive (HDD) or a solid state drive (SSD), and stores various programs and various data.

[0036] The transmitting / receiving unit 23 transmits an electrical signal to the ultrasound probe 10, causing the ultrasound probe 10 to generate an ultrasonic wave. The transmitting / receiving unit 23 also generates an electrical signal of the reflected wave and outputs it to the ultrasound image generating unit 24.

[0037] The ultrasonic image generating unit 24 generates an ultrasonic image using the electrical signal output from the transmitting / receiving unit 23. A conventional method is used to generate an ultrasonic image (ultrasonic image data).

[0038] The display unit 25 is, for example, a liquid crystal display, and displays ultrasound images and the like on the display screen.

[0039] The operation unit 26 includes various switches, buttons, a trackball, a mouse, a keyboard, a touchpad, etc., and outputs operation signals to the control unit 21.

[0040] The ultrasound diagnostic device 1 may include components other than those described above, or may not include some of the components described above.

[0041] 2 is a diagram showing the contents stored in the storage unit 22. The storage unit 22 stores a learning model 100 that has learned the relationship between an ultrasound image and a predetermined region of interest in the ultrasound image.

[0042] The memory unit 22 also stores programs corresponding to the recognition unit 110, determination unit 120, display control unit 130, setting unit 140, and measurement unit 150. The recognition unit 110 analyzes the ultrasound image using the learning model 100 to recognize a predetermined region of interest. The determination unit 120 determines an enlarged display region of the ultrasound image based on the recognition result by the recognition unit 110. The display control unit 130 switches the display format of the ultrasound image displayed on the display unit 25 between live display and still image display based on the recognition result by the recognition unit 110. The setting unit 140 sets a margin in the enlarged display region of the ultrasound image. The measurement unit 150 calculates a measurement value for the region of interest based on the recognition result by the recognition unit 110. The functions of each of the above units are fulfilled by the control unit 21 executing the corresponding program.

[0043] Next, the learning model 100 stored in the storage unit 22 will be described with reference to Fig. 3. Fig. 3 is a diagram for explaining the learning model 100.

[0044] The learning model 100 is a trained model that has been machine-learned using a large amount of training data. The learning model 100 of this embodiment is generated by training the learning device 180 by deep learning using the ultrasound image 200 and the first to third correct answer images 310, 320, and 330.

[0045] Ultrasound image 200 is an ultrasound image of the subject's lower abdomen, and includes a region corresponding to the gestational sac (gestational sac region) 210 and a region corresponding to the fetus (fetal region) 220. First correct answer image 310 is an image showing gestational sac region 311 in ultrasound image 200. Second correct answer image 320 is an image showing a region corresponding to the fetus's head (head region) 321 in ultrasound image 200. Third correct answer image 330 is an image showing a region corresponding to the fetus's buttocks (buttock region) 331 in ultrasound image 200.

[0046] The numerous ultrasound images 200 used as training data may be ultrasound images acquired by the ultrasound diagnostic device 1 or may be ultrasound images acquired by another ultrasound diagnostic device. The learning model 100 may be generated by training the learning device 180 within the ultrasound diagnostic device 1, or may be generated by training the learning device 180 in another information processing device such as a PC (Personal Computer), and then transferred to the ultrasound diagnostic device 1 and stored in the storage unit 22.

[0047] Learning model 100, which has been trained using such training data, receives an input of ultrasound image 250 newly acquired by ultrasound diagnostic device 1 during transvaginal ultrasound examination, and outputs first to third certainty factor images 410, 420, and 430 (see FIG. 5). A detailed description of the first to third certainty factor images 410, 420, and 430 will be given later.

[0048] With the ultrasound diagnostic device 1 of this embodiment configured as described above, when a predetermined button is pressed during transvaginal ultrasound examination, the gestational sac region and fetal region in the ultrasound image are recognized and the CRL of the fetus is measured. The operation of the ultrasound diagnostic device 1 will be described below with reference to Figures 4 to 11.

[0049] 4 is a flowchart showing the procedure of ultrasound diagnostic processing executed by the ultrasound diagnostic apparatus 1. The processing shown in the flowchart of FIG. 4 is executed by the control unit 21 in accordance with a program stored in the storage unit 22 of the ultrasound diagnostic apparatus 1. At the start of the ultrasound diagnostic processing, the ultrasound probe 10 is inserted into the lower abdomen of the subject, and ultrasound images of the lower abdomen are acquired at a predetermined frame rate (for example, 15 fps) and displayed live on the display unit 25.

[0050] (Step S101) First, the control unit 21 determines whether a predetermined button has been pressed. More specifically, the control unit 21 determines whether a button for executing CRL measurement has been pressed by the examiner.

[0051] When it is determined that the predetermined button has not been pressed (step S101: NO), the control unit 21 waits until the predetermined button is pressed.

[0052] On the other hand, if it is determined that a predetermined button has been pressed (step S101: YES), the control unit 21 proceeds to the process of step S102.

[0053] (Step S102) When it is determined that the predetermined button has been pressed (step S101: YES), the control unit 21 performs image analysis on the ultrasound image. More specifically, the control unit 21 performs image analysis using the learning model 100 on the ultrasound image displayed on the display unit 25 at the time the predetermined button was pressed, and recognizes the gestational sac region, the head region, and the buttocks region.

[0054] FIG. 5 is a diagram illustrating image analysis processing by the learning model 100. As shown in FIG. 5, the learning model 100 receives an ultrasound image 250 acquired by the ultrasound diagnostic device 1 as input and outputs first to third certainty image 410, 420, and 430. The first certainty image 410 is an image indicating the certainty of a gestational sac region 411 in the ultrasound image 250. The second certainty image 420 is an image indicating the certainty of a head region 421 in the ultrasound image 250. The third certainty image 430 is an image indicating the certainty of a buttocks region 431 in the ultrasound image 250. The certainty image is an image in which the certainty of a region of interest is plotted for each pixel of the ultrasound image, and indicates the distribution of the certainty for the entire ultrasound image. In the first to third certainty images 410, 420, and 430, for example, pixels with higher certainty have higher brightness. The ultrasound image 250 may include a gestational sac region 260 and a fetus region 270.

[0055] (Step S103) Next, control unit 21 determines whether a gestational sac region is recognized in the ultrasound image. More specifically, control unit 21 determines whether a gestational sac region is recognized in the ultrasound image by determining whether there are any pixels in first certainty factor image 410 whose certainty factor is equal to or greater than a predetermined first threshold. Note that the first threshold is set appropriately taking into consideration the recognition accuracy of the gestational sac region.

[0056] If it is determined that the gestational sac region is not recognized in the ultrasound image (step S103: NO), the control unit 21 ends the process. As a result, the ultrasound image of the subject's lower abdomen continues to be displayed live on the display unit 25 of the ultrasound diagnostic device 1. This allows the examiner to quickly move the ultrasound probe 10 to search for the gestational sac region.

[0057] On the other hand, when it is determined that a gestational sac region is recognized in the ultrasound image (step S103: YES), the control unit 21 proceeds to the process of step S104.

[0058] (Step S104) When it is determined that a gestational sac region is recognized in the ultrasound image (step S103: YES), control unit 21 determines whether both a head region and a buttocks region are recognized in the ultrasound image. More specifically, control unit 21 determines whether a head region is recognized in the ultrasound image by determining whether second certainty level image 420 contains pixels whose certainty level is equal to or greater than a predetermined second threshold. Control unit 21 also determines whether a buttocks region is recognized in the ultrasound image by determining whether third certainty level image 430 contains pixels whose certainty level is equal to or greater than a predetermined third threshold. The second and third thresholds are set as appropriate, taking into consideration the recognition accuracy of the head region and buttocks region.

[0059] If it is determined that both the head region and the buttocks region are recognized in the ultrasound image (step S104: YES), the control unit 21 proceeds to the process of step S106.

[0060] On the other hand, if it is determined that at least one of the head region and the buttocks region is not recognized in the ultrasound image (step S104: NO), the control unit 21 proceeds to the process of step S105.

[0061] (Step S105) If it is determined that at least one of the head region and buttocks region is not recognized in the ultrasound image (step S104: NO), the control unit 21 enlarges the ultrasound image and ends the process. More specifically, the control unit 21 determines the region including the gestational sac region recognized by image analysis as the enlarged display region, enlarges the ultrasound image, and ends the process. As a result, the ultrasound image with the enlarged gestational sac region continues to be displayed live on the display unit 25 of the ultrasound diagnostic device 1. This allows the examiner to diagnose the gestational sac region or move the ultrasound probe 10 so that both the head region and buttocks region are recognized.

[0062] (Step S106) On the other hand, when it is determined that both the head region and the buttocks region are recognized in the ultrasound image (step S104: YES), the control unit 21 enlarges the ultrasound image. More specifically, the control unit 21 determines the size of the enlarged display region of the ultrasound image based on the gestational sac region recognized by image analysis. The control unit 21 also determines the display center position of the enlarged display region based on the head region and buttocks region recognized by image analysis. The control unit 21 then enlarges the ultrasound image in accordance with the determination.

[0063] 6 and 7 are diagrams for explaining the enlarged display processing of an ultrasound image. In the enlarged display processing of this embodiment, as shown in Fig. 6, the smallest rectangular area 450 including the gestational sac region 411 is determined as the size of the enlarged display region. Also, as shown in Fig. 7, an intermediate position 460 between the center position of the head region 421 and the center position of the buttocks region 431 is determined as the display center position of the enlarged display region.

[0064] A margin may be set in the enlarged display area so that the area surrounding the rectangular area 450 is displayed on the display unit 25. The margin may be set in advance by the examiner via the operation unit 26, for example. With this configuration, the gestational sac area can be appropriately enlarged and displayed. Furthermore, the examiner can adjust the enlargement amount of the enlarged display area to suit their own preferences.

[0065] (Step S107) Next, the control unit 21 switches the display format of the ultrasound image displayed on the display unit 25 from live display to still image display. More specifically, the control unit 21 causes the display unit 25 to display the ultrasound image enlarged in the processing of step S106 as a still image.

[0066] 8 is a diagram showing an example of an ultrasound image displayed as a still image on display unit 25. As shown in FIG. 8, ultrasound image 500 displayed as a still image is an enlarged image in which gestational sac region 510 and fetal region (head region and buttocks region) 520 are enlarged. As described above, in this embodiment, the midpoint between the head region and the buttocks region is set as the display center position of the enlarged image. Therefore, even if fetal region 520 is located at the edge of gestational sac region 510, the entire fetal region 520 can be displayed on display unit 25.

[0067] (Step S108) Next, control unit 21 performs CRL measurement. More specifically, control unit 21 sets two measurement positions 551, 552 corresponding to the head and buttocks of the fetus on the ultrasound image displayed as an enlarged still image based on second and third certainty factor images 420, 430 obtained in the processing of step S102 (see FIG. 9). Then, control unit 21 calculates the CRL from the two measurement positions 551, 552 set on the ultrasound image.

[0068] 9 is a diagram for explaining the CRL measurement process. In the CRL measurement process of this embodiment, the position on enlarged image 550 corresponding to the pixel position with the highest certainty in second certainty image 420 obtained in the process of step S102 is set as head-side measurement position 551. Furthermore, the position on enlarged image 550 corresponding to the pixel position with the highest certainty in third certainty image 430 obtained in the process of step S102 is set as buttock-side measurement position 552. Then, from the distance on the image between the two measurement positions 551 and 552 and the sampling pitch (distance between pixels), the actual distance between the two measurement positions 551 and 552 is calculated as the CRL of the fetus.

[0069] (Step S109) Then, the control unit 21 displays the results and ends the process. More specifically, as shown in Fig. 10, the control unit 21 displays two measurement positions 551, 552 corresponding to the head and buttocks, a line 553 connecting the two measurement positions 551, 552, and a CRL measurement value 554 superimposed on an enlarged still image of the ultrasound image 500. The examiner can understand the CRL of the fetus from the result display screen.

[0070] As described above, according to the ultrasound diagnostic processing of this embodiment, when a predetermined button is pressed during a transvaginal ultrasound examination, the ultrasound image displayed live on the display unit 25 is analyzed. Then, when the gestational sac region, head region, and buttocks region are all recognized in the ultrasound image, the gestational sac region is enlarged and displayed as a still image, and CRL measurement is performed. With this configuration, the examiner does not need to visually recognize the gestational sac region or fetal region from the ultrasound image, manually enlarge the gestational sac region, manually switch from live display to still image display, or manually set the CRL measurement position. This reduces the examiner's workload and allows for efficient CRL measurement.

[0071] In addition, according to the ultrasound diagnostic processing of this embodiment, if the gestational sac region is recognized in the ultrasound image but at least one of the head region and buttocks region is not recognized, the gestational sac region is enlarged and displayed while the live display of the ultrasound image is maintained. This configuration allows the examiner to diagnose the gestational sac region or fine-tune the position of the ultrasound probe 10 so that both the head region and buttocks region are recognized.

[0072] In addition, according to the ultrasound diagnostic processing of this embodiment, if the gestational sac region is not recognized in the ultrasound image, the ultrasound image is not enlarged and the live display of the ultrasound image is maintained. With this configuration, the examiner can quickly move the ultrasound probe 10 to search for the gestational sac region.

[0073] (Variation) 4, in the process of step S106, when determining the enlarged display region of the ultrasound image, the midpoint between the head region and the buttocks region is set as the display center position of rectangular area 450 determined by the gestational sac region. However, unlike the above-described embodiment, the center position of rectangular area 450 determined by the gestational sac region may be set as the display center position of rectangular area 450 as is.

[0074] In the process of the flowchart shown in FIG. 4, when CRL measurement is performed in step S108, two measurement positions 551 and 552 are set based on the second and third certainty factor images 420 and 430 obtained in step S102. However, as shown in FIG. 11, the ultrasound image 500 displayed as an enlarged still image in step S107 may be analyzed again by the learning model 100 to re-recognize the head region and the buttocks region, and two measurement positions may be set based on the re-recognition results. In this case, the learning model 100 receives the ultrasound image 500 displayed as an enlarged still image and outputs first to third certainty factor images 610, 620, and 630. The first to third certainty factor images 610, 620, and 630 are images indicating the certainty factors for the gestational sac region 611, the head region 621, and the buttocks region 631. The pixel position with the highest certainty factor in the second certainty factor image 620 is set as the head-side measurement position 651. Furthermore, the pixel position with the highest confidence level in third confidence level image 630 is set as measurement position 652 on the buttocks side. Then, CRL is calculated from two measurement positions 651, 652. With this configuration, two measurement positions 651, 652 are set based on ultrasound image 500 displayed as an enlarged still image, thereby improving the measurement accuracy of CRL measurement.

[0075] (Reference example) In the above-described embodiment, when an ultrasound image is analyzed and a gestational sac region and a fetal region (head region and buttocks region) are recognized in the ultrasound image, the display format of the ultrasound image displayed on the display unit 25 is switched from live display to still image display. However, unlike the above-described embodiment, when a gestational sac region and a fetal region (head region and buttocks region) are recognized in the ultrasound image, the display screen of the display unit 25 may be divided, and live display and still image display of the ultrasound image may be performed simultaneously.

[0076] As described above, the ultrasonic diagnostic apparatus, ultrasonic diagnostic method, and ultrasonic diagnostic program of the present invention have been described in the above-mentioned embodiments. However, it goes without saying that those skilled in the art can appropriately add, modify, and omit the present invention within the scope of the technical concept thereof.

[0077] For example, in the above-described embodiment, a case where a transvaginal ultrasound examination is performed using the ultrasound diagnostic device 1 of the present invention has been described as an example. However, the ultrasound diagnostic device of the present invention is applicable to various ultrasound examinations, such as transabdominal ultrasound examinations. The learning data used to generate the learning model is changed depending on the content of the ultrasound examination to which the ultrasound diagnostic device is applied.

[0078] Furthermore, in the above-described embodiment, when performing CRL measurement, two measurement positions 551, 552 corresponding to the fetal head and buttocks are set based on the second and third certainty level images 420, 430. However, the examiner may manually set the two measurement positions via the operation unit 26 for the ultrasound image 500 displayed as an enlarged still image.

[0079] In the above-described embodiment, the region of interest in the ultrasound image is recognized by the learning model 100. However, the method for recognizing the region of interest is not limited to image recognition using the learning model, and the region of interest may be recognized by applying various image processing techniques such as pattern matching.

[0080] Furthermore, the means and methods for performing various processes in the ultrasound diagnostic apparatus 1 according to the above-described embodiment can be realized by either a dedicated hardware circuit or a programmed computer. The above-described programs may be provided by a computer-readable recording medium such as a USB (Universal Serial Bus) memory or a DVD (Digital Versatile Disc)-ROM, or may be provided online via a network such as the Internet. In this case, the programs recorded on the computer-readable recording medium are typically transferred to and stored in a storage unit such as a hard disk drive (HDD). The above-described programs may be provided as standalone application software or may be incorporated into the software of the ultrasound diagnostic apparatus 1 as a function of the apparatus.

[0081] While embodiments of the present invention have been described and illustrated in detail, the disclosed embodiments are made for purposes of illustration and example only and are not intended to be limiting, and the scope of the present invention should be construed by the language of the appended claims. [Explanation of symbols]

[0082] 1. Ultrasound diagnostic equipment, 10 Ultrasonic transducer, 20 Device body, 21 control section, 22 Memory section, 23 Transmitting and receiving unit, 24 ultrasound image generation unit, 25 Display section, 26 Operation section, 100 learning models, 200, 250, 500 ultrasound images, 310,320,330 correct images, 410,420,430,610,620,630 confidence images.

Claims

1. a display unit that displays an ultrasound image acquired by the ultrasound probe; a recognition unit that analyzes the ultrasound image and recognizes a predetermined region of interest; a determination unit that determines an enlarged display area of ​​the ultrasound image based on a recognition result by the recognition unit; a display control unit that switches the display format of the ultrasound image displayed on the display unit between live display and still image display based on the recognition result by the recognition unit; An ultrasound diagnostic device having:

2. The ultrasound diagnostic apparatus according to claim 1 , further comprising a measurement unit that calculates a measurement value for the region of interest based on a recognition result by the recognition unit.

3. When the region of interest is recognized by the recognition unit, the display control unit causes the display unit to display a still image of the ultrasound image, The ultrasound diagnostic apparatus according to claim 1 , wherein when the region of interest is not recognized by the recognition unit, the display control unit causes the display unit to display a live ultrasound image.

4. When the region of interest is recognized by the recognition unit, the determination unit determines a region including the region of interest as an enlarged display region; The ultrasound diagnostic apparatus according to claim 1 , wherein the display control unit causes the ultrasound image in the enlarged display area to be displayed as a still image on the display unit.

5. the recognition unit recognizes the plurality of regions of interest; The ultrasound diagnostic apparatus according to claim 1 , wherein the determination unit determines the enlarged display region based on the plurality of regions of interest.

6. The ultrasonic diagnostic apparatus according to claim 1 , further comprising a setting unit that sets a margin in the enlarged display area.

7. When the region of interest is recognized by the recognition unit, the determination unit determines a region including the region of interest as an enlarged display region; the display control unit causes the ultrasound image in the enlarged display area to be displayed as a still image on the display unit; the recognition unit analyzes the ultrasound image of the enlarged display area displayed as a still image on the display unit and re-recognizes the region of interest; The ultrasound diagnostic apparatus according to claim 2 , wherein the measurement unit calculates the measurement value based on a result of re-recognition by the recognition unit.

8. Further, a memory unit is provided to store a learning model that has learned the relationship between the ultrasound image and the region of interest, The ultrasound diagnostic apparatus according to claim 1 , wherein the recognition unit recognizes the region of interest using the learning model.

9. the ultrasound image is an intra-abdominal ultrasound image of a mammal; The ultrasound diagnostic apparatus according to claim 1 , wherein the region of interest includes at least one of a region corresponding to a gestational sac and a region corresponding to a fetus.

10. When the recognition unit recognizes both the region corresponding to the gestational sac and the region corresponding to the fetus, the display control unit causes the display unit to display a still image of the ultrasound image, 10. The ultrasound diagnostic device of claim 9, wherein when the recognition unit recognizes a region corresponding to the gestational sac but does not recognize a region corresponding to the fetus, the display control unit causes the display unit to display a live ultrasound image.

11. when both the region corresponding to the gestational sac and the region corresponding to the fetus are recognized, the determination unit determines the region including the region corresponding to the gestational sac as the enlarged display region; The ultrasound diagnostic apparatus according to claim 9 , wherein the display control unit causes the ultrasound image in the enlarged display area to be displayed as a still image on the display unit.

12. The ultrasound diagnostic device according to claim 11 , wherein the determination unit determines a size of the enlarged display region based on a region corresponding to the gestational sac, and determines a display position of the enlarged display region based on a region corresponding to the fetus.

13. the region corresponding to the fetus includes a region corresponding to the head of the fetus and a region corresponding to the buttocks of the fetus; The ultrasound diagnostic apparatus according to claim 12 , wherein the determination unit determines an intermediate position between the region corresponding to the head and the region corresponding to the buttocks as the display center position of the enlarged display region.

14. When the recognition unit recognizes an area corresponding to the gestational sac but does not recognize an area corresponding to the fetus, the determination unit determines an area including the area corresponding to the gestational sac as the enlarged display area; The ultrasound diagnostic apparatus according to claim 9 , wherein the display control unit causes the display unit to display a live ultrasound image of the enlarged display area.

15. the region corresponding to the fetus includes a region corresponding to the head of the fetus and a region corresponding to the buttocks of the fetus; When the recognition unit recognizes a region corresponding to the gestational sac, the determination unit determines a region including the region corresponding to the gestational sac as the enlarged display region; When both the region corresponding to the head and the region corresponding to the buttocks are recognized, the display control unit causes the display unit to display the ultrasound image of the enlarged display region as a still image; 10. The ultrasound diagnostic apparatus according to claim 9, wherein when at least one of the region corresponding to the head and the region corresponding to the buttocks is not recognized, the display control unit causes the display unit to live-display an ultrasound image of the enlarged display region.

16. An ultrasound diagnostic method used in an ultrasound diagnostic device having a display unit that displays an ultrasound image acquired by an ultrasound probe, comprising: (a) analyzing the ultrasound image to identify a predetermined region of interest; a step (b) of determining an enlarged display area of ​​the ultrasound image based on the recognition result in the step (a); a step (c) of switching the display format of the ultrasound image displayed on the display unit between live display and still image display based on the recognition result in the step (a); An ultrasound diagnostic method comprising:

17. An ultrasound diagnostic program executed in an ultrasound diagnostic device having a display unit that displays an ultrasound image acquired by an ultrasound probe, (a) analyzing the ultrasound image to identify a predetermined region of interest; a step (b) of determining an enlarged display area of ​​the ultrasound image based on the recognition result in the step (a); a step (c) of switching the display format of the ultrasound image displayed on the display unit between live display and still image display based on the recognition result in the step (a); an ultrasound diagnostic program that causes the ultrasound diagnostic device to execute the above steps.

Images