Ultrasonic diagnostic device and recording medium

Abstract

The present invention relates to an ultrasonic diagnostic device and a recording medium, and aims to provide a technology that enables a user to intuitively grasp the section recognition result when performing section recognition processing on an ultrasonic image. A recognition unit (20) performs scanning section recognition processing on an ultrasonic image generated by ultrasonic scanning, thereby estimating multiple candidates for scanning sections scanned by ultrasonic scanning. The recognition unit (20) calculates a score representing the accuracy of its estimation for each candidate. A display control unit (22) displays a candidate image on a display in a different display form according to each score, and the candidate image represents each of multiple candidates with a higher score among the multiple candidates.

Description

Technical Field

[0001] The present invention relates to an ultrasonic diagnostic device and a recording medium. Background Art

[0002] There is known a technique for estimating candidates for a cross section scanned by ultrasound by performing cross section recognition processing on an ultrasound image, and displaying candidates having a likelihood greater than or equal to a threshold value.

[0003] Patent Document 1 describes a technique for displaying the same number of body marker candidates and likelihoods as the number of candidates based on cross-sectional information.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2021-153774

[0005] When the displayed cross-section recognition result is not what the user wants, the user may sometimes want to modify the cross-section recognition result through an intuitive method. As a prerequisite, the user may sometimes want to intuitively grasp the cross-section recognition result. However, the previous technology cannot provide a method to meet this user demand. Summary of the invention

[0006] An object of the present invention is to provide a technology that enables a user to intuitively grasp the cross-section identification result when a cross-section identification process is performed on an ultrasonic image.

[0007] One embodiment of the present invention is an ultrasonic diagnostic device, characterized in that it includes: an identification unit, which performs scanning section identification processing on an ultrasonic image generated by ultrasonic scanning, thereby estimating multiple candidates for the scanning section scanned by the ultrasonic scan, and calculating a score representing the accuracy of its estimation for each candidate; and a display control unit, which displays the candidate image on a display in a different display form according to each score, the candidate image representing each of the multiple candidates with a higher score among the multiple candidates.

[0008] The display control unit may display the plurality of candidate images on the display in an arrangement order corresponding to the scores, and may display the plurality of candidate images on the display by changing the arrangement order of the plurality of candidate images according to an arrangement order change instruction from a user.

[0009] The ultrasonic diagnostic apparatus may further include an accepting unit that accepts user selection of a candidate having a score equal to or greater than a threshold value, and does not accept user selection of a candidate having a score less than the threshold value.

[0010] When the candidate selected by the user corresponds to a candidate image displayed at a position corresponding to a specific order in the arrangement order corresponding to the score, and the candidate has a score equal to or greater than a threshold value, the acceptance unit may accept the selection.

[0011] When the user selects a candidate having a score smaller than a threshold value, the acceptance section may accept the selection as a valid selection according to the content of a process performed after the selection.

[0012] When the ultrasonic diagnostic apparatus continuously acquires a plurality of ultrasonic images indicating candidates having scores equal to or greater than a first threshold, the next examination may be performed if the number of the plurality of continuously acquired ultrasonic images is equal to or greater than a second threshold.

[0013] When no candidate having a score equal to or greater than a threshold value is estimated, the display control unit may display, on the display, information prompting the user to manually select a candidate.

[0014] When no candidate having a score equal to or greater than a threshold value is estimated, the display control unit may display a candidate list for the user to select a candidate on the display if an area where a plurality of candidate images are displayed is specified.

[0015] The display control unit may display on the display cross-section candidates whose inspection has been completed and cross-section candidates whose inspection has not been completed separately.

[0016] When the user issues an instruction for re-recognition after the recognition unit estimates multiple candidates, the recognition unit may exclude the candidate with the highest score among the multiple candidates by performing recognition processing on the ultrasonic image again, and estimate multiple new candidates for the scan section. The display control unit may display a candidate image representing the multiple new candidates on the display.

[0017] The ultrasonic diagnostic apparatus may further include an execution unit configured to execute the examination according to a setting related to a first candidate among the plurality of candidates.

[0018] Another embodiment of the present invention is a program that enables a computer to function as the following mechanisms: an identification mechanism that performs scanning section identification processing on an ultrasonic image generated by ultrasonic scanning, thereby estimating multiple candidates for the scanning section scanned by the ultrasonic scan, and calculating a score representing the accuracy of the estimation for each candidate; and a display control mechanism that displays a candidate image on a display in a different display form according to each score, the candidate image representing each of a plurality of candidates with a higher score among the plurality of candidates.

[0019] Effects of the Invention

[0020] According to the present invention, it is possible to provide a technique that enables a user to intuitively grasp the cross-section identification result when the cross-section identification process is executed on an ultrasonic image. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1It is a block diagram showing the structure of the ultrasonic diagnostic apparatus according to the embodiment.

[0022] Figure 2 is a graph representing candidate images.

[0023] Figure 3 It is a diagram schematically showing a rotary encoder.

[0024] Figure 4 FIG. 1 is a diagram showing a display example of a candidate image group.

[0025] Figure 5 FIG. 1 is a diagram showing a display example of a candidate image group.

[0026] Figure 6 FIG. 1 is a diagram showing a selection screen showing a list of candidates for scan cross sections.

[0027] Figure 7 FIG. 1 is a diagram showing a display example of a candidate image group.

[0028] Figure 8 FIG. 1 is a diagram showing a selection screen showing a list of candidates for scan cross sections.

[0029] Fig. 9 FIG. 1 is a diagram showing a display example of a candidate image group.

[0030] Fig.10 This is a block diagram showing the structure of an ultrasonic diagnostic apparatus according to Modification 5.

[0031] Fig.11 FIG. 1 is a diagram showing a display example of a candidate image group.

[0032] Fig.12 This is a diagram showing a determination screen for the user to determine candidates.

[0033] Fig.13 FIG. 1 is a diagram showing a display example of a candidate image group.

[0034] Fig.14 This is a block diagram showing the structure of an ultrasonic diagnostic apparatus according to Modification Example 6.

[0035] Explanation of symbols

[0036] 18-display unit, 20-recognition unit, 22-display control unit, 24-correction unit, 28-control unit, 76-except external parts, 90-setting unit, 92-execution unit. DETAILED DESCRIPTION

[0037] refer to Figure 1 , an ultrasonic diagnostic apparatus 10 according to an embodiment will be described. Figure 1 It is a block diagram showing the configuration of the ultrasonic diagnostic apparatus 10 according to the embodiment.

[0038] The ultrasonic diagnostic apparatus 10 generates ultrasonic image data by transmitting and receiving ultrasonic waves using the ultrasonic probe 12. For example, the ultrasonic diagnostic apparatus 10 transmits ultrasonic waves into a subject and receives ultrasonic waves reflected in the subject, thereby generating ultrasonic image data showing the internal tissue of the subject.

[0039] The ultrasonic probe 12 is a device for transmitting and receiving ultrasonic waves. The ultrasonic probe 12 includes, for example, a 1D array vibrator. The 1D array vibrator is composed of a plurality of ultrasonic vibrators arranged in one dimension. An ultrasonic beam is formed by the 1D array vibrator, and the ultrasonic beam is repeatedly electronically scanned. Thus, a scanning section is formed in the living body each time an electronic scan is performed. The scanning section is equivalent to a two-dimensional echo data acquisition space. The ultrasonic probe 12 may include a 2D array vibrator formed by a plurality of ultrasonic vibrators arranged in two dimensions. If an ultrasonic beam is formed by a 2D array vibrator, and the ultrasonic beam is repeatedly electronically scanned, a scanning section as a two-dimensional echo data acquisition space is formed each time an electronic scan is performed. If a two-dimensional scan of the ultrasonic beam is performed, a three-dimensional space as a three-dimensional echo data acquisition space is formed. As a scanning method, sector scanning, linear scanning, or convex scanning is used.

[0040] The transceiver 14 functions as a transmission beamformer and a reception beamformer. When transmitting, the transceiver 14 supplies a plurality of transmission signals having a predetermined delay relationship to a plurality of ultrasonic transducers included in the ultrasonic probe 12. Thus, an ultrasonic transmission beam is formed. When receiving, the ultrasonic probe 12 receives a reflected wave (RF signal) from the living body, thereby outputting a plurality of reception signals from the ultrasonic probe 12 to the transceiver 14. The transceiver 14 applies a phasing addition process to the plurality of reception signals, thereby forming a reception beam. The data of the reception beam is output to the image generation unit 16. That is, for the reception signal obtained from each ultrasonic transducer, the transceiver 14 performs a delay process according to the delay process condition with respect to each ultrasonic transducer, and performs an addition process on the plurality of reception signals obtained from the plurality of ultrasonic transducers, thereby forming a reception beam. The delay process condition is specified by reception delay data indicating a delay time. A reception delay data set (i.e., a set of delay times) corresponding to the plurality of ultrasonic transducers is supplied from the control unit 28.

[0041] Through the action of the transceiver 14, the ultrasonic beam (i.e., the transmission beam and the reception beam) is electronically scanned, thereby forming a scan section. The scan section is equivalent to a plurality of beams, and the plurality of beams constitute a reception frame (specifically, an RF signal frame). In addition, each beam is composed of a plurality of echoes arranged in the depth direction. By repeatedly performing electronic scanning of the ultrasonic beam, a plurality of reception frames arranged on the time axis are output from the transceiver 14 to the image generator 16. A plurality of reception frames constitute a reception frame sequence.

[0042] When the ultrasonic beam performs two-dimensional electronic scanning by the transceiver 14, a three-dimensional echo data acquisition space is formed, and volume data as an echo data collection body is acquired from the three-dimensional echo data acquisition space. By repeatedly performing electronic scanning of the ultrasonic beam, a plurality of volume data arranged on the time axis is output from the transceiver 14 to the image generator 16. The plurality of volume data constitutes a volume data sequence.

[0043] For the received frames output from the transceiver 14, the image generation unit 16 applies signal processing such as detection, amplitude compression (such as logarithmic compression) and conversion functions (based on the coordinate transformation function and interpolation processing function of DSC (digital scan converter)) to generate ultrasonic image data (such as B-mode image data). Hereinafter, the image data will be appropriately referred to as "image". For example, ultrasonic image data will be appropriately referred to as "ultrasonic image", or B-mode image data will be appropriately referred to as "B-mode image". In addition, the ultrasonic image involved in the present embodiment is not limited to B-mode image, but can also be any image generated by the ultrasonic diagnostic device 10. For example, the ultrasonic image involved in the present embodiment can also be a color Doppler image, a pulsed Doppler image, a strain imaging image (Strain Image) or a shear wave elastography image (Shear Wave Elastography Image), etc. For the ultrasonic image, the image generation unit 16 can perform superimposition processing on the required graphic data.

[0044] The ultrasonic image is output to the display unit 18 and displayed on the display unit 18 in a display form according to a display mode. The display mode is preset and can be changed by the user.

[0045] The display unit 18 is a display such as a liquid crystal display or an EL display. Ultrasonic images such as B-mode images are displayed on the display unit 18. The display unit 18 may also be a device that has both a display and an operation unit 26. For example, a GUI (Graphic User Interface) may be implemented by the display unit 18. In addition, a user interface such as a touch panel may be implemented by the display unit 18.

[0046] The recognition unit 20 estimates multiple candidates of the scanned sections by performing section recognition processing on the ultrasonic image. And the recognition unit 20 calculates a score indicating the accuracy of the estimation (i.e., the accuracy of the estimation) for each candidate of the scanned section. The score indicating the accuracy of the estimation is sometimes also called likelihood.

[0047] The recognition unit 20 can estimate the candidates of the currently scanned scanning cross section by performing the cross section recognition process on the currently acquired ultrasonic image. That is, the recognition unit 20 can also estimate the candidates of the scanning cross section in real time.

[0048] As another example, the recognition unit 20 may estimate candidates for scan cross sections by executing cross section recognition processing on ultrasonic images that have been acquired and stored in a storage device of the ultrasonic diagnostic apparatus 10 or an external device.

[0049] The candidate of the estimated scanning cross section is a candidate of a region indicated in the ultrasonic image of the estimated scanning cross section. That is, the recognition unit 20 estimates the candidate of the region to be ultrasonically scanned by executing the cross section recognition process on the ultrasonic image.

[0050] As the section recognition processing involved in this embodiment, a well-known section recognition processing is used. For example, machine learning or artificial intelligence (AI) can be used in the section recognition processing. The type of machine learning or artificial intelligence used is not limited, and any algorithm or model can be used. For example, CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), GAN (Generative Adversarial Networks), linear models, random forest decision tree learning, support vector machine (SVM), ensemble classifier or other algorithms are used. In addition, pattern matching such as template matching, or algorithms that do not require learning such as correlation coefficient and similarity calculations can also be used for section recognition processing.

[0051] For example, the recognition unit 20 estimates multiple candidates for the scanned cross section by performing cross section recognition processing using machine learning on the ultrasonic image, and calculates a score indicating the accuracy of the estimation using the machine learning (i.e., the accuracy of the estimation) for each candidate for the scanned cross section. Thus, multiple candidates for the ultrasonically scanned part are estimated, and a score indicating the accuracy of the estimation is calculated for each candidate part.

[0052] The recognition unit 20 can compare an ultrasonic image (e.g., a B-mode image) generated by transmitting and receiving ultrasonic waves with a plurality of standard cross-sectional images (e.g., a B-mode image), thereby estimating a plurality of candidates for scanning cross sections scanned by ultrasonic waves, and calculating a score indicating the accuracy of the estimation for each candidate for scanning cross section. At this time, techniques such as pattern matching can also be used.

[0053] The standard cross-sectional image is an ultrasonic image used to estimate the scanning cross section. For example, one or more standard cross-sectional images are generated in advance for each diagnostic part and stored in a storage device of the ultrasonic diagnostic device 10 or an external device. A standard cross-sectional image representing a certain part is an ultrasonic image generated by scanning a standard scanning cross section intersecting the part with ultrasonic waves. For example, the standard scanning cross section is a cross section or a representative cross section that should be photographed in an ultrasonic examination.

[0054] The maximum number of candidates for the scan cross section may be set. The maximum number of candidates for the scan cross section may be set for each part. When "25" is set as the maximum number of candidates, the recognition unit 20 estimates 25 candidates at most.

[0055] The display control unit 22 displays a candidate image representing each of the plurality of candidates with a higher score on the display unit 18 in a different display form according to each score. For example, the display control unit 22 displays the plurality of candidate images on the display unit 18 in an arrangement order corresponding to the score.

[0056] According to the user's instruction to change the arrangement order, the correction unit 24 changes the arrangement order of the plurality of candidate images. The correction unit 24 outputs information indicating the changed arrangement order to the display control unit 22. For example, if the user issues an instruction to change the arrangement order to the ultrasonic diagnostic apparatus 10 by operating the operation unit 26, the correction unit 24 changes the arrangement order of the plurality of candidate images according to the change instruction.

[0057] When receiving information indicating the changed arrangement order from the correction unit 24, the display control unit 22 arranges and displays the plurality of candidate images in the changed arrangement order on the display unit 18. That is, the display control unit 22 changes the arrangement order of the plurality of candidate images according to the arrangement order change instruction of the user, and arranges and displays the plurality of candidate images on the display unit 18.

[0058] When multiple candidates having scores greater than or equal to a threshold are estimated, the display control unit 22 may distinguish candidates for scanned sections that have been examined and candidates for scanned sections that have not been examined and display them on the display unit 18. For example, the threshold is set in advance and may be changed by the user.

[0059] The operation unit 26 is a device for the user to input conditions and instructions required for imaging or examination into the ultrasonic diagnostic apparatus 10. For example, the operation unit 26 is an operation panel, a switch, a button, a keyboard, a mouse, a trackball, a joystick, or the like.

[0060] The control unit 28 controls the operation of each unit of the ultrasonic diagnostic apparatus 10. The control unit 28 may accept the user's selection of a candidate having a score greater than a threshold value, and may not accept the user's selection of a candidate having a score less than the threshold value. In this case, the control unit 28 functions as an example of an accepting unit.

[0061] When the candidate selected by the user corresponds to a candidate image displayed at a position corresponding to a specific order in the arrangement order corresponding to the score, and the candidate has a score equal to or greater than a threshold value, the control unit 28 may accept the selection.

[0062] For example, the user selects a candidate for a scan cross section by operating the operation unit 26. The control unit 28 accepts the selection or does not accept the selection.

[0063] The ultrasonic diagnostic apparatus 10 includes a storage device (not shown). The storage device is a device that constitutes one or more storage areas for storing data. The storage device is, for example, a hard disk drive (HDD), a solid state drive (SSD), various memories (such as RAM, DRAM, ROM, etc.), other storage devices (such as optical disks, etc.), or a combination thereof. For example, ultrasonic images or information indicating imaging conditions are stored in the storage device.

[0064] Below, reference Figure 2 The candidate images are described. Figure 2 An example of a candidate image is shown.

[0065] Here, as an example, the recognition unit 20 estimates the kidney section, liver section, and pancreas section as candidates for the scan section. The kidney section is a scan section that intersects the kidney. The liver section is a scan section that intersects the liver. The pancreas section is a scan section that intersects the pancreas. That is, the recognition unit 20 estimates that any one of the kidney, liver, or pancreas is represented in the ultrasonic image generated by the transmission and reception of ultrasonic waves. In other words, the recognition unit 20 estimates that any one of the kidney, liver, or pancreas is scanned by ultrasonic waves.

[0066] The recognition unit 20 calculates a score indicating the accuracy of the estimation for each candidate scan section. Here, the recognition unit 20 calculates a score indicating the accuracy of the estimation of the kidney section, a score indicating the accuracy of the estimation of the liver section, and a score indicating the accuracy of the estimation of the pancreas section.

[0067] The display control unit 22 displays the candidate images on the display unit 18 in different display forms according to each score, and the candidate images represent each of the plurality of candidates with higher scores among the plurality of candidates. For example, the display control unit 22 displays the plurality of candidate images on the display unit 18 in an arrangement order corresponding to the scores. For example, the candidates from the first to the third are the candidates with higher scores. Here, as an example, the kidney cross section, the liver cross section, and the pancreas cross section are the candidates with higher scores.

[0068] The other scan sections except the kidney section, liver section and pancreas section can be identified by the identification unit 20, and the scores of the other scan sections are calculated. At this time, the top-ranked candidate images are also displayed on the display unit 18. For example, when the kidney section, liver section and pancreas section are top-ranked candidates among the kidney section, liver section, pancreas section and other scan sections, the candidate images of the kidney section, liver section and pancreas section are displayed on the display unit 18.

[0069] Figure 2 , candidate image groups 30, 32, and 34 are shown. Each candidate image group includes a plurality of candidate images. Each candidate image group 30, 32, and 34 will be described below.

[0070] First, the candidate image group 30 is described. The candidate image group 30 includes candidate images 36A, 38A, and 40A. The candidate image 36A is an image showing a cross section of a kidney as a candidate. The candidate image 38A is an image showing a cross section of a liver as a candidate. The candidate image 40A is an image showing a cross section of a pancreas as a candidate.

[0071] The display control unit 22 configures each candidate image in the candidate image group 30 at a position corresponding to the score. For example, among the kidney section, the liver section, and the pancreatic section, the kidney section has the highest score, the liver section has the second highest score, and the pancreatic section has the third highest score. The scan section with the highest score is the first candidate, the scan section with the second highest score is the second candidate, and the scan section with the third highest score is the third candidate. The display control unit 22 configures candidate image 36A as the first candidate at the first candidate position corresponding to the highest score. The display control unit 22 configures candidate image 38A as the second candidate at the second candidate position corresponding to the second highest score. The display control unit 22 configures candidate image 40A as the third candidate at the third candidate position corresponding to the third highest score. Figure 2In the example shown, the first candidate position is the highest position among the three positions. The second candidate position is the left position facing. The third candidate position is the right position facing. Therefore, the display control unit 22 configures the candidate image 36A at the highest position, configures the candidate image 38A at the left position facing, and configures the candidate image 40A at the right position facing. In this way, the display control unit 22 arranges the candidate images 36A, 38A, and 40A in the order corresponding to the scores. By arranging and displaying each candidate image in this way, the user can intuitively grasp the ranking of each candidate of the scan section.

[0072] The display control unit 22 can distinguish between the display form of the candidate image representing the candidate with a score above the threshold and the display form of the candidate image representing the candidate with a score below the threshold. For example, the display control unit 22 displays the candidate image representing the candidate with a score above the threshold in a solid line, and displays the frame of the candidate image representing the candidate with a score below the threshold in a dotted line. In this way, the user can intuitively distinguish and grasp the candidates with a score above the threshold and the candidates with a score below the threshold.

[0073] The frames of the candidate images 36A, 38A, and 40A included in the candidate image group 30 are shown by dotted lines. That is, the scores of the kidney cross section, the liver cross section, and the pancreas cross section are all less than the threshold. The fact that the scores are less than the threshold means that the reliability of the estimation of each candidate is low. The user can recognize that the reliability of the estimation of each candidate is low by referring to the candidate image group 30. In addition, the user is prompted with the candidates with scores less than the threshold, so that the user can understand what kind of scan cross section the candidate with scores less than the threshold is.

[0074] The display control unit 22 displays the candidate image group 30 on the display unit 18. The user can intuitively grasp the ranking of the candidates of each scanning section (i.e., the ranking based on the score) by referring to the candidate image group 30. In addition, the user can intuitively grasp that the reliability of the candidate estimation is low. At this time, the user may consider changing the position or angle of the ultrasonic probe 12 and continuing the imaging so that the score corresponding to the part of the imaging object (i.e., the score of the scanning section intersecting the part of the imaging object) becomes higher.

[0075] The candidate image group 32 is described below. The candidate image group 32 includes candidate images 36B, 38B, and 40A. The candidate image 36B is an image showing a cross section of a kidney as a candidate. The candidate image 38B is an image showing a cross section of a liver as a candidate. The candidate image 40A is an image showing a cross section of a pancreas as a candidate.

[0076] For example, among the kidney section, liver section, and pancreas section, the kidney section has the highest score, the liver section has the second highest score, and the pancreas section has the third highest score. Therefore, the display control unit 22 arranges the candidate image 36B at the highest position, arranges the candidate image 38B at the left position facing it, and arranges the candidate image 40A at the right position facing it. In this way, the display control unit 22 arranges the candidate images 36B, 38B, and 40A in the order of arrangement corresponding to the scores.

[0077] The frames of the candidate images 36B and 38B included in the candidate image group 32 are shown with solid lines. That is, the scores of the kidney cross section and the liver cross section are both above the threshold. The score being above the threshold means that the reliability of the estimation of each candidate is high. On the other hand, as with the candidate image group 30, the frame of the candidate image 40A is shown with dotted lines.

[0078] The display control unit 22 displays the candidate image group 32 on the display unit 18. By referring to the candidate image group 32, the user can intuitively understand that the scores of the kidney cross section and the liver cross section are greater than the threshold and the score of the pancreas cross section is less than the threshold.

[0079] For example, if the user instructs execution of the next examination by operating the operation unit 26, the control unit 28 receives the instruction. The ultrasonic diagnostic apparatus 10 executes the next examination according to the instruction. For example, the ultrasonic diagnostic apparatus 10 executes a specific examination for the part corresponding to the candidate image arranged at the first candidate position. Measurement of ultrasonic images, setting of Doppler flow velocity measurement, detection of abnormalities represented in ultrasonic images, display of the abnormalities, adjustment of ultrasonic image quality, creation of reports, and display of reports are all examples of examinations.

[0080] Taking the candidate image group 32 as an example, the candidate image 36B corresponding to the kidney is arranged at the first candidate position. Therefore, if the user instructs to perform an examination, the ultrasonic diagnostic apparatus 10 performs a unique examination on the kidney on the ultrasonic image, for example, performing unique measurements on the kidney.

[0081] As another example, when the candidate selected by the user corresponds to a candidate image displayed at a position corresponding to a specific position in the arrangement order corresponding to the score, and the candidate has a score above a threshold, the control unit 28 can accept the selection. For example, the specific position is the first position (i.e., the position with the highest score), and the position corresponding to the specific position is the first candidate position. If the user selects the candidate image 36B configured at the first candidate position, the control unit 28 accepts the selection. If the user instructs to perform an examination, the ultrasonic diagnostic apparatus 10 performs a specific examination on the kidney corresponding to the candidate image 36B.

[0082] Even if the user selects the candidate image 38B arranged at the second candidate position, the control unit 28 does not accept the selection. Similarly, even if the user selects the candidate image 40A arranged at the third candidate position, the control unit 28 does not accept the selection. Therefore, even if the user instructs to perform an examination, the ultrasonic diagnostic apparatus 10 does not perform a unique examination for the liver and a unique examination for the pancreas.

[0083] As another example, when the user operates the operation unit 26 to select a candidate image representing a candidate having a score greater than or equal to the threshold value, the control unit 28 may also accept the selection. In this case, the ultrasonic diagnostic apparatus 10 performs an examination on the part corresponding to the selected candidate under the control of the control unit 28. For example, when the user operates the operation unit 26 to select the candidate image 36B or the candidate image 38B, the control unit 28 accepts the selection. When the candidate image 36B is selected, the ultrasonic diagnostic apparatus 10 performs an examination on the kidney. When the candidate image 38B is selected, the ultrasonic diagnostic apparatus 10 performs an examination on the liver.

[0084] On the other hand, even if the user selects a candidate image representing a candidate having a score less than the threshold value by operating the operation unit 26, the control unit 28 does not accept the selection. For example, even if the user selects the candidate image 40A, the control unit 28 does not accept the selection. In this case, the ultrasonic diagnostic apparatus 10 does not perform an examination on the pancreas.

[0085] Next, the candidate image group 34 will be described. The candidate image group 34 is generated by changing the arrangement order of the candidate images 36B, 38B, and 40A included in the candidate image group 32.

[0086] When the user issues an instruction to change the arrangement order of the candidate images 36B, 38B, and 40A included in the candidate image group 32 by operating the operation unit 26, the correction unit 24 changes the arrangement order of the candidate images 36B, 38B, and 40A according to the instruction. The display control unit 22 displays the candidate image group 34 in a state where the arrangement order of the candidate images has been changed on the display unit 18.

[0087] For example, through the user's operation, the candidate image 38B is arranged at the first candidate position, the candidate image 40A is arranged at the second candidate position, and the candidate image 36B is arranged at the third candidate position. In this state, if the user instructs to perform an examination, the ultrasonic diagnostic apparatus 10 performs a unique examination on the liver corresponding to the candidate image 38B arranged at the first candidate position.

[0088] When the user selects a candidate image representing a candidate with a score less than a threshold value by operating the operation unit 26, the control unit 28 can accept the selection as a valid selection according to the content of the processing performed after the selection. For example, the workflow of ultrasonic examination is preset. The workflow of ultrasonic examination is an examination protocol or an examination step. The workflow includes multiple examinations (such as measurement, etc.). The order of each examination is preset. Therefore, the examination performed after the selection of the candidate image is preset. For example, a workflow is set for each part of the diagnostic object, or a workflow is set for each patient. When the examination performed after the selection of the candidate image is a processing other than measurement, the control unit 28 can accept the selection as a valid selection. For example, the processing of recording the position of the scan section is an example of an examination other than measurement. At this time, the control unit 28 accepts the selection of the candidate image representing a candidate with a score less than the threshold value as a valid selection, and records the position of the selected candidate (i.e., the candidate of the scan section). When the examination performed after the selection of the candidate image is measurement, the control unit 28 does not accept the selection as a valid selection. At this time, the measurement is not performed. In addition, even when the examination performed after the selection of the candidate image is a measurement, the control unit 28 can accept the selection as a valid selection. In this case, the ultrasonic diagnostic apparatus 10 performs a unique examination on the part corresponding to the selected candidate. The result of the examination is displayed on the display unit 18. The display control unit 22 displays a message indicating low reliability on the display unit 18 together with the result of the examination.

[0089] For example, the user changes the arrangement order of the candidate images by operating a rotary encoder, a button or switch displayed on a touch panel, or a physical button or switch, etc. The arrangement order of the candidate images may also be changed by voice or sight.

[0090] Figure 3 : represents the rotary encoder 42. The rotary encoder 42 is provided on the operation panel included in the operation unit 26. For example, the user can change the arrangement order of the candidate images by operating the rotary encoder 42 upward (U direction), downward (D direction), leftward (L direction), rightward (R direction), and in the rotation direction (θ direction).

[0091] For example, the candidate images can be moved along the direction in which the rotary encoder 42 is rotated. Specifically, by rotating the rotary encoder 42 in the clockwise direction, the candidate image arranged at the first candidate position can be arranged at the third candidate position, the candidate image arranged at the second candidate position can be arranged at the first candidate position, and the candidate image arranged at the third candidate position can be arranged at the second candidate position. After changing the arrangement order of the candidate images, when the user presses the confirmation button, the change of the arrangement order can be confirmed.

[0092] Figure 4 Display example of candidate image groups. Screen 44 is formed on display unit 18. For example, display control unit 22 displays ultrasound image 46 such as B-mode image on screen 44. In addition, display control unit 22 displays candidate image groups of scanned sections (i.e., sections from which ultrasound image 46 is obtained) on screen 44. Here, as an example, candidate image group 32 is displayed on screen 44.

[0093] For example, after the ultrasonic image 46 is displayed in a frozen state, the candidate image group is updated. Displaying the ultrasonic image 46 in a frozen state means displaying the ultrasonic image 46 as a still image. For example, if the user instructs freezing by operating the operation unit 26, the display control unit 22 displays the ultrasonic image 46 in a frozen state on the display unit 18. A button or switch for instructing freezing may also be provided on the operation unit 26.

[0094] The recognition unit 20 estimates a plurality of candidates for scan cross sections from which the ultrasonic image 46 can be obtained by performing cross section recognition processing on the ultrasonic image 46 in a frozen state, and calculates a score for each candidate. Figure 4 In the example shown, the result of this evaluation is displayed as a set 32 ​​of candidate images.

[0095] The user can change the arrangement order of the candidate images included in the candidate image group 32 by operating the operation unit 26 while referring to the ultrasonic image 46. For example, when the user instructs to perform an examination with the candidate image 36B arranged at the first candidate position, the ultrasonic diagnostic apparatus 10 performs a unique examination on the kidney on the ultrasonic image 46.

[0096] As described above, according to the ultrasonic diagnostic apparatus 10 involved in this embodiment, when the section recognition process is performed on the ultrasonic image, the user can intuitively grasp the section recognition result by referring to the candidate image group. In addition, the user can intuitively change the section recognition result by changing the configuration position of each candidate image included in the candidate image group. As a result, the examination that the user wants to perform can be performed on the ultrasonic image. That is, it is possible to prevent the examination performed after the section recognition from becoming an examination that the user does not want to perform.

[0097] For example, in the diagnosis of renal cell carcinoma, a kidney section is extracted, and then the characteristics in the renal cortex are diagnosed. In this embodiment, after estimating multiple candidates for the scan section through the section recognition process, the user can change the order of each candidate to select the kidney section to be examined. The kidney section is selected, and a unique examination for the kidney is performed. For example, the lesion area detection engine detects the area in the renal cortex, and the characteristic determination engine detects the area in the renal cortex suspected of being a cell carcinoma, and determines the characteristics of the area.

[0098] <Modification 1>

[0099] The following describes a modification example 1. In the modification example 1, when it is estimated that there is no need to change the arrangement order of the candidate images, even if the user does not instruct to perform the examination, the ultrasonic diagnostic apparatus 10 performs a unique examination on the part corresponding to the candidate image arranged at the first candidate position. Figure 4 , even if the user does not instruct to perform an examination, the ultrasonic diagnostic apparatus 10 performs a unique examination on the kidney on the ultrasonic image 46 .

[0100] Specifically, when a plurality of ultrasonic images representing candidates having scores greater than or equal to the first threshold are continuously acquired, if the number of the plurality of ultrasonic images continuously acquired is greater than or equal to the second threshold, the control unit 28 causes the ultrasonic diagnostic apparatus 10 to perform the next examination. The ultrasonic diagnostic apparatus 10 performs a unique examination of the part corresponding to the candidate image arranged at the first candidate position on the ultrasonic image 46. The first threshold and the second threshold are preset values. The first threshold and the second threshold can be changed by the user.

[0101] To explain in more detail, (1) when the change amount of the ultrasonic image is less than or equal to a threshold value within a range of a preset number of frames, the control unit 28 determines that the ultrasonic probe 12 is stationary. In other words, it is estimated that the ultrasonic probe 12 is placed at the same position and the same cross section is being ultrasonically scanned.

[0102] Next, (2) when the estimated candidates are the same within a range of a preset number of frames or more and the score of the first candidate is equal to or greater than a threshold, the control unit 28 determines that the estimation of the cross section is stable.

[0103] When conditions (1) and (2) are satisfied, even if the user does not instruct to perform an examination, the ultrasonic diagnostic apparatus 10 performs a unique examination on the part corresponding to the candidate image arranged at the first candidate position on the ultrasonic image 46. That is, when it is determined that the ultrasonic probe 12 is stationary and the estimation of the cross section is stable, even if the user does not instruct to perform an examination, the ultrasonic diagnostic apparatus 10 performs the corresponding unique examination on the ultrasonic image 46. This can reduce the trouble of the user.

[0104] <Modification 2>

[0105] Modification 2 will be described below. In modification 2, when no candidate having a score equal to or greater than the threshold value is estimated, the display control unit 22 displays information on the display unit 18 prompting the user to manually select a candidate for a scan cross section. Figure 5 and Figure 6 , variant example 2 is described in detail. Figure 5 This figure shows an example of display of candidate image groups. Figure 6] A selection screen showing a list of candidates for scan cross sections is shown in FIG.

[0106] like Figure 5 As shown, the ultrasonic image 46 and the candidate image group 30 are displayed on the screen 44 . Here, the scores of the kidney cross section, the liver cross section, and the pancreas cross section are all smaller than the threshold value. Therefore, the candidate image group 30 is displayed on the screen 44 .

[0107] At this time, the display control unit 22 displays a message 47 prompting the user to manually select a candidate scanning section on the screen 44. For example, a message 47 such as “No candidate sections were found. Please select a candidate from the section list” is displayed on the screen 44.

[0108] When the user operates the operation unit 26 to instruct display of a candidate list of scan sections, the display control unit 22 displays Figure 6 The selection screen 48 shown in FIG. 4 is displayed on the display unit 18 . When the user touches or clicks the message 47 on the screen 44 , the selection screen 48 may be displayed on the display unit 18 .

[0109] Scan section names 50 to 58 are displayed on the selection screen 48. All candidate names may be displayed on the selection screen 48, or candidate names selected by learning or candidate names based on history records may be displayed on the selection screen 48. The number of displayed names may also be changed according to the part to be scanned by ultrasound. Here, as an example, the liver, kidney, pancreas, spleen, and lymph node are displayed as candidates for the scan sections.

[0110] When the user selects a scan section name on the selection screen 48, the control unit 28 determines the scan section having the selected scan section name as the section from which the ultrasonic image 46 can be obtained. For example, the ultrasonic diagnostic apparatus 10 performs a unique examination on the scan section having the selected scan section name on the ultrasonic image 46. Even if the user does not instruct to perform the examination, the ultrasonic diagnostic apparatus 10 can perform the examination. Of course, when the user instructs to perform the examination, the ultrasonic diagnostic apparatus 10 can also perform the examination.

[0111] <Variation 3>

[0112] Modification 3 is described below. In modification 3, when no candidate having a score equal to or greater than the threshold is estimated, if an area where a plurality of candidate images are displayed is specified, the display control unit 22 displays a candidate list for the user to select a candidate on the display unit 18. Figure 7 and Figure 8 , variant example 3 is described in detail. Figure 7 This figure shows an example of display of candidate image groups. Figure 8 ] A selection screen showing a list of candidates for scan cross sections is shown in FIG.

[0113] like Figure 7 As shown, the ultrasonic image 46 and the candidate image group 30 are displayed on the screen 44 . Here, the scores of the kidney cross section, the liver cross section, and the pancreas cross section are all smaller than the threshold value. Therefore, the candidate image group 30 is displayed on the screen 44 .

[0114] At this time, if the user operates the operation unit 26 to place the cursor 60 on the candidate image group 30 on the screen 44, the display control unit 22 Figure 8 The selection screen 62 shown in FIG. 4 is displayed on the display unit 18. Placing the cursor 60 on the candidate image group 30 means specifying an area where a plurality of candidate images are displayed. For example, if the user moves the cursor 60 to the candidate image group 30 on the screen 44, the display control unit 22 displays the selection screen 62 on the display unit 18. When the user touches or clicks the candidate image group 30, the display control unit 22 may display the selection screen 62 on the display unit 18. Figure 5 Similar to the example shown in , the display control unit 22 may display a message 47 on the screen 44 .

[0115] like Figure 8 As shown, the scan section names 64 to 72 are displayed on the selection screen 62. All candidate names may be displayed on the selection screen 62, or the names of candidates selected by learning or the names of candidates based on the history may be displayed on the selection screen 62. The number of displayed names may also be changed according to the part to be scanned by ultrasound. Here, as an example, the liver, kidney, pancreas, spleen, and lymph node are displayed as candidates for the scan sections.

[0116] When the user selects a scan section name on the selection screen 62, the control unit 28 determines the scan section having the selected scan section name as the section from which the ultrasonic image 46 can be obtained. For example, the ultrasonic diagnostic apparatus 10 performs a unique examination on the scan section having the selected scan section name on the ultrasonic image 46. Even if the user does not instruct to perform the examination, the ultrasonic diagnostic apparatus 10 can perform the examination. Of course, when the user instructs to perform the examination, the ultrasonic diagnostic apparatus 10 can also perform the examination.

[0117] <Variation 4>

[0118] Modification 4 will be described below. In modification 4, when the recognition unit 20 estimates a plurality of candidates, the display control unit 22 displays candidates of scan sections that have been inspected and candidates of scan sections that have not been inspected separately on the display unit 18. Fig. 9 , variant example 4 is described in detail. Fig. 9 This figure shows an example of display of candidate image groups.

[0119] The ultrasonic image 46 and the candidate image group 74 are displayed on the screen 44. The candidate image group 74 and Figure 2 The candidate image group 32 shown in FIG. 1 similarly includes candidate images 36B, 38B, and 40A. The kidney cross section is the first candidate, the liver cross section is the second candidate, and the pancreas cross section is the third candidate. Therefore, candidate image 36B is arranged at the first candidate position, candidate image 38B is arranged at the second candidate position, and candidate image 40A is arranged at the third candidate position.

[0120] For example, it is assumed that at the moment when the candidate image group 74 is displayed on the screen 44, the examination of the kidneys is completed, but the examination of the liver and pancreas is not yet completed. At this time, the display control unit 22 displays the candidate image 36B separately from the candidate images 38B and 40A. For example, the display control unit 22 grays out the candidate images corresponding to the parts that have been examined. The display control unit 22 displays the candidate images corresponding to the parts that have not been examined as activated (non-grayed out). Fig. 9 In the example shown, since the examination of the kidneys has been completed, the display control unit 22 displays the candidate image 36B in gray. Since the examination of the liver and pancreas has not been completed, the display control unit 22 displays the candidate images 38B and 40A in an activated state.

[0121] Even if the user selects the candidate image 36B displayed in gray, the control unit 28 does not accept the selection. That is, even if the candidate image 36B is displayed at the first candidate position, the control unit 28 does not accept the user's selection of the candidate image 36B. Therefore, the unique examination for the kidney is not performed.

[0122] For example, the control unit 28 determines whether the examination of the kidney has been completed by utilizing a protocol assistant function or the like. For example, a workflow (i.e., an examination protocol) is set for each part of the diagnostic object. In the workflow, the types and order of examinations are pre-set, and whether each examination is completed is managed. The management of the workflow (e.g., management of whether each examination is completed, etc.) can be performed by the ultrasonic diagnostic device 10, or by an external device other than the ultrasonic diagnostic device 10 (e.g., a server). The control unit 28 can determine whether a series of examinations on the kidney are completed by referring to the workflow.

[0123] The display control unit 22 may display a button (e.g., a "Clear" button) on the screen 44 that allows selection of a candidate image displayed in gray. If the user presses the "Clear" button, the candidate image displayed in gray can be selected. For example, the candidate image 36B can be selected. If the user selects the candidate image 36B, the control unit 28 accepts the selection as a valid selection, and the ultrasonic diagnostic apparatus 10 performs a unique examination for the kidney. For example, it is conceivable that the "Clear" button is pressed when re-measuring or re-examination is performed.

[0124] Furthermore, when the user operates the rotary encoder 42 or the like to place the candidate image 38B at the first candidate position and instructs execution of an examination, the ultrasonic diagnostic apparatus 10 executes a unique examination of the liver. The same applies to the candidate image 40A.

[0125] <Variation 5>

[0126] The following describes modification 5. In modification 5, after the recognition unit 20 estimates multiple candidates, when the user issues an instruction for re-recognition, the recognition unit 20 will perform recognition processing on the ultrasound image again. At this time, the recognition unit 20 excludes the candidate with the highest score among the multiple candidates and estimates multiple new candidates for the scan section. The excluded candidate (i.e., the candidate with the highest score) is not included in the new multiple candidates.

[0127] The recognition unit 20 can exclude all candidates with scores above the threshold from the plurality of candidates by performing recognition processing on the ultrasonic image again, and estimate new candidates for the scanned cross section. At this time, all the excluded candidates (i.e., all candidates with scores above the threshold) are not included in the new plurality of candidates.

[0128] The recognition unit 20 may exclude the candidate represented by the candidate image configured at the first candidate position by performing recognition processing on the ultrasonic image again, and estimate a new candidate of the scan section. At this time, the excluded candidate (i.e., the candidate represented by the candidate image configured at the first candidate position) is not included in the new plurality of candidates.

[0129] When a plurality of new candidates are recognized by the recognition unit 20 , the display control unit 22 causes the display unit 18 to display candidate images representing the plurality of new candidates.

[0130] refer to Figures 10 to 13 , variant example 5 is described in detail. Fig.10 This is a block diagram showing the configuration of an ultrasonic diagnostic apparatus 10A according to Modification 5. Fig.11 This figure shows an example of display of candidate image groups. Fig.12 A determination screen for the user to determine candidates is displayed. Fig.13 This figure shows an example of display of candidate image groups.

[0131] like Fig.10 As shown in FIG. 1 , in addition to the structure of the ultrasonic diagnostic apparatus 10, the ultrasonic diagnostic apparatus 10A further includes an external part 76. The structure other than the external part 76 is similar to Figure 1 The structure of the ultrasonic diagnostic apparatus 10 shown is the same.

[0132] The exclusion section 76 excludes the candidate with the highest score from the multiple candidates estimated by the recognition section 20, and outputs information indicating the excluded candidate to the recognition section 20. As another example, the exclusion section 76 may exclude all candidates with scores greater than a threshold value from the multiple candidates estimated by the recognition section 20, and output information indicating all the excluded candidates to the recognition section 20. Furthermore, as another example, the exclusion section 76 may exclude the candidate represented by the candidate image arranged at the first candidate position from the multiple candidates estimated by the recognition section 20, and output information indicating the excluded candidate to the recognition section 20. The recognition section 20 excludes the candidates excluded by the exclusion section 76, and estimates new candidates for the scan section.

[0133] As an example, Fig.11 It represents the result of the first estimation based on the recognition unit 20. Fig.11 As shown, the ultrasonic image 46 and the candidate image group 78 are displayed on the screen 44. The candidate image group 78 is an image group representing the recognition result relative to the ultrasonic image 46, and includes candidate images 36B, 38B, and 40B. Candidate image 36B is an image representing a kidney cross section as a candidate. Candidate image 38B is an image representing a liver cross section as a candidate. Candidate image 40B is an image representing a pancreatic cross section as a candidate. Here, the frames of the candidate images 36B, 38B, and 40B are each shown with a solid line. That is, the scores of the kidney cross section, the liver cross section, and the pancreatic cross section are each above the threshold. The score being above the threshold means that the reliability of the estimation of each candidate is high.

[0134] After the candidate image group 78 is displayed on the screen 44, the display control unit 22 Fig.12 The determination screen 80 shown is displayed on the display unit 18. When the user issues a display instruction of the determination screen 80 by operating the operation unit 26, the display control unit 22 can display the determination screen 80 on the display unit 18. When the user specifies the candidate image group 78 (for example, when clicking or touching the candidate image group 78), the display control unit 22 can display the determination screen 80 on the display unit 18.

[0135] like Fig.12 As shown, an “Accept” button 82 and a “Reject” button 84 are displayed on the determination screen 80 .

[0136] If the user presses the "Agree" button 82, the result of the first estimation is finalized. That is, the candidate group represented by the candidate image group 78 is finalized. For example, the ultrasonic diagnostic apparatus 10 performs a unique examination on the part corresponding to the candidate image arranged at the first candidate position on the ultrasonic image 46.

[0137] If the user presses the "Reject" button 84, an instruction to re-recognize is issued to the recognition unit 20. The recognition unit 20 performs recognition processing on the ultrasonic image 46 again according to the instruction. At this time, the exclusion unit 76 excludes the candidate with the highest score. The recognition unit 20 excludes the candidate with the highest score and estimates multiple new candidates. Fig.11 In the example shown, the kidney cross section has the highest score. Therefore, the identification unit 20 excludes the kidney cross section and estimates a new plurality of candidates. At this time, the kidney cross section is not included in the new plurality of candidates.

[0138] As another example, the recognition unit 20 may exclude candidates having scores greater than a threshold value and estimate multiple new candidates. Fig.11 In the example shown, the scores of the kidney section, liver section, and pancreas section are all above the threshold. Therefore, the recognition unit 20 excludes the kidney section, liver section, and pancreas section and estimates multiple new candidates. At this time, the kidney section, liver section, and pancreas section are not included in the multiple new candidates.

[0139] As another example, the recognition unit 20 may exclude the candidate represented by the candidate image arranged at the first candidate position in the candidate image group 78 and estimate a plurality of new candidates. Fig.11 In the example shown, the candidate image 36B representing the kidney cross section is arranged at the first candidate position. Therefore, the recognition unit 20 excludes the kidney cross section and estimates a new plurality of candidates. The user can change the arrangement order of the candidate images 36B, 38B, and 40B included in the candidate image group 78, and arrange the candidate images other than the candidate image 36B at the first candidate position. For example, when the candidate image 38B is arranged at the first candidate position, the recognition unit 20 excludes the liver cross section and estimates a new plurality of candidates. At this time, the liver cross section is not included in the new plurality of candidates.

[0140] Fig.13 represents the result of the second estimation based on the recognition unit 20. Fig.13 As shown, the ultrasonic image 46 and the candidate image group 86 are displayed on the screen 44. The candidate image group 86 is an image group indicating the re-recognition result of the ultrasonic image 46, and is a candidate image group indicating a plurality of new candidates.

[0141] Here, among the multiple candidates estimated by the first recognition process, the candidate with the highest score is excluded, and multiple new candidates are estimated. That is, the kidney section is excluded, and multiple new candidates are estimated. As a result of the second recognition process, the liver section, the pancreas section, and the spleen section are estimated as candidates.

[0142] The candidate image group 86 includes candidate images 38B, 40B, and 88B. Candidate image 38B is an image showing a liver cross section as a candidate. Candidate image 40B is an image showing a pancreatic cross section as a candidate. Candidate image 88B is an image showing a spleen cross section as a candidate. Here, the frames of candidate images 38B, 40B, and 88B are shown with solid lines. That is, the scores of the liver cross section, the pancreatic cross section, and the spleen cross section are all above the threshold. The score being above the threshold means that the reliability of the estimation of each candidate is high.

[0143] After the candidate image group 86 is displayed on the screen 44, the display control unit 22 Fig.12 The determination screen 80 shown is displayed on the display unit 18. When the user issues a display instruction of the determination screen 80 by operating the operation unit 26, the display control unit 22 can display the determination screen 80 on the display unit 18. When the user specifies the candidate image group 86 (for example, when the candidate image group 86 is clicked or touched), the display control unit 22 can display the determination screen 80 on the display unit 18.

[0144] If the user presses the "Agree" button 82, the result of the second estimation is finalized. That is, the candidate group represented by the candidate image group 86 is finalized. For example, the ultrasonic diagnostic apparatus 10 performs a unique examination on the ultrasonic image 46 for the part corresponding to the candidate image arranged at the first candidate position.

[0145] If the user presses the "reject" button 84, an instruction for re-recognition is issued to the recognition unit 20. The recognition unit 20 performs recognition processing on the ultrasonic image 46 again according to the instruction. At this time, the recognition unit 20 excludes the candidates excluded by the excluded area 76 and estimates a plurality of new candidates. The same applies to the recognition processing thereafter.

[0146] <Variation 6>

[0147] refer to Fig.14 , variant example 6 is described. Fig.14 This is a block diagram showing the configuration of an ultrasonic diagnostic apparatus 10B according to Modification 6.

[0148] In addition to the structure of the ultrasonic diagnostic apparatus 10, the ultrasonic diagnostic apparatus 10B further includes a setting unit 90 and an execution unit 92. The structure other than the setting unit 90 and the execution unit 92 is the same as that of the ultrasonic diagnostic apparatus 10. Figure 1 The structure of the ultrasonic diagnostic apparatus 10 shown is the same.

[0149] The setting unit 90 performs settings related to the candidates of the scanning section. For example, the setting unit 90 performs settings related to the first candidate among the multiple candidates estimated by the recognition unit 20 on the ultrasonic image. For example, the setting unit 90 sets the ROI (Region Of Interest) to be the object of automatic measurement on the ultrasonic image based on the clinical knowledge information related to the part corresponding to the candidate image configured at the first candidate position. The clinical knowledge information is standard knowledge information related to the part, which is pre-set information. For example, for each part, an ROI for specifying the measurement area is pre-set. If a specific example is given, when the part is the liver, the depth information indicating the area where blood vessels exist is equivalent to an example of clinical knowledge information of the liver.

[0150] The execution unit 92 executes the inspection according to the setting by the setting unit 90. For example, when the above-mentioned ROI is set for the ultrasonic image, the execution unit 92 executes the inspection such as measurement with the ROI set for the ultrasonic image as the target.

[0151] For example, an ROI corresponding to a part of the candidate image arranged at the first candidate position is set on the ultrasound image, and the ROI is used as an object for measurement and inspection. This saves the user the trouble of manually setting an ROI related to a part with high estimated reliability on the ultrasound image.

[0152] The setting unit 90 may make settings related to the candidate with the highest score for the ultrasonic image, and the execution unit 92 may take the ultrasonic image as a target and execute the examination according to the settings.

[0153] <Variation 7>

[0154] In Modification 7, the processing according to this embodiment may be applied to body landmarks. For example, multiple candidates and scores of body landmarks may be calculated based on the result of the cross-section recognition processing, and the ranking of each candidate may be changed using the method according to this embodiment.

[0155] The image generation unit 16, the recognition unit 20, the display control unit 22, the correction unit 24, the control unit 28, the elimination unit 76, the setting unit 90, and the execution unit 92 can be realized by hardware resources such as a processor or an electronic circuit, and a device such as a memory can be used as needed in the implementation process. In addition, the image generation unit 16, the recognition unit 20, the display control unit 22, the correction unit 24, the control unit 28, the elimination unit 76, the setting unit 90, and the execution unit 92 can be realized by a computer, for example. That is, the image generation unit 16, the recognition unit 20, the display control unit 22, the correction unit 24, the control unit 28, the elimination unit 76, the setting unit 90, and the execution unit 92 can be realized in whole or in part by the cooperation of hardware resources such as a CPU (Central Processing Unit) or a memory possessed by the computer and software (program) that specifies the operation of the CPU, etc. The program is stored in a storage device or other storage device of the ultrasonic diagnostic apparatus 10 via a recording medium such as a CD or a DVD, or via a communication path such as a network. As another example, the image generation unit 16, the recognition unit 20, the display control unit 22, the correction unit 24, the control unit 28, the external device 76, the setting unit 90, and the execution unit 92 may also be implemented by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate Array). Of course, a GPU (Graphics Processing Unit) or the like may also be used. The image generation unit 16, the recognition unit 20, the display control unit 22, the correction unit 24, the control unit 28, the external device 76, the setting unit 90, and the execution unit 92 may be implemented by a single device or by a plurality of devices.

[0156] Furthermore, the functions of the recognition unit 20 , the display control unit 22 , the correction unit 24 , the external device 76 , the setting unit 90 , and the execution unit 92 may be performed by a device other than the ultrasonic diagnostic apparatus 10 (eg, a personal computer or a server).

Claims

1. An ultrasonic diagnostic device, characterized in that: include: a recognition unit that performs a scanning cross section recognition process on an ultrasonic image generated by ultrasonic scanning, thereby estimating a plurality of candidates for scanning cross sections subjected to ultrasonic scanning, and calculates a score indicating the accuracy of the estimation for each candidate; and The display control unit displays a candidate image on the display in a different display mode for each score, the candidate image representing each of the plurality of candidates having a higher ranking score among the plurality of candidates.

2. The ultrasonic diagnostic apparatus according to claim 1, wherein: The display control unit displays the plurality of candidate images on the display in an arrangement order corresponding to the scores, and displays the plurality of candidate images on the display by changing the arrangement order of the plurality of candidate images in accordance with an arrangement order change instruction from a user.

3. The ultrasonic diagnostic apparatus according to claim 2, wherein: The ultrasonic diagnostic apparatus further includes an accepting unit that accepts a user's selection of a candidate having a score greater than or equal to a threshold value, and does not accept a user's selection of a candidate having a score less than the threshold value.

4. The ultrasonic diagnostic apparatus according to claim 3, wherein: When the candidate selected by the user corresponds to a candidate image displayed at a position corresponding to a specific order in the arrangement order corresponding to the score and the candidate has a score equal to or greater than a threshold value, the acceptance unit accepts the selection.

5. The ultrasonic diagnostic apparatus according to claim 3, wherein: When the user selects a candidate having a score smaller than a threshold value, the acceptance section accepts the selection as a valid selection based on the content of a process performed after the selection.

6. The ultrasonic diagnostic apparatus according to claim 2, wherein: When a plurality of ultrasonic images indicating candidates having scores equal to or greater than the first threshold are acquired continuously, the next examination is performed if the number of the plurality of ultrasonic images acquired continuously is equal to or greater than the second threshold.

7. The ultrasonic diagnostic apparatus according to claim 1, wherein: When no candidate having a score equal to or greater than a threshold value is estimated, the display control unit displays information prompting a user to manually select a candidate on the display.

8. The ultrasonic diagnostic apparatus according to claim 1, wherein: When no candidate having a score equal to or greater than a threshold value is estimated, the display control unit displays a candidate list for the user to select a candidate on the display if an area where a plurality of candidate images are displayed is specified.

9. The ultrasonic diagnostic apparatus according to claim 1, wherein: The display control unit displays candidates of cross sections whose inspection has been completed and candidates of cross sections whose inspection has not been completed on the display in a differentiated manner.

10. The ultrasonic diagnostic apparatus according to claim 1, wherein: After the recognition unit estimates a plurality of candidates, when a user issues an instruction for re-recognition, the recognition unit performs recognition processing on the ultrasonic image again, thereby excluding the candidate with the highest score among the plurality of candidates and estimating a plurality of new candidates for the scanned cross section. The display control unit displays candidate images representing the new plurality of candidates on the display.

11. The ultrasonic diagnostic apparatus according to claim 1, wherein: The ultrasonic diagnostic apparatus further includes an execution unit configured to execute an examination according to a setting related to a first candidate among the plurality of candidates.

12. A computer-readable non-transitory recording medium, characterized in that: A program is recorded that enables the computer to function as: an identification unit that performs a scanning cross section identification process on an ultrasonic image generated by ultrasonic scanning, thereby estimating a plurality of candidates for scanning cross sections subjected to ultrasonic scanning, and calculating a score indicating the accuracy of the estimation for each candidate; and The display control means displays a candidate image on the display in a different display mode according to each score, wherein the candidate image represents each of a plurality of candidates with higher scores among the plurality of candidates.

Images