Ultrasonic diagnostic device and recording medium
By identifying the cross-sectional reliability in the ultrasonic diagnostic device and automatically adjusting the photography conditions, the workload problem of users frequently adjusting the ultrasonic image photography conditions is solved, and the image recognition reliability is improved.
Patent Information
- Application Number
- CN202411682145.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-11-27
- Filing Date
- 2024-11-22
- Publication Date
- 2025-05-27
AI Technical Summary
In ultrasonic diagnosis, users need to frequently adjust photography conditions to obtain ultrasonic images suitable for examination, resulting in increased workload.
The acquisition unit acquires the ultrasonic image according to the initial photography conditions, the identification unit performs cross-section recognition processing and outputs candidates and reliability. When the candidate with the reliability ranking meets the threshold conditions and continues, the imaging conditions are adjusted to obtain the second set of ultrasonic images.
The workload of users to change photography conditions in order to obtain ultrasonic images suitable for inspection is reduced, and the recognition reliability of ultrasonic images is improved.
Smart Images

Figure CN120036817A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an ultrasonic diagnostic device and a program. Background Art
[0002] There is known a technique for identifying a picked-up cross section from an ultrasonic image acquired by transmitting and receiving ultrasonic waves and performing image processing corresponding to the identified cross section.
[0003] Patent Document 1 describes a system that performs imaging settings optimized for a specific view.
[0004] Patent Document 1: Japanese Patent Application No. 2022-551143
[0005] Sometimes, multiple candidates for the cross section are estimated by the process of identifying the cross section, but it is not limited to estimating the candidate with high reliability. In this case, users such as doctors or laboratory technicians need to adjust the ultrasonic imaging conditions to obtain ultrasonic images suitable for inspection. Therefore, the burden on the user increases. For example, if each of multiple cross sections is adjusted, the workload of the user increases accordingly, and the burden on the user increases. Summary of the invention
[0006] An object of the present invention is to reduce the workload of a user who changes imaging conditions in order to obtain an ultrasonic image suitable for an examination.
[0007] One embodiment of the present invention is an ultrasonic diagnostic device, characterized in that it includes: an acquisition unit, which acquires a first ultrasonic image of a subject according to a first imaging condition; and an identification unit, which performs section identification processing on the first ultrasonic image and outputs multiple candidates for the section and the reliability of identification of each candidate, when the state in which the reliabilities of multiple candidates with top reliability rankings satisfy a threshold condition continues for a predetermined time, the acquisition unit acquires a second ultrasonic image of the subject according to a second imaging condition that is different from the first imaging condition and corresponds to the identified section.
[0008] The reliability of the top candidates may be the sum of the reliabilities calculated by adding the reliabilities of the candidates in order from the candidate with the highest reliability. The state where the reliabilities of the top candidates satisfy the threshold condition may continue for a predetermined period of time, or the state where the sum is within the threshold range may continue for a predetermined period of time.
[0009] The situation where the states of the reliabilities of multiple candidates with higher reliability rankings satisfying the threshold condition continue within a preset time may also be a situation where the rankings of the multiple candidates with higher reliability rankings do not change within a preset time, and the reliability of each of the multiple candidates with higher reliability rankings is less than the threshold value.
[0010] The second imaging condition may be the imaging condition corresponding to the candidate among the multiple candidates with higher reliability rankings whose reliability exceeds the threshold value.
[0011] The second imaging condition may be the imaging condition corresponding to the candidate with the highest reliability among the multiple candidates with higher reliability rankings.
[0012] The recognition unit may further perform processing on the second ultrasonic image recognition section and calculate the reliability of the recognition. When the reliability calculated based on the second ultrasonic image is higher than the reliability calculated based on the first ultrasonic image, the acquisition unit may further acquire the second ultrasonic image according to the second imaging condition.
[0013] When the reliability calculated based on the second ultrasonic image is less than or equal to the reliability calculated based on the first ultrasonic image, the acquisition unit may further continue ultrasonic imaging according to the first imaging condition.
[0014] The ultrasonic diagnostic apparatus may further include a control unit that displays the first ultrasonic image and the second ultrasonic image on a display, and the acquisition unit may acquire an ultrasonic image according to the imaging condition selected by the user from the first imaging condition and the second imaging condition.
[0015] The second imaging condition is a condition related to image processing, and the acquisition unit may acquire the second ultrasonic image by performing image processing according to the second imaging condition on the data acquired according to the first imaging condition.
[0016] Another aspect of the present invention is a program that causes a computer to function as the following mechanisms: an acquisition mechanism that acquires a first ultrasonic image of a subject according to a first imaging condition; and a recognition mechanism that performs processing on a recognition section of the first ultrasonic image and outputs multiple candidates of the section and the reliability of the recognition of each candidate. When the state where the reliabilities of multiple candidates with higher reliability rankings satisfy the threshold condition continues within a preset time, the acquisition mechanism acquires a second ultrasonic image of the subject according to a second imaging condition that is different from the first imaging condition and corresponds to the recognized section.
[0017] Advantages of the Invention
[0018] According to the present invention, it is possible to reduce the workload of a user who changes imaging conditions in order to obtain an ultrasonic image suitable for examination. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 is a block diagram showing an example of the configuration of an ultrasonic diagnostic apparatus according to an embodiment.
[0020] Figure 2 is a graph showing the change over time of the reliability of cross-section identification.
[0021] Figure 3 is a graph showing the change over time of the reliability of cross-section identification.
[0022] Figure 4 is a graph showing the change over time of the sum of reliabilities.
[0023] Figure 5 is a graph showing the change over time of the moving average of the sum of reliabilities.
[0024] Figure 6 is a graph showing the change over time of the reliability of cross-section identification.
[0025] Figure 7 is a graph showing the change over time of the reliability of cross-section identification.
[0026] Figure 8 is a graph showing the change over time of the reliability of cross-section identification.
[0027] Figure 9 is a graph showing the change over time of the reliability of cross-section identification.
[0028] REFERENCE SIGNS
[0029] 10 - ultrasonic diagnostic apparatus, 12 - ultrasonic probe, 14 - transmission / reception unit, 16 - image generation unit, 26 - analysis unit, 28 - identification unit, 30 - image quality adjustment unit, 32 - control unit. DETAILED DESCRIPTION OF THE INVENTION
[0030] REFERENCE Figure 1 , an ultrasonic diagnostic apparatus 10 according to an embodiment will be described. Figure 1 is a block diagram showing an example of the configuration of the ultrasonic diagnostic apparatus 10.
[0031] The ultrasonic diagnostic apparatus 10 generates ultrasonic image data by transmitting and receiving ultrasonic waves using the ultrasonic probe 12. For example, the ultrasonic diagnostic apparatus 10 transmits ultrasonic waves into a subject and receives the ultrasonic waves reflected inside the subject, thereby generating ultrasonic image data representing the internal tissues of the subject.
[0032] The ultrasonic probe 12 is a device for transmitting and receiving ultrasonic waves. The ultrasonic probe 12 includes, for example, a 1D array oscillator. The 1D array oscillator is formed by arranging a plurality of ultrasonic oscillators in a one-dimensional manner. An ultrasonic beam is formed by the 1D array oscillator, and the ultrasonic beam is repeatedly subjected to electronic scanning. Thus, each time an electronic scan is performed, a scan cross-section is formed in the living body. The scan cross-section corresponds to a two-dimensional echo data acquisition space. The ultrasonic probe 12 may include a 2D array oscillator formed by arranging a plurality of ultrasonic oscillators in a two-dimensional manner. If an ultrasonic beam is formed by the 2D array oscillator and the ultrasonic beam is repeatedly subjected to electronic scanning, then each time an electronic scan is performed, a scan cross-section serving as a two-dimensional echo data acquisition space is formed. If two-dimensional scanning of the ultrasonic beam is performed, a three-dimensional space serving as a three-dimensional echo data acquisition space is formed. As the scanning method, sector scanning, linear scanning, convex scanning, etc. are used.
[0033] The transceiver unit 14 functions as a transmit beamformer and a receive beamformer. At the time of transmission, the transceiver unit 14 supplies a plurality of transmit signals having a prescribed delay relationship to the plurality of ultrasonic oscillators included in the ultrasonic probe 12. Thus, an ultrasonic transmit beam is formed. At the time of reception, the ultrasonic probe 12 receives a reflected wave (i.e., an RF signal) from the living body, and thus a plurality of received signals are output from the ultrasonic probe 12 to the transceiver unit 14. The transceiver unit 14 applies in-phase addition processing to the plurality of received signals, thereby forming a receive beam. The data of this receive beam is output to the image generation unit 16. That is, for the received signals obtained from the respective ultrasonic oscillators, the transceiver unit 14 performs delay processing in accordance with the delay processing conditions with respect to the respective ultrasonic oscillators, and performs addition processing on the plurality of received signals obtained from the plurality of ultrasonic oscillators, thereby forming a receive beam. The delay processing conditions are specified by receive delay data indicating the delay time. A set of receive delay data (i.e., a set of delay times) corresponding to the plurality of ultrasonic oscillators is supplied from the control unit 32.
[0034] By the action of the transceiver unit 14, the ultrasonic beam (i.e., the transmit beam and the receive beam) is subjected to electronic scanning, thereby forming a scan cross-section. The scan cross-section corresponds to a plurality of beams, and the plurality of beams constitute a receive frame (specifically, an RF signal frame). In addition, each beam is composed of a plurality of echoes arranged in the depth direction. By repeatedly performing electronic scanning of the ultrasonic beam, a plurality of receive frames arranged on the time axis are output from the transceiver unit 14 to the image generation unit 16. The plurality of receive frames constitute a receive frame sequence.
[0035] If, by the action of the transceiver unit 14, the ultrasonic beam is subjected to two-dimensional electronic scanning, a three-dimensional echo data acquisition space is formed, and volume data serving as an aggregate of echo data is obtained from this three-dimensional echo data acquisition space. By repeatedly performing electronic scanning of the ultrasonic beam, a plurality of volume data arranged on the time axis are output from the transceiver unit 14 to the image generation unit 16. The plurality of volume data constitute a volume data sequence.
[0036] For the received frames output from the transceiver unit 14, the image generation unit 16 applies signal processing such as detection, amplitude compression (e.g., logarithmic compression), and conversion functions (coordinate transformation function and interpolation processing function based on DSC (Digital Scan Converter), etc.) to generate ultrasonic image data (e.g., B-mode image data).
[0037] Hereinafter, the image data is appropriately referred to as an "image". For example, the ultrasonic image data is appropriately referred to as an "ultrasonic image", or the B-mode image data is appropriately referred to as a "B-mode image". In addition, the ultrasonic image related to the present embodiment is not limited to the B-mode image, and may be any image generated by transmitting and receiving ultrasonic waves. For example, the ultrasonic image related to the present embodiment may also be a color Doppler image, a pulsed Doppler image, a strain imaging image (StrainImage), or a shear wave elastography image (Shear Wave Elastography Image), etc.
[0038] In addition, the transceiver unit 14 and the image generation unit 16 are examples of the acquisition unit.
[0039] The display processing unit 18 generates a display image by performing superposition processing on the graphic data required for the ultrasonic image. The display image is output to the display unit 20. One or more images are arranged and displayed in a display form according to the display mode.
[0040] The display unit 20 is a display such as a liquid crystal display or an EL display. An ultrasonic image such as a B-mode image is displayed on the display unit 20. The display unit 20 may also be a device that combines a display and an operation unit 22. For example, a GUI (Graphic User Interface) may be implemented by the display unit 20 and the operation unit 22. In addition, a user interface such as a touch panel may be implemented by the display unit 20 and the operation unit 22.
[0041] The operation unit 22 is a device for a user to input imaging conditions, instructions, etc. into the ultrasonic diagnostic apparatus 10. For example, the operation unit 22 is an operation panel, a switch, a button, a keyboard, a mouse, a trackball, or a joystick, etc.
[0042] The storage unit 24 constitutes one or more storage areas for storing data. For example, the storage unit 24 is a hard disk drive (HDD), a solid state drive (SSD), various memories (e.g., RAM, DRAM, ROM, etc.), other storage devices (e.g., optical discs, etc.), or a combination thereof.
[0043] For example, the storage unit 24 stores the received signal received by the transceiver unit 14, the received beam generated based on the received signal, the received frame, the volume data, the ultrasonic image, the information indicating the imaging conditions, and the information related to the subject (such as a patient).
[0044] The analysis unit 26 includes an identification unit 28 and an image quality adjustment unit 30, and determines the imaging conditions for adjusting the image quality of the ultrasonic image by analyzing the ultrasonic image. The analysis unit 26 outputs the information indicating the imaging conditions to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16.
[0045] The imaging conditions include at least one of the conditions related to the transceiver unit 14 and the conditions related to the image generation unit 16. The conditions related to the transceiver unit 14 include the conditions related to the transmission of ultrasonic waves and the conditions related to the reception of ultrasonic waves. The conditions related to the image generation unit 16 include the conditions related to the image processing for generating the ultrasonic image. When the imaging conditions are the conditions related to the transceiver unit 14, the analysis unit 26 outputs the information indicating the imaging conditions to the transceiver unit 14. When the imaging conditions are the conditions related to the image generation unit 16, the analysis unit 26 outputs the information indicating the imaging conditions to the image generation unit 16. When the imaging conditions include the conditions related to the transceiver unit 14 and the conditions related to the image generation unit 16, the analysis unit 26 outputs the information indicating the imaging conditions to both the transceiver unit 14 and the image generation unit 16.
[0046] If specific examples are given, the imaging conditions include parameters such as brightness, contrast, smoothing, adaptive filtering, gamma value, sharpness, edge enhancement, gain, frame rate, focus depth of the transmitted beam, aperture width, center frequency of the transmitted ultrasonic wave, bandwidth of the transmitted ultrasonic wave, frequency characteristics of the received ultrasonic wave, coefficients of the image processing filter (such as a smoothing filter, etc.), apodization shape, characteristics of the receive band-pass filter, and characteristics of the dynamic range. Of course, these parameters are only an example of the imaging conditions, and other parameters other than these may also be included in the imaging conditions related to the present embodiment. For example, the imaging conditions include a combination of multiple parameters.
[0047] When the information indicating the imaging conditions determined by the analysis unit 26 is output from the analysis unit 26 to the transceiver unit 14, the transceiver unit 14 controls the transmission and reception of ultrasonic waves based on the ultrasonic probe 12 according to the imaging conditions determined by the analysis unit 26.
[0048] When the information indicating the imaging conditions determined by the analysis unit 26 is output from the analysis unit 26 to the image generation unit 16, the image generation unit 16 adjusts the image quality of the ultrasonic image according to the imaging conditions determined by the analysis unit 26.
[0049] When information indicating the imaging conditions determined by the analysis unit 26 is output to the transceiver unit 14 and the image generation unit 16, the transceiver unit 14 controls the transmission and reception of ultrasonic waves based on the ultrasonic probe 12 according to the imaging conditions determined by the analysis unit 26, and the image generation unit 16 adjusts the image quality of the ultrasonic image according to the imaging conditions determined by the analysis unit 26.
[0050] The recognition unit 28 estimates one or more candidates for the scanned cross-section scanned by the ultrasonic waves by performing processing on the ultrasonic image recognition cross-section (hereinafter referred to as "cross-section recognition processing"). Further, the recognition unit 28 calculates the reliability of the recognition for each candidate for the scanned cross-section. The reliability is a score indicating the accuracy of the estimation (i.e., the accuracy or likelihood of the estimation).
[0051] For example, the recognition unit 28 can estimate candidates for the currently scanned cross-section by performing cross-section recognition processing on the currently acquired ultrasonic image. That is, the recognition unit 28 can also estimate candidates for the scanned cross-section in real time.
[0052] As another example, the recognition unit 28 can also perform cross-section recognition processing on ultrasonic images that have been acquired and stored in the storage unit 24 of the ultrasonic diagnostic apparatus 10 or an external apparatus, thereby estimating candidates for the scanned cross-section.
[0053] By estimating candidates for the scanned cross-section, it is possible to estimate candidates for the part represented in the ultrasonic image of the scanned cross-section. That is, the recognition unit 28 can estimate candidates for the part scanned by the ultrasonic waves by performing cross-section recognition processing on the ultrasonic image.
[0054] As the cross-section recognition processing according to the present embodiment, a known cross-section recognition processing is used. For example, machine learning or artificial intelligence (AI) can be used in the cross-section recognition processing. The type of machine learning or artificial intelligence used is not limited, and any algorithm or model can be used. For example, CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), GAN (Generative Adversarial Networks), linear models, decision tree learning, support vector machine (SVM), Ensemble Classifier, or other algorithms are used. Further, pattern matching such as template matching, or algorithms that do not require learning such as correlation coefficient and similarity calculation can also be used for the cross-section recognition processing.
[0055] For example, the recognition unit 28 estimates one or more candidates for the scanned cross-section by performing cross-section recognition processing using machine learning on the ultrasonic image, and calculates a reliability representing the accuracy of the estimation using this machine learning for each candidate of the scanned cross-section. The recognition unit 28 may estimate one or more candidates for the part being ultrasonically scanned, and calculate a reliability representing the accuracy of the estimation for each candidate of the part.
[0056] The recognition unit 28 may compare the ultrasonic image (e.g., B-mode image) generated by transmitting and receiving ultrasonic waves with a plurality of standard cross-section images (e.g., B-mode images), thereby estimating one or more candidates for the scanned cross-section being ultrasonically scanned, and calculating a reliability representing the accuracy of the estimation for each candidate of the scanned cross-section. For example, techniques such as pattern matching are used to estimate the candidates for the scanned cross-section.
[0057] The standard cross-section image is an ultrasonic image used to estimate the scanned cross-section. For example, one or more standard cross-section images are pre-generated for each diagnostic part and stored in the storage unit 24 of the ultrasonic diagnostic apparatus 10 or in an external device. The standard cross-section image representing a certain part is an ultrasonic image generated by ultrasonically scanning the standard scanned cross-section that intersects with that part. For example, the standard scanned cross-section is a cross-section that should be photographed during ultrasonic examination or a representative cross-section, etc.
[0058] The image quality adjustment unit 30 determines the imaging conditions for adjusting the image quality of the ultrasonic image. The image quality adjustment unit 30 outputs information representing the determined imaging conditions to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16.
[0059] For example, when the recognition unit 28 estimates a candidate for the cross-section, the image quality adjustment unit 30 determines the imaging conditions suitable for photographing the estimated candidate for the cross-section (i.e., the imaging conditions for the ultrasonic examination suitable for the candidate), and outputs information representing the determined imaging conditions.
[0060] For example, for each cross-section of the diagnostic part, imaging conditions suitable for photographing the cross-section (i.e., the imaging conditions for the ultrasonic examination suitable for the cross-section) are preset in advance, and information representing the imaging conditions for each cross-section is stored in the storage unit 24 or an external device in advance. For example, for each cross-section, cross-section recognition information for identifying the cross-section and information representing the imaging conditions suitable for photographing the cross-section are associated with each other in advance and stored in the storage unit 24 or an external device. The image quality adjustment unit 30 determines the imaging conditions associated with the candidate for the cross-section estimated by the recognition unit 28, and outputs information representing the imaging conditions to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16.
[0061] It is also possible to preset imaging conditions suitable for the imaging site for each diagnostic site (i.e., imaging conditions for ultrasonic examination suitable for the site), and store the information indicating the imaging conditions for each site in the storage unit 24 or an external device in advance. For example, for each diagnostic site, site identification information for identifying the diagnostic site is associated in advance with information indicating the imaging conditions suitable for imaging the diagnostic site, and stored in the storage unit 24 or an external device. The image quality adjustment unit 30 determines the imaging conditions associated with the site including the candidate cross-section estimated by the identification unit 28, and outputs the information indicating the imaging conditions to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16.
[0062] The control unit 32 controls each part of the ultrasonic diagnostic apparatus 10. Further, the control unit 32 displays various information on the display unit 20.
[0063] Hereinafter, the operation of the ultrasonic diagnostic apparatus 10 will be described in detail.
[0064] First, the acquisition unit acquires a first ultrasonic image of the subject according to the first imaging condition. That is, the transceiver unit 14 transmits and receives ultrasonic waves through the ultrasonic probe 12 according to the first imaging condition, and the image generation unit 16 generates an ultrasonic image according to the reception frames output from the transceiver unit 14 according to the first imaging condition. The ultrasonic image generated according to the first imaging condition is the first ultrasonic image.
[0065] For example, the first imaging condition is a preset imaging condition (e.g., a preset condition). The preset condition includes a plurality of parameters, and the information indicating the preset condition is stored in the storage unit 24 of the ultrasonic diagnostic apparatus 10 in advance. It is also possible to create a plurality of different preset conditions in advance. In this case, a user such as a doctor or a medical technician operates the operation unit 22 to select a preset condition from the plurality of different preset conditions. The selected preset condition is the first imaging condition. The acquisition unit (i.e., the transceiver unit 14 and the image generation unit 16) acquires the first ultrasonic image according to the preset condition selected by the user. The user can set a plurality of parameters by operating the operation unit 22 to create the first imaging condition.
[0066] If the first ultrasonic image is acquired, the identification unit 28 estimates one or more candidates for the scanning cross-section scanned by ultrasonic waves by performing a cross-section identification process on the first ultrasonic image. Further, the identification unit 28 calculates the reliability of the identification for each candidate of the scanning cross-section.
[0067] When a state in which the reliabilities of multiple candidates with higher reliability rankings satisfy the threshold condition continues within a preset time T, the acquisition unit acquires a second ultrasonic image of the subject according to the second imaging condition. That is, the transceiver unit 14 transmits and receives ultrasonic waves through the ultrasonic probe 12 according to the second imaging condition, and the image generation unit 16 generates an ultrasonic image according to the received frames output from the transceiver unit 14 according to the second imaging condition. The ultrasonic image acquired according to the second imaging condition is the second ultrasonic image.
[0068] The second imaging condition is an imaging condition different from the first imaging condition and is an imaging condition corresponding to the scan section identified by the identification unit 28. As described above, for each cross-section of the diagnostic site, an imaging condition suitable for photographing the cross-section (i.e., an imaging condition suitable for ultrasonic examination of the cross-section) is preset in advance, and information indicating the imaging conditions of each cross-section is stored in the storage unit 24 or an external device in advance. The image quality adjustment unit 30 determines the imaging condition associated with the scan section identified by the identification unit 28 (i.e., the candidate estimated by the identification unit 28) and outputs information indicating the imaging condition to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16. When imaging conditions are set for each diagnostic site, the image quality adjustment unit 30 determines the imaging condition associated with the site including the candidate of the section estimated by the identification unit 28 and outputs information indicating the imaging condition to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16.
[0069] The time T can be changed by a user such as a doctor or a medical technician. The time T can be set according to the number of frames of the ultrasonic image. The time T can also be set for each part that is the object of ultrasonic examination.
[0070] For example, the reliability of multiple candidates with higher reliability rankings is the sum of reliabilities calculated by successively adding the reliabilities of each candidate starting from the candidate with the highest reliability. The sum of reliabilities is calculated by the image quality adjustment unit 30. The image quality adjustment unit 30 successively adds the reliabilities of each candidate starting from the candidate with the highest reliability until the sum of reliabilities exceeds the threshold, thereby calculating the sum of reliabilities. The threshold is a preset value. The threshold can be changed by the user. The image quality adjustment unit 30 can also successively add the reliabilities of a preset number of candidates starting from the candidate with the highest reliability, thereby calculating the sum of reliabilities. The preset number can also be changed by the user.
[0071] The state in which the reliability of multiple candidates with a high reliability ranking satisfies the threshold condition means that the sum of the reliabilities is within the threshold range. The threshold range can be preset or changed by the user. The threshold range is the range between the upper threshold A and the lower threshold B of the reliability. For example, when the state in which the sum of the reliabilities is within the threshold range continues for time T, the acquisition unit acquires the second ultrasonic image according to the second imaging condition.
[0072] As another example, the state in which the reliability of multiple candidates with a high reliability ranking satisfies the threshold condition means that the moving average of the sum of the reliabilities is within the threshold range. The threshold range can be preset or changed by the user. The threshold range is the range between the upper threshold C of the moving average and the lower threshold D of the moving average. For example, when the state in which the moving average of the sum of the reliabilities is within the threshold range continues for time T, the acquisition unit acquires the second ultrasonic image according to the second imaging condition. The moving average of the sum of the reliabilities is calculated by the image quality adjustment unit 30.
[0073] Hereinafter, with reference to Figure 2 , the time change of the reliability of cross-section identification will be described. Figure 2 It shows the time change of the reliability of cross-section identification. The horizontal axis represents time, and the vertical axis represents the reliability of cross-section identification.
[0074] Symbol 34 indicates the time change of the reliability of cross-section α. Symbol 36 indicates the time change of the reliability of cross-section β. Symbol 38 indicates the time change of the sum of the reliabilities of cross-section α and cross-section β.
[0076] Cross-sections α and β are candidates with a high reliability ranking. For example, cross-section α is the candidate with the highest reliability or the second highest reliability, and cross-section β is the candidate with the highest reliability or the second highest reliability. When the reliability of cross-section α is the highest, the reliability of cross-section β is the second highest, and when the reliability of cross-section α is the second highest, the reliability of cross-section β is the highest. Therefore, cross-sections α and β correspond to candidates with a high reliability ranking. As another example, when the user designates two as the number of candidates with a high ranking, it is determined that cross-sections α and β are set as candidates with a high reliability ranking.
[0077] In Figure 2 In the example shown, as indicated by symbols 34 and 36, as time passes, the reliability of cross-section α and the reliability of cross-section β fluctuate up and down, and the rankings of cross-section α and cross-section β are switched as time passes. For example, when the cross-section actually scanned by ultrasonic waves is a cross-section having the image features of cross-section α and the image features of cross-section β, the time changes of the reliabilities indicated by symbols 34 and 36 are observed.
[0078] Figure 3 Another time variation representing the reliability of cross-section identification. The horizontal axis represents time, and the vertical axis represents the reliability of cross-section identification.
[0079] Symbol 40 indicates the time variation of the reliability of cross-section α. Symbol 42 indicates the time variation of the reliability of cross-section β. Symbol 44 indicates the time variation of the sum of the reliability of cross-section α and the reliability of cross-section β.
[0080] Similar to Figure 2 the example shown, cross-sections α and β are candidates with relatively high reliability rankings. When the reliability of cross-section α is the highest, the reliability of cross-section β is the second highest, and when the reliability of cross-section α is the second highest, the reliability of cross-section β is the highest.
[0081] In Figure 3 the example shown, as indicated by symbols 40 and 42 respectively, the reliability of cross-section α and the reliability of cross-section β are both below 0.5 (i.e., 50%), and do not change significantly up and down over time. For example, when the cross-section actually scanned by ultrasonic waves does not have many features of either image of cross-sections α and β, the time variations indicated by symbols 40 and 42 are observed.
[0082] Refer to Figure 4 to explain the relationship between the sum of reliability and the threshold range. Figure 4 Represents the time variation of the sum of reliability. The horizontal axis represents time, and the vertical axis represents the reliability of cross-section identification. And, Figure 4 time T, upper threshold A, and lower threshold B are shown.
[0083] Symbol 38 indicates the time variation of the sum of the reliability of cross-section α and the reliability of cross-section β. Figure 4 In Figure 2 the curve indicated by symbol 38 is the same as the curve indicated by symbol 38 in
[0084] As Figure 2 and Figure 4 shown, the sum of reliability varies significantly in the time period before time T, but afterwards, it continuously varies between the upper threshold A and the lower threshold B within time T. In Figure 2 and Figure 4 the example shown, within time T, the sum of reliability varies between the upper threshold A and the lower threshold B. When the state where the sum of reliability is included within the threshold range (i.e., between the upper threshold A and the lower threshold B) continues within time T, the acquisition unit acquires the second ultrasonic image according to the second imaging condition.
[0085] In Figure 3Among them, the sum of reliabilities indicated by symbol 44 also fluctuates significantly in the time zone before time T, but after that, it continuously changes between the upper limit threshold A and the lower limit threshold B within time T. Therefore, the acquisition unit acquires the second ultrasonic image according to the second imaging condition.
[0086] Reference Figure 5 , the relationship between the moving average of the sum of reliabilities and the threshold range will be described. Figure 5 It shows the time change of the moving average of the sum of reliabilities. The horizontal axis represents time, and the vertical axis represents the moving average of the reliability of cross-section identification. And, Figure 5 time T, the upper limit threshold C, the lower limit threshold D, and the deviation Δ are shown.
[0087] For example, the image quality adjustment unit 30 calculates the moving average of the sum of reliabilities indicated by symbol 38 in Figure 2 . Symbol 46 indicates the time change of the moving average of the sum of reliabilities indicated by symbol 38. For example, the deviation Δ is the deviation of the moving average and is about 10% of the moving average. Of course, this value is only an example, and other values can also be used as the deviation Δ, or the deviation Δ can be set by the user.
[0088] As Figure 5 shown, the moving average of the sum of reliabilities fluctuates significantly in the time zone before time T, but after that, it continuously changes between the upper limit threshold C and the lower limit threshold D within time T. And, the deviation of the moving average is maintained within the deviation Δ. When the state where the moving average of the sum of reliabilities is included within the threshold range (that is, between the upper limit threshold C and the lower limit threshold D) continues within time T, the acquisition unit acquires the second ultrasonic image according to the second imaging condition.
[0089] Generally, it is considered that when a user such as a doctor or a medical technician searches for a cross-section suitable for ultrasonic examination while taking a picture with the ultrasonic probe 12, the reliability of cross-section estimation is unstable. For example, during the process of searching for a cross-section, sometimes the user changes the position or angle of the ultrasonic probe 12 while taking a picture. In this case, it is considered that the fluctuation of the reliability calculated during the search becomes large and the reliability is unstable. On the other hand, it is considered that when the user continues to take a picture without changing the position or angle of the ultrasonic probe 12, the fluctuation of the reliability calculated during this shooting period becomes small and the reliability is stable.
[0090] For example, when the state where the sum of reliabilities is within the threshold range continues for time T, it is presumed that the sum of reliabilities is stable. Similarly, when the state where the moving average of the sum of reliabilities is within the threshold range continues for time T, it is presumed that the sum of reliabilities is stable. That is, it is presumed that in these cases, a certain cross-section is scanned stably. Therefore, the acquisition unit acquires the second ultrasonic image according to the second imaging condition. As a result, the reliability of cross-section identification can be improved.
[0091] It may also be the case that the state where the reliabilities of multiple candidates with higher reliability rankings satisfy the threshold condition continues for time T, or the state where the rankings of multiple candidates with higher reliability rankings do not change for time T, and the reliabilities of each of the multiple candidates with higher reliability rankings are less than the threshold. The threshold is a preset value. The threshold can be changed by the user. For example, it is presumed that when the state where the reliability of cross-section α is the highest and the reliability of cross-section β is the second highest continues for time T, and the reliabilities of cross-section α and cross-section β are respectively less than the threshold, a certain cross-section is scanned stably. Therefore, the acquisition unit acquires the second ultrasonic image according to the second imaging condition.
[0092] Hereinafter, specific examples of the second imaging condition will be described.
[0093] For example, the second imaging condition is the imaging condition corresponding to the candidate whose reliability exceeds the threshold among multiple candidates with higher reliability rankings. The threshold is a preset value. The threshold can be changed by the user.
[0094] In Figure 2 and Figure 3 In the example shown, when the reliability of cross-section α exceeds the threshold and the reliability of cross-section β does not exceed the threshold, the image quality adjustment unit 30 determines the imaging condition suitable for photographing cross-section α (that is, the imaging condition associated with cross-section α) as the second imaging condition, and outputs the information indicating the imaging condition to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16. Thereby, the acquisition unit acquires the second ultrasonic image according to the second imaging condition corresponding to cross-section α.
[0095] When the reliability of cross-section α does not exceed the threshold and the reliability of cross-section β exceeds the threshold, the image quality adjustment unit 30 determines the imaging condition suitable for photographing cross-section β (that is, the imaging condition associated with cross-section β) as the second imaging condition, and outputs the information indicating the imaging condition to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16. Thereby, the acquisition unit acquires the second ultrasonic image according to the second imaging condition corresponding to cross-section β.
[0096] The second imaging condition may be the imaging condition corresponding to the candidate with the highest reliability among multiple candidates with a relatively high reliability ranking. For example, when the reliabilities of both cross-section α and cross-section β exceed the threshold, the image quality adjustment unit 30 determines the imaging condition corresponding to the cross-section with the highest reliability among cross-section α and cross-section β as the second imaging condition.
[0097] When the reliability of cross-section α is higher than that of cross-section β, the image quality adjustment unit 30 determines the imaging condition suitable for photographing cross-section α (i.e., the imaging condition associated with cross-section α) as the second imaging condition, and outputs the information indicating the imaging condition to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16. Thereby, the acquisition unit acquires the second ultrasonic image according to the second imaging condition corresponding to cross-section α.
[0098] When the reliability of cross-section β is higher than that of cross-section α, the image quality adjustment unit 30 determines the imaging condition suitable for photographing cross-section β (i.e., the imaging condition associated with cross-section β) as the second imaging condition, and outputs the information indicating the imaging condition to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16. Thereby, the acquisition unit acquires the second ultrasonic image according to the second imaging condition corresponding to cross-section β.
[0099] According to the present embodiment, a user such as a doctor or a medical technician can perform an ultrasonic examination using the second ultrasonic image suitable for ultrasonic examination. As a result, the user does not need to set the imaging conditions suitable for the diagnostic site, and the workload and time for setting the imaging conditions can be reduced.
[0100] Hereinafter, application examples of the present embodiment will be described.
[0101] For example, in the ultrasonic examination of the liver, if the imaging conditions are inappropriate, it may be difficult to display the portal vein in the ultrasonic image of the intercostal cross-section representing the liver due to insufficient sensitivity or the like. As a result, the reliability of cross-section recognition sometimes decreases. According to the present embodiment, for example, when the state where the sum of the reliabilities of the top 2 cross-sections in terms of reliability is within the threshold range continues at time T, the acquisition unit acquires the second ultrasonic image according to the second imaging condition. For example, the imaging condition suitable for the intercostal cross-section of the liver (for example, the imaging condition in which the focus depth, aperture width, gain, etc. of the transmitted beam are adjusted) is used as the second imaging condition to acquire the second ultrasonic image. In this way, high sensitivity can be obtained, and the second ultrasonic image that appropriately displays the blood vessels is generated. And the second ultrasonic image with high reliability is generated.
[0102] Hereinafter, with reference to Figures 6 to 9 specific examples of the second imaging condition will be described. Figures 6 to 9 shows the time change of the reliability of cross-section recognition. InFigures 6 to 9 In this case, the horizontal axis represents time and the vertical axis represents reliability.
[0103] Figure 6 It represents the time change of the reliability calculated from the first ultrasonic image. Symbol 48 indicates the time change of the reliability of cross-section α. Symbol 50 indicates the time change of the reliability of cross-section β. Symbol 52 indicates the time change of the sum of the reliability of cross-section α and the reliability of cross-section β. Each reliability is a value calculated from the first ultrasonic image. When the state where the sum of the reliabilities satisfies the threshold condition continues within time T, the acquisition unit acquires the second ultrasonic image according to the second imaging condition.
[0104] Figures 7 to 9 It represents the time change of the reliability calculated from the second ultrasonic image.
[0105] Figure 7 The reliability of each cross-section shown in this figure is the reliability calculated from the second ultrasonic image acquired according to the second imaging condition that gives priority to contrast. Symbol 54 indicates the time change of the reliability of cross-section α. Symbol 56 indicates the time change of the reliability of cross-section β. Symbol 58 indicates the time change of the sum of the reliability of cross-section α and the reliability of cross-section β.
[0106] Figure 8 The reliability of each cross-section shown in this figure is the reliability calculated from the second ultrasonic image acquired according to the second imaging condition that gives priority to resolution. Symbol 60 indicates the time change of the reliability of cross-section α. Symbol 62 indicates the time change of the reliability of cross-section β. Symbol 64 indicates the time change of the sum of the reliability of cross-section α and the reliability of cross-section β.
[0107] Figure 9 The reliability of each cross-section shown in this figure is the reliability calculated from the second ultrasonic image acquired according to the second imaging condition that gives priority to deep sensitivity. Symbol 66 indicates the time change of the reliability of cross-section α. Symbol 68 indicates the time change of the reliability of cross-section β. Symbol 70 indicates the time change of the sum of the reliability of cross-section α and the reliability of cross-section β.
[0108] Hereinafter, a modified example will be described.
[0109] (Modified Example 1)
[0110] In Modified Example 1, the recognition unit 28 estimates one or more candidates for the scanned cross-section by performing cross-section recognition processing on the second ultrasonic image. And the recognition unit 28 calculates the reliability of the recognition for each candidate of the scanned cross-section.
[0111] The image quality adjustment unit 30 compares the reliability calculated based on the first ultrasonic image with the reliability calculated based on the second ultrasonic image. For example, the image quality adjustment unit 30 compares the highest reliability calculated based on the first ultrasonic image (i.e., the reliability of the cross-section with the highest reliability) with the highest reliability calculated based on the second ultrasonic image (i.e., the reliability of the cross-section with the highest reliability).
[0112] When the reliability calculated based on the second ultrasonic image is higher than the reliability calculated based on the first ultrasonic image, the image quality adjustment unit 30 outputs the information indicating the second imaging condition to the transceiver unit 14, the image generation unit 16, or both the transceiver unit 14 and the image generation unit 16. The acquisition unit acquires the second ultrasonic image according to the second imaging condition.
[0113] When the reliability calculated based on the second ultrasonic image is less than or equal to the reliability calculated based on the first ultrasonic image, the image quality adjustment unit 30 maintains the imaging condition as the first imaging condition without changing the imaging condition. The acquisition unit continues ultrasonic imaging according to the first imaging condition.
[0114] According to Modification Example 1, since the ultrasonic image is acquired according to the imaging condition that can obtain a higher reliability, a more appropriate ultrasonic examination can be achieved.
[0115] (Modification Example 2)
[0116] In Modification Example 2, the control unit 32 causes the display unit 20 to display the first ultrasonic image and the second ultrasonic image. For example, the control unit 32 arranges and displays the first ultrasonic image and the second ultrasonic image on the display unit 20. The control unit 32 can also switch and display the first ultrasonic image and the second ultrasonic image on the display unit 20. For example, if the user gives a switching instruction by operating the operation unit 22, the control unit 32 switches and displays the first ultrasonic image and the second ultrasonic image on the display unit 20. The control unit 32 can also automatically switch and display the first ultrasonic image and the second ultrasonic image on the display unit 20 every time a preset time elapses.
[0117] The user refers to the first ultrasonic image and the second ultrasonic image displayed on the display unit 20 and selects the first imaging condition or the second imaging condition by operating the operation unit 22. The acquisition unit acquires the ultrasonic image according to the imaging condition selected by the user.
[0118] For example, the control unit 32 arranges and displays the image for selecting the first imaging condition (such as an icon or button image indicating the first imaging condition) and the image for selecting the second imaging condition (such as an icon or button image indicating the second imaging condition) on the display unit 20. The user selects the imaging condition by pressing the icon or button image, etc.
[0119] As another example, the user may select the imaging conditions by selecting the displayed ultrasonic image, and the image quality adjustment unit 30 receives this selection. For example, when the user selects the first ultrasonic image by operating the operation unit 22, the image quality adjustment unit 30 receives this selection and sets the imaging conditions to the first imaging conditions. When the user selects the second ultrasonic image by operating the operation unit 22, the image quality adjustment unit 30 receives this selection and sets the imaging conditions to the second imaging conditions. The acquisition unit acquires the ultrasonic image according to the imaging conditions set by the image quality adjustment unit 30.
[0120] According to Modification Example 2, the ultrasonic image is acquired according to the imaging conditions desired by the user. Therefore, the ultrasonic image desired by the user is generated and presented to the user.
[0121] In addition, when the reliability calculated based on the second ultrasonic image is lower than the reliability calculated based on the first ultrasonic image, the control unit 32 may not display the second ultrasonic image on the display unit 20. In this case, if the reliability calculated based on the second ultrasonic image is higher than the reliability calculated based on the first ultrasonic image, the control unit 32 displays the first ultrasonic image and the second ultrasonic image on the display unit 20.
[0122] (Modification Example 3)
[0123] In Modification Example 3, the second imaging conditions are conditions related to the image processing performed by the image generation unit 16. The image quality adjustment unit 30 outputs information indicating the second imaging conditions to the image generation unit 16. The image generation unit 16 performs image processing according to the second imaging conditions on the data acquired according to the first imaging conditions (for example, reception frames), thereby generating the second ultrasonic image. The image processing performed according to the second imaging conditions is image processing suitable for the estimated cross-section, for example, image processing in which an image processing filter (for example, a smoothing filter) is adjusted.
[0124] According to Modification Example 3, the second ultrasonic image can be acquired by only changing the image processing conditions using the data acquired according to the first imaging conditions.
[0125] The image generation unit 16, the display processing unit 18, the analysis unit 26, and the control unit 32 can be implemented, for example, by using hardware resources such as a processor or an electronic circuit. In their implementation, devices such as a memory can be utilized as needed. Moreover, the image generation unit 16, the display processing unit 18, the analysis unit 26, and the control unit 32 can be implemented by a computer, for example. That is, all or part of the image generation unit 16, the display processing unit 18, the analysis unit 26, and the control unit 32 can be implemented through the cooperation of hardware resources such as the CPU (Central Processing Unit) or the memory included in the computer and software (program) that defines the operation of the CPU and the like. This program is stored in the storage unit 24 of the ultrasonic diagnostic apparatus 10 or other storage devices via a storage medium such as a CD or a DVD, or via a communication path such as a network. As another example, the image generation unit 16, the display processing unit 18, the analysis unit 26, and the control unit 32 can also be implemented by a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like. Of course, a GPU (Graphics Processing Unit) or the like can also be used. The image generation unit 16, the display processing unit 18, the analysis unit 26, and the control unit 32 can be implemented by a single device or by multiple devices.
[0126] In addition, the functions of the image generation unit 16, the display processing unit 18, the analysis unit 26, and the control unit 32 can also be executed by a device other than the ultrasonic diagnostic apparatus 10 (for example, a personal computer or a server).
Claims
1. An ultrasonic diagnostic device, characterized in that: include: an acquisition unit that acquires a first ultrasonic image of the subject according to a first imaging condition; and an identification unit that performs a process of identifying a cross section on the first ultrasonic image and outputs a plurality of candidates for the cross section and a degree of reliability of identification of each candidate, When the reliabilities of the top reliability candidates satisfy a threshold condition for a predetermined period of time, the acquisition unit acquires a second ultrasonic image of the subject under a second imaging condition that is different from the first imaging condition and corresponds to the identified cross section.
2. The ultrasonic diagnostic apparatus according to claim 1, wherein: The reliability of the plurality of candidates ranked high in reliability is the sum of the reliability calculated by adding the reliability of each candidate in order from the candidate with the highest reliability. The state where the reliabilities of the plurality of candidates with higher reliability rankings satisfy the threshold condition continues for a predetermined period of time means that the state where the sum is included in the threshold range continues for a predetermined period of time.
3. The ultrasonic diagnostic apparatus according to claim 1, wherein: The situation where the reliabilities of multiple candidates with high reliability rankings satisfy the threshold conditions for a predetermined period of time means that the rankings of multiple candidates with high reliability rankings do not change for a predetermined period of time, and the reliability of each of the multiple candidates with high reliability rankings is less than the threshold.
4. The ultrasonic diagnostic apparatus according to claim 1, wherein: The second imaging condition is an imaging condition corresponding to a candidate having a reliability exceeding a threshold value among a plurality of candidates having a high reliability ranking.
5. The ultrasonic diagnostic apparatus according to claim 4, characterized in that: The second imaging condition is an imaging condition corresponding to a candidate having the highest reliability among a plurality of candidates having a high reliability ranking.
6. The ultrasonic diagnostic apparatus according to claim 1, wherein: The recognition unit further performs a process of recognizing a cross section on the second ultrasonic image and calculates a reliability of the recognition. When the reliability calculated based on the second ultrasonic image is higher than the reliability calculated based on the first ultrasonic image, the acquisition unit further acquires the second ultrasonic image according to the second imaging condition.
7. The ultrasonic diagnostic apparatus according to claim 6, wherein: When the reliability calculated based on the second ultrasonic image is equal to or lower than the reliability calculated based on the first ultrasonic image, the acquisition unit further continues ultrasonic imaging according to the first imaging condition.
8. The ultrasonic diagnostic apparatus according to claim 1, wherein: Also includes: a control unit that displays the first ultrasonic image and the second ultrasonic image on a display, The acquisition unit acquires an ultrasonic image according to an imaging condition selected by a user from among the first imaging condition and the second imaging condition.
9. The ultrasonic diagnostic apparatus according to claim 1, wherein: The second photographing condition is a condition related to image processing. The acquisition unit acquires the second ultrasonic image by performing image processing according to the second imaging condition on the data acquired according to the first imaging condition.
10. A computer-readable non-transitory recording medium having a program recorded thereon, the program causing a computer to function as: an acquisition unit that acquires a first ultrasonic image of the subject according to a first imaging condition; and an identification unit that performs a process of identifying a cross section on the first ultrasonic image and outputs a plurality of candidates for the cross section and a degree of reliability of identification of each candidate; When the reliabilities of the top reliability candidates satisfy the threshold condition for a predetermined period of time, the acquisition unit acquires a second ultrasonic image of the subject under a second imaging condition that is different from the first imaging condition and corresponds to the identified cross section.
Citation Information
Patent Citations
Systems and methods for image optimization
JP2022551143A