A fetal heart rate display method, an ultrasonic imaging apparatus, and a storage medium
By performing correlation calculations and region of interest identification in B-mode ultrasound images, the problem of low accuracy of fetal heart rate values in Doppler and M-mode ultrasounds was solved, achieving more efficient fetal heart rate detection.
Patent Information
- Application Number
- CN202211486110.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2018-12-28
- Publication Date
- 2026-08-25
- Estimated Expiration
- 2038-12-28
AI Technical Summary
Interference and noise exist in existing Doppler and M-mode ultrasound fetal heart rate examinations, resulting in low accuracy of fetal heart rate values and complex operation, which affects the accuracy and efficiency of fetal health detection.
A correlation calculation method based on B-mode ultrasound images is adopted. By acquiring multiple frames of images, the region of interest and the image with the highest correlation are determined, the fetal heart rate value is calculated, and the heart rate value and image are displayed in the ultrasound imaging device. This includes correlation calculation, region of interest identification, and preset condition judgment.
It improves the accuracy and speed of fetal heart rate measurements, reduces the difficulty of clinical operation, and achieves more efficient fetal health monitoring.
Smart Images

Figure CN115836877B_ABST
Abstract
Description
[0001] This disclosure is based on Chinese Patent Application No. 201811628654.3, filed on December 28, 2018, entitled "A Fetal Heart Rate Display Method, Ultrasonic Imaging Device, and Storage Medium", and is a divisional application within the scope of that Chinese Patent Application, the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of ultrasound imaging, and more particularly to a method for displaying fetal heart rate, an ultrasound imaging device, and a storage medium. Background Technology
[0003] Fetal heart rate refers to the number of times the fetal heart beats per minute. Its changes reflect the regulatory function of the circulatory and central nervous systems, allowing doctors to determine the fetus's health in the womb. An abnormal fetal heart rate indicates fetal hypoxia, which can lead to intrauterine developmental abnormalities and, in severe cases, endanger the fetus's life. Therefore, perinatal fetal heart rate monitoring is crucial and is a mandatory component of prenatal ultrasound examinations in grades I-IV. Currently, fetal heart rate monitoring is typically performed using Doppler or M-mode ultrasound. However, due to various interferences and noise in Doppler echo signals and the more time-consuming and complex workflow of M-mode ultrasound, the accuracy and speed of the displayed fetal heart rate values are often low. Summary of the Invention
[0004] To address the aforementioned technical problems, this application aims to provide a method for displaying fetal heart rate, an ultrasound imaging device, and a storage medium, which can improve the accuracy of fetal heart rate values and reduce the difficulty of clinical operation.
[0005] The technical solution of this application embodiment can be implemented as follows:
[0006] This application provides a method for displaying fetal heart rate, the method comprising:
[0007] Acquire multiple frames of B-mode ultrasound images of the target fetus;
[0008] Based on the multi-frame B-mode ultrasound images, correlation calculation is performed on the current ultrasound image to obtain the heart rate value of the target fetus. The current ultrasound image is the ultrasound image acquired at the current time among the multi-frame B-mode ultrasound images.
[0009] The heart rate value and the current ultrasound image are displayed.
[0010] In the above method, before performing correlation calculation on the current ultrasound image based on the multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus, the method further includes:
[0011] Determine whether the current ultrasound image meets the preset heart rate display conditions;
[0012] When it is determined that the current ultrasound image meets the preset heart rate display conditions, the correlation of the current ultrasound image is calculated based on the multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus.
[0013] In the above method, the step of calculating the correlation between the current ultrasound image and the multi-frame B-mode ultrasound image to obtain the heart rate value of the target fetus includes:
[0014] A first ultrasound image is determined from the multiple frames of B-mode ultrasound images, wherein the first ultrasound image is M frames of ultrasound images preceding the current ultrasound image, and M is determined based on the preset heart rate cycle of the target fetus.
[0015] Determine the correlation between the first ultrasound image and the current ultrasound image;
[0016] The first ultrasound image with the highest correlation to the current ultrasound image is determined as the second ultrasound image;
[0017] The heart rate value is determined based on the frame distance between the second ultrasound image and the current ultrasound image.
[0018] In the above method, the step of calculating the correlation between the current ultrasound image and the multi-frame B-mode ultrasound image to obtain the heart rate value of the target fetus includes:
[0019] A first ultrasound image is determined from the multiple frames of B-mode ultrasound images, wherein the first ultrasound image is M frames of ultrasound images preceding the current ultrasound image, where M is determined based on the preset heart rate cycle of the target fetus, and the first ultrasound image includes dynamically determined multiple frames of first sub-ultrasound images and dynamically determined second sub-ultrasound images.
[0020] Determine the correlation between the multiple frames of the first sub-ultrasound image and the second sub-ultrasound image;
[0021] The heart rate value is determined based on the maximum average correlation between the first sub-ultrasound image and the second sub-ultrasound image determined dynamically each time.
[0022] In the above method, before performing correlation calculation on the current ultrasound image based on the multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus, the method further includes:
[0023] Using a preset positioning method, ultrasound images containing a region of interest are determined from the multiple frames of B-mode ultrasound images, wherein the region of interest includes all fetal heart structures of the target fetus;
[0024] The step of calculating the correlation between the current ultrasound image and the multi-frame B-mode ultrasound images to obtain the heart rate value of the target fetus includes:
[0025] A first ultrasound image is determined from the ultrasound images containing the region of interest, wherein the first ultrasound image is an M-frame ultrasound image preceding the current ultrasound image, and M is determined based on a preset heart rate cycle of the target fetus.
[0026] Determine the correlation between the region of interest in the first ultrasound image and the region of interest in the current ultrasound image;
[0027] The first ultrasound image with the highest correlation to the region of interest of the current ultrasound image is determined as the second ultrasound image;
[0028] The heart rate value is determined based on the frame distance between the second ultrasound image and the current ultrasound image.
[0029] In the above method, before performing correlation calculation on the current ultrasound image based on the multiple frames of B-mode ultrasound images, the method further includes:
[0030] Determine whether the number of first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0;
[0031] When the number of the first frames meets the first preset number of frames, in the third ultrasound image, find an ultrasound image whose correlation with the current ultrasound image is higher than a preset threshold.
[0032] Determine whether the number of second frames of ultrasound images whose correlation with the current ultrasound image is higher than a preset threshold meets the second preset frame count requirement;
[0033] When the number of the second frame meets the number of the second preset frame, it is determined that the current ultrasound image meets the preset heart rate display conditions.
[0034] In the above method, before performing correlation calculation on the current ultrasound image based on the multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus, the method further includes:
[0035] Determine whether the number of first frames of the third ultrasound image satisfies the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0;
[0036] When the number of the first frames meets the first preset number of frames, determine whether the region of interest is located from the current ultrasound image;
[0037] When the region of interest is located in the current ultrasound image, the third ultrasound image is searched for ultrasound images whose correlation with the region of interest in the current ultrasound image is higher than a preset threshold, and it is determined whether the number of second frames of the ultrasound images whose correlation with the region of interest in the current ultrasound image is higher than the preset threshold satisfies the second preset number of frames.
[0038] When the number of the second frame meets the number of the second preset frame, it is determined that the current ultrasound image meets the preset heart rate display conditions.
[0039] In the above method, before performing correlation calculation on the current ultrasound image based on the multiple frames of B-mode ultrasound images, the method further includes:
[0040] Determine whether the number of first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0;
[0041] When the number of the first frames meets the first preset number of frames, an ultrasound image with a region of interest is determined in the third ultrasound image, and it is determined whether the number of the third frames of the ultrasound image with the region of interest meets the third preset number of frames. When the number of the third frames meets the third preset number of frames, it is determined that the current ultrasound image meets the preset heart rate display condition.
[0042] In the above method, determining the ultrasound image containing the region of interest from the multiple frames of B-mode ultrasound images using a preset positioning method includes:
[0043] Training is performed on preset ultrasound image data;
[0044] Based on the training results, feature matching is performed sequentially on the multiple frames of B-mode ultrasound images to determine the ultrasound images containing regions of interest from the multiple frames of B-mode ultrasound images.
[0045] In the above method, determining the ultrasound image containing the region of interest from the multiple frames of B-mode ultrasound images using a preset positioning method includes:
[0046] Feature learning is performed on preset ultrasound image data;
[0047] Based on the learning results, predictions are sequentially performed on the multiple frames of B-mode ultrasound images to determine ultrasound images containing regions of interest from the multiple frames of B-mode ultrasound images.
[0048] In the above method, before searching for ultrasound images in the third ultrasound image whose correlation with the region of interest of the current ultrasound image is higher than a preset threshold, the method further includes:
[0049] Obtain the matching value corresponding to the region of interest in the current ultrasound image;
[0050] When it is determined that the matching value meets the preset matching threshold, it indicates that the region of interest has been located from the current ultrasound image;
[0051] When it is determined that the matching value does not meet the preset matching threshold, it indicates that the region of interest has not been located from the current ultrasound image.
[0052] In the above method, displaying the heart rate value and the current ultrasound image includes:
[0053] In the current ultrasound image, a region of interest for the target fetus is identified, wherein the region of interest includes all fetal heart structures of the target fetus;
[0054] The heart rate value is displayed in the current ultrasound image according to a first font parameter, wherein the first font parameter includes at least one of font, font size, and color.
[0055] In the above method, displaying the heart rate value and the current ultrasound image includes:
[0056] A heart rate change trend graph is generated based on the heart rate value. The heart rate change trend graph represents the change trend of the heart rate value corresponding to each current ultrasound image. The heart rate change trend graph includes at least one of an amplitude value trend graph and a sine wave diagram.
[0057] The heart rate change trend graph is displayed in the current ultrasound image.
[0058] In the above method, displaying the heart rate value and the current ultrasound image includes:
[0059] Based on the heart rate value, obtain the duration of each heartbeat;
[0060] The process of heartbeat is simulated using the aforementioned heartbeat duration;
[0061] The morphology of the simulated heartbeat is dynamically displayed in the current ultrasound image.
[0062] In the above method, dynamically displaying the beating pattern of the simulated heart in the current ultrasound image includes:
[0063] A simulated heartbeat is displayed in the current ultrasound image, the simulated heartbeat being used to simulate the beating pattern of the heart;
[0064] Play a heartbeat sound effect.
[0065] In the above method, after displaying the heart rate value in the current ultrasound image according to the first font parameter, the method further includes:
[0066] The heart rate value is then broadcast.
[0067] In the above method, the method further includes:
[0068] The preset heart rate range is displayed in the current ultrasound image;
[0069] When the heart rate value is determined to exceed the preset heart rate range, an alarm is triggered using a preset display method, wherein the preset display method includes at least one of emitting an alarm sound, displaying the heart rate value in a dynamic manner, and changing the color or font of the heart rate value.
[0070] In the above method, after determining whether the current ultrasound image meets the preset heart rate display conditions, the method further includes:
[0071] When it is determined that the current ultrasound image does not meet the preset heart rate display conditions, the heart rate value is not displayed in the current ultrasound image.
[0072] This application provides an ultrasound imaging device, the ultrasound imaging device comprising:
[0073] probe;
[0074] A transmitting circuit that excites the probe to emit ultrasound waves toward the target fetus;
[0075] A receiving circuit that receives ultrasound echoes returned from the target fetus via the probe to obtain an ultrasound echo signal;
[0076] A processor that processes the ultrasound echo signal to obtain ultrasound image data of the target fetus, wherein the ultrasound image data is B-mode ultrasound image data;
[0077] A display showing the B-mode ultrasound image data;
[0078] The processor further performs the following steps:
[0079] Acquire multiple frames of B-mode ultrasound images of the target fetus; based on the multiple frames of B-mode ultrasound images, perform correlation calculation on the current ultrasound image to obtain the heart rate value of the target fetus, wherein the current ultrasound image is the ultrasound image acquired at the current time among the multiple frames of B-mode ultrasound images;
[0080] The display is also used to display the heart rate value and the current ultrasound image.
[0081] In the aforementioned ultrasound imaging device, the processor is further configured to determine whether the current ultrasound image meets the preset heart rate display conditions; when it is determined that the current ultrasound image meets the preset heart rate display conditions, the processor performs correlation calculation on the current ultrasound image based on the multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus.
[0082] In the aforementioned ultrasound imaging device, a first ultrasound image is determined from the multiple frames of B-mode ultrasound images, wherein the first ultrasound image is M frames of ultrasound images preceding the current ultrasound image, and M is determined based on the preset heart rate cycle of the target fetus; the correlation between the first ultrasound image and the current ultrasound image is determined; the first ultrasound image with the highest correlation to the current ultrasound image is determined as the second ultrasound image; and the heart rate value is determined based on the frame distance between the second ultrasound image and the current ultrasound image.
[0083] In the aforementioned ultrasound imaging device, the processor is further configured to determine a first ultrasound image from the multiple frames of B-mode ultrasound images, wherein the first ultrasound image is M frames of ultrasound images preceding the current ultrasound image, where M is determined based on a preset heart rate cycle of the target fetus, and the first ultrasound image includes dynamically determined multiple frames of first sub-ultrasound images and dynamically determined second sub-ultrasound images; determine the correlation between the multiple frames of first sub-ultrasound images and the second sub-ultrasound images respectively; and determine the heart rate value based on the average maximum correlation between each dynamically determined first sub-ultrasound image and each dynamically determined second sub-ultrasound image.
[0084] In the aforementioned ultrasound imaging device, the processor is further configured to: determine an ultrasound image containing a region of interest from the multi-frame B-mode ultrasound images using a preset positioning method, wherein the region of interest includes all fetal heart structures of the target fetus; determine a first ultrasound image from the ultrasound images containing the region of interest, wherein the first ultrasound image is M frames of ultrasound images preceding the current ultrasound image, where M is determined based on a preset heart rate cycle of the target fetus; determine the correlation between the region of interest of the first ultrasound image and the region of interest of the current ultrasound image; determine the first ultrasound image with the highest correlation to the region of interest of the current ultrasound image as a second ultrasound image; and determine the heart rate value based on the frame distance between the second ultrasound image and the current ultrasound image.
[0085] In the aforementioned ultrasound imaging device, it is determined whether the number of first frames of the third ultrasound image meets a first preset frame count, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames meets the first preset frame count, in the third ultrasound image, an ultrasound image with a correlation higher than a preset threshold is searched; it is determined whether the number of second frames of the ultrasound images with a correlation higher than the preset threshold meets a second preset frame count; when the number of second frames meets the second preset frame count, it is determined that the current ultrasound image meets the preset heart rate display condition.
[0086] In the aforementioned ultrasound imaging device, it is determined whether the number of first frames of the third ultrasound image satisfies the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames satisfies the first preset number of frames, it is determined whether the region of interest is located in the current ultrasound image; when it is determined that the region of interest is located in the current ultrasound image, ultrasound images in the third ultrasound image with a correlation higher than a preset threshold with the region of interest of the current ultrasound image are searched, and it is determined whether the number of second frames of the ultrasound images with a correlation higher than the preset threshold with the region of interest of the current ultrasound image satisfies the second preset number of frames; when the number of second frames satisfies the second preset number of frames, it is determined that the current ultrasound image satisfies the preset heart rate display condition.
[0087] In the aforementioned ultrasound imaging device, it is determined whether the number of first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames meets the first preset number of frames, an ultrasound image containing a region of interest is identified in the third ultrasound image, and it is determined whether the number of third frames of the ultrasound image containing the region of interest meets the third preset number of frames; when the number of third frames meets the third preset number of frames, it is determined that the current ultrasound image meets the preset heart rate display condition.
[0088] In the aforementioned ultrasound imaging device, the processor is further configured to train preset ultrasound image data; and based on the training results, sequentially perform feature matching on the multiple frames of B-mode ultrasound images to determine ultrasound images containing regions of interest from the multiple frames of B-mode ultrasound images.
[0089] In the aforementioned ultrasound imaging device, the processor is further configured to perform feature learning on preset ultrasound image data; and based on the learning results, sequentially predict the multiple frames of B-mode ultrasound images to determine ultrasound images containing regions of interest from the multiple frames of B-mode ultrasound images.
[0090] In the aforementioned ultrasound imaging device, the processor is further configured to acquire a matching value corresponding to the region of interest in the current ultrasound image; when it is determined that the matching value meets a preset matching threshold, it indicates that the region of interest has been located from the current ultrasound image; when it is determined that the matching value does not meet the preset matching threshold, it indicates that the region of interest has not been located from the current ultrasound image.
[0091] In the aforementioned ultrasound imaging device, the display is further configured to mark the region of interest of the target fetus in the current ultrasound image, wherein the region of interest includes all fetal heart structures of the target fetus; and to display the heart rate value in the current ultrasound image according to a first font parameter, wherein the first font parameter includes at least one of font, font size, and color.
[0092] In the aforementioned ultrasound imaging device, the display is further configured to generate a heart rate change trend graph based on the heart rate value, the heart rate change trend graph representing the change trend of the heart rate value corresponding to each current ultrasound image, the heart rate change trend graph including at least one of an amplitude value trend graph and a sine wave schematic diagram; and display the heart rate change trend graph in the current ultrasound image.
[0093] In the aforementioned ultrasound imaging device, the display is further configured to acquire the duration of each heartbeat based on the heart rate value; simulate the heartbeat process using the heartbeat duration; and dynamically display the morphology of the simulated heartbeat in the current ultrasound image.
[0094] In the aforementioned ultrasound imaging device, the display is further configured to display a simulated heartbeat in the current ultrasound image, the simulated heartbeat being used to simulate the beating pattern of the heart.
[0095] The processor is also used to play the sound effect of a heartbeat.
[0096] In the aforementioned ultrasound imaging device, the processor is also used to broadcast the heart rate value.
[0097] In the aforementioned ultrasound imaging device, the display is further configured to display a preset heart rate range in the current ultrasound image;
[0098] The processor is further configured to issue an alarm reminder using a preset display method when it is determined that the heart rate value exceeds the preset heart rate range. The preset display method includes at least one of emitting an alarm sound, displaying the heart rate value in a dynamic manner, and changing the color or font of the heart rate value.
[0099] In the aforementioned ultrasound imaging device, the processor is further configured to not display the heart rate value in the current ultrasound image when it is determined that the current ultrasound image does not meet the preset heart rate display requirements.
[0100] This application provides a computer-readable storage medium storing a computer program applied to an ultrasound imaging device. When executed by a processor, the computer program implements the fetal heart rate display method as described in any of the preceding claims.
[0101] This application provides a method for displaying fetal heart rate, an ultrasound imaging device, and a storage medium. The method includes: acquiring multiple frames of B-mode ultrasound images of the target fetus; performing correlation calculations on the current ultrasound image based on the multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus, wherein the current ultrasound image is the ultrasound image acquired at the current time among the multiple frames of B-mode ultrasound images; and displaying the heart rate value and the current ultrasound image. Using the above method, the ultrasound imaging device automatically calculates the heart rate value of the target fetus using B-mode ultrasound. First, based on the acquired multiple frames of B-mode ultrasound images, correlation calculations are performed on the current ultrasound image, and then the heart rate value of the target fetus is automatically calculated and displayed. This significantly improves the speed and accuracy of displaying the fetal heart rate value and reduces the difficulty of clinical operation. Attached Figure Description
[0102] Figure 1 This is a schematic diagram of the structure of an ultrasound imaging device provided in an embodiment of this application;
[0103] Figure 2 A flowchart of a fetal heart rate display method provided in this application embodiment Figure 1 ;
[0104] Figure 3 A schematic diagram of an exemplary ultrasound imaging device provided in this application embodiment;
[0105] Figure 4 A schematic diagram illustrating an exemplary correlation calculation between a current ultrasound image and a first ultrasound image, provided for an embodiment of this application;
[0106] Figure 5 A flowchart of a fetal heart rate display method provided in this application embodiment Figure 2 ;
[0107] Figure 6An exemplary display diagram of the fetal heart region and fetal heart rate provided in this application embodiment. Figure 1 ;
[0108] Figure 7 This application provides an example of a display diagram showing the fetal heart region and fetal heart rate. Figure 2 ;
[0109] Figure 8 This is an exemplary display diagram illustrating the display of multiple frames of B-mode ultrasound images, provided as an embodiment of this application.
[0110] Figure 9 This is an exemplary schematic diagram of a fetal heart area provided for an embodiment of this application;
[0111] Figure 10 An exemplary flowchart for calculating and displaying fetal heart rate based on B-mode ultrasound images, provided as an embodiment of this application;
[0112] Figure 11 A flowchart of a fetal heart rate display method provided in this application embodiment Figure 3 ;
[0113] Figure 12 A flowchart illustrating the steps of an exemplary ultrasound imaging device for identifying a region of interest, provided in an embodiment of this application;
[0114] Figure 13 A schematic diagram illustrating an exemplary automatic fetal heart rate region positioning effect provided in an embodiment of this application;
[0115] Figure 14 This is a flowchart illustrating an exemplary ultrasound imaging device for calculating and displaying fetal heart rate based on a B-mode ultrasound image of the fetal heart region, as provided in an embodiment of this application. Detailed Implementation
[0116] In order to gain a more detailed understanding of the features and technical content of the embodiments of this application, the implementation of the embodiments of this application will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for reference and illustration only and are not intended to limit the embodiments of this application.
[0117] Figure 1This is a schematic diagram of the ultrasound imaging device 10 in an embodiment of this application. The ultrasound imaging device 10 may include a probe 100, a transmitting circuit 101, a transmitting / receiving selection switch 102, a receiving circuit 103, a beamforming circuit 104, a processor 105, and a display 106. The transmitting circuit 101 excites the probe to emit ultrasound waves toward the target fetus. The receiving circuit 103 receives the ultrasound echoes returned from the target fetus through the probe 100 to obtain ultrasound echo signals. These ultrasound echo signals are processed by the beamforming circuit 104 and then sent to the processor 105. The processor 105 processes the ultrasound echo signals to obtain ultrasound image data of the target fetus, which is B-mode ultrasound image data. The B-mode ultrasound image data obtained by the processor 105 can be stored in a memory 107, and this B-mode ultrasound image data can be displayed on the display 106.
[0118] In this embodiment, the display 106 of the aforementioned ultrasonic imaging device 10 can be a touch screen, a liquid crystal display, or an independent display device such as a liquid crystal display or a television set, separate from the ultrasonic imaging device 10. It can also be a display screen on an electronic device such as a mobile phone or a tablet computer.
[0119] In this embodiment of the application, the memory 107 of the aforementioned ultrasound imaging device 10 can be a flash memory card, solid-state memory, hard disk, etc.
[0120] This application also provides a computer-readable storage medium storing a plurality of program instructions. After being called and executed by the processor 105, the plurality of program instructions can execute some or all of the steps or any combination of the steps in the fetal heart rate display method in various embodiments of this application.
[0121] In one embodiment, the computer-readable storage medium may be a memory 107, which may be a non-volatile storage medium such as a flash memory card, a solid-state memory, or a hard disk.
[0122] In this embodiment, the processor 105 of the aforementioned ultrasound imaging device 10 can be implemented by software, hardware, firmware, or a combination thereof. It can use circuits, one or more application-specific integrated circuits (ASICs), one or more general-purpose integrated circuits, one or more microprocessors, one or more programmable logic devices, or a combination of the aforementioned circuits or devices, or other suitable circuits or devices, so that the processor 105 can execute the corresponding steps of the fetal heart rate display method in the aforementioned embodiments.
[0123] The fetal heart rate display method of this application is described in detail below. This method is applied to an ultrasound imaging device, specifically any portable or desktop ultrasound device capable of B-mode ultrasound imaging. The ultrasound imaging device acquires multiple frames of B-mode ultrasound images of the target fetus. Based on the multiple frames of B-mode ultrasound images, correlation calculations are performed on the current ultrasound image to obtain the heart rate value of the target fetus, and the heart rate value and the current ultrasound image are displayed. Please refer to [link to relevant documentation]. Figure 2 The specific procedure for the fetal heart rate display method in this application may include:
[0124] S101. Acquire multiple frames of B-mode ultrasound images of the target fetus.
[0125] The fetal heart rate display method provided in this application embodiment is applicable to scenarios where fetal heart rate is automatically measured and displayed based on B-mode ultrasound.
[0126] In the embodiments of this application, such as Figure 3 As shown, the ultrasound imaging device consists of four parts: a probe, a front-end, a back-end, and a display. The front-end includes a transmitting circuit, a signal amplifier, a digital-to-analog converter (DAC), and beamforming. The back-end includes preprocessing filtering, a B-mode processing unit, a digital scan transformation, and an image processing unit. The front-end transmits a set of pulses, focused with delay, to the probe via the transmitting circuit, emitting ultrasound waves to the target fetus. After a delay, the probe receives the ultrasound echo reflected from the fetus and converts it into an electrical signal using piezoelectricity. This signal is amplified by the signal amplifier and then converted from analog to digital by the DAC. Finally, beamforming performs receiving / transmitting focusing. The back-end then uses signal processing to generate ultrasound images, including preprocessing filtering, a B-mode processing unit, digital scan transformation, and an image processing unit. After one or more complete scan cycles, the probe obtains one or more sets of ultrasound data represented in polar coordinates. The image processing unit then converts this polar coordinate data into rectangular coordinate data, which constitutes the multi-frame B-mode ultrasound images to be acquired.
[0127] S102. Based on multiple frames of B-mode ultrasound images, perform correlation calculation on the current ultrasound image to obtain the heart rate value of the target fetus. The current ultrasound image is the ultrasound image acquired at the current time among multiple frames of B-mode ultrasound images.
[0128] After the ultrasound imaging device acquires multiple frames of B-mode ultrasound images of the target fetus, it performs correlation calculations on the current ultrasound image based on these frames to obtain the fetal heart rate value. The current ultrasound image is the one acquired at the current time among the multiple B-mode ultrasound images. For example, if the ultrasound imaging device acquires multiple B-mode ultrasound images, the last acquired frame at the current time is the current ultrasound image. The correlation calculation for the current ultrasound image is mainly based on the variation range of all pixel values between the current ultrasound image and other ultrasound images, or simply on the variation range of pixel values within the region of interest. Generally, the larger the variation range of pixel values, the lower the correlation; conversely, the smaller the variation range, the higher the correlation. There are many ways for the ultrasound imaging device to determine the fetal heart rate value; several possible implementation methods are illustrated below:
[0129] In one possible implementation, the ultrasound imaging device determines a first ultrasound image from multiple frames of B-mode ultrasound images. The first ultrasound image is M frames of ultrasound images preceding the current ultrasound image, where M is an integer greater than 0. The first ultrasound image can be any of all ultrasound images preceding the current ultrasound image used to examine the target fetus; that is, all ultrasound images include all ultrasound images from the start of imaging the target fetus to the current ultrasound image. Alternatively, the first ultrasound image can be M frames of ultrasound images set according to a preset method, where M can be determined based on a preset heart rate cycle of the target fetus. For example, M can be the number of frames corresponding to one or more preset heart rate cycles. Of course, the first ultrasound image can also be the remaining ultrasound images within a preset heart rate cycle after removing ultrasound images without a region of interest preceding the current ultrasound image; the specific method is not limited here. Further, the ultrasound imaging device determines the correlation between each first ultrasound image and the current ultrasound image, and identifies the first ultrasound image with the highest correlation to the current ultrasound image as the second ultrasound image. The heart rate value is then determined based on the frame distance between the second ultrasound image and the current ultrasound image. For example, the pixel values of all first ultrasound images and the pixel values of the current ultrasound image are calculated and analyzed to obtain the correlation value between each first ultrasound image and the current ultrasound image. The first ultrasound image with the largest correlation value is taken as the second ultrasound image, and the heart rate value is determined according to the frame distance between the second ultrasound image and the current ultrasound image.
[0130] In one possible implementation, the ultrasound imaging device determines a first ultrasound image from multiple frames of B-mode ultrasound images, wherein the first ultrasound image is M frames of ultrasound images preceding the current ultrasound image, where M is determined based on a preset heart rate cycle of the target fetus. The first ultrasound image includes dynamically determined multiple first sub-ultrasound images and dynamically determined second sub-ultrasound images; the correlation between the multiple first sub-ultrasound images and the second sub-ultrasound images is determined; and the heart rate value is determined based on the average maximum correlation between each dynamically determined first sub-ultrasound image and each dynamically determined second sub-ultrasound image.
[0131] Since ultrasound imaging devices acquire B-mode ultrasound images in real time, the heart rate value can be calculated immediately after a specific ultrasound image is determined. For example, multiple B-mode ultrasound images are a1, a2, a3, a4, a5, a6, a7, a8, a9, and a10. Assuming the current ultrasound image is a10, the range of the current ultrasound image is determined based on the preceding ultrasound images. Assuming the range of the current ultrasound image is a8, a9, and a10, and following a preset method of 6 frames for maximum distance and 4 frames for minimum distance, all B-mode ultrasound images corresponding to a2 to a4 are designated as the first sub-ultrasound image, and a8 as the second sub-ultrasound image. That is, the ultrasound image with the maximum distance to a8 is a2, and the ultrasound image with the minimum distance is a4. The correlation between a2, a3, a4, and a8 is calculated. Continuing with the preset method of 6 frames for maximum distance and 4 frames for minimum distance, all B-mode ultrasound images corresponding to a3 to a5 are designated as the first sub-ultrasound image, and a9 as the second sub-ultrasound image. The images, i.e., the ultrasound image with the maximum distance to a9 is a3, and the ultrasound image with the minimum distance is a5, are used to calculate the correlation between a3, a4, a5 and a9 respectively. And so on, according to the preset method of the maximum distance frame being 6 frames and the minimum distance frame being 4 frames, all B-mode ultrasound images corresponding to a4 to a6 are determined as the first sub-ultrasound images, and a10 is the second sub-ultrasound image, i.e., the ultrasound image with the maximum distance to a10 is a4, and the ultrasound image with the minimum distance is a6, are used to calculate the correlation between a4, a5, a6 and a10 respectively. Then, the correlation values of a2 and a8, a3 and a9, and a4 and a10 are summed and averaged to obtain the first mean. The correlation values of a3 and a8, a4 and a9, and a5 and a10 are summed and averaged to obtain the second mean. The correlation values of a4 and a8, a5 and a9, and a6 and a10 are summed and averaged to obtain the third mean. The largest mean is selected from the first, second, and third means, and the corresponding frame distance is obtained based on this largest mean. The heart rate value is determined based on this frame distance. There are many ways to determine the frame distance, one of which can be based on a preset formula. For example, the frame distance Nhr is equal to the sum of the index NS of the current largest mean position, the minimum distance frame N_min, and the quantity 1, i.e., Nhr = NS + Nmin + 1. In the above example, assuming the second mean is the largest mean, then Nhr = 2 + 4 + 1 = 7.
[0132] In one possible implementation, the ultrasound imaging device uses a preset positioning method to determine an ultrasound image containing a region of interest (ROI) from multiple frames of B-mode ultrasound images. The ROI includes the entire fetal heart structure of the target fetus. A first ultrasound image is then determined from the images containing the ROI. This first ultrasound image can be any of all ultrasound images preceding the current ultrasound image, i.e., all ultrasound images from the start of imaging the target fetus to the current ultrasound image. The first ultrasound image can also be M frames of ultrasound images set according to a preset method, where M is an integer greater than 0. M can be determined based on a preset heart rate cycle of the target fetus; for example, M can be one preset heart rate cycle or the number of frames corresponding to multiple preset heart rate cycles, without specific limitations here. Further, the correlation between the ROI of the first ultrasound image and the ROI of the current ultrasound image is determined, and the first ultrasound image with the highest correlation to the ROI of the current ultrasound image is determined as the second ultrasound image. The heart rate value is determined based on the frame distance between the second ultrasound image and the current ultrasound image.
[0133] The process of determining the fetal heart rate value will be explained in detail below, taking the first ultrasound image as an example, which can be an M-frame ultrasound image from the N_min frame to the N_max frame of the current ultrasound image.
[0134] In this embodiment of the application, the formula for calculating the heart rate cycle using the ultrasound imaging device is formula (1).
[0135] N = 60 x fr / h (1)
[0136] Where N is the heart rate cycle, h is the target fetal heart rate, and fr is the frame rate corresponding to the current ultrasound image. fr can be preset by the ultrasound imaging device. When the ultrasound imaging device determines N_min, h_max is generally set to 180 beats / minute; when the ultrasound imaging device determines N_max, h_min is generally set to 100 beats / minute.
[0137] As can be seen, the ultrasound imaging device calculates the correlation between the current ultrasound image and the first ultrasound image based on the region of interest of the current ultrasound image and the region of interest of the first ultrasound image, wherein the region of interest includes all fetal heart structures of the target fetus; or, the ultrasound imaging device calculates the correlation between the current ultrasound image and the first ultrasound image based on the global image of the current ultrasound image and the global image of the first ultrasound image. The specific choice is made according to the actual situation, and the embodiments of this application do not impose specific limitations.
[0138] For example, such as Figure 4As shown, the d-th frame ultrasound image is the current ultrasound image, and the image frame segment between N_min and N_max is the first ultrasound image. The ultrasound imaging device sequentially calculates the correlation between each frame in the image frame segment between N_min and N_max and the d-th frame.
[0139] In this embodiment of the application, the method for the ultrasound imaging device to determine the region of interest from multiple frames of B-mode ultrasound images is as follows: the ultrasound imaging device uses a preset machine learning algorithm to train preset ultrasound image data; then, based on the training results, the ultrasound imaging device sequentially performs feature matching on multiple frames of B-mode ultrasound images to determine the ultrasound images containing the region of interest from the multiple frames of B-mode ultrasound images.
[0140] In this embodiment of the application, the process of the ultrasound imaging device determining the heart rate value based on the frame distance between the second ultrasound image and the current ultrasound image is as follows: the frame distance between the second ultrasound image and the current ultrasound image is the target fetal heart rate cycle N, and then the heart rate value h is calculated using formula (2).
[0141] h = 60 x fr / N (2)
[0142] Furthermore, before the ultrasound imaging device performs correlation calculations on the current ultrasound image based on multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus, the ultrasound imaging device first determines whether the current ultrasound image meets the preset heart rate display conditions. Only when it is determined that the current ultrasound image meets the preset heart rate display conditions does the ultrasound imaging device perform correlation calculations on the current ultrasound image based on multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus.
[0143] S103 displays the heart rate value and the current ultrasound image.
[0144] After the ultrasound imaging device obtains the heart rate value of the target fetus, it displays the heart rate value on the ultrasound device interface and also displays the current ultrasound image on the ultrasound device interface. The heart rate value and the current ultrasound image can be displayed on the same interface or on different interfaces. The heart rate value can be displayed on the current ultrasound image or in other areas outside the current ultrasound image. No specific limitation is made here.
[0145] In some possible implementations, the heart rate value can be directly displayed on the current ultrasound image. For example, it can be displayed in the upper left or upper right corner of the current ultrasound image where there is no region of interest, and displayed using a color such as white that is different from the current ultrasound image.
[0146] Optionally, the ultrasound imaging device marks a region of interest (ROI) of the target fetus in the current ultrasound image, wherein the ROI includes all fetal heart structures of the target fetus; according to a first font parameter, the ultrasound imaging device displays the heart rate value in the current ultrasound image, wherein the first font parameter includes at least one of font, font size, and color. For example, the ROI can be marked by a black or white rectangle or other shape, and the heart rate value can be labeled by white numbers, or numbers or letters of other colors.
[0147] Optionally, the ultrasound imaging device generates a heart rate trend graph based on the heart rate value. The heart rate trend graph represents the trend of heart rate value change corresponding to each current ultrasound image. The heart rate trend graph includes at least one of an amplitude trend graph and a sine wave diagram. The ultrasound imaging device displays the heart rate trend graph in the current ultrasound image. Of course, the heart rate trend graph can also be a cosine wave diagram or other diagrams used to represent the trend of heart rate change; no specific limitation is made here.
[0148] Optionally, the ultrasound imaging device acquires the duration of each heartbeat based on the heart rate value; the ultrasound imaging device uses the heartbeat duration to simulate the process of heartbeat; the ultrasound imaging device dynamically displays the simulated heartbeat pattern in the current ultrasound image. For example, the heartbeat pattern can be simulated by the degree of expansion of a heart, which can represent both the magnitude of the heart rate and the direction of the heartbeat.
[0149] Specifically, the ultrasound imaging device dynamically displays a simulated heartbeat pattern in the current ultrasound image as follows: the ultrasound imaging device displays a simulated heartbeat device in the current ultrasound image, which is used to simulate the heartbeat pattern; the ultrasound imaging device plays the sound effect of the heartbeat. That is, the sound effect of the heartbeat can be played through an audio player.
[0150] In this embodiment of the application, a speaker is installed on or near the display screen of the ultrasound imaging device. The speaker can announce the heart rate value, or when the ultrasound imaging device determines that the heart rate value exceeds the preset heart rate range, the speaker of the ultrasound imaging device will emit an alarm sound to remind the user.
[0151] In this embodiment, the ultrasound imaging device displays a preset heart rate range in the current ultrasound image; when it is determined that the heart rate value exceeds the preset heart rate range, the ultrasound imaging device provides an alarm reminder by emitting an alarm sound or displaying a fluctuating heart rate value.
[0152] Understandably, ultrasound imaging devices use B-mode ultrasound to examine the heart rate of the target fetus. Specifically, the ultrasound imaging device acquires multiple frames of B-mode ultrasound images, performs correlation calculations on the current ultrasound images, and then automatically calculates and displays the heart rate value of the target fetus, which can greatly improve the speed and accuracy of displaying the fetal heart rate value.
[0153] This application provides a method for displaying fetal heart rate in B-mode ultrasound images, such as... Figure 5 As shown, the method may include:
[0154] S201. The ultrasound imaging device acquires multiple frames of B-mode ultrasound images of the target fetus.
[0155] The fetal heart rate display method provided in this application embodiment is applicable to scenarios where fetal heart rate is automatically measured and displayed based on a global image of B-mode ultrasound images.
[0156] Here, the description of S201 in this embodiment is the same as that of S101, and will not be repeated here.
[0157] S202. The ultrasound imaging device determines whether the current ultrasound image meets the preset heart rate display conditions.
[0158] After the ultrasound imaging device acquires multiple frames of B-mode ultrasound images of the target fetus, the ultrasound imaging device determines whether the current ultrasound image meets the preset heart rate display conditions.
[0159] In one possible implementation, the ultrasound imaging device determines whether the number of first frames in the third ultrasound image meets a first preset frame count, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, where N is an integer greater than 0. The third ultrasound image can be any ultrasound image preceding the current ultrasound image, or it can be an ultrasound image determined according to a preset method, i.e., determined based on a preset heart rate cycle of the target fetus, or it can be randomly set, etc. The third ultrasound image can be completely identical or partially identical to the first ultrasound image; no specific limitation is made here. When the number of first frames meets the first preset frame count, the ultrasound imaging device searches for ultrasound images in the third ultrasound image whose correlation with the current ultrasound image is higher than a preset threshold. The ultrasound imaging device then determines whether the number of second frames of these ultrasound images whose correlation with the current ultrasound image is higher than the preset threshold meets a second preset frame count. When the number of second frames meets the second preset frame count, the ultrasound imaging device determines that the current ultrasound image meets the preset heart rate display conditions.
[0160] In this embodiment of the application, the first preset number of frames is C average heart rate cycles, that is, the image frame segment that is greater than or equal to C average heart rate cycles before the current ultrasound image. The image frame segment includes a third ultrasound image. The third ultrasound image can be M ultrasound images from the N_min frame to the N_max frame of the current ultrasound image. Generally, C is 3 or 4. When calculating the average heart rate cycle using formula (1), h is taken as the average heart rate value of a normal fetus, which is 150 beats / minute.
[0161] In this embodiment of the application, the ultrasound imaging device uses formula (1) to determine the starting N_min frame and the ending N_max frame of the third ultrasound image. When the ultrasound imaging determines N_min, h_max is generally taken as 180 times / minute; when the ultrasound imaging device determines N_max, h_min is generally taken as 100 times / minute.
[0162] In this embodiment of the application, after the ultrasound imaging device calculates the number of first frames between the N_min frame and the N_max frame, it compares the number of first frames with the number of first preset frames. When the number of first frames is greater than or equal to the number of first preset frames, the ultrasound imaging device searches for ultrasound images in the third ultrasound image whose correlation with the current ultrasound image is higher than a preset threshold.
[0163] In this embodiment, the ultrasound imaging device sequentially calculates the correlation between the current ultrasound image and the first ultrasound image, and sequentially compares the correlation between the current ultrasound image and the third ultrasound image with a preset threshold. Then, from the third ultrasound image, it determines the number of second frames of ultrasound images whose correlation with the current ultrasound image is higher than the preset threshold. After that, the ultrasound imaging device compares the number of second frames with the second preset number of frames. When it is determined that the number of second frames is greater than or equal to the second preset number of frames, the ultrasound imaging device determines that the current ultrasound image meets the preset heart rate display conditions.
[0164] S203. When the ultrasound imaging device determines that the current ultrasound image meets the preset heart rate display conditions, the ultrasound imaging device determines the first ultrasound image from multiple frames of B-mode ultrasound images, wherein the first ultrasound image is the M frames of ultrasound images preceding the current ultrasound image, and M is determined according to the preset heart rate cycle of the target fetus.
[0165] Optionally, M can be all the frames preceding the current ultrasound image, or the number of frames corresponding to one or more heart rate cycles. The specific choice depends on the actual situation, and this application embodiment does not impose any specific limitations.
[0166] In this embodiment of the application, if the third ultrasound image is exactly the same as the first ultrasound image, when the ultrasound imaging device determines that the number of the first frames of the third ultrasound image meets the first preset number of frames, the first ultrasound image is determined from the multiple frames of B-mode ultrasound images. Here, the ultrasound imaging device calls the third ultrasound image determined during the determination.
[0167] Of course, in one possible implementation, the ultrasound imaging device uses the number of frames corresponding to all ultrasound images preceding the current ultrasound image as the first frame count. When the first frame count meets a first preset frame count, it searches for ultrasound images among all ultrasound images preceding the current ultrasound image whose correlation with the current ultrasound image is higher than a preset threshold. It then determines whether the second frame count of these ultrasound images with a correlation higher than the preset threshold meets a second preset frame count. If the first frame count meets the second preset frame count, it is determined that the current ultrasound image meets a preset heart rate display condition. Further, a first ultrasound image is determined from all ultrasound images preceding the current ultrasound image, and a correlation calculation is performed on this first ultrasound image. It should be noted that the third ultrasound image may include all or part of the first ultrasound images; correspondingly, the first ultrasound image may include all or part of the third ultrasound images; no specific limitation is made here.
[0168] Specifically, the first ultrasound image can be M ultrasound images preceding the current ultrasound image, from frame N_min to frame N_max of the current ultrasound image. The ultrasound imaging device uses formula (1) to determine the starting frame N_min and the ending frame N_max of the first ultrasound image. When ultrasound imaging determines N_min, h_max is generally taken as 180 times / minute; when ultrasound imaging device determines N_max, h_min is generally taken as 100 times / minute.
[0169] S204. The ultrasound imaging device determines the correlation between the first ultrasound image and the current ultrasound image.
[0170] After the ultrasound imaging device determines the first ultrasound image from multiple frames of B-mode ultrasound images, the ultrasound imaging device determines the correlation between the first ultrasound image and the current ultrasound image.
[0171] In this embodiment of the application, when the ultrasound imaging device searches for an ultrasound image whose correlation with the current ultrasound image is higher than a preset threshold, it calculates the correlation between the first ultrasound image and the current ultrasound image. Here, the ultrasound imaging device calls the correlation between the first ultrasound image and the current ultrasound image calculated during the search.
[0172] The specific method for calculating the correlation is as follows: the ultrasound imaging device sequentially multiplies the pixel matrix of the current ultrasound image and the pixel matrix of the first ultrasound image and adds them together to obtain a set of values, which represent the correlation between the current ultrasound image and the first ultrasound image.
[0173] It should be noted that when calculating the correlation between ultrasound images, the current ultrasound image and the first ultrasound image need to be the same size. That is, the ultrasound imaging device needs to acquire the current ultrasound image and the first ultrasound image using the same shooting parameters, or the ultrasound imaging device needs to determine a global image or region of interest with the same position and size from the current ultrasound image and the first ultrasound image for correlation calculation. The specific choice depends on the actual situation, and this application embodiment does not make specific limitations.
[0174] S205. The ultrasound imaging device determines the first ultrasound image, which has the highest correlation with the current ultrasound image, as the second ultrasound image.
[0175] Once the ultrasound imaging device determines the correlation between the first ultrasound image and the current ultrasound image, the ultrasound imaging device will identify the first ultrasound image, which has the highest correlation with the current ultrasound image, as the second ultrasound image.
[0176] In this embodiment of the application, the ultrasound imaging device searches for the second ultrasound image that has the highest correlation with the current ultrasound image from the first ultrasound image.
[0177] In this embodiment of the application, the ultrasound imaging device searches for the maximum value from a set of values and determines the ultrasound image corresponding to the maximum value as the second ultrasound image with the highest correlation to the current ultrasound image.
[0178] S206. The ultrasound imaging device determines the heart rate value based on the frame distance between the second ultrasound image and the current ultrasound image.
[0179] After the ultrasound imaging device determines the second ultrasound image, it determines the heart rate value based on the frame distance between the second ultrasound image and the current ultrasound image.
[0180] In this embodiment of the application, the ultrasound imaging device determines the frame distance between the second ultrasound image and the current ultrasound image as the target fetal heart rate cycle N, and then calculates the heart rate value h using formula (2).
[0181] S207, The ultrasound imaging device displays the heart rate value and the current ultrasound image.
[0182] Once the ultrasound imaging device determines the heart rate value, it displays the heart rate value and the current ultrasound image. The heart rate value can be displayed in the current ultrasound image or in other areas outside the current ultrasound image.
[0183] Optionally, the ultrasound imaging device marks the region of interest of the target fetus in the current ultrasound image, wherein the region of interest includes all fetal heart structures of the target fetus; and the ultrasound imaging device displays the heart rate value in the current ultrasound image according to a first font parameter, wherein the first font parameter includes at least one of font, font size, and color.
[0184] For example, the text containing heart rate information, such as “Heart Rate: 144 beats / minute”, “Fetal Heart Rate: 144 / min”, “FHR: 144 / MIN”, etc., is clearly displayed on the monitor in an appropriate color and font, either alone or in combination, in Chinese, English or other languages.
[0185] For example, such as Figure 6 As shown, the fetal heart position is marked in the two-dimensional B-mode ultrasound image, and "Heart rate: 144 beats / minute" is displayed.
[0186] Optionally, the ultrasound imaging device generates an amplitude trend graph based on the heart rate value, which represents the trend of heart rate value change corresponding to each current ultrasound image; the ultrasound imaging device displays the amplitude trend graph in the current ultrasound image.
[0187] For example, such as Figure 7 As shown, the fetal heart position is marked in a two-dimensional B-mode ultrasound image, and an amplitude trend graph is displayed. The horizontal axis represents the time direction, i.e., the reading direction of the image frame, and the vertical axis represents the amplitude value of the heart rate. Of course, the ultrasound imaging device can also generate various heart rate trend graphs, such as cosine wave diagrams or sine wave diagrams, based on the heart rate value; no specific limitation is made here.
[0188] Optionally, the ultrasound imaging device obtains the duration of each heartbeat based on the heart rate value; the ultrasound imaging device uses the heartbeat duration to simulate the process of heartbeat; the ultrasound imaging device dynamically displays the simulated heartbeat pattern in the current ultrasound image.
[0189] Specifically, the ultrasound imaging device dynamically displays the simulated heartbeat pattern in the current ultrasound image as follows: the ultrasound imaging device displays a simulated heartbeat device in the current ultrasound image, which is used to simulate the heartbeat pattern; the ultrasound imaging device plays the sound effect of the heartbeat.
[0190] For example, a dynamic sine wave diagram is displayed at a suitable position on the monitor. The amplitude value of the dynamic sine wave diagram is a preset fixed value, and the period is the heart rate value or a value proportional to the heart rate value. A ball-like marker is displayed on the sine wave segment, moving along the waveform from sin0° and reaching sin360° after exactly one heart rate cycle frame; or the above process is accomplished by gradually coloring the line segment. Similarly, the dynamic sine wave diagram can also use the period as a preset fixed value and the amplitude value as proportional to the heart rate value to draw the sine wave segment diagram. This application embodiment does not impose specific limitations.
[0191] In this embodiment of the application, a speaker is installed on or near the display screen of the ultrasound imaging device. The speaker can announce the heart rate value, or when the ultrasound imaging device determines that the heart rate value exceeds the preset heart rate range, the speaker of the ultrasound imaging device will emit an alarm sound to remind the user.
[0192] In this embodiment of the application, the ultrasound imaging device displays a preset heart rate range in the current ultrasound image; when it is determined that the heart rate value exceeds the preset heart rate range, the ultrasound imaging device uses a preset display method to issue an alarm reminder, wherein the preset display method includes at least one of emitting an alarm sound, displaying the heart rate value in a jumping manner, and changing the color or font of the heart rate value.
[0193] For example, upper and lower limit warning values can be added to all displayed heart rate values and amplitude trend charts, using red or other obvious colors to indicate the range of normal heart rate values.
[0194] For example, an alarm sound can be emitted by vibrating a buzzer, or the heart rate value can be displayed in a jumping manner, such as the heart rate value changing dynamically. Of course, while the heart rate value is changing dynamically, at least one of the heart rate values, such as color or font, can also change.
[0195] Furthermore, when the ultrasound imaging device determines that the number of first frames of the third ultrasound image does not meet the first preset number of frames, or when the number of first frames meets the first preset number of frames and no ultrasound image with a correlation higher than the preset threshold is found, the ultrasound imaging device displays the current ultrasound image.
[0196] For example, such as Figure 8 As shown, the ultrasound imaging device displays a two-dimensional B-mode ultrasound image.
[0197] Furthermore, when the ultrasound imaging device determines that the number of second frames of ultrasound images with a correlation higher than a preset threshold to the current ultrasound image does not meet the second preset number of frames, the ultrasound imaging device marks the current region of interest in the current ultrasound image.
[0198] For example, such as Figure 9 As shown, the fetal heart region is delineated by a black dashed rectangle in a two-dimensional B-mode ultrasound image using an ultrasound imaging device. Of course, the current fetal heart region can also be marked in other ways, such as by marking it in pseudo-color, etc., which are not specifically limited here.
[0199] For example, such as Figure 10 As shown, the process by which the ultrasound imaging device calculates and displays the fetal heart rate based on global data from B-mode ultrasound images is as follows:
[0200] 1. The ultrasound imaging device acquires and stores two-dimensional B-mode ultrasound images frame by frame;
[0201] 2. The ultrasound imaging device determines whether the current ultrasound image meets the preset heart rate display conditions;
[0202] 3. When the ultrasound imaging device determines that the current ultrasound image meets the preset heart rate display conditions, the ultrasound imaging device calculates the fetal heart rate based on the current ultrasound image.
[0203] 4. The ultrasound imaging device can be customized to display the current ultrasound image and fetal heart rate;
[0204] 5. When the ultrasound imaging device determines that the current ultrasound image does not meet the preset heart rate display conditions, the ultrasound imaging device will display the current ultrasound image in a custom way.
[0205] 6. The ultrasound imaging device determines whether multiple frames of B-mode ultrasound images have been read.
[0206] 7. The process ends when reading is complete;
[0207] 8. Continue execution 1 if the reading is not complete.
[0208] Understandably, ultrasound imaging devices use B-mode ultrasound to examine the heart rate of the target fetus. The specific ultrasound imaging device performs a quality evaluation on the current ultrasound image. Based on the quality evaluation result, the ultrasound imaging device decides whether to display the fetal heart rate value on the instrument interface. When the current ultrasound image passes the quality evaluation, the ultrasound imaging device performs correlation calculations on the current ultrasound image based on the acquired multiple frames of B-mode ultrasound images, and then automatically calculates and displays the heart rate value of the target fetus, which can greatly improve the speed and accuracy of displaying the fetal heart rate value.
[0209] This application provides a method for displaying fetal heart rate in B-mode ultrasound images, such as... Figure 11 As shown, the method may include:
[0210] S301, The ultrasound imaging device acquires multiple frames of B-mode ultrasound images of the target fetus.
[0211] The method for displaying fetal heart rate in B-mode ultrasound images provided in this application is applicable to scenarios where fetal heart rate is automatically measured and displayed based on fetal heart region images from B-mode ultrasound images.
[0212] Here, the description of S301 in this embodiment is consistent with the description of S101, and will not be repeated here.
[0213] S302. The ultrasound imaging device determines whether the number of the first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0.
[0214] After the ultrasound imaging device acquires multiple frames of B-mode ultrasound images of the target fetus, the ultrasound imaging device determines whether the number of the first frames of the third ultrasound image preceding the current ultrasound image meets the first preset number of frames.
[0215] Optionally, N can be the number of all frames preceding the current ultrasound image, or the number of frames corresponding to one or more heart rate cycles. The specific choice depends on the actual situation, and this application embodiment does not impose any specific limitations.
[0216] In this embodiment of the application, the first preset number of frames is C average heart rate cycles, that is, the image frame segment that is greater than or equal to C average heart rate cycles before the current ultrasound image. The image frame segment includes a third ultrasound image, which is an M-frame ultrasound image from the N_min frame to the N_max frame of the current ultrasound image. Generally, C is 3 or 4, and when calculating the average heart rate cycle using formula (1), h is taken as the average heart rate value of a normal fetus, which is 150 beats / minute.
[0217] In this embodiment of the application, the ultrasound imaging device uses formula (1) to determine the starting N_min frame and the ending N_max frame of the third ultrasound image. When the ultrasound imaging determines N_min, h_max is generally taken as 180 times / minute; when the ultrasound imaging device determines N_max, h_min is generally taken as 100 times / minute.
[0218] In this embodiment of the application, after the ultrasound imaging device calculates the number of first frames between the N_min frame and the N_max frame, it compares the number of first frames with the number of first preset frames.
[0219] S303. When the number of first frames meets the first preset number of frames, the ultrasound imaging device determines whether to locate the region of interest from the current ultrasound image.
[0220] After the ultrasound imaging device determines whether the number of first frames of the third ultrasound image meets the first preset number of frames, the ultrasound imaging device determines whether to locate the region of interest from the current ultrasound image when it determines that the number of first frames meets the first preset number of frames.
[0221] In this embodiment, the ultrasound imaging device acquires the matching value corresponding to the region of interest in the current ultrasound image; when the ultrasound imaging device determines that the matching value meets the preset matching threshold, it indicates that the region of interest has been located from the current ultrasound image; when the ultrasound imaging device determines that the matching value does not meet the preset matching threshold, it indicates that the region of interest has not been located from the current ultrasound image.
[0222] In this embodiment of the application, the ultrasound imaging device uses a preset machine learning algorithm to locate the region of interest from the current ultrasound image.
[0223] Specifically, such as Figure 12 As shown, the ultrasound imaging device identifies regions of interest (ROIs) in three steps: 1. Acquire B-mode ultrasound images; 2. Construct a database containing multiple B-mode ultrasound images and corresponding ROI calibration results. The ROI calibration results can be set according to actual task requirements, and can be either a bounding box containing the fetal heart or a mask that precisely segments the fetal heart; 3. Localization and recognition, which involves using machine learning algorithms to learn the features or patterns in the database that can distinguish between ROIs and non-ROIs to achieve the identification and localization of ROIs in B-mode ultrasound images.
[0224] Optionally, the preset machine learning algorithms include: sliding window-based methods, deep learning-based bounding-box methods, deep learning-based end-to-end semantic segmentation network methods, and methods that use the above methods to label regions of interest and design classifiers to classify and judge regions of interest based on the labeling results. The specific selection is made according to the actual situation, and this application embodiment does not make specific limitations.
[0225] Specifically, the sliding window-based method is as follows: First, feature extraction is performed on the region within the sliding window. Feature extraction methods can be traditional PCA, LDA, Haar features, texture features, etc., or deep neural networks can be used for feature extraction. Then, the extracted features are matched with the database, and discriminators such as KNN, SVM, random forest, and neural networks are used for classification to determine whether the current sliding window is a region of interest and to obtain its corresponding category.
[0226] Specifically, deep learning-based bounding-box methods involve learning features and regressing parameters on a constructed database by stacking convolutional and fully connected layers. For an input B-type image, the network can directly regress the bounding box of the corresponding region of interest, while simultaneously obtaining the category of the tissue structure within that region. Common networks used in this approach include R-CNN, Fast R-CNN, Faster R-CNN, SSD, and YOLO.
[0227] Specifically, end-to-end semantic segmentation network methods based on deep learning involve learning features and regressing parameters on a constructed database by stacking convolutional layers, upsampling layers, or deconvolutional layers. For an input image, the network can directly regress the bounding box of the corresponding region of interest. By adding upsampling or deconvolutional layers, the input and output sizes are made the same, thus directly obtaining the region of interest and its corresponding category of the input image. Common networks include FCN, U-Net, and Mask R-CNN.
[0228] Specifically, in the process of labeling the region of interest using the above method and designing a classifier based on the labeling results to classify and judge the region of interest, the method for classifying and judging the target is to use discriminators such as KNN, SVM, random forest, and neural networks for classification.
[0229] It should be noted that if the fetal heart rate is not located within the effective sector area of the image, or only part of the fetal heart rate is located within the effective sector area of the image, or the entire fetal heart rate is located within the effective sector area of the image but some of it is obscured, the fetal heart rate data may be unavailable. In such cases, the ultrasound imaging device may not be able to successfully locate or segment the region of interest.
[0230] For example, such as Figure 13 The image shown is a schematic diagram of the automatic positioning effect of the fetal heart region. The ultrasound imaging device positions the fetal heart region as XR*YR in a two-dimensional B-mode ultrasound image.
[0231] In this embodiment of the application, when the ultrasound imaging device uses a machine learning method to locate the region of interest in the current ultrasound image, it outputs the matching value corresponding to the current ultrasound image.
[0232] S304. When the ultrasound imaging device determines that a region of interest has been located in the current ultrasound image, the ultrasound imaging device searches for ultrasound images in the third ultrasound image whose correlation with the region of interest in the current ultrasound image is higher than a preset threshold, and determines whether the number of second frames of ultrasound images whose correlation with the region of interest in the current ultrasound image is higher than the preset threshold meets the second preset number of frames.
[0233] After the ultrasound imaging device determines whether a region of interest has been located in the current ultrasound image, when the ultrasound imaging device determines that a region of interest has been located in the current ultrasound image, it searches for ultrasound images in the third ultrasound image whose correlation with the region of interest in the current ultrasound image is higher than a preset threshold, and determines whether the number of second frames of ultrasound images whose correlation with the region of interest in the current ultrasound image is higher than the preset threshold meets the second preset number of frames.
[0234] In this embodiment, the ultrasound imaging device sequentially calculates the correlation between the region of interest (ROI) of the current ultrasound image and the ROI of the third ultrasound image, and sequentially compares the correlation between the ROI of the current ultrasound image and the ROI of the third ultrasound image with a preset threshold. Then, it determines the number of second frames of ultrasound images from the first ultrasound image whose correlation with the ROI of the current ultrasound image is higher than the preset threshold. After that, the ultrasound imaging device compares the number of second frames with the second preset number of frames.
[0235] Specifically, the method by which the ultrasound imaging device sequentially calculates the correlation between the region of interest (ROI) of the current ultrasound image and the ROI of the third ultrasound image is as follows: The ultrasound imaging device sequentially determines ROIs of the same size from the current and third ultrasound images. Then, it sequentially multiplies the pixel matrix of the ROI in the current ultrasound image and the pixel matrix of the ROI in the third ultrasound image, and adds them together to obtain a set of values. This set of values represents the correlation between the ROI of the current ultrasound image and the ROI of the third ultrasound image. The method for calculating the correlation between the first ultrasound image and the current ultrasound image is the same or similar, and will not be elaborated here.
[0236] Specifically, the ultrasound imaging device identifies ultrasound images from this set of values that have values greater than a preset threshold. These ultrasound images are those whose correlation with the region of interest of the current ultrasound image is higher than the preset threshold.
[0237] It should be noted that due to fetal heart movement, improper scanning by the operator, or the fetus turning to the side, the correlation between the region of interest in the current ultrasound image and the region of interest in the third ultrasound image may be lower than the preset threshold.
[0238] Optionally, the preset threshold is typically set to 0.7 or 0.75.
[0239] Optionally, the number of the second preset frames is typically 0.8 or 0.9 times the number of the first frames.
[0240] S305. When the number of second frames meets the second preset number of frames, the ultrasound imaging device determines that the current ultrasound image meets the preset heart rate display conditions.
[0241] When the ultrasound imaging device determines whether the number of second frames of an ultrasound image whose correlation with the region of interest of the current ultrasound image is higher than a preset threshold meets the second preset frame count, the ultrasound imaging device determines that the current ultrasound image meets the preset heart rate display conditions when it determines that the number of second frames meets the second preset frame count.
[0242] In this embodiment of the application, when the ultrasound imaging device determines that the number of the second frame is greater than or equal to the number of the second preset frame, the ultrasound imaging device determines that the current ultrasound image meets the preset heart rate display conditions.
[0243] In one possible implementation, the ultrasound imaging device determines whether the number of first frames in the third ultrasound image meets a first preset frame count, where the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0. When the number of first frames meets the first preset frame count, ultrasound images containing a region of interest are identified within the third ultrasound image, and it is determined whether the number of third frames containing the region of interest meets the third preset frame count. When the number of third frames meets the third preset frame count, the current ultrasound image is determined to meet a preset heart rate display condition. This third frame count is a multiple of the first frame count, for example, 0.9 times. It is understood that the third ultrasound image must contain a certain number of regions of interest to meet the preset heart rate display condition.
[0244] S306. The ultrasound imaging device uses a preset positioning method to determine the ultrasound image containing the region of interest from multiple frames of B-mode ultrasound images, wherein the region of interest includes all fetal heart structures of the target fetus.
[0245] Once the ultrasound imaging device determines that the current ultrasound image meets the preset heart rate display conditions, the ultrasound imaging device uses a preset positioning method to identify the ultrasound image containing the region of interest from multiple frames of B-mode ultrasound images.
[0246] In this embodiment, the ultrasound imaging device uses a preset machine learning algorithm to train preset ultrasound image data; then, based on the training results, it sequentially performs feature matching on multiple frames of B-mode ultrasound images to determine ultrasound images containing regions of interest from the multiple frames of B-mode ultrasound images.
[0247] In one possible implementation, determining the ultrasound image containing the region of interest from multiple frames of B-mode ultrasound images includes: training a preset ultrasound image data set, and performing feature matching on the multiple frames of B-mode ultrasound images sequentially based on the training results, so as to determine the ultrasound image containing the region of interest from the multiple frames of B-mode ultrasound images.
[0248] In one possible implementation, determining the ultrasound image containing the region of interest from multiple B-mode ultrasound images includes: performing feature learning on preset ultrasound image data, and predicting the multiple B-mode ultrasound images sequentially based on the learning results to determine the ultrasound image containing the region of interest from the multiple B-mode ultrasound images.
[0249] In the embodiments of this application, such as Figure 12As shown, the ultrasound imaging device identifies regions of interest (ROIs) in three steps: 1. Acquire B-mode ultrasound images; 2. Construct a database containing multiple B-mode ultrasound images and corresponding ROI calibration results. The ROI calibration results can be set according to actual task requirements, and can be either a bounding box containing the fetal heart or a mask that precisely segments the fetal heart; 3. Localization and recognition, which involves using machine learning algorithms to learn the features or patterns in the database that can distinguish between ROIs and non-ROIs to achieve the identification and localization of ROIs in B-mode ultrasound images.
[0250] Optionally, the preset machine learning algorithms include: sliding window-based methods, deep learning-based bounding-box methods, deep learning-based end-to-end semantic segmentation network methods, and methods that use the above methods to label regions of interest and design classifiers to classify and judge regions of interest based on the labeling results. The specific selection is made according to the actual situation, and this application embodiment does not make specific limitations.
[0251] Specifically, the sliding window-based method is as follows: First, feature extraction is performed on the region within the sliding window. Feature extraction methods can be traditional PCA, LDA, Haar features, texture features, etc., or deep neural networks can be used for feature extraction. Then, the extracted features are matched with the database, and discriminators such as KNN, SVM, random forest, and neural networks are used for classification to determine whether the current sliding window is a region of interest and to obtain its corresponding category.
[0252] Specifically, deep learning-based bounding-box methods involve learning features and regressing parameters on a constructed database by stacking convolutional and fully connected layers. For an input B-type image, the network can directly regress the bounding box of the corresponding region of interest, while simultaneously obtaining the category of the tissue structure within that region. Common networks used in this approach include R-CNN, Fast R-CNN, Faster R-CNN, SSD, and YOLO.
[0253] Specifically, end-to-end semantic segmentation network methods based on deep learning involve learning features and regressing parameters on a constructed database by stacking convolutional layers, upsampling layers, or deconvolutional layers. For an input image, the network can directly regress the bounding box of the corresponding region of interest. By adding upsampling or deconvolutional layers, the input and output sizes are made the same, thus directly obtaining the region of interest and its corresponding category of the input image. Common networks include FCN, U-Net, and Mask R-CNN.
[0254] Specifically, in the process of labeling the region of interest using the above method and designing a classifier based on the labeling results to classify and judge the region of interest, the method for classifying and judging the target is to use discriminators such as KNN, SVM, random forest, and neural networks for classification.
[0255] S307. The ultrasound imaging device determines a first ultrasound image from ultrasound images containing a region of interest, wherein the first ultrasound image is an M-frame ultrasound image preceding the current ultrasound image, and M is determined based on a preset heart rate cycle of the target fetus.
[0256] After the ultrasound imaging device determines the ultrasound image containing the region of interest from multiple frames of B-mode ultrasound images, the ultrasound imaging device determines the first ultrasound image from the ultrasound image containing the region of interest.
[0257] Specifically, the first ultrasound image can be M ultrasound images preceding the current ultrasound image, from frame N_min to frame N_max of the current ultrasound image. The ultrasound imaging device uses formula (1) to determine the starting frame N_min and the ending frame N_max of the first ultrasound image. When ultrasound imaging determines N_min, h_max is generally taken as 180 times / minute; when ultrasound imaging device determines N_max, h_min is generally taken as 100 times / minute.
[0258] S308. The ultrasound imaging device determines the correlation between the region of interest of the first ultrasound image and the region of interest of the current ultrasound image.
[0259] After the ultrasound imaging device determines the first ultrasound image from ultrasound images containing a region of interest, the ultrasound imaging device determines the correlation between the region of interest of the first ultrasound image and the region of interest of the current ultrasound image.
[0260] In this embodiment of the application, when the ultrasound imaging device searches for an ultrasound image whose correlation with the region of interest of the current ultrasound image is higher than a preset threshold, it sequentially calculates the correlation between the region of interest of the first ultrasound image and the region of interest of the current ultrasound image. When the third ultrasound image includes all of the first ultrasound images, the ultrasound imaging device calls the correlation between the region of interest of the first ultrasound image and the region of interest of the current ultrasound image calculated during the search.
[0261] S309. The ultrasound imaging device determines the first ultrasound image, which has the highest correlation with the region of interest of the current ultrasound image, as the second ultrasound image.
[0262] After the ultrasound imaging device determines the correlation between the region of interest of the first ultrasound image and the region of interest of the current ultrasound image, the ultrasound imaging device determines the first ultrasound image, which has the highest correlation with the region of interest of the current ultrasound image, as the second ultrasound image.
[0263] In this embodiment of the application, the ultrasound imaging device searches for a second ultrasound image from the first ultrasound image that has the highest correlation with the region of interest of the current ultrasound image.
[0264] S310, The ultrasound imaging device determines the heart rate value based on the frame distance between the second ultrasound image and the current ultrasound image.
[0265] After the ultrasound imaging device identifies the first ultrasound image, which has the highest correlation with the region of interest of the current ultrasound image, as the second ultrasound image, the ultrasound imaging device determines the heart rate value based on the frame distance between the second ultrasound image and the current ultrasound image.
[0266] Here, the description of S310 in this embodiment is consistent with the description of S206, and will not be repeated here.
[0267] S311, The ultrasound imaging device displays the heart rate value and the current ultrasound image.
[0268] After the ultrasound imaging device determines the heart rate value based on the frame distance between the second ultrasound image and the current ultrasound image, the ultrasound imaging device displays the heart rate value in the current ultrasound image.
[0269] Here, the description of S311 in this embodiment is consistent with the description of S207, and will not be repeated here.
[0270] For example, such as Figure 14 As shown, the process by which the ultrasound imaging device calculates and displays the fetal heart rate based on the fetal heart region of the B-mode ultrasound image is as follows:
[0271] 1. The ultrasound imaging device acquires and stores two-dimensional B-mode ultrasound images frame by frame;
[0272] 2. The ultrasound imaging device locates or segments the fetal heart region in the current ultrasound image and the third ultrasound image preceding the current ultrasound image.
[0273] 3. The ultrasound imaging device determines whether the fetal heart rate region in the current ultrasound image meets the preset heart rate display conditions.
[0274] 4. When the ultrasound imaging device determines that the fetal heart area in the current ultrasound image meets the preset heart rate display conditions, the ultrasound imaging device calculates the fetal heart rate based on the fetal heart area in the current ultrasound image.
[0275] 5. The ultrasound imaging device can be customized to display the current ultrasound image and fetal heart rate;
[0276] 6. When the ultrasound imaging device determines that the fetal heart rate region in the current ultrasound image does not meet the preset heart rate display conditions, the ultrasound imaging device will display the current ultrasound image in a custom way.
[0277] 7. The ultrasound imaging device determines whether multiple frames of B-mode ultrasound images have been read.
[0278] 8. The process ends when reading is complete;
[0279] 9. Continue execution 1 if the reading is not complete.
[0280] Understandably, ultrasound imaging devices use B-mode ultrasound to examine the heart rate of the target fetus. Specifically, the ultrasound imaging device automatically locates the region of interest (ROI) of the fetal heart rate and performs a quality assessment on the current ultrasound image. Based on the quality assessment results, the ultrasound imaging device decides whether to display the fetal heart rate value on the instrument interface. When the current ultrasound image passes the quality assessment, the ultrasound imaging device performs correlation calculations on the ROI of the current ultrasound image based on the ROI of multiple frames of B-mode ultrasound images, and then automatically calculates and displays the heart rate value of the target fetus, which can greatly improve the speed and accuracy of displaying the fetal heart rate value.
[0281] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.
[0282] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0283] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0284] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims. All of these forms are within the protection scope of this application.
Claims
1. A method for displaying fetal heart rate, wherein, The method includes: Acquire multiple frames of B-mode ultrasound images of the target fetus; Determine whether the current ultrasound image meets the preset heart rate display conditions. The current ultrasound image is the ultrasound image acquired at the current time among the multiple frames of B-mode ultrasound images. When it is determined that the current ultrasound image meets the preset heart rate display conditions, the correlation of the current ultrasound image is calculated based on the multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus. Display the heart rate value and the current ultrasound image; The determination that the current ultrasound image meets the preset heart rate display conditions includes any one of the first determination method, the second determination method, and the third determination method; The first determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset frame number; when the number of first frames meets the first preset frame number, searching for ultrasound images in the third ultrasound image whose correlation with the current ultrasound image is higher than a preset threshold; wherein, the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; determining whether the number of second frames of ultrasound images whose correlation with the current ultrasound image is higher than the preset threshold meets the second preset frame number; when the number of second frames is greater than or equal to the second preset frame number, the current ultrasound image meets the preset heart rate display condition; The second determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames meets the first preset number of frames, determining an ultrasound image with a region of interest in the third ultrasound image, and determining whether the number of third frames of the ultrasound image with the region of interest meets the third preset number of frames; when the number of third frames meets the third preset number of frames, determining that the current ultrasound image meets the preset heart rate display condition; The third determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset frame number, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames meets the first preset frame number, determining whether a region of interest is located in the current ultrasound image; when it is determined that the region of interest is located in the current ultrasound image, searching for ultrasound images in the third ultrasound image whose correlation with the region of interest of the current ultrasound image is higher than a preset threshold, and determining whether the number of second frames of the ultrasound images whose correlation with the region of interest of the current ultrasound image is higher than the preset threshold meets the second preset frame number; when the number of second frames meets the second preset frame number, determining that the current ultrasound image meets the preset heart rate display condition.
2. The method according to claim 1, wherein, The display of the heart rate value and the current ultrasound image includes: The region of interest of the target fetus is identified in the current ultrasound image; The heart rate value is displayed in the current ultrasound image according to a first font parameter, wherein the first font parameter includes at least one of font, font size, and color.
3. The method according to claim 1, wherein, The display of the heart rate value and the current ultrasound image includes: A heart rate change trend graph is generated based on the heart rate value. The heart rate change trend graph represents the change trend of the heart rate value corresponding to each current ultrasound image. The heart rate change trend graph includes at least one of an amplitude value trend graph and a sine wave diagram. The heart rate change trend graph is displayed in the current ultrasound image.
4. The method according to claim 1, wherein, The display of the heart rate value and the current ultrasound image includes: Based on the heart rate value, obtain the duration of each heartbeat; The process of heartbeat is simulated using the aforementioned heartbeat duration; The simulated heartbeat pattern is dynamically displayed in the current ultrasound image.
5. The method according to claim 4, wherein, The dynamic display of the simulated heartbeat pattern in the current ultrasound image includes: A simulated heartbeat is displayed in the current ultrasound image, the simulated heartbeat being used to simulate the beating pattern of the heart; Play a heartbeat sound effect.
6. The method according to claim 2, wherein, After displaying the heart rate value in the current ultrasound image according to the first font parameter, the method further includes: The heart rate value is then broadcast.
7. The method according to claim 2, wherein, The method further includes: The preset heart rate range is displayed in the current ultrasound image; When the heart rate value is determined to exceed the preset heart rate range, an alarm is triggered using a preset display method, wherein the preset display method includes at least one of emitting an alarm sound, displaying the heart rate value in a dynamic manner, and changing the color or font of the heart rate value.
8. The method according to claim 1, wherein, The method further includes: When it is determined that the current ultrasound image does not meet the preset heart rate display conditions, the heart rate value is not displayed in the current ultrasound image.
9. A method for displaying fetal heart rate, wherein, The method includes: Acquire multiple frames of B-mode ultrasound images of the target fetus; Determine whether the current ultrasound image meets the preset heart rate display conditions. The current ultrasound image is the ultrasound image acquired at the current time among the multiple frames of B-mode ultrasound images. When it is determined that the current ultrasound image meets the preset heart rate display conditions, a first ultrasound image is determined from the multiple frames of B-mode ultrasound images. The first ultrasound image is M frames of ultrasound images preceding the current ultrasound image, where M is an integer greater than 0, and M is determined based on the preset heart rate cycle of the target fetus. The first ultrasound image includes dynamically determined multiple frames of first sub-ultrasound images and dynamically determined second sub-ultrasound images. The correlation between the multiple frames of first sub-ultrasound images and the second sub-ultrasound images is determined. The heart rate value is determined based on the average of the maximum correlation between each dynamically determined first sub-ultrasound image and each dynamically determined second sub-ultrasound image. Display the heart rate value and the current ultrasound image; The determination that the current ultrasound image meets the preset heart rate display conditions includes any one of the first determination method, the second determination method, and the third determination method; The first determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset frame number; when the number of first frames meets the first preset frame number, searching for ultrasound images in the third ultrasound image whose correlation with the current ultrasound image is higher than a preset threshold; wherein, the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; determining whether the number of second frames of ultrasound images whose correlation with the current ultrasound image is higher than the preset threshold meets the second preset frame number; when the number of second frames is greater than or equal to the second preset frame number, the current ultrasound image meets the preset heart rate display condition; The second determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames meets the first preset number of frames, determining an ultrasound image with a region of interest in the third ultrasound image, and determining whether the number of third frames of the ultrasound image with the region of interest meets the third preset number of frames; when the number of third frames meets the third preset number of frames, determining that the current ultrasound image meets the preset heart rate display condition; The third determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames meets the first preset number of frames, determining whether a region of interest is located in the current ultrasound image; when it is determined that the region of interest is located in the current ultrasound image, searching for ultrasound images in the third ultrasound image whose correlation with the region of interest of the current ultrasound image is higher than a preset threshold, and determining whether the number of second frames of the ultrasound images whose correlation with the region of interest of the current ultrasound image is higher than the preset threshold meets the second preset number of frames; when the number of second frames meets the second preset number of frames, determining that the current ultrasound image meets the preset heart rate display condition.
10. The method according to claim 9, characterized in that, The display of the heart rate value and the current ultrasound image includes: The region of interest of the target fetus is identified in the current ultrasound image; The heart rate value is displayed in the current ultrasound image according to a first font parameter, wherein the first font parameter includes at least one of font, font size, and color.
11. The method according to claim 9, characterized in that, The display of the heart rate value and the current ultrasound image includes: A heart rate change trend graph is generated based on the heart rate value. The heart rate change trend graph represents the change trend of the heart rate value corresponding to each current ultrasound image. The heart rate change trend graph includes at least one of an amplitude value trend graph and a sine wave diagram. The heart rate change trend graph is displayed in the current ultrasound image.
12. The method according to claim 9, characterized in that, The method further includes: The preset heart rate range is displayed in the current ultrasound image; When the heart rate value is determined to exceed the preset heart rate range, an alarm is triggered using a preset display method, wherein the preset display method includes at least one of emitting an alarm sound, displaying the heart rate value in a dynamic manner, and changing the color or font of the heart rate value.
13. An ultrasound imaging device, wherein, The ultrasound imaging device includes: probe; A transmitting circuit that excites the probe to emit ultrasound waves toward the target fetus; A receiving circuit, wherein the receiving circuit receives the ultrasound echo returned from the target fetus through the probe, and obtains an ultrasound echo signal; The processor acquires multiple frames of B-mode ultrasound images of the target fetus based on the ultrasound echo signal, determines whether the current ultrasound image meets preset heart rate display conditions, and the current ultrasound image is the ultrasound image acquired at the current time among the multiple frames of B-mode ultrasound images; when it is determined that the current ultrasound image meets the preset heart rate display conditions, the processor performs correlation calculation on the current ultrasound image based on the multiple frames of B-mode ultrasound images to obtain the heart rate value of the target fetus; A display showing the heart rate value and the current ultrasound image; The processor is further configured to determine, using any one of the first, second, and third determination methods, that the current ultrasound image meets the preset heart rate display conditions; The first determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset frame number; when the number of first frames meets the first preset frame number, searching for ultrasound images in the third ultrasound image whose correlation with the current ultrasound image is higher than a preset threshold; wherein, the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; determining whether the number of second frames of ultrasound images whose correlation with the current ultrasound image is higher than the preset threshold meets the second preset frame number; when the number of second frames is greater than or equal to the second preset frame number, the current ultrasound image meets the preset heart rate display condition; The second determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames meets the first preset number of frames, determining an ultrasound image with a region of interest in the third ultrasound image, and determining whether the number of third frames of the ultrasound image with the region of interest meets the third preset number of frames; when the number of third frames meets the third preset number of frames, determining that the current ultrasound image meets the preset heart rate display condition; The third determination method includes: determining whether the number of first frames of the third ultrasound image meets the first preset number of frames, wherein the third ultrasound image is N ultrasound images preceding the current ultrasound image, and N is an integer greater than 0; when the number of first frames meets the first preset number of frames, determining whether a region of interest is located in the current ultrasound image; when it is determined that the region of interest is located in the current ultrasound image, searching for ultrasound images in the third ultrasound image whose correlation with the region of interest of the current ultrasound image is higher than a preset threshold, and determining whether the number of second frames of the ultrasound images whose correlation with the region of interest of the current ultrasound image is higher than the preset threshold meets the second preset number of frames; when the number of second frames meets the second preset number of frames, determining that the current ultrasound image meets the preset heart rate display condition.
14. A computer-readable storage medium having a computer program stored thereon for use in an ultrasound imaging apparatus, wherein the computer program, when executed by a processor, implements the method as described in any one of claims 1-12.
Citation Information
Patent Citations
Processing method for simultaneously acquiring fetal heart rate and fetal heart waveform
CN101926656A
Ultrasound diagnostic device and ultrasound image processing method
CN106061397A