Methods and systems for fetal cardiac assessment - Patents.com

JP7638291B2Active Publication Date: 2025-03-03KONINKLIJKE PHILIPS NV
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022549983
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-04-02
Filing Date
2021-02-03
Publication Date
2025-03-03
Estimated Expiration
2041-02-03

Smart Images

  • Figure 0007638291000001
    Figure 0007638291000001
  • Figure 0007638291000002
    Figure 0007638291000002
  • Figure 0007638291000003
    Figure 0007638291000003
Patent Text Reader

Abstract

The present invention provides a method for deriving biometric parameters of a fetal heart. The method includes acquiring multiple ultrasound images of a region of interest that includes the fetal heart and comparing the multiple ultrasound images to a predefined clinical view. A group of ultrasound images associated with the predefined clinical view is selected based on the comparison. The group of ultrasound images represents at least one cardiac cycle. Anatomical landmarks of the fetal heart are detected within one ultrasound image of the group of ultrasound images, and the anatomical landmarks of the fetal heart are detected or tracked across the group of ultrasound images. The biometric parameters of the fetal heart are then determined based on the anatomical landmarks detected or tracked from one or more ultrasound images of the group of ultrasound images.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to the field of fetal ultrasound imaging, and more specifically to the field of fetal cardiac ultrasound assessment. [Background technology]

[0002] Congenital heart disease (CHD) is a common condition affecting approximately 1% of live births and accounts for approximately one-third of all congenital disorders. Fetal ultrasound screening is recommended for all pregnant women between 18-24 weeks of gestation worldwide and provides at least five and up to eight recommended screening views of the fetal heart. The fetal heart is a complex structure and to explore abnormalities, the recommended views entail both B-mode (grayscale), Doppler (color) and M-mode ultrasound to understand the structure and function of the fetal heart.

[0003] Although CHD may be asymptomatic during fetal life, it causes significant morbidity and mortality after birth and represents the leading cause of infant death in newborns born with birth defects. The earlier CHD is diagnosed, the better the outcomes and treatment options at birth. Also, in utero treatments for certain CHD lesions (e.g., intrauterine aortic valvuloplasty for HLHS) are increasingly available and effective and can significantly improve fetal health. All of these potential benefits depend on accurate prenatal diagnosis of CHD. Prenatal diagnosis rates for CHD in the community are 30-50% even in areas where prenatal ultrasound is universal.

[0004] The primary reasons for this diagnostic gap are insufficient expertise to interpret fetal cardiac images and relatively little exposure to congenital heart disease among caregivers due to the diagnostic challenges presented by the small, rapidly beating fetal heart. Signs of cardiac disease are often subtle and require careful targeted testing. Fetal cardiac evaluations are routinely performed at 18 and 22 weeks gestational age, although some types of congenital heart disease may be recognized as early as gestational age, and other CHDs may appear or be detected later. Summary of the Invention [Problem to be solved by the invention]

[0005] Thus, there is a need for more accurate means of identifying and assessing CHD during prenatal ultrasound examinations. [Means for solving the problem]

[0006] The invention is defined by the claims.

[0007] According to an example according to an aspect of the present invention, Biometrics A method for deriving parameters is provided, the method comprising: acquiring a plurality of ultrasound images of a region of interest including the fetal heart; comparing the plurality of ultrasound images with predefined clinical views; selecting a group of ultrasound images associated with a predefined clinical view based on the comparison, the group of ultrasound images representing at least one cardiac cycle; detecting an anatomical landmark of a fetal heart in an ultrasound image of the group of ultrasound images; Detecting or tracking anatomical landmarks of the fetal heart throughout the group of ultrasound images; determining a location of the fetal heart based on the detected or tracked anatomical landmarks from one or more of the group of ultrasound images; Biometricsand deriving the parameters.

[0008] This method is Biometrics It provides a means to accurately estimate parameters.

[0009] The fetal heart is normally difficult to examine due to its high movement and variability.

[0010] The fetal heart is visualized by automatically selecting a group of ultrasound images that correspond to the desired clinical views over a complete cardiac cycle and tracking anatomical landmarks across that group of images. Biometrics It is possible to derive the parameters exactly.

[0011] In one embodiment, the step of tracking anatomical landmarks comprises: automatically detecting anatomical landmarks in the ultrasound images using a dynamic model of the fetal heart; and detecting and tracking anatomical landmarks throughout the group of ultrasound images using a dynamic motion model of the fetal heart.

[0012] In this way, anatomical landmarks can be tracked with point accuracy, and the derived Biometrics The accuracy of the parameters is improved.

[0013] In a further embodiment, the plurality of ultrasound images comprises: 2D ultrasound images, and the tracking points of the dynamic motion model are derived from the images; or Tracking points for a dynamic motion model are derived from the volume, including the 3D ultrasound image.

[0014] In one embodiment, the method includes detecting a plurality of anatomical landmarks; tracking the plurality of anatomical landmarks across a group of ultrasound images; and determining a location of the fetal heart based on the plurality of tracked anatomical landmarks. Biometrics and deriving the parameters.

[0015] By tracking multiple anatomical landmarks, various Biometrics The parameters can be derived.

[0016] In one embodiment, the plurality of ultrasound images are 2D ultrasound images, and the method comprises: generating a 3D ultrasound image based on the plurality of tracked anatomical landmarks. Biometrics Deriving the parameters is included.

[0017] In this way, 3D images of ventricular volumes, etc. Biometrics The parameters can be accurately derived from 2D ultrasound images.

[0018] In one embodiment, the predefined clinical views include: Abdominal view, 4 Chamber View, Left ventricular outflow tract view, Right ventricular outflow tract view, 3 Vascular View, 3 Vascular Tracheal View, Aortic arch view, and The views may include one or more of the arch views.

[0019] In one embodiment, the pre-defined clinical view includes multiple views.

[0020] In a further embodiment, the method includes bookmarking the 2D ultrasound image for each of the multiple views at a common point in the cardiac cycle.

[0021] In this way, from a given 2D ultrasound scan, the fetal heart can be viewed from multiple different view planes at the same point in the cardiac cycle.

[0022] In one embodiment, the method comprises: Biometrics The method further includes bookmarking ultrasound images of interest based on the parameters.

[0023] In this way, BiometricsImages related to parameters can be bookmarked for reference.

[0024] In one embodiment, the method comprises: Biometrics The method further includes bookmarking a cine-loop of the ultrasound image of interest based on the parameters.

[0025] In this way, Biometrics A series of images related to a parameter (eg, one cardiac cycle of a given view, such as a four-chamber view, or all related views of one cardiac cycle) can be bookmarked for reference.

[0026] In one embodiment, Biometrics The parameters are: Abdominal parameters, Chest parameters, Atrial parameters, Ventricular parameters, Arterial parameters, wall parameters, and The valve parameters are derived from one or more of:

[0027] In one embodiment, the method comprises: identifying a gate location within an ultrasound image of the group of ultrasound images for placing a Doppler gate; tracking gate locations across a group of ultrasound images based on anatomical landmarks; and automatically positioning a Doppler gate at the tracked gate location.

[0028] In this way, color Doppler data of the fetal heart can be acquired automatically. For example, the valves or septum of the heart can be tracked through a group of images to ensure that the Doppler gate remains within the correct valve or septum. For example, a gate can be placed on the interventricular septum to directly assess blood flow between the left and right ventricles through a hole in the septum.

[0029] In one embodiment, the method further includes performing automated M-mode data acquisition from the group of ultrasound images, the performing automated M-mode data acquisition comprising: defining one or more sets of beamlines for a group of ultrasound images automatically based on the tracked anatomical structures; collecting M-mode data along the beamline; and tracking the beamline at the anatomical location based on the tracked anatomical features throughout the cardiac cycle.

[0030] In this manner, precise data relating to the movement of a given anatomical location along a given line can be obtained for further analysis, for example, M-mode data can identify arrhythmias.

[0031] According to an example embodiment of the present invention there is provided a computer program comprising computer program code which, when said computer program is run on a computer, causes said computer program to perform the method set out above.

[0032] According to an example according to an aspect of the present invention, Biometrics A system for deriving a parameter is provided, the system including a processor, the processor comprising: acquiring a plurality of ultrasound images of a region of interest, the region of interest including the fetal heart; Comparing the plurality of ultrasound images to a predefined clinical view; selecting a group of ultrasound images associated with a predefined clinical view based on the comparison, the group of ultrasound images representing at least one cardiac cycle; Detecting fetal heart anatomical landmarks in a group of ultrasound images; Tracking anatomical landmarks of the fetal heart across a group of ultrasound images; Based on the tracked anatomical landmarks, the fetal heart Biometricsand deriving the parameters.

[0033] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.

[0034] Examples of the invention will now be described in detail with reference to the accompanying drawings. [Brief description of the drawings]

[0035] [Figure 1] An ultrasound diagnostic imaging system is shown to illustrate its general operation. [Diagram 2] The method of the present invention is shown. [Diagram 3] A first ultrasound image of a fetal heart in end systole and a second ultrasound image in end diastole are shown. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0036] The present invention will now be described with reference to the figures.

[0037] It should be understood that the detailed description and specific examples, while indicating exemplary embodiments of the devices, systems, and methods, are for purposes of illustration only and are not intended to limit the scope of the invention. These and other features, aspects, and advantages of the devices, systems, and methods of the present invention will become better understood from the following description, the appended claims, and the accompanying drawings. It should be understood that the figures are merely schematic and are not drawn to scale. It should also be understood that the same reference numerals are used throughout the figures to indicate the same or similar parts.

[0038] The present invention relates to a method for the treatment of fetal heart disease. BiometricsA method for deriving a parameter is provided that includes acquiring a plurality of ultrasound images of a region of interest, the region of interest including a fetal heart, and comparing the plurality of ultrasound images to a predefined clinical view. A group of ultrasound images associated with the predefined clinical view is selected based on the comparison. The group of ultrasound images represents at least one cardiac cycle.

[0039] Anatomical landmarks of the fetal heart are detected within one ultrasound image of the group of ultrasound images, and the anatomical landmarks of the fetal heart are detected or tracked throughout the group of ultrasound images. A fetal heart anatomical landmark is then calculated based on the detected or tracked anatomical landmarks from one or more ultrasound images of the group of ultrasound images. Biometrics The parameters are determined.

[0040] Various ultrasound measurements such as fetal head diameter (BPD), crown-rump length (CRL), head circumference (HC), abdominal circumference (AC), and femur length (FL) can be used to estimate fetal gestational age (GA). All of these measurements are based on physical growth (mass or percentage), which is subject to genetic variation (e.g., fetal head size and shape), sex, and inherent variability during fetal development. Fetal heart rate and fetal heart valve distance derived from fetal echocardiograms may be used as alternative means to estimate GA and have been shown to correlate with CRL.

[0041] Fetal echocardiography is a detailed assessment of cardiac structure and function and typically involves sequential segmental analysis of the fetal heart using up to eight recommended views, including: (a) abdominal view (ABDO), (b) four-chamber view (4C), (c) left ventricular outflow tract (LVOT), (d) right ventricular outflow tract (RVOT), (e) three-vessel view (3VV), (f) three-vessel tracheal view (3VT), (g) aortic arch (AA), and (h) ductus arteriosus arch (DA). Segmental analysis includes an initial assessment of fetal right / left orientation, followed by assessment of the following segments and their relationships: visceral / abdominal location (including stomach location and apex location), atrial assessment (including location, systemic and pulmonary venous connections, venous anatomy, atrial anatomy (including septum), and foramen ovale), ventricular assessment (including location, atrial connections, ventricular anatomy (including septum), relative and absolute size, function, and pericardium), aortic assessment (aorta, large pulmonary artery and pulmonary artery branches, and ductus arteriosus) (including location relative to the trachea, ventricular connections, vessel size, patency, and flow (both rate and direction)), atrioventricular junction (including atrioventricular valve (e.g., mitral, tricuspid) anatomy, size, and function), and ventricular-arterial junction assessment (including semilunar valve (e.g., aortic and pulmonary) anatomy, size, and function) (including assessment of both subpulmonary and subaortic regions).

[0042] However, the fetal heart is a difficult organ to measure using conventional echocardiographic techniques.

[0043] First, with reference to FIG. 1, and since the present invention relates to the processing of signals measured by the transducer array, the general operation of an exemplary ultrasound system will be described, with an emphasis on the signal processing functions of the system.

[0044] The system includes an array transducer probe 4 having a transducer array 6 for transmitting ultrasound waves and receiving echo information. The transducer array 6 may include CMUT transducers, piezoelectric transducers formed from materials such as PZT or PVDF, or any other suitable transducer technology. In this example, the transducer array 6 is a two-dimensional array of transducers 8 that can scan either a 2D plane or a three-dimensional volume of an area of ​​interest. In another example, the transducer array may be a 1D array.

[0045] The transducer array 6 is coupled to a microbeamformer 12 that controls reception of signals by the transducer elements. The microbeamformer is capable of at least partial beamforming of signals received by subarrays of transducers (commonly referred to as "groups" or "patches"), as described in U.S. Patents 5,997,479 (Savord et al.), 6,013,032 (Savord), and 6,623,432 (Powers et al.).

[0046] It should be noted that the microbeamformer is entirely optional. Additionally, the system includes a transmit / receive (T / R) switch 16 to which the microbeamformer 12 can be coupled to switch the array between transmit and receive modes, and to protect the main beamformer 20 from high energy transmit signals when the microbeamformer is not used and the transducer array is directly operated by the main system beamformer. Transmission of ultrasound beams from the transducer array 6 is directed by a transducer controller 18, which is coupled to the microbeamformer by the T / R switch 16 and the main transmit beamformer (not shown). The transducer controller 18 receives input from user operation of a user interface or control panel 38. The controller 18 includes transmit circuitry arranged to drive the transducer elements of the array 6 (directly or via the microbeamformer) during transmit mode.

[0047] In a typical line-by-line imaging sequence, the beamforming system in the probe operates as follows: During transmit, the beamformer (which can be a microbeamformer or the main system beamformer depending on the implementation) activates the transducer array, or a subaperture of the transducer array. A subaperture can be a one-dimensional line of transducers or a two-dimensional patch of transducers within a larger array. In transmit mode, the focusing and steering of the ultrasound beam generated by the array or a subaperture of the array is controlled as follows:

[0048] Upon receiving backscattered echo signals from the subject, the received signals undergo beamforming (described below) to align the received signals, and if subapertures are used, the subapertures are shifted, for example, by one transducer element, and the shifted subaperture is then activated and the process is repeated until all transducer elements of the transducer array have been activated.

[0049] For each line (or sub-aperture), the sum of the received signals used to form the associated line of the final ultrasound image is the sum of the voltage signals measured by the transducer elements of the given sub-aperture during the receive period. The resulting line signals after the following beamforming process are usually referred to as radio frequency (RF) data. Each line signal (RF data set) generated by the various sub-apertures undergoes additional processing to generate the lines of the final ultrasound image. The change in amplitude of the line signal over time contributes to the change in brightness of the ultrasound image with depth, with high amplitude peaks corresponding to bright pixels (or groups of pixels) in the final image. Peaks appearing near the beginning of the line signal represent echoes from shallow structures, while peaks appearing gradually later in the line signal represent echoes from structures of increasing depth within the subject.

[0050] One of the functions controlled by the transducer controller 18 is the direction in which the beam is steered and focused. The beam can be steered straight ahead from the transducer array (orthogonal to the transducer array) or at a different angle to obtain a wider field of view. The steering and focusing of the transmit beam is controlled according to the activation times of the transducer elements.

[0051] Common ultrasound data acquisition methods are classified into two categories: plane wave imaging and "beam steered" imaging, which are categorized by the presence or absence of beamforming in the transmit mode ("beam steered" imaging) and / or the receive mode (plane wave imaging and "beam steered" imaging).

[0052] Looking first at the focusing function, by activating all transducer elements simultaneously, the transducer array creates a plane wave that diverges as it passes through the subject. In this case, the ultrasound beam remains unfocused. By introducing a position-dependent time delay into the transducer activation, it is possible to converge the wavefront of the beam to a desired point, called the focal zone. A focal zone is defined as a point where the lateral width of the beam is less than half the transmit beam width. In this way, the lateral resolution of the final ultrasound image is enhanced.

[0053] For example, when the transducer elements are activated sequentially with time delays (starting with the outermost elements and ending with the central element of the transducer array), a focal zone is formed at a given distance from the probe along the central element. The distance of the focal zone from the probe varies with the time delay between each subsequent round of transducer element activation. After passing through the focal zone, the beam begins to diverge, forming a far-field imaging region. It is noted that in focal zones close to the transducer array, the ultrasound beam diverges fast in the far field, leading to beamwidth artifacts in the final image. Typically, the near field between the transducer array and the focal zone shows little detail due to the large overlap of the ultrasound beams. Thus, changing the position of the focal zone leads to a significant change in the quality of the final image.

[0054] It should be noted that in transmit mode, only one focal point is defined, unless the ultrasound image is divided into multiple focal zones (each of which may have a different transmit focal point).

[0055] Additionally, upon receiving echo signals from within the subject, the reverse of the above process can be performed to perform receive focusing; that is, the incoming signals are received by the transducer elements and subjected to an electronic time delay before being passed to the system for signal processing. The simplest example of this is called delay-and-sum beamforming. The receive focus of the transducer array can be dynamically adjusted as a function of time.

[0056] Now, looking at the function of beam steering, by applying the right amount of time delays to the transducer elements, an ultrasound beam can be given a desired angle as it leaves the transducer array. For example, activating the transducers on a first side of the transducer array, then activating the remaining transducers in sequence, ending up on the other side of the array, will tilt the wavefront of the beam towards the second side. The magnitude of the steering angle with respect to the normal to the transducer array depends on the magnitude of the time delay between the activation of subsequent transducer elements.

[0057] Additionally, it is possible to focus the steered beam, in which case the total time delay applied to each transducer element is the sum of both the focusing time delay and the steering time delay, in which case the transducer array is called a phased array.

[0058] For CMUT transducers that require a DC bias voltage for operation, the transducer controller 18 is coupled to control the DC bias control 45 of the transducer array. The DC bias control 45 sets the DC bias voltage applied to the CMUT transducer elements.

[0059] For each transducer element of the transducer array, an analog ultrasound signal (usually called channel data) enters the system through a receive channel. In the receive channel, a partially beamformed signal is generated from the channel data by the microbeamformer 12 and passed to the main receive beamformer 20. Here, the partially beamformed signals from the individual patches of the transducer are combined into a fully beamformed signal (called radio frequency (RF) data). The beamforming performed at each stage may be as described above or may include additional functions. For example, the main beamformer 20 has 128 channels, each receiving partially beamformed signals from patches consisting of tens or hundreds of transducer elements. In this way, the signals received by the thousands of transducers of the transducer array efficiently contribute to a single beamformed signal.

[0060] The beamformed received signals are coupled to a signal processor 22. The signal processor 22 processes the received echo signals in various ways, such as bandpass filtering, decimation, separation of I and Q components, and harmonic signal separation (separating linear and nonlinear signals to allow identification of nonlinear (higher harmonics of the fundamental frequency) echo signals returning from tissues and microbubbles). The signal processor may also perform additional signal enhancements such as speckle reduction, signal combining, and noise removal. The signal processor's bandpass filters are tracking filters, with the passband sliding from higher to lower frequency bands as echo signals are received from increasing depths. This rejects high frequency noise from deep depths where there is typically no anatomical information.

[0061] The transmit and receive beamformers can be implemented in different hardware and have different functions. Of course, the receiver beamformer takes into account the characteristics of the transmit beamformer. For clarity, FIG. 1 only shows the receiver beamformers 12, 20. In the overall system, there is also a transmit chain with a transmit microbeamformer and a main transmit beamformer.

[0062] The function of the microbeamformer 12 is to provide an initial combination of signals to reduce the number of analog signal paths, which is typically performed in the analog domain.

[0063] Final beamforming takes place in the main beamformer 20, typically after digitization.

[0064] The transmit and receive channels use the same transducer array 6 with a fixed frequency band. However, the bandwidth occupied by the transmit pulses may differ depending on the transmit beamforming used. The receive channels can either capture the entire transducer bandwidth (conventional approach) or use bandpass processing to extract only the bandwidth containing the desired information (e.g. harmonics of the main harmonic).

[0065] The RF signals are then coupled to a B-mode (i.e., intensity mode, or 2D imaging mode) processor 26 and a Doppler processor 28. The B-mode processor 26 performs amplitude detection on the received ultrasound signals for imaging of internal body structures such as organ tissues and blood vessels. In the case of line-by-line imaging, each line (beam) is represented by an associated RF signal, the amplitude of which is used to generate an intensity value that is assigned to a pixel of the B-mode image. The exact location of a pixel in the image is determined by the position of the associated amplitude measurement along the RF signal and the line (beam) number of the RF signal. B-mode images of such structures are formed in harmonic or fundamental image modes, or a combination of both, as described in U.S. Pat. No. 6,283,919 (Roundhill et al.) and U.S. Pat. No. 6,458,083 (Jago et al.). The Doppler processor 28 processes the time-varying signals resulting from tissue motion and blood flow for detection of moving material, such as flow of blood cells, within the image field. The Doppler processor 28 typically includes a wall filter whose parameters are set to pass or reject echoes returned from selected types of material within the body.

[0066] The structural and motion signals generated by the B-mode and Doppler processors are coupled to the scan converter 32 and the multiplanar reformatter 44. The scan converter 32 places the echo signals in the desired image format in the original spatial relationship in which they were received. That is, the scan converter operates to convert the RF data from a cylindrical coordinate system to a Cartesian coordinate system suitable for displaying ultrasound images on the image display 40. For B-mode imaging, the brightness of a pixel at a given coordinate is proportional to the amplitude of the RF signal received from that location. For example, the scan converter can place the echo signals in a two-dimensional (2D) sector format, or a pyramidal three-dimensional (3D) image. The scan converter overlays on the B-mode structural image a color corresponding to the motion at the point in the image field (where the Doppler estimated velocity produces a given color). The combined B-mode structural and color Doppler images describe the tissue motion and blood flow within the structural image field. The multiplanar reformatter converts echoes received from points in a common plane within a volumetric region of the body into an ultrasound image of that plane, as described in U.S. Patent No. 6,443,896 (Detmer). A volume renderer 42 converts the echo signals of the 3D data set into a projected 3D image viewed from a given reference point, as described in U.S. Patent No. 6,530,885 (Entrekin et al.).

[0067] The 2D or 3D images are coupled from the scan converter 32, multiplanar reformatter 44, and volume renderer 42 to the image processor 30 for further enhancement, buffering, and temporary storage for display on the image display 40. The imaging processor is adapted to remove certain imaging artifacts from the final ultrasound image, such as acoustic shadowing caused by, for example, strong attenuators or refraction, back enhancement caused by, for example, weak attenuators, and reverberation artifacts where, for example, highly reflective tissue interfaces are in close proximity. Additionally, the image processor is adapted to operate certain speckle reduction functions to enhance the contrast of the final ultrasound image.

[0068] In addition to being used for imaging, the blood flow values ​​produced by the Doppler processor 28 and tissue structure information produced by the B-mode processor 26 are coupled to a quantification processor 34. The quantification processor produces various flow condition metrics, such as blood flow volume rate, in addition to structural measurements such as organ size and gestational age. The quantification processor receives input from a user control panel 38, such as the points within the anatomical structures in the image at which to make measurements.

[0069] Output data from the quantification processor is coupled to a graphics processor 36 for reproducing measurement graphics and values ​​with the image on the display 40, and for audio output from the display device 40. The graphics processor 36 also generates graphic overlays for display with the ultrasound images. These graphic overlays can include standard identifying information such as the patient name, the date and time of the image, imaging parameters, etc. To this end, the graphics processor receives input such as the patient name from a user interface 38. The user interface is also coupled to a transmit controller 18 to control the generation of the ultrasound signals from the transducer array 6, and thus the images generated by the transducer array and the ultrasound system. The transmit control function of the controller 18 is only one of the functions performed. The controller 18 also takes into account the mode of operation (given by the user) and the required transmitter configuration and bandpass configuration in the receiver analog-to-digital converter. The controller 18 can also be a state machine with fixed states.

[0070] The user interface is also coupled to a multi-planar reformatter 44 for selecting and controlling planes of multiple multi-planar reformatted (MPR) images that are used to perform quantified evaluation criteria on the image fields of the MPR images.

[0071] Figure 2 shows the fetal heart. Biometrics 1 illustrates a method 100 for deriving parameters.

[0072] The method begins by acquiring multiple ultrasound images of a region of interest, including the fetal heart, at step 110. The ultrasound images may include 2D ultrasound images and / or 3D ultrasound images.

[0073] In step 120, the multiple ultrasound images are compared to predefined clinical views. As previously mentioned, a variety of different clinical views are considered in a typical fetal echocardiogram. For example, the predefined clinical views include one or more of an abdominal view, a four-chamber view, a left ventricular outflow tract view, a right ventricular outflow tract view, a three-vessel view, a three-vessel tracheal view, an aortic arch view, and an arch view.

[0074] Based on the comparison, a group of ultrasound images associated with a predefined clinical view is selected in step 130. The group of ultrasound images represents at least one cardiac cycle.

[0075] The group of ultrasound images is selected to match as closely as possible to a predefined clinical view. Because a particular predefined clinical view requires the fetal heart to be at a given point in the cardiac cycle to be accurate, the group of ultrasound images is selected to cover at least one cardiac cycle of the fetal heart. For example, an accurate four-chamber view requires the heart valves to be closed.

[0076] At step 140, fetal heart anatomical landmarks are detected within one ultrasound image of the group of ultrasound images.

[0077] For example, anatomical landmarks are identified based on a model of posture points (also called key points in 2D images) of a view of the fetal heart. A desired time point of the cardiac cycle for a given clinical view is selected from a group of ultrasound images by tracking the posture points in real time. Anatomical landmarks associated with posture points include, for example, the aortic and ductal arches, the inferior and superior vena cava, the trachea, etc. Furthermore, multiple anatomical landmarks can be considered and detected within the ultrasound images.

[0078] At step 150, anatomical landmarks of the fetal heart are detected or tracked throughout the group of ultrasound images.

[0079] Tracking of anatomical landmarks is performed, for example, by automatically detecting anatomical landmarks in ultrasound images using a dynamic model of the fetal heart and detecting and tracking anatomical landmarks across a group of ultrasound images using the dynamic motion model of the fetal heart.

[0080] In an example of a dynamic model, the model estimates the cardiac cycle directly from B-mode ultrasound data and is used to detect disorders such as arrhythmias. The dynamic model may also be used to automatically place and track Doppler gates dynamically and precisely following cardiac motion to examine valves, veins, arteries, septum, and foramen ovale, thus potentially detecting associated anatomical and functional abnormalities. Doppler gate placement is described further below.

[0081] Additionally, in the example of a dynamic model, the model may also detect functional abnormalities such as malfunctioning valves, flapping of the membrane of the foramen ovale in the wrong atrium, etc.

[0082] At step 160, a fetal heart is detected based on the anatomical landmarks detected or tracked from one or more ultrasound images of the group of ultrasound images. Biometrics The parameters are determined. Biometrics The parameters are derived from one or more of an abdominal parameter, a thoracic parameter, an atrial parameter, a ventricular parameter, an arterial parameter, a wall parameter, and a valvular parameter.

[0083] The method provides a means to generate a fingerprint of the fetal heart during a live scan. The fingerprint is constructed from key anatomical landmarks detected in real time of the fetal heart structure from the live ultrasound data. In this way, a model of the fetal heart is constructed from which several parameters such as biometrics, structural and functional abnormalities are detected. This model can be used to find optimal scan planes and fetal screening views during a given ultrasound scan of the fetal heart.

[0084] The method can operate on any ultrasound image. For example, the plurality of ultrasound images includes 2D ultrasound images, where the tracking points of the dynamic motion model are derived from the 2D images. In another example, the plurality of ultrasound images includes 3D ultrasound images, where the tracking points of the dynamic motion model are derived from a volume.

[0085] FIG. 3 shows a first ultrasound image 210 of a fetal heart at end systole (end of ejection phase) and a second ultrasound image 220 at end diastole (end of ventricular filling).

[0086] The first and second ultrasound images include tracking points 230 that correspond to anatomical landmarks in the fetal heart, in accordance with an aspect of the present invention. In the image shown in Figure 3, the tracking points 230 are used to define a cardiac axis 240, which is commonly used to derive biometrics from the fetal heart.

[0087] The cardiac axis (CAx) in a normal four-chamber fetal cardiac image is expected to be 45°±15°. This axis is defined as a line from the spine to the cardiac cross with the apex.

[0088] The nature of abnormal CAx and the CAx shift during the fetal cardiac cycle vary with the type of CHD. Zhao et al., in "Cardiac axis shift within the cardiac cycle of normal fetuses and fetuses with congenital heart defect" (Ultrasound in Obstetrics and Gynecology 2014), found that at 18-26 weeks of gestation, the mean CAx of normal fetal hearts was 45.9 ± 8.5° at end systole and 38.3 ± 8.4° at end diastole (P < 0.001). The mean CAx of fetuses with CHD reported in this study was 53.4 ± 17.8° at end systole and 47.5 ± 17.3° at end diastole (P < 0.001), a mean difference of 7.6 ± 3.2°. However, in some types of CHD, such as hypoplastic left heart syndrome and transposition of the great arteries (L), the CAx was larger at end diastole than at end systole, with a difference of more than 5°.

[0089] In Hornberger et al.'s "Re:Cardiac axis shift within the cardiac cycle of normal fetuses and fetuses with congenital heart defect" (Ultrasound in Obstetrics and Gynecology 2015), the authors conclude that the cardiac axis showed the least variability among controls at end systole and was also more abnormal (abnormality defined as <25° or >65°) in CHD patients at end systole, suggesting that end systole may be the optimal timing of the cardiac cycle to evaluate the cardiac axis. The study concludes that the heart pivots or sways from diastole to systole. The authors study the unique mechanical properties of ventricular myocardial and circumferential fibers and the torsional mechanics that are responsible for the swaying and differentiate the contractile pattern in hypoplastic left heart syndrome that results in this behavior.

[0090] Automatically tracked points 230 at the valves, cusps, and aortic junctions can be used to quantify the mechanics of heart motion throughout the cardiac cycle to improve understanding of biomechanical abnormalities in CHD.

[0091] Tracking points are used to assess the atrial and ventricular sizes in addition to the cardiac axis. In particular, tracking points at the left atrium, right atrium, mitral junction, and tricuspid junction can be used to provide the left and right atrial sizes. Quantification of fetal atrial sizes is used to identify, for example, Ebstein's anomaly, which is characterized by right atrial enlargement. Similarly, tracking points at the left ventricle, right ventricle, mitral junction, and tricuspid junction are used to predict the relative sizes of the left and right ventricles, which are expected to be approximately the same. Tracking points are tracked in all relevant phases of the cardiac cycle.

[0092] By monitoring atrial and ventricular dimensions over at least one cardiac cycle, a measure of ventricular function can be determined. Biometrics Contribute to the parameters.

[0093] In some applications, 3D ultrasound imaging may not be possible. Biometrics Parameters can still be derived from 2D ultrasound images based on multiple tracked anatomical landmarks.

[0094] In a given clinical workflow, volumes are measured from 2D ultrasound images using Simpson's rule. Simpson's rule assumes that the cross section of each ventricular slice is cylindrical and the total volume is the sum of all cylinders present in the image. These measurements are then plotted against gestational age (determined by fetal head diameter or fetal length measurements). For example, normalized charts exist for right to left ventricular ratios at various gestational ages. The above method provides not only an automated estimation of these biometrics, but also a more accurate 3D approximation of these biometrics across all phases of the cardiac cycle. This is possible because points are tracked across all views and all phases of the cardiac cycle, leading to a more accurate patient-specific shape approximation.

[0095] Except for the mitral and tricuspid valves, the fetal circulatory system uses shunts to bypass the lungs and liver, which are not fully developed. These are the foramen ovale, which transfers blood from the right atrium to the left atrium of the heart, and the ductus arteriosus, which transfers blood from the pulmonary artery to the aorta. Newborns with CHD may also present with a persistent foramen ovale and / or ductus arteriosus. By tracking these points in the acquired ultrasound images, cardiac axis abnormalities, right atrial enlargement, atrial septal defect, AV septal defect, truncus arteriosus, transposition of the great vessels, single ventricle, hypoplastic left ventricular, hypoplastic right heart syndrome, hypoplastic left heart syndrome, coarctation, valvular abnormalities, etc. are detected in prenatal ultrasound images.

[0096] As tracking points, the leaflets, septum, and junctions are tracked in real time. The method provides an automatic mode in the user interface to jump to the evaluation of any given anatomical landmark, such as the foramen ovale or mitral valve, and also provides automation there to set focus / depth / pre-set parameters for evaluation by tracking these orientation points. This is helpful for less experienced sonographers or to speed up the examination time for fetal ultrasound screening.

[0097] Furthermore, this method is derived Biometricsbookmarking ultrasound images of interest based on the parameters. Biometrics Based on the parameters, the user may wish to further explore the parameters. Biometrics By automatically bookmarking the image or images on which the parameters are based, the user better understands the source of the measurements. Biometrics The method further includes bookmarking a cine-loop of the ultrasound image of interest based on the parameters.

[0098] An ultrasound image may be bookmarked for multiple different clinical views at the same time in the cardiac cycle. By calculating the relative distance between the tracking points, the model is used to identify consistent points in the cardiac cycle for bookmarking the different views.

[0099] The method further includes the steps of identifying a gate location in one ultrasound image of the group of ultrasound images for placing a Doppler gate, tracking the gate location across the group of ultrasound images based on anatomical landmarks, and automatically positioning the Doppler gate at the tracked gate location.

[0100] Doppler assessment of the fetal heart is used to evaluate septal defects and valvular disorders. Diastolic perfusion across the atrioventricular valves is evaluated using color Doppler ultrasound measurements in an apical or basal approach. Using pulsed Doppler ultrasound, the typical biphasic shape of the diastolic flow velocity waveform is observed, with an early peak diastolic velocity and a second peak at atrial contraction. In this plane, regurgitant flow across the atrioventricular valves, which occurs more frequently at the tricuspid valve, is detected during systole using color Doppler imaging. Flow across the foramen ovale is visualized in a lateral approach in a four-chamber view. Color Doppler imaging provides confirmation of a physiological right-to-left shunt and visualization of the pulmonary veins as they enter the left atrium.

[0101] In the above Doppler acquisitions, a Doppler gate must be placed at the relevant location for each of the above assessments. The gate location can be automatically detected using the tracking points described above. For example, tracking points can be used to place a color Doppler window in a four-chamber view. Additionally, tracking points can be used to place a pulsed Doppler gate at the valve to measure AV flow.

[0102] Additionally, the method further includes performing automated M-mode data acquisition from the group of ultrasound images, the automated M-mode data acquisition including defining one or more sets of beamlines in the group of ultrasound images automatically based on the tracked anatomical features, acquiring M-mode data along the beamlines, and tracking the beamlines at anatomical locations based on the tracked anatomical features throughout the cardiac cycle.

[0103] The dynamic model described above is utilized for auto-defined M-mode data acquisition, where lines are drawn between relevant selected structures such as atria, ventricles, left atrium with left ventricle, right atrium with right ventricle, and left-right crossings. Due to the known anatomical context of the tracking points, combined with the anatomical intelligence of the model, the resulting data can be used to detect arrhythmias and also to identify exactly where they are coming from.

[0104] The above method may be integrated into any suitable ultrasound imaging or other processing system to provide workflow-guided assessment of the heart for analysis of the fetal heart by identifying key anatomical landmarks and tracking them in real time to allow separate assessment of the structural and functional aspects of each of these structures. Such a system may include a user interface for one-click assessment of fetal cardiac structures, for example to identify fetal heart defects.

[0105] This simplifies fetal cardiac assessment and allows for set-up of guidance workflows.

[0106] Other variations of the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure and the appended claims. In the claims, the word "comprises" does not exclude other elements or steps, and the singular does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be interpreted as limiting the scope.

Claims

1. 16. A method of operating a system for deriving fetal heart biometric parameters, the system including a processor, the method comprising: acquiring a plurality of ultrasound images of a region of interest including a fetal heart; the processor comparing the plurality of ultrasound images to a predefined clinical view and a group of ultrasound images associated with the predefined clinical view to select a matching group of ultrasound images representing at least one cardiac cycle; detecting an anatomical landmark of the fetal heart in an ultrasound image of the group of ultrasound images; the processor detecting or tracking the anatomical landmarks of the fetal heart throughout the group of ultrasound images; deriving, by the processor, biometry parameters of the fetal heart based on the detected or tracked anatomical landmarks from one or more ultrasound images of the group of ultrasound images; A method comprising:

2. The step of tracking anatomical landmarks includes: the processor automatically detecting anatomical landmarks in the ultrasound images using a dynamic motion model of the fetal heart; the processor detecting and tracking the anatomical landmarks throughout the group of ultrasound images using a dynamic motion model of the fetal heart; The method of claim 1 , comprising:

3. The plurality of ultrasound images are 2D ultrasound images, and the tracking points of the dynamic motion model are derived from the images; or a 3D ultrasound image, the tracking points of the dynamic motion model being derived from a volume; the tracking points correspond to the anatomical landmarks; The method of claim 2.

4. 4. The method of claim 1, further comprising: detecting a plurality of anatomical landmarks by the processor; tracking the plurality of anatomical landmarks across the group of ultrasound images by the processor; and deriving biometric parameters of the fetal heart based on the plurality of tracked anatomical landmarks.

5. 5. The method of claim 1, wherein the plurality of ultrasound images are 2D ultrasound images, and the method includes the step of the processor deriving 3D biometry parameters based on the plurality of tracked anatomical landmarks.

6. The predefined clinical view may include: Abdominal view, 4 chamber view, Left ventricular outflow tract view, Right ventricular outflow tract view, 3 vascular view, 3 Vascular tracheal view, Aortic arch view, and Arch of the arteries view, The method of claim 1 , further comprising one or more of the following:

7. The method of claim 1 , wherein the predefined clinical view comprises a plurality of views.

8. The method of claim 7 , wherein the method includes the processor bookmarking a 2D ultrasound image for each of the multiple views at a common point in the cardiac cycle.

9. The method of claim 1 , further comprising the step of the processor bookmarking ultrasound images of interest based on the derived biometric parameters.

10. The method of claim 1 , further comprising the step of the processor bookmarking a cine-loop of an ultrasound image of interest based on the derived biometric parameters.

11. The biometric parameters are: Abdominal parameters, Chest parameters, Atrial parameters, Ventricular parameters, Arterial parameters, wall parameters, and Valve parameters, The method of claim 1 , wherein the first and second parameters are derived from one or more of the following:

12. The method comprises: the processor identifying a gate location in an ultrasound image in the group of ultrasound images for placing a Doppler gate at the anatomical landmark; the processor tracking the gate location across the group of ultrasound images based on the anatomical landmarks; the processor automatically positions the Doppler gate at the tracked gate location; The method of claim 1 , further comprising:

13. The method further includes the processor performing automated M-mode data acquisition from the group of ultrasound images, the step of performing automated M-mode data acquisition comprising: the processor automatically defining one or more sets of beamlines for the group of ultrasound images based on tracked anatomical structures; the processor collecting M-mode data along the beamline; the processor tracking the beamline at an anatomical location based on anatomical features tracked throughout the cardiac cycle; 13. The method of any one of claims 1 to 12, comprising:

14. 1. A system for deriving fetal heart biometric parameters, the system including a processor, the processor comprising: obtaining a plurality of ultrasound images of a region of interest including the fetal heart; comparing the plurality of ultrasound images to a predefined clinical view and a group of ultrasound images associated with the predefined clinical view to select a matching group of ultrasound images representing at least one cardiac cycle; detecting anatomical landmarks of the fetal heart in the group of ultrasound images; tracking the anatomical landmarks of the fetal heart across the group of ultrasound images; deriving biometric parameters of the fetal heart based on the tracked anatomical landmarks; and Run the system.

15. A computer program comprising computer program code which causes the method of any one of claims 1 to 13 to be performed when the computer program is executed on a processor of a system according to claim 14.

Citation Information

Patent Citations

  • Device and method for obtaining anatomical measurements from an ultrasound image

    EP3513731A1

  • Identifying an optimal image from a number of ultrasound images

    EP3590436A1

  • Method and apparatus for recognizing moving anatomical structures using ultrasound

    JP2012529329A

  • Automated heart rate detection for 3D ultrasound fetal imaging

    JP2013528458A

  • Automatic placement of standard planes for real-time fetal cardiac evaluation.

    JP2015534872A