Improved Cardiac Ultrasound Imaging

By employing model-based segmentation to predict dropout regions in cardiac ultrasound images and adjusting signal processing and transmission parameters accordingly, the method enhances SNR in cardiac ultrasound images without compromising frame rates, addressing the limitations of existing techniques.

JP7648005B2Active Publication Date: 2025-03-18KONINKLIJKE PHILIPS NV
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024516607
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-10-14
Filing Date
2022-09-29
Publication Date
2025-03-18
Estimated Expiration
2042-09-29

AI Technical Summary

Technical Problem

Existing techniques for improving the signal-to-noise ratio (SNR) in cardiac ultrasound images increase computational complexity and lower frame rates, making them unsuitable for default imaging modes.

Method used

A method that uses model-based segmentation to identify cardiac anatomy and predict the location of dropout regions, allowing for the application of different echo signal processing and transmission parameters specifically to these areas to enhance SNR without significantly affecting frame rates.

Benefits of technology

This approach effectively improves the SNR in regions with low visibility, such as sidewalls, while maintaining frame rates and reducing computational complexity, making it suitable for inclusion in default imaging modes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007648005000001
    Figure 0007648005000001
  • Figure 0007648005000002
    Figure 0007648005000002
  • Figure 0007648005000003
    Figure 0007648005000003
Patent Text Reader

Abstract

The ultrasound probe is controlled to receive first reflected ultrasound echo signals from the heart transmitted using first transmit parameters, and an ultrasound image of the heart is generated from the first reflected ultrasound echo signals using the first echo signal processing parameters. A model-based segmentation is performed on the ultrasound image to identify anatomical structures of the heart, and for at least one anatomical structure having a region of dropout, the segmentation is used to extrapolate from the identified anatomical structure to identify a location within the image of the region of dropout. A subsequent ultrasound image of the heart is acquired using different second echo signal processing parameters, in particular the transmit parameters for the at least one anatomical structure, thereby improving the signal-to-noise ratio for at least the region of dropout.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to the field of cardiac ultrasound imaging, and in particular to improving the signal-to-noise ratio of cardiac ultrasound images. [Background technology]

[0002] The visibility of side walls in cardiac ultrasound B-mode images is an important image quality component in cardiac ultrasound imaging. In many cardiac ultrasound images, the side walls are not visible due to a low signal-to-noise ratio (SNR). There are known techniques in the image formation process to improve the SNR, most of which involve averaging over some dimension, such as adjusting the receive beamforming (such as the number of elevation planes) using multiple transmit pulses per scanline, and adjusting retrospective transmit beamforming. Summary of the Invention [Problem to be solved by the invention]

[0003] However, when these techniques are applied to ultrasound images, the computational complexity increases significantly, which is likely to result in a decrease in frame rate. These drawbacks may prevent these techniques from being included as part of the default imaging mode. Therefore, improved methods for improving the SNR of cardiac ultrasound images are needed.

[0004] US Patent Application Publication No. 2021 / 128114(A1) discloses a method for automatically adjusting beamformer parameters based on ultrasound image analysis to improve ultrasound image acquisition. [Means for solving the problem]

[0005] The invention is defined by the claims.

[0006] According to an embodiment of the present invention, 1. A method of imaging the heart, comprising: controlling an ultrasound probe to receive a first reflected ultrasound echo signal from the heart, the first reflected ultrasound echo signal being transmitted using first transmit parameters; generating an ultrasound image of the heart from the first reflected ultrasound echo signals using first echo signal processing parameters; performing a model-based segmentation of the ultrasound image to identify the cardiac anatomical structures; for at least one anatomical structure having a region of dropout, using said segmentation to extrapolate from said identified anatomical structure to identify a location within the image of said region of dropout; acquiring subsequent ultrasound images of the heart using different second echo signal processing parameters and / or different second transmit parameters, in particular for the at least one anatomical structure or for a region of a dropout for the at least one anatomical structure, thereby improving the signal-to-noise ratio for the at least one region of a dropout; A method is provided comprising:

[0007] A region of dropout may be a region of an anatomical structure where the received ultrasound signal is relatively weak. A region of dropout (i.e., a dropout region) may be a region of an ultrasound image having an SNR less than 15 dB or less than 10 dB.

[0008] Often, in ultrasound images where the sidewalls are not visible (or are barely visible), the sidewalls are the only areas of the image where SNR improvement is needed, since the image still has sufficient SNR. If the lateral location is known a priori, an averaging technique for improving the SNR (i.e., by using different signal processing parameters) can be selectively applied to areas of the image that contain the lateral direction. This limits the drawbacks of using this technique (i.e., reduced frame rate, increased computational complexity). However, it can be difficult to determine where the sidewalls are in the image before performing a scan, as this varies from subject to subject and depends on the position and orientation of the ultrasound probe relative to the subject's heart.

[0009] Thus, model-based segmentation can be used to identify anatomical structures such as sidewalls in ultrasound images of the heart. Model-based segmentation may be able to segment regions of the anatomical structure that have low SNR (i.e., regions that are barely visible in the ultrasound image). In other words, model-based segmentation may be able to predict the location of regions of the anatomical structure (that have dropouts) given other (visible) regions of the anatomical structure.

[0010] A central assumption of model-based segmentation approaches is that structures of interest have a tendency towards a particular shape. In other words, the segmentation is biased towards a particular shape. This is of particular interest in the case of cardiac images, since the heart is expected to have a particular shape regardless of the subject. Therefore, a probabilistic model can be derived that characterizes the shape of the heart (and its variability) for model-based segmentation. This model can be used as a priori information to impose constraints when segmenting images. Such a task may involve alignment of training examples to a common pose, a probabilistic representation of the variability of the aligned samples, and statistical inference between the model and the images.

[0011] For example, the Philips HeartModel™ is a model-based segmentation algorithm that can identify and label cardiac structures in ultrasound B-mode images. Thus, an initial scan can be performed using a default imaging plan (i.e., first echo signal processing parameters) to generate input for the cardiac model. Model-based segmentation using the cardiac model can then detect regions of the image that contain sidewalls, or, if the sidewalls are not visible, predict the likely location of the sidewalls given other cardiac structures.

[0012] The locations of dropouts may be identified based on the output of the model-based segmentation (i.e., the locations of anatomical structures) that have low SNR.

[0013] The second transmit parameter and / or the second echo signal processing parameter may thereby be selected to improve the SNR of the ultrasound image relative to the first transmit parameter and / or the first echo signal processing parameter, respectively.

[0014] Typically, the area of ​​dropout may cover about 10% to 25% of the scan lines of an ultrasound image, so having different transmit / receive parameters for this small area of ​​the ultrasound image does not impact computational resources and / or frame rate as much as using different transmit / receive parameters for everyone's ultrasound image.

[0015] Acquiring a subsequent ultrasound image of the heart using different second echo signal processing parameters and / or second different transmit parameters may be specifically only for at least one anatomical structure or only for the region of dropout.

[0016] Obtaining a next ultrasound image of the heart may include controlling the ultrasound probe to receive a second reflected ultrasound echo signal, the second reflected ultrasound echo signal being transmitted using second transmit parameters, and optionally applying different second echo signal processing parameters to the second reflected ultrasound echo signal.

[0017] The second different transmit parameters may comprise different beamforming parameters compared to the first transmit parameters, the second transmit parameters being: an increased number of transmit pulses per scan line; Increased transmit aperture, Increased scanline density, Different pulse frequencies, and Different pulse shapes Contains one or more of the following:

[0018] Obtaining a subsequent ultrasound image of the heart may include applying different second echo signal processing parameters to the first reflected ultrasound echo signal.

[0019] The first and second echo signal processing parameters may comprise parameters for retrospective dynamic transmit focusing. For example, they may include the number of transmit beams combined per scan line. The number of transmit beams combined may be greater for the second echo signal processing parameters than for the first echo signal processing parameters.

[0020] The parameters for retrospective dynamic transmit focusing may comprise the number of so-called "multilines in" per transmit beam. The number of multilines for the second echo signal processing parameter may be greater than the number of multilines for the first echo signal processing parameter. Forming multilines may be a prerequisite for retrospective dynamic transmit focusing. In order to increase the number of transmit beams per scan line, it may be necessary to increase the number of multilines.

[0021] The first and second echo signal processing parameters may include parameters for elevation spatial compounding. For example, they may include a number of elevation planes. The number of elevation planes of the second echo signal processing parameters may be greater than the number of elevation planes of the first echo signal processing parameters.

[0022] The first and second echo signal processing parameters may include a frequency compounding parameter, and the frequency compounding parameter of the second echo signal processing parameter may be selected to improve the contrast-to-noise ratio of the dropout region.

[0023] The first and second echo signal processing parameters may include a spatial compounding parameter, and the spatial compounding parameter of the second echo signal processing parameter may be selected to improve the contrast-to-noise ratio of the dropout region.

[0024] Identifying the location within the image of the dropout region may include using a confidence measure generated by the model-based segmentation.

[0025] The at least one anatomical structure can include a lateral heart wall.

[0026] The invention also provides a computer program comprising computer program code adapted to perform the method for cardiac imaging as described above, when said program is run on a computer.

[0027] The present invention also provides an ultrasound imaging system for imaging the heart, comprising:

[0028] an ultrasound probe for transmitting a first ultrasound signal using first transmit parameters and receiving a first reflected ultrasound echo signal from the heart;

[0029] an imaging system for generating an ultrasound image of the heart using the first echo signal processing parameters;

[0030] a model-based segmentation unit for identifying anatomical structures of the heart from the ultrasound image, the image-based segmentation unit being adapted to extrapolate from the identified anatomical structures to identify locations within the image of regions of dropout of at least one anatomical structure;

[0031] a controller adapted to select different second echo signal processing parameters and / or different second transmit parameters in particular for said at least one anatomical structure or for a region of a dropout for said anatomical structure, thereby improving the signal-to-noise ratio at least for said region of a dropout. An ultrasound imaging system is also provided.

[0032] The controller may be adapted to control the ultrasound probe to transmit a second ultrasound signal using second, different transmit parameters and to receive a second reflected ultrasound echo signal from the heart, and optionally to apply different, second echo signal processing parameters to the second reflected ultrasound echo signal.

[0033] The controller may be adapted to apply different second echo signal processing parameters to the first reflected ultrasound echo signal.

[0034] The image-based segmentation unit may be adapted to identify locations within the image of the dropout regions by extrapolating from the identified anatomical structures and using the confidence measure generated by the model-based segmentation.

[0035] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.

[0036] For a better understanding of the invention and to show more clearly how it may be carried into effect, reference will now be made, by way of example only, to the accompanying drawings in which: [Brief description of the drawings]

[0037] [Figure 1] 1 illustrates the general operation of an exemplary ultrasound system. [Diagram 2] 1 shows an ultrasound image of the heart. [Diagram 3] 1 shows the output of model-based segmentation on an ultrasound image of the heart. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0038] The present invention will now be described with reference to the drawings.

[0039] It should be understood that the detailed description and specific examples, while indicating exemplary embodiments of the devices, systems, and methods, are for purposes of illustration only and are not intended to limit the scope of the invention. These and other features, aspects, and advantages of the devices, systems, and methods of the present invention will become better understood from the following description, appended claims, and accompanying drawings. It should be understood that the figures are merely schematic and are not drawn to scale. It should also be understood that the same reference numerals are used throughout the figures to denote the same or similar parts.

[0040] The invention provides a method of imaging the heart, where an ultrasound probe is controlled to receive first reflected ultrasound echo signals from the heart transmitted using first transmission parameters, and an ultrasound image of the heart is generated from the first reflected ultrasound echo signals using first echo signal processing parameters. A model-based segmentation is performed on the ultrasound image to identify anatomical structures of the heart, and for at least one anatomical structure having a dropout region, the segmentation is used to extrapolate from the identified anatomical structure to identify a location in the image of the dropout region. A subsequent ultrasound image of the heart is acquired using different second echo signal processing parameters and / or different second transmission parameters, in particular for the at least one anatomical structure or for a region of dropout for the at least one anatomical structure, thereby improving the signal-to-noise ratio for the at least one region of dropout.

[0041] With reference to FIG. 1, since the present invention is concerned with processing signals measured by a transducer array, the general operation of an exemplary ultrasound system will first be described with emphasis on the signal processing functions of the system.

[0042] The system includes an array transducer probe 4 having a transducer array 6 for transmitting ultrasound waves and receiving echo information. The transducer array 6 may include CMUT transducers, piezoelectric transducers formed from materials such as PZT or PVDF, or any other suitable transducer technology. In this example, the transducer array 6 is a two-dimensional array of transducers 8 capable of scanning either a 2D plane or a three-dimensional volume of an area of ​​interest. In another example, the transducer array may be a 1D array.

[0043] The transducer array 6 is coupled to a microbeamformer 12 which controls reception of signals by the transducer elements. The microbeamformer is capable of at least partial beamforming of signals received by subarrays of transducers (commonly referred to as "groups" or "patches") as described in U.S. Patents 5,997,479 (Savord et al.), 6,013,032 (Savord), and 6,623,432 (Powers et al.).

[0044] It should be noted that the microbeamformer is entirely optional. Additionally, the system includes a transmit / receive (T / R) switch 16 to which the microbeamformer 12 may be coupled to switch the array between transmit and receive modes and to protect the main beamformer 20 from high energy transmit signals when the microbeamformer is not used and the transducer array is operated directly by the main system beamformer. The transmission of ultrasound beams from the transducer array 6 is directed by a transducer controller 18 coupled to the microbeamformer by the T / R switch 16 and a main transmit beamformer (not shown) that may receive input from user operation of a user interface or control panel 38. The controller 18 may include transmit circuitry configured to drive the transducer elements of the array 6 (directly or via the microbeamformer) during transmission mode.

[0045] In a typical line-by-line imaging sequence, the beamforming system in the probe may operate as follows: During transmit, the beamformer (which may be a microbeamformer or a main system beamformer, depending on the implementation) activates the transducer array, or a subaperture of the transducer array. A subaperture may be a one-dimensional line of transducers, or a two-dimensional patch of transducers within a larger array. In transmit mode, the focusing and steering of the ultrasound beams generated by the array or subapertures of the array are controlled as described below.

[0046] Upon receiving the backscattered echo signals from the subject, the received signals undergo receive beamforming (as described below) to align the received signals, and if subapertures are used, the subapertures are shifted, for example, by one transducer element, and then the shifted subaperture is activated and the process is repeated until all of the transducer elements of the transducer array have been activated.

[0047] For each line (or sub-aperture), the total received signal used to form the associated line of the final ultrasound image is the sum of the voltage signals measured by the transducer elements of the given sub-aperture during the receive period. The resulting line signals, following the beamforming process, are usually referred to as radio frequency (RF) data. Each line signal (RF data set) generated by the various sub-apertures then undergoes additional processing to generate a line of the final ultrasound image. The change in amplitude of the line signal with time contributes to the change in brightness of the ultrasound image with depth, with high amplitude peaks corresponding to bright pixels (or groups of pixels) in the final image. Peaks appearing near the beginning of the line signal represent echoes from shallow structures, while peaks appearing gradually later in the line signal represent echoes from structures with increasing depth within the subject.

[0048] One of the functions controlled by the transducer controller 18 is the direction in which the beam is steered and focused. The beam may be steered straight ahead (orthogonal) from the transducer array, or at a different angle to a wider field of view. The steering and focusing of the transmit beam may be controlled as a function of the activation time of the transducer elements.

[0049] Two methods can be distinguished in general ultrasound data acquisition: plane wave imaging and "beam steering" imaging. The two methods are distinguished by the presence of beamforming in the transmit ("beam steering" imaging) and / or receive modes (plane wave imaging and "beam steering" imaging).

[0050] Looking first at the focusing function, by activating all of the transducer elements simultaneously, the transducer array creates a plane wave that diverges as it travels through the subject. In this case, the beam of ultrasound remains unfocused. By introducing position-dependent time delays in the activation of the transducers, it is possible to focus the wavefront of the beam to a desired point, called a focal zone. A focal zone is defined as a point where the lateral beam width is less than half the transmit beam width. In this way, the lateral resolution of the final ultrasound image is improved.

[0051] For example, if a time delay activates the transducer elements successively, starting with the outermost elements of the transducer array and finishing with the central elements, a focal zone is formed along the central elements at a predetermined distance from the probe. The distance of the focal zone from the probe varies according to the time delay between each subsequent round of transducer element activation. After the beam passes through the focal zone, it begins to diverge, forming a far-field imaging region. It is noted that with focal zones located close to the transducer array, the ultrasound beam diverges rapidly in the far field, leading to beamwidth artifacts in the final image. Typically, the near field located between the transducer array and the focal zone shows little detail due to the large overlap of the ultrasound beams. Thus, changing the location of the focal zone can result in significant changes in the quality of the final image.

[0052] It should be noted that in transmit mode, only one focal point may be defined, unless the ultrasound image is divided into multiple focal zones (each of which may have a different transmit focal point).

[0053] Also, upon receiving echo signals from within the subject, the above process can be reversed to provide receive focusing. In other words, the input signals can be received by the transducer elements and subjected to electronic time delays before being passed to the system for signal processing. The simplest example of this is called delay-and-sum beamforming. It is possible to dynamically adjust the receive focusing of the transducer array as a function of time.

[0054] Looking now at the function of beam steering, through the correct application of time delays to the transducer elements, it is possible to give the ultrasound beam a desired angle as it exits the transducer array. For example, by activating transducers on a first side of the transducer array and then activating the remaining transducers in a sequence ending on the opposite side of the array, the wavefront of the beam is angled toward the second side. The magnitude of the steering angle relative to the normal of the transducer array depends on the magnitude of the time delay between the activation of subsequent transducer elements.

[0055] Furthermore, it is possible for the total time delay applied to each transducer element to focus the steering beam by the sum of both the focus time delay and the steering time delay, in which case the transducer array is called a phased array.

[0056] For CMUT transducers that require a DC bias voltage for activation, the transducer controller 18 can be coupled to control a DC bias control 45 for the transducer array. The DC bias control 45 sets the DC bias voltage applied to the CMUT transducer elements.

[0057] For each transducer element of the transducer array, an analog ultrasound signal, typically called channel data, enters the system via a receive channel, where a partially beamformed signal is generated from the channel data by the microbeamformer 12 and then passed to the main receive beamformer 20, where the partially beamformed signals from the individual patches of the transducer are combined into a fully beamformed signal, called radio frequency (RF) data. The beamforming performed at each stage may be performed as described above or may include additional functions. For example, the main beamformer 20 may have 128 channels, each of which receives partially beamformed signals from patches of tens or hundreds of transducer elements. In this way, the signals received by the thousands of transducers of the transducer array can be efficiently contributed to a single beamformed signal.

[0058] The beamformed received signals are coupled to a signal processor 22. The signal processor 22 may process the received echo signals in various ways, such as bandpass filtering, decimation, I and Q component separation, and harmonic signal separation, which acts to separate linear and nonlinear signals to allow identification of nonlinear (harmonic of fundamental frequency) echo signals returning from tissue and microbubbles. The signal processor may also perform additional signal enhancements, such as speckle reduction, signal synthesis, and noise removal. The bandpass filters in the signal processor may be tracking filters whose passbands slide from higher to lower frequency bands as echo signals are received from increasing depths, thereby eliminating noise at higher frequencies from greater depths that typically lack anatomical information.

[0059] The beamformers for transmit and receive can be implemented with different hardware and have different functionality. Of course, the receiver beamformer is designed to take into account the characteristics of the transmit beamformer. In Fig. 1, for simplicity, only the receiver beamformers 12, 20 are shown. In a complete system, there will also be a transmit chain with a transmit microbeamformer and a main transmit beamformer.

[0060] The function of the microbeamformer 12 is to provide an initial combination of signals to reduce the number of analog signal paths, which is typically performed in the analog domain.

[0061] Final beamforming occurs in the main beamformer 20, typically after digitization.

[0062] The transmit and receive channels use the same transducer array 6 with a fixed frequency band. However, the bandwidth occupied by the transmit pulses can vary depending on the transmit beamforming used. The receive channels can capture the entire transducer bandwidth (classical approach) or, by using bandpass processing, extract only the bandwidth containing the desired information (e.g. harmonics of the main harmonic).

[0063] The RE signals may then be coupled to a B-mode (i.e., intensity mode, or 2D imaging mode) processor 26 and a Doppler processor 28. The B-mode processor 26 performs amplitude detection on the received ultrasound signals to image body structures such as organ tissues and blood vessels. For line-by-line imaging, each line (beam) is used to generate an intensity value to be assigned to a pixel in the B-mode image, with the associated RE signal amplitude. The exact location of the pixel in the image is determined by the location of the amplitude measurement associated with the RE signal and the number of lines (beams) of the RF signal. B-mode images of such structures can be formed in harmonic or fundamental imaging modes, or a combination of both, as described in U.S. Pat. No. 6,283,919 (Roundhill et al.) and U.S. Pat. No. 6,458,083 (Jago et al.). The Doppler processor 28 processes the time-varying signals resulting from tissue motion and blood flow for detection of moving material, such as flowing blood cells, within the image field. The Doppler processor 28 typically includes a wall filter with parameters set to pass or reject echoes returned from selected types of materials within the body.

[0064] The structural and motion signals generated by the B-mode and Doppler processors are coupled to the scan converter 32 and the multiplanar reformatter 44. The scan converter 32 arranges the echo signals in the spatial relationship from which they were received and in the desired image format. In other words, the scan converter acts to convert the RF data from a cylindrical coordinate system to a Cartesian coordinate system suitable for displaying ultrasound images on the image display 40. For a B-mode image, the brightness of a pixel at a given coordinate is proportional to the amplitude of the RF signal received from that location. For example, the scan converter may arrange the echo signals in a two-dimensional (2D) sector format, or a pyramidal three-dimensional (3D) image. The scan converter may overlay a B-mode structural image with a color corresponding to the motion at the point in the image field, where the Doppler estimated velocity produces a given color. The combined B-mode structural image and color Doppler image depict the tissue motion and blood flow within the structural image field. The multiplanar reformatter converts echoes received from points in a common plane within a volumetric region of the body into an ultrasound image of that plane, as described in U.S. Patent 6,443,896 (Detmer). The volume renderer 42 converts the echo signals of the 3D data set into a projected 3D image viewed from a given reference point, as described in U.S. Patent 6,530,885 (Entrekin et al.).

[0065] The 2D or 3D images are coupled from the scan converter 32, multiplanar reformatter 44, and volume renderer 42 to the image processor 30 for further enhancement, buffering, and temporary storage for display on the image display 40. The imaging processor may be adapted to remove certain imaging artifacts from the final ultrasound image, such as acoustic shadowing caused by strong attenuators or refraction, back enhancement caused by weak attenuators, and reverberation artifacts where highly reflective tissue interfaces are located in close proximity. In addition, the image processor may be adapted to process certain speckle reduction functions to improve the contrast of the final ultrasound image.

[0066] In addition to being used for the images, the blood flow values ​​produced by the Doppler processor 28 and the tissue structure information produced by the B-mode processor 26 are coupled to a quantification processor 34. The quantification processor produces measurements of different flow conditions, such as volumetric velocity of blood flow, in addition to structural measurements such as organ size and gestational age. The quantification processor can receive input from a user control panel 38, such as the points within the anatomical structures in the image where measurements are to be taken.

[0067] Output data from the quantification processor is coupled to a graphics processor 36 for reproducing measurement graphics and values ​​with images on a display 40 and audio output from the display device 40. The graphics processor 36 can also generate graphic overlays for display with the ultrasound images. These graphic overlays can include standard identification information such as the patient name, date and time of the image, imaging parameters, etc. For these purposes, the graphics processor receives inputs such as the patient name from a user interface 38. The user interface is also coupled to a transmit controller 18 for controlling the generation of ultrasound signals from the transducer array 6 and, therefore, the generation of images generated by the transducer array and the ultrasound system. The transmit control function of the controller 18 is only one of the functions performed. The controller 18 also takes into account the operating mode (given by the user) and the corresponding required transmitter settings and bandpass settings in the receiver analog-to-AD converter. The controller 18 can be a state machine with fixed states.

[0068] The user interface is also coupled to a multiplanar reformatter 44 for selection and control of multiple multiplanar reformat (MPR) image planes that can be used to perform quantified measurements in the image field of the MPR images.

[0069] An objective of the present invention is to increase the signal-to-noise ratio (SNR) in regions of the ultrasound image where sidewalls are expected to appear. By using a cardiac model to predict the likely location of the sidewalls, SNR boosting techniques can be selectively applied to limit the negative consequences of these techniques on frame rate and computational complexity.

[0070] 2 shows an illustration of an ultrasound image of the heart and is used to explain the processing steps for improving the signal-to-noise ratio. A first B-mode ultrasound image 202 is acquired using default imaging technique and parameters, which are first transmit parameters and first echo signal processing parameters.

[0071] In general, the first image 202 is acquired using first transmit parameters and first receive parameters (i.e., first echo signal processing parameters). The transmit parameters are parameters that affect the transmit pulses of the ultrasound probe / transducer. The receive parameters are parameters that affect the processing of the received echo signals.

[0072] Model-based segmentation (MBS) is applied to the first image 202 (e.g., using a fast cardiac model) to identify anatomical structures of the heart. The identified anatomical structures can be seen in the segmented ultrasound image 204. As can be seen in the segmented image 204, MBS is able to identify where regions of the anatomical regions should be, even though certain regions are not visible due to dropouts because the ultrasound signal is too weak.

[0073] Thus, the image of the anatomical structure has a dropout region represented by image portion 206, and segmentation is used to extrapolate from the identified anatomical structure in image 204 to identify the location within the image of the dropout region.

[0074] For example, regions of the first image 202 that contain a sidewall (if a sidewall is visible) or are expected to contain a sidewall (if a sidewall is not visible) are identified based on the segmentation. This can be seen in the upper left region of the segmented image 204, where a sidewall was identified even though the MBS is not shown in the first image 202.

[0075] MBS is known as a robust technique to apply to ultrasound images even in the presence of missing or noisy data. It is therefore capable of predicting anatomical regions such as the lateral wall based on a trained constellation model. Applying MBS with a small number of mesh points and iterations allows for rapid adaptation to the image with sufficient accuracy.

[0076] This allows, for example, to identify sidewall regions in one frame and dynamically adapt the imaging parameters (i.e., transmit and / or receive parameters) for the next frame of the ultrasound sequence. Fast models can be used to identify regions that are often affected by poor visibility or dropout.

[0077] The next step involves acquiring a second ultrasound image 208 that has a better SNR for the sidewalls than the first image 202 for the dropout region 206 .

[0078] This second ultrasound image may be acquired by using different second echo signal processing parameters and / or by using second different transmit parameters for the at least one anatomical structure or for the dropout region 206 for the at least one anatomical structure.

[0079] A first embodiment 208 for obtaining a second image includes retransmitting a new scan line pulse sequence for the dropout region 206. In practice, when performing cardiac ultrasound imaging, the dropout region 206 is likely to be a sidewall.

[0080] For image lines that include sidewalls (i.e., corresponding to dropout regions 206), instead of transmitting one pulse at this location and acquiring one set of channel data at these locations, it is proposed to transmit N pulses and acquire N sets of channel data. For example, the number of pulses per line may be increased from 1 to 2 or 3.

[0081] The transmit pulses may also be transmitted at different frequencies and / or with different waveforms. These variations may help to decorrelate the acoustic multipath noise and therefore improve the SNR of the second image 208.

[0082] Additionally, if the default image settings (i.e., first transmit parameters) are not using the maximum transmit aperture (corresponding to the thinnest, most focused transmit beam), the transmit aperture can be increased for the scan lines around the dropout region 206. For example, the line density may be increased from 1 degree to 0.25 degrees.

[0083] For each scan line location where multiple data sets (e.g., N transmit pulses) are acquired, the data sets acquired for the same location may be averaged. If the receive beamforming is based on retrospective transmit beamforming, the averaging may need to be performed before the retrospective transmit beamforming.

[0084] Retrospective transmit beamforming can be used to form synthetically focused ultrasound images using standard (scanned and focused) ultrasound transmissions. In general, retrospective transmit beamforming is a synthetic focusing technique that forms images using a combination of standard scanned beam transmit data, dynamic receive focusing, and time-aligned data from multiple transmit beams.

[0085] Beamforming can also be based on multiline beamforming. Multiline beamforming is based on acquiring two or more scan lines (i.e., multilines in) for a single transmit beam to increase the frame rate. The number of multilines per transmit beam is based on the width of the transmit beam (i.e., the wider the transmit beam, the more lines can be acquired). Multiline beamforming can be a prerequisite for retrospective transmit beamforming. Retrospective transmit beamforming is a known method for increasing the SNR of ultrasound images. The number of multilines can be a parameter of retrospective transmit beamforming. Thus, the first and second echo signal processing parameters can comprise parameters for retrospective transmit beamforming, which can include the number of acquired multilines and / or the number of combined transmit beams.

[0086] The number of multilines may be adapted, for example, prior to adapting the number of transmit beams that are combined in retrospective transmit beamforming.

[0087] However, averaging of the transmit pulses can occur either before or after the receive multiline formation. In general, some form of averaging is performed over one or more dimensions along which several acquisitions were taken. The averaging can be coherent and / or incoherent.

[0088] The remaining image formation process (as described above) of the second image 208 may be performed based on a conventional process (e.g., identical to the image formation process of the first image 202). This is possible because the change in the transmission parameters of the dropout region 206 should improve the SNR of the sidewall regions compared to the first image 202.

[0089] In general, the first embodiment can be summarized as identifying a dropout region 206 from a first image 202, adapting transmit parameters (e.g., via optimization), for example, using known SNR improvement techniques, and acquiring a subsequent second image 208 in which the dropout region 206 is acquired with the adapted (second) transmit parameters. By continually applying MBS to each ultrasound frame, it is possible to refine the region of interest or track it as the object or transducer moves. The first embodiment described above involves retransmitting a custom pulse sequence after performing an MBS (e.g., a Philips cardiac model) on the first ultrasound image 202. While this approach is theoretically possible, implementing this strategy may require significant software and / or field programmable gate array (FPGA) code modification and rework. Thus, in some cases, it may be preferable not to adapt the transmit parameters.

[0090] A second embodiment is proposed that does not involve retransmission. Instead of acquiring new echo signal data, the channel data used to generate the first image 202 is reprocessed differently (i.e., with different receiving parameters) after the MBS identifies the dropout region 206. Various SNR boosting techniques are proposed below.

[0091] An exemplary SNR boosting technique for receive parameters involves increasing the number of simultaneous receive beams per transmit beam formed (up to a certain point depending on the width of the transmit beam) and then increasing the number of transmit beams combined per scan line when using a retrospective dynamic transmit focusing approach (i.e., a version of retrospective transmit beamforming) in the dropout region 206. Retrospective dynamic transmit focusing averages multiple transmit beams for a single location to increase the signal-to-noise ratio. When multiple transmit beams are combined to generate each scan line and each transmit beam has a different noise pattern, the noise adds incoherently while the signal adds coherently, thus improving the signal-to-noise ratio.

[0092] In general, parameters of the retrospective dynamic transmit focusing may be adapted to increase the SNR in the dropout region 206. The parameters of the retrospective dynamic transmit focusing may include the number of multilines and / or the number of transmit beams that are combined (e.g., averaged).

[0093] Another exemplary SNR boosting technique for receive parameters involves forming and averaging many closely spaced elevation planes used in an elevation spatial compounding approach in the dropout region 206. The averaging can be done coherently in the beam-summed RF domain, or incoherently after logarithmic compression, in which case it is usually called "elevation compounding." The number of elevation planes can only be increased to a point before a reduction in feedback is realized, since the elevation planes must all fit within the transmit diagonal beam.

[0094] In general, the parameters of the advanced spatial compounding can be adapted to increase the SNR in the dropout region 206 .

[0095] Adapting the amount of frequency compounding and / or performing additional spatial compounding may also be used to improve the contrast-to-noise ratio in the dropout region 206. However, improving the contrast-to-noise ratio by varying the frequency compounding and / or performing additional spatial compounding may come at the expense of resolution.

[0096] Frequency compounding is commonly used to reduce speckle variance in ultrasound images in order to improve contrast resolution by averaging two or more uncorrelated subband images (after receive beamforming). In other words, two or more different bandpass filters are applied to the received echoes and the results are averaged.

[0097] Similarly, spatial compounding involves acquiring echo data from several different angles and combining them (eg, by averaging) to produce a single ultrasound image.

[0098] Increasing the number of transmit beams combined in retrospective dynamic transmit focusing and creating closely spaced elevation planes can be used together or separately.

[0099] The first embodiment (changing the transmit parameters) can be combined with the second embodiment (changing the receive parameters) so that a new second image 208 is acquired using different receive and transmit parameters, and the changes in both the receive and transmit parameters are for increasing the SNR of the dropout region 206 relative to the first image 202.

[0100] For localization of dropout regions, it is proposed to include a built-in confidence measure of MBS to identify the regions. Figure 3 shows the output of model-based segmentation on an ultrasound image of a heart 302. MBS is applied to the ultrasound image 302 and the results are overlaid on the ultrasound image 302. For illustration purposes, a section 304 of the MBS output is shown below the ultrasound image 302.

[0101] In regions 306 with high confidence (thick black line), no beamforming parameters need to be changed, while in regions 308 with low confidence (dotted line), beamforming needs to be adapted to achieve a higher SNR relative to the dropout region.

[0102] It may be advantageous to gradually guide the (computational) effort put into retransmission / recalculation, ideally balancing the frame rate degradation against the useful investment in SNR improvement. For example, the number of pulses N can be determined by determining the "weakness" of image features and / or the SNR of dropout regions.

[0103] One skilled in the art could easily develop a controller to perform any of the methods described herein. Thus, each step of the flowchart may represent a different action performed by the controller and may be performed by a respective module of the processing controller.

[0104] The controller can be implemented in a number of ways using software and / or hardware to perform the various functions required. A processor is one example of a controller that uses one or more microprocessors that can be programmed using software (e.g., microcode) to perform the necessary functions. However, the controller can be implemented with or without a processor, and can also be implemented as a combination of dedicated hardware to perform some functions and a processor (e.g., one or more programmed microprocessors and associated circuitry) to perform other functions.

[0105] Examples of controller components that may be used in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, application specific integrated circuits (ASICs), and field programmable gate arrays (FPGAs).

[0106] In various implementations, a processor or controller may be associated with one or more storage media, such as volatile and non-volatile computer memories, such as RAM, PROM, EPROM, and EEPROM. The storage media may be encoded with one or more programs that, when executed on the one or more processors and / or controllers, perform the necessary functions. The various storage media may be fixed within the processor or controller, or may be portable, such that one or more programs stored thereon may be loaded into the processor or controller.

[0107] Variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality.

[0108] The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

[0109] The computer program may be stored / distributed on a suitable medium, such as an optical storage medium or a solid-state medium, provided together with or as part of other hardware, but may also be distributed in other forms, such as over the Internet or other wired or wireless telecommunications systems.

[0110] It should be noted that when the term "adapted for" is used in the claims or description, it is intended to be equivalent to the term "configured for."

[0111] Any reference signs in the claims should not be construed as limiting the scope.

Claims

1. 1. A method of imaging the heart, comprising: controlling an ultrasound probe to receive a first reflected ultrasound echo signal from the heart, the first reflected ultrasound echo signal being transmitted using first transmit parameters; generating an ultrasound image of the heart from the first reflected ultrasound echo signals using first echo signal processing parameters; performing a model-based segmentation of the ultrasound image to identify the cardiac anatomical structures; for at least one anatomical structure having a region of dropout, using said segmentation to extrapolate from said identified anatomical structure to identify a location within the image of said region of dropout; acquiring a subsequent ultrasound image of the heart using different second echo signal processing parameters and / or different second transmit parameters for the at least one anatomical structure or for a region of a dropout for the at least one anatomical structure, thereby improving the signal to noise ratio for the at least region of a dropout; The method comprising:

2. 2. The method of claim 1, wherein acquiring a next ultrasound image of the heart comprises controlling the ultrasound probe to receive a second reflected ultrasound echo signal, the second reflected ultrasound echo signal being transmitted using the second transmit parameters, and applying the different second echo signal processing parameters to the second reflected ultrasound echo signal.

3. The different second transmit parameters comprise different beamforming parameters compared to the first transmit parameters, and the second transmit parameters have a different beamforming parameter with respect to the first transmit parameters: an increased number of transmit pulses per scan line; Increased transmit aperture, Increased scanline density, Different pulse frequencies, and Different pulse shapes The method of claim 2 , comprising one or more of:

4. 2. The method of claim 1, wherein acquiring a subsequent ultrasound image of the heart comprises applying the different second echo signal processing parameters to the first reflected ultrasound echo signal.

5. 5. The method of claim 4, wherein the first and second echo signal processing parameters comprise parameters for retrospective dynamic transmit focusing including a number of transmit beams synthesized per scan line.

6. The method of claim 5 , wherein the parameters for the retrospective dynamic transmit focusing include a number of multilines per transmit beam.

7. The method of claim 4 , wherein the first and second echo signal processing parameters comprise parameters for elevation space compounding including a number of elevation planes.

8. 5. The method of claim 4, wherein the first and second echo signal processing parameters comprise frequency compounding parameters and / or spatial compounding parameters, and the frequency compounding parameter and / or spatial compounding parameter for the second echo signal processing parameter is selected to improve contrast-to-noise ratio in areas of the dropout.

9. The method of claim 1 , wherein identifying locations within an image of regions of dropout comprises using a confidence measure generated by the model-based segmentation.

10. The method of claim 1 , wherein the at least one anatomical structure comprises a lateral heart wall.

11. A computer program comprising computer program code means adapted to carry out the method according to claim 1, when said program is run on a computer.

12. 1. An ultrasound imaging system for imaging the heart, comprising: an ultrasound probe for transmitting a first ultrasound signal using first transmit parameters and receiving a first reflected ultrasound echo signal from the heart; an imaging system for generating an ultrasound image of the heart using the first echo signal processing parameters; a model-based segmentation unit for identifying anatomical structures of the heart from the ultrasound image, the image-based segmentation unit being adapted to extrapolate from the identified anatomical structures to identify locations within the image of regions of dropout of at least one anatomical structure; a controller adapted to select different second echo signal processing parameters and / or different second transmit parameters for the at least one anatomical structure or for a region of a dropout for the anatomical structure, thereby improving a signal-to-noise ratio for at least the region of the dropout. An ultrasound imaging system comprising:

13. 13. The system of claim 12, wherein the controller is adapted to control the ultrasound probe to transmit a second ultrasound signal using the different second transmit parameters and receive a second reflected ultrasound echo signal from the heart, and to apply the different second echo signal processing parameters to the second reflected ultrasound echo signal.

14. The system of claim 12 , wherein the controller is adapted to apply the different second echo signal processing parameters to the first reflected ultrasound echo signal.

15. The system of claim 12 , wherein the image-based segmentation unit is adapted to identify locations within an image of regions of dropouts by using a confidence measure generated by the model-based segmentation.

Citation Information

Patent Citations

  • An automated method for digital image quantification

    JP1998504225A

  • Automatic Cardiac Functional Assessment Using Ultrasonic Cardiac Images

    US20110262018A1

  • Fully automated image optimization based on automated organ recognition

    US20180160981A1

  • Method and system for providing ultrasound image enhancement by automatically adjusting beamformer parameters based on ultrasound image analysis

    US20210128114A1

  • Systems and methods for image optimization

    WO2021069445A1