Ultrasound imaging system and method for volumetric parametric imaging in contrast-enhanced ultrasound imaging

Abstract

A system, method (200), and tangible non-transitory computer readable medium (130) storing instructions are described. The instructions, when executed by a processor (120), cause the processor to: determine a color value (202) of a contrast agent for each pixel according to a selected time-based parameter; determining an opacity value of the contrast agent for each pixel (204); and a display (140) in communication with the processor and configured to display (206) the color value and the opacity value for each pixel.

Description

Background Art

[0001] Contrast-enhanced ultrasound (CEUS) is an ultrasound imaging technique used in a variety of clinical applications. CEUS is able to detect nonlinear signals received from microbubbles circulating in the bloodstream following intravenous injection of ultrasound contrast agents. As such, CEUS imaging allows: documentation of tissue perfusion due to relatively slow flow at the capillary level, and visualization of blood flow in arteries and veins. As a result, CEUS is able to provide dynamic visualization of blood flow at both the macrocirculatory level and the microcirculatory level. Among other clinical applications, the CEUS imaging modality is recommended for the diagnosis and treatment monitoring of (potentially malignant) liver lesions.

[0002] CEUS parametric imaging is often used to characterize blood perfusion patterns and, therefore, lesion types. For example, many lesions (e.g., benign focal nodular hyperplasia (FNH) and malignant hepatocellular carcinoma (HCC)) exhibit rapid complete enhancement during the arterial phase. However, FNH exhibits an "early arrival" hub-and-spoke arterial enhancement pattern, while HCC exhibits a "spatially complex" chaotic arterial enhancement pattern. Time-of-arrival (TOA) parametric imaging directly visualizes the time it takes for contrast agents to reach the target tissue and is particularly effective in delineating arterial enhancement patterns (e.g., time-sensitive hub-and-spoke).

[0003] However, currently available parametric imaging in CEUS is limited to two-dimensional (2D) imaging. Three-dimensional (3D) and four-dimensional (4D = 3D data + time) CEUS parametric imaging modes are desirable and will facilitate visualization of various aspects of the anatomy, such as vessel tortuosity in malignant lesions (e.g., HCC) and center-to-edge blood supply patterns in benign tumors (e.g., FNH).

[0004] There is a need for a system and method that overcomes at least the above-mentioned disadvantages of the known systems described above. Summary of the invention

[0005] According to one aspect of the present disclosure, a system for providing an ultrasound image is described. The system includes: a source of ultrasound signal data from a contrast enhanced ultrasound (CEUS) examination; a processor; a tangible non-transitory computer readable medium storing instructions that, when executed by the processor, cause the processor to perform the following operations: determine a color value of a contrast agent for each pixel according to a selected time-based parameter; determine an opacity value of the contrast agent for each pixel; and a display that communicates with the processor and is configured to display the color value and the opacity value for each pixel.

[0006] According to another aspect of the present disclosure, a tangible, non-transitory computer-readable medium storing instructions is disclosed. The instructions, when executed by a processor, cause the processor to perform the following operations: determine a color value of a contrast agent for each pixel based on a selected time-based parameter; determine an opacity value of the contrast agent for each pixel; and display the color value and the opacity value for each pixel.

[0007] According to another aspect of the present disclosure, a method for providing an ultrasound image is disclosed. The method includes: determining a color value of a contrast agent for each pixel according to a selected time-based parameter; determining an opacity value of the contrast agent for each pixel; and displaying the color value and the opacity value for each pixel. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Representative embodiments may be best understood from the following detailed description when read in conjunction with the accompanying drawings. It should be emphasized that the various features are not necessarily drawn to scale. In fact, the dimensions may be increased or decreased arbitrarily for clarity of discussion. Where applicable and feasible, the same reference numerals refer to the same elements.

[0009] Figure 1 is a simplified block diagram of a CEUS imaging system for imaging a portion of a body, according to a representative embodiment.

[0010] Figure 2A is a flow chart of a method of assigning color values, intensity values, and opacity values ​​(α) of a contrast agent according to selected time-based parameters, according to a representative embodiment.

[0011] Figure 2B yes Figure 2A A flow chart of a method of imaging a contrast agent and depicts various tools for assigning color values, intensity values, and opacity values ​​(α) of a contrast agent according to selected time-based parameters according to representative embodiments.

[0012] Figure 3A is a graph of contrast agent color versus time of arrival (TOA) according to a representative embodiment.

[0013] Figure 3B is a graph of opacity versus contrast intensity according to a representative embodiment.

[0014] Figure 3C is a depiction of a display of a CEUS imaging system of a representative embodiment and depicts the Figure 3A-3B color and opacity.

[0015] Figure 4Ais a graph of contrast agent color versus time of arrival (TOA) according to a representative embodiment.

[0016] Figure 4B is a graph of opacity versus TOA according to a representative embodiment.

[0017] Figure 4C is a depiction of a display of a CEUS imaging system of a representative embodiment and depicts the Figure 4A-4B color and opacity.

[0018] Figure 5A is a graph of contrast agent color versus time of arrival (TOA) according to a representative embodiment.

[0019] Figure 5B is a graph of opacity versus contrast intensity and TOA according to a representative embodiment.

[0020] Figure 5C is a depiction of a display of a CEUS imaging system of a representative embodiment and depicts the Figure 5A-5B color and opacity.

[0021] Figures 6A-6I is a depiction of a display of a CEUS imaging system according to a representative embodiment, and depicts a display for each pixel of the display according to a representative embodiment. Figure 5A-5B color and opacity. DETAILED DESCRIPTION

[0022] In the following detailed description, for the purpose of explanation rather than limitation, representative embodiments of the disclosure of specific details are set forth to provide a thorough understanding of the embodiments according to the present teachings. The description of known systems, equipment, materials, operating methods, and manufacturing methods can be omitted to avoid making the description of the representative embodiments unclear. Nevertheless, systems, equipment, materials, and methods within the capabilities of those of ordinary skill in the art are within the scope of the present teachings and can be used according to the representative embodiments. It should be understood that the terms used herein are only for the purpose of describing specific embodiments and are not intended to be limited. The defined terms are the meanings outside the scientific and technical meanings of the defined terms that are generally understood and accepted in the technical field of the present teachings.

[0023] It should be understood that although the terms first, second, third, etc. may be used herein to describe various elements or components, these elements or components should not be limited by these terms. These terms are only used to distinguish one element or component from another element or component. Therefore, without departing from the teachings of the inventive concept, the first element or component discussed below may also be referred to as the second element or component.

[0024] The terms used herein are only for the purpose of describing specific embodiments and are not intended to be limiting. The singular forms of the terms "one", "an" and "the" as used in the specification and claims are intended to include both the singular and plural forms, unless the context clearly dictates otherwise. In addition, the terms "include", "comprise" and / or similar terms specify the presence of recorded features, elements and / or parts, but do not exclude the presence or increase of one or more other features, elements, parts and / or groups thereof. The term "and / or" as used herein includes any and all combinations of one or more items in the associated listed items.

[0025] The term "substantially" as used in the specification and appended claims, in addition to its ordinary meaning, means within an acceptable limit or degree. For example, "substantially 20 GHz" means that one of ordinary skill in the art would consider the signal to be 20 GHz within a reasonable measurement range.

[0026] The term "substantially" as used in the specification and appended claims, in addition to its ordinary meaning, means within acceptable limits or degrees. For example, "plurality of transducer ports are substantially the same" means that a person of ordinary skill in the art would consider the plurality of transducer ports to be the same.

[0027] The term "opacity" as used herein refers to the degree of blocking the background pixel color and displaying the current pixel color. More generally, the present teaching considers the use of a known color model commonly referred to as the RGBA model, wherein RGBA stands for red, green, blue, alpha, wherein alpha is the opacity value of the pixel. Although it is sometimes described as a color space, it is actually a three-channel RGB color model supplemented by a fourth alpha (α) channel to achieve opacity. As described in conjunction with various representative embodiments, the value of alpha indicates how opaque each pixel is, and allows the use of alpha compounding with transparent areas and anti-aliasing of the edges of opaque areas to combine images onto other images. The value of opacity (α) is between 0 and 1. Alternatively, a transparency value can be assigned to each pixel, wherein transparency refers to the degree to which the current pixel color is displayed at a specific pixel and the background color of the pixel is blocked. The value of transparency (T) is between 0 and 1, wherein T = 1-α. When α=0, T=1, the pixel is completely transparent, and all background colors will be displayed without obstruction from the current pixel; however, since the current pixel color is transparent, the current pixel color will not be displayed. In simple terms, the human eye can see the background pixels but not the current pixel. In contrast, when α=1, T=0, the pixel is completely opaque. In this case, since the current pixel is completely blocked, the background color will not be displayed. The current pixel color will be fully displayed. In simple terms, when α=1, the human eye cannot see the background pixel due to the obstruction of the current pixel. Of course, assigning values ​​of opacity (α) and transparency (T) between 0 and 1 will cause different degrees of opacity / transparency. It should be emphasized that RGB colors are merely illustrative, and other color schemes may also be considered. By way of example only, the present teaching considers the use of a CMY color model, where CMY stands for cyan magenta yellow. Similarly, it is also considered that a CMYA model with three colors supplemented by a fourth (α) channel is used in conjunction with various representative embodiments described herein.

[0028] As mentioned above, known parametric imaging is limited to 2D of CEUS. Specifically, in a 2D parametric imaging mode, parameters are derived from a 2D CEUS frame and then color-coded to form an output image. There are already a variety of color coding and mapping design methods, such as dynamic or adaptive color mapping. In the 3D / 4D parametric imaging of the present teaching, time-based parameters are derived from a 3D / 4D CEUS volume, and then the parameters are color-coded to form an output volume on a display or monitor for review from various orientations. Although various 2D color mapping methods can be directly applied to 3D / 4D parametric imaging, among other beneficial improvements, a feature of the 3D / 4D parametric imaging of the present teaching is the ability to control the transparency of the output volume (3D or 4D) pixels. As described more fully below, in order to visualize color-coded anatomical features (e.g., arteries and / or veins) inside a 3D target (e.g., an organ, lesion, or tumor), the transparency value is beneficially fully adjusted between 1 (completely transparent) and 0 (completely opaque). For example, to highlight the origin of the perfusion, the transparency can be set to increase with TOA.

[0029] As described more fully below, the present teachings relate to a CEUS system, method, and tangible non-transient computer-readable medium for providing 4D parametric imaging in CEUS, wherein time-based parameters are used as color-coded imaging parameters. Through the present teachings, parameters are extracted from 3D / 4D data of CEUS scans. Parametric imaging displays each image sequence as a single composite image, wherein each pixel is color-coded and has an opacity value / transparency value to characterize time-based parameters of contrast agent dynamics, thereby providing direct visual evaluation of vascular characteristics of anatomical parts (including lesions or tumors) on a specific CEUS image sequence / cycle. According to a representative embodiment, the time-based parameter is illustratively the arrival time (TOA) of the contrast agent at the anatomical location of interest. TOA is merely illustrative and is used as an exemplary feature because a relatively simple TOA formula can be obtained from the time-intensity curve and the dependence of TOA on contrast agent infusion conditions is weak. However, other time-based parameters are considered for implementation according to various representative embodiments of the present teachings. When using CEUS imaging to analyze anatomical features, these parameters are often of interest. These parameters include, but are not limited to, the following for each pixel: time to peak of contrast agent, wash-in rate of contrast agent, rise time of contrast agent, peak intensity of contrast agent, wash-out rate of contrast agent, mean transit time of contrast agent, fall time of contrast agent, and area under the curve of contrast agent; and these parameters also include the slope or slope change of the intensity of the contrast agent at each pixel. Therefore, the present teachings contemplate various time-related parameters for implementation in 4D CEUS parametric imaging and diagnostic applications.

[0030] Among other benefits, the workflow according to the present teaching also allows for improved observation of the results of ultrasound scanning. It is noteworthy that not only are the various pixels displayed by the CEUS system color-coded to reflect specific time-based parameters (e.g., TOA), but also the opacity of each pixel is provided in the 3D or 4D image (and therefore transparency). The image is color-coded (e.g., RGB, CMY), and the opacity (α) of the selected time-based parameter is depicted in each pixel of the display. As such, a color value and an opacity value are assigned to each pixel of the display, and by assigning an opacity value (or transparency value) at each pixel, an improvement in the visualization of the selected time-based parameter is achieved. The resulting image consisting of a color code and a transparency value at each pixel is configured to rotate 360 ​​degrees around an axis to allow review of this time-based parameter from different vantage points or viewing angles. This ability to rotate the image allows review of different degrees of opacity / transparency and improves the accuracy of review by trained clinicians in diagnostic applications. Therefore, the present teaching enables 3D or 4D visualization of the selected time-based parameter on a display.

[0031] Figure 1 is a simplified block diagram of an ultrasound imaging system 100 for imaging a region of interest of a subject, according to a representative embodiment.

[0032] refer to Figure 1 , ultrasound imaging system 100 includes an imaging device 110 and a computer system 115 for controlling imaging of a region of interest in a patient, such as a patient 105 on an examination table 106. Imaging device 110 is illustratively an ultrasound imaging system capable of providing contrast enhanced ultrasound (CEUS) image scans of a region of interest (ROI) of patient 105.

[0033] The computer system 115 receives image data from the imaging device 110 and stores and processes the imaging data according to the representative embodiments described herein. The computer system 115 includes a controller 120, a memory 130, a display 140, and a user interface 150, which may include a graphical user interface (GUI) 145. The display 140 may also include a speaker (not shown) to provide auditory feedback. It is worth noting that, as described more fully below, an important parameter in CEUS imaging is the arrival time (TOA) of the contrast agent to a specific location of the patient's anatomical structure. Among the many control functions undertaken by the GUI 145 and the user interface 150, according to a representative embodiment, the TOA is measured from the start time of the contrast agent injection, which can be controlled by the GUI 145 or the user interface 150.

[0034] The memory 130 stores instructions that can be executed by the controller 120. As described more fully below, the instructions, when executed, enable the controller 120 to allow a user to use the GUI 145 or the user interface 150 or both to perform different steps and initialize the ultrasound imaging device including the transducer. It is worth noting that, among other functions, the GUI 145 and the display 140 or the user interface 150 and the display 140 are also used to select the desired time-based parameters, which are the parameters that are expected to be reviewed by the clinician or sonographer. In addition, the controller 120 can perform additional operations based on the execution of the instructions, for example, instructing another element of the computer system 115 (including the memory 130 and the display 140) with instructions or communicating with it to perform one or more of the above-mentioned processes.

[0035] The memory 130 may include main memory and / or static memory, which may be in communication with each other and with the controller 120 via one or more buses. The memory 130 stores instructions for implementing some or all aspects of the methods and processes described herein.

[0036] For example, the memory 130 may be implemented by any number, type, and combination of random access memory (RAM) and read-only memory (ROM), and may store various types of information, such as software algorithms that serve as instructions that, when executed by a processor, cause the processor to perform various steps and methods according to the present teachings. In addition, updates to the methods and processes described herein may also be provided to the computer system 115 and stored in the memory 130.

[0037] The various types of ROM and RAM may include any number, type, and combination of computer-readable storage media, such as disk drives, flash memory devices, electrically programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), registers, hard disks, removable disks, magnetic tapes, compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), floppy disks, Blu-ray disks, universal serial bus (USB) drives, or any other form of storage media known in the art. Memory 130 is a tangible storage medium for storing data and executable software instructions, and is non-transient during the storage of software instructions therein. The term "non-transient" as used herein should not be interpreted as a permanent state characteristic, but rather a state characteristic that will persist for a period of time. The term "non-transient" specifically denies transient characteristics, such as carrier waves or signals or other forms of characteristics that only exist temporarily at any time and at any place. Memory 130 may store software instructions and / or computer-readable code capable of performing various functions. Memory 130 may be secure and / or encrypted, or may be unsecured and / or unencrypted.

[0038] "Memory" is an example of a computer-readable storage medium and should be interpreted as possibly being multiple memories or databases. For example, the memory or database may be multiple memories or databases local to the computer, and / or multiple memories or databases distributed across multiple computer systems or computing devices, or multiple memories or databases set up in the "cloud" according to known components and methods. Computer-readable storage media is defined as any medium that constitutes patentable subject matter under 35 U.S.C. §101, and does not include any medium that does not constitute patentable subject matter under 35 U.S.C. §101. Examples of such media include non-transient media, such as computer storage devices that store information in a format readable by a computer or data processing system. More specific examples of non-transient media include computer disks and non-volatile memory.

[0039] The controller 120 represents one or more processing devices and is configured to run software instructions stored in the memory 130 to perform functions as described in various embodiments herein. The controller 120 can be implemented using any combination of hardware, software, firmware, hard-wired logic circuits, or a combination thereof, by a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a general-purpose computer, a central processing unit, a computer processor, a microprocessor, a graphics processing unit (GPU), a microcontroller, a state machine, a programmable logic device, or a combination thereof. In addition, any processing unit or processor herein may include multiple processors, parallel processors, or both. Multiple processors may be included in or coupled to a single device or multiple devices.

[0040] The term "processor" as used herein encompasses an electronic component capable of running a program or machine-executable instructions. References to a computing device that includes a "processor" should be interpreted as including more than one processor or processing core, as in the case of a multi-core processor. A processor may also refer to a collection of processors within a single computer system or distributed across multiple computer systems, as in the case of cloud-based or other multi-site applications. The term "computing device" should also be interpreted to include a collection or network of computing devices, each of which includes one or more processors. A module has software instructions that use one or more processors to perform various functions, which processors may be within the same computing device or distributed across multiple computing devices.

[0041] The display 140 may be a monitor, such as a computer monitor, a television, a liquid crystal display (LCD), a light emitting diode (LED) display, a flat panel display, a solid state display, or a cathode ray tube (CRT) display, or an electronic whiteboard. The display 140 may also provide a graphical user interface (GUI) 145 for displaying information to a user and receiving information from a user.

[0042] The user interface 150 may include a user and / or network interface for providing information and data output by the controller 120 and / or the memory 130 to the user, and / or for receiving information and data input by the user. That is, the user interface 150 enables the user to operate the imaging device as described herein, and schedule, control or manipulate various aspects of the ultrasound imaging system 100 of the present teaching. It is worth noting that the user interface 150 enables the controller 120 to indicate the effect of the user's control or manipulation. The user interface 150 may include one or more ports, disk drives, wireless antennas or other types of receiver circuits. The user interface 150 may also be connected to one or more interface devices, for example, a mouse, keyboard, mouse, trackball, joystick, microphone, video camera, touch pad, touch screen, voice or gesture recognition captured by a microphone or video camera.

[0043] It is noteworthy that the controller 120, memory 130, display 140, GUI 145 and user interface 150 can be located away from the imaging device 110 operated by the ultrasound physician (e.g., in another location of the building or in another building). The controller 120, memory 130, display 140, GUI 145 and user interface 150 can be located, for example, at the location where the radiologist / clinician is located. However, it is noteworthy that additional controllers, memories, displays, GUIs and user interfaces can be located near the ultrasound physician and help to implement various functions of the imaging device 110 required to complete the CEUS scan contemplated by the present teachings. Finally, in a more general sense, the ultrasound imaging system 100 can include a source of ultrasound signal data from a CEUS examination. In such an embodiment, the computer system 115 can be connected to these sources of ultrasound signal data from the CEUS examination (e.g., at a location away from the computer system 115) to receive these data, but the ultrasound imaging system 100 does not include the imaging device 110 or the examination table 106.

[0044] Figure 2A According to the use of representative embodiments Figure 1 Flowchart of method 200 for collecting images using a CEUS imaging system to provide images on display 140, the images being color coded based on a time-based parameter for each pixel and an opacity α (and thus, as described above, a transparency T, where α=1-T) for each pixel. Various aspects and details of the method are in conjunction with Figure 1 The contents described in the representative embodiments of the present invention are common. These common aspects and details may not be repeated to avoid obscuring the representative embodiments described herein.

[0045] At 202, the method begins by determining a color value of a contrast agent enhanced ultrasound signal for each pixel of the display 140 according to a selected time-based parameter. After determining the color value for each pixel, the controller 120 assigns each color value to a specific pixel of the display 140 corresponding to the color value. As described above, TOA provides an excellent time-based parameter to describe various aspects of the method 200. Therefore, following this example and as described more fully below, a color value (RGB or CMY) is first determined, and then a color value is assigned to each pixel based on the TOA of the contrast agent associated with the pixel in the body. However, at the risk of redundancy, it should be noted that the color value assigned to each pixel can also be based on one of many other time-based parameters that are useful in diagnosing a condition based on US images acquired by the ultrasound imaging system 100. Notably, determining the color of each pixel can be a more intuitive and efficient way to quantify the TOA value. Instead of reading the TOA value of each pixel, red can indicate an earlier arriving contrast agent, while blue can indicate a later arriving contrast agent.

[0046] At 204, the method continues by determining an opacity value of the contrast agent for each pixel of the display 140. After determining the opacity values, the controller 120 assigns each opacity value to a particular pixel of the display 140 that corresponds to the opacity value.

[0047] As described more fully below, the distribution of contrast agent for each pixel of the display can be performed according to the selected time-based parameters, or according to the intensity of the contrast agent (contrast intensity), or according to both. The distribution of opacity (and thus transparency) beneficially allows anatomical features to be reviewed more clearly, while having less opacity (greater transparency) at certain research locations. It is worth noting that, as described more fully below, the ability to rotate the image on the display 140 using the GUI 145 or user interface 150 allows the 3D / 4D image to be reviewed from different vantage points. As such, by assigning opacity values ​​to each pixel based on the selected time-based parameters or the contrast intensity for each pixel displayed, or both, the clinician is allowed to see the points of interest through the 3D / 4D image by assigning low opacity (high transparency) values ​​to certain pixels in the region of interest between the surfaces of the anatomical part so that other pixels below the surface in the region of interest can work. Alternatively, the method can assign higher opacity (low transparency) values ​​to another part of the anatomical part in the region of interest, so that features on the surface in the region of interest can be studied.

[0048] As described above and as described more fully below, the opacity value assigned to each pixel of the display 140 can be implemented according to the time-related parameters selected for a particular CEUS examination. Thus, continuing with the example, the opacity value can be assigned based on the TOA. By way of illustration only, an opacity value can be assigned to each pixel in a region of interest of the anatomical portion being examined based on the TOA to facilitate review of the region of interest from a wide range (e.g., 360 degrees) of viewing angles / vantage points of the 3D / 4D image provided to the display. Notably, the determination of the opacity value to be assigned to each pixel is preferably accomplished by optimizing the opacity value assigned to each pixel to achieve optimal imaging quality, thereby obtaining better diagnostic accuracy and confidence. Specifically, the opacity cannot be too low so as not to lose the color value for the current pixel; and the opacity cannot be too high so as not to block the color from the background pixels. Thus, some embodiments may limit the range of opacity used to set the pixel value to a range between fully transparent and fully opaque.

[0049] Alternatively, as described more fully below, the opacity value assigned to each pixel of the display 140 can be implemented based on the contrast intensity at each pixel. The opacity value can be calculated based on the CEUS intensity at a given pixel (e.g., a value from 0 to 1 derived from a non-linear mapping of CEUS intensity (e.g., an S-curve)) and based on the CEUS intensity from the beginning of the acquisition until the current volume number (e.g., a time average, minimum, maximum, time standard deviation, etc.).

[0050] Still alternatively, the opacity value assigned to each pixel of the display 140 may be implemented based on time-related parameters selected for a particular CEUS examination and the contrast intensity at each pixel. Thus, continuing with this example, an opacity value may be assigned based on the TOA and contrast intensity at each pixel of the display 140. By way of illustration only, an opacity value may be assigned to each pixel in a region of interest of an anatomical portion being examined based on the TOA and contrast intensity to facilitate review of the region of interest from a wide range of viewing angles / vantage points (e.g., 360 degrees) of the 3D / 4D images provided to the display.

[0051] At 206, method 200 continues by displaying the color values ​​and opacity values ​​assigned in 202, 204 on display 140 for review by a clinician or sonographer. Again, as described more fully below, assigning color values ​​at each pixel based on selected time-related parameters and assigning opacity values ​​at each pixel based on time-based parameters and / or contrast intensity facilitates review of various aspects of the anatomical portion being examined, thereby allowing review from different angles, thereby revealing elements below the surface of the anatomical portion and / or on the surface of the anatomical portion and / or above the surface of the anatomical portion.

[0052] Figure 2B According to the use of representative embodiments Figure 1 Flow chart of a method 200 of collecting images by a CEUS imaging system of the embodiment of the present invention to provide an image that is color-coded based on a time-based parameter and an opacity α (and thus a transparency T, where α=1−T) for each pixel on the display 140 . Figure 2B The flowchart highlights and describes the combination Figure 2A Various aspects of the method 200 described herein. Various aspects and details of the method and the combination Figure 1-2A The aspects and details described in the representative embodiments of the present invention are the same. These common aspects and details may not be repeated to avoid obscuring the representative embodiments described herein.

[0053] At 212, if combined Figure 2AAs described in 202 of , the method depicts that the color value of the contrast agent is assigned to each pixel of the display 140 according to the selected time-based parameter. Again, in the representative embodiment currently described, the time-related parameter is TOA. As shown in the figure, the color assigned to a specific data point varies linearly with TOA, and the data of the contrast agent that arrives first is encoded as red (R), and its color in the visible spectrum changes from red to blue over time. Therefore, at point 214, the color assigned to the contrast agent that arrives in the first few seconds is red, and the pixels of the contrast agent in these first few seconds are depicted on the display 140. Similarly, the contrast agent that arrives at about 100 seconds at 216 is assigned yellow, and the pixels that the contrast agent arrives at 100 seconds on the display are yellow. The contrast agent that arrives at about 150 seconds at 218 is assigned green, and the pixels that the contrast agent arrives at 100 seconds on the display are green. Contrast arriving at approximately 150 seconds at 220 is assigned a blue color, and the pixel depicting contrast arriving at 100 seconds is blue on the display. Notably, light and dark variations of color across the visible spectrum can be selected to identify the TOA of the contrast agent with significant granularity and therefore precision. Additionally, clinical information related to the perfusion pattern of the contrast agent is shown based on the color assigned to a particular TOA, which provides a better understanding of the timing of perfusion patterns with different anatomical levels or depths due to the assignment of color and opacity values ​​to each pixel of the display 140. Finally, it is again emphasized that TOA is merely an illustrative time-based parameter, and it is also contemplated to use other time-based parameters as described above to provide parametric imaging that displays each image sequence as a single composite image, wherein each pixel is color-coded to characterize a time-based parameter of the contrast agent dynamics, thereby providing a direct visual assessment of the vascular characteristics of the anatomical portion (including a lesion or tumor) on a particular CEUS image sequence / cycle.

[0054] At 212, an aspect of 204 is depicted using the results of assigning a component of the opacity value (α) for each pixel. Specifically, parametric imaging displays each image sequence as a single composite image, wherein each pixel has an opacity value / transparency value to characterize a time-based parameter of the contrast agent dynamics (TOA in this example). As such, 212 depicts the assignment of opacity values / transparency values ​​relative to TOA values. Thus, in the representative embodiment currently described, for the earliest arriving contrast agent, the assigned color changes from relatively opaque (i.e., showing its initially assigned color) and depicts the lowest transparency (T=1-α=0) / highest opacity (α=1), while the later arriving contrast agent is assigned a color shade such as red, orange, or yellow, as shown, having a reduced opacity / increased transparency.

[0055] At 221, another aspect of 204 is depicted, wherein another component is assigned to the opacity value (α) of each pixel. Specifically, parametric imaging displays each image sequence as a single composite image, wherein each pixel has an opacity value / transparency value to characterize the contrast intensity of the contrast agent dynamics. As such, 212 depicts the assignment of opacity values / transparency values ​​relative to contrast intensity values. Thus, in the representative embodiment currently described, for the highest intensity contrast agent, the assigned color varies from relatively opaque and depicts the lowest transparency (T=1-α=0) / highest opacity (α=1), while lower intensity contrast agents are assigned color shades such as red, orange, or yellow, as shown, having reduced opacity / increased transparency.

[0056] Thus, for each pixel of the displayed image, 212 and 221 provide a color coded value based on the TOA and an opacity value based on the TOA or the contrast intensity or both.

[0057] At 223, the color (RGB) value for each pixel is added to the opacity value at 224 to assign a color-coded RGB and opacity (RGBA) value to each pixel in the displayed CEUS image at 226. Thus, as described more fully below, assigning a color value at each pixel based on selected time-related parameters and assigning an opacity value at each pixel based on time-based parameters and / or contrast intensity facilitates review of various aspects of the anatomical portion being examined, thereby allowing review from different angles, thereby revealing elements below the surface of the anatomical portion and / or on the surface of the anatomical portion and / or above the surface of the anatomical portion.

[0058] Go to Figures 3A-3C , Figures 3A-3C Assigning colors and opacities to pixels on a display based on a TOA is described. Various aspects and details of the method are combined with Figure 1-2B The aspects and details described in the representative embodiments of the present invention are the same. These common aspects and details may not be repeated to avoid obscuring the representative embodiments described herein.

[0059] Figure 3AA graph of color versus time of arrival (TOA) of a contrast agent according to a representative embodiment is shown. As described above, according to a representative embodiment of the method (or algorithm), the color assigned to a particular data point varies linearly with the TOA, encoding the data of the contrast agent that arrives first as red (R), while the color of the particular data point that arrives latest from the source of the ultrasound image data is encoded as blue (B). Again, other colors between red and blue in the visible spectrum are assigned to data points that arrive in time between the first (R) data point and the last (B) data point, which are assigned other colors along the color spectrum (orange, yellow, green). In addition, as described above, the shading of the colors along the rainbow of the spectrum can be used to further distinguish the TOA of the data points from the current CEUS scan through these shading gradients, with more shading providing greater distinction between the TOA of the data points represented by the color of the pixel. As such, it is possible to select a color shading gradient between red and blue in the visible spectrum to accurately identify the TOA of the contrast agent with significant granularity and therefore accuracy.

[0060] Figure 3B is a graph of opacity versus contrast agent intensity according to a representative embodiment. As shown, in the present method (or algorithm), the assignment of opacity values ​​is not linear, but rather somewhat parabolic and increases with contrast intensity. As such, data points with relatively low contrast intensity are assigned low opacity / high transparency, while data points with relatively high contrast intensity are assigned relatively high opacity / relatively low transparency. For illustration only, in Figure 3B A data point from a CEUS scan with a contrast intensity of 50 on a relative scale of has an opacity of approximately 0.05. More generally, CEUS intensities are normalized and quantized by 8-bit unsigned integers ranging from 0 to 255.

[0061] Such a data point will be relatively transparent. In contrast, a data point from the same CEUS scan with a contrast intensity of 200 on the relative scale of the plot has an opacity of about 0.75 or a transparency of about 0.25. Such a data point will be relatively opaque. Typically, as Figure 3B As shown in the example in , the relationship between opacity and intensity can be determined by an algorithm, or by generating a result by testing a large number of candidate shadings for such a relationship. The selected shading is determined to provide sufficient image quality to improve diagnostic accuracy.

[0062] Figure 3Cis a depiction of a display of a CEUS imaging system of a representative embodiment, depicting the color and opacity for each pixel of the display. It is noteworthy that the scale on the right side of the plot shows the arrival time of the data points from the CEUS in grayscale, and the opacity value for each pixel is based on Figure 3B In this embodiment, by applying Figure 3A and Figure 3B When depicted on a color display, the 3D TOA volume image has a relatively opaque color on the surface of the anatomical portion being viewed, making the discrimination of the internal structure of the anatomical portion (e.g., a lesion) more difficult. Furthermore, while this effect of obscuring the internal structure of the anatomical portion may be beneficial for some diagnoses, this effect may be less beneficial in other diagnoses. Therefore, although not an ideal method, the 3D TOA volume image may have a relatively opaque color on the surface of the anatomical portion being viewed, making the discrimination of the internal structure of the anatomical portion (e.g., a lesion) more difficult. Furthermore, while this effect of obscuring the internal structure of the anatomical portion may be beneficial for some diagnoses, this effect may be less beneficial in other diagnoses. Figure 3A-3B Such an algorithm providing color and opacity values ​​would enable review of a 3D / 4D volumetric image of the anatomical portion being studied in a CEUS imaging procedure.

[0063] Go to Figures 4A-4C , Figures 4A-4C Assigning colors and opacities to pixels on a display based on a TOA is described. Various aspects and details of the method are combined with Figure 1-3C The aspects and details described in the representative embodiments of the present invention are the same. These common aspects and details may not be repeated to avoid obscuring the representative embodiments described herein.

[0064] Figure 4A A graph of color versus time of arrival (TOA) of a contrast agent according to a representative embodiment is shown. As described above, according to a representative embodiment of the method (or algorithm), the color assigned to a particular data point varies linearly with the TOA, encoding the data of the contrast agent that arrives first as red (R), while the color of the particular data point that arrives latest from the source of the ultrasound image data is encoded as blue (B). Again, other colors between red and blue in the visible spectrum are assigned to data points that arrive in time between the first (R) data point and the last (B) data point, which are assigned other colors along the color spectrum (orange, yellow, green). In addition, as described above, the shading of the colors along the rainbow of the spectrum can be used to further distinguish the TOA of the data points from the current CEUS scan through these shading gradients, with more shading providing greater distinction between the TOA of the data points represented by the color of the pixel. As such, it is possible to select a color shading gradient between red and blue in the visible spectrum to accurately identify the TOA of the contrast agent with significant granularity and therefore accuracy.

[0065] Figure 4Bis a graph of opacity versus contrast intensity according to a representative embodiment. As shown, in the present method (or algorithm), the assignment of opacity values ​​is also not linear, but rather somewhat of a decreasing exponential function. As such, data points with relatively low TOA are assigned high opacity / low transparency, while data points with relatively high TOA are assigned relatively low opacity / relatively high transparency. The relative scale of TOA is normalized and quantized by an 8-bit unsigned integer ranging from 0 to 255, where 0 is assigned to the contrast agent that arrives first and 255 is assigned to the contrast agent that arrives last. By way of illustration only, a data point from a CEUS scan having a contrast agent TOA of 10 on the relative scale of the drawing has an opacity of approximately 0.8. Such a data point would be relatively opaque. In contrast, a data point from the same CEUS scan having a contrast agent TOA of 200 on the relative scale of the drawing has an opacity of approximately 0.1 or a transparency of approximately 0.9. Such a data point would be relatively transparent. Typically, as Figure 4B As shown in the example in , the relationship between opacity and contrast agent TOA can be determined by an algorithm, or by generating a result by testing a large number of candidate shadings for this relationship. The selected shading is determined to provide sufficient image quality to improve diagnostic accuracy.

[0066] Figure 4C is a depiction of a display of a CEUS imaging system of a representative embodiment, depicting the color and opacity for each pixel of the display. It is noteworthy that the scale on the right side of the plot shows the arrival time of the data points from the CEUS in grayscale, and the opacity value for each pixel is based on Figure 4B In this embodiment, by applying Figure 4A and Figure 4B When depicted on a color display, the 3D TOA volume image has relatively transparent colors on the surface of the anatomical part being viewed, making it similar to the image in the figure. Figure 3C The internal structure of the anatomical part (e.g., lesion) can be better discerned than in the case of the image of Figure 4C402 are not easily observed in the CEUS image, but due to the relatively high opacity at the beginning of the CEUS imaging process (i.e., from the start time of injection of contrast agent as described above), there are colored (e.g., red) spots 401, 402. Although blurring the internal structure of the anatomical structure in the image by the spots 401, 402 may be beneficial in some diagnoses, their impact may be less beneficial in other diagnoses. It is worth noting that residual clutter, earlier arriving contrast agent values, or background noise all have relatively low TOA values ​​and can create obstructions on the outer surface of the anatomical portion being imaged, making the review of the internal structure of the anatomical portion more difficult. In addition, the desired clearer structures on the outer surface of the anatomical portion are often at least partially covered by the earlier arriving contrast agent. However, even taking these disadvantages into account, combined with Figures 4A-4C The method described is also Figure 4C Improvements are provided in the Results view of 3D / 4D volumetric images.

[0067] Go to Figures 5A-5C , Figures 5A-5C Assigning colors and opacities to pixels on a display according to TOA is described. This will become clearer as this description continues. Figure 5C The 3D / 4D volume image is obtained by Figures 3A-4C The various aspects and details of the method are combined with the more advantageous aspects of the method described in Figure 1-4C The aspects and details described in the representative embodiments of the present invention are the same. These common aspects and details may not be repeated to avoid obscuring the representative embodiments described herein.

[0068] Figure 5A A graph of color versus time of arrival (TOA) of a contrast agent according to a representative embodiment is shown. As described above, according to a representative embodiment of the method (or algorithm), the color assigned to a particular data point varies linearly with the TOA, encoding the data of the contrast agent that arrives first as red (R), while the color of the particular data point that arrives latest from the source of the ultrasound image data is encoded as blue (B). Again, other colors between red and blue in the visible spectrum are assigned to data points that arrive in time between the first (R) data point and the last (B) data point, which are assigned other colors along the color spectrum (orange, yellow, green). In addition, as described above, the shading of the colors along the rainbow of the spectrum can be used to further distinguish the TOA of the data points from the current CEUS scan through these shading gradients, with more shading providing greater distinction between the TOA of the data points represented by the color of the pixel. As such, it is possible to select a color shading gradient between red and blue in the visible spectrum to accurately identify the TOA of the contrast agent with significant granularity and therefore accuracy.

[0069] Figure 5B Shows the Figure 5C The relationship between the opacity value assigned to each pixel in the resulting image and the contrast intensity, wherein each pixel has a color and an opacity value / transparency value to characterize a time-based parameter (TOA in this example) of the contrast agent dynamics. In the representative embodiment currently described, the opacity value / transparency value at each pixel is based on the TOA and the contrast intensity. As such, two parameters are used to determine the opacity at each pixel. Notably, for the earliest arriving contrast agent, the assigned color varies from relative opacity and depicts the lowest transparency (T=1-α=0) / highest opacity (α=1), while the later arriving contrast agents are assigned color shades such as red, orange, or yellow, as shown in the figure, which have reduced opacity / increased transparency. In addition, the assignment of opacity values / transparency values ​​relative to the contrast intensity value is based on Figure 5B Thus, in the currently described representative embodiment, for the highest intensity contrast agent, the assigned color varies from relatively opaque and depicts the lowest transparency (T=1-α=0) / highest opacity (α=1), while lower intensity contrast agents are assigned color shades such as red, orange, or yellow, as shown, with decreasing opacity / increasing transparency. Typically, as Figure 5B As shown in the example in , the relationship between opacity, TOA and intensity can be determined by an algorithm, or by generating a result by testing a large number of candidate shadings for such a relationship. The selected shading is determined to provide sufficient image quality to improve diagnostic accuracy.

[0070] Figure 5C is a depiction of a display of a CEUS imaging system of a representative embodiment, depicting the color and opacity for each pixel of the display. It is noteworthy that the scale on the right side of the plot shows the arrival time of the data points from the CEUS in grayscale, and the opacity value for each pixel is based on Figure 5B In this embodiment, by applying Figure 5A and Figure 5B When depicted on a color display, the 3D TOA volume image has relatively transparent colors on the surface of the anatomical part being viewed, making it similar to the image in the figure. Figure 3C and Figure 4C The internal structure of an anatomical part (e.g., a lesion) can be better discerned than in an image of the subject.

[0071] Depiction of the display of a CEUS imaging system combines Figure 3C and Figure 4CThe benefits and advantages of the representative embodiments described herein are as follows. Specifically, Figure 5C The displayed image allows visualization of the internal structure of the lesion and removal of surface obstructions from the image. Although better illustrated with color, Figure 5C The image eliminates relatively opaque colors (eg, red—not shown) on the surface of the anatomical portion being viewed, making it more difficult to discern the internal structure of the anatomical portion (eg, a lesion). Figure 5C The images beneficially reduce residual clutter, early arriving contrast agent values, or background noise, which have relatively low TOA values ​​and can create obstructions on the outer surface of the anatomical portion being imaged, making examination of the internal structures of the anatomical portion more difficult.

[0072] Figures 6A-6I FIG. 1 is a depiction of a display of a CEUS imaging system according to a representative embodiment. Figure 5A-5B The color and opacity of each pixel displayed. It is worth noting that when the image is rotated 360° in increments of approximately 40°, Figures 6A-6I The various views of the image show the anatomical part (e.g., lesion) from multiple perspectives. Figures 6A-6I Each image of the anatomical portion is viewed at an angle rotated 40 degrees clockwise from the previous view. As such, in areas where it is useful to view "through" the image, the opacity values ​​assigned to pixels that may block the image are made transparent, as described below. In contrast, opacity values ​​assigned to pixels on the surface of the anatomical portion are assigned relatively high opacity values, so that the portion of the anatomical image to be shown can be viewed from a particular angle / vantage point. Figures 6A-6I The displayed image allows visualization of the internal structure of the lesion and removal of surface obstructions from the image. Although better illustrated with color, Figures 6A-6I The image eliminates relatively opaque colors (eg, red—not shown) on the surface of the anatomical portion being viewed, making it more difficult to discern the internal structure of the anatomical portion (eg, a lesion). Figures 6A-6I The images beneficially reduce residual clutter, early arriving contrast agent values, or background noise, which have relatively low TOA values ​​and can create obstructions on the outer surface of the anatomical portion being imaged, making examination of the internal structures of the anatomical portion more difficult.

[0073] Those of ordinary skill in the art who benefit from the present disclosure will appreciate that the devices, systems, and methods of the present teachings provide for the transmission of echo image data from an ultrasound device. For example, compared to known methods and systems, various aspects of the protocol (including the start, duration, and termination of the steps in the protocol) can be facilitated during the generation of the protocol or during the implementation of the protocol or during both. In addition, errors caused by the interaction of people with the imaging system can be reduced, thereby reducing the need for repeated processes and reducing the time required to complete the imaging process. It is worth noting that these benefits are illustrative, and other advances in the field of medical imaging will become apparent to those of ordinary skill in the art who benefit from the present disclosure.

[0074] Although the methods, systems, and components for implementing imaging protocols have been described with reference to several exemplary embodiments, it should be understood that the words that have been used are descriptive and illustrative, rather than limiting. Changes may be made within the scope of the appended claims, as currently stated and amended, without departing from the scope and spirit of the protocol implementation methods of the present teachings. The foregoing description of the disclosed embodiments is provided to enable any person skilled in the art to practice the concepts described in the present disclosure. As such, the subject matter disclosed above is considered to be illustrative, rather than restrictive, and the appended claims are intended to cover all such modifications, enhancements, and other embodiments that fall within the true spirit and scope of the present disclosure. Therefore, to the maximum extent permitted by law, the scope of the present disclosure will be determined by the broadest permissible interpretation of the appended claims and their equivalents, and shall not be restricted or limited by the foregoing detailed description.

Claims

1. A system for providing an ultrasound image, comprising: A source of ultrasound signal data from a contrast-enhanced ultrasound (CEUS) examination; Processor (120); as well as A tangible, non-transitory computer-readable medium (130) storing instructions that, when executed by the processor (120), cause the processor (120) to: determine a color value (202) of a contrast agent for each pixel based on a selected time-based parameter; determine an opacity value (204) of the contrast agent for each pixel; as well as A display (140) is in communication with the processor (120) and is configured to display (206) the color value and the opacity value for each pixel.

2. The system according to claim 1, wherein: The determined opacity value is a function of the time-based parameter selected for each pixel.

3. The system according to claim 1, wherein: The determined opacity value is a function of the intensity of the contrast agent for each pixel.

4. The system according to claim 1, wherein: The determined opacity value is a function of the selected time-based parameter for each pixel and the intensity of the contrast agent for each pixel.

5. The system according to claim 1, wherein: The selected time-based parameter is one of the following for each pixel: the arrival time (TOA) of the contrast agent, the peak time of the contrast agent, the wash-in rate of the contrast agent, the rise time of the contrast agent, the peak intensity of the contrast agent, the wash-out rate of the contrast agent, the mean transit time of the contrast agent, the decline time of the contrast agent, and the area under the curve of the contrast agent.

6. The system according to claim 1, wherein: The opacity value is a function of the CEUS intensity or a temporal statistics of the CEUS intensity.

7. The system according to claim 1, wherein: The instructions also cause the processor to initially pre-process an input of contrast enhanced ultrasound (CEUS) data for each pixel.

8. The system according to claim 7, wherein: The pre-processing includes one or more of the following: normalizing the CEUS data; reducing background noise to improve contrast-to-noise ratio (CNR); and suppressing clutter.

9. The system according to claim 8, wherein: The CEUS data includes contrast intensity for each pixel.

10. A tangible, non-transitory computer-readable medium storing instructions that, when executed by a processor (120), cause the processor to: determine a color value (202) of a contrast agent for each pixel based on a selected time-based parameter; determine an opacity value (204) of the contrast agent for each pixel; and display (206) the color value and the opacity value for each pixel.

11. The tangible, non-transitory computer-readable medium of claim 10, wherein: The determined opacity value is a function of the time-based parameter selected for each pixel.

12. The tangible, non-transitory computer-readable medium of claim 10, wherein: The determined opacity value is a function of the intensity of the contrast agent for each pixel.

13. The tangible, non-transitory computer-readable medium of claim 10, wherein: The determined opacity value is a function of the selected time-based parameter for each pixel and the intensity of the contrast agent for each pixel.

14. The tangible, non-transitory computer-readable medium of claim 10, wherein: The selected time-based parameter is one of the following for each pixel: TOA of the contrast agent, time to peak of the contrast agent, wash-in rate of the contrast agent, rise time of the contrast agent, peak intensity of the contrast agent, wash-out rate of the contrast agent, mean transit time of the contrast agent, decay time of the contrast agent, and area under the curve of the contrast agent.

15. The tangible, non-transitory computer-readable medium of claim 10, wherein: The instructions also cause the processor to initially pre-process an input of contrast enhanced ultrasound (CEUS) data for each pixel.

16. The tangible, non-transitory computer readable medium of claim 15, wherein: The pre-processing includes one or more of the following: normalizing the CEUS data; reducing background noise to improve contrast-to-noise ratio (CNR); and suppressing clutter.

17. The tangible, non-transitory computer readable medium of claim 16, wherein: The CEUS data includes contrast intensity for each pixel.

18. A method (200) for providing an ultrasound image, the method (200) comprising: determining a color value of the contrast agent for each pixel based on a selected time-based parameter (202); determining an opacity value of the contrast agent for each pixel (204); and The color value and the opacity value for each pixel are displayed (206).

19. The method (200) of claim 18, wherein: Determining the opacity value further includes determining the opacity value for each pixel based on the selected time-based parameter.

20. The method (200) of claim 18, determining the opacity value further comprising determining the opacity value for each pixel based on an intensity of the contrast agent.

21. The method (200) of claim 18, wherein: Determining the opacity value further includes determining the opacity value for each pixel as a function of the selected time-based parameter and the intensity of the contrast agent.

22. The method (200) of claim 18, wherein: The selected time-based parameter is one of the following for each pixel: TOA of the contrast agent, time to peak of the contrast agent, wash-in rate of the contrast agent, peak intensity of the contrast agent, and area under the curve of the contrast agent.

Images