Interface and shadow detection method for intravascular imaging system
Intravascular data collection systems with graphical user interfaces enhance stent deployment accuracy by integrating OCT and IVUS data with angiography, addressing visualization challenges and reducing deployment risks.
Patent Information
- Application Number
- CN202111234946.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2015-12-18
- Filing Date
- 2016-05-17
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2036-05-17
AI Technical Summary
Existing stent deployment methods face challenges in accurately visualizing stent deployment relative to the vessel wall, leading to risks of over-expansion, under-expansion, and poor adherence, which can cause vessel damage, disintegration, and increased thrombosis risk, with manual review of angiography images prone to error.
Intravascular data collection systems, such as OCT and IVUS, are integrated with graphical user interfaces to display diagnostic information, including longitudinal indices and stent strut indicators, superimposed on angiographic frames, to enhance stent delivery planning by accurately identifying stent apposition and avoiding data misinterpretation.
The system provides accurate visualization of stent apposition and malapposition, reducing the risk of vessel damage and thrombosis by ensuring precise stent deployment, and minimizing errors in data interpretation.
Smart Images

Figure CN113995380B_ABST
Abstract
Description
Technical Field
[0001] The present invention generally relates to intravascular measurement and feature detection and related diagnostic methods and apparatus. Background Art
[0002] Coronary artery disease is one of the causes of death worldwide. Better diagnosis, monitoring, and the ability to treat coronary artery disease can be crucial in saving lives. Intravascular optical coherence tomography (OCT) is a catheter-based imaging mode that uses light to peer into the coronary artery wall and generate its image for research. Utilizing coherent light, interferometry, and micro-optics, OCT can provide in vivo tomography at video rates within diseased blood vessels with micron-level resolution. Using fiber optic probes to view subsurface tissue structures with high resolution makes OCT especially useful for minimally invasive imaging of internal tissues and organs. The level of detail that can be performed using OCT allows clinicians to diagnose and monitor the progress of coronary artery disease. OCT images provide high-resolution vision of coronary artery morphology and can be used alone or in combination with other information, such as angiographic data and other sources of patient data that help diagnose and plan (such as stent delivery plan).
[0003] OCT imaging of multiple parts of a patient's body provides physicians and others with useful diagnostic tools. For example, imaging of coronary arteries by intravascular OCT can visualize the location of narrowing or stenosis. This information helps cardiologists choose between invasive coronary artery bypass surgery and minimally invasive catheter-based procedures such as angioplasty or stent delivery. Although a popular choice, stent delivery has its own associated risks.
[0004] A stent is a tubular structure usually formed of mesh. A stent can be inserted into a blood vessel and expanded to counteract a stenotic condition that constricts blood flow. Stents are usually made of metal or polymer scaffolds. Stents can be deployed to the site of stenosis with the aid of a catheter. During cardiovascular surgery, stents can be delivered to the site of stenosis through a catheter with the aid of a guide wire and deployed using a balloon. Typically, a preset pressure is used to deploy the stent to enlarge the lumen of the stenotic vessel. Angiography systems, intravascular ultrasound systems, and OCT systems can be used in combination or alone to facilitate stent delivery planning and stent deployment.
[0005] There are multiple factors that affect patient treatment outcomes when deploying a stent. In some procedures, the stent should be expanded to a diameter that corresponds to the diameter of an adjacent healthy vessel segment. Over-expansion of a stent can cause severe damage to the vessel, making it susceptible to disintegration, detachment, and intramural bleeding. An under-expanded stent may inappropriately expand the vessel. If multiple portions of the stent do not contact the vessel wall, the risk of thrombosis may increase. An under-inflated or poorly adhered stent may not be able to restore normal flow. Once the stent is installed, poor stent adherence and insufficient expansion of the stent can lead to a variety of problems.
[0006] There are other challenges associated with stent implantation and related procedures. Visualizing the deployment of stents relative to the vessel wall using an angiography system is challenging to perform by inspection. In addition, manually reviewing angiography images to determine stent position on a per-image basis is also prone to error.
[0007] The present invention addresses these and other challenges. Summary of the invention
[0008] In part, the present invention relates to angiographic and intravascular data collection systems, such as OCT and / or IVUS, that can be used to plan stent delivery or otherwise generate and display diagnostic information of interest. The present invention also relates to the generation of various indices and the integration of these indices relative to the display of image data. As an example, longitudinal indices (such as apposition strips) can be used alone or in conjunction with stent strut indices and superimposed on angiographic frames that are co-registered with an intravascular data set, such as a set of OCT scan lines used for a diagnostic procedure (such as stent planning) or images generated relative thereto.
[0009] In part, in one embodiment, the present invention relates to systems and methods for displaying the results of data analysis applied to intravascular data sets to users of intravascular data collection systems and angiography systems. In part, the present invention describes a graphical user interface (GUI) that provides a user interface and graphical data representations that can be applied to one or more generated images or angiography images of a vessel so that areas of interest (such as areas of stent apposition, etc.) are easy to find and understand on OCT and angiography images.
[0010] In part, the present invention relates to a data collection system, such as an intravascular data collection system suitable for use in a catheterization laboratory, such as an optical coherence tomography system. In part, the present invention relates to a data collection system including a processor suitable for displaying intravascular image data. The displayed image data includes data or images generated based on depth measurements. In one embodiment, the image data is generated using optical coherence tomography. The system can also display a user interface for displaying intravascular information, such as data about stent malapposition in a longitudinal mode based on each stent strut or a bar with areas corresponding to stents, no stents, or stent apposition levels that may be of interest for one or more stents in the vessel.
[0011] One or more indicators (such as longitudinal indicators, as a non-limiting example) can be generated in response to the stent detection process and the lumen boundary detection and displayed relative to the angiography, OCT and IVUS images. These can be viewed by the user to plan stent delivery and to expand or adjust stent delivery by reviewing the fused OCT images and angiography images with relevant indicators of interest. In part, the systems and methods described herein relate to methods for avoiding or reducing the possibility of data misinterpretation by replacing areas of missing data with indicators (such as hash values, colored areas, or other visual indicators). In this way, the end user is informed when data is missing, rather than misinterpreting black areas as shadows or side branches. Therefore, the missing data area is encoded with an indicator that prevents the area from being misinterpreted as a side branch, a stent, or other features of interest to the diagnostician. In one embodiment, the method may include the steps of displaying a marker of the stent strut on a graphical user interface and displaying a marker indicating one or more areas in the intravascular image, where the data is not available for display. In one embodiment, the wall strip is displayed so that it is an independent intravascular view, so that the wall strip is displayed when there is no image containing an indicator or a stent. In one embodiment, the invention is directed to an applicator strip aligned with a stented region including positioned stent struts, wherein the applicator strip is rotationally independent or continuous.
[0012] In part, the present invention relates to stent detection and shadow detection in the context of an intravascular dataset acquired using a probe, such as an optical coherence tomography probe or an intravascular ultrasound probe, for example.
[0013] In part, the present invention relates to systems and methods for accurately identifying a metallic stent strut offset or location within a shadow cast in OCT image data. The method of stent strut detection may include: accessing multiple frames of intravascular imaging data, the multiple frames including optical coherence tomography (OCT) scan lines; identifying a shadow region corresponding to a candidate stent strut; identifying a scan line corresponding to the candidate stent strut shadow region to generate a candidate strut shadow scan line; and analyzing the candidate strut shadow scan line to identify the location of the stent strut.
[0014] The method for stent strut detection may also include: storing multiple frames of intravascular imaging data; detecting stent struts in a first frame group of the multiple frames; detecting one or more shadow areas in the first frame group, wherein one or more of the shadow areas are adjacent to the detected stent struts; determining whether a given shadow area is a guidewire-initiated area or a side branch-initiated area based on each shadow area to generate a set of candidate stent strut shadow areas, wherein each candidate stent strut shadow area includes a shadow boundary; and identifying a scan line of a candidate stent strut shadow area within the shadow boundary.
[0015] The methods of the present invention may include additional steps or features. For example, the methods may include identifying a shaded area corresponding to a candidate stent strut by eliminating a shaded area corresponding to a non-stent feature. The non-stent feature may be selected from, for example, a group consisting of a guidewire, a side branch, and a combination thereof.
[0016] The methods may include eliminating candidate strut shadow scan lines that contain overflow from lumen pixels. The methods may include determining a projection across each candidate strut shadow scan line by summing the signal responses across the candidate strut shadow scan lines, or a portion or sample of such scan lines. The methods may include identifying up to three local maxima in the projection.
[0017] These methods may include ranking local maxima based on peak signal strength to generate a peak score. The ranking may be a sequential ranking, wherein local maxima with higher peak signal strengths receive higher peak scores.
[0018] The methods may include ranking the local maxima based on proximity to the vessel wall to generate a proximity score. The ranking may be an ordinal ranking, wherein local maxima closer to the vessel wall receive higher proximity scores. The methods may include assigning a malapposition score to each local maximum. The malapposition score may be binary, wherein local maxima that are malapposition receive a score of zero.
[0019] These methods can include summing the peak score, the proximity score, and the malapposition score, wherein the local maximum with the highest total score is designated as the location of the stent strut.
[0020] The methods may include: identifying a plurality of shadow regions corresponding to candidate stent struts; identifying a scan line corresponding to each candidate stent strut shadow region; and identifying a location of a stent strut within each candidate stent strut shadow region. The methods may include performing a cross-frame analysis to verify a designated stent strut across a plurality of optical coherence tomography (OCT) imaging frames.
[0021] The methods may include displaying the validated stent struts on a graphical user interface. The invention also includes a computer readable medium including non-transitory instructions that, when executed, cause a processor to perform any of the above steps.
[0022] Although the present invention relates to different aspects and embodiments, it should be understood that the different aspects and embodiments disclosed herein can be integrated together in whole or in part, as appropriate. Therefore, for a given implementation, each embodiment disclosed herein can be incorporated into various aspects to varying degrees, as appropriate. In addition, although some aspects and embodiments are described using "components for..." terms, it should be understood that all aspects, embodiments, and other concepts disclosed herein can be used as support for component-plus-function claims, even if specific "components for..." language is not used in specific portions of the written specification. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] The drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating principles. The drawings are to be regarded in all respects as illustrative and not intended to limit the invention, the scope of which is defined solely by the claims.
[0024] Figure 1 A schematic diagram of an intravascular imaging and data collection system is shown in accordance with an illustrative embodiment of the invention.
[0025] FIG. 2A to FIG. 2E Additional details are shown regarding a user interface display and intravascular data collection system and appropriate indices thereof, and angiographic imaging system for diagnostic procedures including stent delivery planning, according to an illustrative embodiment of the present invention.
[0026] Figures 3A to 6 Various user interfaces and data presentations are shown, including various metrics and fused features associated with one or more imaging modalities, according to illustrative embodiments of the invention.
[0027] FIG. 7A to FIG. 7B A three-dimensional representation of a side branch index generated using intravascular imaging data, such as OCT data, is shown in accordance with an illustrative embodiment of the invention.
[0028] FIG. 8A to FIG. 9B Additional details are shown regarding a user interface display and intravascular data collection system and its appropriate indicators, as well as a contrast imaging system for diagnostic procedures.
[0029] Fig. 10A An exemplary intravascular data collection system and associated intravascular data collection probe and related image processing, detection and other software components according to an illustrative embodiment of the present invention are shown.
[0030] Fig. 10B is a cross-sectional OCT image of a stented blood vessel according to an illustrative embodiment of the invention.
[0031] Fig.11 is a flow chart of a method for detecting struts in OCT image data according to an illustrative embodiment of the present invention.
[0032] Fig.12 FIG. 1 is a scan line OCT image of a stented blood vessel in polar coordinates and on a logarithmic scale according to an illustrative embodiment of the present invention.
[0033] Fig.13 is a diagram illustrating detection of multiple potential braces within a single shadow, according to an illustrative embodiment of the invention. DETAILED DESCRIPTION
[0034] In part, the present invention relates to intravascular data collection systems, such as OCT, IVUS, and angiography systems, and data exchange between, for example, two or more of the foregoing, and generation and display of diagnostic information, such as indicators. In one embodiment, intravascular data, such as OCT, is collected while angiography data is collected synchronously. Indicators may include one or more one-dimensional or two-dimensional graphical elements and one or more associated indicia, such as color, grayscale or other color scale, hash value, symbol, or other visual element.
[0035] One or more indicators can be generated and displayed, such as by overlaying or otherwise combining such indicators with images generated using an intravascular data collection system. These indicators can include longitudinal, cross-sectional, and other indicator types, such as one or more markers or graphic elements suitable for indicating diagnostic information of interest (such as tracking relative to a user-selected marker). Stent strut indicators can also be used. Methods of stent and shadow detection are described herein, which can be used to display such intravascular features in a user interface and to display overlays associated therewith, such as indicators or markers. Angiographic data can also be integrated with various commonly used indicators and displayed as part of a fused display. In one embodiment, shadows and other elements that can be misinterpreted as dissections, side branches, or other vascular features can be colored or otherwise changed to distinguish them and facilitate user inspection and analysis of image frames and data according to one embodiment.
[0036] Suitable diagnostic information may include stent apposition information, such as poor apposition of the stent relative to the vessel wall or lumen boundary, a user-selected OCT position in the vessel and an associated angiographic frame position, and other intravascular diagnostic information or other information generated to facilitate stent delivery planning. The system includes a processor that communicates with a graphical user interface and is configured to send commands to the graphical user interface. One or more software programs are used to perform one or more of the following: fusing data (such as multiple frames of image data), generating and displaying longitudinal indicators representing the position of the stent relative to the determined lumen boundary, encoding or marking data missing areas for end users, converting user-selected OCT position information to an angiographic display using one or more graphical elements to facilitate fusion, and visually identifying stents and simulated stents for planning purposes, as well as other items disclosed herein.
[0037] In part, the present invention relates to graphical user interface (GUI) elements or indicators represented on a display of patient data (such as image data or other intravascular parameters measured relative to the patient). Any clinically useful parameter can be evaluated and displayed as an indicator or marker as it changes longitudinally or cross-sectionally during the course of an optical coherence tomography pullback record or IVUS or other intravascular or angiographic system. Individual indicators / markers can be used by cardiologists to quickly view clinically useful information for the entire pullback record in a single view without manually manipulating the image. Indicators can guide the user to specific points of interest in the vessel based on parameters exceeding or falling below clinically meaningful thresholds. By encoding parameter values in a continuous color scale or other scale using, for example, appropriate markings, the different severity of the parameters can be easily summarized for the entire vessel in an easily understandable view. These features are shown using various wall-attaching strips, stent indicators, and other indicators for angiographic images and other intravascular data collection images.
[0038] Figure 1 Systems suitable for performing some of these features are included. Figure 2A Four panels are shown, where the top right panel includes an angiographic display with various indices, including a first user selected location US1, a second user selected location US2, and an active frame AF. These indices are also shown in the bottom L-mode or longitudinal panel, where US1 and US2 correspond to the vertical lines shown, and the active frame AF corresponds to the vertical line between US1 and US2. The active frame is shown in a cross-sectional view at the top right panel. The middle panel shows the values of the US1 position and the US2 position in mm as the vessel positions and the calculated MLA. Figure 2B Shown with Figure 1 OCT data fusion Figure 1 The user interfaces include movable elements C1, C2 that can be controlled by a user using a mouse, joystick, or other control element and can be operated using one or more processors and memory storage elements. The movable elements C1, C2 are controls and can be rotated or moved as part of the interface. Figure 2C and Figure 3B And other figures also show movable elements C1, C2. Figure 3B Controls C1 , C2 are also represented as semicircles relative to the stent struts in the 3D image and as line segments in the right panel.
[0039] Figure 2C The wall-adherent strip / indicator strip 111 is shown as an indicator having regions R1 to R7, which are shown in the upper right angiographic image. Figure 2D. The upper right panel shows R3 showing the adherent area exceeding the threshold of interest. In L mode, the stent struts are coded with markers, such as symbols or colors. The adherent area of interest in the adherent strip remains on the display, even if the data set is rotated to focus the user on the area important for stent planning and patient diagnosis. In this sense, the indicator can continue to guide the user's focus during planning or other processes. Figure 2E Additional details are shown regarding an exemplary adherence bar or indicator bar 111. The indicator bar 111 can be used for stent planning and inspection and indicates areas in the intravascular image that have adherence or another metric relative to the stent struts. In one embodiment, the indicator bar 111 is persistent in the user interface view to alert the user to the stent area even if the stent area is not visible based on the view selected by the user (3D, cross-sectional, longitudinal, viewing angle, etc.).
[0040] Reference Figure 2C , the two points of interest selected by the user are shown as U1 and U2. R3 corresponds to the malapposition region of interest. R2 corresponds to the first stent and R6 corresponds to the second stent. R5 is the gap between R2 and R6. This data is fused with the angiographic data, as shown in Figure 2D , to facilitate stent planning. The data collection elements of probe DC are shown in this image. R1 and R7 are distal and proximal regions where no stent is present and correspond to the lumen of the vessel. U1 and U2 serve as user placed landmarks that can be used by a user viewing a live angiogram to provide them with a reference frame for the vessel segments marked with U1 and U2. One or more displays may be used, such as a live angiogram and OCT pullback data with a previously acquired pullback frame.
[0041] Using these and other indicators, graphs and indicators can be used as tools to help Figure 2C and Figure 2D Indicators can also be more detailed with color-coded or otherwise coded stent strut markings to show when the stent needs to be expanded, either in cross-sectional or longitudinal views. Figure 2E In the embodiment, the area of the first stent 222a and the second stent 222b is shown by the wall-adherence strip 111. The lumen or stent-free area 224 and the poor wall-adherence area 223 are also shown. The strip 111 can be displayed on any angiographic or OCT or IVUS image of interest. In one embodiment, the wall-adherence strip is displayed so that it is an independent or continuous intravascular view, so that the wall-adherence strip is displayed when there is no image containing the index or stent. For example, it can be based on the use of Figure 1 and Fig. 10A The system generates stent detection, lumen detection, stent adhesion measurement and various graphic overlays to generate various indicators and markers.
[0042] Figure 3A An interface with a longitudinal view or L-mode is shown showing an apposition bar over a stent strut indicator encoded based on an apposition threshold. An indicator bar 111 is shown in the middle of the GUI showing an unstented area 224 and a malapposition area 223. Lumen boundary data from OCT or IVUS is used to determine apposition problems, such as when a threshold is exceeded given the detected strut data as input to the apposition bar generation software module. Figure 3B , the interface screen shows an example of an indicator measuring advanced adhesion for a metallized stent strut as shown above the L-mode display in the GUI screenshot shown. The adhesion indicator allows summary information about clinical parameters to be displayed without manually manipulating or inspecting the image data. The stent adhesion strip and other indicators shown in this article and their integration with the angiogram provide many advantages to the user.
[0043] exist Figure 3A , Figure 3B , Figure 4A and Figure 4B In some embodiments of the user interface, intravascular data and angiographic data (where applicable) are shown together with exemplary indicators for stent strut adhesion and other indicator-based data displays. In one embodiment, adhesion strips are shown on L-mode and angiographic images, three-dimensional flow images, etc. Figure 4B An angiographic image with stent data is shown showing threshold information along the outer boundary of the vessel and a longitudinal view of the apposition strip 111. Area 161a in the angiographic portion of the user interface is also aligned with area 161b of the indicator strip 111. In one embodiment, the angiographic image is aligned or registered with the apposition strip. One feature of the apposition strip 111 is that the apposition strip 111 is persistent in the user interface so that if a stent is present in a 2D or 3D image, but the stent is not visible based on the cross-section or viewing angle, the apposition strip will persist and show that the stent and any associated malapposition are present, even if the 2D or 3D stent is not visible in the GUI. This is a useful feature for stents that are planned for diagnosis.
[0044] exist Figure 4A In FIG. 1 , an indicator bar 111 is shown indicating stent struts and regions of interest 157 for adherence. These regions of interest 157 showing adherence can be grouped using representations of the stent struts themselves, which are color coded or coded with another marker visible in the GUI. Figure 3A , Figure 3B , Figure 5 and Figure 6, an example of a grouping of stent struts encoded with indicia and indicator bars is shown by regions 188. In these regions 188, indicator bars 111 are shown aligned with a representation of a stent and a series of struts having various indicia corresponding to adherence relative to the vessel wall. The detected lumen boundary is used to compare the stent position relative thereto. Additional details regarding stent detection are included herein.
[0045] Figure 5 Another GUI with index or image data processing feature is shown, by which missing data (such as the missing shadow of the data or guide wire covered) is modified by software to replace the missing data with a grayscale mask or another index. In order to avoid the user being confused by side branch, dissection or missing data, the area of data missing is indicated using index MD. This has the benefit of preventing the user from making mistakes for missing data, dissection area or side branch. In one embodiment, the area of data missing due to shadow or otherwise is shown with a mark or index, such as a grayscale area, a shading area, a hash value or another visual mark. The middle double arrow icon allows the view to be rotated. This user controls the image data and / or the diagnostic range of angiographic data from the intravascular data collection probe all improved and extended by color coding or other markings to the identification of the guide wire.
[0046] In another embodiment, Figure 5 As shown, the indicator W is used to point to the guidewire image. In one embodiment, the indicator W can be used to identify the guidewire in the GUI or select the guidewire to be removed from the image. Figure 6 A 3D fly-through is shown with an adherence bar shown as a track ahead of the user's view plane corresponding to the cross section on the right. Indicator bars 111 showing stent struts and adherence areas of interest - included in the 3D fly-through view and any other view of interest - the area of interest remains visible during rotation to alert the user to important vessel areas during stent planning.
[0047] Fig. 7A and Figure 7B Other indicators SB corresponding to the side branches are shown. A rendering of the vessel wall VW is also shown relative to the side branches. These and other indicators can be used to highlight areas in the 2D data and 3D data. As shown in the illustrated user interface, such as Fig. 9B , the various circles / line segments C1, C2 in the upper right view can be rotated to navigate between various views of the image. FIG. 8A to FIG. 9BAdditional interfaces and control information for navigating image data sets and performing diagnosis (such as stent planning) are shown. Each proximal view and distal view and other perspective views can be navigated using the tool shown in this article. In one or more embodiments, indicators (such as wall-adhering strips 111) are continuous, so that these indicators remain in the view, even if navigated away from the poorly adhered area.
[0048] Thus, some indicators are independent of rotation, so that if an indicator includes an area or length having a parameter exceeding a threshold, the area remains indicated, such that even if the image data is changed so that the rotated view obscures an area such as a malapposed stent area. Thus, if one side of a vessel has an apposition problem, the user remains aware that the problem relates to its location in the vessel. An apposition bar can be displayed as an indicator in one or more views or user interfaces of an angiographic or OCT image.
[0049] As shown in each figure, the wall-adherent strip 111 can be subdivided into various regions or lengths, which represent the existence of one or more stents in the blood vessel or the poor wall adhesion or gap between the stents of the blood vessel with multiple stents. Angiographic data and associated image frames can be fused with OCT data. In addition, as shown in the figure, the vertical line corresponding to the specific longitudinal distance on the artery selected by the user can be set to guide the stent plan. The rotation of the strip is irrelevant or continuous. The nature provides further assistance and error reduction during the stent plan.
[0050] During the stent delivery planning process, clinician-specified landmarks can be used for stent planning by providing a user with a reference for selecting stent size relative to the vessel, relative to which the user can refer while deploying the stent using live angiography. Given the malapposition grade and location, the user can refer to the OCT and annotated angiography to further expand or move the stent as part of the delivery plan. For example, these system features and methods can be used in Figure 1 The system shown in 3 and Fig. 10A system to achieve this.
[0051] Figure 1 A system 3 is shown, which includes various data collection subsystems suitable for collecting data or detecting characteristics of a patient 4 or sensing a condition of a patient 4 or otherwise diagnosing a patient 4. In one embodiment, the patient is placed on a suitable support 19, such as a table, bed, chair, or other suitable support. Typically, the patient 4 is a human or other animal having a specific area 25 of interest.
[0052] The data collection system 3 includes a non-invasive imaging system, such as magnetic resonance imaging, x-ray, computer-assisted tomography, or other suitable non-invasive imaging technology. As shown, as a non-limiting example of such a non-invasive imaging system, a vascular angiography system 21 such as one suitable for generating images is shown. The vascular angiography system 21 may include a fluoroscopic system. For example, the vascular angiography system 21 is configured to non-invasively image the patient 4 so that multiple frames of vascular angiography data (usually in the form of multiple frames of image data) are generated while performing a pullback process using the probe 30, thereby imaging blood vessels in the region 25 of the patient 4 using angiography in one or more imaging techniques (such as OCT or IVUS).
[0053] In one embodiment, the angiography system 21 communicates with an angiography data storage and image management system 22, which can be implemented as a workstation or server. In one embodiment, data processing on the collected angiography signals is performed directly on the detector of the angiography system 21. Images from the system 21 are stored and managed by the angiography data storage and image management system 22.
[0054] In one embodiment, the system server 50 or workstation 87 handles the functions of system 22. In some embodiments, the entire system 21 generates electromagnetic radiation, such as x-rays. System 21 also receives such radiation after passing through patient 4. Next, data processing system 22 uses the signals from angiography system 21 to image one or more regions of patient 4, including region 25. The system allows angiography data to be displayed on display 82 and display 82 along with intravascular data and various indicators as described herein, as well as detected stent struts and shadows.
[0055] As shown in this particular example, the region of interest 25 is a subset of a vascular or peripheral vascular system (such as a specific blood vessel). This can be imaged using OCT. A catheter-based data collection probe 30 is introduced into the patient 4 and placed in the lumen of a specific blood vessel (such as, for example, a coronary artery). The probe 30 can be various types of data collection probes, such as, for example, an OCT probe, an FFR probe, an IVUS probe, a probe combining the features of two or more of the above items, and other probes suitable for imaging within a blood vessel. The probe 30 typically includes a probe tip, one or more radiopaque markers, an optical fiber, and a torsion wire. In addition, the probe tip includes one or more data collection subsystems, such as a beam director, an acoustic beam director, a pressure detector sensor, other transducers or detectors, and a combination of the above items.
[0056] For intravascular probes that include a beam director, the optical fiber 33 is in optical communication with the probe having the beam director. The torsion wire defines a hole in which the optical fiber is placed. Figure 1 , the optical fiber 33 is shown without a torsion wire surrounding it. In addition, the probe 30 also includes a sheath, such as a polymer sheath (not shown), that forms part of the catheter. The optical fiber 33 is optically coupled to a patient interface unit (PIU) 35, as shown, which in the context of an OCT system is part of the sample arm of an interferometer.
[0057] The patient interface unit 35 includes a probe connector suitable for receiving the end of the probe 30 and optically connected to it. Typically, the data collection probe 30 is disposable. Based on the type of data collection probe used, the PIU 35 includes suitable connectors and components. For example, a combined OCT and IVUS data collection probe requires an OCT and IVUS PIU. The PIU 35 also typically includes a motor that is suitable for pulling back the torsion wire, sheath, and optical fiber 33 disposed therein as part of the pullback process. In addition to being pulled back, the probe tip is typically rotated by the PIU 35. In this way, the blood vessels of the patient 4 can be imaged longitudinally or by means of a cross section. The probe 30 can also be used to measure specific parameters, such as FFR or other pressure measurements. The image data can be used to generate various 2D views and 3D views that can be navigated, as shown in the user interface drawing.
[0058] Next, the PIU 35 is connected to one or more intravascular data collection systems 42. The intravascular data collection system 42 can be an OCT system, an IVUS system, another imaging system, and combinations of the foregoing. For example, the system 42 in the context of an OCT probe can include a sample arm of an interferometer, a reference arm of an interferometer, a photodiode, a control system, and a patient interface unit. Similarly, as another example, in the context of an IVUS system, the intravascular data collection system 42 can include ultrasound signal generation and processing circuitry, noise filters, rotatable joints, motors, and an interface unit. In one embodiment, the data collection system 42 and the angiography system 21 have a shared clock or other timing signal configured to synchronize angiography video frame timestamps and OCT image frame timestamps.
[0059] Apart from Figure 1 The invasive and non-invasive image data collection systems and devices of the present invention can also collect various other types of data with respect to the patient's region 25 and other parameters of interest to the patient. For example, the data collection probe 30 can include one or more pressure sensors, such as, for example, a pressure wire. The pressure wire can be used without adding an OCT or ultrasound component. Pressure readings can be obtained along a segment of a blood vessel in the region 25 of the patient 4.
[0060] Such readings may be forwarded via a wired connection or by means of a wireless connection. As shown in the fractional flow reserve FFR data collection system, the wireless transceiver 48 is configured to receive pressure readings from the probe 30 and transmit these readings to a system that generates FFR measurements or to further locations along the measured vessel. One or more displays 82, 83 may also be used to show angiographic data frames, OCT frames, user interfaces for OCT and angiographic data, shading, indicators, missing data, and other controls and features of interest.
[0061] Intravascular image data, such as multiple frames of intravascular data generated using the data collection probe 30, may be routed to a data collection processing system 42 that is coupled to the probe via the PIU 35. Non-invasive image data generated using the angiography system 22 may be transmitted to, stored in, and processed by one or more servers or workstations, such as the fusion server 50 or the workstation 87. In various embodiments, a video frame grabber 55, such as a computer board, configured to capture angiography image data from the system 22 may be used.
[0062] In one embodiment, the server 50 includes one or more fusion software modules 60 stored in the memory 70 and executed by the processor 80. The server 50 may include other typical components for a processor-based computing server. Alternatively, more databases (such as database 90) may be configured to receive the generated image data, the patient's parameters, and other generated information, which are received or stored by the database 90. Figure 1 One or more of the system devices or components shown in the embodiment are transmitted to the database 90. Although the database 90 is shown as being connected to the server 50 when stored in the memory at the workstation 87, this is an exemplary configuration. For example, the software module 60 can be run on a processor at the workstation 87, and the database 90 can be located in the memory of the server 50. Devices or systems for running various software modules are provided as examples. In various combinations, the hardware and software described herein can be used to obtain multiple frames of image data, process such image data, and register such image data.
[0063] As otherwise noted herein, software modules 60 may include software (such as pre-processing software), transforms, matrices, lumen detection, stent detection, shadow detection, indicator generators and displays, and other software-based components for processing image data or responding to patient triggers to facilitate or otherwise perform fusion of different types of image data by other software-based components 60. Modules may include lumen detection using scanline-based or image-based methods, stent detection using scanline-based or image-based methods, indicator generation, applicator strip generation for stent planning, and guidewire shadow indicators to prevent objectionable confusion, side branches, and missing data, etc.
[0064] The database 90 may be configured to receive and store angiography image data 92, such as image data generated by the angiography system 21 and acquired by the frame grabber 55 of the server 50. The database 90 may be configured to receive and store OCT image data 95, such as image data generated by the OCT system 42 and acquired by the frame grabber 55 of the server 50.
[0065] In addition, patient 4 may be electrically coupled to one or more monitors, such as, for example, monitor 49, via one or more electrodes. Monitor 49 may include, but is not limited to, an ECG monitor configured to generate data about cardiac function and showing various states of the patient, such as systole and diastole. It is known that cardiac phase may be used to assist in tracking of vascular centerlines, as the geometry of the heart, including the coronary arteries, is nearly identical at a particular cardiac phase, even over different cardiac cycles.
[0066] Thus, if the angiographic data spans several cardiac cycles, a first order match of the vessel centerline at the same cardiac phase can assist in tracking the centerline throughout the pullback. Furthermore, because the majority of cardiac motion occurs during systole, vessel motion is expected to be higher near systole and dampened toward diastole. This provides data to one or more software modules as an indication of the amount of motion expected between consecutive angiographic frames. Knowledge of the expected motion can be used by one or more software modules to improve tracking quality and vessel centerline quality by allowing adaptive constraints based on the expected motion.
[0067] Shadow detection related implementation methods
[0068] The present invention provides, in part, methods and systems for identifying within a detected stent shadow the precise offset or position of a strut that causes the detected shadow. Sometimes, there is a possible single strut position within the shadow that corresponds to a bright strut highlight or peak in a scan line relative to a dark shadow background. However, multiple strut peaks are often detected within the strut shadow, making it difficult to identify the precise location of the stent strut. False peaks can be caused by, for example, blood stagnation in a pullback zone, poor blood clearance, or edge oscillation effects caused by imaging optics interacting with metal struts. The present invention provides methods and systems for identifying within a stent shadow the best candidate for a true stent.
[0069] Fig. 10A FIG. 1 is a high-level schematic diagram showing a blood vessel 5 (such as an artery), a data collection probe 7, and an intravascular data collection and processing system 10. Fig.11 The described method can also be used Figure 1 The system 10 may include, for example, an OCT system, an intravascular ultrasound (IVUS) system, or other intravascular imaging systems. A stent 12 is shown in a blood vessel 5. The stent includes a plurality of struts. Some struts may generate shadows or shadow regions SR as part of a process of imaging a blood vessel using an intravascular probe. The system 10 may include various software modules suitable for performing side branch detection, peak detection, shadow region detection and processing, error correction, indicator bar generation and display, model comparison, lumen detection, and various other processes as described herein. The system 10 may include a suitable light source that meets the interference and bandwidth requirements of the applications and data collection described herein. The system 10 may include an ultrasound imaging system. The probe 7 may include a catheter 20 having a catheter portion having one or more optical fibers 15 and a probe tip 17 disposed therein. In one embodiment, the probe tip 17 includes a beam director.
[0070] As shown, the catheter 20 is introduced into a lumen 11, such as an arterial lumen. The probe 7 may include a rotating or slidable optical fiber 15 that directs light forward into the lumen L or in a direction perpendicular to the longitudinal axis of the optical fiber 15. Thus, OCT data is collected relative to the wall of the blood vessel 5 with light directed from one side of the probe as the optical fiber 15 rotates. The wall of the blood vessel 5 defines the lumen boundary. The lumen boundary can be detected using distance measurements obtained from optical signals collected at the probe tip 17 using a lumen detection software component. In the scan lines generated during the pullback through the artery with the probe, side branches and stent struts and shadow areas and other features can be identified.
[0071] In one embodiment, in addition to OCT, the probe 7 may also include other imaging modalities, such as ultrasound in one embodiment. In one embodiment, the lumen / luminal boundary refers to the portion of the vessel that is first hit when light or ultrasound waves leave the intravascular imaging probe, which generates the signal of interest for imaging the vessel. This excludes any blood flowing within the vessel, which is removed by using a masking form of image processing. In one embodiment, the lumen or lumen boundary refers to the tissue region that is placed in front of the vessel wall and faces the blood-containing region of the vessel.
[0072] like Fig. 10A As shown, the probe tip 17 is located in the lumen L such that the probe tip 17 is distal to the stented region of the blood vessel 5. The probe tip 17 is configured to emit light and receive light backscattered from targets, such as the stent 12 and the wall of the blood vessel 5. The probe tip 17 and the rest of the data collection probe 7 are pulled through the lumen L. As shown in FIG. Fig. 10B As shown, the probe 17 is shown before and after insertion into a blood vessel. The probe 7 is in optical communication with the OCT system 10. The OCT system or subsystem 10 connected to the probe 17 via an optical fiber 15 may include a light source (such as a laser), an interferometer having a sample arm and a reference arm, various optical paths, a clock generator, a photodiode, and other OCT system components.
[0073] In one embodiment, an optical receiver 31 (such as a balanced photodiode based system) can receive light exiting the probe 7. A computing device 40 (such as a computer, processor, ASIC, or other device) can be part of the OCT system 10 or can be included as a separate subsystem in electrical or optical communication with the OCT system 10. The computing device 40 can include memory, storage, buses, and other components suitable for processing data and software 44, such as configured for side branch detection, stent strut candidate selection or identification, candidate stent strut shadow region detection, correlation analysis and comparison of stent image data, stent visualization, and image data processing stages of pullback data collection as discussed below.
[0074] In one embodiment, the computing device 40 includes or accesses software modules or programs 44, such as a side branch detection module, a lumen detection module, a stent detection module, a stent strut verification module, a candidate stent strut identification module, and other software modules. The software modules or programs 44 may include an image data processing pipeline or its component modules and one or more graphical user interfaces (GUIs). The various software-based methods described herein may be included as part of the set of software / programs 44. The modules may be subsets of each other and arranged and connected by various inputs, outputs, and data classes.
[0075] The exemplary image processing pipeline and its components may constitute one or more software programs or modules 44. The software module 44 may include multiple image processing algorithms formulated to detect vessel lumens, side branches, guidewires, catheters, stent struts, and stent regions. The present invention relates to image processing to determine the location of metal struts within their shadows. The image data processing pipeline, its components, software modules, and related methods, and any of the methods described herein are stored in a memory and executed using one or more computing devices (such as processors, devices, or other integrated circuits).
[0076] As shown, in Fig. 10A 4, the display 46 may also be part of the system 10 for displaying information 47, such as cross-sectional and longitudinal views of the vessel generated from OCT or IVUS imaging data and adherent strips and other indicators. Image processing software algorithms 44 provide data corresponding to detected image features (such as stents, side branches, guidewires, etc.), and this data is input to the GUI where these features are displayed in the desired format on the cross-sectional, longitudinal and / or 3D display sections of the GUI. Fig. 10B The image of is an example of display information 47, which can be displayed and interacted with using the GUI and various input devices. Specifically, the figure shows a 2D cross-sectional view of a coronary artery containing a metal stent.
[0077] In addition, the displayed information 47 may include, but is not limited to, cross-sectional scan data, longitudinal scans, diameter maps, image masks, stents, malapposition areas, lumen boundaries, and other images or representations of the vessel, or underlying distance measurements obtained using the OCT system and data collection probe. The computing device 40 may also include software or programs 44, which may be stored in one or more storage devices 45 and configured to identify stent struts and malapposition levels (such as based on comparison of thresholds and measured distances), shaded areas, and struts within shaded areas, and other vessel features, such as using text, arrows, color coding, highlights, contours, or other suitable human or machine readable indicia.
[0078] Fig. 10B : is a cross-sectional OCT image of a stented blood vessel according to the present invention. The lumen / lumen boundary of the blood vessel 10 is in the center of the image. On the upper side of the image from 12 o'clock to 1 o'clock, the guidewire shadow 12 is visible. Fig. 10B Also visible in the figure are a plurality of metal stent struts 14 which cast shadows 16 in the OCT image. The metal stent struts cast shadows against the vessel wall because the coherent light typically used for OCT imaging cannot penetrate the stent struts and is reflected. The present invention provides an improved method for detecting the precise deflection of the struts within the strut shadows. Once detected, the Fig. 10BThe shadows of the struts can be used to generate the user interfaces and indicators described in this article.
[0079] Fig.11 Flow chart of a method for detecting struts in OCT image data. Method 100 analyzes shadows corresponding to stent struts in multiple OCT pullback frames. Method 100 may include one or more of the steps described herein. Unless otherwise required, the steps may be performed in any order. The metal strut detection method operates based on various inputs from other image / intravascular data processing modules, such as information about guidewires (140), side branches (130), and strut shadow locations (110). The process flow and associated method steps and stages may operate based on raw intravascular data or raw data 120 obtained using OCT, IVUS, or other intravascular data collection systems. In one embodiment, the data 120 has been processed by one or more image processing modules in a pipeline configuration.
[0080] In step 110, each shadow in the OCT image data is compared or correlated with the data input from the side branch detection module 130 and the guidewire detection module 140 to determine whether the shadow is attributable to a side branch vessel or a guidewire. Methods, systems and devices for detecting strut shadows, side branches and guidewire shadows are known. For example, see US 8,412,312, US 8,478,387, US 8,831,321, US 9,138,147 and US 9,173,591.
[0081] At step 150, if a given shadow is determined to be attributable to a guidewire or side branch, the shadow is discarded and the analysis with respect to the shadow ends. At step 160, if a given shadow is determined to be attributable to a stent strut by direct detection or by a process of elimination, the shadow is analyzed to calculate or isolate the interior portion of the shadow. The shadow boundary is trimmed off or otherwise reduced or constrained so that only scan lines or A-lines corresponding to the interior (and therefore "darkest") portion of the shadow are retained. The reason for this is that the shadow region (specifically, the start scan line and the end scan line of the shadow) can sometimes contain overflow from adjacent lumen pixels. Isolating the interior of the shadow and ignoring transition scan lines at the edge of the shadow improves the assessment of strut excursion.
[0082] At step 170, the interior of the shadow is analyzed to calculate the projection (or sum) of each sample across the scan lines corresponding to the interior portion of the shadow. Each scan line is sampled as a discrete pixel or "sample". In the input OCT image data, each scan line refers to the data acquired along a specific angular direction using a centrally located imaging catheter. Each scan line is radially sampled in turn as a set of discrete pixels or "samples". Each sample in the OCT data is typically a few microns wide and is typically uniform in size. "Projection" refers to the process of adding across each scan line. In other words, the two-dimensional shadow in {scan line, sample} space is collapsed into a one-dimensional signal, where the i-th indicator corresponds to the sum of the i-th samples of each scan line involved in the process. The projection contains samples at a radius R, which are the average of the samples from the constituent scan lines at the same radius R.
[0083] At step 180, projections are searched for up to three (e.g., 1, 2, or 3) of the largest local maxima. The position or offset of each selected maximum can be recorded as a potential strut location, and then specific features of the selected maxima are analyzed to determine which is the best candidate for use as the true strut. In various embodiments, only the largest maximum is selected. In other embodiments, two or three of the largest maxima are selected. The initial selection of multiple local maxima increases sensitivity. Although more than three local maxima can be selected, this is generally unnecessary because one of the three highest maxima generally indicates the true strut location. The maximum selection process is performed by Fig.12 and Fig.13 Shown.
[0084] Fig.12 A-line or scanline OCT image of a stented vessel on a logarithmic scale. The box 155 on the right side of the image indicates the shadow being analyzed, and Fig.13 A projection diagram for the shadow is shown. The lumen L of the blood vessel is the dark area on the upper side of the image, and the vessel wall 18 is the bright area on the lower side of the image. In this article, L is generally used to indicate the lumen. Multiple stents 14 and stent shadows 16 are visible in the image. In one embodiment, the lumen is the boundary between the tissue and the clean interior of the blood vessel.
[0085] Fig.13 A diagram illustrating the detection of multiple potential braces within a single shadow. Fig.13 22a and 22b. These maxima correspond to two potential strut positions within the shadow. These positions can be used by an intravascular imaging system (such as an OCT or IVUS system) to display stent struts on a user interface, as shown in this article.
[0086] Additional filters can be applied to local maxima to remove false positives. In various embodiments, a local maximum is selected as long as it has a signal greater than 1 / 10 (e.g., 10%) of the global peak (the maximum maximum along the projection). The global peak is the peak with the largest amplitude. The 10% threshold reduces the chance of selecting a false local maximum due to noise. The threshold can be set between 5% (i.e., 1 / 20) and 10% of the global peak, such as 5%, 6%, 7%, 8%, 9%, or 10%, with 10% being preferred. In various embodiments, if multiple peaks very close to each other are detected, only the maximum peak is selected for further analysis.
[0087] At step 190, the selected local maxima are analyzed to determine which maximum has the highest probability of being a true strut based on information available from the vicinity of the strut. A relevance score is assigned to each strut based on one or more of the following criteria:
[0088] 1. Proximity to the Lumen: The selected local maxima are scored based on their proximity to the lumen boundary. The local maxima closest to the lumen around the strut shadow receive the highest score, and the local maxima farthest from the lumen around the strut shadow receive the lowest score.
[0089] 2. Peak strength: The selected local maxima are scored based on peak strength. The local maximum with the highest peak receives the highest score, and the local maximum with the lowest peak receives the lowest score.
[0090] 3. Malapposition: The selected local maxima are scored based on their apposition, which refers to the state of apposition with the lumen. Local maxima that are within a predefined acceptable distance from the lumen or vessel wall receive a higher malapposition score. Struts that are too far from the lumen or vessel wall (determined by user-specified thresholds or based on accepted treatment thresholds using one or more interface screens) are penalized and receive a lower malapposition score as potential false positives. In one embodiment, a strut may have a malapposition score of 0 or 1 depending on whether it is malapposition or not, respectively.
[0091] These scoring criteria are exemplary, and additional scoring criteria based on other strut and shadow features may be used. In one embodiment, a candidate stent strut is validated using cross-frame analysis to indicate that a strut is valid if a segment of the strut is adjacent to or aligned with another segment in an adjacent or neighboring frame.
[0092] Each local maximum receives a combined score that is a linear sum of the above criteria. At step 200, the local maximum with the highest score is selected as a valid strut. At step 210, the remaining local maxima are saved as alternative or backup struts to be further analyzed. In the event of a tie, the local maximum closest to the lumen and / or the brightest local maximum is used as the tiebreaker attribute. Table 1 provides an exemplary ranking of local maxima for stent shadows.
[0093] Table 1: Local maximum classification for bracket shadows
[0094]
[0095] As shown in Table 1, local maximum 1 has the highest total score and will therefore be selected as a candidate valid strut. Local maximum 2 and local maximum 3 will be designated as backup struts.
[0096] In step 220, all local maxima (active struts and any backup struts) undergo multi-frame verification. In this step, adjacent frames are compared to verify that the active struts in one frame are aligned with the active struts selected for the adjacent frame. If the active struts are not aligned with the struts of other cross frames, the active struts can be replaced with backup struts, provided that the backup struts better fit the cross frame model. One embodiment of the multi-frame verification step can use the support strut geometry and position information. Other embodiments with a larger set of struts and shadow features can also be used for this step. The position and geometry can be used as a feature together with other features (such as previous pullback data or other user-supplied information).
[0097] Once detected, the active or selected struts can be displayed on a user interface that communicates to the clinician a critical visual aid regarding the precise location of the stent struts and whether adjustments may be needed to optimize and / or accelerate stent implantation and reduce the risk of side effects. The user interface can include cross-sectional images, L-mode images, scan line images, three-dimensional renderings, or any other suitable display format for visualizing the detected struts. The user interface can also include indicator bars, angiographic data, and other views and features described and drawn herein.
[0098] In one embodiment, the detection algorithm accurately identifies the location of the strut with a sensitivity ranging from greater than about 80%. In one embodiment, the detection algorithm accurately identifies the location of the strut with a sensitivity ranging from greater than about 00%. In one embodiment, the sensitivity is the ratio of correctly positioned struts to the total number of struts (correctly positioned struts plus incorrectly positioned struts). In one embodiment, the positive predictive value is the ratio of correctly detected struts to all positive calls (correctly detected struts plus false positives). The various features described herein are suitable for use with different catheterization laboratory systems (such as intravascular imaging and pressure measurement systems). The indicators and detection steps described herein provide various advantages to diagnosticians and physicians planning stent deployment or evaluating deployed stents.
[0099] The use of directional arrows or the lack of arrows in a given figure is not intended to limit or require the direction in which information may flow. Figure 1 and Fig. 10A The arrows and lines shown in the figure connecting multiple elements, for example, information can flow in one or more directions or in only one direction, as appropriate for a given embodiment. The connection may include various suitable data transmission connections, such as optical connections, wired connections, power connections, wireless connections, or electrical connections.
[0100] Certain portions of the detailed description are presented in accordance with algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations can be used by those skilled in the art of computer and software related fields. In one embodiment, an algorithm is herein and generally contemplated as a methodical sequence of operations leading to a desired result. Operations as performed by method steps or otherwise described herein are operations requiring physical manipulation of physical quantities. Typically, but not necessarily, these quantities employ electrical or magnetic signals that can be stored, transmitted, combined, converted, compared, and otherwise manipulated.
[0101] Non-limiting software features and implementations for implementing interfaces, detection and other features of the present invention
[0102] The following description is intended to provide an overview of the equipment hardware and other operating components suitable for performing the method of the present invention described herein. This description is not intended to limit the applicable environment or scope of the present invention. Similarly, hardware and other operating components may be suitable as parts of the device described above. Other system configurations may be utilized to practice the present invention, including personal computers, multiprocessor systems, microprocessor-based or programmable electronic devices, network PCs, microcomputers, mainframe computers, etc. The present invention may also be practiced in a distributed computing environment, wherein a remote processing device such as a remote processing device linked by a communication network in different compartments of a catheter or catheter room is utilized to perform tasks.
[0103] Certain portions of the detailed description are presented in accordance with algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations can be used by those skilled in the art of computer and software related fields. In one embodiment, an algorithm is herein and generally contemplated as a methodical sequence of operations leading to a desired result. Operations as performed by method steps or otherwise described herein are operations requiring physical manipulation of physical quantities. Typically, but not necessarily, these quantities employ electrical or magnetic signals that can be stored, transmitted, combined, converted, compared, and otherwise manipulated.
[0104] Unless otherwise expressly indicated, as will be apparent from the following discussion, it is to be appreciated that throughout the specification, discussions utilizing terms such as "processing" or "computing" or "searching" or "indicating" or "detecting" or "measuring" or "calculating" or "comparing" or "generating" or "sensing" or "determining" or "displaying", or Boolean logic or other set-related operations, etc., refer to the actions and processes of a computer system or electronic device that manipulate data represented by physical (electronic) quantities within registers and memories of the computer system or electronic device and convert them into other data similarly represented by physical quantities within electronic memories or registers or other such information storage, transmission or display devices.
[0105] In some embodiments, the present invention also relates to an apparatus for performing the operations described herein. The apparatus may be constructed specifically for the desired purpose, or the apparatus may include a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. The various circuits and components of the apparatus may be used to perform some of the data collection and conversion and processing described herein.
[0106] The algorithms and displays presented herein are not inherently related to any particular computer or other device. Various general purpose systems may be used in conjunction with the programs taught herein, or it may prove convenient to construct more specialized devices for performing the required method steps. The structures required for a variety of these systems will emerge from the following description. In addition, the present invention is not described with reference to any particular programming language, and therefore various embodiments may be implemented using a variety of programming languages. In one embodiment, the software instructions are configured for operation on a microprocessor or ASIC for an intravascular imaging / data collection system.
[0107] Embodiments of the present invention may be embodied in many different forms, including but not limited to computer program logic for use with a processor (e.g., a microprocessor, a microcontroller, a digital signal processor, or a general purpose computer), programmable logic for use with a programmable logic device (e.g., a Field Programmable Gate Array (FPGA) or other programmable logic device), discrete components, integrated circuits (e.g., an Application Specific Integrated Circuit (ASIC)), or any other means including any combination of the foregoing. In a typical embodiment of the present invention, some or all of the processing of data collected using an OCT probe and a processor-based system, or used to generate control signals or initiate user interface instructions, is implemented as a set of computer program instructions that are converted into a computer executable form, stored in a medium such as a computer readable medium, and executed by a microprocessor under the control of an operating system.
[0108] Thus, the queries, responses, transmitted probe data, input data, and other data and signals described herein are converted into processor understandable instructions suitable for responding to user interface selections, controlling graphical user interfaces, controlling and graphical signal processing, displaying cross-sectional information and images from other data collection modes, generating and displaying stents and apposition strips and other intravascular data, displaying OCT, angiography, detecting shadows, detecting peaks, and other data as part of a graphical user interface, and other features and embodiments as described above. Data and parameters suitable for display as GUI components or controls, values, or other representations in a graphical user interface may include, but are not limited to, malapposition values, apposition strips, stent struts, missing data representations, indicator bars, shadows, angiography representations, three-dimensional and two-dimensional presentations and views, and other features as described herein.
[0109] The computer program logic that implements all or part of the functions previously described herein can be embodied in various forms, including but not limited to source code form, computer executable form, and various intermediate forms (e.g., forms generated by assemblers, compilers, linkers, or locators). The source code may include a series of computer program instructions implemented in any of various programming languages (e.g., object code, assembly language, or high-level languages such as Fortran, C, C++, JAVA, or HTML) used with various operating systems or operating environments. The source code may define and use various data structures and communication messages. The source code may be in a computer executable form (e.g., with the aid of an annotator), or the source code may be converted (e.g., with the aid of a translator, assembler, or compiler) to a computer executable form.
[0110] A computer program may be permanently or temporarily fixed in any form (e.g., source code form, computer executable form, or intermediate form) in a tangible storage medium such as a semiconductor storage device (e.g., RAM, ROM, PROM, EEPROM, or flash-programmable RAM), a magnetic storage device (e.g., a magnetic disk or fixed hard disk), an optical storage device (e.g., a CD-ROM), a PC card (e.g., a PCMCIA card), or other storage device. A computer program may be fixed in any form in a signal that can be sent to a computer using any of a variety of communication technologies, including but not limited to analog, digital, optical, wireless, networking, and internetworking technologies. A computer program may be distributed in any form as a removable storage medium with printed or electronic documentation (e.g., shrink-wrapped software), preloaded with a computer system (e.g., on a system ROM or fixed hard disk), or distributed over a network.
[0111] Hardware logic that implements all or part of the functionality previously described herein (including programmable logic for use with programmable logic devices) can be designed using traditional manual methods, or can be designed, captured, simulated, or documented electronically using various tools, such as computer-aided design (CAD), hardware description languages (e.g., VHDL or AHDL), or PLD programming languages (e.g., PALASM, ABEL, or CUPL).
[0112] Programmable logic may be permanently or temporarily fixed in a tangible storage medium, such as a semiconductor storage device (e.g., RAM, ROM, PROM, EEPROM, or flash-programmable RAM), a magnetic storage device (e.g., a magnetic disk or fixed hard disk), an optical storage device (e.g., a CD-ROM), or other storage device. Programmable logic may be fixed in a signal that can be sent to a computer using any of a variety of communication technologies, including but not limited to analog, digital, optical, wireless (e.g., Bluetooth), networking, and internetworking. Programmable logic may be distributed as a removable storage medium with printed or electronic documentation (e.g., shrink-wrapped software), preloaded with a computer system (e.g., on a system ROM or fixed hard disk), or distributed over a communication system (e.g., the Internet or World Wide Web) from a server or electronic bulletin board.
[0113] Various examples of suitable processing modules are discussed in more detail below. As used herein, a module refers to software, hardware, or firmware suitable for performing a specific data processing or data transmission task. Typically, in a preferred embodiment, a module refers to a software routine, program, or other memory resident application suitable for receiving, transforming, routing, and processing instructions or various types of data, such as OCT scan data, user interface data, control signals, angiography data, user actions, frequencies, interferometer signal data, detected stents, candidate stent struts, FFR data, IVUS data, shadows, pixels, intensity patterns, scoring, projections, side branch data, and guidewire data, as well as other information of interest as described herein.
[0114] The computers and computer systems described herein may include operatively associated machine-readable media, such as computer-readable media, such as memory for storing software applications used in obtaining, processing, storing and / or transmitting data. It will be appreciated that such memory may be internal, external, remote or local relative to the computer or computer system with which it is operatively associated.
[0115] The memory may also include any component for storing software or other instructions, including but not limited to hard disk, optical disk, floppy disk, DVD (digital versatile disc), CD (compact disk), memory stick, flash memory, ROM (read-only memory), RAM (random access memory), DRAM (dynamic random access memory), PROM (programmable ROM), EEPROM (extended erasable PROM) and / or other similar computer-readable media.
[0116] Typically, the computer-readable storage medium associated with the embodiments of the present invention described herein may include a storage medium capable of storing instructions executed by a programmable device. Where applicable, the method steps described herein may be embodied or executed as instructions stored on a computer-readable storage medium or storage medium. According to embodiments of the present invention, these instructions may be software embodied in various programming languages, various programming languages such as C++, C, Java and / or various other types of software programming languages applicable to create instructions.
[0117] The term "machine-readable medium" or "computer-readable medium" includes any medium capable of storing, encoding, or carrying a set of instructions for being executed by a machine and causing the machine to perform any one or more of the methodologies of the present invention. Although the machine-readable medium is shown as a single medium in the exemplary embodiment, the term "machine-readable medium" should be taken to include a single medium or multiple media (e.g., a database, one or more centralized or distributed databases and / or associated caches and servers) storing one or more sets of instructions.
[0118] The storage medium may be non-volatile or include a non-volatile device. Thus, a non-volatile storage medium or a non-volatile device may include a tangible device, meaning that the device has a specific material form, but the device can change its physical state. Thus, for example, non-volatility means that the device remains tangible regardless of changes in state.
[0119] The aspects, embodiments, features and examples of the present invention are to be considered illustrative in all respects and are not intended to limit the present invention, the scope of the present invention being limited only by the claims. Other embodiments, modifications, and uses will be apparent to those skilled in the art without departing from the spirit and scope of the present invention as claimed.
[0120] The use of headings and sections in this application is not intended to limit the invention; each section may apply to any aspect, embodiment, or feature of the invention.
[0121] Throughout this application, where a composition is described as having, including, or comprising specific components, or where a process is described as having, including, or comprising specific process steps, it is contemplated that the compositions of the present teachings also essentially include or comprise the listed components, and that the processes of the present teachings also essentially include or comprise the listed process steps.
[0122] In the present application, when an element or component is said to be included in a list of listed elements or components and / or selected from the list, it should be understood that the element or component can be any one of the listed elements or components and can be selected from a group consisting of two or more of the listed elements or components. In addition, it should be understood that the elements and / or features of the compositions, devices or methods described herein can be combined in various ways without departing from the spirit and scope of the present teachings, whether explicit or implicit, herein.
[0123] Use of the terms "including," "comprising," or "having" should generally be construed as open ended and non-limiting, unless expressly stated otherwise.
[0124] The use of the singular herein includes the plural (and vice versa), unless expressly stated otherwise. In addition, the singular forms "a", "an" and "the" include the plural forms unless the context clearly indicates otherwise. In addition, when the term "about" is used before a numerical value, the present teachings also include the specific numerical value itself ±10%, unless expressly stated otherwise.
[0125] It should be understood that the order of steps or the order in which certain actions are performed is not essential, as long as the present teachings remain operable. In addition, two or more steps or actions may be performed simultaneously.
[0126] In the case of providing a series of values or a list of values, each intermediate value between the upper and lower limits of the series of values or a list of values is considered separately and is included in the present invention, as if each value is clearly listed in this article. In addition, the smaller range between and including the upper and lower limits of a given range is considered and is included in the present invention. The list of exemplary values or ranges is not to abandon other values or ranges between and including the upper and lower limits of a given range.
[0127] It should be understood that in order to clearly understand the present invention, the drawings and description of the present invention have been simplified to illustrate relevant elements, while eliminating other elements for simplicity. However, those of ordinary skill in the present invention will recognize that these elements and other elements may be desirable. However, since such elements are well known in the art and since these elements do not promote a better understanding of the present invention, a discussion of such elements is not provided herein. It should be understood that the drawings are presented for illustrative purposes and are not intended to be construction drawings. The omitted details and modifications or alternative embodiments are within the scope of those of ordinary skill in the art.
[0128] It is understood that in certain aspects of the invention, a single component may be replaced with multiple components, and multiple components may be replaced with a single component to provide an element or structure or to perform a given function or functions. Except where such replacements would not work to practice a particular embodiment of the invention, such replacements are considered to be within the scope of the invention.
[0129] The examples presented herein are intended to illustrate potential and special implementations of the present invention. For those skilled in the art, it will be appreciated that these examples are primarily intended to illustrate the purpose of the present invention. Variations of these figures or operations described herein may be present without departing from the spirit of the present invention. For example, in some cases, method steps or operations may be performed or executed in different orders, or multiple operations may be added, deleted or modified.
[0130] Furthermore, although specific embodiments of the present invention have been described for the purpose of illustrating the present invention and not for the purpose of limiting the present invention, those skilled in the art will understand that various modifications may be made to the details, materials and arrangements of elements, steps, structures and / or parts within the principle and scope of the present invention without departing from the present invention as described in the claims.
Claims
1. A method for detecting a stent strut, comprising: accessing a plurality of frames of acquired intravascular image data relative to the blood vessel, the plurality of frames of intravascular image data comprising optical coherence tomography image data; identifying a plurality of shadow regions in a plurality of frames of intravascular image data; eliminating shadow regions corresponding to non-stent features from the identified plurality of shadow regions to identify shadow regions that are candidate stent strut shadow regions; identifying scan lines corresponding to candidate stent strut shadow regions to generate candidate stent strut shadow scan lines; determining a projection across each of the candidate stent strut shadow scan lines by summing the signal responses across the candidate stent strut shadow scan lines; identifying up to three local maxima in the projection; assigning one or more scores to the local maximum corresponding to each candidate stent strut based on one or more of proximity to the lumen boundary, peak signal intensity, and degree of malapposition; as well as The candidate scaffold strut corresponding to the local maximum with the highest score is selected as the scaffold strut.
2. The method of claim 1, wherein: The non-stent feature is selected from the group consisting of: a guidewire, a side branch, and combinations thereof.
3. The method of claim 1, wherein: The multiple frames of intravascular image data are stored in an electronic storage device that is in electronic communication with the imaging system.
4. The method of claim 1, wherein: Eliminating shadow regions also includes eliminating candidate stent strut shadow regions that contain lumen pixels.
5. The method of claim 1, wherein: The one or more scores are determined based on proximity of the candidate stent struts corresponding to the local maxima to the lumen boundary, wherein the candidate stent struts closest to the lumen boundary receive the highest scores.
6. The method of claim 1, wherein: The one or more scores are determined based on the peak intensities of the local maxima corresponding to the candidate stent struts.
7. The method of claim 6, further comprising ranking the local maxima based on peak signal strength to generate a peak score.
8. The method of claim 1, wherein: The one or more scores are malapposition scores.
9. The method of claim 8, wherein: Candidate stent struts corresponding to local maxima in malapposition scores that exceed a threshold distance from the lumen boundary are identified as false positive detections.
10. The method of claim 1, wherein: The one or more scores are three scores, wherein the three scores are added to generate a combined score, wherein the combined score is used to identify a stent strut from among the candidate stent struts corresponding to local maxima.
11. The method of claim 1, wherein: The one or more scores are selected from the group consisting of: a peak score, a proximity to lumen boundary score, and a malapposition score.
12. The method of claim 11, further comprising combining the peak score, the proximity score, and the malapposition score, wherein a highest combined score is assigned to a stent strut at a particular location in a blood vessel.
13. The method of claim 1, further comprising performing a cross-frame analysis to verify a designated stent strut across multiple frames of the multiple frames of intravascular image data.
14. The method of claim 13, further comprising displaying the validated stent struts on a graphical user interface.
15. A computer readable medium comprising non-transitory instructions which, when executed, cause a processor to perform the steps of claim 1.
16. The method of claim 1, wherein: The multiple frames of intravascular image data include multiple scan lines.
17. A method for detecting a stent strut, comprising: accessing a plurality of frames of intravascular image data, the plurality of frames of intravascular image data comprising optical coherence tomography image data; identifying a plurality of shadow regions in a plurality of frames of intravascular image data; Eliminate shadow areas corresponding to non-bracket features; identifying scan lines corresponding to candidate stent strut shadow regions; analyzing scan lines corresponding to candidate stent strut shadow regions to determine the locations of the stent struts; as well as performing a cross-frame analysis using the one or more geometric structures and positional information to validate the stent struts across multiple frames; Analyzing scan lines corresponding to candidate stent strut shadow regions to determine stent strut locations includes: determining a projection across each of the candidate stent strut shadow scan lines by summing the signal responses across the candidate stent strut shadow scan lines; identifying up to three local maxima in the projection; assigning one or more scores to the local maximum corresponding to each candidate stent strut based on one or more of proximity to the lumen boundary, peak signal intensity, and degree of malapposition; and The candidate stent strut corresponding to the local maximum with the highest score is selected as the position of the stent strut.
18. The method of claim 17, comprising displaying the validated stent struts on a graphical user interface.
