The Method And System For Multi-Layer-Based Navigation Using Synchronization Between APlurality Of Intravascular Ultrasound Data

The multi-layer based search method synchronizes IVUS data across different time points, addressing inefficiencies in existing systems by aligning and correcting for deformation errors, enabling efficient real-time quantitative analysis of stent expansion and vascular conditions.

KR103046508B1Active Publication Date: 2026-11-10ATEROSOFT CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
KR1020260113229
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2026-06-22
Publication Date
2026-11-10
Estimated Expiration
2046-06-22

AI Technical Summary

Technical Problem

Existing medical image analysis systems for intravascular ultrasound (IVUS) data lack an integrated interface to synchronize and compare multiple data points across different time points, leading to inefficiencies in deriving quantitative analysis due to manual alignment and deformation errors, which hinder real-time evaluation of stent expansion and vascular conditions.

Method used

A multi-layer based search method and system that synchronizes multiple IVUS data using a computing system with processors and memory, aligning data in a shared coordinate system, and displaying synchronized views through a user interface with layers for real-time comparative analysis, including longitudinal, transverse, and 3D views, with automatic correction for deformation errors.

Benefits of technology

Enhances the efficiency of comparative reading by automatically aligning and synchronizing IVUS data, reducing visual fatigue, and enabling real-time calculation of quantitative parameters like stent expansion rate and area gain, while correcting for errors caused by heartbeat and mechanical tension.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112026075323237-PAT00001_ABST
    Figure 112026075323237-PAT00001_ABST
Patent Text Reader

Abstract

The present invention relates to a multi-layer based search method and system utilizing synchronization among multiple intravascular ultrasound data. More specifically, the invention relates to a multi-layer based search method and system utilizing synchronization among multiple intravascular ultrasound (IVUS) data acquired at different points in time or locations, which aligns and synchronizes the data and visualizes them in parallel or superimposed through multiple layers and an interconnected interface on a screen, thereby maximizing the convenience of comparative reading between multiple medical image data and enhancing the efficiency of organic interconnected search.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a multi-layer based search method and system utilizing synchronization among multiple intravascular ultrasound data. More specifically, the invention relates to a multi-layer based search method and system utilizing synchronization among multiple intravascular ultrasound (IVUS) data acquired at different points in time or locations, which aligns and synchronizes the data and visualizes them in parallel or superimposed through multiple layers and an interconnected interface on a screen, thereby maximizing the convenience of comparative reading between multiple medical image data and enhancing the efficiency of organic interconnected search. Background Technology

[0003] In the field of percutaneous cardiovascular intervention (PCI), intravascular ultrasound (IVUS) technology is critically utilized not only to characterize lesions but also for cross-analyzing multiple data points acquired at different time points—such as before the procedure, after balloon dilation, and after stent insertion. By precisely comparing pre- and post-procedure images, operators must evaluate whether the stent has expanded evenly to the appropriate location according to clinical criteria, whether sufficient lumen gain or area gain has been achieved, and whether there are any residual lesions or vascular dissections requiring further intervention. This organic comparative interpretation of multi-timepoint data is a critical process that determines the success of the procedure and predicts the patient's prognosis.

[0004] However, in existing medical image analysis equipment or software environments, the efficiency of interpretation is significantly reduced due to the absence of an integrated interface that can synchronize and compare multiple intravascular ultrasound data into a single coordinate system. To compare pre- and post-procedure data, medical staff must open each pullback data file in a separate window and manually scroll through the frames on both sides while visually searching for anatomically similar points. This method not only makes it difficult to match the precise longitudinal positions between thousands of frames but also places a severe visual cognitive load during the simultaneous search process, posing significant limitations in deriving quantitative comparative analysis data, such as stent expansion rate or area gain, in real time.

[0005] Furthermore, even some automation attempts that provide simple alignment functions exhibit limitations as they fail to overcome physical deformations and errors occurring in actual clinical environments. This is because longitudinal geometric deformation inevitably occurs between data acquired at different points in time due to errors in the catheter's mechanical tension speed and the contraction and expansion of blood vessels caused by the patient's heartbeat or respiration. Moreover, existing interfaces suffer from a problem where various visualization components—such as longitudinal sections, transverse sections, analysis graphs, and detailed reports—are fragmented, preventing components across the entire screen from being updated in real-time based on the same coordinate system when a user fine-tunes the alignment offset or changes the search position of a specific layer.

[0006] Under these circumstances, there is a need for the development of synchronization technology capable of automatically generating an integrated longitudinal coordinate system and offsetting longitudinal deformation errors between multiple intravascular ultrasound data through AI-based catheter region exclusion technology, feature point analysis, or cross-correlation operations between profile waveforms. Along with this, there is a need for the design of a multi-layer-based navigation system that simultaneously synchronizes longitudinal views, transverse views, analysis graphs, 3D chemogram views, and detailed reports in real time by arranging multiple data layers in parallel or overlapping them within a single virtual screen space and organically controlling multiple navigation slides. The problem to be solved

[0008] The present invention aims to provide a multi-layer-based search method and system utilizing synchronization among multiple intravascular ultrasound data, and more specifically, to provide a multi-layer-based search method and system utilizing synchronization among multiple intravascular ultrasound (IVUS) data acquired at different points in time or locations by aligning and synchronizing the data, and visualizing them in parallel or superimposed through multiple layers and an interconnected interface on a screen, thereby maximizing the convenience of comparative reading between multiple medical image data and enhancing the efficiency of organic interconnected search. means of solving the problem

[0010] In order to solve the above problems, one embodiment of the present invention provides a multi-layer based search method using synchronization between multiple intravascular ultrasound data performed in a computing system comprising one or more processors and one or more memories, comprising: a data acquisition step of acquiring multiple intravascular ultrasound data each comprising a plurality of frame cross-sectional images; a synchronization step of aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system; and a display step of providing a user terminal with a user interface comprising a plurality of layers that individually display information of each of the multiple intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the multiple layers.

[0011] In one embodiment of the present invention, when a selection input of a specific location is received from any one of the plurality of search slides, the user interface displays data of the corresponding location on a layer corresponding to the search slide, and at the same time, based on the synchronization step, automatically tracks the location of the search slide corresponding to the other layer and dynamically changes and displays the intravascular ultrasound data of the other layer together.

[0012] In one embodiment of the present invention, each of the plurality of layers is configured to include a longitudinal view visualizing a longitudinal cross-section of ultrasound data within the blood vessel, a transverse view visualizing a cross-section of a specific frame, an analysis graph layout mapping the trend of change of quantitative indicators along the entire longitudinal direction of the blood vessel, a 3D chemogram view visualizing the distribution state of plaque by component, and a detailed report table listing extracted quantitative parameter information, wherein the analysis graph layout includes at least one of a plaque burden rate graph by longitudinal direction, a lumen diameter graph, and a lumen area graph, and the display step can simultaneously synchronize and update in real time the search line of each longitudinal view included in all of the plurality of layers, the frame of the transverse view, the data pointer of the analysis graph layout, the position marker of the 3D chemogram view, and the data row of the detailed report table based on the same coordinate system in conjunction with the movement control of any one of the plurality of search slides.

[0013] In one embodiment of the present invention, the synchronization step may include: a step of analyzing each image frame of the plurality of intravascular ultrasound data to detect a reference feature point including a common anatomical feature point or an artificial mark generated by a catheter device; a step of setting the location of the reference feature point as a matching reference origin and calculating a longitudinal deformation mapping matrix to offset the shooting tension speed error between the plurality of data or the vascular expansion error caused by the patient's heartbeat; and a step of applying the longitudinal deformation mapping matrix to the plurality of intravascular ultrasound data to generate an integrated longitudinal coordinate system in which the plurality of data are synchronized one-to-one and shared.

[0014] In one embodiment of the present invention, the user interface includes a alignment adjustment interface so that the user can visually check and fine-tune the coordinate system synchronization state aligned by the synchronization step, and the display step can update in real time by recalculating the positional correspondence relationship between the plurality of intravascular ultrasound data based on the modified reference point or changed position information when a Pullback playback synchronization command that links playback between multiple pullback layers acquired at different points in time through the alignment adjustment interface, or a calibration input that modifies the alignment reference point on a specific layer or changes the search position is received.

[0015] In one embodiment of the present invention, after the display step, the method may further include: a step of detecting at least one interest area synchronization and annotation change event, including the setting of a lesion interest area, a stent interest area, or a reference segment, on a specific layer screen of any one of the plurality of layers; and a step of backtracking the same coordinate system to calculate the longitudinal position coordinates of the point where the change event occurred, and projecting and visualizing the same annotation graphic layer in real time by mapping it onto the corresponding position coordinates of the remaining other layers.

[0016] In one embodiment of the present invention, the user interface provides an overlay mode that displays a pre-procedure data layer and a post-procedure data layer among the synchronized plurality of layers by overlapping them in a single virtual screen space, or a contrast mode that tracks the pre-procedure data layer and the post-procedure data layer by arranging them in parallel with each other in a synchronized manner. When the overlay mode or the contrast mode is activated, the luminal contour of the pre-procedure data and the luminal contour of the post-procedure data are precisely aligned and contrasted on the same coordinate system, thereby calculating quantitative parameters including stent expansion rate, luminal expansion gain, and area gain in real time for each longitudinal position of the blood vessel and outputting them in an integrated manner to a detailed report table included in the plurality of layers.

[0017] In order to solve the above problems, one embodiment of the present invention provides a method for synchronizing ultrasound data between a plurality of intravascular ultrasound data for multilayer-based search performed in a computing system comprising one or more processors and one or more memories, comprising: a data acquisition step of acquiring a plurality of intravascular ultrasound data each comprising a plurality of frame cross-sectional images; and a synchronization step of aligning the plurality of intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system; wherein the synchronization step continuously extracts profile information regarding the shape or structure according to the longitudinal direction of the blood vessel from each of the plurality of intravascular ultrasound data, calculates an optimal initial longitudinal shift value by comparing the signal similarity between the waveforms of each of the profile information, and automatically aligns the initial alignment coordinate system between the plurality of intravascular ultrasound data based on the optimal initial longitudinal shift value.

[0018] In order to solve the above problems, one embodiment of the present invention provides a computing system comprising one or more processors and one or more memories, and performing a multi-layer based search method using synchronization between a plurality of intravascular ultrasound data, comprising: a data acquisition unit for acquiring a plurality of intravascular ultrasound data each including a plurality of frame cross-sectional images; a synchronization unit for aligning the plurality of intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system; and a display unit for providing a user terminal with a user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers.

[0019] In one embodiment of the present invention, when a selection input of a specific location is received from any one of the plurality of search slides, the user interface displays data of the corresponding location on a layer corresponding to the search slide, and at the same time, based on the synchronization unit, automatically tracks the location of the search slide corresponding to the other layer and dynamically changes and displays the intravascular ultrasound data of the other layer together.

[0020] In one embodiment of the present invention, each of the plurality of layers is configured to include a longitudinal view visualizing a longitudinal cross-section of ultrasound data within the blood vessel, a transverse view visualizing a cross-section of a specific frame, an analysis graph layout mapping the trend of change of quantitative indicators along the entire longitudinal direction of the blood vessel, a 3D chemogram view visualizing the distribution state of plaque by component, and a detailed report table listing extracted quantitative parameter information, wherein the analysis graph layout includes at least one of a plaque burden rate graph by longitudinal direction, a lumen diameter graph, and a lumen area graph, and the display unit may be configured to simultaneously synchronize and update in real time the search line of each longitudinal view included in all of the plurality of layers, the frame of the transverse view, the data pointer of the analysis graph layout, the position marker of the 3D chemogram view, and the data row of the detailed report table based on the same coordinate system in conjunction with the movement control of any one of the plurality of search slides.

[0021] In one embodiment of the present invention, the synchronization unit may perform the steps of: analyzing each image frame of the plurality of intravascular ultrasound data to detect a reference feature point including a common anatomical feature point or an artificial mark generated by a catheter device; setting the location of the reference feature point as a matching reference origin and calculating a longitudinal deformation mapping matrix to offset the shooting tension speed error between the plurality of data or the vascular stretching error caused by the patient's heartbeat; and applying the longitudinal deformation mapping matrix to the plurality of intravascular ultrasound data to generate an integrated longitudinal coordinate system in which the plurality of data are synchronized one-to-one and shared.

[0022] In one embodiment of the present invention, the user interface includes a alignment adjustment interface so that the user can visually check and fine-tune the coordinate system synchronization state aligned by the synchronization step, and the display step can control the recalculation of the positional correspondence between the plurality of intravascular ultrasound data based on the modified reference point or changed position information and update it in real time when a Pullback playback synchronization command that links playback between multiple pullback layers acquired at different points in time through the alignment adjustment interface, or a calibration input that modifies the alignment reference point on a specific layer or changes the search position is received.

[0023] In one embodiment of the present invention, the computing system may further include: an event detection unit that detects at least one interest area synchronization and annotation change event, including the setting of a lesion interest area, a stent interest area, or a reference segment on a specific layer screen of any one of the plurality of layers; and a projection visualization unit that backtracks the same coordinate system to calculate the longitudinal position coordinates of the point where the change event occurred, and projects and visualizes the same annotation graphic layer in real time by mapping it onto the corresponding position coordinates of the remaining other layers.

[0024] In order to solve the above problems, one embodiment of the present invention provides a computer-readable storage medium for implementing a multi-layer based search method using synchronization between a plurality of intravascular ultrasound data performed in a computing system comprising one or more processors and one or more memories, wherein the computer-readable storage medium comprises computer-executable instructions that cause the computing system to perform the following steps, and the following steps include: a data acquisition step of acquiring a plurality of intravascular ultrasound data each comprising a plurality of frame cross-sectional images; a synchronization step of aligning the plurality of intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system; and a display step of providing a user terminal with a user interface comprising a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers. Effects of the invention

[0026] According to one embodiment of the present invention, by synchronizing the search positions between multiple intravascular ultrasound data acquired at different points in time and automatically tracking them, the convenience and efficiency of comparative reading between multiple point-in-time data can be maximized.

[0027] According to one embodiment of the present invention, the longitudinal section view, cross section view, analysis graph layout, 3D chemogram view, and detailed report table included in a plurality of layers can be simultaneously synchronized and updated in real time based on the same coordinate system in conjunction with a plurality of search slide controls.

[0028] According to one embodiment of the present invention, by calculating a longitudinal deformation mapping matrix based on reference feature points detected through image frame analysis, it is possible to generate an integrated longitudinal coordinate system that effectively offsets shooting tension speed errors and vascular stretching errors caused by heartbeats.

[0029] According to one embodiment of the present invention, by receiving a Pullback playback synchronization command or an independent calibration input through a matching adjustment interface and recalculating the relative position margin, the effect of precisely correcting the coordinate system mapping reference in real time can be achieved.

[0030] According to one embodiment of the present invention, by backtracking region of interest synchronization and annotation change events detected on a specific layer screen based on the same coordinate system, it is possible to achieve the effect of mapping and projecting the same annotation graphic layer in real time to corresponding positions of the remaining other layers.

[0031] According to one embodiment of the present invention, by aligning and displaying the lumen contours of pre-procedure data and post-procedure data through an overlay mode or a contrast mode, it is possible to calculate quantitative parameters according to the procedure in real time and output them in an integrated manner to a detailed report table.

[0032] According to one embodiment of the present invention, by generating a preprocessed frame in which the catheter region is automatically excluded from each frame image using a trained artificial neural network model, the effect of resolving the noise vulnerability of profile information extraction can be achieved.

[0033] According to one embodiment of the present invention, by performing a cross-correlation operation between continuously extracted blood vessel diameter profiles or plaque burden rate profile waveforms to calculate an optimal initial longitudinal shift value, the effect of enabling auto-alignment without manual intervention by the user can be achieved.

[0034] According to one embodiment of the present invention, by visualizing the change trend of at least one of the plaque burden rate, lumen diameter, and lumen area graphs in the longitudinal direction through an analysis graph layout in conjunction with a data pointer, it is possible to achieve the effect of supporting a comprehensive analysis of the vascular condition.

[0035] According to one embodiment of the present invention, by providing a user interface in which a plurality of layers and a plurality of navigation slides are organically combined, it is possible to achieve the effect of reducing visual fatigue and cognitive load experienced by the operator during multi-viewpoint large-volume medical image reading. Brief explanation of the drawing

[0037] FIG. 1 schematically illustrates the internal configuration of a computing system according to one embodiment of the present invention. FIG. 2 schematically illustrates the execution steps of a multi-layer based search method according to an embodiment of the present invention. FIG. 3 schematically illustrates the process of performing a data acquisition step according to one embodiment of the present invention. FIG. 4 schematically illustrates the process of performing a data acquisition step according to one embodiment of the present invention. FIG. 5 schematically illustrates the process of performing a synchronization step according to one embodiment of the present invention. FIG. 6 schematically illustrates the process of performing a synchronization step according to one embodiment of the present invention. FIG. 7 schematically illustrates the process of performing a display step according to one embodiment of the present invention. FIG. 8 schematically illustrates the process of performing a display step according to one embodiment of the present invention. FIG. 9 schematically illustrates a user interface according to one embodiment of the present invention. FIG. 10 schematically illustrates a user interface according to one embodiment of the present invention. FIG. 11 illustrates the internal configuration of a computing device according to one embodiment of the present invention. Specific details for implementing the invention

[0038] Hereinafter, various embodiments and / or aspects are disclosed with reference to the drawings. For illustrative purposes, numerous specific details are disclosed in the following description to aid in a general understanding of one or more aspects. However, it will also be recognized by those skilled in the art that these aspects may be practiced without such specific details. The following description and the accompanying drawings describe specific exemplary aspects of one or more aspects in detail. However, these aspects are exemplary, and some of the various methods in the principles of the various aspects may be used, and the description is intended to include all such aspects and their equivalents.

[0039] Additionally, terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. The term "and / or" includes a combination of a plurality of related described items or any of a plurality of related described items.

[0040] Furthermore, in the embodiments of the present invention, all terms used herein, including technical or scientific terms, unless otherwise defined, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in the embodiments of the present invention.

[0041] The "user terminal" mentioned below may be implemented as a computer or portable terminal capable of connecting to a server or other terminal via a network. Here, the computer includes, for example, a notebook, desktop, or laptop equipped with a web browser, and the portable terminal may include, for example, all types of handheld-based wireless communication devices that ensure portability and mobility, such as smartphones, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet), and BLE Beacon (Bluetooth Low Energy Beacon) terminals. In addition, the “network” can be implemented as a wired network such as a Local Area Network (LAN), Wide Area Network (WAN), or Value Added Network (VAN), or as any type of wireless network such as a mobile radio communication network or a satellite communication network.

[0043] FIG. 1 schematically illustrates the internal configuration of a computing system (1000) according to an embodiment of the present invention.

[0045] As illustrated in FIG. 1, the computing system (1000) comprises: a data acquisition unit (100) that performs a data acquisition step of acquiring a plurality of intravascular ultrasound data each including a plurality of frame cross-sectional images; a synchronization unit (200) that performs a synchronization step of aligning the plurality of intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system; and a display unit (300) that performs a display step of providing a user terminal with a user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers.

[0047] Specifically, each component included in the computing system (1000) illustrated in FIG. 1 performs the role of controlling the operation of the computing system (1000) that performs the multi-layer based search method of the present invention.

[0048] More specifically, the data acquisition unit (100) of the computing system (1000) can acquire multiple intravascular ultrasound data, each including multiple frame cross-sectional images.

[0050] The synchronization unit (200) of the above computing system (1000) can synchronize the plurality of intravascular ultrasound data by aligning them in the longitudinal direction of the blood vessel so that they share the same coordinate system.

[0051] In one embodiment of the present invention, the synchronization step may include: a step of analyzing each image frame of the plurality of intravascular ultrasound data to detect a reference feature point including a common anatomical feature point or an artificial mark generated by a catheter device; a step of setting the location of the reference feature point as a matching reference origin and calculating a longitudinal deformation mapping matrix to offset the shooting tension speed error between the plurality of data or the vascular expansion error caused by the patient's heartbeat; and a step of applying the longitudinal deformation mapping matrix to the plurality of intravascular ultrasound data to generate an integrated longitudinal coordinate system in which the plurality of data are synchronized one-to-one and shared.

[0052] In addition, the synchronization step can continuously extract profile information regarding the shape or structure along the longitudinal direction of the blood vessel from each of the plurality of intravascular ultrasound data, calculate an optimal initial longitudinal shift value by comparing the signal similarity between the waveforms of each of the profile information, and automatically align the initial alignment coordinate system between the plurality of intravascular ultrasound data based on the optimal initial longitudinal shift value.

[0053] The display unit (300) of the above computing system (1000) may provide a user interface to a user terminal that includes a plurality of layers for individually displaying information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides for individually controlling the search position of each of the plurality of layers.

[0054] In one embodiment of the present invention, when a selection input of a specific location is received in any one of the plurality of search slides, the user interface displays data of the corresponding location on the layer corresponding to the search slide, and at the same time, based on the synchronization step, automatically tracks the location of the search slide corresponding to the other layer and dynamically changes and displays the intravascular ultrasound data of the other layer together.

[0055] Additionally, each of the above-mentioned plurality of layers is configured to include a longitudinal view visualizing a longitudinal cross-section of the ultrasound data within the blood vessel, a transverse view visualizing a cross-section of a specific frame, an analysis graph layout mapping the trend of change of quantitative indicators along the entire longitudinal direction of the blood vessel, a 3D chemogram view visualizing the distribution state of plaque by component, and a detailed report table listing extracted quantitative parameter information, wherein the analysis graph layout includes at least one of a plaque burden rate graph by longitudinal direction, a lumen diameter graph, and a lumen area graph, and the display step can simultaneously synchronize and update in real time the search line of the longitudinal view, the frame of the transverse view, the data pointer of the analysis graph layout, the position marker of the 3D chemogram view, and the data row of the detailed report table included in all of the plurality of layers based on the same coordinate system in conjunction with the movement control of any one of the plurality of search slides.

[0056] Additionally, the user interface includes a alignment adjustment interface so that the user can visually check and fine-tune the coordinate system synchronization status aligned by the synchronization step, and the display step can update the coordinate system mapping standard of the synchronization step in real time by recalculating the relative position margin of the same coordinate system based on the correction distance when a Pullback playback synchronization command that links playback between multiple pullback layers acquired at different points in time through the alignment adjustment interface, or a calibration input that separates the search slide of a specific layer from other layers and moves it independently is received.

[0057] In addition, the user interface provides an overlay mode that displays a pre-procedure data layer and a post-procedure data layer among the synchronized multiple layers by overlapping them in a single virtual screen space, or a contrast mode that tracks the pre-procedure data layer and the post-procedure data layer by arranging them in parallel with each other in synchronization. When the overlay mode or the contrast mode is activated, the luminal contour of the pre-procedure data and the luminal contour of the post-procedure data are precisely aligned and contrasted on the same coordinate system, thereby calculating quantitative parameters including stent expansion rate, luminal expansion gain, and area gain in real time for each longitudinal position of the blood vessel and outputting them in an integrated manner to a detailed report table included in the multiple layers.

[0059] Preferably, the multi-layer based search method of the present invention may further include, after the display step, a step of detecting at least one interest area synchronization and annotation change event including the setting of a lesion interest area, a stent interest area, or a reference segment on a specific layer screen of any one of the plurality of layers; and a step of backtracking the same coordinate system to calculate the longitudinal position coordinates of the point where the change event occurred, and projecting and visualizing the same annotation graphic layer in real time by mapping it onto the corresponding position coordinates of the remaining other layers.

[0061] Meanwhile, in one embodiment of the present invention, the plurality of intravascular ultrasound data obtained in the data acquisition step may include annotation data for a lesion region of interest (ROI) or a stent region of interest that is subject to registration and synchronization or serves as a standard for comparative analysis.

[0062] At this time, the region of interest data may be data detected and input from an external independent medical image analysis engine or a separate rule set-based algorithm, or it may be region information manually designated by the operator through a user terminal.

[0064] Furthermore, according to another variant of the present invention, the computing system (1000) may be configured to optionally include its own region of interest detection module. The region of interest detection module may be configured to calculate the plaque burden rate for each frame cross-sectional image, capture a master frame as a reference frame among frames where the plaque burden rate is above a threshold value and the lumen area is at a minimum value, and then automatically generate and supply a region of interest by continuously expanding and searching surrounding frames in both directions from the reference frame.

[0065] As such, the synchronization and multi-layer visualization architecture of the present invention is not limited to the source of generation of region of interest data (external input, user manual specification, or internal self-automatic detection), and can provide universal compatibility that enables linked tracking and appropriateness diagnosis by organically aligning multiple time point data on a shared coordinate system.

[0067] At this time, the boundary and annotation information of the region of interest, which is automatically generated internally through the region of interest detection module or input through an external analysis engine or manual designation by the operator, can be transmitted to the synchronization step and the display step in the form of longitudinal position coordinate data and combined in subsequent operations.

[0069] More specifically, in the process of creating an integrated longitudinal coordinate system between multiple multi-layer data in the synchronization step, the longitudinal boundary coordinates of the transmitted region of interest can be simultaneously linked on a coordinate system mapping matrix. Through this, in the synchronization step, the lesion region of interest on the pre-procedure data layer and the stent region of interest on the post-procedure data layer, which are captured at different points in time, can be controlled to be precisely aligned 1:1 on the same spatial coordinate standard without distortion or physical length error.

[0071] Furthermore, in the display stage described above, by backtracking and comparing the relative boundary coordinates of regions of interest aligned on the integrated shared coordinate system in real time, the lengths of the geographical miss areas and uncovered sections described later can be automatically calculated and diagnosed without error. Consequently, the visualization architecture of the present invention establishes an organic computational environment capable of perfectly performing integrated search and procedural appropriateness evaluation regardless of the form in which region of interest data is input, by densely combining the front-end acquisition channel of the region of interest with the back-end synchronization / diagnosis pipeline.

[0073] The expressions used in this specification as one-to-one synchronization or synchronization between data are not limited to simply meaning an arithmetic 1:1 mapping on a frame-to-frame basis.

[0074] Synchronization in the present invention includes all technical acts for establishing longitudinal positional associations between data, and may include all alignment techniques used in the industry to link positions between data, such as mapping interpolated positional values ​​to overcome differences in data sampling intervals, correspondence of approximate frames integrating multiple adjacent frames, derivation of corresponding positions on specific continuous coordinates, or matching of corresponding segments based on specific anatomical structures. Accordingly, the synchronization of the present invention can encompass all implementation methods that establish a substantial positional correspondence relationship along the longitudinal direction of blood vessels, regardless of whether there is a 1:1 correspondence of physical frames.

[0076] FIG. 2 schematically illustrates the execution steps of a multi-layer based search method according to one embodiment of the present invention.

[0078] As illustrated in FIG. 2, the multilayer-based search method can first acquire a plurality of intravascular ultrasound data, each comprising a plurality of frame cross-sectional images (S10). Each intravascular ultrasound data can be acquired through a pulse-back process in which an ultrasound probe moves along the longitudinal direction of the blood vessel and transmits and receives ultrasound signals, and can be configured to include a plurality of frame cross-sectional images acquired sequentially at different locations along the longitudinal direction of the blood vessel.

[0080] Next, the plurality of intravascular ultrasound data can be synchronized (S11) by aligning them along the longitudinal direction of the blood vessel to share the same coordinate system. That is, multiple intravascular ultrasound data, which are acquired separately through independent pearlback processes and whose longitudinal alignment states may not match each other, can be processed to share a single integrated longitudinal coordinate system by aligning them based on the longitudinal direction of the blood vessel. Through this, a specific longitudinal position on one of the data can be converted one-to-one to a corresponding longitudinal position on the other data.

[0082] Next, a user interface (S12) may be provided to a user terminal, comprising a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers. At this time, since the plurality of layers share the same coordinate system generated in the synchronization step, when a specific position is selected through one of the search slides, the corresponding position of the remaining other layers can be automatically tracked and displayed together based on the same coordinate system.

[0084] Through such a series of steps, the multi-layer-based search method of the present invention aligns multiple intravascular ultrasound data, each independently acquired at different points in time or under different conditions, based on the same coordinate system and displays them on a single screen, and enables searching by mutually comparing the same longitudinal positions of multiple data with only the operation of a single search slide.

[0086] FIG. 3 schematically illustrates the process of performing a data acquisition step according to one embodiment of the present invention.

[0088] In summary, the data acquisition step can acquire multiple intravascular ultrasound data, each comprising multiple frame cross-sectional images.

[0090] Specifically, an intravascular ultrasound device may include an ultrasound probe inserted into the interior of a blood vessel, and ultrasound data regarding the interior of the blood vessel can be acquired by transmitting and receiving ultrasound signals as the ultrasound probe moves along the longitudinal direction of the blood vessel. The intravascular ultrasound data acquired in this manner may correspond to data that visualizes the internal structure of the blood vessel.

[0091] As illustrated in FIG. 3, the intravascular ultrasound data may include a plurality of cross-sectional frame images, and a longitudinal view may be reconstructed and visualized by aligning the plurality of cross-sectional frame images in the longitudinal direction. That is, the intravascular ultrasound data is composed of a plurality of frame cross-sectional images, and the computing system (1000) can generate a longitudinal visualization image of the blood vessel based on this.

[0093] At this time, the cross-sectional data for the intravascular ultrasound data includes a plurality of frame cross-sectional images acquired at different locations along the longitudinal direction of the blood vessel, and each frame cross-sectional image may be arranged sequentially along the longitudinal direction of the blood vessel, such as Frame #1, Frame #2 to Frame #N. Meanwhile, the visualization area referred to as the longitudinal cross-sectional data in FIG. 3 refers to a cross-sectional view shape virtually reconstructed by a computing system (1000) by continuously aligning and arranging the plurality of frame cross-sectional images along the longitudinal direction of the blood vessel, and may correspond to a screen that visualizes and guides the trend of thickness change of the lumen and plaque along the longitudinal direction of the blood vessel.

[0095] At this time, the cross-sectional structure of the blood vessel may appear in each frame cross-sectional image. More specifically, from the frame cross-sectional image, a lumen contour indicating the boundary of the lumen, which is the area where blood flows, and an outer elastic membrane contour indicating the outer boundary of the blood vessel may be detected. In addition, the area within the outer elastic membrane contour, excluding the area within the lumen contour, corresponds to a plaque, and the plaque corresponds to the part of the cross-section of the blood vessel where blood does not flow.

[0096] For example, in some frame cross-sectional images, plaque is barely visible, so the lumen contour and the outer elastic membrane contour may appear adjacent to each other, whereas in other frame cross-sectional images, plaque is formed thickly, so the internal region of the lumen contour may appear relatively narrow.

[0098] In one embodiment of the present invention, the ultrasound probe can sequentially acquire each frame cross-sectional image while moving at predetermined intervals along the longitudinal direction of the blood vessel, and accordingly, the spacing between adjacent frame cross-sectional images can correspond to a certain physical distance along the longitudinal direction of the blood vessel. That is, the number of frame cross-sectional images arranged can be converted into a distance along the longitudinal direction of the blood vessel, and this correspondence can be used to calculate the length of the region of interest or the distance between regions of interest in a subsequent step.

[0099] The intravascular ultrasound data obtained in this manner is input and stored in the computing system (1000), and can be used as basic data for synchronizing multiple intravascular ultrasound data in a subsequent step and displaying them on a user interface.

[0101] FIG. 4 schematically illustrates the process of performing a data acquisition step according to one embodiment of the present invention.

[0103] In summary, the data acquisition step can acquire multiple intravascular ultrasound data, each comprising a plurality of frame cross-sectional images. As illustrated in FIG. 4, the plurality of intravascular ultrasound data may include intravascular ultrasound data A and intravascular ultrasound data B, but is not limited thereto and may include more than one plurality of intravascular ultrasound data. That is, the data acquisition step can acquire two or more intravascular ultrasound data, each acquired independently, by performing a pulse-back process multiple times in which an ultrasound probe moves along the longitudinal direction of the blood vessel and transmits and receives ultrasound signals.

[0105] Preferably, each of the plurality of intravascular ultrasound data may be composed of a plurality of frame cross-sectional images sequentially acquired at different locations along the longitudinal direction of the blood vessel. Additionally, each intravascular ultrasound data may include a longitudinal view reconstructed by aligning the plurality of frame cross-sectional images along the longitudinal direction of the blood vessel, and a specific location on the longitudinal view may be linked to any one of the frame cross-sectional images corresponding to that location. In FIG. 4, the location marker displayed on the longitudinal view may correspond to indicating the longitudinal position of the frame cross-sectional image currently being visualized.

[0107] At this time, the plurality of intravascular ultrasound data may correspond to data acquired at different points in time or under different conditions. For example, intravascular ultrasound data A may correspond to data acquired before the stent procedure, and intravascular ultrasound data B may correspond to data acquired after the stent procedure, and additionally, data acquired during the procedure or after a certain period may be included.

[0108] However, the present invention is not limited to the point in time when the plurality of intravascular ultrasound data are acquired, and it is significant in that it provides two or more data acquired independently for the same blood vessel section so that they can be compared with each other.

[0110] Meanwhile, since the above multiple intravascular ultrasound data are acquired separately through independent pulse-back processes, even if the same vascular segment is captured, the starting position, number of frames, or alignment status in the longitudinal direction may not match between the data. This may be due to errors in the shooting tensile speed between the data or errors in vascular expansion caused by the patient's heartbeat.

[0111] In this case, the above-mentioned imaging tension speed error corresponds to a longitudinal distance error that occurs when the tension speed of the ultrasound probe is not maintained at a constant level and fluctuates during the pull-back process, in which the ultrasound probe moves while being tensioned along the longitudinal direction of the blood vessel. That is, when multiple intravascular ultrasound data are acquired through independent pull-back processes, the tension speed may differ slightly with each pull-back or fluctuate during the pull-back process; consequently, even if the same blood vessel section is imaged, the longitudinal positions corresponding to the frame cross-sectional images between the data may be misaligned. Meanwhile, the above-mentioned blood vessel stretching error corresponds to an error that occurs when the same anatomical position is displaced longitudinally depending on the time of imaging as the blood vessel stretches in the longitudinal direction in accordance with the patient's heartbeat.

[0112] Accordingly, multiple intravascular ultrasound data obtained in this way are input and stored in the computing system (1000), and then, in a subsequent synchronization step, are aligned in the longitudinal direction of the blood vessel and processed to share the same coordinate system, so that they can be provided in a form that can be compared with each other on a user interface.

[0114] FIG. 5 schematically illustrates the process of performing a synchronization step according to one embodiment of the present invention.

[0116] In summary, the synchronization step can align the plurality of intravascular ultrasound data along the longitudinal direction of the blood vessel to synchronize them so that they share the same coordinate system.

[0118] Specifically, the synchronization step may include: a step of analyzing each image frame of the plurality of intravascular ultrasound data to detect a reference feature point including a common anatomical feature point or an artificial mark generated by a catheter device; a step of setting the location of the reference feature point as a matching reference origin and calculating a longitudinal deformation mapping matrix to offset the shooting tension speed error between the plurality of data or the vascular expansion error caused by the patient's heartbeat; and a step of applying the longitudinal deformation mapping matrix to the plurality of intravascular ultrasound data to generate an integrated longitudinal coordinate system in which the plurality of data are synchronized one-to-one and shared.

[0120] As illustrated in FIG. 5, the synchronization step can be performed through a series of processes including receiving multiple intravascular ultrasound data, performing image frame analysis, detecting reference feature points, setting a matching reference origin, calculating a longitudinal deformation mapping matrix, and generating an integrated longitudinal coordinate system.

[0122] First, the computing system (1000) receives a plurality of intravascular ultrasound data inputs (S20), analyzes each image frame (S21), and can detect a reference feature point (S22) that is common to each of the plurality of intravascular ultrasound data. At this time, the reference feature point may include an anatomical feature point (S23) that is common to the plurality of intravascular ultrasound data, or an artificial mark (S24) generated by a catheter device.

[0123] The aforementioned anatomical feature points may correspond to structural features consistently observed at the same location regardless of the condition of the blood vessel or the time of imaging, and for example, features capable of identifying longitudinal positions, such as the carina point where a lateral branch diverges from the main blood vessel, or the shape of a site where calcium has formed, may be utilized. Meanwhile, the artificial markers generated by the catheter device may correspond to identifiable markers artificially created on the image by the catheter device during the imaging process.

[0125] Next, the location of the reference feature point is set as the matching reference origin (S25), and a longitudinal deformation mapping matrix can be calculated based on the matching reference origin (S26). The longitudinal deformation mapping matrix is ​​intended to compensate for errors in the shooting tension speed existing between multiple intravascular ultrasound data, or errors in the stretching of blood vessels caused by the patient's heartbeat. That is, since multiple intravascular ultrasound data are acquired separately through independent pulseback processes, even if the same blood vessel section is captured, the alignment state in the longitudinal direction may not match each other; the longitudinal deformation mapping matrix can define a transformation relationship that corrects such longitudinal discrepancies between the data.

[0127] Subsequently, by applying the longitudinal deformation mapping matrix to the plurality of intravascular ultrasound data, an integrated longitudinal coordinate system can be created (S27) in which the plurality of data are synchronized and shared one-to-one. As the integrated longitudinal coordinate system is created, the longitudinal positions of each of the plurality of intravascular ultrasound data correspond to one another on the same coordinate system, and a specific longitudinal position on any one of the data can be converted one-to-one to a corresponding longitudinal position on the other data.

[0129] The integrated longitudinal coordinate system generated in this manner can be used as a reference coordinate system for synchronizing and displaying multiple layers and multiple navigation slides in a subsequent display step. That is, by enabling multiple intravascular ultrasound data to share the same coordinate system through the synchronization step, it becomes possible to automatically track the location of the remaining data corresponding to the location selected in one data and display them together.

[0130] The integrated longitudinal coordinate system thus generated corresponds to the same coordinate system referred to in the claim.

[0132] The same coordinate system as used in this specification. The terms "same coordinate system" or "integrated longitudinal coordinate system" may encompass all logical or mathematical correspondences capable of linking the relative positions between multiple ultrasonic data. That is, it should be interpreted that the category of the same coordinate system includes not only forms that physically generate a single absolute coordinate system, but also all computational systems capable of mutually synchronizing the longitudinal positions between two data, such as a mapping function that maps indices between data, a mapping table that defines correspondence relationships between data, or an offset-based logical linkage relationship that substitutes a specific position of one data with the position of the other data.

[0134] In addition, the term "longitudinal deformation mapping matrix" as described in this specification is not limited to a two-dimensional matrix structure in a mathematical sense or a specific linear algebraic operation data structure. It is a term intended to comprehensively refer to the entirety of the alignment information or positional correspondence information calculated to offset longitudinal physical errors between multiple intravascular ultrasound data.

[0135] That is, the above mapping matrix should be understood in a broad sense to include all forms of algorithmic computation results and data structures that a computer can compute and reference to synchronize the positions between data, such as non-linear warping information by dynamic time warping (DTW), displacement fields, mapping functions between data, mapping tables, lookup tables, correction parameters, or transformation relationship information.

[0137] In the embodiments of the present invention, the term "matching reference origin" has been used for convenience of explanation, but it is not limited to a reference point in the form of a single point. In the present invention, the matching reference origin should be interpreted in a comprehensive sense that includes a set of one or more anchor points, a reference location including specific anatomical structures such as branched blood vessels or major calcification zones, or a reference zone determined by combining multiple points.

[0138] That is, the matching process may be performed based on a single reference point, but it may also include a method of determining the optimal positional correspondence between data by considering the weight distribution between multiple anchor points or reference intervals.

[0140] As used in this specification, the term "artificial mark caused by a catheter device" may encompass all forms of artifacts or identifiable features that appear visually or signal-wise on ultrasound image data due to the physical structure, material, or operational characteristics of the intravascular ultrasound catheter device itself.

[0141] More specifically, the above artificial markings should be interpreted in a broad sense, including but not limited to the following examples:

[0142] Catheter Shadow: A fixed shadow area formed radially or at a constant angle on an image due to ultrasound signals being blocked by a drive shaft or specific structures inside the catheter.

[0143] Device outline and echo: Regular concentric signal patterns generated by the catheter sheath or highly reflective catheter outer wall structures.

[0144] Guide-wire Artifact: Strong reflection echoes or signal shadows occurring behind them in the image due to the presence of a guidewire inserted along with the catheter.

[0145] Identification Marker: A radiopaque marker intentionally placed at a specific location on the catheter or a marker band with different ultrasound reflection properties.

[0146] Even in ultrasound data segments where changes in the biological state of blood vessels or anatomical structures such as side branches or calcified nodules are not distinct, these artificial markers can function as anchor points (FD landmarks, anchor points) that establish relative positional relationships between multiple data by utilizing the unique geometric signal characteristics of the catheter that are fixed and regular within the image.

[0148] Therefore, the present invention should be interpreted as including all configurations that utilize any signal features generated within an ultrasound image due to the physical presence or operation of a catheter device as a standard for synchronization and matching operations.

[0150] FIG. 6 schematically illustrates the process of performing a synchronization step according to one embodiment of the present invention.

[0152] In summary, the synchronization step can continuously extract profile information regarding the shape or structure along the longitudinal direction of the blood vessel from each of the plurality of intravascular ultrasound data, calculate an optimal initial longitudinal shift value by comparing the signal similarity between the waveforms of each of the profile information, and automatically align the initial alignment coordinate system between the plurality of intravascular ultrasound data based on the optimal initial longitudinal shift value.

[0153] In one embodiment of the present invention, the synchronization step can automatically align initial alignment coordinate systems between multiple intravascular ultrasound data without manual intervention by a user. As illustrated in FIG. 6, the synchronization step can be performed through a series of processes in which multiple intravascular ultrasound data are input to generate a preprocessing frame, profile information is continuously extracted from the preprocessing frame, an optimal initial longitudinal shift value is calculated through cross-correlation, and an initial alignment coordinate system is automatically aligned based on the shift value.

[0155] First, the computing system (1000) can generate a preprocessed frame in which the catheter region is automatically excluded from each frame image of the plurality of intravascular ultrasound data using a learned artificial neural network model. The frame images of the intravascular ultrasound data may include the cross-sectional structure of the blood vessel along with the region formed by the catheter device used for imaging; however, since this catheter region does not correspond to the actual cross-sectional structure of the blood vessel, it may reduce the accuracy of the subsequent profile analysis.

[0156] Therefore, by automatically identifying and excluding catheter regions from each frame image through the above-mentioned trained artificial neural network model, preprocessed frames suitable for analyzing the cross-sectional structure of blood vessels can be generated.

[0158] Next, profile information can be continuously extracted from a preprocessed frame from which the catheter region is excluded, based on frame cross-sectional image analysis or profile analysis related to vascular structure. The profile information may include a vascular diameter profile or a plaque burden ratio profile.

[0159] In this case, the blood vessel diameter profile corresponds to information indicating the trend of change in blood vessel diameter according to the longitudinal position of the blood vessel, and the plaque burden rate profile corresponds to information indicating the trend of change in plaque burden rate according to the longitudinal position of the blood vessel. Such profile information can be extracted in the form of a continuous waveform along the longitudinal direction of the blood vessel for each of the multiple intravascular ultrasound data.

[0160] Here, the blood vessel diameter in the above blood vessel diameter profile may correspond to a diameter calculated based on the lumen contour or outer elastic membrane contour detected from a frame cross-sectional image, and may be distinguished in its purpose and display target from the lumen diameter graph of the analysis graph layout displayed to the user in the display stage in that it corresponds to waveform information that serves as the basis for cross-correlation operations for longitudinal alignment between data. However, depending on the embodiment, the above blood vessel diameter profile may be composed of information indicating the trend of change in the lumen diameter, and in this case, it may be calculated based on the same indicator as the above lumen diameter graph.

[0162] Next, by performing a cross-correlation operation to compare the signal similarity between the waveforms of the extracted profile information, the optimal initial longitudinal shift value can be calculated where the waveform graphs between each profile information match most closely.

[0163] Specifically, even if the same blood vessel segment was captured, the waveforms of the profile information extracted from each of the multiple intravascular ultrasound data may be misaligned in the longitudinal direction due to differences in the longitudinal alignment state between the data. Accordingly, the cross-correlation operation calculates the signal similarity with the waveform of another data while relatively shifting the waveform of one data in the longitudinal direction, and can determine the amount of longitudinal shift that shows the highest signal similarity as the optimal initial longitudinal shift value.

[0165] Finally, based on the calculated shift value, the initial alignment coordinate system between the plurality of intravascular ultrasound data can be automatically aligned without manual user intervention. That is, by moving the other data longitudinally by the optimal initial longitudinal shift value relative to one data, an initial alignment coordinate system in which the plurality of intravascular ultrasound data are primarily aligned in the longitudinal direction can be automatically generated.

[0166] The initial alignment coordinate system automatically aligned in this way can be used as a basis for generating the integrated longitudinal coordinate system of the synchronization step described earlier, or provided as an initial state for the user to perform fine-tuning in a subsequent step.

[0168] Meanwhile, the synchronization step can continuously extract profile information regarding the shape or structure along the longitudinal direction of the blood vessel from each of the plurality of intravascular ultrasound data, calculate an optimal initial longitudinal shift value by comparing the signal similarity between the waveforms of each of the profile information, and automatically align the initial alignment coordinate system between the plurality of intravascular ultrasound data based on the optimal initial longitudinal shift value.

[0169] In the embodiments of the present invention, a trained artificial neural network model is used to exclude the catheter region, but the scope of the present invention is not limited thereto. Depending on the embodiments, various preprocessing methods may be applied, such as identifying and excluding the catheter region using traditional image processing techniques widely known in the art, such as pixel intensity-based threshold processing and edge detection.

[0170] Furthermore, although the embodiments of the present invention describe performing cross-correlation operations to compare the degree of agreement between waveforms of profile information, this is merely one embodiment. Any similarity comparison algorithm known in the art, such as mean squared error (MSE) minimization and dynamic time warping (DTW) algorithms, may be applied without limitation as long as it can compare signal similarity or agreement between two data waveforms and derive an optimal shift value.

[0172] FIG. 7 schematically illustrates the process of performing a display step according to one embodiment of the present invention.

[0174] In summary, the display step may provide a user terminal with a user interface comprising a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers.

[0176] Specifically, when a selection input of a specific location is received from any one of the plurality of search slides, the user interface displays the data of that location on the layer corresponding to the search slide, and at the same time, based on the synchronization step, automatically tracks the location of the search slide corresponding to the other layer and dynamically changes and displays the intravascular ultrasound data of the other layer together.

[0178] As illustrated in FIG. 7, the display step can be performed through a series of processes that, upon the occurrence of a search control event, process a selection input received from one of the search slides and automatically track and visualize the remaining other layer based on the synchronization step.

[0180] First, the computing system (1000) may configure a user interface including the plurality of layers and the plurality of search slides and provide it to a user terminal. The plurality of layers correspond to individually displaying information for each of the plurality of intravascular ultrasound data, and the plurality of search slides correspond to individually controlling the search position of each of the plurality of layers.

[0181] For example, the first layer can display information extracted from ultrasound data within the first blood vessel, and the second layer can display information extracted from ultrasound data within the second blood vessel, and the first search slide and the second search slide can each control the search positions of the first layer and the second layer.

[0183] Next, a navigation control event may occur while the above-mentioned user interface is provided. More specifically, a selection input for a specific location may be received on any one of the plurality of navigation slides, and when the selection input is received, intravascular ultrasound data of the corresponding location may be displayed on the layer corresponding to the navigation slide. That is, data corresponding to a specific location selected on any one of the navigation slides may be visualized on the layer corresponding to the navigation slide.

[0185] Next, based on the synchronization step, the remaining other layers, excluding the navigation slide where the selected input was received, can be automatically tracked and visualized. Using the same coordinate system generated in the preceding synchronization step, the location of the navigation slide of the remaining other layers corresponding to the location where the selected input was received can be automatically tracked. Subsequently, based on the tracked location, the intravascular ultrasound data of the remaining other layers can be dynamically changed and displayed together with the data of the selected location.

[0187] According to this display stage, simply by the user selecting a specific location through a single navigation slide, the corresponding location of the other layer sharing the same coordinate system can be automatically tracked and visualized together. Therefore, the user can compare and verify information regarding the same longitudinal location of multiple intravascular ultrasound data on a single screen without having to search for the same location for each of the multiple intravascular ultrasound data separately.

[0189] FIG. 8 schematically illustrates the process of performing a display step according to one embodiment of the present invention.

[0191] In summary, each of the plurality of layers is configured to include a longitudinal view visualizing a longitudinal cross-section of ultrasound data within the blood vessel, a transverse view visualizing a cross-section of a specific frame, an analysis graph layout mapping the trend of change of quantitative indicators along the entire longitudinal direction of the blood vessel, a 3D chemogram view visualizing the distribution state of plaque by component, and a detailed report table listing extracted quantitative parameter information, wherein the analysis graph layout includes at least one of a plaque burden rate graph by longitudinal direction, a lumen diameter graph, and a lumen area graph, and the display step can simultaneously synchronize and update in real time the search line of each longitudinal view included in all of the plurality of layers, the frame of the transverse view, the data pointer of the analysis graph layout, the position marker of the 3D chemogram view, and the data row of the detailed report table based on the same coordinate system in conjunction with the movement control of any one of the plurality of search slides.

[0193] As illustrated in FIG. 8, the plurality of layers may include Layer 1 and Layer 2 of FIG. 8, and Layer 1 and Layer 2 share an integrated longitudinal coordinate system, and a search slide that individually controls the search position of the corresponding layer may be provided on the lower side of each layer.

[0194] Each of the above plurality of layers may be configured to include a longitudinal view visualizing a longitudinal cross-section of the ultrasound data within the blood vessel, a transverse view visualizing a cross-section of a specific frame, an analysis graph layout mapping the trend of change in quantitative indicators along the entire longitudinal direction of the blood vessel, a 3D chemogram view visualizing the distribution state of plaque by component, and a detailed report table listing the extracted quantitative parameter information.

[0195] Here, a search line indicating the current search location may be displayed in the longitudinal view, and the boundary between the lumen and the outer elastic membrane detected from the corresponding frame cross-sectional image and the plaque area between them may be visualized in the transverse view. Additionally, the analysis graph layout may include at least one of a plaque burden rate graph by length direction, a lumen diameter graph, and a lumen area graph, and a data pointer corresponding to the current search location may be displayed on each graph. A location marker corresponding to the current search location may be displayed in the 3D chemogram view, and a data row corresponding to the current search location may be displayed in the detailed report table.

[0197] At this time, the display step can update the longitudinal view, cross-sectional view, analysis graph layout, 3D chemogram view, and detailed report table included in a single layer together based on the same search position in conjunction with the movement control of any one of the plurality of search slides. That is, when any one of the search slides moves to a specific longitudinal position, the search line of the longitudinal view, the frame of the cross-sectional view, the data pointer of the analysis graph layout, the position marker of the 3D chemogram view, and the data row of the detailed report table within the corresponding layer can all be updated collectively to correspond to the moved position.

[0199] Furthermore, the display step can simultaneously synchronize and update in real time the search line of each longitudinal section view, the frame of the cross section view, the data pointer of the analysis graph layout, the position marker of the 3D chemogram view, and the data row of the detailed report table based on the same coordinate system in conjunction with the movement control of any one of the plurality of search slides.

[0200] Specifically, as illustrated in FIG. 8, when a selection input is received from a navigation slide of one layer, the corresponding navigation slide position of the other layer is automatically tracked based on the integrated longitudinal coordinate system, and each component of the longitudinal view or detailed report table included in the other layer is simultaneously synchronized and updated in real time based on the tracked position.

[0202] According to this display stage, various visualization components included in multiple layers are collectively synchronized and updated based on the same longitudinal position with only the movement of a single navigation slide, so the user can compare and verify longitudinal sections, transverse sections, trends in quantitative indicators, plaque component distribution, and detailed quantitative parameters for multiple intravascular ultrasound data on a single screen based on the same position.

[0204] The expressions "real-time update" or "update by synchronization" as used in this specification are not limited to an immediate processing method in which the screen changes continuously without delay simultaneously with user input.

[0205] Depending on the software's event processing method, this concept encompasses not only continuous updates while specific user operations, such as dragging, are in progress, but also methods where linked information is collectively updated or asynchronously changed upon being triggered by the completion of an operation—such as releasing a click, dropping a mouse, ending a touch, or finishing a specific key input. In other words, it should be understood in a broad sense as including all update logic where information from another layer is logically synchronized and displayed in response to control events at the navigation position, even without the user issuing a separate manual refresh command.

[0206] FIG. 9 schematically illustrates a user interface according to one embodiment of the present invention.

[0208] In summary, the user interface provides an overlay mode that displays a pre-procedure data layer and a post-procedure data layer among the synchronized plurality of layers by overlapping them in a single virtual screen space, or a contrast mode that tracks the pre-procedure data layer and the post-procedure data layer by arranging them in parallel with each other in synchronization. When the overlay mode or the contrast mode is activated, the luminal contour of the pre-procedure data and the luminal contour of the post-procedure data are precisely aligned and contrasted on the same coordinate system, thereby calculating quantitative parameters including stent expansion rate, luminal expansion gain, and area gain in real time for each longitudinal position of the blood vessel and outputting them in an integrated manner to a detailed report table included in the plurality of layers.

[0210] The user interface illustrated in FIG. 9 corresponds to a screen configuration for a single layer that displays information on intravascular ultrasound data, and the layer may be configured to include a cross-sectional view, a longitudinal view, an analysis graph layout, a 3D chemogram view, and a detailed report table. In this case, each component is interconnected based on the same longitudinal coordinate system so that when any one search position changes, they can be updated together.

[0212] First, a cross-sectional view that visualizes a cross-section of a specific frame may be displayed on the upper side (1) of the screen. In the cross-sectional view, a frame cross-sectional image corresponding to the current search position may be displayed, and the inner lumen contour and outer elastic membrane contour detected from the frame cross-sectional image, and the plaque area excluding the inner lumen contour from the inner region of the outer elastic membrane contour may be visualized together.

[0213] For example, the above cross-sectional view can display the original frame cross-sectional image and the frame cross-sectional image with the inner lumen contour and outer elastic membrane contour superimposed side by side, allowing the user to intuitively verify the detection results.

[0215] A longitudinal cross-sectional view visualizing the longitudinal cross-section of the corresponding intravascular ultrasound data may be displayed in the central part (2) of the screen. The longitudinal cross-sectional view corresponds to a cross-sectional shape reconstructed by aligning multiple frame cross-sectional images in the longitudinal direction of the blood vessel, and a search line indicating the current search position is displayed above it to guide the user to intuitively recognize the longitudinal position.

[0217] Additionally, on the lower side (3) of the above-mentioned longitudinal view, an analysis graph layout mapping the trend of changes in quantitative indicators along the entire longitudinal direction of the blood vessel may be displayed. The analysis graph layout may include at least one of a graph of plaque burden rate by longitudinal direction, a graph of lumen diameter, and a graph of lumen area, and a data pointer corresponding to the current search position may be displayed on each graph. The analysis graph layout may also display specific longitudinal locations that are clinically significant, such as the location where the minimum lumen area appears, or the location where plaque attenuation or calcium appears at its maximum.

[0219] A 3D chemogram view visualizing the distribution state of plaque components may be displayed on the lower side (4) of the screen. The 3D chemogram view visualizes the distribution state of plaque components along the longitudinal direction of the blood vessel by distinguishing them by color, and can guide the user to identify the distribution of calcified plaque or attenuated plaque, etc., at a glance according to the longitudinal position.

[0221] On one side (5) of the screen, a detailed report table listing extracted quantitative parameter information may be displayed. The detailed report table may display quantitative parameters calculated by lesion area of ​​interest or reference segment in a table format, and may include, for example, quantitative indicators such as minimum lumen area, outer elastic membrane area, plaque burden rate, or plaque volume burden rate.

[0223] Meanwhile, the above user interface may further include an input element (E1) for setting a region of interest on the corresponding layer. For example, the input element (E1) may include a selection button corresponding to each of a plurality of reference values ​​for the plaque burden rate, and when the user selects one of the selection buttons, a lesion region of interest based on the corresponding reference value may be automatically detected and displayed on the longitudinal view and the analysis graph layout. For the region of interest set in this way, quantitative parameters of the region of interest may be calculated and output in the detailed report table.

[0225] Meanwhile, in one embodiment of the present invention, the user interface may provide an overlay mode or a contrast mode for mutually comparing a pre-procedure data layer and a post-procedure data layer among the synchronized plurality of layers. The pre-procedure data layer corresponds to a layer displaying intravascular ultrasound data acquired before stent implantation, and the post-procedure data layer corresponds to a layer displaying intravascular ultrasound data acquired after stent implantation.

[0227] The above overlay mode corresponds to a mode that displays the pre-procedure data layer and the post-procedure data layer superimposed in a single virtual screen space. That is, when the above overlay mode is activated, the computing system (1000) can display the longitudinal view, transverse view, or internal contour line of both data superimposed in a single virtual screen space, while the pre-procedure data and the post-procedure data are aligned longitudinally based on the same coordinate system generated in the synchronization step.

[0228] On the other hand, the above-mentioned contrast mode corresponds to a mode that synchronizes and tracks the pre-procedure data layer and the post-procedure data layer by arranging them in parallel, as previously explained. The user may selectively activate the above-mentioned overlay mode or the above-mentioned contrast mode depending on the purpose of comparison.

[0230] When the above overlay mode or the above contrast mode is activated, the lumen contour of the pre-procedure data and the lumen contour of the post-procedure data can be precisely aligned and displayed in contrast on the same coordinate system. That is, since the lumen contours of both data are aligned and displayed based on the same longitudinal position, the user can intuitively compare and verify the changes in the lumen contour before and after the procedure according to the longitudinal position of the blood vessel.

[0232] Furthermore, based on the precisely aligned pre-procedure data and post-procedure data, quantitative parameters including stent expansion rate, lumen expansion gain, and area gain can be calculated in real time for each longitudinal position of the blood vessel. The stent expansion rate may correspond to the ratio of the area of ​​the stent region calculated from the post-procedure data to a reference area; the lumen expansion gain may correspond to the degree to which the lumen diameter of the post-procedure data at the same longitudinal position has increased relative to the lumen diameter of the pre-procedure data; and the area gain may correspond to the degree to which the lumen area of ​​the post-procedure data has increased relative to the lumen area of ​​the pre-procedure data at the same longitudinal position.

[0233] As explained above, since the pre-procedure data and post-procedure data share the same coordinate system and have corresponding longitudinal positions, the computing system (1000) can calculate the quantitative parameters by directly comparing the quantitative indicators extracted from both data for each directional position.

[0235] The quantitative parameters calculated in this manner can be integrated and output into a detailed report table included in the plurality of layers. Accordingly, the user can comprehensively check the quantitative parameters indicating changes in the vascular condition before and after the procedure on a single screen based on the same longitudinal position, and can quantitatively evaluate the degree of lumen expansion and the expansion state of the stent caused by the stent procedure.

[0237] The overlay mode or contrast mode mentioned in this specification is merely one visualization embodiment provided in the synchronized search environment of the present invention. The core technical concept of the present invention lies in a process of logically combining quantitative data derived from multiple IVUS data based on the same coordinate system or positional correspondence, and thereby performing comparative analysis in specific corresponding intervals. That is, regardless of whether a specific UI mode called the contrast mode is activated, all functional actions of the present system in performing indicator calculation and difference operations based on synchronized position information may be included within the scope of comparative analysis of the present invention.

[0238] The stent expansion rate, lumen expansion gain, and area gain exemplified in the embodiments of the present invention are merely some of the quantitative indicators that can be calculated by the present invention. The present invention can calculate and compare all quantitative analysis indicators in the art that can be derived from IVUS data, such as lumen diameter, vascular area, plaque volume, calcification distribution rate, stent compression distance, and wall shear stress (WSS), without limitation. In other words, the present invention is not limited to the names of specific indicators and can encompass all types of comparative analysis indicators derived from synchronized locations.

[0239] The present invention is not limited to specific UI components, such as detailed report tables, in the method of providing calculated and compared quantitative indicators. The system may provide the analyzed indicators in any form of visual or data-based reporting permitted in the industry, such as 1) overlay graphics on the corresponding analysis area, 2) graphs indicating time flow or longitudinal changes, 3) independent report display areas, or 4) raw data or exported document formats for linking with external analysis systems. In short, the present invention covers the scope of protection for all technical configurations that output results derived through the synchronization-based comparative analysis process, regardless of how the calculated comparative data is visualized and provided to the user or in what file format it is output.

[0241] FIG. 10 schematically illustrates a user interface according to one embodiment of the present invention.

[0243] In summary, the user interface includes a alignment adjustment interface that allows the user to visually check and fine-tune the coordinate system synchronization status aligned by the synchronization step, and the display step can update the coordinate system mapping standard of the synchronization step in real time by recalculating the relative position margin of the same coordinate system based on the correction distance when a pullback playback synchronization command that links playback between multiple pullback layers acquired at different points in time through the alignment adjustment interface, or a calibration input that separates the search slide of a specific layer from other layers and moves it independently is received.

[0245] The calibration or fine-tuning process described in the embodiments of the present invention is not limited to a linear correction method that simply shifts the entire data by adding or subtracting a certain longitudinal distance (offset).

[0246] The correction in the present invention may include input by a user to add one or more reference points corresponding to specific anatomical landmarks, change the location of existing reference points, or delete them on the UI. Based on the updated reference point information per image, the computing system can dynamically recalculate and update the overall positional correspondence relationship, including non-linear warping or segment-by-segment mapping functions between multiple intravascular ultrasound data. Accordingly, the present invention can encompass not only simple offset addition / subtraction but also advanced synchronization calibration methods in which the alignment information between data is structurally updated according to changes in reference points.

[0248] The user interface illustrated in FIG. 10 can correspond to a contrast mode that synchronizes tracking by arranging multiple layers in parallel to each other, each displaying multiple intravascular ultrasound data acquired at multiple different points in time. As illustrated in FIG. 10, the multiple layers may include a layer corresponding to a first point in time, a layer corresponding to a second point in time, and a layer corresponding to a third point in time, but are not limited thereto and may include two or more layers.

[0249] For example, the layer corresponding to the first time point may display intravascular ultrasound data acquired before the stent procedure, the layer corresponding to the second time point may display intravascular ultrasound data acquired during the procedure, and the layer corresponding to the third time point may display intravascular ultrasound data acquired after the stent procedure. However, the acquisition time of the data displayed by the plurality of layers in the present invention is not limited.

[0251] Each of the above plurality of layers may be configured to include a cross-sectional view, a longitudinal view, an analysis graph layout, a 3D chemogram view, and quantitative parameter information regarding intravascular ultrasound data at the corresponding point in time. As shown in FIG. 10, a frame cross-sectional image corresponding to the current search position may be displayed as a cross-sectional view in each layer, and the lumen contour and outer elastic membrane contour detected from the frame cross-sectional image may be visualized together. In addition, each layer may display the lumen area, lumen diameter, outer elastic membrane area, outer elastic membrane diameter, plaque burden rate, or quantitative parameters related to calcium and attenuation calculated from the intravascular ultrasound data at the corresponding point in time.

[0253] At this time, the plurality of layers share an integrated longitudinal coordinate system created in the previous synchronization step, and when a search position is selected in any one layer, the corresponding longitudinal position of the other layer can be automatically tracked and updated together. That is, as shown in FIG. 10, when a specific longitudinal position is selected on the cross-sectional view, longitudinal view, or analysis graph layout of any one layer while the plurality of layers are arranged in parallel, the other layers can simultaneously display the frame cross-sectional image and quantitative parameters of the longitudinal position anatomically corresponding to that position. Through this, the user can compare and verify intravascular ultrasound data from different time points on a single screen for the same longitudinal position of the same blood vessel segment.

[0255] For example, by selecting a specific longitudinal position in the layer at the time point before the procedure where the minimum lumen area appears, the user can compare and verify changes in lumen area, lumen diameter, or plaque calcium and attenuation status at the same longitudinal position during and after the procedure. In this comparison mode, intravascular ultrasound data acquired independently at multiple time points is aligned and displayed in parallel based on the same coordinate system; therefore, the user can precisely compare changes in the vascular condition before and after the procedure based on the same position without the need for manual alignment of data from each time point.

[0257] In one embodiment of the present invention, the user interface may include a alignment adjustment interface so that the user can visually check and fine-tune the coordinate system synchronization status aligned by the synchronization step. Even if a plurality of intravascular ultrasound data are automatically aligned to share an integrated longitudinal coordinate system by the synchronization step, a fine alignment error may remain in some longitudinal positions due to errors in the shooting tension speed between data or errors in the expansion and contraction of blood vessels caused by the patient's heartbeat.

[0258] The above alignment adjustment interface corresponds to an input element provided to allow the user to directly check and correct such residual alignment errors, and the user can input a correction through the above alignment adjustment interface to move the longitudinal position of one layer relative to another layer.

[0260] More specifically, the display step can update the mapping reference of the same coordinate system in real time based on the calibration input received through the alignment adjustment interface. The calibration input corresponds to an input that separates the navigation slide of a specific layer from the navigation slide of the other layer and moves it independently.

[0261] That is, in a normal search state, the position of the search slide of the other layer is automatically tracked together in conjunction with the movement of one search slide, but when the calibration input is received, only the search slide of the specific layer can be temporarily separated from the automatic tracking linkage and moved independently. At this time, the longitudinal distance in which the search slide of the specific layer is moved independently can correspond to the correction distance for which the user wishes to correct the alignment position of the layer.

[0263] Subsequently, the relative position margin of the same coordinate system can be recalculated based on the correction distance generated in this manner. The relative position margin corresponds to a relative position correction amount assigned to correspond the longitudinal positions between one layer and the other layer on the integrated longitudinal coordinate system.

[0264] That is, the relative position margin can be recalculated to shift the longitudinal correspondence of the corresponding layer by the correction distance generated by the calibration input, and the recalculated relative position margin can be reflected in the coordinate system mapping standard of the synchronization step to update it in real time. Accordingly, when a normal search is performed again after the calibration input, multiple layers can be mutually synchronized in a corrected alignment state based on the updated coordinate system mapping standard.

[0266] In addition, when a Pullback playback synchronization command is received through the alignment adjustment interface, the display step can perform playback between multiple pullback layers acquired at different points in time by linking them based on the same coordinate system. That is, when the Pullback playback synchronization command is received, the search position of one layer is sequentially moved along the longitudinal direction of the blood vessel, and the intravascular ultrasound data of that layer is continuously played back. At the same time, the corresponding longitudinal position of the remaining layer is tracked and synchronized playback is performed based on the same coordinate system. Through this, the user can play back multiple pullback layers together based on the same longitudinal position, and continuously compare and verify the trends of change in intravascular ultrasound data at different points in time.

[0268] With this configuration, the user can directly check and fine-tune the remaining alignment error of the coordinate system automatically aligned by the synchronization step through the alignment adjustment interface, and since the relative position margin recalculated according to the calibration input is reflected in real-time to the coordinate system mapping standard, multiple intravascular ultrasound data can be compared in a more precisely aligned and synchronized state.

[0270] Preferably, the multi-layer based search method may further include, after the display step, a step of detecting at least one interest area synchronization and annotation change event including the setting of a lesion interest area, a stent interest area, or a reference segment on a specific layer screen among the plurality of layers; and a step of backtracking the same coordinate system to calculate the longitudinal position coordinates of the point where the change event occurred, and projecting and visualizing the same annotation graphic layer in real time by mapping it onto the corresponding position coordinates of the remaining other layers.

[0272] The same annotation graphic layer mentioned in this specification is not limited to a method of reproducing the visual form or graphic data of annotations exactly as they are in the original. It refers to any process in which annotation information on the first data is logically transferred and visualized to a corresponding location on the second data based on the positional correspondence relationship of the present invention.

[0273] That is, the present invention may include the following modified embodiments in the visualization of tin.

[0274] A method in which the annotation information of the first data is automatically converted and displayed in terms of form, attribute, or identification value to match the image characteristics of the second data, such as changes before / after the procedure; a method in which new quantitative analysis results are calculated, displayed, or updated at the longitudinal position of the corresponding data for the region of interest (ROI) or reference position specified by the annotation; and an interconnected data relationship in which analysis results, measurement values, display information, etc., contained in the annotation are mutually stored and updated under the same logical layer, even if the visual graphics are different.

[0275] Therefore, the present invention should be interpreted to encompass all synchronization logic that goes beyond simply copying comments to convert and recalculate indicators according to corresponding locations / sections, and variably display / store them.

[0277] More specifically, on a specific layer screen of any one of the plurality of layers, at least one region of interest synchronization and annotation change event including the setting of a lesion region of interest, a stent region of interest, or a reference segment can be detected.

[0278] At this time, the lesion region of interest corresponds to a region of interest set for a lesion section where plaque is formed within a blood vessel, the stent region of interest corresponds to a region of interest set for a section where a stent is implanted, and the reference segment may correspond to a segment set for a normal blood vessel section that serves as a standard for quantitative comparison of the lesion section.

[0279] That is, if a user newly sets the lesion region of interest, stent region of interest, or reference segment, or changes its location or range on any one specific layer screen, such setting or change can be detected as a region of interest synchronization and annotation change event.

[0281] Subsequently, the longitudinal position coordinates of the point where the change event occurred can be calculated by backtracking the same coordinate system generated in the previous synchronization step. That is, the longitudinal position coordinates on the integrated longitudinal coordinate system corresponding to the location on the specific layer where the change event occurred can be calculated by backtracking. In this case, if the change event occurs over a certain interval, such as when setting a region of interest, the longitudinal position coordinates corresponding to the start and end positions of that interval can be calculated, respectively.

[0283] Next, based on the calculated longitudinal position coordinates, the same annotation graphic layer can be projected and visualized in real time by mapping it onto the corresponding position coordinates of the remaining other layers. In this case, the annotation graphic layer may correspond to a graphic element that visually represents a lesion region of interest, a stent region of interest, or a reference segment set or changed by the change event.

[0284] That is, through the aforementioned integrated longitudinal coordinate system, the longitudinal position coordinates calculated in a specific layer are converted into the corresponding longitudinal position coordinates of the remaining other layers, and the annotation graphic layer can be projected and displayed identically on the corresponding position coordinates.

[0286] According to this configuration, by simply setting or changing a lesion region of interest, a stent region of interest, or a reference segment on a specific layer screen, the same annotation graphic layer is displayed in real time at the anatomically corresponding locations of the remaining layers that share the same coordinate system.

[0287] Therefore, without the need to repeatedly set the same region of interest for each of the multiple layers, the user can collectively apply a region of interest set in one layer to all of the multiple intravascular ultrasound data based on the same longitudinal position, thereby enabling mutual comparison and verification.

[0289] In another embodiment of the present invention, the multi-layer-based search method of the present invention may further include, after the display step, a step of extracting the longitudinal boundary coordinates of the lesion interest region detected in the pre-procedure data layer and the longitudinal boundary coordinates of the stent interest region detected in the post-procedure data layer based on the synchronized same coordinate system and performing a mutual comparison operation; and, as a result of the comparison operation, if there exists an uncovered section where the longitudinal boundary of the lesion interest region extends beyond the boundary range of the stent interest region, or if the plaque burden rate per specific frame within the uncovered section exceeds a preset safety threshold, automatically diagnosing it as a geographical settlement failure area, overlaying a visual warning marker on the user interface, and additionally outputting the length of the corresponding uncovered section as a quantitative parameter in a detailed report table included in the plurality of layers.

[0291] More specifically, the computing system (1000) can extract the longitudinal boundary coordinates of the lesion interest region detected in the pre-procedure data layer and the longitudinal boundary coordinates of the stent interest region detected in the post-procedure data layer, respectively, based on the synchronized same coordinate system, and perform a mutual comparison operation. The pre-procedure data layer corresponds to a layer among a plurality of layers that displays intravascular ultrasound data acquired before the stent procedure, and the post-procedure data layer corresponds to a layer that displays intravascular ultrasound data acquired after the stent procedure.

[0292] At this time, since the lesion region of interest and the stent region of interest can each be expressed as longitudinal boundary coordinates on the integrated longitudinal coordinate system, the computing system (1000) can directly compare the longitudinal boundary coordinates of both regions of interest on the same coordinate system to calculate the inclusion or exclusion relationship.

[0294] As a result of the above comparison operation, there may exist uncovered sections where the longitudinal boundary of the lesion region of interest extends beyond the boundary range of the stent region of interest. These uncovered sections correspond to longitudinal sections that are not covered by the implanted stent despite the presence of a lesion; this corresponds to areas where the risk of restenosis or side effects is relatively high after the procedure because the stent fails to sufficiently cover the lesion region.

[0295] Furthermore, a section can be identified as a risk section not only when such an uncovered section exists, but also when the plaque burden rate for a specific frame within the uncovered section exceeds a preset safety threshold. In other words, by considering the degree of plaque burden remaining in the out-of-bounds section in addition to simply whether the stent boundary has been exceeded, clinically more significant sections can be selectively diagnosed.

[0297] If, as a result of the above comparison operation, there exists an uncovered section or if the plaque burden rate per specific frame within the uncovered section exceeds the preset safety threshold, the computing system (1000) can automatically diagnose this as an area where the stent has not sufficiently covered the lesion section, i.e., an area of ​​geographical failure to settle.

[0298] Additionally, a visual warning marker can be overlaid on the user interface at a longitudinal position corresponding to the automatically diagnosed geographical settlement failure area. In this case, since the visual warning marker is displayed based on the integrated longitudinal coordinate system, it can be displayed together at the corresponding longitudinal positions of the pre-procedure data layer and the post-procedure data layer among the plurality of layers.

[0300] Furthermore, the computing system (1000) can additionally output the length of the corresponding uncovered section as a quantitative parameter to the detailed report table included in the plurality of layers. As previously explained, since the number of arranged frame cross-sectional images can be converted into a distance along the longitudinal direction of the blood vessel, the computing system (1000) can quantitatively calculate the length of the corresponding section from the longitudinal boundary coordinates corresponding to the uncovered section and output it to the detailed report table.

[0302] According to this configuration, the user does not need to manually determine whether the stent has sufficiently covered the lesion by comparing data before and after the procedure one by one. Instead, the computing system (1000) automatically compares the boundaries of the lesion interest area and the stent interest area based on the same coordinate system to diagnose the uncovered section and provides this information in the form of a visual warning marker and quantitative parameters. Therefore, the user can quickly and accurately verify the appropriateness of the stent procedure based on the same longitudinal position and intuitively determine the necessity of additional procedures for the uncovered section.

[0304] The term "Layer" as used in this specification is not limited to a specific hierarchical structure in which graphic elements overlap. It refers to any form of independent or interconnected space that visualizes multiple intravascular ultrasound data information by individually partitioning it on a screen, and should be interpreted as encompassing all graphic interface areas for displaying data by separating or arranging it in parallel, such as display areas, panels, views, viewers, windows, and dashboards commonly used in the industry.

[0305] In addition, the navigation slide described in this specification is not limited to specific GUI components, such as a bar-shaped slider composed of tracks and thumbs. It is a term used to comprehensively refer to all interaction means through which a user can control, input, or change the longitudinal navigation position of a blood vessel.

[0306] That is, the above navigation slide should be understood in a broad sense to include not only the traditional slider bar form, but also all forms of input and navigation control interfaces that allow the user to specify and control the navigation position according to their intent, such as keyboard arrow key operation, mouse wheel scrolling, touch gestures such as swiping, interactions such as directly clicking or dragging a specific location on a cross-sectional view, and direct input of coordinate values.

[0308] In one embodiment of the present invention, the user interface of the present invention may support an individual search control mode and a total integrated search control mode. A first operation interface, such as an individual slide, independently changes only the search position of specific individual data, while a second operation interface, such as a total slide, synchronously controls the search positions between multiple data based on alignment information. The present invention includes selective switching between such individual control and integrated control, or determining whether to link based on user settings, and regardless of which operation interface is implemented, the functional essence lies in a logical process of calculating and updating positions within the same coordinate system.

[0310] The above navigation control interface is not limited to GUI-based slider components. It refers to any user input mode in which a user can indicate or select a navigation location. For example, it may include all forms of navigation control events in which location information to be searched is transmitted to the system, such as direct input of a frame number to be searched, click / drag / touch interaction on a specific point within a cross-sectional view, continuous input using arrow keys or a wheel on a keyboard, or input through external devices such as a mouse, foot pedal, or joystick.

[0312] In the embodiments of the present invention, for convenience of explanation and optimal information provision, an integrated user interface including a longitudinal section view, a cross-sectional view, an analysis graph layout, a 3D chemogram view, and a detailed report table was described as an example.

[0313] However, the scope of the present invention is not necessarily limited to including all of the aforementioned visualization components. It is understood that only some of the views and panels listed in the drawings may be selectively combined and provided, such as by providing only longitudinal and transverse views, depending on the embodiments, user settings, or system environment.

[0314] Furthermore, extended embodiments in which new types of medical image visualization components or analysis tools required in the relevant technical field are additionally combined within the same coordinate system-based synchronous interlocking structure may also be fully included within the scope of the present invention. The key point is that each implemented visualization component is interconnected and simultaneously updated based on the same coordinate system or correspondence relationship.

[0316] FIG. 11 illustrates, exemplarily, the internal configuration of a computing device (11000) according to one embodiment of the present invention.

[0318] The computing system (1000) mentioned in the description of FIG. 1 may include the components of the computing device (11000) illustrated in FIG. 11, which will be described later.

[0320] As illustrated in FIG. 11, the computing device (11000) may include at least one processor (11100), memory (11200), peripheral interface (11300), input / output subsystem (I / O subsystem) (11400), power circuit (11500), and communication circuit (11600).

[0322] Specifically, the memory (11200) may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or non-volatile memory. The memory (11200) may include software modules, instruction sets, or various other data required for the operation of the computing device (11000).

[0323] At this time, access to the memory (11200) from other components, such as the processor (11100) or the peripheral device interface (11300), can be controlled by the processor (11100). The processor (11100) may be composed of a single or multiple units and may include processors in the form of GPUs and TPUs to improve computation processing speed.

[0324] The above peripheral device interface (11300) can connect input and / or output peripheral devices of the computing device (11000) to the processor (11100) and the memory (11200). The processor (11100) can perform various functions for the computing device (11000) and process data by executing a software module or instruction set stored in the memory (11200).

[0325] The input / output subsystem (11400) may connect various input / output peripheral devices to the peripheral device interface (11300). For example, the input / output subsystem (11400) may include a controller for connecting peripheral devices such as a monitor, keyboard, mouse, printer, or, if necessary, a touchscreen or sensor to the peripheral device interface (11300). According to another aspect, the input / output peripheral devices may be connected to the peripheral device interface (11300) without passing through the input / output subsystem (11400).

[0326] The power circuit (11500) may supply power to all or part of the components of the terminal. For example, the power circuit (11500) may include one or more power sources such as a power management system, a battery or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or any other components for power generation, management, and distribution.

[0327] The communication circuit (11600) may enable communication with another computing device using at least one external port. Alternatively, as described above, the communication circuit (11600) may enable communication with another computing device by including an RF circuit and transmitting and receiving an RF signal, also known as an electromagnetic signal, as needed.

[0329] The embodiment of FIG. 11 is merely an example of the computing device (11000), and the computing device (11000) may have some components shown in FIG. 11 omitted, additional components not shown in FIG. 11 added, or a configuration or arrangement that combines two or more components. For example, a computing device for a communication terminal in a mobile environment may include a touchscreen or sensors in addition to the components shown in FIG. 11, and the communication circuit (11600) may include a circuit for RF communication of various communication methods (Wi-Fi, 3G, LTE, 5G, 6G, Bluetooth, NFC, Zigbee, etc.). The components that can be included in the computing device (11000) may be implemented as hardware, software, or a combination of both hardware and software, including one or more integrated circuits specialized for signal processing or applications.

[0330] Methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded on a computer-readable medium. In particular, the program according to the present embodiment may be configured as a PC-based program or an application dedicated to a mobile terminal. An application to which the present invention is applied may be installed on a user terminal through a file provided by a file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file in response to a request from the user terminal.

[0332] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0333] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively. Software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave in order to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be standardized and stored or executed in a standardized manner on a networked computing device. Software and data may be stored on one or more computer-readable recording media.

[0334] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the embodiment, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

[0336] According to one embodiment of the present invention, by synchronizing the search positions between multiple intravascular ultrasound data acquired at different points in time and automatically tracking them, the convenience and efficiency of comparative reading between multiple point-in-time data can be maximized.

[0337] According to one embodiment of the present invention, the longitudinal section view, cross section view, analysis graph layout, 3D chemogram view, and detailed report table included in a plurality of layers can be simultaneously synchronized and updated in real time based on the same coordinate system in conjunction with a plurality of search slide controls.

[0338] According to one embodiment of the present invention, by calculating a longitudinal deformation mapping matrix based on reference feature points detected through image frame analysis, it is possible to generate an integrated longitudinal coordinate system that effectively offsets shooting tension speed errors and vascular stretching errors caused by heartbeats.

[0339] According to one embodiment of the present invention, by receiving a Pullback playback synchronization command or an independent calibration input through a matching adjustment interface and recalculating the relative position margin, the effect of precisely correcting the coordinate system mapping reference in real time can be achieved.

[0340] According to one embodiment of the present invention, by backtracking region of interest synchronization and annotation change events detected on a specific layer screen based on the same coordinate system, it is possible to achieve the effect of mapping and projecting the same annotation graphic layer in real time to corresponding positions of the remaining other layers.

[0341] According to one embodiment of the present invention, by aligning and displaying the lumen contours of pre-procedure data and post-procedure data through an overlay mode or a contrast mode, it is possible to calculate quantitative parameters according to the procedure in real time and output them in an integrated manner to a detailed report table.

[0342] According to one embodiment of the present invention, by generating a preprocessed frame in which the catheter region is automatically excluded from each frame image using a trained artificial neural network model, the effect of resolving the noise vulnerability of profile information extraction can be achieved.

[0343] According to one embodiment of the present invention, by performing a cross-correlation operation between continuously extracted blood vessel diameter profiles or plaque burden rate profile waveforms to calculate an optimal initial longitudinal shift value, the effect of enabling auto-alignment without manual intervention by the user can be achieved.

[0344] According to one embodiment of the present invention, by visualizing the change trend of at least one of the plaque burden rate, lumen diameter, and lumen area graphs in the longitudinal direction through an analysis graph layout in conjunction with a data pointer, it is possible to achieve the effect of supporting a comprehensive analysis of the vascular condition.

[0345] According to one embodiment of the present invention, by providing a user interface in which a plurality of layers and a plurality of navigation slides are organically combined, it is possible to achieve the effect of reducing visual fatigue and cognitive load experienced by the operator during multi-viewpoint large-volume medical image reading.

[0347] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents. Therefore, other implementations, other embodiments, and equivalents to the claims below are also within the scope of the claims.

Claims

Claim 1 A multi-layer based search method using synchronization between multiple intravascular ultrasound data performed in a computing system comprising one or more processors and one or more memories, comprising: a data acquisition step of acquiring multiple intravascular ultrasound data, each comprising a plurality of frame cross-sectional images; and a synchronization step of aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system. A multi-layer based search method comprising: a display step of providing a user terminal with a user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers or a whole slide that integrates and controls the search position of all of the plurality of layers; wherein the user interface, when a selection input of a specific position is received in any one of the plurality of search slides, displays the data of the specific position on the layer corresponding to the search slide, and based on the synchronization step, automatically tracks the search slide position corresponding to each of the remaining other layers and dynamically changes and displays the intravascular ultrasound data of the remaining other layers together, or when a selection input of a specific position is received in the whole slide, automatically tracks the search position corresponding to each of the plurality of layers based on the synchronization step and dynamically changes and displays the intravascular ultrasound data of the plurality of layers together based on the search position. Claim 2 delete Claim 3 A multi-layer based search method using synchronization between multiple intravascular ultrasound data performed in a computing system comprising one or more processors and one or more memories, comprising: a data acquisition step of acquiring multiple intravascular ultrasound data, each comprising a plurality of frame cross-sectional images; and a synchronization step of aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system. The method comprises a display step of providing a user terminal with a user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers or a whole slide that integrally controls the search position of all of the plurality of layers; wherein each of the plurality of layers is configured to include a longitudinal view visualizing a longitudinal cross-section of the corresponding intravascular ultrasound data, a transverse view visualizing a cross-section of a specific frame, an analysis graph layout mapping the trend of change of quantitative indicators along the entire longitudinal direction of the blood vessel, a 3D chemogram view visualizing the distribution state of plaque by component, and a detailed report table listing extracted quantitative parameter information; wherein the analysis graph layout includes at least one of a plaque burden rate graph by length direction, a lumen diameter graph, and a lumen area graph; and wherein the display step, in conjunction with the movement control of any one of the plurality of search slides, includes a search line of each of the longitudinal view included in all of the plurality of layers, a frame of the transverse view, a data pointer of the analysis graph layout, and a position marker of the 3D chemogram view. A multi-layer based search method that simultaneously synchronizes data rows of the above-mentioned detailed report table based on the same coordinate system and updates them in real time. Claim 4 A multi-layer based search method according to claim 1, wherein the synchronization step comprises: a step of analyzing each image frame of the plurality of intravascular ultrasound data to detect a reference feature point including a common anatomical feature point or an artificial mark generated by a catheter device; a step of setting the location of the reference feature point as a matching reference origin and calculating a longitudinal deformation mapping matrix to offset the shooting tension speed error between the plurality of data or the vascular expansion error caused by the patient's heartbeat; and a step of applying the longitudinal deformation mapping matrix to the plurality of intravascular ultrasound data to generate an integrated longitudinal coordinate system in which the plurality of data are synchronized one-to-one and shared. Claim 5 A multi-layer based search method using synchronization between multiple intravascular ultrasound data performed in a computing system comprising one or more processors and one or more memories, comprising: a data acquisition step of acquiring multiple intravascular ultrasound data, each comprising a plurality of frame cross-sectional images; and a synchronization step of aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system. A multi-layer based search method comprising: a display step of providing a user terminal with a user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers or a whole slide that integrates and controls the search position of all the plurality of layers; wherein the user interface includes a alignment adjustment interface so that the user can visually confirm and fine-tune the coordinate system synchronization state aligned by the synchronization step; and wherein the display step, when a Pullback playback synchronization command that links playback between multiple pullback layers acquired at different multiple points in time, or a calibration input that modifies an alignment reference point on a specific layer or changes the search position, is received, recalculates the position correspondence relationship between the plurality of intravascular ultrasound data based on the modified reference point or changed position information and updates it in real time. Claim 6 A multi-layer based search method utilizing synchronization between multiple intravascular ultrasound data performed in a computing system comprising one or more processors and one or more memories, comprising: a data acquisition step of acquiring multiple intravascular ultrasound data each comprising multiple frame cross-sectional images; a synchronization step of aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system; and a display step of providing a user terminal with a user interface comprising a plurality of layers that individually display information of each of the multiple intravascular ultrasound data on a screen, a plurality of search slides that individually control the search position of each of the plurality of layers, or a whole slide that integrally controls the search position of all the plurality of layers; and further comprising, after the display step, a step of detecting at least one interest region synchronization and annotation change event including the setting of a lesion interest region, a stent interest region, or a reference segment on a specific layer screen of any one of the multiple layers; and a step of backtracking the same coordinate system to calculate the longitudinal position coordinates of the point where the change event occurred, and projecting and visualizing the same annotation graphic layer in real time by mapping it onto the corresponding position coordinates of the remaining other layers. Claim 7 A multi-layer based search method using synchronization between multiple intravascular ultrasound data performed in a computing system comprising one or more processors and one or more memories, comprising: a data acquisition step of acquiring multiple intravascular ultrasound data, each comprising a plurality of frame cross-sectional images; and a synchronization step of aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system. A multi-layer based search method comprising: a display step of providing a user interface to a user terminal, the user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers or a whole slide that integrates and controls the search position of all the plurality of layers; wherein the user interface provides an overlay mode that displays a pre-procedure data layer and a post-procedure data layer among the synchronized plurality of layers by overlapping them in a single virtual screen space, or a contrast mode that synchronizes and tracks the pre-procedure data layer and the post-procedure data layer by arranging them in parallel with each other; and when the overlay mode or the contrast mode is activated, the lumen contour of the pre-procedure data and the lumen contour of the post-procedure data are precisely aligned and contrasted on the same coordinate system, thereby calculating quantitative parameters including stent expansion rate, lumen expansion gain, and area gain in real time for each longitudinal position of the blood vessel and outputting them integratedly to a detailed report table included in the plurality of layers. Claim 8 A method for synchronizing multiple intravascular ultrasound data for multi-layer-based exploration performed in a computing system comprising one or more processors and one or more memories, comprising: a data acquisition step of acquiring multiple intravascular ultrasound data each comprising a plurality of frame cross-sectional images; and a synchronization step of aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system; wherein the synchronization step comprises: continuously extracting profile information regarding the shape or structure according to the longitudinal direction of the blood vessel from each of the multiple intravascular ultrasound data, calculating an optimal initial longitudinal shift value by comparing the signal similarity between the waveforms of each of the profile information, automatically aligning the initial alignment coordinate system between the multiple intravascular ultrasound data based on the optimal initial longitudinal shift value, and, when a calibration input for modifying the alignment reference point or changing the position is received, recalculating the position correspondence relationship between the multiple intravascular ultrasound data based on the modified reference point or changed position information to update the initial alignment coordinate system in real time. Claim 9 A computing system comprising one or more processors and one or more memories, and performing a multi-layer based search method using synchronization between multiple intravascular ultrasound data, comprising: a data acquisition unit for acquiring multiple intravascular ultrasound data, each comprising multiple frame cross-sectional images; and a synchronization unit for aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system. A computing system comprising: a display unit providing a user interface to a user terminal, the user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers or a whole slide that integrates and controls the search position of all of the plurality of layers; wherein, when a selection input of a specific position is received in any one of the plurality of search slides, the user interface displays the data of the specific position on the layer corresponding to the search slide, and based on the synchronization unit, automatically tracks the search slide position corresponding to each of the remaining other layers and dynamically changes and displays the intravascular ultrasound data of the remaining other layers together, or when a selection input of a specific position is received in the whole slide, automatically tracks the search position corresponding to each of the plurality of layers based on the synchronization unit and dynamically changes and displays the intravascular ultrasound data of the plurality of layers together based on the search position. Claim 10 delete Claim 11 A computing system comprising one or more processors and one or more memories, and performing a multi-layer based search method using synchronization between multiple intravascular ultrasound data, comprising: a data acquisition unit for acquiring multiple intravascular ultrasound data, each comprising multiple frame cross-sectional images; and a synchronization unit for aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system. A display unit providing a user terminal with a user interface comprising: a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen; a plurality of search slides that individually control the search position of each of the plurality of layers; or a total slide that integrally controls the search position of all of the plurality of layers; wherein each of the plurality of layers is configured to include a longitudinal view visualizing a longitudinal cross-section of the corresponding intravascular ultrasound data, a transverse view visualizing a cross-section of a specific frame, an analysis graph layout mapping the trend of change of quantitative indicators along the entire longitudinal direction of the blood vessel, a 3D chemogram view visualizing the distribution state of plaque by component, and a detailed report table listing extracted quantitative parameter information; wherein the analysis graph layout includes at least one of a plaque burden rate graph by length direction, a lumen diameter graph, and a lumen area graph; and wherein the display unit, in conjunction with the movement control of any one of the plurality of search slides, includes a search line of each of the longitudinal view included in all of the plurality of layers, a frame of the transverse view, a data pointer of the analysis graph layout, a position marker of the 3D chemogram view, and A computing system configured to simultaneously synchronize data rows of the above-mentioned detailed report table based on the same coordinate system to update them in real time. Claim 12 A computing system according to claim 9, wherein the synchronization unit performs the steps of: analyzing each image frame of the plurality of intravascular ultrasound data to detect a reference feature point including a common anatomical feature point or an artificial mark generated by a catheter device; setting the location of the reference feature point as a matching reference origin and calculating a longitudinal deformation mapping matrix to offset an error in the shooting tension speed between the plurality of data or an error in the stretching of the blood vessel caused by the patient's heartbeat; and applying the longitudinal deformation mapping matrix to the plurality of intravascular ultrasound data to generate an integrated longitudinal coordinate system in which the plurality of data are synchronized one-to-one and shared. Claim 13 A computing system comprising one or more processors and one or more memories, and performing a multi-layer based search method using synchronization between multiple intravascular ultrasound data, comprising: a data acquisition unit for acquiring multiple intravascular ultrasound data, each comprising multiple frame cross-sectional images; and a synchronization unit for aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system. A computing system comprising: a display unit providing a user terminal with a user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers or a whole slide that integrates and controls the search position of all the plurality of layers; wherein the user interface includes a alignment adjustment interface so that the user can visually check and fine-tune the coordinate system synchronization state aligned by the synchronization unit; and wherein, when a pullback playback synchronization command that links playback between multiple pullback layers acquired at different multiple points in time, or a calibration input that modifies an alignment reference point on a specific layer or changes the search position, is received through the alignment adjustment interface, the display unit controls the recalculation of the position correspondence relationship between the plurality of intravascular ultrasound data based on the modified reference point or changed position information to update in real time. Claim 14 A computing system comprising one or more processors and one or more memories, and performing a multi-layer based search method using synchronization between multiple intravascular ultrasound data, comprising: a data acquisition unit for acquiring multiple intravascular ultrasound data each comprising multiple frame cross-sectional images; a synchronization unit for aligning the multiple intravascular ultrasound data in the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system; and a display unit for providing a user terminal with a user interface including a plurality of layers that individually display information of each of the multiple intravascular ultrasound data on a screen, a plurality of search slides that individually control the search position of each of the multiple layers, or a total slide that integrally controls the search position of all the multiple layers; and the computing system further comprises: an event detection unit for detecting at least one interest region synchronization and annotation change event including the setting of a lesion interest region, a stent interest region, or a reference segment on a specific layer screen of any one of the multiple layers; and a projection visualization unit for backtracking the same coordinate system to calculate the longitudinal position coordinates of the point where the change event occurred, and projecting and visualizing by mapping the same annotation graphic layer in real time onto the corresponding position coordinates of the remaining other layers. Claim 15 A computer-readable storage medium for implementing a multi-layer based search method using synchronization between multiple intravascular ultrasound data performed in a computing system comprising one or more processors and one or more memories, wherein the computer-readable storage medium comprises computer-executable instructions that cause the computing system to perform the following steps, the following steps comprising: a data acquisition step of acquiring multiple intravascular ultrasound data each comprising a plurality of frame cross-sectional images; and a synchronization step of aligning the multiple intravascular ultrasound data along the longitudinal direction of the blood vessel to synchronize them so as to share the same coordinate system. A computer-readable storage medium comprising: a display step of providing a user interface to a user terminal, the user interface including a plurality of layers that individually display information of each of the plurality of intravascular ultrasound data on a screen, and a plurality of search slides that individually control the search position of each of the plurality of layers or a whole slide that integrally controls the search position of all of the plurality of layers; wherein, when a selection input of a specific position is received in any one of the plurality of search slides, the user interface displays the data of the specific position on a layer corresponding to the search slide, and based on the synchronization step, automatically tracks the search slide position corresponding to each of the remaining other layers and dynamically changes and displays the intravascular ultrasound data of the remaining other layers together, or when a selection input of a specific position is received in the whole slide, automatically tracks the search position corresponding to each of the plurality of layers based on the synchronization step and dynamically changes and displays the intravascular ultrasound data of the plurality of layers together based on the search position.

Citation Information

Patent Citations

  • Method and system for localizing a body cavity medical device - Patents.com

    JP2024501364A

  • Method, Device and recording Medium for Predicting Stent Procedure to Coronary Artery through Ultrasound Image-Based Deap Learning

    KR102546291B1

  • Intraluminal ultrasound navigation guidance and associated devices, systems, and methods

    US12232907B2

  • Vascular data processing and image registration systems, methods, and apparatuses

    US9351698B2

  • Coregistered intravascular and angiographic images

    US20140276085A1