Graphical user interface for an automated lesion assessment system using intravascular ultrasound

Abstract

The present disclosure provides a graphical user interface (GUI) configured to convey information about IVUS images and lesion assessment and allow a user to manipulate the information. The GUI can be generated to include cross-sectional views without post-recording assessment of the IVUS images or to show assessment after navigating frames of the IVUS images.

Description

[Technical Field]

[0001]

[0001] The present disclosure relates generally to intravascular ultrasound (IVUS) imaging systems. In particular, but not exclusively, the present disclosure relates to an improved graphical user interface for IVUS imaging systems.

[0002] This application claims the benefit of U.S. Provisional Patent Application No. 63 / 406,353, filed September 14, 2022, the disclosure of which is incorporated herein by reference. [Background technology]

[0002] Patient-insertable ultrasound devices have proven diagnostic capabilities for a variety of diseases and disorders. For example, intravascular ultrasound (IVUS) imaging systems are used as an imaging modality to diagnose blocked blood vessels and provide information to assist physicians in selecting and placing stents and other devices to restore or increase blood flow.

[0003] An IVUS imaging system includes a control module (having a pulse generator, image acquisition and processing components, and a monitor), a catheter, and a transducer disposed within the catheter. The catheter containing the transducer is positioned within a lumen or cavity in or adjacent to a region to be imaged, such as a blood vessel wall or patient tissue adjacent to the blood vessel wall. The pulse generator within the control module generates electrical pulses that are delivered to the transducer and converted into acoustic pulses that are transmitted through the patient tissue. The patient tissue (or other structure) reflects the acoustic pulses, and the reflected pulses are absorbed by the transducer and converted into electrical pulses. The converted electrical pulses are delivered to the image acquisition and processing components and converted into an image that can be displayed on a monitor.

[0004] However, it can be difficult for physicians to visualize the complete anatomy of a patient's lumen (e.g., blood vessel) from raw IVUS images. For example, it can be difficult to determine the overall plaque burden, the appropriate size (e.g., diameter and / or length) of a stent to use in correcting any stenosis within the lumen, and where to seat the stent. Therefore, there is a need for a user interface, particularly a graphical user interface, that conveys information from the IVUS system to the user. Summary of the Invention

[0005] This Summary is provided to introduce a selection of concepts in a simplified form that are further described in the Detailed Description. This Summary is not intended to necessarily identify key features or essential features of the claimed subject matter, nor is it intended to aid in determining the scope of the claimed subject matter.

[0006] Generally, the present disclosure provides an improvement to computing devices, particularly IVUS guidance systems, in that it provides a graphical user interface configured to convey the wealth of information generated by current IVUS systems. For example, IVUS systems may include machine learning capabilities for processing and analyzing signals generated during IVUS runs. Such information may include automated detection of lesions, lesion-related keyframes, stents, etc. The improved graphical user interface provided herein includes the ability to display such information and provide a way for a user to manipulate the information as desired.

[0007] In some implementations, the present disclosure is embodied as a method, such as a method for an intravascular ultrasound (IVUS) imaging system, that includes receiving a series of intravascular ultrasound (IVUS) images of a patient's blood vessel, the series including a plurality of frames, generating a first graphical user interface (GUI) component including a display of a cross-sectional view of one of the frames, generating a second GUI component including a display of at least one menu option, generating a third GUI component including a display of at least one layout option, generating a fourth GUI component including a display of a navigation input with an evaluation button, generating a GUI including the first, second, third, and fourth GUI components, the first GUI component being disposed between the second GUI component and the third GUI component, and rendering the GUI for display on a display.

[0008] Alternatively or additionally, any embodiment of the above method may include generating the fourth GUI component including a representation of a distal bracket and a proximal bracket along with a representation of the evaluation button, the distal bracket and the proximal bracket being movable.

[0009] Alternatively or additionally, any of the embodiments of the above methods may include receiving instructions via an input device to move the distal bracket, the proximal bracket, or the distal bracket and the proximal bracket.

[0010] Alternatively or additionally, any embodiment of the above method may include regenerating the fourth GUI component including a graphical representation of the moved distal bracket, the moved proximal bracket, or the moved distal and proximal brackets and the evaluation button.

[0011] Alternatively or additionally, any embodiment of the above method may include the evaluation button being disposed between the proximal bracket and the distal bracket. Alternatively or additionally, any embodiment of the above method may include determining a distance between the distal bracket and the proximal bracket and generating a display of the evaluation button based on the distance.

[0012] Alternatively or additionally, any embodiment of the above method may include determining whether the distance is greater than a threshold, and based on a determination that the distance is greater than the threshold, generating a display of the rating button including a graphical representation including at least an icon and text.

[0013] Alternatively or additionally, any embodiment of the above method may include generating a display of the rating button that includes a graphical representation that includes either text or an icon, but not both, based on a determination that the distance is less than or equal to the threshold.

[0014] Alternatively or additionally, any embodiment of the above method may include receiving an indication via an input device that the Evaluate button has been clicked, and generating a fifth GUI component including a display of the distal bracket, the proximal bracket, a minimum area, a vascular profile view, and a mirror of the vascular profile view.

[0015] Alternatively or additionally, any embodiment of the above method may include wherein the vascular profile view includes a display of a boundary of the vessel and a boundary of a lumen within the vessel represented along a longitudinal axis of the vessel.

[0016] Alternatively or additionally, any of the embodiments of the above method may include receiving an indication of the vascular boundary and the lumen boundary for each of the plurality of frames, generating a graphical representation of the vascular boundary and the lumen boundary based on the indication, generating the vascular profile view including the graphical representation of the vascular boundary and the lumen boundary, and mirroring the vascular profile view about a central longitudinal axis to generate a mirror of the vascular profile view.

[0017] Alternatively or additionally, any embodiment of the method may include receiving the indication of the vessel boundary and the lumen boundary from a machine learning automated boundary detection model, receiving an indication of a confidence level of the vessel boundary for each of the plurality of frames, determining whether the confidence level for each of the plurality of frames is less than or equal to a threshold confidence level, generating the graphical representation of the vessel boundary for a first portion of the central longitudinal axis, the graphical representation including a first graphical representation based on a determination that the confidence level for the frames associated with the first portion is less than or equal to the threshold confidence level, and generating the graphical representation of the vessel boundary for a second portion of the central longitudinal axis, the graphical representation including a second graphical representation based on a determination that the confidence level for the frames associated with the second portion is not less than or equal to the threshold confidence level, wherein the second graphical representation is different from the first graphical representation.

[0018] Alternatively or additionally, any embodiment of the above method may include the first graphical representation including a first color, a first width, or a first line style, and the second graphical representation including a second color, a second width, or a second line style.

[0019] In some implementations, the present disclosure is embodied as an apparatus including a processor coupled to a memory, the memory including a plurality of instructions executable by the processor, the processor configured to couple to an intravascular ultrasound (IVUS) imaging system and configured to execute the plurality of instructions, which when executed cause the processor to perform a method of any combination of the above-described embodiments.

[0020] In some implementations, the present disclosure is embodied as at least one machine-readable storage device comprising a plurality of instructions that, in response to being executed by a processor of an intravascular ultrasound (IVUS) imaging system, cause the processor to perform the method of any combination of the above-described embodiments.

[0021] In some implementations, the present disclosure is embodied as an apparatus for an intravascular ultrasound (IVUS) imaging system, the apparatus comprising: a display; an interface configured to couple to an IVUS catheter; a processor coupled to the interface and the display; and a memory device containing a plurality of instructions that, when executed by the processor, cause the IVUS imaging system to receive a series of intravascular ultrasound (IVUS) images of a patient's blood vessel, the series comprising a plurality of frames; generate a first graphical user interface (GUI) component including a display of a cross-sectional view of one of the plurality of frames; generate a third GUI component including a display of at least one menu option; generate a fourth GUI component including a display of a navigation input with an evaluation button; generate a GUI including the first, second, third, and fourth GUI components, the first GUI component being disposed between the second and third GUI components; render the GUI; and transmit the rendered graphical information to a display.

[0022] Alternatively or additionally, in any of the above device embodiments, the fourth GUI component may include a representation of a distal bracket and a proximal bracket along with a representation of the evaluation button, the distal bracket and the proximal bracket being movable.

[0023] Alternatively or additionally, in any of the embodiments of the above device, the memory device may further include instructions that, when executed by the processor, cause the IVUS imaging system to receive instructions via an input device to move the distal bracket, the proximal bracket, or the distal bracket and the proximal bracket.

[0024] Alternatively or additionally, in any of the embodiments of the above device, the memory device may further include instructions that, when executed by the processor, cause the IVUS imaging system to regenerate the fourth GUI component including a graphical representation of the moved distal bracket, the moved proximal bracket, or the moved distal and proximal brackets and the evaluation button.

[0025] Alternatively or additionally in any embodiment of the above device, the evaluation button is located between the proximal bracket and the distal bracket. Alternatively or additionally, in any of the above device embodiments, the memory device may further include instructions that, when executed by the processor, cause the IVUS imaging system to determine a distance between the distal bracket and the proximal bracket and generate a display of the evaluation button based on the distance.

[0026] Alternatively or additionally, in any of the above device embodiments, the memory device may further include instructions that, when executed by the processor, cause the IVUS imaging system to determine whether the distance is greater than a threshold value and, based on a determination that the distance is greater than the threshold value, generate a display of the evaluation button including a graphical representation including at least an icon and text.

[0027] Alternatively or additionally, in any of the embodiments of the above device, the memory device may further include instructions that, when executed by the processor, cause the IVUS imaging system to generate a display of the evaluation button that includes a graphical representation that includes either text or an icon, but not both, based on a determination that the distance is less than or equal to the threshold.

[0028] In some implementations, the present disclosure is embodied as at least one machine-readable storage device comprising: a plurality of instructions that, when executed by a processor of an intravascular ultrasound (IVUS) imaging system, cause the processor to receive a series of intravascular ultrasound (IVUS) images of a patient's blood vessel, the series comprising a plurality of frames; generate a first graphical user interface (GUI) component comprising a display of a cross-sectional view of one of the plurality of frames; generate a third GUI component comprising a display of at least one menu option; generate a fourth GUI component comprising a display of a navigation input with an evaluation button; generate a GUI comprising the first, second, third, and fourth GUI components, wherein the first GUI component is disposed between the second and third GUI components; and render the GUI for display on a display.

[0029] Alternatively or additionally, in any embodiment of the at least one machine-readable storage device described above, the instructions may further cause the processor, in response to being executed by the processor, to receive an indication via the input device that the Evaluate button has been clicked, and generate a fifth GUI component including a display of the distal bracket, the proximal bracket, a minimum area, a vascular profile view, and a mirror of the vascular profile view.

[0030] Alternatively or additionally, in any embodiment of the at least one machine-readable storage device, the vascular profile view may include a representation of the boundary of the vessel and the boundary of the lumen within the vessel represented along the longitudinal axis of the vessel.

[0031] Alternatively or additionally, in any of the embodiments of the at least one machine-readable storage device described above, the instructions may further, in response to being executed by the processor, cause the processor to receive an indication of the vascular boundary and the lumen boundary for each of the plurality of frames, generate a graphical representation of the vascular boundary and the lumen boundary based on the indication, generate the vascular profile view including the graphical representation of the vascular boundary and the lumen boundary, and mirror the vascular profile view about a central longitudinal axis to generate a mirror of the vascular profile view.

[0032] Alternatively or additionally, in any embodiment of the at least one machine-readable storage device described above, the instructions, responsive to being executed by the processor, may further cause the processor to receive the representation of the vessel boundary and the lumen boundary from a machine learning automated boundary detection model, receive an indication of a confidence level of the vessel boundary for each of the plurality of frames, determine whether the confidence level for each of the plurality of frames is less than or equal to a threshold confidence level, generate the graphical representation of the vessel boundary for a first portion of the central longitudinal axis, the graphical representation including a first graphical representation based on a determination that the confidence level for the frame associated with the first portion is less than or equal to the threshold confidence level, and generate the graphical representation of the vessel boundary for a second portion of the central longitudinal axis, the graphical representation including a second graphical representation based on a determination that the confidence level for the frame associated with the second portion is not less than or equal to the threshold confidence level, wherein the second graphic representation is different from the first graphic representation.

[0033] Alternatively or additionally, in any embodiment of the at least one machine-readable storage device described above, the first graphical representation may include a first color, a first width, or a first line style, and the second graphical representation includes a second color, a second width, or a second line style. [Brief explanation of the drawings]

[0034] [Figure 1] FIG. 1 shows an IVUS imaging system. [Figure 2] FIG. 2 shows an angiographic image of a blood vessel. [Figure 3A] FIG. 3A shows a longitudinal view of an IVUS image. [Figure 3B] FIG. 3B shows a cross-sectional view of a frame of an IVUS image. [Figure 4] FIG. 4 shows an IVUS image visualization system. [Figure 5A] FIG. 5A shows a first graphical interface for an IVUS imaging system. [Figure 5B] FIG. 5B shows a second graphical interface for an IVUS imaging system. [Figure 5C] FIG. 5C shows a third graphical interface for an IVUS imaging system. [Figure 6A] FIG. 6A shows a fourth graphical interface for an IVUS imaging system. [Figure 6B] FIG. 6B shows a fifth graphical interface for an IVUS imaging system. [Figure 7A] FIG. 7A shows a first graphical component of a graphical interface for an IVUS imaging system. [Figure 7B] FIG. 7B shows a second graphical component of a graphical interface for an IVUS imaging system. [Figures 8A-8D]8A, 8B, 8C, and 8D show multiple versions of a third graphical component of a graphical interface for an IVUS imaging system. [Figure 9A] FIG. 9A shows a sixth graphical interface for an IVUS imaging system. [Figure 9B] FIG. 9B shows a seventh graphical interface for an IVUS imaging system. [Figure 10] FIG. 10 shows an eighth graphical interface for an IVUS imaging system. [Figure 11A] FIG. 11A shows a third graphical component of a graphical interface for an IVUS imaging system. [Figure 11B] FIG. 11B shows a fourth graphical component of the graphical interface for an IUS imaging system. [Figures 12A-12C] 12A, 12B, and 12C show multiple versions of a fifth graphical component of a graphical interface for an IVUS imaging system. [Figure 13] FIG. 13 shows a sixth graphical component of the graphical interface for an IVUS imaging system. [Figures 14A-14B] 14A and 14B show multiple versions of the seventh graphical component of a graphical interface for an IVUS imaging system. [Figure 15] FIG. 15 shows a ninth graphical interface for an IVUS imaging system. [Figure 16] FIG. 16 shows a tenth graphical interface for an IVUS imaging system. [Figure 17] FIG. 17 shows the logic flow for generating a graphical interface for an IVUS imaging system. [Figure 18] FIG. 18 illustrates a computer-readable storage medium. [Figure 19] Figure 19 shows a schematic diagram of the machine. DETAILED DESCRIPTION OF THE INVENTION

[0035] The foregoing has outlined broadly the features and technical advantages of the present disclosure so that the detailed description thereof may be better understood. It will be appreciated by those skilled in the art that the disclosed embodiments may be readily utilized as a basis for modifying or designing other structures for carrying out the same purposes of the present disclosure. The novel features of the present disclosure, both as to its organization and operation, together with further objects and advantages, may be better understood from the following description when considered in conjunction with the accompanying drawings. It should be noted, however, that each drawing is provided for purposes of illustration and description and is not intended to limit the disclosure. To readily identify an element or description of a process, the most significant digit(s) in a reference number refers to the figure in which the element is first introduced.

[0036] As noted above, the present disclosure relates to IVUS systems and automated evaluation of IVUS images. In particular, the present disclosure provides a graphical user interface (GUI) configured to convey information related to IVUS images and lesion evaluation and to allow a user to manipulate the information. Accordingly, the following describes an exemplary IVUS imaging system, a patient's vessel, and a series of IVUS images.

[0037] Suitable IVUS imaging systems include, but are not limited to, one or more transducers disposed at the distal end of a catheter configured and arranged for percutaneous insertion into a patient. Examples of IVUS imaging systems with catheters can be found, for example, in U.S. Patent Nos. 7,246,959, 7,306,561, and 6,945,938, as well as U.S. Patent Application Publication Nos. 2006 / 0100522, 2006 / 0106320, 2006 / 0173350, 2006 / 0253028, 2007 / 0016054, and 2007 / 0038111, all of which are incorporated herein by reference.

[0038] 1 illustrates one embodiment of an IVUS imaging system 100. The IVUS imaging system 100 includes a catheter 102 that can be coupled to a control system 104. The control system 104 can include, for example, a processor 106, a pulse generator 108, and a drive unit 110. The pulse generator 108 forms electrical pulses that can be input to one or more transducers (not shown) disposed within the catheter 102.

[0039] In some embodiments, mechanical energy from the drive unit 110 may be used to drive an imaging core (not shown) disposed within the catheter 102. In at least some embodiments, electrical signals transmitted from one or more transducers may be input to the processor 106 for processing. In at least some embodiments, the processed electrical signals from the one or more transducers may be used to form a series of images, which are described in more detail below. For example, a scan converter may be used to map scan line samples (e.g., radial scan line samples, etc.) onto a two-dimensional Cartesian grid, which may be used as the basis for a series of IVUS images that may be displayed to a user.

[0040] In at least some embodiments, the processor 106 may also be used to control the functions of one or more of the other components of the control system 104. For example, the processor 106 may be used to control the frequency and / or duration of the electrical pulses transmitted from the pulse generator 108 and the rotation speed of the imaging core by the drive unit 110. Also, if the IVUS imaging system 100 is configured for automatic pullback, the drive unit 110 may control the speed and / or length of the pullback.

[0041] 2 shows an image 200 of a patient's blood vessel 202. An IVUS imaging system (e.g., IVUS imaging system 100, etc.) is used to obtain a series of images or "recordings" of a blood vessel, such as blood vessel 202. For example, an IVUS catheter (e.g., catheter 102) is inserted into blood vessel 202, and the recordings or series of IVUS images are obtained as catheter 102 is withdrawn from distal end 204 to proximal end 206. Catheter 102 may be withdrawn manually or automatically (e.g., under the control of drive unit 110, etc.).

[0042] 3A and 3B show two-dimensional (2D) representations of IVUS images of a blood vessel 202. For example, FIG. 3A shows multiple IVUS images 300a of a longitudinal view of an IVUS recording of the blood vessel 202 between the proximal end 206 and the distal end 204.

[0043] 3B shows an image frame 300b of an on-axial (or short-axis or cross-sectional) view of the blood vessel 202 at the location 302. In other words, the image frame 300b is a frame or an image from a series of IVUS images that may be acquired between the distal end 204 and the proximal end 206, as described herein. As discussed above, the present disclosure provides systems and techniques for processing raw IVUS images to identify regions of interest, such as, for example, start and end points that include frames of interest within a series of IVUS images.

[0044] For example, IVUS image 300a shows an entire series of IVUS images taken from blood vessel 202 between distal end 204 and proximal end 206. IVUS images may be acquired at several stages of a percutaneous coronary intervention (PCI). That is, IVUS may be acquired pre-PCI, pre-PCI, or post-PCI. For example, IVUS may be employed to acquire images of the condition of blood vessel 202 before a stent is implanted. In such an example, automated image evaluation (e.g., vessel border detection, lumen border detection, plaque burden detection, keyframe identification, stent size and landing zone recommendation, stent expansion estimation, etc.) may be performed. This represents a significant amount of information to convey to a user. Furthermore, the prior art does not provide for communicating this information with the IVUS images (e.g., IVUS images 300a and 300b) so that a user can manipulate the automated evaluation (e.g., keyframes, etc.). Thus, the present disclosure provides the advantage of an improved GUI for better understanding and manipulating image features.

[0045] FIG. 4 illustrates an IVUS image visualization system 400 according to some embodiments of the present disclosure. Generally, the IVUS image visualization system 400 is a system for processing, annotating, and presenting multiple IVUS images. The IVUS image visualization system 400 may be implemented in a commercially available IVUS guidance or navigation system, such as the AVVIGO® guidance system available from Boston Scientific®. The present disclosure provides advantages over conventional IVUS navigation systems in that it reduces the time required to treat a patient through an improved GUI. For example, the present disclosure may be implemented in an IVUS navigation system to efficiently communicate IVUS information to a user and allow the user to manipulate the information.

[0046] In some embodiments, the IVUS image visualization system 400 may be implemented as part of the control system 104. Alternatively, the control system 104 may be implemented as part of the IVUS image visualization system 400. As shown, the IVUS image visualization system 400 includes a computing device 402. Optionally, the IVUS image visualization system 400 includes the IVUS imaging system 100 and a display 404.

[0047] The computing device 402 may be any of a variety of computing devices. In some embodiments, the computing device 402 may be incorporated into and / or implemented by the console of the display 404. In some embodiments, the computing device 402 may be a workstation or server communicatively coupled to the IVUS imaging system 100 and / or the display 404. In still other embodiments, the computing device 402 may be provided by a cloud-based computing device, such as a computing means as a service system accessible via a network (e.g., the Internet, an intranet, a wide area network, etc.). The computing device 402 may include a processor 406, a memory 408, input and / or output (I / O) devices 410, a network interface 412, and an IVUS imaging system acquisition circuit 414.

[0048] Processor 406 may include circuitry or processor logic, such as, for example, any of various commercially available processors. In some examples, processor 406 may include multiple processors, a multithreaded processor, a multi-core processor (where multiple cores may coexist on the same die or may be separate), and / or some other type of multi-processor architecture in which multiple physically separate processors are linked in some way. Also, in some examples, processor 406 may include a graphics processing portion, as well as dedicated memory, multithreaded processing, and / or some other parallel processing capability. In some examples, processor 406 may be an application-specific integrated circuit (ASIC) or a field-programmable integrated circuit (FPGA).

[0049] Memory 408 may include logic portions, portions of which may include an array of integrated circuits to form non-volatile memory or a combination of non-volatile and volatile memory for persistent storage of data. Memory 408 may be based on any of a variety of technologies. In particular, the array of integrated circuits included in memory 120 may be arranged to form one or more types of memory, such as, for example, dynamic random access memory (DRAM), NAND memory, NOR memory, etc.

[0050] I / O device 410 may be any of a variety of devices for receiving input and / or providing output. For example, I / O device 410 may include a keyboard, a mouse, a joystick, a foot pedal, a display, a touch-enabled display, a tactile feedback device, an LED, etc.

[0051] The network interface 412 may include logic and / or functionality to support communications interfaces. For example, the network interface 412 may include one or more interfaces operating according to various communications protocols or standards for communicating directly or over a network communications link. Direct communication may occur through the use of communications protocols or standards set forth in one or more industry standards (including derivatives and variations). For example, the network interface 412 may facilitate communication over buses such as Peripheral Component Interconnect Express (PCIe®), Non-Volatile Memory Express (NVMe®), Universal Serial Bus (USB), System Management Bus (SMBus®), SAS (e.g., Serial Attached Small Computer System Interface (SCSI)), and Serial AT Attachment (SATA) interfaces. The network interface 412 may also include logic and / or functionality to enable communication over various wired or wireless network standards (e.g., 802.11 communications standards). For example, the network interface 412 may be configured to support wired communications protocols or standards such as Ethernet. As another example, the network interface 412 may be configured to support wireless communication protocols or standards such as Wi-Fi, Bluetooth, ZigBee, LTE, 5G, etc.

[0052] The IVUS imaging system acquisition circuitry 414 may include circuitry including custom-manufactured or specially programmed circuitry configured to send and receive signals to and from the IVUS imaging system 100 including instructions for an IVUS performance, a display of a series of IVUS images, or a display of one or more frames of an IVUS image.

[0053] The memory 408 may include a plurality of instructions 416. During operation, the processor 406 may execute the instructions 416 to cause the computing device 402 to receive a record of an "IVUS run" (e.g., from the IVUS imaging system 100) and store the record in the memory 408 as an IVUS image 418. For example, the processor 406 may execute the instructions 416 to receive from the IVUS imaging system 100 an information element including a representation of an IVUS image acquired by the catheter 102 while the catheter 102 is being pulled back from the distal end 204 to the proximal end 206. The IVUS image includes a representation of the anatomy and / or structure of the blood vessel 202, including the vessel wall and plaque. The IVUS image 418 may be stored in a variety of image formats, including a representation of the blood vessel 202, or in a non-image format or data structure. Also, the IVUS image 418 includes several "frames" or individual images that, when represented collinearly, can be used to form an image of the blood vessel 202, for example, as represented by the IVUS images 300a and / or 300b.

[0054] The present disclosure provides for generating a graphical information element 420 from an IVUS image 418 and generating a GUI 422 that is displayed on the display 404 based on the graphical information element 420. The processor 406 may be further configured to generate an assessment 424 based on the IVUS image 418 by executing the instructions 416, as will be described in more detail below. Generally, the assessment may include vessel boundary detection, lumen boundary detection, plaque burden determination, key frame identification, and distance between key frames, among other assessments. Thus, in some embodiments, the graphical information element 420 may be generated based on the IVUS image 418 and the assessment 424.

[0055] Processor 406 may also be configured to execute instructions 416 to receive operations 426 that include modifications to assessment 424. For example, processor 406 may execute instructions 416 to receive modifications to vessel and / or lumen boundaries, keyframe locations, etc., and store the modifications as operations 426. In response to receiving operations 426, processor 406 may execute instructions 416 to regenerate graphic information elements 420 based on IVUS images 418, assessment 424, and / or operations 426.

[0056] 5A illustrates a GUI 500a that may be generated in accordance with some embodiments of the present disclosure. For example, the GUI 500a may be generated as a GUI 422 by the IVUS image visualization system 400 and displayed on the display 404. As illustrated, the GUI 500a includes several graphic information elements 420, such as menus 502a and 502b, a cross-sectional view 504, and a vascular navigation 506. Furthermore, the vascular navigation 506 includes a single-frame ALA button 508. In some embodiments, the processor 406 may be configured to generate the GUI 500a by executing instructions 416 upon completion of an IVUS recording (or IVUS run). For example, in response to receiving an IVUS image 418, the processor 406 may generate the GUI 500a by executing instructions 416. Notably, the GUI 500a does not include a graphic information element 420 having an indication of the assessment 424. For example, the assessment 424 (e.g., automated lesion assessment output such as vessel boundary, lumen boundary, keyframes, etc.) is not displayed until the user selects (e.g., activates, clicks, etc.) the single frame ALA button 508. Thus, the GUI 500a provides the user with as large an unobstructed view as possible of the cross-sectional view 504 of the IVUS image 418.

[0057] Menu 502a may include GUI inputs such as buttons, drop down menus, selection icons, etc. Menu 502a may include GUI input options for selecting measurement and annotation tools, length tools, correction reset buttons, etc. Menu 502b may include GUI inputs such as buttons, drop down menus, selection icons, etc. Menu 502b may include GUI input options for selecting views related to the view of the IVUS image, layout options, annotations, navigation, dynamic review options, computing device status, etc.

[0058] The cross-sectional view 504 may include a cross-sectional view of one IVUS image 418 (e.g., a frame, etc.) of the plurality of IVUS images 418. For example, the cross-sectional view 504 may include image frame 300b. Examples of the vascular navigation 506 are described below. Generally, the vascular navigation 506 may include a navigation slider for navigating the IVUS image 418 associated with the cross-sectional view 504. That is, as the slider is moved, the image displayed in the cross-sectional view 504 changes to match the position indicated by the slider. Additionally, in some examples, the positions of distal and proximal frames (e.g., distal and proximal key frames) linearly along the series of IVUS images 418 are indicated (e.g., by brackets, etc.). Additionally, the vascular navigation 506 may include a single-frame ALA button 508. These and other embodiments of the vascular navigation 506 are described below.

[0059] 5B illustrates a GUI 500b that may be generated in accordance with some embodiments of the present disclosure. For example, the GUI 500b may be generated as the GUI 422 by the IVUS image visualization system 400 and displayed on the display 404. As shown, the GUI 500b includes several graphic information elements 420 similar to those of the GUI 500a. Among other things, the GUI 500b further includes a vessel length view 510. The vessel length view 510 may include a longitudinal view of the vessel (e.g., the vessel 202) represented by the IVUS image 418. For example, the vessel length view 510 may include the IVUS image 300a.

[0060] 5C illustrates a GUI 500c that may be generated in accordance with some embodiments of the present disclosure. For example, the GUI 500c may be generated as the GUI 422 by the IVUS image visualization system 400 and displayed on the display 404. As illustrated, the GUI 500c includes several graphic information elements 420 similar to those of the GUIs 500a and 500b. Among other things, the GUI 500c includes multiple cross-sectional views. The GUI 500c includes a side-by-side cross-sectional dual view 512a and a cross-sectional dual view 512b. The cross-sectional dual views 512a and 512b may be similar to the cross-sectional view 504 and may include a cross-sectional view of one IVUS image 418 (e.g., a frame) of the multiple IVUS images 418. For example, the cross-sectional dual view 512a may include an image similar to the image frame 300b, while the cross-sectional dual view 512b may include an image similar to the image frame 300b but based on another frame of the IVUS images 418. Additionally, the GUI 500c may optionally include a dual view vascular navigation 514 including multiple sliders (described below) that provide navigation and visualization of each of the cross-sectional dual views 512a and 512b longitudinally along the IVUS image 418.

[0061] 6A illustrates a GUI 600a that may be generated in accordance with some embodiments of the present disclosure. For example, the GUI 600a may be generated as a GUI 422 by the IVUS image visualization system 400 and displayed on the display 404. In some embodiments, in response to the completion of an IVUS recording (e.g., receiving an IVUS image 418), the processor 406 may execute instructions 416 to generate a graphical information element 420 and the GUI 600a based on the graphical information element 420.

[0062] As shown, GUI 600a includes menus 502a and 502b positioned on either side of (or framing) cross-sectional view 504 and vascular navigation 506. GUI 600a may include menu 502a, which itself includes length measurement input 602, measurement and annotation input 604, single-frame ALA button 606, bookmark button 608, and snapshot button 610. GUI 600a may also include menu 502b, which itself includes layout button 612, view button 614, dynamic review navigation 616, and tablet status 618.

[0063] In some examples, the length measurement input 602 may include a drop-down menu with multiple options for (1) indicating no length, (2) indicating the length "between brackets" (e.g., between keyframe brackets, etc.), (3) indicating the length "between marks" (e.g., between a bookmark and brackets, etc.), (4) indicating the length "to the current frame" (e.g., between a scrubber or frame slider indicating the current frame position and a bookmark or bracket, etc.), or (5) indicating the length between dual frames (e.g., as described in more detail below). In some examples, the measurement and annotation input 604 may include multiple drop-down menus and / or buttons for selecting from several options for annotating and / or measuring aspects of the current frame (e.g., lumen boundary or vessel boundary, etc.) or annotating the current frame (e.g., adding text).

[0064] The vascular navigation 506 may operate to provide an ALA predicted boundary on the current frame, and if an ALA boundary has already been indicated and manually corrected, the vascular navigation 506 may operate to reset the boundary to the originally predicted boundary.

[0065] The layout button 612 may be configured to change the display framed between the menus 502a, 502b to a single cross-sectional view (e.g., cross-sectional view 504) and vascular navigation 506, a single cross-sectional view (e.g., cross-sectional view 504) and vascular navigation 506 together with a longitudinal view of the vessel (e.g., such as vascular navigation 506), or a dual cross-sectional view (described in more detail below).

[0066] 6B illustrates a GUI 600b that may be generated in accordance with some embodiments of the present disclosure. For example, the GUI 600b may be generated by the IVUS image visualization system 400 as the GUI 422 and displayed on the display 404. In some embodiments, in response to completing an IVUS recording (e.g., receiving an IVUS image 418), the processor 406 may execute instructions 416 to generate the graphical information element 420 and the GUI 600b based on the graphical information element 420.

[0067] GUI 600b may be similar to GUI 600a, with the notable difference that GUI 600b includes a vessel length view 510. In some embodiments, GUI 600b may be generated in response to a user selecting a length view layout option within layout button 612. As can be seen, vessel length view 510 includes a depiction of IVUS image 418 longitudinally disposed between cross-sectional view 504 and vessel navigation 506.

[0068] 7A and 7B illustrate examples of vascular navigation 506. In some embodiments, the processor 406 may execute the instructions 416 to generate a graphic information element 420 including a representation of the vascular navigation 506 depending on whether the IVUS image 418 is acquired with automatic pullback or manual pullback. For example, FIG. 7A illustrates vascular navigation 700a according to some embodiments of the present disclosure. The IVUS image visualization system 400 may be configured to generate the vascular navigation 700a as the vascular navigation 506 when the IVUS image 418 corresponds to an automatic IVUS performance. In such embodiments, the processor 406 may execute the instructions 416 to generate the graphic information element 420 and use the graphic information element 420 to generate the vascular navigation 700a. The vascular navigation 700a includes the vascular navigation 506, a distal bracket end 704a, a proximal bracket end 702a, a single-frame ALA button 508, a slider axis 706, and a view slider 708.

[0069] 7B illustrates vascular navigation 700b according to some embodiments of the present disclosure. The IVUS image visualization system 400 may be configured to generate vascular navigation 700b as vascular navigation 506 when the IVUS image 418 corresponds to a manual IVUS performance. In such an embodiment, the processor 406 may execute the instructions 416 to generate the graphic information element 420 and generate vascular navigation 700b using the graphic information element 420. The vascular navigation 700b includes the vascular navigation 506, a distal bracket end 704b, a proximal bracket end 702b, a single-frame ALA button 508, and a view slider 708.

[0070] Generally, vascular navigation 700a and vascular navigation 700b are similar except for the primary difference in look and feel, which indicates whether the IVUS image is from an automatic or manual pullback operation. For example, proximal bracket end 702a and distal bracket end 704a may include angled brackets to indicate an automatic pullback for IVUS image 418, while proximal bracket end 702b and distal bracket end 704b may include 90-degree brackets to indicate a manual pullback.

[0071] In some embodiments, the proximal bracket ends 702a, 702b and the distal bracket ends 704a, 704b may have initial positions corresponding to distal and proximal keyframes (e.g., based on an automated lesion assessment program, etc.). The processor 406 may execute instructions 416 to enable user manipulation of the proximal bracket ends 702a, 702b and the distal bracket ends 704a, 704b (e.g., via the I / O device 410). For example, a user can drag one of the brackets (e.g., via a touchscreen, via a mouse, etc.) to change the position of the keyframe represented by that bracket. In response to receiving an instruction to change the position, the processor 406 may execute instructions 416 to move the view slider 708 to the bracket position to track the bracket's movement. In this way, the cross-sectional views (and longitudinal views, if enabled) will track the bracket's movement.

[0072] Additionally, the vascular navigation system 700a includes a slider axis 706 that may include an indication (eg, a scale, etc.) of the distance of the IVUS frame from the distal end (or the start of the IVUS run).

[0073] 8A-8D show examples of graphical information elements 420 that may be generated to form graphical components of vascular navigation 506. These figures show a single-frame ALA button 508 and options for the graphical representation of the single-frame ALA button 508 based on the distance between the proximal bracket end 702 a and the distal bracket end 704 a. These figures show the changes to the single-frame ALA button 508 as the proximal bracket end 702 a and the distal bracket end 704 a are moved (or automatically positioned) closer to one another as outlined above.

[0074] 8A illustrates a graphical information element 800a according to some embodiments of the present disclosure. The processor 406 may execute instructions 416 to generate a graphical information element 420 including a display of a representation of the graphical information element 800a, including the proximal bracket end 702a (or the proximal bracket end 702b), the distal bracket end 704a (or the distal bracket end 704b), and the single-frame ALA button 508. In some embodiments, the processor 406 may execute instructions 416 to determine the distance between the brackets and select the graphical representation of the single-frame ALA button 508 based on the determined distance. For example, if the distance is greater than a threshold, the processor 406 may execute instructions 416 to select the single-frame ALA button 508 including the graphical representation of text and an icon.

[0075] 8B and 8C show graphical information element 800b and graphical information element 800c, respectively. Processor 406 may execute instructions 416 to generate graphical information element 420 including a display of a representation of graphical information element 800b or graphical information element 800c, including proximal bracket end 702a (or proximal bracket end 702b), distal bracket end 704a (or distal bracket end 704b), and single-frame ALA button 508. In some embodiments, processor 406 may execute instructions 416 to determine the distance between the brackets and select the graphical representation of single-frame ALA button 508 based on the determined distance. For example, if the distance is greater than a threshold, processor 406 may execute instructions 416 to select single-frame ALA button 508 including the graphical representation of text and an icon.

[0076] 8D illustrates a graphical information element 800d according to some embodiments of the present disclosure. The processor 406 may execute instructions 416 to generate a graphical information element 420 including a display of a representation of the graphical information element 800d, which includes the proximal bracket end 702a (or the proximal bracket end 702b), the distal bracket end 704a (or the distal bracket end 704b), and the single-frame ALA button 508. In some embodiments, the processor 406 may execute instructions 416 to determine the distance between the brackets and select the graphical representation of the single-frame ALA button 508 based on the determined distance. For example, if the distance is less than (or equal to or less than) a threshold, the processor 406 may execute instructions 416 to select the single-frame ALA button 508 that includes the graphical representation of the text (or icon), but not both.

[0077] FIG. 9A illustrates a GUI 900a that may be generated according to some embodiments of the present disclosure. For example, the GUI 900a may be generated by the IVUS image visualization system 400 as a GUI 422 and displayed on the display 404. As illustrated, the GUI 900a includes several graphic information elements 420, such as menus 502a and 502b, an interactive cross-sectional view 902, and an interactive vascular navigation 904. In some embodiments, the processor 406 may be configured to generate the GUI 900a by executing instructions 416 when the vascular navigation 506 is selected. For example, in response to receiving input (e.g., via the I / O device 410, etc.) indicating that the vascular navigation 506 has been selected, the processor 406 may execute instructions 416 to generate the GUI 900a. In some embodiments, the processor 406 may execute instructions 416 to modify (or replace) portions of a previous GUI (e.g., GUI 500a, GUI 500b, etc.) with an interactive portion such as that shown in FIG. 9A .

[0078] For example, cross-sectional view 504 may be replaced with interactive cross-sectional view 902. Examples of interactive cross-sectional view 902 are described in more detail below. Generally, interactive cross-sectional view 902 may include a display of vessel and lumen boundaries along with a representation of image frame 300b and assessment 906. Similarly, vascular navigation 506 may be replaced with interactive vascular navigation 904. Examples of interactive vascular navigation 904 are described in more detail below. Generally, interactive vascular navigation 904 may include a display of minimum areas along with a representation of vessel and lumen profiles. Examples of assessment 906 are described in more detail below. Generally, they are based on assessment 424.

[0079] 9B illustrates a GUI 900b that may be generated in accordance with some embodiments of the present disclosure. For example, the GUI 900b may be generated as the GUI 422 by the IVUS image visualization system 400 and displayed on the display 404. As shown, the GUI 900b includes several graphic information elements 420 similar to the GUI 900a. Among other things, the GUI 900b further includes a vessel length view 510. The vessel length view 510 may include a longitudinal view of the vessel (e.g., the vessel 202) represented by the IVUS image 418. For example, the vessel length view 510 may include the IVUS image 300a.

[0080] 10 illustrates a GUI 1000 that may be generated in accordance with some embodiments of the present disclosure. For example, the GUI 1000 may be generated as a GUI 422 by the IVUS image visualization system 400 and displayed on the display 404. In some embodiments, in response to initiation of the vascular navigation 506, the processor 406 may execute instructions 416 to generate the graphic information element 420 and the GUI 1000 based on the graphic information element 420.

[0081] As shown, the GUI 1000 includes a menu 502a and a menu 502b positioned on either side of (or framing) the interactive cross-sectional view 902 and the interactive vascular navigation 904. The interactive cross-sectional view 902 includes a depiction (not shown for clarity) of a frame of the IVUS image 418, a graphical representation of a boundary 1002 associated with the frame of the IVUS image 418 corresponding to where the view slider 708 is positioned, and a depiction or representation of the assessment 906.

[0082] The interactive vascular navigation 904 also includes a proximal bracket end 702a, a distal bracket end 704a, a view slider (reference numbers omitted), a profile view 1004, and a minimum region 1006. Examples of the profile view 1004 and the minimum region 1006 are described below.

[0083] 11A and 11B illustrate interactive cross-sectional dual views 1100a and 1100b, respectively, according to some embodiments of the present disclosure. The IVUS image visualization system 400 may be configured to generate the interactive cross-sectional dual view 1100a or 1100b as the interactive cross-sectional view 902. As shown, the interactive cross-sectional dual view 1100a and 1100b include a GUI component depicting or representing the cross-sectional view 504 (e.g., corresponding to the location in the IVUS image 418 where the view slider 708 is located), along with a depiction of a representation of the assessment 424, which is represented as a GUI component of the assessment 1102. Generally, the assessment 1102 may include several representations (e.g., icons, images, video, text, etc.), such as representations 1104a, 1104b, 1104c, 1104d, 1104e, and 1104f.

[0084] As described above, in some embodiments, a display of the vascular boundary and the lumen boundary may be depicted. The interactive cross-sectional dual view 1100b in FIG. 11B includes the GUI components of the interactive cross-sectional dual view 1100a in addition to the vascular boundary 1106 and the lumen boundary 1108. In some examples, the processor 406 may execute instructions 416 to generate the interactive cross-sectional dual view 1100b as the interactive cross-sectional view 902 in response to enabling the vascular navigation 506, in which the vascular boundary 1106 and the lumen boundary 1108 are set to “visible” by default, and to generate the interactive cross-sectional dual view 1100a in response to enabling the view button 614, which indicates disabling the boundaries to provide a clearer view of the cross-sectional representation of the vessel shown in the interactive cross-sectional view 902.

[0085] 12A illustrates an interactive cross-sectional dual view 1200a that may be generated in accordance with some embodiments of the present disclosure. For example, the interactive cross-sectional dual view 1200a may be generated by the IVUS image visualization system 400 as the interactive cross-sectional view 902 of the GUI 422 and displayed on the display 404. In some embodiments, as shown, the interactive cross-sectional dual view 1200a includes the cross-sectional view 504 and an assessment 1102. The assessment 1102 includes indications 1104a, 1104b, 1104c, and 1104d, each showing the lumen area and cross-sectional diameter, the vessel area and cross-sectional diameter, the plaque burden (e.g., the ratio of lumen area to vessel area), and the distance from the distal starting point of the IVUS image 418 along with the frame number (e.g., the image number within the series of IVUS images 418).

[0086] 12B illustrates an interactive cross-sectional dual view 1200b that may be generated in accordance with some embodiments of the present disclosure. For example, the interactive cross-sectional dual view 1200b may be generated by the IVUS image visualization system 400 as the interactive cross-sectional view 902 of the GUI 422 and displayed on the display 404. In some embodiments, as shown, the interactive cross-sectional dual view 1200b includes the cross-sectional view 504 and the evaluation 1102.

[0087] The cross-sectional view 504 includes a depiction of the cross-sectional diameter of the vessel and lumen, along with a depiction of the vessel boundary 1106 and lumen boundary 1108. The assessment 1102 includes displays 1104a, 1104b, 1104c, and 1104d, each showing the lumen area and cross-sectional diameter, the vessel area and cross-sectional diameter, the plaque burden (e.g., the ratio of lumen area to vessel area), and the distance from the distal starting point of the IVUS image 418 along with the frame number (e.g., the image number within the series of IVUS images 418).

[0088] 12C illustrates an interactive cross-sectional dual view 1200c that may be generated in accordance with some embodiments of the present disclosure. For example, the interactive cross-sectional dual view 1200c may be generated by the IVUS image visualization system 400 as the interactive cross-sectional view 902 of the GUI 422 and displayed on the display 404. In some embodiments, as shown, the interactive cross-sectional dual view 1200c includes the cross-sectional view 504 and the evaluation 1102.

[0089] The cross-sectional view 504 includes a depiction of the cross-sectional diameter of the vessel and lumen, along with a depiction of the vessel boundary 1106 and lumen boundary 1108. The assessment 1102 includes displays 1104a, 1104b, 1104c, and 1104d, each showing the lumen area and cross-sectional diameter, the vessel area and cross-sectional diameter, the plaque burden (e.g., the ratio of lumen area to vessel area), and the distance from the distal starting point of the IVUS image 418 along with the frame number (e.g., the image number within the series of IVUS images 418).

[0090] In some embodiments, the confidence level of the automatic boundary detection may be low. For example, if machine learning is used to automatically detect the vascular and lumen boundaries, the detection may include a confidence score. In such an example, if the confidence score is below a threshold, the depiction of the boundary may be altered to convey low confidence in the boundary. For example, the cross-sectional view of the blood vessel shown in FIG. 12C is attenuated, indicating low confidence in the vascular boundary. In that case, the lumen boundary 1108 is shown as a dashed or dash-dot line, as opposed to a solid line.

[0091] In some examples, the boundaries (e.g., vascular boundary 1106, lumen boundary 1108, etc.) are editable. For example, a user can manipulate or modify the boundaries (e.g., via I / O device 410, etc.). In some embodiments, processor 406, by executing instructions 416, may change lumen boundary 1108 to a standard boundary (e.g., vascular boundary 1106, 1108, etc.) in response to manipulation or modification by a user. Processor 406, by executing instructions 416, may receive an indication of a modification to lumen boundary 1108 and change lumen boundary 1108 to vascular boundary 1106 or (as the case may be) lumen boundary 1108 based on the modification.

[0092] Additionally, in some embodiments, the depiction of assessment 1102 may change based on the confidence level of the assessment. For example, the vessel area shown in display 1104b is shown with a dashed or dotted outline. Processor 406, by executing instructions 416, may change the depiction or representation of portions of assessment 1102 based on modifications from the user. For example, if a user modifies lumen boundary 1108, the boundary and corresponding display (e.g., 1104b) may be changed to indicate a higher confidence level based on the user modifications.

[0093] 13 illustrates a profile view 1300 according to some embodiments of the present disclosure. The IVUS image visualization system 400 may be configured to generate the profile view 1300 as the interactive vascular navigation 904. As illustrated, the profile view 1300 includes several GUI components, including a central axis 1302 relative to which a longitudinal boundary profile 1304 and a longitudinal boundary profile mirror reflection 1306 are positioned. Examples of the longitudinal boundary profiles 1304, 1306 are described below. Generally, the longitudinal boundary profile 1304 depicts or is representative of a detected boundary (e.g., the vessel boundary 1106, the lumen boundary 1108, the lumen boundary 1108, etc.) of the IVUS image 418. The longitudinal boundary profile mirror reflection 1306 is a mirror reflection of the longitudinal boundary profile 1304, thereby providing a more complete visualization of the vessel and lumen profile.

[0094] The profile view 1300 further includes a scale 1308 that indicates the radius of the detection boundary represented in the longitudinal boundary profile 1304. The profile view 1300 also includes the minimum area 1006 along with the proximal bracket end 702 a and the distal bracket end 704 a (or possibly the proximal bracket end 702 b and the distal bracket end 704 b). Each bracket is movable via user input (e.g., via the I / O device 410). Additionally, in some examples, a ruler 1310 can be enabled (e.g., by default or by selecting an input button, etc.) to measure the distance between the brackets (e.g., between the proximal bracket end 702 a and the distal bracket end 704 a).

[0095] 14A illustrates a profile view 1400a that may be generated in accordance with some embodiments of the present disclosure. For example, the profile view 1400a may be generated by the IVUS image visualization system 400 as the interactive vascular navigation 904 of the GUI 422 and displayed on the display 404. As illustrated, the profile view 1400a may include the longitudinal boundary profile 1304 and the longitudinal boundary profile mirror reflection 1306. The longitudinal boundary profile 1304 and the longitudinal boundary profile mirror reflection 1306 each include the vessel boundary 1106 and the lumen boundary 1108. In some embodiments, the processor 406, upon executing the instructions 416, may shade or color the region between the vessel boundary 1106 and the lumen boundary 1108 to indicate plaque. The profile view 1400a may also include the proximal bracket end 702a, the distal bracket end 704a, and the minimum region 1006. Additionally, although not shown, the profile view 1400 a may include a central axis 1302 and a scale 1308 .

[0096] 14B illustrates a profile view 1400a that may be generated in accordance with some embodiments of the present disclosure. As discussed above, in some instances, the confidence level of the detected boundary may be low. In such instances, the boundary represented in the profile view may be generated to indicate the low confidence level of the boundary. For example, profile view 1400b includes the GUI components of profile view 1400a, but differs in that the boundary of the lumen boundary 1108 or the portion of the low-confidence vascular boundary 1106 is indicated by a dashed line. For example, a frame of an IVUS image 418 having a low-confidence boundary, such as in a portion of the frame, may be depicted (or indicated) by a different line profile than the portion of the IVUS image 418 that exceeds the confidence threshold.

[0097] 15 illustrates a GUI 1500 that may be generated in accordance with some embodiments of the present disclosure. For example, GUI 1500 may be generated by IVUS image visualization system 400 as GUI 422 and displayed on display 404. As shown, GUI 1500 includes several graphic information elements 420 similar to previous GUIs (e.g., GUI 900a, GUI 900b, etc.). However, GUI 1500 includes a dual or side-by-side view of cross-sectional regions. In some embodiments, the side-by-side view may be enabled by a button in one of menus 502a, 502b (e.g., via layout button 612, etc.).

[0098] As shown, GUI 1500 includes interactive cross section view 1502 and interactive cross section view 1504 positioned side-by-side between menu 502a and menu 502b. Interactive cross section views 1502 and 1504 may include ratings 1506 and 1508, respectively. Ratings 1506 and 1508 list a rating for each frame shown in interactive cross section views 1502 and 1504.

[0099] GUI 1500 further includes dual vessel length views 1510, 1512. Generally, dual vessel length view 1510 and dual interactive vessel navigation 1512 may be similar to previous vessel length views (e.g., vessel navigation 506, etc.) and vessel navigation GUI components (e.g., interactive vessel navigation 904, etc.), except that the dual view GUI component includes two sliders (e.g., view slider 708).

[0100] 16 illustrates a GUI 1600 that may be generated in accordance with some embodiments of the present disclosure. For example, the GUI 1600 may be generated by the IVUS image visualization system 400 as the GUI 422 and displayed on the display 404. In some embodiments, in response to a dual layout being enabled (e.g., via the layout button 612, etc.), the processor 406 may execute instructions 416 to generate the graphic information element 420 and the GUI 1600 based on the graphic information element 420.

[0101] As shown, GUI 1600 includes a first interactive cross-sectional view 1502 and a second interactive cross-sectional view 1504 arranged side-by-side, both surrounded by menus 502a and 502b. Additionally, GUI 1600 includes a dual vessel length view 1510 and dual interactive vessel navigation 1512 arranged below interactive cross-sectional view 1502 and interactive cross-sectional view 1504. Dual vessel length view 1510 includes a view slider 708 for each cross-sectional view. For example, first slider 708 and second slider 708 are shown. In some embodiments, the sliders and cross-sectional views may be color-coded to indicate which slider controls which view. Additionally, in some embodiments, ruler 1310 may be enabled (e.g., via length measurement input 602, etc.). As shown, ruler 1310 indicates the distance between the respective frames shown in interactive cross-sectional view 1502 and interactive cross-sectional view 1504 .

[0102] 17 shows a logic flow 1700 for generating a GUI according to some embodiments of the present disclosure. The logic flow 1700 may be implemented by the IVUS image visualization system 400. Below, for clarity of presentation, the logic flow 1700 is described with reference to the IVUS image visualization system 400. However, the logic flow 1700 may also be implemented by an IVUS guidance system different from the IVUS image visualization system 400.

[0103] Logic flow 1700 may begin at block 1702. At block 1702, "Receive a series of intravascular ultrasound (IVUS) images of a patient's blood vessel, the series including a plurality of frames," a series of IVUS images may be received that were acquired via an IVUS catheter percutaneously inserted into the patient's blood vessel. For example, an information element including a representation of IVUS images 418 may be received from IVUS imaging system 100 at a location where catheter 102 is (or was) percutaneously inserted into blood vessel 202. IVUS images 418 may include frames of images representing images acquired while catheter 102 is being retracted from distal end 204 to proximal end 206. Processor 406 may execute instructions 416 to receive information elements including a representation of IVUS images 418 from IVUS imaging system 100, or in some cases directly from catheter 102.

[0104] Next, proceeding to block 1704, "Generate a first graphical user interface (GUI) component including a display of a cross-sectional view of a frame of the plurality of frames," a first GUI component including a display of a cross-sectional view of a frame of the plurality of frames is generated. For example, processor 406 may execute instructions 416 to generate a cross-sectional view (e.g., cross-sectional view 504, interactive cross-sectional view 902, etc.).

[0105] The process then proceeds to block 1706, "Generate a second GUI component including a display of at least one menu option," where a second GUI component including a display of at least one menu option is generated. For example, the processor 406 may execute instructions 416 to generate menu 502a. The process then proceeds to block 1708, "Generate a third GUI component including a display of at least one layout option," where a third GUI component including a display of at least one layout option is generated. For example, the processor 406 may execute instructions 416 to generate menu 502b. The process then proceeds to block 1710, "Generate a fourth GUI component including a display of a navigation input," where a fourth GUI component including a display of a navigation input is generated. The processor 406 may execute instructions 416 to generate vascular navigation 506.

[0106] Control then proceeds to block 1712, "Generate a GUI including first, second, third, and fourth GUI components, where the first GUI component is disposed between the second and third GUI components," which generates a GUI including first, second, third, and fourth GUI components, where the first GUI component is disposed between the second and third GUI components. For example, processor 406 may execute instructions 416 to generate GUI 422. Control then proceeds to block 1714, "Render a GUI for display on a display," which may render the GUI for display. For example, processor 406 may execute instructions 416 to render the GUI components and the GUI for display on display 404.

[0107] 18 illustrates a computer-readable storage medium 1800. The computer-readable storage medium 1800 may include any non-transitory computer-readable or machine-readable storage medium, such as an optical storage medium, a magnetic storage medium, or a semiconductor storage medium. In various embodiments, the computer-readable storage medium 1800 may include an article of manufacture. In some embodiments, the computer-readable storage medium 1800 may store computer-executable instructions 1802 executable by a circuit (e.g., processor 106, processor 406, IVUS imaging system acquisition circuitry 414, etc.). For example, the computer-executable instructions 1802 may include instructions for implementing the operations described with respect to instructions 416, logic flow 1700, graphic information elements 420, and / or GUI 422. Examples of computer-readable storage medium 1800 or machine-readable storage media may include any tangible medium capable of storing electronic data, including volatile or non-volatile memory, removable or non-removable memory, erasable or non-erasable memory, writable or rewritable memory, etc. Examples of computer-executable instructions 1802 may include any suitable type of code, such as source code, compiled code, interpreted code, executable code, static code, dynamic code, object-oriented code, visual code, etc.

[0108] FIG. 19 illustrates a schematic diagram of a machine 1900 in the form of a computer system within which a set of instructions may be executed to cause the machine to perform any one or more of the methods described herein. Specifically, FIG. 19 illustrates a schematic diagram of a machine 1900 in the exemplary form of a computer system within which instructions 1908 (e.g., software, programs, applications, applets, apps, or other executable code) may be executed to cause the machine 1900 to perform any one or more of the methods described herein. For example, the instructions 1908 may cause the machine 1900 to execute logic flow 1700 of FIG. 17 or instructions 416 of FIG. 4. More generally, the instructions 1908 may cause the machine 1900 to generate a GUI using IVUS before, before, after, or after PCI, with the functionality and behavior described herein. The present disclosure provides a specific and distinct implementation of a GUI representation, which is a significant improvement over the prior art. In particular, the present disclosure provides improvements to computing techniques in that it provides greater visibility and navigation of IVUS images through a GUI.

[0109] The instructions 1908 transform the general, unprogrammed machine 1900 into a specific machine 1900 programmed to perform the functions described and illustrated in a specific manner. In alternative embodiments, the machine 1900 may operate as a standalone device or may be coupled (e.g., networked) to other machines. In a networked deployment, the machine 1900 may operate as a server or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine 1900 may include, but is not limited to, a server computer, a client computer, a personal computer (PC), a tablet computer, a laptop computer, a netbook, a set-top box (STB), a PDA, an entertainment media system, a mobile phone, a smartphone, a mobile device, a wearable device (e.g., a smart watch), a smart home device (e.g., a smart appliance), other smart devices, a web appliance, a network router, a network switch, a network bridge, or any machine capable of sequentially or otherwise executing instructions 1908 that specify operations to be performed by the machine 1900. Additionally, although only a single machine 1900 is illustrated, the term "machine" is also intended to include a collection of machines 1900 that individually or cooperatively execute instructions 1908 to perform any one or more of the methods described herein.

[0110] Machine 1900 may include processor 1902, memory 1904, and I / O components 1942, which may be configured to communicate with each other via a bus 1944 or the like. In an exemplary embodiment, processor 1902 (e.g., a central processing unit (CPU), a reduced instruction set computing (RISC) processor, a complex instruction set computing (CISC) processor, a graphics processing unit (GPU), a digital signal processor (DSP), an ASIC, a radio frequency integrated circuit (RFIC), another processor, or any suitable combination thereof) may include, for example, processor 1906 and processor 1910, which may execute multiple instructions 1908. The term "processor" is intended to include multi-core processors, which may include two or more independent processors (sometimes referred to as "cores") capable of simultaneously executing instructions. While FIG. 19 shows multiple processors 1902, machine 1900 may include a single processor with a single core, a single processor with multiple cores (e.g., a multi-core processor), multiple processors with a single core, multiple processors with multiple cores, or any combination thereof.

[0111] Memory 1904 may include a main memory 1912, a static memory 1914, and a storage unit 1916, which are accessible to processor 1902 via a bus 1944 or the like. Main memory 1904, static memory 1914, and storage unit 1916 store instructions 1908 that embody any one or more of the methods or functions described herein. Also, instructions 1908 may reside, completely or partially, within main memory 1912, within static memory 1914, within a machine-readable medium 1918 in storage unit 1916, within at least one of processors 1902 (e.g., within a processor's cache memory), or any suitable combination thereof during execution thereof by machine 1900.

[0112] I / O components 1942 may include a wide variety of components for receiving input, providing output, generating output, transmitting information, exchanging information, capturing measurements, etc. The particular I / O components 1942 included in a particular machine will depend on the type of machine. For example, a portable device such as a cell phone will likely include a touch input device or other such input mechanism, while a headless server machine will likely not include such a touch input device. I / O components 1942 may also include many other components not shown in FIG. 19 . I / O components 1942 are grouped according to function solely to simplify the following description, and this grouping is not intended to be limiting. In various exemplary embodiments, I / O components 1942 may include output components 1928 and input components 1930. Output components 1928 may include visual components (e.g., a display such as a plasma display panel (PDP), light-emitting diode (LED) display, liquid crystal display (LCD), projector, or cathode ray tube (CRT)), acoustic components (e.g., speakers), haptic components (e.g., vibration motors, resistive mechanisms), other signal generators, etc. Input components 1930 may include alphanumeric input components (e.g., a keyboard, a touchscreen configured to receive alphanumeric input, a photo-optical keyboard, or other alphanumeric input component), point-based input components (e.g., a mouse, touchpad, trackball, joystick, motion sensor, or another pointing device), tactile input components (e.g., physical buttons, a touchscreen that provides the position and / or force of a touch or touch gesture, or other tactile input component), audio input components (e.g., a microphone), etc.

[0113] In further illustrative embodiments, I / O component 1942 may include a biometric component 1932, a motion component 1934, an environmental component 1936, or a position component 1938, among a wide variety of other components. For example, biometric component 1932 may include components for detecting facial expressions (e.g., hand expressions, facial expressions, vocal expressions, gestures, or eye tracking), measuring biosignals (e.g., blood pressure, heart rate, body temperature, sweat, or brain waves), identifying people (e.g., voice identification, retinal identification, face identification, fingerprint identification, or brainwave-based identification), etc. Motion component 1934 may include an acceleration sensor component (e.g., an accelerometer), a gravity sensor component, a rotation sensor component (e.g., a gyroscope), etc. The environmental components 1936 may include, for example, an illuminance sensor component (e.g., a photometer), a temperature sensor component (e.g., one or more thermometers that detect ambient temperature), a humidity sensor component, a pressure sensor component (e.g., a barometer), an acoustic sensor component (e.g., one or more microphones that detect background noise), a proximity sensor component (e.g., an infrared sensor that detects nearby objects), a gas sensor (e.g., a gas detection sensor that detects concentrations of harmful gases or measures pollutants in the air for safety purposes), or other components that may provide an indication, measurement, or signal corresponding to the surrounding physical environment. The position components 1938 may include a location sensor component (e.g., a GPS receiver component), an altitude sensor component (e.g., an altimeter or barometer that detects air pressure from which altitude can be derived), an orientation sensor component (e.g., a magnetometer), etc.

[0114] Communications may be implemented using a wide variety of technologies. I / O component 1942 may include a communications component 1940 operable to couple machine 1900 to network 1920 or device 1922 via connection 1924 and connection 1926, respectively. For example, communications component 1940 may include a network interface component or another suitable device for interfacing with network 1920. In further embodiments, communications component 1940 may include a wired communications component, a wireless communications component, a cellular communications component, a near-field communications (NFC) component, a Bluetooth® component (e.g., Bluetooth® Low Energy), a Wi-Fi® component, and other communications components for communicating via other modalities. Device 1922 may be another machine or any of a wide variety of peripheral devices (e.g., a peripheral device connected via USB).

[0115] Further, the communications component 1940 may detect an identifier or may include a component operable to detect an identifier. For example, the communications component 1940 may include a radio frequency identification (RFID) tag reader component, an NFC smart tag detection component, an optical reader component (e.g., an optical sensor for detecting one-dimensional barcodes such as Universal Product Code (UPC) barcodes, multidimensional barcodes such as Quick Response (QR) Code, Aztec Code, Data Matrix, Dataglyph, MaxiCode, PDF417, Ultra Code, UCC RSS-2D barcodes, and other optical codes), or an acoustic detection component (e.g., a microphone for identifying tagged audio signals). Additionally, various information, such as location via Internet Protocol (IP) geolocation, location via Wi-Fi signal triangulation, location by detection of NFC beacon signals that may indicate a particular location, may be derived via the communications component 1940.

[0116] The various memories (i.e., memory 1904, main memory 1912, static memory 1914, and / or memory of processor 1902) and / or storage units 1916 may store one or more sets of instructions and data structures (e.g., software) that embody or are utilized by any one or more of the methods or functions described herein. These instructions (e.g., instructions 1908), when executed by processor 1902, cause various operations to implement the disclosed embodiments.

[0117] As used herein, the terms “mechanical storage medium,” “device storage medium,” and “computer storage medium” mean the same thing and may be used interchangeably in this disclosure. These terms refer to single or multiple storage devices and / or media (e.g., centralized or distributed databases, and / or associated caches and servers) that store executable instructions and / or data. Accordingly, these terms are intended to include, but are not limited to, solid-state memory and magneto-optical media, including memory internal or external to a processor. Specific examples of mechanical storage media, computer storage media, and / or device storage media include non-volatile memory, including semiconductor memory devices such as erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), FPGAs, and flash memory devices; magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The terms "machine storage media," "computer storage media," and "device storage media" specifically exclude carrier waves, modulated data signals, and other such media, at least some of which are encompassed under the term "signal media" discussed below.

[0118] In various exemplary embodiments, one or more portions of network 1920 may be an ad-hoc network, an intranet, an extranet, a VPN, a LAN, a WLAN, a WAN, a WWAN, a MAN, the Internet, a portion of the Internet, a portion of the PSTN, a plain old telephone service (POTS) network, a cellular telephone network, a wireless network, a Wi-Fi network, another type of network, or a combination of two or more such networks. For example, network 1920 or portions of network 1920 may include a wireless or cellular network. Connection 1924 may be a code division multiple access (CDMA) connection, a Global System for Mobile Communications (GSM) connection, or another type of cellular or wireless connection. In this example, connection 1924 may implement any of various types of data transfer technologies, such as single-carrier radio transmission technology (1xRTT), Evolution Data Optimized (EVDO) technology, General Packet Radio Service (GPRS) technology, Enhanced Data Rates for GSM Evolution (EDGE) technology, Third Generation Partnership Project (3GPP) including 3G, Fourth Generation Wireless (4G) networks, Universal Mobile Telecommunications System (UMTS), High Speed ​​Packet Access (HSPA), Worldwide Interoperability for Microwave Access (WiMAX), Long Term Evolution (LTE) standards, others defined by various standards-setting bodies, other long-range protocols, or other data transfer technologies.

[0119] The instructions 1908 may be transmitted and received over the network 1920 using a transmission medium via a network interface device (e.g., a network interface component included in the communications component 1940) and utilizing any one of several well-known transfer protocols (e.g., Hypertext Transfer Protocol (HTTP)). Similarly, the instructions 1908 may be transmitted and received using a transmission medium via a connection 1926 (e.g., a peer-to-peer connection) to the device 1922. The terms “transmission medium” and “signal medium” mean the same thing and may be used interchangeably in this disclosure. The terms “transmission medium” and “signal medium” are intended to include any intangible medium capable of storing, encoding, or carrying the instructions 1908 for execution by the machine 1900 and including digital or analog communications signals or other intangible media for facilitating communication of such software. Accordingly, the terms “transmission medium” and “signal medium” are intended to include any form of modulated data signal, carrier wave, etc. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.

[0120] Terms used in this specification are to be given their ordinary meaning in the relevant art or as indicated by their use in context, except that if an explicit definition is provided, that meaning will control.

[0121] References herein to "one embodiment" or "an embodiment" do not necessarily refer to the same embodiment, but may refer to the same embodiment. Throughout this specification and claims, words such as "comprises," "comprising," and the like are intended to be construed in an inclusive sense, as opposed to an exclusive or exhaustive sense, such as "including but not limited to," unless the context clearly dictates otherwise. Terms used in the singular or plural also include the plural or singular, respectively, unless expressly limited to one or more. Additionally, the words "herein," "above," "below," and similar words, when used in this application, refer to this application as a whole, not to any portion thereof. When a claim uses the word "or" in connection with a list of two or more items, the word encompasses any item in the list, all items in the list, and any combination of items in the list, unless expressly limited to one or the other. Any terms not expressly defined herein have their conventional meanings as commonly understood by those of ordinary skill in the art.

[0122] By using a true model of the anatomy, more accurate surgical planning can be achieved than through statistical modeling. Terms used in this specification are to be given their ordinary meaning in the relevant art or as indicated by their use in context, except that if an explicit definition is provided, that meaning will control.

[0123] References herein to "one embodiment" or "an embodiment" do not necessarily refer to the same embodiment, but may refer to the same embodiment. Throughout this specification and claims, words such as "comprises," "comprising," and the like are intended to be construed in an inclusive sense, as opposed to an exclusive or exhaustive sense, such as "including but not limited to," unless the context clearly dictates otherwise. Terms used in the singular or plural also include the plural or singular, respectively, unless expressly limited to one or more. Additionally, the words "herein," "above," "below," and similar words, when used in this application, refer to this application as a whole, not to any portion thereof. When a claim uses the word "or" in connection with a list of two or more items, the word encompasses any item in the list, all items in the list, and any combination of items in the list, unless expressly limited to one or the other. Any terms not expressly defined herein have their conventional meanings as commonly understood by those of ordinary skill in the art.

Claims

1. 1. A method for an intravascular ultrasound (IVUS) imaging system, comprising: receiving a series of intravascular ultrasound (IVUS) images of a blood vessel of a patient, the series of IVUS images comprising a plurality of frames; generating a first graphical user interface (GUI) component including a display of a cross-sectional view of one of the plurality of frames; generating a second GUI component including a display of at least one menu option; generating a third GUI component including a representation of at least one layout option; generating a fourth GUI component including a display of the navigation input with a rating button; generating a GUI including the first, second, third, and fourth GUI components, wherein the first GUI component is disposed between the second GUI component and the third GUI component; and rendering the GUI for display on a display; A method for providing

2. 2. The method of claim 1, wherein generating the fourth GUI component comprises generating the fourth GUI component including a display of a distal bracket and a proximal bracket along with a display of the evaluation button, wherein the distal bracket and the proximal bracket are movable.

3. The method of claim 2 , comprising receiving instructions via an input device to move the distal bracket, the proximal bracket, or the distal and proximal brackets.

4. The method of claim 3 , further comprising regenerating the fourth GUI component including a graphical representation of the moved distal bracket, the moved proximal bracket, or the moved distal and proximal brackets along with the evaluation button.

5. The method of any one of claims 2 to 4, wherein the evaluation button is located between the proximal bracket and the distal bracket.

6. Determining the distance between the distal bracket and the proximal bracket; and generating a display of the rating button based on the distance; The method according to any one of claims 2 to 4, comprising:

7. determining whether the distance is greater than a threshold; and generating a display of the rating button including a graphical representation including at least an icon and text based on a determination that the distance is greater than the threshold; The method of claim 6 comprising:

8. 8. The method of claim 7, comprising generating a display of the rating button that includes a graphical representation that includes either text or an icon, but not both, based on a determination that the distance is less than or equal to the threshold.

9. receiving an indication via an input device that the rating button has been clicked; and generating a fifth GUI component including a representation of the distal bracket, the proximal bracket, a minimum area, a vessel profile view, and a mirror of the vessel profile view; The method of claim 2 comprising:

10. The method of claim 9 , wherein the vascular profile view includes a representation of a boundary of the vessel and a boundary of a lumen within the vessel represented along a longitudinal axis of the vessel.

11. receiving an indication of the vessel boundary and the lumen boundary for each of the plurality of frames; generating a graphical representation of the vessel boundary and the lumen boundary based on the representation; generating the vascular profile view including the graphical representation of the vessel boundary and the lumen boundary; and mirroring the vessel profile view about a central longitudinal axis to generate a mirror of the vessel profile view; The method of claim 10 comprising:

12. receiving the representation of the vessel boundary and the lumen boundary from a machine learning automated boundary detection model; receiving an indication of confidence of the vessel boundary for each of the plurality of frames; determining for each of the plurality of frames whether the confidence is less than or equal to a threshold confidence level; generating the graphical representation of a boundary of the vessel for a first portion of the central longitudinal axis, the graphical representation comprising the first graphical representation based on a determination that the confidence for the frame associated with the first portion is less than or equal to the threshold confidence level; and generating the graphical representation of the vessel boundary for a second portion of the central longitudinal axis, the graphical representation comprising the second graphical representation based on a determination that the confidence level for the frame associated with the second portion is not less than or equal to the threshold confidence level; The method of claim 11 , wherein the second graphical representation is different from the first graphical representation.

13. 13. The method of claim 12, wherein the first graphical representation comprises a first color, a first width, or a first line style, and the second graphical representation comprises a second color, a second width, or a second line style.

14. 14. An apparatus comprising a processor coupled to a memory, the memory comprising a plurality of instructions executable by the processor, the processor configured to be coupled to an intravascular ultrasound (IVUS) imaging system and configured to execute the plurality of instructions, the plurality of instructions, when executed, causing the processor to perform the method of any one of claims 1 to 13.

15. At least one machine-readable storage device comprising a plurality of instructions that, when executed by a processor of an intravascular ultrasound (IVUS) imaging system, cause the processor to perform the method of any one of claims 1 to 13.

Images