Method and system for image synchronization
Through the coordination of the rotary motor and the pullback motor, the synchronization of image data in the OCT system is achieved by using the encoder signal and the flip-flop signal, which solves the problem of difficulty in aligning the image with the pullback mechanism in the prior art, and improves the imaging quality and system efficiency .
Patent Information
- Application Number
- CN202110899480.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-07-20
- Filing Date
- 2021-08-06
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-08-06
AI Technical Summary
Existing optical coherence tomography (OCT) systems are difficult to synchronize images with pullback mechanisms in intravascular imaging, resulting in data alignment problems and affecting imaging quality and accuracy.
The rotary motor and pullback motor are used to cooperate with the data acquisition processor and the synchronization processor to synchronize the image data through the encoder signal and the flip-flop signal to ensure the accurate alignment of the imaging beam and the probe position.
The synchronization between the image and the pull-back mechanism is achieved, the accuracy and consistency of the imaging data are improved, and the manufacturing and maintenance costs of the system are reduced.
Smart Images

Figure CN114052659B_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application is related to and claims priority to U.S. patent application serial No. 63 / 062,159 filed on August 6, 2020, the entire disclosure of which is incorporated herein by reference in its entirety. Technical Field
[0003] The present disclosure relates generally to the field of imaging, and more particularly to one or more optical devices, systems, methods (for use and / or manufacture), and storage media, such as, but not limited to, fiber optic catheters, endoscopes, and / or optical coherence tomography (OCT) and / or fluorescence devices and systems, and methods and storage media for use therewith, for synchronizing images, such as with a pullback mechanism, when acquiring image(s), for one or more imaging modalities, such as OCT or others (e.g., intravascular ultrasound (IVUS), other imaging modalities for image(s) or lumen(s), etc.). Examples of such applications include imaging, evaluating, and diagnosing biological objects, such as, but not limited to, gastrointestinal, pulmonary, cardiac, ophthalmic, and / or intravascular applications, and obtained via one or more optical instruments, such as, but not limited to, one or more optical probes, one or more catheters, one or more endoscopes, one or more phase shifting units (e.g., galvanometer scanners), one or more tethered capsules, one or more needles (e.g., biopsy needles), and one or more benchtop systems. Background Art
[0004] Fiber optic catheters and endoscopes have been developed to access internal organs. For example, in cardiology, OCT has been developed to view depth-resolved images of blood vessels using a catheter. A catheter, which may include a sheath, coil, and optical probe, may be navigated to the coronary arteries.
[0005] Optical coherence tomography (OCT) is a technique for obtaining high-resolution cross-sectional images of tissues or materials, and enables real-time visualization. The purpose of OCT technology is to measure the time delay of light by using an interference optical system or interferometry, such as via Fourier transform or Michelson interferometer. Light from a light source is delivered and separated into a reference arm and a sample (or measurement) arm by a beam splitter (e.g., a beam splitter). The reference beam is reflected from a reference mirror (partially reflective element or other reflective element) in the reference arm, while the sample beam is reflected or scattered from the sample in the sample arm. The two beams are combined (or recombined) at the beam splitter and generate an interference pattern. The output of the interferometer is detected by one or more detectors (such as, but not limited to, photodiodes or multi-array cameras) in one or more devices (such as, but not limited to, spectrometers (e.g., Fourier transform infrared spectrometers)). When the path length of the sample arm matches the path length of the reference arm and is within the coherence length of the light source, an interference pattern is generated. By evaluating the output beam, the spectrum of the input radiation can be derived as a function of frequency. The frequency of the interference pattern corresponds to the distance between the sample arm and the reference arm. The higher the frequency, the greater the difference in path length. Single-mode fiber can be used for OCT optical probes, while double-clad fiber can be used for fluorescence and / or spectroscopy.
[0006] Percutaneous coronary intervention (PCI) and other vascular diagnostic and interventional procedures have been improved with the introduction of intravascular imaging (IVI) modalities such as, but not limited to, intravascular ultrasound (IVUS) and optical coherence tomography (OCT). IVI modalities provide precise lesion information (e.g., lumen size, plaque morphology, implanted devices, etc.) by imaging the cross section of the coronary arteries. Despite this, only approximately 20% of interventional cardiologists in the United States use IVI imaging in conjunction with coronary angiography during PCI procedures.
[0007] Previous system attempts have relied on: (i) estimating the delay between the issuance of the pullback start command and the actual start of the pullback mechanism and accounting for that delay in timing the first acquisition frame; (ii) using image processing techniques to estimate which acquisition frame corresponds to the start of the pullback; or (iii) using two signals from the scanning mechanism to signal the start of the pullback and the acquisition of rotation information.
[0008] However, such existing systems do not perform image synchronization based on a pull-back mechanism (including an automatic pull-back mechanism). In such existing systems, the data may not be properly aligned with the scanning mechanism, and may cause undesirable results, such as, but not limited to, erroneous measurement of (one or more) object features, premature termination of imaging recording, recording of more data than necessary, etc.
[0009] Thus, there is a need to synchronize the image with a pullback mechanism and / or an automatic pullback mechanism, especially where the start of the pullback can be triggered manually or by an algorithm. It is also desirable to provide one or more image synchronization techniques and / or structures for use in at least one optical device, assembly, or system to achieve consistent, reliable image synchronization results with high efficiency and reasonable manufacturing and maintenance costs. Summary of the invention
[0010] Thus, a broad object of the present disclosure is to provide imaging (e.g., OCT, NIRAF, etc.) devices, systems, methods, and storage media for using and / or controlling one or more imaging modalities and / or performing image synchronization with (one or more) pullback mechanisms using one or more imaging devices, systems, storage media, etc. Another broad object of the present disclosure is to provide OCT devices, systems, methods, and storage media using interference optical systems, such as interferometers (e.g., spectral domain OCT (SD-OCT), swept light source OCT (SS-OCT), multimode OCT (MM-OCT), intravascular ultrasound (IVUS), near infrared autofluorescence (NIRAF), near infrared spectroscopy (NIRS), near infrared fluorescence (NIRF), therapeutic modalities using light, sound or other radiation sources, etc.).
[0011] One or more embodiments of the present disclosure generally relate to at least the field of imaging employing image synchronization with a pullback mechanism. Examples of such applications include, but are not limited to, imaging, evaluation, and diagnosis of biological objects such as, but not limited to, gastrointestinal, pulmonary, and / or intravascular applications, obtained via one or more instruments such as, but not limited to, one or more probes, one or more catheters, one or more endoscopes, one or more tethered capsules, and one or more needles (e.g., biopsy needles).
[0012] In one or more embodiments, intracavitary imaging is intended to obtain high-resolution cross-sectional images of tissue and achieve real-time visualization. Intracavitary imaging can use manually triggered scanning, algorithm triggered scanning, and / or automatically triggered scanning of the optical probe, while the system records data. In one or more embodiments, the data can be aligned with the actual physical movement of the probe, which can be performed using a method referred to herein as a scanning mechanism, preferably used to enable one or more devices or systems to operate as desired.
[0013] At least one embodiment of an imaging system according to the present disclosure was prototyped to investigate the feasibility of synchronizing image acquisition with probe position throughout the probe scan. In this case, the probe can be a catheter having a fixed outer layer and a rotatable and translatable inner core containing an optical fiber and distal optics for focusing light on a sample.
[0014] One or more embodiments of the present disclosure provide one or more of the following advantages: reducing the number of PIU cable lines to achieve a more flexible PIU and / or PIU cable; reducing the number of auxiliary inputs of the HS digitizer, thereby making the design simpler (and can be used with standard or off-the-shelf (one or more) digitizers); using any operating system to achieve image acquisition that can be synchronized with a pullback mechanism without relying on a real-time operating system or global synchronization (or, in one or more embodiments, can be used with a real-time operating system or global synchronization); and / or providing a flexible design that can be used in distributed systems where the distance between data acquisition and the pullback mechanism is important; etc.
[0015] One or more embodiments of the present disclosure may include an imaging device or imaging system, a scanning mechanism, and a single data acquisition synchronization signal or device. In fact, one or more embodiments of a system for synchronizing image acquisition with an imaging beam position may include: an imaging system, a scanning mechanism, and a single data acquisition synchronization signal or device.
[0016] In one or more embodiments, a system for performing image synchronization may include: an imaging device or imaging system that uses one or more imaging modalities to obtain imaging data; a scanning mechanism that operates to perform beam scanning on a catheter or probe of the system to obtain the beam position of the catheter or probe; and one or more processors that operate to achieve image synchronization by recording the beam position simultaneously or contemporaneously with the imaging data, and operate to achieve accurate spatial alignment of the imaging data.
[0017] In one or more embodiments, the one or more processors may further include a data acquisition processor and a hardware management processor, the hardware management processor operates to control the data acquisition processor and the data acquisition processor operates to acquire imaging data obtained by the imaging device or imaging system.
[0018] In one or more embodiments, the system may further include: (i) a rotation motor that operates to rotate the scanning mechanism, a portion of the scanning mechanism and / or the catheter or probe, and (ii) a pullback motor that operates to control the pullback of the catheter or probe, wherein the catheter or probe beam scanning is performed by the scanning mechanism using the rotation motor and the pullback motor.
[0019] In one or more embodiments, one or more of the following may occur: (i) one or more processors also include a data acquisition processor and a hardware management processor, the hardware management processor operates to control the data acquisition processor and the data acquisition processor operates to acquire imaging data obtained by the imaging device or imaging system; (ii) the system also includes a rotation motor controller and a retraction motor controller, the rotation motor controller operates to control the rotation motor, and the retraction motor controller operates to control the retraction motor; (iii) the system also includes a rotation motor controller and a retraction motor controller, the rotation motor controller operates to control the rotation motor, and the retraction motor controller operates to control the retraction motor, and one or more processors include a control processor, the control processor operates to control the rotation motor controller and the retraction motor controller or send commands to them so as to achieve a set or predetermined speed and / or position of the catheter or probe, and / or a set or predetermined rotation motor. (iv) the one or more processors include a synchronization processor, and the system also includes a first encoder signal operative for use by the rotation motor controller and a second encoder signal operative for use by the pullback motor controller, wherein the synchronization processor operates to regulate or control the first and second encoder signals; and / or (v) the one or more processors include a synchronization processor, and the system also includes a first encoder signal operative for use by the rotation motor controller and a second encoder signal operative for use by the pullback motor controller, wherein the synchronization processor operates to regulate or control the first and second encoder signals before the synchronization processor is interfaced with the data acquisition processor so that each time a depth scan is acquired on the imaging data input, information from the encoder signals is recorded for each of the rotation motor and the pullback motor to record the exact or approximate beam position for the depth scan.
[0020] In one or more embodiments, the one or more processors further include a data acquisition processor that operates to acquire imaging data acquired by the imaging device or imaging system; and the one or more processors include a synchronization processor, and the system further includes a first encoder signal that operates for use by the rotation motor controller and a second encoder signal that operates for use by the retraction motor controller, wherein the synchronization processor operates to adjust or control the first and second encoder signals before the synchronization processor interfaces with the data acquisition processor so that each time a depth scan is acquired on the imaging data input, information from the encoder signal is recorded for each of the rotation motor and the retraction motor to record an exact or approximate waveform for the depth scan. beam position, and the synchronization processor operates to use a single synchronization signal for the data acquisition processor to capture the position of the catheter or probe for each measured depth scan profile, wherein one or more of the following occurs: (i) triggering a single acquisition of the depth scan using the trigger signal and recording the values of the rotation digital counter and the pullback digital counter derived from the demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of the data acquisition processor of the system; (ii) triggering a single acquisition of the depth scan on an analog-to-digital converter (ADC) using the trigger signal and recording the values of the rotation digital counter and the pullback digital counter derived from the demodulated encoded synchronization signal is demodulated by a demodulator of the system and / or a demodulator of a data acquisition processor of the system; (iii) the trigger signal is an A-line trigger signal operative to trigger sampling of imaging data, or the trigger signal is a k-clock trigger signal operative to trigger sampling of imaging data so as to uniformly acquire imaging data at k intervals; (iv) the synchronization signal includes or comprises a resultant pulse train, the resultant pulse train being a result of superposition of pulse trains from each of the first and second encoder signals, the first and second encoder signals operative to switch at a predetermined rate per revolution of the rotation motor and / or the pullback motor, and the rotation digital counter and the pullback digital counter of the data acquisition processor operative to count the switching, thereby measuring the current position of the rotation motor and the pullback motor; (v) the encoder signal pulse has an amplitude of 2 volts (V) for the rotation motor encoder signal and a 3V amplitude for the pullback motor encoder signal, the rotation digital counter operates to increment at one or more of the following transitions: a transition from 0V to 2V, a transition from 3V to 5V and / or a transition from 0V to 5V, and the pullback digital counter operates to increment at one or more of the following transitions: a transition from 0V to 3V, a transition from 2V to 5V and / or a transition from 0V to 5V; and / or (vi) the ADC, the demodulator, and the rotation digital counter and the pullback digital counter are included in the data acquisition processor.
[0021] In one or more embodiments, the one or more processors further include a data acquisition processor that operates to acquire imaging data acquired by the imaging device or imaging system; and the one or more processors include a synchronization processor, and the system further includes a first encoder signal that operates for use by the rotation motor controller and a second encoder signal that operates for use by the pullback motor controller, wherein the synchronization processor operates to condition or control the first and second encoder signals prior to the synchronization processor being interfaced with the data acquisition processor so that each time a depth scan is acquired on the imaging data input, information from the encoder signals is recorded for each of the rotation motor and the pullback motor to record an exact or approximate beam position for the depth scan, and The synchronization processor operates to use a single synchronization signal for the data acquisition processor to capture the position of the catheter or probe for each measured depth scan profile, wherein one or more of the following occurs: (i) triggering a single acquisition of the depth scan using the trigger signal and recording the values of the rotation digital counter and the pullback digital counter derived from the demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of the data acquisition processor of the system; (ii) triggering a single acquisition of the depth scan on an analog-to-digital converter (ADC) using the trigger signal and recording the values of the rotation digital counter and the pullback digital counter derived from the demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of the data acquisition processor of the system the synchronizing signal comprises or includes a result pulse train, the result pulse train being a pulse train from the synchronizing processor, and the synchronizing processor is operative to send a pulse corresponding to an index of the first encoder signal occurring at each revolution of the rotary motor, except that the synchronizing processor modifies the pulse at a predetermined or set portion of the pullback, the predetermined or set portion of the pullback being one or more of: the start of the pullback, wherein the synchronizing processor modifies the pulse at a predetermined or set portion of the pullback, the synchronization processor modifies the pulses in a manner that the synchronization processor blanks or skips a pulse at the beginning of the pullback; the end of the pullback, wherein the synchronization processor modifies the pulses in a manner that the synchronization processor blanks or skips a pulse at the end of the pullback; the beginning and end of the pullback, wherein the synchronization processor modifies the pulses in a manner that the synchronization processor blanks or skips a pulse at the beginning of the pullback and then blanks or skips another pulse at the end of the pullback; the beginning and / or end of the pullback, wherein the synchronization processor modifies the pulses in a manner that the synchronization processor introduces additional pulses and / or delays at the beginning of the pullback and / or at the end of the pullback; at the end of the pullback, wherein the synchronization processor modifies the pulses so that a frame counter of the data acquisition processor increments at a slower rate as the rotation motor decelerates;and / or at the beginning of a pullback, wherein the synchronization processor modifies the pulses so that a frame counter of the data acquisition processor increments toward a steady rate as the rotary motor accelerates to a steady-state target.;
[0022] In one or more embodiments, one or more of the following may occur: (i) the data acquisition processor includes a frame counter that increments at a fixed, steady, or predetermined or set rate except at the beginning of a pullback, at which time the frame counter increments at approximately half the predetermined or set rate or a fraction of the predetermined or set rate, such that a jump between the beginning of the pullback and the time at which the frame counter increments at the fixed, steady, or predetermined or set rate accurately signals or indicates the beginning and / or end of the pullback, and a total pullback length and / or time is derived for each pullback if the total pullback length and / or time is known or set; (ii) one or more processors including a control processor operative to control or send commands to a rotation motor controller and a pullback motor controller so as to achieve a set or predetermined catheter or probe speed and / or position and / or a set or predetermined rotation motor and / or pullback motor speed and / or position to produce one or more scanning patterns, and the data acquisition processor including a frame counter, wherein the first encoder signal pulse train is delayed except at the end of the pullback when the synchronization processor modifies the pulses to increment at a slower rate as the rotation motor decelerates. The frame counter is incremented at a fixed, steady or predetermined or set rate, except that the frame counter is incremented by an increasing number of A-line triggers, and the control processor or one or more processors control the rotation motor to decelerate to accurately coincide with the end of the pullback to reduce or eliminate the uncertainty between the end of the pullback and the beginning of the rotation motor deceleration to accurately determine the end of the pullback and derive an approximate or accurate record of the exact beam position for each depth scan for a predetermined or set total pullback length and / or time; (iii) the rotation motor has a sharp deceleration profile, and the rotation motor is operated to decelerate the rotation motor in one rotation for each depth scan. The number of A-line triggers that occur before the counter is incremented is a significant or substantial deceleration, so that the deceleration profile of the rotary motor is large enough to be detected as a deceleration of the rotary motor rather than a change in the speed of the rotary motor; and / or (iv) the change in the speed of the rotary motor operates to cause a pulse train per a predetermined or set number of A-line triggers in normal operation, and the deceleration of the rotary motor during a time equivalent to one steady-state rotation operates for a number of A-line triggers greater than the predetermined or set number of A-line triggers, so that a threshold above the A-line trigger is set or selected and a threshold below the A-line trigger is set or selected to detect the end of the pullback.
[0023] One or more embodiments may include or have one or more of the following: (i) one or more processors also include a pullback condition processor that operates to determine a pullback condition that indicates or detects the start and / or end of a pullback; (ii) deceleration of the rotary motor is initiated by a rotary motor controller and / or by a rotary motor controller and a driver, and the rotary motor controller and / or driver operate to receive a command to control deceleration from the pullback condition processor; (iii) the pullback condition processor also operates to receive information from the rotary motor controller and / or driver to determine a pullback condition; and / or (iv) the pullback condition processor is deployed or included in a scanning mechanism of the system.
[0024] In one or more embodiments, one or more of the following may occur or exist: (i) the rotary motor rotates at a speed below a target steady-state value and then accelerates when or approximately simultaneously with the pullback motor accelerates; (ii) the data acquisition processor includes a frame counter that increments once or at a fixed, stable, or predetermined or set rate as the rotary motor accelerates to the target steady-state value; (iii) one or more processors include a control processor that operates to control or send commands to a rotary motor controller and a pullback motor controller so as to achieve a set or predetermined speed and / or position of the catheter or probe and / or a set or predetermined speed and / or position of the rotary motor and / or pullback motor to produce one or more scanning patterns, and the rotary motor acceleration is controlled by the control processor or one or more processors to accurately coincide with the start of the pullback to reduce or eliminate the start of the pullback. and / or (v) the change in rotational motor speed prior to pullback operates to result in a pulse train per predetermined or set number of A-line triggers, and the rotational motor acceleration operates for a number of A-line triggers greater than the predetermined or set number of A-line triggers during a time equivalent to one steady-state rotation, such that a threshold is set or selected to detect the start of the pullback.
[0025] One or more embodiments may include or have one or more of the following: (i) one or more processors also include a pullback condition processor that operates to determine a pullback condition that indicates or detects the start and / or end of a pullback; (ii) acceleration of the rotary motor is initiated by a rotary motor controller and / or by a rotary motor controller and a driver, and the rotary motor controller and / or driver operates to receive commands to control acceleration from the pullback condition processor; (iii) the pullback condition processor also operates to receive information from the rotary motor controller and / or driver to determine a pullback condition; and / or (iv) the pullback condition processor is deployed or included in a scanning mechanism of the system.
[0026] In one or more embodiments, the system may also include or be connected to one or more of the following: a light source that operates to generate light; an interference optical system that operates to: (i) receive light from the light source and separate it into a first light to be used to illuminate an object or sample and a second reference light, (ii) send the second reference light to reflect off a reference mirror of the interference optical system, and (iii) generate interference light by combining or recombining reflected or scattered light of the first light that has been used to illuminate an object or sample and the reflected second reference light, and causing the interference lights that generate one or more interference patterns to interfere with each other; and / or one or more detectors that operate to continuously acquire interference light and / or one or more interference patterns so that one or more A lines are obtained.
[0027] One or more embodiments may use one or more imaging modalities, wherein the one or more imaging modalities include one or more of the following: optical coherence tomography (OCT), single-modality OCT, multi-modality OCT, swept-source OCT, optical frequency domain imaging (OFDI), intravascular ultrasound (IVUS), another luminal imaging modality, near infrared spectroscopy, near infrared fluorescence (NIRF), near infrared autofluorescence (NIRAF), and an intravascular imaging modality.
[0028] In one or more embodiments, a method for controlling a system that performs image synchronization may include: using an imaging device or imaging system of the system to obtain imaging data using one or more imaging modalities; performing beam scanning on a catheter or probe of the system via a scanning mechanism of the system to obtain the beam position of the catheter or probe; and achieving image synchronization via one or more processors of the system by recording the beam position simultaneously or contemporaneously with the imaging data, and achieving accurate spatial registration of the imaging data.
[0029] In one or more embodiments, the method may further include: controlling a data acquisition processor in the one or more processors via the hardware management processor, and acquiring imaging data acquired by the imaging device or the imaging system via the data acquisition processor.
[0030] One or more methods may include: (i) rotating a scanning mechanism, a portion of the scanning mechanism and / or a catheter or probe using a rotation motor, and (ii) controlling retraction of the catheter or probe using a retraction motor, wherein catheter or probe beam scanning is performed by the scanning mechanism using the rotation motor and the retraction motor.
[0031] One or more methods may include one or more of the following: (i) controlling a data acquisition processor of one or more processors via a hardware management processor; (ii) acquiring imaging data obtained by an imaging device or imaging system via the data acquisition processor; (iii) controlling a rotation motor using a rotation motor controller of the system and controlling a retraction motor using a retraction motor controller of the system; (iv) controlling or sending commands to the rotation motor controller and the retraction motor controller via a control processor of the system so as to achieve a set or predetermined speed and / or position of the catheter or probe and / or a set or predetermined speed and / or position of the rotation motor and / or retraction motor to generate one or more scanning patterns; (v) synchronizing one or more processors via a synchronization processor (vi) regulating or controlling the first and second encoder signals, wherein the system further includes the first encoder signal operative for use by a rotation motor controller and the second encoder signal operative for use by a pullback motor controller; and / or (vii) regulating or controlling the first and second encoder signals via a synchronization processor of one or more processors prior to the synchronization processor interfacing with the data acquisition processor such that each time a depth scan is acquired on the imaging data input, information from the first and second encoder signals is recorded for each of the rotation motor and the pullback motor to record an exact or approximate beam position for the depth scan, wherein the system further includes the first encoder signal operative for use by the rotation motor controller and the second encoder signal operative for use by the pullback motor controller.
[0032] In one or more method embodiments, the one or more processors further include a data acquisition processor operative to acquire imaging data acquired by an imaging device or imaging system; and the one or more processors include a synchronization processor, and the system further includes a first encoder signal operative for use by a spin motor controller and a second encoder signal operative for use by a pullback motor controller, wherein the synchronization processor operates to condition or control the first and second encoder signals prior to the synchronization processor being interfaced with the data acquisition processor such that each time a depth scan is acquired on the imaging data input, information from the encoder signals is recorded for each of the spin motor and the pullback motor to record an exact or approximate beam position for the depth scan, and The synchronization processor operates to use a single synchronization signal for the data acquisition processor to capture the position of the catheter or probe for each measured depth scan profile, wherein the method may include one or more of the following: (i) triggering a single acquisition of the depth scan via a trigger signal of the system and recording the values of a rotation digital counter and a pullback digital counter derived from the demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of the data acquisition processor of the system; (ii) triggering a single acquisition of the depth scan on an analog-to-digital converter (ADC) via a trigger signal of the system and recording the values of a rotation digital counter and a pullback digital counter derived from the demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of the data acquisition processor of the system (iii) triggering the sampling of imaging data via a trigger signal as an A-line trigger signal, or triggering the sampling of imaging data via a trigger signal as a k-clock trigger signal so as to uniformly acquire imaging data at k intervals; (iv) using a synchronization signal including or containing a resultant pulse train, the resultant pulse train being the result of superposition of pulse trains from each of the first and second encoder signals, the first and second encoder signals operating to switch at a predetermined rate per revolution of the rotation motor and / or the pullback motor, and counting the switching via a rotation digital counter and a pullback digital counter of the data acquisition processor so as to measure the rotation motor and / or the pullback motor. the current position of the pull back motor; (v) using an encoder signal pulse having a 2 volt (V) amplitude for the rotation motor encoder signal and a 3V amplitude for the pull back motor encoder signal, wherein the rotation digital counter operates to increment at one or more of the following transitions: a transition from 0V to 2V, a transition from 3V to 5V and / or a transition from 0V to 5V, and the pull back digital counter operates to increment at one or more of the following transitions: a transition from 0V to 3V, a transition from 2V to 5V and / or a transition from 0V to 5V; and / or (vi) using a data acquisition processor, in which an ADC, a demodulator, and a rotation digital counter and a pull back digital counter are included.
[0033] In one or more methods, the one or more processors further include a data acquisition processor operative to acquire imaging data acquired by an imaging device or imaging system; and the one or more processors include a synchronization processor, and the system further includes a first encoder signal operative for use by a spin motor controller and a second encoder signal operative for use by a pullback motor controller, wherein the synchronization processor operates to condition or control the first and second encoder signals prior to the synchronization processor being interfaced with the data acquisition processor such that each time a depth scan is acquired on the imaging data input, information from the encoder signals is recorded for each of the spin motor and the pullback motor to record an exact or approximate beam position for the depth scan, and the synchronization processor The method is operable to use a single synchronization signal for a data acquisition processor to capture the position of a catheter or probe for each measured depth scan profile, wherein the method(s) may further include one or more of: (i) triggering a single acquisition of a depth scan via a trigger signal and recording values of a rotation digital counter and a pullback digital counter derived from a demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of a data acquisition processor of the system; (ii) triggering a single acquisition of a depth scan on an analog-to-digital converter (ADC) via the trigger signal and recording values of a rotation digital counter and a pullback digital counter derived from a demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of a data acquisition processor of the system (iii) triggering sampling of the imaging data via a trigger signal being an A-line trigger signal, or triggering sampling of the imaging data via a trigger signal being a k-clock trigger signal so as to uniformly acquire imaging data at k intervals; and / or (iv) using a synchronization signal comprising or including a result pulse train, the result pulse train being a pulse train from a synchronization processor, wherein the synchronization processor operates to send pulses corresponding to an index of the first encoder signal occurring at each revolution of the rotary motor, except that the synchronization processor modifies the pulses at a predetermined or set portion of the pullback, the predetermined or set portion of the pullback being one or more of the following: the beginning of the pullback, wherein the synchronization processor modifies the pulses at a predetermined or set portion ... the synchronization processor modifies the pulse in a manner that the synchronization processor blanks or skips a pulse at the beginning of the pullback; the end of the pullback, wherein the synchronization processor modifies the pulse in a manner that the synchronization processor blanks or skips a pulse at the end of the pullback; the beginning and end of the pullback, wherein the synchronization processor modifies the pulse in a manner that the synchronization processor blanks or skips a pulse at the beginning of the pullback and then blanks or skips another pulse at the end of the pullback; the beginning and / or end of the pullback, wherein the synchronization processor modifies the pulse in a manner that the synchronization processor introduces additional pulses and / or delays at the beginning of the pullback and / or at the end of the pullback; at the end of the pullback, wherein the synchronization processor modifies the pulse so that a frame counter of the data acquisition processor increments at a slower rate as the rotation motor decelerates;and / or at the beginning of a pullback, wherein the synchronization processor modifies the pulses so that a frame counter of the data acquisition processor increments toward a steady rate as the rotary motor accelerates to a steady-state target.;
[0034] One or more method embodiments may involve or have one or more of the following: (i) the data acquisition processor includes a frame counter, the frame counter increments at a fixed, steady, or predetermined or set rate except at the beginning of a pullback, at which time the frame counter increments at about half the predetermined or set rate or a fraction of the predetermined or set rate, such that a jump between the beginning of the pullback and the time when the frame counter increments at the fixed, steady, or predetermined or set rate accurately signals or indicates the beginning and / or end of the pullback, and the total pullback length and / or time is derived if the total pullback length and / or time is known or set. (ii) one or more processors including a control processor operative to control or send commands to a rotation motor controller and a pullback motor controller so as to achieve a set or predetermined catheter or probe speed and / or position and / or a set or predetermined rotation motor and / or pullback motor speed and / or position to produce one or more scan patterns, and the data acquisition processor including a frame counter, except at the end of the pullback, the synchronization processor modifies the pulses to increment at a slower rate as the rotation motor decelerates, thereby causing the first encoder signal pulse train to be incremented at a slower rate. The frame counter is incremented at a fixed, steady or predetermined or set rate, except for the delay and the frame counter is incremented by an increasing number of A-line triggers, the rotation motor deceleration is controlled by the control processor or one or more processors to accurately coincide with the end of the pullback to reduce or eliminate the uncertainty between the end of the pullback and the beginning of the rotation motor deceleration to accurately determine the end of the pullback and derive an approximate or accurate record of the exact beam position for each depth scan for a predetermined or set total pullback length and / or time; (iii) the rotation motor has a sharp deceleration profile, and the rotation motor is operated to decelerate for a predetermined or set total pullback length and / or time before the frame counter is incremented. The number of A-line triggers that occur before the pullback significantly or substantially decelerates in one rotation, so that the deceleration profile of the rotary motor is large enough to be detected as a deceleration of the rotary motor rather than a change in the rotational speed of the rotary motor; and / or (iv) the change in the speed of the rotary motor operates to cause a pulse train per a predetermined or set number of A-line triggers in normal operation, and the deceleration of the rotary motor during a time equivalent to one steady-state rotation operates to a number of A-line triggers greater than the predetermined or set number of A-line triggers, so that a threshold above the A-line trigger is set or selected and a threshold below the A-line trigger is set or selected to detect the end of the pullback.
[0035] In one or more embodiments, the (one or more) methods may also include one or more of the following: (i) determining a pullback condition indicating or detecting the start and / or end of a pullback via a pullback condition processor of one or more processors; (ii) initiating deceleration of the rotary motor via a rotary motor controller and / or via a rotary motor controller and driver, wherein the rotary motor controller and / or driver operates to receive commands to control deceleration from the pullback condition processor; (iii) receiving information from the rotary motor controller and / or driver via the pullback condition processor to determine a pullback condition; and / or (iv) using the pullback condition processor when the pullback condition processor is deployed or included in a scanning mechanism of the system.
[0036] In one or more embodiments, one or more of the following may occur: (i) the rotary motor rotates at a speed below a target steady-state value and then accelerates when or approximately simultaneously with the pullback motor acceleration; (ii) the data acquisition processor includes a frame counter that increments once or at a fixed, stable, or predetermined or set rate as the rotary motor accelerates to the target steady-state value; (iii) one or more processors include a control processor that operates to control or send commands to a rotary motor controller and a pullback motor controller so that a set or predetermined speed and / or position of the catheter or probe and / or a set or predetermined speed and / or position of the rotary motor and / or pullback motor are achieved to produce one or more scanning patterns, and the rotary motor acceleration is controlled by the control processor or one or more processors to accurately coincide with the start of the pullback to reduce or eliminate the start of the pullback and the start of the pullback. (iv) the rotary motor has a steep acceleration profile and the rotary motor operates to accelerate significantly or substantially in one rotation for a number of A-line triggers that occur before the frame counter is incremented, such that the acceleration profile of the rotary motor is large enough to be detected as an acceleration of the rotary motor to a target steady-state value rather than as a change in the rotational motor speed; and / or (v) the change in rotary motor speed before the pullback operates to result in a pulse train per a predetermined or set number of A-line triggers, and the rotary motor acceleration during a time equivalent to one steady-state rotation operates for a number of A-line triggers greater than a predetermined or set number of A-line triggers, such that a threshold is set or selected to detect the start of the pullback.
[0037] One or more method embodiments may also include one or more of the following: (i) determining a pullback condition indicating or detecting the start and / or end of a pullback via a pullback condition processor of one or more processors; (ii) initiating acceleration of a rotary motor via a rotary motor controller and / or via a rotary motor controller and driver, wherein the rotary motor controller and / or driver operates to receive commands to control acceleration from the pullback condition processor; (iii) receiving information from the rotary motor controller and / or driver via the pullback condition processor to determine a pullback condition; and / or (iv) using the pullback condition processor when the pullback condition processor is deployed or included in a scanning mechanism of the system.
[0038] In one or more embodiments, a computer-readable storage medium may store at least one program that operates to cause one or more processors to execute a method for performing image synchronization for one or more imaging modalities of a system, the method comprising: using an imaging device or imaging system of the system to obtain imaging data using one or more imaging modalities; performing beam scanning on a catheter or probe of the system via a scanning mechanism of the system to obtain a beam position of the catheter or probe; and achieving image synchronization via one or more processors of the system by recording the beam position simultaneously or contemporaneously with the imaging data, and achieving accurate spatial alignment of the imaging data.
[0039] At least one broad object of the present disclosure is to provide one or more optical devices, systems, methods (for use and / or manufacture), and storage media, such as but not limited to fiber optic catheters, endoscopes, and / or optical coherence tomography (OCT) devices and systems, and methods and storage media for use therewith, to achieve consistent, reliable image synchronization, including high efficiency and reasonable manufacturing and maintenance costs.
[0040] In one or more embodiments, a computer-readable storage medium may store at least one program that operates to cause one or more processors to execute a method for performing image synchronization, wherein the method may include one or more steps discussed herein.
[0041] According to one or more embodiments of the present disclosure, the apparatus and system, method and storage medium for performing image synchronization may also be operated to characterize biological objects, such as but not limited to blood, mucus, tissue, etc.
[0042] It should be noted that one or more embodiments of the method(s) and / or other methods for image synchronization disclosed herein may be used in other imaging systems, devices or apparatuses, wherein an image is formed by reflection and scattering of signals within a tissue sample(s) using a scanning probe. For example, an IVI modality such as IVUS may be used, wherein an IVI or IVUS image may be processed in addition to or instead of an OCT image.
[0043] One or more embodiments of the present disclosure may be used for (one or more) clinical applications, such as, but not limited to, intervascular imaging, atherosclerotic plaque assessment, cardiac stent assessment, balloon sinusoplasty, sinus stent implantation, arthroscopy, ophthalmology, otology research, veterinary use and research, and the like.
[0044] According to at least another aspect of the present disclosure, one or more of the techniques discussed herein may be employed to reduce the cost of at least one of manufacturing and maintaining one or more devices, equipment, systems, and storage media by reducing or minimizing the number of optical components and using efficient techniques to cut the use / manufacturing costs of such devices, equipment, systems, and storage media.
[0045] According to other aspects of the present disclosure, one or more additional devices, one or more systems, one or more methods, and one or more storage media using or used with one or more image synchronization techniques are discussed herein. Other features of the present disclosure will be partially understandable and will become clear in part from the following description and with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] To illustrate various aspects of the present disclosure, similar numerals indicate similar elements and simplified forms that may be used are shown in the drawings, but it should be understood that the present disclosure is not limited or restricted to the precise arrangements and tools shown. To assist those skilled in the relevant art in making and using the subject matter of the present disclosure, reference is made to the drawings, in which:
[0047] Figure 1 is a diagram illustrating an embodiment of a system that may utilize one or more image synchronization techniques according to one or more aspects of the present disclosure;
[0048] Figure 2 is a diagram of an embodiment of a catheter that may be used with at least one embodiment of an apparatus or system for performing an image synchronization technique according to one or more aspects of the present disclosure;
[0049] Figure 3 is a diagram illustrating at least one device / system embodiment for performing image synchronization technology according to one or more aspects of the present disclosure;
[0050] Figure 4 is a diagram illustrating at least one embodiment of an apparatus or system for performing an image synchronization technique according to one or more aspects of the present disclosure;
[0051] Figure 5 is a diagram illustrating at least one embodiment of an apparatus or system for using a synchronization signal for data acquisition to capture a probe position for each measured depth profile according to one or more aspects of the present disclosure;
[0052] Figure 6 is a diagram illustrating at least one additional embodiment of an apparatus or system for using a synchronization signal for data acquisition to capture a probe position for each measured depth profile in accordance with one or more aspects of the present disclosure;
[0053] Figure 7 is a diagram illustrating at least one embodiment of an apparatus or system using a synchronization technique and using a pullback motor and a controller according to one or more aspects of the present disclosure;
[0054] Figure 8 is a flowchart of at least one embodiment of an image synchronization method or technology according to one or more aspects of the present disclosure;
[0055] Fig. 9 is a diagram illustrating an embodiment of at least another system that may utilize one or more image synchronization techniques according to one or more aspects of the present disclosure;
[0056] Fig.10 is a diagram illustrating an embodiment of at least another system that may utilize one or more image synchronization techniques according to one or more aspects of the present disclosure;
[0057] Fig.11 is a diagram illustrating an embodiment of at least one more system that can utilize one or more image synchronization techniques according to one or more aspects of the present disclosure;
[0058] Fig.12 is a flow chart illustrating at least one method embodiment of performing an imaging feature, function, or technique that may be used with one or more image synchronization techniques in accordance with one or more aspects of the present disclosure;
[0059] Fig.13 A schematic diagram illustrating an embodiment of a computer that may be used with one or more embodiments of at least one apparatus, system, method, and / or storage medium, including but not limited to, for performing one or more image synchronization techniques according to one or more aspects of the present disclosure; and
[0060] Fig.14A schematic diagram of another embodiment of a computer that can be used with one or more embodiments of at least one apparatus, system, method, and / or storage medium, including but not limited to, for performing one or more image synchronization techniques according to one or more aspects of the present disclosure is shown. DETAILED DESCRIPTION
[0061] Disclosed herein are one or more devices / apparatuses, optical systems, methods, and storage media for performing one or more image synchronization techniques.
[0062] Turning now to the details of the drawings, Figure 1 An OCT system 100 (referred to herein as "system 100" or "the system 100") operating to utilize OCT technology, including but not limited to one or more embodiments of the image synchronization techniques discussed herein, with an optical probe application according to one or more aspects of the present disclosure is shown. System 100 includes a light source 101, a reference arm 102, a sample arm 103, a beam splitter 104 (also referred to herein as a "beam splitter"), a reference mirror (also referred to herein as a "reference reflective element") 105, and one or more detectors 107. System 100 may include a phase shifting device or phase shifting unit 130, and in one or more embodiments, the phase shifting device or phase shifting unit may be omitted. In one or more embodiments, system 100 may include a patient interface device or patient interface unit ("PIU") 110 and a catheter 120 (such as Figure 1-2 ), and the system 100 can interact with a sample or target 106 (e.g., via a catheter 120 / probe and / or PIU 110). In one or more embodiments, the system 100 includes an interferometer, or the interferometer is defined by one or more components of the system 100 (such as but not limited to at least a light source 101, a reference arm 102, a sample arm 103, a beam splitter 104, and a reference mirror 105).
[0063] The light source 101 operates to generate light to the beam splitter 104, which splits the light from the light source 101 into a reference beam that enters the reference arm 102 and a sample beam that enters the sample arm 103. The beam splitter 104 is positioned or disposed at an angle with a reference mirror 105, one or more detectors 107, and a sample or target 106. The reference beam passes through a phase shift unit 130 (when included in the system, as shown in the system 100), and the reference beam is reflected from the reference mirror 105 in the reference arm 102, while the sample beam is reflected or scattered from the sample 106 by the PIU (patient interface unit; also referred to herein as patient interface component (PIC)) 110 and catheter 120 in the sample arm 103. Both the reference beam and the sample beam are combined (or recombined) at the beam splitter 104 and generate an interference pattern. The output of the system 100 and / or its interferometer is continuously acquired with one or more detectors 107 (such as, but not limited to, a photodiode or a multi-array camera). The one or more detectors 107 measure the interference or interference pattern between the two radiation or light beams that are combined or recombined. In one or more embodiments, the reference beam and the sample beam have traveled different optical path lengths such that a fringe effect is produced and can be measured by one or more detectors 107. The electrical analog signals obtained from the output of the system 100 and / or its interferometers are converted into digital signals for analysis by a computer such as, but not limited to, computers 1200, 1200′ ( Fig.13 or Fig.14 In one or more embodiments, the light source 101 may be a radiation source or a broadband light source that radiates in a wide wavelength band. In one or more embodiments, a Fourier analyzer including software and electronic devices may be used to convert the electrical analog signal into a spectrum.
[0064] The light source 101 may include multiple light sources or may be a single light source. In one or more embodiments, the light source 101 generates broadband laser light. The light source 101 may include one or more of a laser, an organic light emitting diode (OLED), a light emitting diode (LED), a halogen lamp, an incandescent lamp, a laser-pumped supercontinuum light source, and / or a fluorescent lamp. The light source 101 may be any light source that provides light, which may then be split into at least three bands, each of which is further dispersed to provide light that is subsequently used for spectral encoding of spatial information. The light source 101 may be fiber-coupled or may be free-space coupled to other components of one or more systems discussed herein (such as, but not limited to, system 100, system 100a, system 100', system 100'', system 100''', etc.).
[0065] According to at least one aspect of the present disclosure, features of an OCT system are implemented using optical fibers. As mentioned above, one application of the OCT technology of the present disclosure is to use an OCT having a catheter 120, such as Figure 1-2 As shown schematically in FIG.
[0066] Figure 2 An embodiment of a catheter 120 is shown, comprising a sheath 121, a coil 122, a protector 123, and an optical probe 124. Figure 1-2 As schematically shown in , catheter 120 is preferably connected to PIU 110 to spin coil 122 by pulling back (e.g., at least one embodiment of PIU 110 operates to spin coil 122 by pulling back). Coil 122 delivers torque from its proximal end to its distal end (e.g., via or through a rotary motor in PIU 110). In one or more embodiments, coil 122 is fixed / fixed to optical probe 124 together with optical probe 124 so that the distal tip of optical probe 124 also spins to see an omnidirectional view of the biological organ, sample, or material being evaluated (such as but not limited to a hollow organ such as a blood vessel, heart, etc.). For example, the fiber optic catheter and endoscope can reside in a sample arm of an OCT interferometer (such as sample arm 103, as shown in FIG. 1 ). Figure 1 ) in order to provide access to internal organs, such as intravascular images, the gastrointestinal tract, or any other narrow areas that are difficult to access. As the light beam of the optical probe 124 passing through the catheter 120 or the interior of the endoscope rotates over the surface of interest, a cross-sectional image of one or more samples is obtained. In order to obtain three-dimensional data, the optical probe 124 is simultaneously translated longitudinally during the rotational spin, thereby generating a spiral scanning pattern. This translation can be performed by pulling the tip of the probe 124 back toward the proximal end and is therefore referred to as a pullback.
[0067] In one or more embodiments, the PIU 110 may include or comprise a connection component (or interface module), such as a swivel joint, to connect one or more components (such as one or more components of the probe (e.g., the catheter 120 (see, e.g., Figure 1-2)), needle, capsule, patient interface unit or patient interface component (e.g., PIU110), etc.) is connected to one or more other components (such as optical components, light sources (e.g., light source 101), deflection sections (e.g., such as deflection sections or deflected sections, which are components that operate to deflect light from the light source to the interference optical system and then send the light received from the interference optical system toward at least one detector; deflection or steering sections, which include at least one of the following: one or more interferometers, circulators, beam splitters, isolators, couplers, fused fiber couplers, partially cut mirrors with holes therein, and partially cut mirrors with taps; etc.), sample arm 103, a motor that operates to power the connection components and / or PIU110, etc.). For example, when the connection member or interface module is a rotary joint, the rotary joint preferably operates as discussed below. In one or more other embodiments, the rotary joint can be at least one of the following: a contact rotary joint, a lensless rotary joint, a lens-based rotary joint, or other rotary joints known to those skilled in the art.
[0068] In at least one embodiment, the PIU 110 can include a fiber optic rotary joint (FORJ), a rotary motor and a translation motorized platform (e.g., part of the PIU 110), and a catheter connector (e.g., part of the PIU 110). The FORJ allows for uninterrupted transmission of optical signals while rotating the optical fiber along the fiber axis. The FORJ can have a free space optical beam combiner including a rotor and a stator.
[0069] At least one embodiment of an imaging system or imaging device according to one or more features of the present disclosure is prototyped to investigate the feasibility of synchronizing the acquisition of images with the position of the probe throughout the probe scan. In at least one embodiment, the probe can be a catheter having a fixed outer layer and a rotatable and translatable inner core, the inner core including an optical fiber and a distal optic to focus light on the sample.
[0070] Volumetric images of luminal organs (such as coronary arteries) can be obtained by rapidly rotating and simultaneously translating the inner core of the catheter to obtain cross-sectional images. One or more embodiments of the system or device may include an imaging system, an imaging catheter, and a patient interface unit (PIU). The PIU (e.g., PIU 110, any other PIU discussed herein, etc.) can be used to scan the catheter core so that the beam delivered and recovered by the imaging catheter can then be recovered by the system or device to generate an image of the luminal organ.
[0071] Figure 3A general schematic diagram of at least one embodiment of the present disclosure is shown, which may include a multi-modal swept source optical coherence tomography and laser induced near infrared autofluorescence system. The system may also be a single modality OCT, OFDI, any other imaging modality discussed herein, etc., or the system may use a different second modality, such as near infrared spectroscopy or other modalities. The system 100a may include an OCT light source 101, a NIRF or NIRAF light source 101, a beam splitter 104, a deflection section 108, one or more circulators 901, a reference arm 102 including a reference reflective element 105 (which may or may not include a reference delay portion of the reference arm 102), a combiner 903, (one or more) OCT detectors 107, (one or more) NIRF and / or NIRAF detectors 107, a computer and / or data acquisition unit (such as but not limited to a computer 1200, a computer 1200', any other processor or computer discussed herein, etc.), and a sample arm including a PIU 110 and a catheter 120. Light from the imaging system 100a may be directed along the sample arm 103 to the PIU 110 and the imaging catheter 120 and may then pass through the OCT detector(s) 107 and / or the NIRF and / or NIRAF detector(s) 107 .
[0072] Figure 4At least one embodiment of a block diagram and flow chart of signal and imaging data connections between elements of the data acquisition processor or unit 210 and the hardware management processor or unit 220 and the PIU 110 and the synchronization unit 300 is shown. In one or more embodiments, the scanning mechanism may be included in the PIU 110 or may be part of the PIU 110. The synchronization unit 300 operates to allow the beam position to be recorded simultaneously with the imaging data (e.g., from and / or stored in the imaging data unit 301), thereby achieving accurate spatial registration of the imaging data. The imaging data obtained by the imaging system can be acquired by the data acquisition processor or unit 210 under the control of the hardware management processor or unit 220. The beam scanning of the catheter 120 can be performed by the scanning mechanism enclosed in the PIU 110 using a motor 260 for rotation (e.g., a rotation motor 260) and a motor 270 for retraction (e.g., a retraction motor 270). Each motor 260, 270 can be controlled by a motor controller and driver 240, 250, respectively. The control unit or processor 230 may be included in the PIU 110 and may be responsible for commanding each motor controller and driver 240, 250 to achieve certain desired speeds and / or positions to produce certain desired scan patterns. The corresponding encoder signals 280, 290 may be configured to be available to the motors 260, 270 and the synchronization processor or unit 300. In one or more embodiments, the encoder signals 280, 290 may be conditioned by the synchronization unit 300 prior to interfacing the synchronization processor or unit 300 with the data acquisition unit 210 so that each time a depth scan is acquired on the imaging data input or received via the catheter 120, information from the encoder signals 280, 290 may be recorded for each corresponding motor 260, 270 to approximately and accurately record the exact beam position for that depth scan.
[0073] One or more embodiments (e.g., Figure 5) can utilize a single synchronization signal for the data acquisition unit 210 to capture the probe position for each measured depth profile. For example, the A-line trigger signal 310 can be used to trigger a single acquisition of a depth scan on the analog-to-digital converter (ADC) 331, and also to record the values of digital counters (e.g., rotation digital counter 342 and pullback digital counter 343) derived from the demodulated encoded synchronization signal 340, which is demodulated with a demodulator 341 of the data acquisition processor or unit 350 (in one or more embodiments, the data acquisition processor or unit 350 can be located in or a part of the data acquisition processor or unit 210). For example, the k-clock trigger signal 320 can be used to trigger sampling of the imaging data 330 (and / or the imaging data 301) so that the imaging data is uniformly acquired at k intervals. The synchronization signal 340 can be a result pulse train, which can be the result of the superposition of pulse trains from each of the two encoder signals 280, 290, which can switch at a given rate per motor revolution. In one or more embodiments, the encoder signal pulses can have a 2V amplitude for the rotary encoder signal and a 3V amplitude for the pullback signal. Therefore, the rotary digital counter can be incremented at one or more of the following transitions: a transition from 0V to 2V, a transition from 3V to 5V, or a transition from 0V to 5V, and the pullback digital counter is incremented at one or more of the following transitions: a transition from 0V to 3V, a transition from 2V to 5V, or a transition from 0V to 5V. By counting these transitions using a digital counter, the current motor position can be measured. The ADC converter 331, the demodulation unit 341, and the digital counters 342, 343 can be included in the data acquisition unit 350.
[0074] Figure 6At least one embodiment of the present disclosure is shown in which a single synchronization signal can be used for the data acquisition processor or unit 210 to capture the probe position for each measured depth profile. For example, the trigger signal 410 can be used to trigger a single acquisition of a depth scan on the analog-to-digital converter (ADC) 431, and also record the value of the frame counter 441 derived from the synchronization signal 440 input for each acquired depth scan. For example, the k-clock trigger signal 420 can be used to trigger the sampling of imaging data (e.g., from the imaging data 430) so that the imaging data is uniformly acquired at k intervals. The synchronization signal 440 can be a resultant pulse train as a pulse train from the synchronization processor or unit 300. In one or more embodiments, the synchronization processor or unit 300 operates to send a pulse corresponding to an index of the encoder signal 280 that can occur at each revolution of the rotary motor 260, except at the beginning of the pullback in one or more embodiments, at the beginning of the pullback, the synchronization processor or unit 300 modifies the pulse in a manner that the synchronization processor or unit 300 blanks (e.g., the synchronization processor or unit 300 can blank by skipping one pulse at the beginning of the pullback). In one or more embodiments, the rotary motor (e.g., rotary motor 260) rotates at a nearly steady rate, such as once every 500 A-line triggers. In one or more embodiments, the frame counter 441 increments at a relatively steady rate, such as once every 500 A-line triggers, except in one or more embodiments at the beginning of a pullback, at which time the frame counter 441 may increment at about half the original rate or after about 1000 A-line triggers. This jump can be used to accurately determine the beginning of the pullback, and therefore derive an approximate record of the exact beam position for that depth scan, assuming the total pullback length / time is known or set a priori or in advance.
[0075] In another embodiment, in addition to at the end of the pullback in one or more embodiments, the synchronization processor or unit 300 may be operative to send a pulse corresponding to an index of the encoder signal 280 that may occur at each revolution of the rotary motor 260, at the end of the pullback, the synchronization processor or unit (e.g., the synchronization processor or unit 300) may modify the pulse in such a way that the synchronization processor or unit 300 blanks (e.g., the synchronization processor or unit 300 may blank by skipping one pulse at the end of the pullback). This skipping may be used to accurately determine the end of the pullback, and therefore derive an approximate or accurate record of the exact beam position for that depth scan, assuming the total pullback length / time is known a priori or in advance.
[0076] In one or more other embodiments, the synchronization processor or unit 300 may be operative to send pulses corresponding to indices of the encoder signal 280 that may occur at each revolution of the rotary motor 260, in addition to at the beginning and end of the pullback (e.g., the synchronization processor or unit 300 may blank by skipping one pulse at the end of the pullback), at which the synchronization processor or unit 300 modifies the pulses in such a way that the synchronization processor or unit 300 blanks (e.g., the synchronization processor or unit 300 may blank by skipping one pulse at the beginning of the pullback and another pulse at the end of the pullback). These two skips may be used to accurately determine the beginning and end of the pullback, and thus derive an approximate or accurate record of the exact beam position for that depth scan. In one or more embodiments, a priori or prior knowledge of the total pullback length / time may or may not be used.
[0077] In one or more other embodiments, the synchronization processor or unit 300 may be operative to send pulses corresponding to indices of the encoder signal 280 that may occur at each revolution of the rotary motor 260, in addition to at the beginning and / or end of a pullback, at which the synchronization processor or unit 300 modifies the pulses in a manner that the synchronization processor or unit 300 introduces additional pulses and / or delayed pulses at the beginning and / or end of the pullback instead of blanking. The jump in the number of A-line flip-flops for the frame counter 441 to increment may be used to accurately determine the beginning and / or end of the pullback and thus derive an approximate record of the exact beam position for that depth scan.
[0078] In one or more additional embodiments, the synchronization signal 440 may be a resultant pulse train as a pulse train from the synchronization processor or unit 300. In one or more embodiments, the synchronization processor or unit 300 may operate to send pulses corresponding to the index of the encoder signal 280 that may occur at each revolution of the rotary motor (e.g., rotary motor 260). In one or more embodiments, the rotary motor (e.g., rotary motor 260) may rotate at a nearly constant speed, such as once every 500 A-line triggers. In one or more embodiments, the frame counter 441 may be incremented at a relatively constant rate, such as once every 500 A-line triggers, except at the end of the pullback, at which point the frame counter 441 may be incremented at a slower rate as the rotary motor 260 decelerates. In one or more embodiments, as the rotary motor (e.g., rotary motor 260) decelerates, the encoder signal 280 pulse train may be further delayed, and the frame counter 441 may be incremented by a predetermined increasing number of A-line triggers or an increasing number of A-line triggers. The deceleration may be commanded by the control processor or unit 230 to coincide exactly with the end of the pullback to reduce the uncertainty between the end of the pullback and the start of the spin motor deceleration. This deceleration of the frame counter 441 incrementing may be used to accurately determine the end of the pullback, and thus, assuming the total pullback length / time is known a priori or in advance, an approximate record of the exact beam position for that depth scan may be derived. In one or more embodiments, the spin motor 260 may have a sharp deceleration profile such that the spin motor 260 may decelerate significantly in one revolution for the number of A-line triggers that occur before the frame counter 441 is incremented, such that the spin motor 260 deceleration profile is large enough to be detected as a deceleration of the spin motor 260, rather than as a change in the rotational motor speed. For example, in one or more embodiments, a change in motor speed may result in a pulse train of every 500±2 A-line triggers in normal operation, but the motor deceleration during the time equivalent to one steady-state revolution may be at least 510 A-line triggers. As such, a threshold above a predetermined number of A-line triggers and below another predetermined number of A-line triggers may be selected to detect the end of the pullback, such as but not limited to above 502 and below 510 A-line triggers.
[0079] In one or more other embodiments, the synchronization processor or unit 300 may be operative to send pulses corresponding to indices of the encoder signal 280 that may occur at each revolution of the rotary motor 260. In at least one embodiment, the rotary motor 260 may be rotated at a speed such as, but not limited to, 490 A-line flip-flops per revolution or any other set or predetermined number of A-line flip-flops per revolution that is lower than a target steady-state value of one revolution per 500 A-line flip-flops or any other set or predetermined target steady-state value of a certain number of revolutions per set number of A-line flip-flops. The rotary motor (e.g., rotary motor 260, Figure 7 The rotation motor 560, etc.) can then be pulled back by the pull-back motor (e.g., the pull-back motor 270, Figure 7 The start of the pullback may be determined as long as the frame counter 441 is incremented at a relatively steady rate, such as once every 500 A-line triggers (or any other set or predetermined amount per set or predetermined amount of A-line triggers), as the rotation motor 260 is accelerated to its steady-state target (this may be set manually by the user, may be set automatically by any algorithm, method or processor or unit discussed herein, etc.). The acceleration may be commanded by the control processor or unit 230 to coincide exactly with the start of the pullback to reduce the uncertainty between the start of the pullback and the start of the rotation motor acceleration (e.g., acceleration of the rotation motor 260, acceleration of the rotation motor 560, etc.). This stabilization of the frame counter 441 increments may be used to accurately determine the start of the pullback, and thus, assuming the total pullback length / time is known a priori or in advance, an approximate record of the exact beam position for that depth scan may be derived or used to determine. In one or more embodiments, the rotary motor 260 may have a sharp acceleration profile, such that the rotary motor 260 may accelerate significantly in one rotation for the number of A-line triggers that occur before the frame counter 441 is incremented, such that the acceleration profile of the rotary motor 260 is large enough to be detected as the rotary motor 260 accelerating to a steady-state value rather than being detected as a change in the rotational speed of the rotary motor. For example, a change in motor speed before pullback may result in a pulse train of every 490±2 A-line triggers, but the motor accelerating to a steady-state pullback speed rotation of 500±2 A-line triggers may always be achieved in a deterministic manner, preferably in one rotation. As such, a threshold value may be selected to detect the start of pullback, and / or a threshold value for a change in motor speed before pullback or a threshold value for steady-state pullback speed rotation may be set.
[0080] In one or more additional embodiments, a combination of one or more features of the above-mentioned embodiments may be implemented to detect both the start and end of the pullback. One or more variations of the above-mentioned embodiments may be such that the start of acceleration and / or deceleration of the rotary motor 560 may be initiated by the rotary motor controller and driver 540 and may be detected from, for example, Figure 7 The pull back status unit 595 shown receives its command. The pull back (PB) status processor or unit 595 can receive commands from Figure 7 The pull-back motor controller and driver 550 shown in FIG. 1 or from FIG. Figure 7 The encoder signal 590 shown in determines the pullback condition. If the encoder signal 580 is fully compatible with the data acquisition unit 510, then the synchronization processor or unit 600 can be configured to provide signal conditioning or can be bypassed. Figure 7 The structure shown in can be combined with the above for the present disclosure Figure 1-6 Any of the above mentioned features are discussed for use together.
[0081] The description of similarly numbered elements present in system 100' and already described above (such as for system 100 and / or for system 100a) should not be repeated and are incorporated herein by reference in their entirety. Additionally or alternatively, in one or more embodiments in which similarly named elements have different numbers (e.g., such as Figure 4 and Figure 7 ), it should be understood that any feature discussed for similarly named elements with different numbers may be used for one or all such similarly named elements. Figure 4 A data acquisition processor or unit 210, a hardware management device 220, a control processor or unit 230, a rotation motor controller and driver 240, a pullback motor controller and driver 250, a rotation motor 260, a pullback motor 270, an encoder signal 280, an encoder signal 290, and a synchronization processor or unit 300 are shown, but one or more embodiments of the present disclosure may additionally or alternatively include similarly named (one or more) elements with different numbers, such as but not limited to, Figure 7, a data acquisition processor or unit 510, a hardware management device 520, a control processor or unit 530, a rotation motor controller and driver 540, a retraction controller and driver 550, a rotation motor 560, a retraction motor 570, an encoder signal 580, an encoder signal 590 and a synchronization processor or unit 600 are shown. In fact, one or more embodiments may include one or more of the following: a data acquisition unit 210 and / or a data acquisition unit 510, a hardware management device 220 and / or a hardware management device 520, a control processor or unit 230 and / or a control processor or unit 530, a rotation motor controller and driver 240 and / or a rotation motor controller and driver 540, a pullback controller and driver 250 and / or a pullback controller and driver 550, a rotation motor 260 and / or a rotation motor 560, a pullback motor 270 and / or a pullback motor 570, an encoder signal 280 and / or an encoder signal 580, an encoder signal 290 and / or an encoder signal 590, a synchronization processor or unit 300 and / or a synchronization processor or unit 600, etc.
[0082] In at least one embodiment, the console 1200, 1200' operates to control the movement of a motor and a translational motorized stage (hereinafter referred to as "motor" or "motor and stage"), acquire intensity data from at least one detector 107, and display the scanned image (e.g., on a monitor or screen, such as Fig.13 Console 1200 and / or Fig.14 In one or more embodiments, the console 1200, 1200' operates to change the speed of the motor and / or stop the motor. The motor can be a stepper motor or a DC servo motor to control speed and improve position accuracy. In one or more embodiments, the console 1200, 1200' can be operated to control any one of the above-mentioned processors or units, controllers and drivers, signals and / or motors, etc., including but not limited to: data acquisition unit 210 and / or data acquisition unit 510, hardware management device 220 and / or hardware management device 520, control processor or unit 230 and / or control processor or unit 530, rotation motor controller and driver 240 and / or rotation motor controller and driver 540, pullback controller and driver 250 and / or pullback controller and driver 550, rotation motor 260 and / or rotation motor 560, pullback motor 270 and / or pullback motor 570, encoder signal 280 and / or encoder signal 580, encoder signal 290 and / or encoder signal 590, synchronization processor or unit 300 and / or synchronization processor or unit 600, etc.
[0083] In one or more embodiments, the console or computer 1200, 1200' operates to control the system 100 and / or system 100a (as well as other systems, such as but not limited to system 100', system 100", system 100''', etc., as further discussed below), the catheter 120, and / or one or more of the other above-mentioned components of the system 100 and / or system 100a. In at least one embodiment, the console or computer 1200, 1200' operates to acquire intensity data from at least one detector 107 of the OCT system / device / apparatus and display (one or more) images (e.g., on a monitor or screen, such as Fig.13 Console 1200 and / or Fig.14 The output of one or more components of the system 100 and / or system 100a (and other systems such as, but not limited to, system 100', system 100", system 100'', etc., as further discussed below) is acquired using at least one detector 107 of the OCT system / device / apparatus (such as, but not limited to, a photodiode, (one or more) photomultiplier tubes (PMTs), (one or more) line scan cameras, or (one or more) multi-array cameras). The electrical analog signal or one or more components thereof obtained from the output of the system 100 and / or system 100a (and / or other systems such as, but not limited to, system 100', system 100", system 100'', etc., as further discussed below) is converted into a digital signal for use with a computer (such as, but not limited to, computer 1200, 1200' (e.g., Figure 1 , Figure 3-7 , Figure 9-11 and Figure 13-14 In one or more embodiments, the light source 101 can be a radiation source or a broadband light source that radiates in a wide wavelength band. In one or more embodiments, a Fourier analyzer including software and electronic devices can be used to convert the electrical analog signal into a spectrum. In some embodiments, at least one detector 107 includes three detectors configured to detect three different light bands.
[0084] In one or more embodiments, one or more imaging techniques may be used, such as, but not limited to, various OCT imaging techniques, lumen edge detection, stent strut detection, and / or artifact detection techniques, as well as other techniques discussed at least in U.S. Patent Application No. 62 / 901,472, which is incorporated herein by reference in its entirety. In one or more embodiments of the present disclosure, an OCT image is formed in a polar coordinate system based on A-lines. Each A-line includes more information about the object being imaged, such as, but not limited to: clear indications of artifacts from metallic objects (e.g., stents, stent struts, guidewires, PIU reflections, catheter / probe reflections, noise artifacts, etc.), such as narrow signal widths and / or sharp rising and falling edges; significant differences in signal intensity and shape of unobstructed soft tissue compared to sheath reflections and other artifacts (e.g., wide signal widths and gentle falling edges). Each A-line can represent a cross-sectional 1D sampling of a target, sample, object, etc. (such as, but not limited to, a blood vessel) along a certain viewing angle. As the imaging probe or device rotates (e.g., about 0 to about 360 degrees, about 180 degrees to about 360 degrees, about 360 degrees, etc.), the corresponding A-lines form a complete two-dimensional (2D) cross-section of a target, sample, object, etc. (e.g., a blood vessel) in polar coordinates, which are then converted to Cartesian coordinates to form a tomo-view image of the cross-section of the target, sample, object, etc. (e.g., a blood vessel).
[0085] In accordance with at least one aspect of the present disclosure and as noted above, one or more additional methods for lumen, stent and / or artifact detection in OCT images are provided herein and discussed in U.S. patent application No. 16 / 414,222 filed on May 16, 2019, the entire disclosure of which is incorporated herein by reference in its entirety.
[0086] Regardless of the method used, in one or more embodiments, a predetermined or determined threshold can be used to detect the most important pulse that can correspond to the lumen edge in a particular A-line (in one or more embodiments, the most important pulse represents the largest peak and its associated leading edge is also referred to as the "main peak / main edge"; such data may contain or include artifact edge pixels). Any pulse above the threshold is an edge pulse of the object candidate. In terms of the area under the pulse, the largest pulse among all candidates is considered to be the largest peak (also referred to herein as the "most important pulse" or "main peak / main edge", etc.).
[0087] One or more embodiments of the present disclosure may use OCT signals and / or NIRF and / or NIRAF signals (e.g., at the PIU output connector) to determine image synchronization, and / or may use OCT signals and / or NIRF and / or NIRAF signals regarding or for the PIU output connector and the catheter connector to determine image synchronization.
[0088] If via Figure 1-7 As shown in the figure numbers in , although not limited to such examples, one or more of the subject devices or systems can have the same or similar components (or one or more of the same or similar components) as other devices or systems discussed herein. For example, one or more devices can have a light source 101, a beam splitter 104 or a deflection section 108, one or more circulators 901, a reference arm 102, a sample arm 103, a PIU 110, a catheter 120 or a probe, a reference reflective element 105, a detector (e.g., a light receiver, a photodiode, etc.) 107, a computer, a processor or other type of data acquisition unit (DAQ) (e.g., a computer or processor 1200, a computer or processor 1200', etc.), etc. Reference is made throughout the disclosure to Figure 1-7 , Figure 9-11 and Figure 13-14 Numerous non-limiting, non-exhaustive examples of embodiments of such components are discussed, and details of one or more embodiments (s) of one or more of such components will not be repeated with reference to figures discussed later in this disclosure.
[0089] At least one image synchronization method embodiment of the present disclosure describes steps that can be used to determine image synchronization (e.g., Figure 8 In one or more embodiments, determining image synchronization may include one or more of the following: (i) using an imaging device or imaging system of the system to obtain imaging data using one or more imaging modalities (see, e.g. Figure 8 (ii) performing beam scanning on a catheter or a probe of the system (eg, via a scanning mechanism of the system) (eg, see Figure 8 (iii) achieving image synchronization and accurate spatial registration of the imaging data by recording the beam position simultaneously or contemporaneously with the imaging data (see e.g. Figure 8 One or more methods may include one or more features of the methods discussed herein.
[0090] In one or more embodiments, a method for controlling a system that performs image synchronization may include: using an imaging device or imaging system of the system to obtain imaging data using one or more imaging modalities; performing beam scanning on a catheter or probe of the system via a scanning mechanism of the system to obtain the beam position of the catheter or probe; and achieving image synchronization via one or more processors of the system by recording the beam position simultaneously or contemporaneously with the imaging data, and achieving accurate spatial registration of the imaging data.
[0091] In one or more embodiments, the method may further include: controlling a data acquisition processor in one or more processors via the hardware management processor, and acquiring imaging data acquired by the imaging device or the imaging system via the data acquisition processor.
[0092] One or more methods may include: (i) rotating a scanning mechanism, a portion of the scanning mechanism and / or a catheter or probe using a rotation motor, and (ii) controlling retraction of the catheter or probe using a retraction motor, wherein catheter or probe beam scanning is performed by the scanning mechanism using the rotation motor and the retraction motor.
[0093] One or more methods may include one or more of the following: (i) controlling a data acquisition processor of one or more processors via a hardware management processor; (ii) acquiring imaging data obtained by an imaging device or imaging system via the data acquisition processor; (iii) controlling a rotation motor using a rotation motor controller of the system and controlling a retraction motor using a retraction motor controller of the system; (iv) controlling or sending commands to the rotation motor controller and the retraction motor controller via a control processor of the system so as to achieve a set or predetermined speed and / or position of the catheter or probe and / or a set or predetermined speed and / or position of the rotation motor and / or retraction motor to generate one or more scanning patterns; (v) synchronizing one or more processors via a synchronization processor (vi) regulating or controlling the first and second encoder signals, wherein the system further includes the first encoder signal operative for use by a rotation motor controller and the second encoder signal operative for use by a pullback motor controller; and / or (vii) regulating or controlling the first and second encoder signals via a synchronization processor of one or more processors prior to the synchronization processor interfacing with the data acquisition processor such that each time a depth scan is acquired on the imaging data input, information from the first and second encoder signals is recorded for each of the rotation motor and the pullback motor to record an exact or approximate beam position for the depth scan, wherein the system further includes the first encoder signal operative for use by the rotation motor controller and the second encoder signal operative for use by the pullback motor controller.
[0094] In one or more method embodiments, the one or more processors further include a data acquisition processor operative to acquire imaging data acquired by an imaging device or imaging system; and the one or more processors include a synchronization processor, and the system further includes a first encoder signal operative for use by a spin motor controller and a second encoder signal operative for use by a pullback motor controller, wherein the synchronization processor operates to condition or control the first and second encoder signals prior to the synchronization processor being interfaced with the data acquisition processor such that each time a depth scan is acquired on the imaging data input, information from the encoder signals is recorded for each of the spin motor and the pullback motor to record an exact or approximate beam position for the depth scan, and The synchronization processor operates to use a single synchronization signal for the data acquisition processor to capture the position of the catheter or probe for each measured depth scan profile, wherein the method may include one or more of the following: (i) triggering a single acquisition of the depth scan via a trigger signal of the system and recording the values of a rotation digital counter and a pullback digital counter derived from the demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of the data acquisition processor of the system; (ii) triggering a single acquisition of the depth scan on an analog-to-digital converter (ADC) via a trigger signal of the system and recording the values of a rotation digital counter and a pullback digital counter derived from the demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of the data acquisition processor of the system (iii) triggering the sampling of imaging data via a trigger signal as an A-line trigger signal, or triggering the sampling of imaging data via a trigger signal as a k-clock trigger signal so as to uniformly acquire imaging data at k intervals; (iv) using a synchronization signal including or containing a resultant pulse train, the resultant pulse train being the result of superposition of pulse trains from each of the first and second encoder signals, the first and second encoder signals operating to switch at a predetermined rate per revolution of the rotation motor and / or the pullback motor, and counting the switching via a rotation digital counter and a pullback digital counter of the data acquisition processor so as to measure the rotation motor and / or the pullback motor. the current position of the pull back motor; (v) using an encoder signal pulse having a 2 volt (V) amplitude for the rotation motor encoder signal and a 3V amplitude for the pull back motor encoder signal, wherein the rotation digital counter operates to increment at one or more of the following transitions: a transition from 0V to 2V, a transition from 3V to 5V and / or a transition from 0V to 5V, and the pull back digital counter operates to increment at one or more of the following transitions: a transition from 0V to 3V, a transition from 2V to 5V and / or a transition from 0V to 5V; and / or (vi) using a data acquisition processor, in which an ADC, a demodulator, and a rotation digital counter and a pull back digital counter are included.
[0095] In one or more methods, the one or more processors further include a data acquisition processor operative to acquire imaging data acquired by an imaging device or imaging system; and the one or more processors include a synchronization processor, and the system further includes a first encoder signal operative for use by a spin motor controller and a second encoder signal operative for use by a pullback motor controller, wherein the synchronization processor operates to condition or control the first and second encoder signals prior to the synchronization processor being interfaced with the data acquisition processor such that each time a depth scan is acquired on the imaging data input, information from the encoder signals is recorded for each of the spin motor and the pullback motor to record an exact or approximate beam position for the depth scan, and the synchronization processor The method is operable to use a single synchronization signal for a data acquisition processor to capture the position of a catheter or probe for each measured depth scan profile, wherein the method(s) may further include one or more of: (i) triggering a single acquisition of a depth scan via a trigger signal and recording values of a rotation digital counter and a pullback digital counter derived from a demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of a data acquisition processor of the system; (ii) triggering a single acquisition of a depth scan on an analog-to-digital converter (ADC) via the trigger signal and recording values of a rotation digital counter and a pullback digital counter derived from a demodulated encoded synchronization signal, the encoded synchronization signal being demodulated using a demodulator of the system and / or a demodulator of a data acquisition processor of the system (iii) triggering sampling of the imaging data via a trigger signal being an A-line trigger signal, or triggering sampling of the imaging data via a trigger signal being a k-clock trigger signal so as to uniformly acquire imaging data at k intervals; and / or (iv) using a synchronization signal comprising or including a result pulse train, the result pulse train being a pulse train from a synchronization processor, wherein the synchronization processor operates to send pulses corresponding to an index of the first encoder signal occurring at each revolution of the rotary motor, except that the synchronization processor modifies the pulses at a predetermined or set portion of the pullback, the predetermined or set portion of the pullback being one or more of the following: the beginning of the pullback, wherein the synchronization processor modifies the pulses at a predetermined or set portion ... the synchronization processor modifies the pulse in a manner that the synchronization processor blanks or skips a pulse at the beginning of the pullback; the end of the pullback, wherein the synchronization processor modifies the pulse in a manner that the synchronization processor blanks or skips a pulse at the end of the pullback; the beginning and end of the pullback, wherein the synchronization processor modifies the pulse in a manner that the synchronization processor blanks or skips a pulse at the beginning of the pullback and then blanks or skips another pulse at the end of the pullback; the beginning and / or end of the pullback, wherein the synchronization processor modifies the pulse in a manner that the synchronization processor introduces additional pulses and / or delays at the beginning of the pullback and / or at the end of the pullback; at the end of the pullback, wherein the synchronization processor modifies the pulse so that a frame counter of the data acquisition processor increments at a slower rate as the rotation motor decelerates;and / or at the beginning of a pullback, wherein the synchronization processor modifies the pulses so that a frame counter of the data acquisition processor increments toward a steady rate as the rotary motor accelerates to a steady-state target.;
[0096] One or more method embodiments may involve or have one or more of the following: (i) the data acquisition processor includes a frame counter, the frame counter increments at a fixed, steady, or predetermined or set rate except at the beginning of a pullback, at which time the frame counter increments at about half the predetermined or set rate or a fraction of the predetermined or set rate, such that a jump between the beginning of the pullback and the time when the frame counter increments at the fixed, steady, or predetermined or set rate accurately signals or indicates the beginning and / or end of the pullback, and the total pullback length and / or time is derived if the total pullback length and / or time is known or set. (ii) one or more processors including a control processor operative to control or send commands to a rotation motor controller and a pullback motor controller so as to achieve a set or predetermined catheter or probe speed and / or position and / or a set or predetermined rotation motor and / or pullback motor speed and / or position to produce one or more scan patterns, and the data acquisition processor including a frame counter, except at the end of the pullback, the synchronization processor modifies the pulses to increment at a slower rate as the rotation motor decelerates, thereby causing the first encoder signal pulse train to be incremented at a slower rate. The frame counter is incremented at a fixed, steady or predetermined or set rate, except for the delay and the frame counter is incremented by an increasing number of A-line triggers, and the rotary motor is decelerated by the control processor or one or more processors to accurately coincide with the end of the pullback to reduce or eliminate the uncertainty between the end of the pullback and the beginning of the rotary motor deceleration to accurately determine the end of the pullback and derive an approximate or accurate record of the exact beam position for each depth scan for a predetermined or set total pullback length and / or time; (iii) the rotary motor has a sharp deceleration profile, and the rotary motor is operated to decelerate the rotary motor for each depth scan before the frame counter is incremented. The number of A-line triggers that occur before the pullback significantly or substantially decelerates in one rotation, so that the deceleration profile of the rotary motor is large enough to be detected as a deceleration of the rotary motor rather than a change in the rotational speed of the rotary motor; and / or (iv) the change in the speed of the rotary motor operates to cause a pulse train per a predetermined or set number of A-line triggers in normal operation, and the deceleration of the rotary motor during a time equivalent to one steady-state rotation operates to a number of A-line triggers greater than the predetermined or set number of A-line triggers, so that a threshold above the A-line trigger is set or selected and a threshold below the A-line trigger is set or selected to detect the end of the pullback.
[0097] In one or more embodiments, the (one or more) methods may also include one or more of the following: (i) determining a pullback condition indicating or detecting the start and / or end of a pullback via a pullback condition processor of one or more processors; (ii) initiating deceleration of the rotary motor via a rotary motor controller and / or via a rotary motor controller and driver, wherein the rotary motor controller and / or driver operates to receive commands to control deceleration from the pullback condition processor; (iii) receiving information from the rotary motor controller and / or driver via the pullback condition processor to determine a pullback condition; and / or (iv) using the pullback condition processor when the pullback condition processor is deployed or included in a scanning mechanism of the system.
[0098] In one or more embodiments, one or more of the following may occur: (i) the rotary motor rotates at a speed below a target steady-state value and then accelerates when or simultaneously with the pullback motor accelerates; (ii) the data acquisition processor includes a frame counter that increments once or at a fixed, stable, or predetermined or set rate as the rotary motor accelerates to the target steady-state value; (iii) one or more processors include a control processor that operates to control or send commands to a rotary motor controller and a pullback motor controller so that a set or predetermined speed and / or position of the catheter or probe and / or a set or predetermined speed and / or position of the rotary motor and / or pullback motor are achieved to produce one or more scanning patterns, and the rotary motor acceleration is controlled by the control processor or one or more processors to accurately coincide with the start of the pullback to reduce or eliminate the start of the pullback and the rotary motor acceleration. (iv) the rotary motor has a steep acceleration profile and the rotary motor operates to accelerate significantly or substantially in one rotation for a number of A-line triggers that occur before the frame counter is incremented, such that the acceleration profile of the rotary motor is large enough to be detected as an acceleration of the rotary motor to a target steady-state value rather than as a change in the rotational motor speed; and / or (v) the change in rotary motor speed prior to the pullback operation operates to result in a pulse train per a predetermined or set number of A-line triggers, and the rotary motor acceleration during a time equivalent to one steady-state rotation is a number of A-line triggers greater than a predetermined or set number of A-line triggers, such that a threshold is set or selected to detect the start of the pullback.
[0099] One or more method embodiments may also include one or more of the following: (i) determining a pullback condition indicating or detecting the start and / or end of a pullback via a pullback condition processor of one or more processors; (ii) initiating acceleration of a rotary motor via a rotary motor controller and / or a rotary motor controller and driver, wherein the rotary motor controller and / or driver operates to receive commands to control acceleration from the pullback condition processor; (iii) receiving information from the rotary motor controller and / or driver via the pullback condition processor to determine a pullback condition; and / or (iv) using the pullback condition processor when the pullback condition processor is deployed or included in a scanning mechanism of the system.
[0100] In one or more embodiments, a computer-readable storage medium may store at least one program that operates to cause one or more processors to execute a method for performing image synchronization for one or more imaging modalities of a system, the method comprising: using an imaging device or imaging system of the system to obtain imaging data using one or more imaging modalities; performing beam scanning on a catheter or probe of the system via a scanning mechanism of the system to obtain a beam position of the catheter or probe; and achieving image synchronization via one or more processors of the system by recording the beam position simultaneously or contemporaneously with the imaging data, and achieving accurate spatial alignment of the imaging data.
[0101] One or more embodiments of the present disclosure determine image synchronization.
[0102] In one or more embodiments, intracavitary imaging may be used to obtain high-resolution cross-sectional images of tissue or material and enable real-time visualization.
[0103] Thus, at least one broad object of the present disclosure is to provide one or more optical devices, systems, methods (for use and / or manufacture), and storage media, such as but not limited to fiber optic catheters, endoscopes, and / or optical coherence tomography (OCT) and / or NIRF and / or NIRAF (and / or any other imaging modality) devices and systems, and methods and storage media for use therewith, to achieve consistent, reliable image synchronization, including high efficiency and reasonable manufacturing and maintenance costs.
[0104] In one or more embodiments, the A-line signal may be processed in one or more ways, such as those discussed in U.S. Patent Application No. 62 / 944,064 filed on December 5, 2019, the disclosure of which is incorporated herein by reference in its entirety. For example, one or more of the A-line signals may be smoothed by a 2D Gaussian filter for more reliable and accurate peak detection. Preferably, in one or more embodiments, special care or (one or more) steps may be taken to avoid any phase delay introduced by any filtering so that the pulse position is not shifted. After such filtering, a smoother A-line signal may be obtained. As at least another example, in one or more method embodiments, additional filtering (e.g., 1D filtering) may be performed to smooth the A-line. The pulses in the one-dimensional signal may correspond to the vessel wall. The rising edge of the pulse may be the location of the edge pixel of the A-line. By detecting the edge pixels in each A-line, the two-dimensional edge detection problem may be converted into a simpler one-dimensional pulse detection problem. In other words, one or more embodiments of the present disclosure may simplify at least one lumen edge, stent and / or artifact detection method and provide a solution at the same time.
[0105] In one or more embodiments, additional steps of finding and calculating peak and width parameters of lumen edges, stent(s), and / or artifact(s) may be performed, for example, as discussed in U.S. Patent Application No. 62 / 944,064, filed on December 5, 2019, the disclosure of which is incorporated herein by reference in its entirety. In one or more embodiments, peak or threshold (or other measurement / calculation) information may be applied to detect and guide one or more optical connections. In one or more embodiments, for each A-line signal, the highest peak may be detected within an appropriate FOV range. In at least one embodiment, there may be three (3) types of widths defined for the detected peaks. The first may be a half-maximum width that may be detected using an adaptive threshold based on the average and maximum values of the smoothed A-lines. By way of example of at least one embodiment, the threshold may be calculated as follows:
[0106] Threshold = (average + peak) / 2,
[0107] Wherein "average" is the average value of the smoothed A-line, and "peak" is the maximum value of the smoothed A-line. This threshold can be used to detect the most important pulse corresponding to the lumen edge in a particular A-line. In one or more embodiments, any pulse above the threshold can be an edge pulse candidate. In terms of the area under the pulse, the largest pulse among all candidates can be considered to be the maximum peak (or "the most important pulse"). The second width of the highest peak can be defined as a one-dimensional gradient signal along the A-line near the maximum peak, and can be used to identify the exact location of the lumen edge point in the smoothed A-line. Similar to the second width, the third width of the same peak can be defined along the A-line. However, for the third width, the gradient value will drop from its peak value to zero, which indicates the point where the value change stops and begins to reverse its direction. By putting together all lumen edge points thus detected from all A-lines in one or more embodiments, the lumen edge of the blood vessel can be formed as a function of the maximum peak position relative to the A-line index.
[0108] As a further example, another way to find the threshold is to find the average between the largest and smallest peaks:
[0109] Threshold = (minimum value + peak value) / 2
[0110] Another alternative is to find the threshold based on the largest peak:
[0111] Threshold = (peak value)*2 / 3
[0112] The location of the highest peak of the one-dimensional gradient signal along the A-line near the maximum peak can be used to identify the exact location of the lumen edge point in the smoothed A-line. Likewise, in one or more embodiments, the lumen edge data may contain or include artifact edge pixels.
[0113] In one or more embodiments, stent, peak and / or edge detection can be performed and / or guidewire artifacts can be determined / detected and removed, as discussed in U.S. Patent Application No. 62 / 944,064, filed on December 5, 2019, the disclosure of which is incorporated herein by reference in its entirety. In one or more embodiments, the lumen edge can be output and / or the stent strut center position (and / or other stent strut position information) can be output, such as discussed in U.S. Patent Application No. 62 / 944,064, filed on December 5, 2019, the disclosure of which is incorporated herein by reference in its entirety. A 1D smoothing filter can be applied to or used for the lumen edge results. The lumen edge and / or stent strut center position information (and / or other stent strut position information) can be output in a desired format, can be stored in a memory, can be printed, can be displayed on a display, and the like.
[0114] As discussed in U.S. patent application Ser. No. 62 / 944,064, filed on Dec. 5, 2019, the disclosure of which is incorporated herein by reference in its entirety, an OCT image (e.g., of a stented vessel) in polar coordinates may be displayed vertically (instead of, or in addition to, horizontally), and / or may be displayed together with a corresponding OCT image in a Cartesian coordinate system using at least one device or system for performing lumen, stent, and / or artifact detection techniques according to one or more aspects of the present disclosure.
[0115] In accordance with at least one aspect of the present disclosure and as noted above, one or more additional methods for lumen, stent and / or artifact detection in OCT images are provided herein, or may be used with one or more of the features or aspects of the present disclosure, and are discussed in U.S. patent application No. 16 / 414,222 filed on May 16, 2019, the entire disclosure of which is incorporated herein by reference in its entirety.
[0116] In one or more embodiments, the pulse width or the area under the 1D signal pulse can be used as a measure of the signal pulse size, as discussed in U.S. patent application No. 16 / 414,222 filed on May 16, 2019, the entire disclosure of which is incorporated herein by reference in its entirety.
[0117] Using the significant difference in the ratio of the descending to ascending gradients and the difference in the A-line pulse size, a simple thresholding method can be used to identify the locations of artifact regions corresponding to the guidewires and stent struts in the detected lumen margins, where the threshold can be set, for example, as:
[0118] Pulse size threshold = mean value – sigma*k1
[0119] or
[0120] FRGR threshold = mean + sigma*k2,
[0121] Wherein, “mean” and “sigma” are the mean and standard deviation of the corresponding signal, and k1 and k2 are empirical parameters, preferably but not limited to, between 1 and 2.
[0122] An alternative way to calculate the threshold could be:
[0123] Pulse size threshold = average + (peak – average) / 3
[0124] or
[0125] FRGR threshold = average + (peak – average) / 3
[0126] Furthermore, as another alternative, the threshold can also be calculated as:
[0127] Pulse size threshold = peak value – (peak value – average value) / 2
[0128] or
[0129] FRGR threshold = peak value – (peak value – average value) / 2
[0130] Preferably, in one or more embodiments, these identified edge points are not considered as lumen edges and are not used in lumen parameter calculations.
[0131] One advantage of using one-dimensional A-line signal processing for lumen edge detection is that there may be multi-peak patterns from these boundary regions of the A-line signal because both the stent and lumen edge peaks are present in the A-line signal. For example, as discussed in U.S. Patent Application No. 16 / 414,222 filed on May 16, 2019 (the entire disclosure of which is incorporated herein by reference in its entirety), the boundary region may produce clustered multi-peak pulses in the A-line signal. Multi-peak pulses can be detected using the same threshold used in the maximum peak detection step discussed above, so they are not repeated herein. If the falling edge of the peak rises again before the falling edge falls below the threshold, then in at least one embodiment, a multi-peak pulse is considered to be identified. Preferably, if a pulse is detected as a multi-peak pulse, the lumen edge data from that A-line can be regarded as the boundary region of the stent strut and guidewire and removed from the lumen edge detection. In one or more embodiments, multi-peaks that are not in the boundary region can be retained, and are preferably retained in one or more embodiments.
[0132] Even if the falling edge of the peak drops below the threshold and then rises again to form another peak, it can still be considered a multi-peak pulse. In at least one embodiment, the correct identification of the lumen edge can then rely on the main peak detection and the size of the leading peak. If the leading peak is identified as an artifact, such as but not limited to a stent or guidewire, then the second peak may be the lumen edge. There may be small vessel branches in the tissue beneath the vessel wall, which in one or more embodiments may ultimately appear as two separate peaks in a single A-line in a similar manner. In this case, the leading peak without a narrow width may be the lumen edge. At least one way to distinguish multi-peak pulses between valid lumen edges and the influence of one or more artifacts is to determine whether they are located within a boundary area. Therefore, multi-peak situations can be further classified into non-boundary area and boundary area situations, and they can be removed from the detected lumen edge only in the boundary area.
[0133] As another example and an alternative to the examples mentioned above, a horizontal gradient can be used to identify and remove lumen edge data corresponding to the boundary region between soft tissue and narrow artifacts. As discussed in U.S. Patent Application No. 16 / 414,222 filed on May 16, 2019, the entire disclosure of which is incorporated herein by reference in its entirety, a gradient across an A-line can display a pattern of many shadows caused by light blocking artifacts (which can include one or more artifact shadows).
[0134] For each detected lumen edge point, the average of the cross-A-line gradient beneath the edge point can be calculated as discussed in U.S. Patent Application No. 16 / 414,222 filed on May 16, 2019, the entire disclosure of which is incorporated herein by reference in its entirety. These averages reflect the location of shadows caused by light blocking artifacts. Given the directional characteristics of the gradient across the A-line, edges from light to dark produce rising peaks, while edges from dark to light produce falling peaks. For each dark shadow produced by a stent strut, the boundary of the shadow is a rising peak on one side and a falling edge on the other side.
[0135] A computer (such as console or computer 1200, 1200') may be directed to any device and / or system manufactured or used (including but not limited to device or system 100, device or system 100a, device or system 100', device or system 100'', device or system 100''', Figure 1-7 , Figure 9-11 and Figure 13-14 any embodiment shown in, any other device or system discussed herein, etc.) to perform any steps, processes and / or techniques discussed herein.
[0136] According to one or more additional aspects of the present disclosure, the desktop system may be used with techniques such as, but not limited to, the image synchronization techniques disclosed herein. Fig. 9 An example of a system is shown that can use image synchronization technology for benchtop use, such as for ophthalmic applications. Light from light source 101 is delivered through deflection (or steering) section 108 and split into reference arm 102 and sample arm 103. The reference beam passes through length adjustment section 904 (optional in one or more embodiments) and is reflected from a reference mirror (such as Figure 1105) while the sample beam is reflected from a sample, target or object 106 in the sample arm 103 (e.g., via the PIU 110 and the catheter 120). In one embodiment, the two beams are combined at the deflection (steering) section 108 and generate an interference pattern. In one or more embodiments, the beams enter the combiner 903, and the combiner 903 combines the two beams via the circulator 901 and the deflection section 108. The combined beam is preferably delivered to one or more detectors (such as one or more detectors 107). A beam splitter (see, e.g., Figure 1 The output of the beam splitter 104 in the deflection section 108 and / or the interferometer is continuously acquired by one or more detectors (such as one or more detectors 107). The electrical analog signal is converted into a digital signal for use with a computer (such as, but not limited to, computer 1200 (see Figure 1 ; also discussed further below Figure 3-7 , Figure 9-11 and Fig.13 ), computer 1200 '(see, e.g., further discussed below Fig.14 ) etc.) to analyze it.
[0137] In one or more embodiments, the sample arm 103 may include a phase shift unit 130 for use in (one or more) benchtop systems, such as Fig.10 The sample 106 may be located at the position of the mirror 105 used with the phase shift unit 130 (e.g., as shown in FIG. Figure 1 ). Light from the light source 101 is delivered through the beam splitter 104 and split into the reference arm 102 and the sample arm 103. The reference beam passes through the length adjustment section 904 and is emitted from a reference mirror (such as Figure 9-11 105) while the sample beam is reflected or scattered from the sample, target and / or object 106 by a phase shift unit (such as phase shift unit 130) in the sample arm 103. In one embodiment, the two beams are combined at the beam splitter 104 and an interference pattern is generated. In one or more embodiments, the beams enter the combiner 903, and the combiner 903 combines the two beams via the circulator 901 and the beam splitter 104, and the combined beam is delivered to one or more detectors (such as one or more detectors 107). The output of the beam splitter 104 and / or the interferometer is continuously acquired with one or more detectors (such as one or more detectors 107). The electrical analog signal is converted into a digital signal so that it can be analyzed by a computer.
[0138] There are many ways to calculate rotation, intensity, or any other measurement discussed herein, and / or control and / or manufacture digital and analog MMOCT devices / apparatuses, systems, and / or storage media. In at least one embodiment, a computer (such as console or computer 1200, 1200') can be dedicated to controlling and / or using OCT devices, systems, methods, and / or storage media for use with the apparatus described herein. One or more other imaging modalities (e.g., NIRF, NIRF, IVUS, etc.) can be used with one or more embodiments.
[0139] According to one or more additional aspects of the present disclosure, one or more other systems may be used with the image synchronization techniques disclosed herein. Fig.11 An example of a system 100''' is shown that can use image synchronization techniques for applications such as ophthalmology. Light from a light source 101 is delivered and split into a reference arm 102 and a sample arm 103 by a deflection section 108 (e.g., a beam splitter or other deflection or steering sections discussed herein) located within an OCT imaging engine 150, which in one or more embodiments can also include an OCT interferometer 151 (which can house or include the deflection section 108) and a swept source engine 152. The reference beam can pass through a length adjustment section 904 that can be operated to change the reference mirror (such as a reference mirror or reference reflective element 105; also in FIG. 1 ). Figure 1 The sample beam is reflected from a reference reflective element 105 in the reference arm 102, while the sample beam is reflected or scattered from a sample, target or object 106 in the sample arm 103. In one embodiment, the two beams are combined at the deflection section 108 and generate an interference pattern. In one or more embodiments, the combined beam is delivered to one or more detectors. The output of the interferometer 151 is continuously acquired with one or more detectors, such as one or more detectors 107. The electrical analog signal is converted into a digital signal for use with a computer, such as, but not limited to, computer 1200 (see, e.g., Figure 1 ; also discussed further below Figure 3-7 , Figure 9-11 and Fig.13 ), computer 1200 '(eg, see further discussion below Fig.14) etc.) to analyze it. In one or more embodiments, the sample arm 103 includes a PIU 110 and a catheter 120, so that the sample beam is reflected or scattered from the sample, target or object 106, as discussed herein. In one or more embodiments, the PIU 110 may include one or more motors to control the pullback operation of the catheter 120 (or one or more components thereof) and / or control the rotation or spin of the catheter 120 (or one or more components thereof). For example, the PIU 110 may include a pullback motor (PM) and a spin motor (SM), and / or may include a motion control unit 112 that operates to perform pullback and / or rotation features using the pullback motor PM and / or the spin motor SM. Additionally or alternatively, a pullback motor (e.g., pullback motor 270, 570) and / or a rotation motor (e.g., rotation motor 260, 560) as discussed above may be used. As discussed herein, the PIU 110 may include a rotary joint (e.g., as Fig. 9 and Fig.11 106). The rotary joint RJ can be connected to the spin motor SM so that the catheter 120 can obtain one or more views or images of the sample 106. The computer 1200 (or computer 1200') can be used to control one or more of the pullback motor PM, the spin motor SM and / or the motion control unit 112. The OCT system may include one or more of an OCT engine 150, a computer (e.g., computer 1200, computer 1200', etc.), a PIU 110, a catheter 120, a monitor, etc. One or more embodiments of the OCT system may interact with one or more external systems (such as, but not limited to, a vascular system, an external display, one or more hospital networks, an external storage medium, a power supply, a bedside controller (e.g., which may be connected to the OCT system using Bluetooth technology or other known wireless communication methods), etc.).
[0140] Unless otherwise discussed herein, like numbers refer to like elements. For example, although systems / devices (such as, but not limited to, system 100, system 100a, system 100', system 100", system 100'', Figure 1-7There may be variations or differences between the systems / devices, etc. (e.g., differences between the positions of (one or more) of the reference reflective element 105 (and / or the reference arm 102), which depends on the OCT system or method used), but one or more features thereof may be the same or similar to each other, such as, but not limited to, the light source 101, the deflection section 108, or (one or more) other components thereof (e.g., the console 1200, the console 1200', etc.). Those skilled in the art will recognize that the light source 101, the at least one detector 107, and / or one or more other elements of the system 100 may operate in the same or similar manner as those similarly numbered elements of one or more other systems (such as, but not limited to, the system 100a, the system 100', the system 100'', the system 100''', etc.), as discussed herein. Those skilled in the art will recognize that the system 100, the system 100a, the system 100', the system 100'', the system 100''', etc. Figure 1-7 Alternative embodiments of the systems / apparatuses and / or one or more like-numbered elements of one of such systems, while having other variations as discussed herein, may operate in the same or similar manner as like-numbered elements of any other system (or its component(s)) discussed herein. Indeed, while in system 100, system 100a, system 100', system 100'' and system 100''', Figure 1-7 There are certain differences between the systems / devices, etc. discussed herein, but there are similarities between the devices / systems discussed herein. Likewise, although the console or computer 1200 may be used in one or more systems (e.g., system 100, system 100a, system 100', system 100", system 100'', system 100''', Figure 1-7 , but one or more other consoles or computers (such as console or computer 1200') may additionally or alternatively be used.
[0141] According to one or more aspects of the present disclosure, one or more methods for image synchronization are provided herein, and one or more methods for performing imaging are provided herein. Fig.12 A flow chart of at least one embodiment of a method for performing imaging is illustrated. Preferably, the method(s) may include one or more of the following: (i) separating or splitting the light into a first light and a second reference light (see Fig.12 (ii) receiving reflected or scattered light of the first light after the first light travels along the sample arm and illuminates the object or sample (see step S4000 in FIG. 1 ); Fig.12 (iii) receiving the second reference light after the second reference light travels along the reference arm and is reflected by the reference reflective element (see step S4001 in FIG. 4 ); Fig.12(iv) generating interference light by causing the reflected or scattered light of the first light and the reflected second reference light to interfere with each other (e.g., by combining or recombining and then interfering, by interference, etc.), the interference light generating one or more interference patterns (see Fig.12 One or more methods may also include using a low frequency monitor to update or control the high frequency component to improve image quality. For example, one or more embodiments may use balanced detection, polarization diversity, automated polarization control, etc. and / or image synchronization to achieve improved image quality. In one or more embodiments, the imaging probe may be connected to one or more systems (e.g., system 100, system 100a, system 100', system 100'', Figure 1-7 , devices, apparatuses, or systems, any other systems or apparatuses discussed herein, etc.). For example, when the connecting member or interface module is a rotary joint for an imaging probe, the rotary joint may be at least one of the following: a contact rotary joint, a lensless rotary joint, a lens-based rotary joint, or other rotary joints known to those skilled in the art. The rotary joint may be a single-channel rotary joint or a dual-channel rotary joint. In one or more embodiments, the illumination portion of the imaging probe may be separated from the detection portion of the imaging probe. For example, in one or more applications, the probe may refer to an illumination assembly, which includes an illumination fiber (e.g., a single-mode fiber, a GRIN lens, a gasket, and a grating on a polished surface of the gasket, etc.). In one or more embodiments, the scope may refer to an illumination portion, which may be surrounded and protected by, for example, a drive cable, a sheath, and a detection fiber (e.g., a multimode fiber (MMF)) surrounding the sheath. For one or more applications, the grating covering on the detection fiber (e.g., MMF) is optional. The illumination portion may be connected to the rotary joint and may be continuously rotated at video rates. In one or more embodiments, the detection portion may include one or more of the following: a detection fiber, a detector (e.g., one or more detectors 107, a spectrometer, etc.), a computer 1200, a computer 1200', etc. The detection fiber may surround the illumination fiber, and the detection fiber may or may not be covered by a grating, a spacer, a lens, the end of a probe or a catheter, etc.
[0142] There are many digital as well as analog ways to calculate power and / or detect lumen edge(s) and artifact(s), and / or detect and / or guide optical connection / disconnection. In at least one embodiment, a computer (such as console or computer 1200, 1200') can be dedicated to the control and monitoring of the OCT devices, systems, methods, and / or storage media described herein.
[0143] The electrical signals used for imaging may be transmitted via cable(s) or wire(s) such as, but not limited to, cable(s) or wire(s) 113 (see Fig.13 )) is sent to one or more processors (such as, but not limited to, a computer 1200 as discussed further below (see, e.g. Figure 1-7 , Figure 9-11 and Fig.13 ), computer 1200 ′ (see e.g. Fig.14 )wait).
[0144] Computer system 1200 (see e.g. Figure 1-7 and Figure 9-11 The various components of the console or computer 1200 are shown in Fig.13 The computer system 1200 may include a central processing unit ("CPU") 1201, a ROM 1202, a RAM 1203, a communication interface 1205, a hard disk (and / or other storage device) 1204, a screen (or a monitor interface) 1209, a keyboard (or an input interface; in addition to the keyboard, a mouse or other input device may also be included) 1210, and buses or other connecting lines (e.g., connecting lines 1213) between one or more of the above-mentioned components (e.g., Fig.13 ). In addition, the computer system 1200 may include one or more of the above-mentioned components. For example, the computer system 1200 may include a CPU 1201, a RAM 1203, an input / output (I / O) interface (such as a communication interface 1205), and a bus (which may include one or more lines 1213 as a communication system between the components of the computer system 1200; in one or more embodiments, the computer system 1200 and at least its CPU 1201 may communicate with one or more of the above-mentioned components or devices or systems using it (such as, but not limited to, the system 100, system 100a, system 100', system 100'', system 100''', and / or system 100''' discussed above) via one or more lines 1213. Figure 1-7The computer system 1200 may be configured to communicate with a computer system / device) and one or more other computer systems 1200 may include one or more combinations of the other components mentioned above. CPU 1201 is configured to read and execute computer executable instructions stored in a storage medium. Computer executable instructions may include those instructions for performing the methods and / or calculations described herein. In addition to CPU 1201, computer system 1200 may also include one or more additional processors, and such processors including CPU 1201 may be used to control and / or manufacture equipment, systems or storage media for use with it or with any lumen detection, (one or more) stent detection, (one or more) artifact detection and / or (one or more) image synchronization technology discussed herein. System 1200 may also include one or more processors connected via a network connection (e.g., via network 1206). CPU 1201 and any additional processors used by system 1200 may be located in the same telecommunications network or in different telecommunications networks (e.g., the execution, manufacture, control and / or use of (one or more) technologies may be remotely controlled).
[0145] I / O or communication interface 1205 provides a communication interface to input and output devices, which may include light source 101, RJ, PM, SM, unit 150, unit 112, microphone, communication cable and network (wired or wireless), keyboard 1210, mouse (see e.g. Fig.14 The mouse 1211 shown in FIG. 1 ), a touch screen or screen 1209, a light pen, etc. The monitor interface or screen 1209 provides a communication interface therefor.
[0146] Any of the methods and / or data of the present disclosure, such as methods for using and / or making an apparatus, system, or storage medium for use therewith and / or for detecting lumen edge(s), stent(s), and / or artifact(s) included in one or more OCT images and / or methods(s) for image synchronization, as discussed herein, can be stored on a computer-readable storage medium. Commonly used computer-readable and / or writable storage media (such as, but not limited to, hard disks (e.g., hard disk 1204, magnetic disks, etc.), flash memory, CDs, optical disks (e.g., compact disks ("CD"), digital versatile disks ("DVD"), Blu-ray discs, etc.), and / or computer-readable ... and / or computer-readable storage media (such as, but not limited to, hard disks (e.g., hard disk 1204, magnetic disks, etc.), flash memory, CD TM disks, etc.), magneto-optical disks, random access memory ("RAM") (such as RAM 1203), DRAM, read-only memory ("ROM"), storage devices of distributed computing systems, memory cards, etc. (e.g., other semiconductor memories such as, but not limited to, non-volatile memory cards, solid-state drives (SSDs) (see Fig.14The SSD 1207 in the computer system 1200), SRAM, etc.), their optional combinations, one or more of servers / databases, etc.) can be used to cause a processor (such as the processor or CPU 1201 of the computer system 1200 mentioned above) to perform the steps of the method disclosed herein. The computer-readable storage medium may be a non-transitory computer-readable medium, and / or the computer-readable medium may include all computer-readable media, with the only exception of transient propagation signals. The computer-readable storage medium may include a medium that stores information for a predetermined, limited or (one or more) short period of time and / or only when there is power, such as but not limited to random access memory (RAM), register memory, (one or more) processor caches, etc. The (one or more) embodiments of the present disclosure may also be implemented by a computer of a system or device that reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more comprehensively referred to as a "non-transitory computer-readable storage medium") to perform one or more of the functions of the above-mentioned (one or more) embodiments, and / or by a computer of a system or device that includes one or more circuits (e.g., an application-specific integrated circuit (ASIC)) for performing one or more of the above-mentioned (one or more) embodiments, and is implemented by a method executed by a computer of the system or device by, for example, reading out and executing computer-executable instructions from a storage medium to perform one or more of the functions of the above-mentioned (one or more) embodiments and / or controlling one or more circuits to perform one or more of the functions of the above-mentioned (one or more) embodiments.
[0147] According to at least one aspect of the present disclosure, methods, devices, systems, and computer-readable storage media related to a processor (such as but not limited to the processor of the computer 1200 mentioned above, the processor of the computer 1200', etc., as described above) can be implemented using appropriate hardware, such as shown in the figure. The functions of one or more aspects of the present disclosure can be implemented using appropriate hardware, such as Fig.13 Such hardware may be implemented using any known technology, such as standard digital circuit systems, any known processor operable to execute software and / or firmware programs, one or more programmable digital devices or systems (such as programmable read-only memory (PROM), programmable array logic device (PAL), etc.). CPU1201 (such as Fig.13 or Fig.14) may also include and / or consist of one or more microprocessors, nanoprocessors, one or more graphics processing units ("GPUs"; also called visual processing units ("VPUs"), one or more field programmable gate arrays ("FPGAs"), or other types of processing components (e.g., (one or more) application specific integrated circuits (ASICs)). Further, various aspects of the present disclosure may be implemented by (one or more) software and / or firmware programs that may be stored on a suitable storage medium (e.g., a computer-readable storage medium, a hard drive, etc.) or a medium for transport and / or distribution (such as (one or more) floppy disks, (one or more) memory chips, etc.). The computer may include a network of independent computers or independent processors to read out and execute computer-executable instructions. Computer-executable instructions may be provided to the computer, for example, from a network or a storage medium.
[0148] As mentioned above, the hardware structure of an alternative embodiment of the computer or console 1200' is Fig.14 The computer 1200' includes a central processing unit (CPU) 1201, a graphics processing unit (GPU) 1215, a random access memory (RAM) 1203, a network interface device 1212, an operation interface 1214 (such as a universal serial bus (USB)), and a memory (such as a hard disk drive or a solid state drive (SSD) 1207). Preferably, the computer or console 1200' includes a display 1209. The computer 1200' can communicate with a rotary joint (for example, Fig. 9 RJ Fig.11 RJ, etc.), motor PM, motor SM and / or system (eg, system 100, system 100a, system 100', system 100'', system 100''', Figure 1-7 systems / devices, Figure 9-11 The CPU 1201 or the GPU 1215 may be connected to one or more other components of a system / device, etc.). In one or more embodiments, a computer (such as computer 1200, 1200') may include an RJ, a PM, and / or an SM. An operation interface 1214 is connected to an operation unit (such as a mouse device 1211, a keyboard 1210, or a touch panel device). The computer 1200' may include two or more of each component. Alternatively, the CPU 1201 or the GPU 1215 may be replaced by a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or other processing units, depending on the design of the computer (such as computer 1200, computer 1200', etc.).
[0149] The computer program is stored in the SSD 1207, and the CPU 1201 loads the program onto the RAM 1203 and executes the instructions in the program to perform one or more of the processes described herein, as well as the basic input, output, calculation, memory write, and memory read processes.
[0150] A computer (such as computer 1200, 1200') communicates with PIU 110, a rotary joint (e.g., RJ, etc.), a motor PM, a motor SM, a catheter 120, and / or one or more other components of a system (such as system 100, 100a, 100', 100", 100''', etc.) to perform imaging and / or image synchronization and reconstruct an image based on the acquired intensity data. A monitor or display 1209 displays the reconstructed image and may display other information about the imaging conditions or about the object to be imaged. Monitor 1209 also provides a graphical user interface for a user to operate the system (e.g., system 100, system 100a, system 100', system 100", system 100'', etc.), for example when performing OCT or other imaging techniques, including but not limited to detection of (one or more) lumen edges and / or (one or more) artifacts, and / or image synchronization. The operation signal is input from the operation unit (e.g., such as but not limited to the mouse device 1211, the keyboard 1210, the touch panel device, etc.) to the operation interface 1214 in the computer 1200', and corresponding to the operation signal, the computer 1200' instructs the system (e.g., the system 100, the system 100a, the system 100', the system 100'', the system 100''', Figure 1-7 systems / devices, Figure 9-11 The laser source 101 of the OCT system mentioned above may have an interface for communicating with the computer 1200, 1200' to send and receive status information and control signals.
[0151] Similarly, one or more components of the present disclosure and / or devices, systems, and storage media and / or methods thereof may also be used in conjunction with optical coherence tomography probes. Such probes include, but are not limited to, OCT imaging systems disclosed in U.S. Patent Nos. 7,872,759; 8,289,522; and 8,928,889 to Tearney et al., and arrangements and methods for facilitating photoluminescent imaging, such as disclosed in U.S. Patent No. 7,889,348 to Tearney et al., and disclosures for multimodal imaging disclosed in U.S. Patent No. 9,332,942 and U.S. Patent Publication Nos. 2010 / 0092389, 2012 / 0101374, 2016 / 0228097, 2018 / 0045501, and 2018 / 0003481, each of which is incorporated herein by reference in its entirety. As mentioned above, any features or aspects of the present disclosure may be used with the OCT imaging systems, devices, methods, storage media, or other aspects or features discussed in U.S. patent application No. 16 / 414,222 filed on May 16, 2019 (the entire disclosure of which is incorporated herein by reference in its entirety) and U.S. patent application No. 62 / 944,064 filed on December 5, 2019 (the entire disclosure of which is incorporated herein by reference in its entirety).
[0152] Although the present disclosure has been described herein with reference to specific embodiments, it should be understood that these embodiments are merely illustrative of the principles and applications of the present disclosure (and are not limited thereto). It should therefore be understood that various modifications may be made to the illustrative embodiments and other arrangements may be designed without departing from the spirit and scope of the present disclosure. The scope of the following claims should be given the broadest interpretation to encompass all such modifications, equivalent structures, and functions.
Claims
1. An optical system for performing image synchronization, comprising: an imaging device that uses one or more imaging modalities to obtain imaging data; a scanning mechanism that operates to perform beam scanning on a catheter or a probe of the optical system to obtain a beam position of the catheter or the probe; one or more processors operative to achieve image synchronization by recording beam position simultaneously with imaging data and operative to achieve accurate spatial registration of the imaging data, the one or more processors further comprising a data acquisition processor operative to acquire imaging data obtained by the imaging device, and the one or more processors further comprising a synchronization processor; a rotation motor and a pullback motor, the rotation motor operative to rotate at least a portion of the scanning mechanism and / or the catheter or probe, the pullback motor operative to control pullback of the catheter or probe, wherein beam scanning of the catheter or probe is performed by the scanning mechanism using the rotation motor and the pullback motor; a spin motor controller and a pullback motor controller, wherein the one or more processors communicate with, control, or send commands to the spin motor controller and the pullback motor controller; and a first encoder signal operable for use by a rotation motor controller and a second encoder signal operable for use by a pullback motor controller, wherein the synchronization processor operates to control the first encoder signal and the second encoder signal before the synchronization processor is interfaced with the data acquisition processor such that each time a depth scan is acquired from the imaging data input, information from the first encoder signal and the second encoder signal is recorded for each of the rotation motor and the pullback motor to record the beam position for the depth scan, and the synchronization processor operates to use a single synchronization signal for the data acquisition processor to capture the position of the catheter or probe for each measured depth scan profile.
2. The optical system of claim 1, wherein the one or more processors further comprises a hardware management processor operative to control the data acquisition processor.
3. An optical system as described in claim 1, wherein the one or more processors include a control processor, which operates to control a rotation motor controller and a retraction motor controller or send commands to them to achieve a set speed and / or position of the catheter or probe, and / or a set speed and / or position of the rotation motor and / or retraction motor to produce one or more scanning patterns.
4. The optical system of claim 1, wherein one or more of the following: (i) triggering a single acquisition of the depth scan using a trigger signal and recording the values of a rotation digital counter and a pullback digital counter derived from a demodulated coded synchronization signal demodulated by a demodulator of the optical system; (ii) using a trigger signal to trigger a single acquisition of a deep scan on an analog-to-digital converter ADC; (iii) the trigger signal is used as an A-line trigger signal that operates to trigger sampling of imaging data, or the trigger signal is a k-clock trigger signal that operates to trigger sampling of imaging data so as to uniformly acquire imaging data at k intervals; (iv) the synchronization signal includes a resultant pulse train, the resultant pulse train being a resultant of a superposition of pulse trains from each of a first encoder signal and a second encoder signal, the first encoder signal and the second encoder signal being operative to switch at a predetermined rate per revolution of the spin motor and / or the pullback motor, and a rotation digital counter and a pullback digital counter of the data acquisition processor being operative to count the switching of the first encoder signal and the second encoder signal so as to measure a current position of the spin motor and the pullback motor; (v) the encoder signal pulses have an amplitude of 2V for the rotary motor encoder signal and 3V for the pullback motor encoder signal, the rotary digital counter operates to increment at one or more of the following transitions: a transition from 0V to 2V, a transition from 3V to 5V, and / or a transition from 0V to 5V, and the pullback digital counter operates to increment at one or more of the following transitions: a transition from 0V to 3V, a transition from 2V to 5V, and / or a transition from 0V to 5V; and / or (vi) An analog-to-digital converter ADC, a demodulator, a rotation digital counter, and a pullback digital counter are included in the data acquisition processor.
5. The optical system of claim 1, wherein one or more of the following: (i) triggering a single acquisition of a depth scan on an analog-to-digital converter ADC using a trigger signal and recording a rotation digital counter and a pullback digital counter derived from a demodulated encoding synchronization signal demodulated by a demodulator of the optical system; (ii) the synchronization signal comprises a result pulse train, the result pulse train being a pulse train from the synchronization processor, and the synchronization processor is operative to send pulses corresponding to an index of the first encoder signal occurring at each revolution of the rotary motor, except that the synchronization processor is operative to modify the pulses at a set portion of the pullback, the set portion of the pullback being one or more of: the start of the pullback, the end of the pullback, a period from the start of the pullback to the end of the pullback, wherein the synchronization processor is operative to modify the pulses in a manner such that the synchronization processor blanks or skips a pulse at the start of the pullback, wherein the synchronization processor is operative to modify the pulses in a manner such that the synchronization processor blanks or skips a pulse at the end of the pullback, and wherein the synchronization processor is operative to modify the pulses in a manner such that the synchronization processor blanks or skips a pulse at the end of the pullback. wherein the synchronous processor is operative to modify the pulses in a manner such that the synchronous processor blanks or skips one pulse at the beginning of the pullback and then blanks or skips another pulse at the end of the pullback, wherein the synchronous processor is operative to modify the pulses in a manner such that the synchronous processor introduces additional pulses and / or delays at the beginning of the pullback and / or at the end of the pullback, wherein at the end of the pullback, the synchronous processor is operative to modify the pulses so that a frame counter of the data acquisition processor increments at a slower rate than a set rate as the rotary motor decelerates; and / or wherein at the beginning of the pullback, the synchronous processor is operative to modify the pulses so that a frame counter of the data acquisition processor increments toward a steady rate as the rotary motor accelerates to a steady-state target; and / or (iii) The data acquisition processor includes a frame counter that increments every set number of triggers.
6. The optical system of claim 5, wherein one or more of the following: (i) the data acquisition processor includes a frame counter that increments at a set rate except at the beginning of a pullback, at which time the frame counter increments at a fraction of the set rate, such that a jump between the beginning of the pullback and the time at which the frame counter increments at the set rate accurately indicates the beginning and / or end of the pullback and derives an accurate record of the beam position for each depth scan given a set total pullback length and / or time; (ii) the one or more processors include a control processor operative to control or send commands to a rotation motor controller and a pullback motor controller so as to achieve a set catheter or probe speed and / or position and / or set rotation motor and / or pullback motor speed and / or position to produce one or more scan patterns, and the data acquisition processor includes a frame counter, the frame counter incrementing at the set rate except that at the end of the pullback the synchronization processor is operative to modify the pulses to increment at a rate slower than the set rate as the rotation motor decelerates, whereupon the first encoder signal pulse train is delayed and the frame counter increments by an increasing number of A-line triggers, the frame counter incrementing at the set rate, the rotation motor deceleration being controlled by the control processor to accurately coincide with the end of the pullback, so as to accurately determine the end of the pullback and derive an accurate record of the beam position for each depth scan for a set total pullback length and / or time; (iii) the rotary motor has a sharp deceleration profile, and the rotary motor operates to decelerate significantly in one rotation for the number of A-line triggers that occur before a frame counter of the data acquisition processor is incremented, such that the deceleration profile of the rotary motor is large enough to be detected as a deceleration of the rotary motor, rather than merely as a change in the rotational speed of the rotary motor; and / or (iv) a variation in the speed of the rotary motor is operated to cause a pulse train per a set number of A-line triggers in normal operation, and a deceleration of the rotary motor is operated for another number of A-line triggers greater than the set number of A-line triggers during a time equivalent to one steady-state rotation, so that a threshold value above the set number of A-line triggers and below the another number of A-line triggers is set to detect the end of the pullback.
7. The optical system of claim 6, wherein one or more of the following: (i) the one or more processors further comprising a pullback condition processor operative to determine a pullback condition indicative of or detecting the start and / or end of a pullback; (ii) deceleration of the rotary motor is initiated by the rotary motor controller and / or by the rotary motor controller and the driver, and the rotary motor controller and / or the driver is operative to receive a command from the pullback condition processor to control the deceleration; (iii) the pullback condition processor is further operative to receive information from the rotary motor controller and / or driver to determine the pullback condition; and / or (iv) The pullback condition processor is included in the scanning mechanism of the optical system.
8. The optical system of claim 5, wherein one or more of the following: (i) the rotary motor rotates at a speed lower than the target steady-state value and then accelerates simultaneously with the pullback motor acceleration; (ii) the data acquisition processor includes a frame counter that increments once at a set rate or as the rotary motor accelerates to a target steady-state value; (iii) the one or more processors include a control processor that operates to control or send commands to a rotation motor controller and a pullback motor controller so that a set speed and / or position of the catheter or probe and / or a set speed and / or position of the rotation motor and / or pullback motor is achieved to produce one or more scan patterns, and rotation motor acceleration is controlled by the control processor to accurately coincide with the start of pullback, and the start of pullback is accurately determined and an accurate record of the beam position for each depth scan is derived for a set total pullback length and / or time; (iv) the rotary motor has a steep acceleration profile, and the rotary motor operates to accelerate significantly in one revolution for a number of A-line triggers that occur before a frame counter of the data acquisition processor is incremented, such that the acceleration profile of the rotary motor is large enough to be detected as acceleration of the rotary motor to a target steady-state value rather than merely as a change in the rotational speed of the rotary motor; and / or (v) the variation in the speed of the rotary motor before the pullback is operated to cause a pulse train per a set number of A-line triggers, and the acceleration of the rotary motor during a time equivalent to one steady-state rotation is operated to be another number of A-line triggers greater than the set number of A-line triggers, so that a threshold value higher than the set number of A-line triggers and lower than the said another number of A-line triggers is set to detect the start of the pullback.
9. The optical system of claim 8, wherein one or more of the following: (i) the one or more processors further comprising a pullback condition processor operative to determine a pullback condition indicative of or detecting the start and / or end of a pullback; (ii) acceleration of the rotary motor is initiated by the rotary motor controller and / or by the rotary motor controller and the driver, and the rotary motor controller and / or the driver are operative to receive commands from the pullback condition processor to control the acceleration; (iii) the pullback condition processor is further operative to receive information from the rotary motor controller and / or driver to determine the pullback condition; and / or (iv) The pullback condition processor is included in the scanning mechanism of the optical system.
10. The optical system of claim 1, wherein the optical system further comprises or is connected to one or more of the following: a light source that operates to produce light; An interference optical system that operates to: (i) receive light from a light source and separate it into a first light to be used to illuminate an object and a second reference light, (ii) send the second reference light for reflection off a reference mirror of the interference optical system, and (iii) generate interference light by combining reflected or scattered light of the first light that has been used to illuminate the object and the reflected second reference light, and cause the interference lights that generate one or more interference patterns to interfere with each other; and / or One or more detectors operating to continuously acquire the interference light and / or one or more interference patterns such that one or more A-lines are obtained.
11. The optical system of claim 1, wherein the one or more imaging modalities include one or more of: optical coherence tomography (OCT), optical frequency domain imaging (OFDI), near infrared spectroscopy, and intravascular imaging modalities.
12. The optical system of claim 11, wherein the OCT comprises one or more of single-modality OCT, multi-modality OCT, and swept-source OCT, wherein the intravascular imaging modality comprises intravascular ultrasound (IVUS), and wherein the near-infrared spectrum comprises one or more of near-infrared fluorescence (NIRF) and near-infrared autofluorescence (NIRAF).
13. A method for controlling an optical system for performing image synchronization, the method comprising: An imaging device using an optical system to obtain imaging data using one or more imaging modalities; performing beam scanning on a catheter or a probe of the optical system via a scanning mechanism of the optical system using a rotation motor of the optical system and a pullback motor of the optical system to obtain a beam position of the catheter or the probe, the rotation motor being operative to rotate at least a portion of the scanning mechanism and / or the catheter or the probe, and the pullback motor being operative to control pullback of the catheter or the probe; achieving image synchronization via the one or more processors of the optical system by recording beam positions simultaneously with imaging data and achieving accurate spatial registration of the imaging data; controlling, via the one or more processors of the optical system, a rotation motor controller of the optical system and a pullback motor controller of the optical system or sending commands thereto; as well as A synchronization processor via the one or more processors controls the first encoder signal and the second encoder signal before the synchronization processor interfaces with a data acquisition processor of the one or more processors so that each time a depth scan is acquired from the imaging data input, information from the first encoder signal and the second encoder signal is recorded for each of the rotation motor and the retraction motor to record the beam position for the depth scan, and the synchronization processor operates to use a single synchronization signal for the data acquisition processor to capture the position of the catheter or probe for each measured depth scan profile, wherein the optical system also includes a first encoder signal operative for use by the rotation motor controller and a second encoder signal operative for use by the retraction motor controller.
14. The method of claim 13, further comprising: (i) using a rotary motor to scan at least a portion of the mechanism and / or the catheter or probe, and (ii) Controlled retraction of the catheter or probe using a retraction motor.
15. The method of claim 13, further comprising one or more of the following: (i) controlling the data acquisition processor via a hardware management processor of the one or more processors; (ii) acquiring, via a data acquisition processor, imaging data acquired by an imaging device; and / or (iii) controlling the rotation motor controller and the retraction motor controller or sending commands to them via the control processor of the one or more processors of the optical system so as to achieve a set speed and / or position of the catheter or probe and / or a set speed and / or position of the rotation motor and / or retraction motor to generate one or more scanning patterns.
16. The method of claim 13, wherein the method further comprises one or more of the following: (i) triggering a single acquisition of a depth scan via a trigger signal of the optical system and recording the values of a rotation digital counter and a pullback digital counter derived from a demodulated coded synchronization signal demodulated by a demodulator of the optical system; (ii) triggering a single acquisition of a depth scan on an analog-to-digital converter ADC via a trigger signal of the optical system and recording a rotation digital counter and a pullback digital counter derived from a demodulated encoding synchronization signal demodulated by a demodulator of the optical system; (iii) triggering sampling of imaging data via a trigger signal used as an A-line trigger signal, or triggering sampling of imaging data via a trigger signal as a k-clock trigger signal to uniformly acquire imaging data at k intervals; (iv) using a synchronization signal including a resultant pulse train, the resultant pulse train being a resultant of a superposition of pulse trains from each of a first encoder signal and a second encoder signal, the first encoder signal and the second encoder signal being operative to switch at a predetermined rate per revolution of the rotation motor and / or the pullback motor, and counting the switching of the first encoder signal and the second encoder signal via a rotation digital counter and a pullback digital counter of the data acquisition processor so as to measure the current position of the rotation motor and the pullback motor; (v) using encoder signal pulses having a 2V amplitude for the rotation motor encoder signal and a 3V amplitude for the pullback motor encoder signal, wherein the rotation digital counter operates to increment at one or more of the following transitions: a transition from 0V to 2V, a transition from 3V to 5V, and / or a transition from 0V to 5V, and the pullback digital counter operates to increment at one or more of the following transitions: a transition from 0V to 3V, a transition from 2V to 5V, and / or a transition from 0V to 5V; and / or (vi) Using a data acquisition processor, the data acquisition processor includes an analog-to-digital converter ADC, a demodulator, a rotation digital counter and a pullback digital counter.
17. The method of claim 13, wherein the method further comprises one or more of the following: (i) triggering a single acquisition of a depth scan via a trigger signal and recording the values of a rotation digital counter and a pullback digital counter derived from a demodulated coded synchronization signal demodulated by a demodulator of the optical system; (ii) triggering a single acquisition of a depth scan on an analog-to-digital converter ADC via a trigger signal and recording a rotation digital counter and a pullback digital counter derived from a demodulated encoding synchronization signal demodulated by a demodulator of the optical system; (iii) triggering sampling of imaging data via a trigger signal used as an A-line trigger signal, or triggering sampling of imaging data via a trigger signal as a k-clock trigger signal to uniformly acquire imaging data at k intervals; (iv) using a synchronization signal comprising a result pulse train, the result pulse train being a pulse train from a synchronization processor, wherein the synchronization processor is operative to send pulses corresponding to an index of the first encoder signal occurring at each revolution of the rotary motor, except that the synchronization processor is operative to modify the pulses at a set portion of the pullback, the set portion of the pullback being one or more of: the beginning of the pullback, the end of the pullback, a period from the beginning of the pullback to the end of the pullback, wherein the synchronization processor is operative to modify the pulses in a manner such that the synchronization processor blanks or skips a pulse at the beginning of the pullback, wherein the synchronization processor is operative to modify the pulses in a manner such that the synchronization processor blanks or skips a pulse at the end of the pullback, wherein the synchronization processor is operative to modify the pulses in a manner such that the synchronization processor blanks or skips a pulse at the end of the pullback, The processor is operative to modify the pulses in a manner such that the synchronization processor blanks or skips one pulse at the beginning of the pullback and then blanks or skips another pulse at the end of the pullback, wherein the synchronization processor is operative to modify the pulses in a manner such that the synchronization processor introduces additional pulses and / or delays at the beginning of the pullback and / or at the end of the pullback, wherein at the end of the pullback, the synchronization processor is operative to modify the pulses so that a frame counter of the data acquisition processor increments at a slower rate than a set rate as the rotary motor decelerates; and / or wherein at the beginning of the pullback, the synchronization processor is operative to modify the pulses so that a frame counter of the data acquisition processor increments toward a steady rate as the rotary motor accelerates to a steady-state target; and / or (v) The data acquisition processor includes a frame counter that increments every set number of triggers.
18. The method of claim 17, wherein one or more of the following: (i) the data acquisition processor includes a frame counter that increments at a set rate except at the beginning of a pullback, at which time the frame counter increments at a fraction of the set rate, such that a jump between the beginning of the pullback and the time at which the frame counter increments at the set rate accurately indicates the beginning and / or end of the pullback and allows for an accurate record of the beam position for each depth scan to be derived given a set total pullback length and / or time; (ii) the one or more processors include a control processor operative to control or send commands to a rotation motor controller and a pullback motor controller so as to achieve a set catheter or probe speed and / or position and / or set rotation motor and / or pullback motor speed and / or position to produce one or more scan patterns, and the data acquisition processor includes a frame counter, the frame counter incrementing at the set rate except that at the end of the pullback the synchronization processor is operative to modify the pulses to increment at a rate slower than the set rate as the rotation motor decelerates, whereupon the first encoder signal pulse train is delayed and the frame counter increments by an increasing number of A-line triggers, the frame counter incrementing at the set rate, the rotation motor deceleration being controlled by the control processor to accurately coincide with the end of the pullback, so as to accurately determine the end of the pullback and derive an accurate record of the beam position for each depth scan for a set total pullback length and / or time; (iii) the rotary motor has a sharp deceleration profile, and the rotary motor operates to decelerate significantly in one rotation for the number of A-line triggers that occur before a frame counter of the data acquisition processor is incremented, such that the deceleration profile of the rotary motor is large enough to be detected as a deceleration of the rotary motor, rather than merely as a change in the rotational speed of the rotary motor; and / or (iv) a variation in the speed of the rotary motor is operated to cause a pulse train per a set number of A-line triggers in normal operation, and a deceleration of the rotary motor is operated for another number of A-line triggers greater than the set number of A-line triggers during a time equivalent to one steady-state rotation, so that a threshold value above the set number of A-line triggers and below the another number of A-line triggers is set to detect the end of the pullback.
19. The method of claim 18, further comprising one or more of the following: (i) determining, via a pullback condition processor of the one or more processors, a pullback condition indicating or detecting the beginning and / or end of a pullback; (ii) initiating deceleration of the rotary motor by a rotary motor controller and / or by a rotary motor controller and a driver, wherein the rotary motor controller and / or the driver are operative to receive a command from the pullback condition processor to control the deceleration; (iii) receiving information from a rotary motor controller and / or driver via a pullback condition processor to determine a pullback condition; and / or (iv) The pullback condition processor is used when it is included in a scanning mechanism of the optical system.
20. The method of claim 17, wherein one or more of the following: (i) the rotary motor rotates at a speed lower than the target steady-state value and then accelerates simultaneously with the pullback motor acceleration; (ii) the data acquisition processor includes a frame counter that increments once at a set rate or as the rotary motor accelerates to a target steady-state value; (iii) the one or more processors include a control processor that operates to control or send commands to a rotation motor controller and a pullback motor controller so that a set speed and / or position of the catheter or probe and / or a set speed and / or position of the rotation motor and / or pullback motor is achieved to produce one or more scan patterns, and rotation motor acceleration is controlled by the control processor to accurately coincide with the start of pullback, and the start of pullback is accurately determined and an accurate record of the beam position for each depth scan is derived for a set total pullback length and / or time; (iv) the rotary motor has a steep acceleration profile, and the rotary motor operates to accelerate significantly in one revolution for a number of A-line triggers that occur before a frame counter of the data acquisition processor is incremented, such that the acceleration profile of the rotary motor is large enough to be detected as acceleration of the rotary motor to a target steady-state value rather than merely as a change in rotary motor speed; and / or (v) the variation in the speed of the rotary motor before the pullback is operated to cause a pulse train per a set number of A-line triggers, and the acceleration of the rotary motor during a time equivalent to one steady-state rotation is operated to be another number of A-line triggers greater than the set number of A-line triggers, so that a threshold value higher than the set number of A-line triggers and lower than the another number of A-line triggers is set to detect the start of the pullback.
21. The method of claim 20, further comprising one or more of the following: (i) determining, via a pullback condition processor of the one or more processors, a pullback condition indicating or detecting the beginning and / or end of a pullback; (ii) initiating acceleration of the rotary motor by a rotary motor controller and / or by a rotary motor controller and a driver, wherein the rotary motor controller and / or the driver are operative to receive commands to control the acceleration from the pullback condition processor; (iii) receiving information from a rotary motor controller and / or driver via a pullback condition processor to determine a pullback condition; and / or (iv) The pullback condition processor is used when it is included in a scanning mechanism of the optical system.
22. A non-transitory computer readable storage medium storing at least one program, the program operative to cause one or more processors to execute a method for performing image synchronization for one or more imaging modalities of an optical system, the method comprising: An imaging device using an optical system to obtain imaging data using one or more imaging modalities; performing beam scanning on a catheter or a probe of the optical system via a scanning mechanism of the optical system using a rotation motor of the optical system and a pullback motor of the optical system to obtain a beam position of the catheter or the probe, the rotation motor being operative to rotate at least a portion of the scanning mechanism and / or the catheter or the probe, and the pullback motor being operative to control pullback of the catheter or the probe; achieving image synchronization by recording the beam position simultaneously with the imaging data and achieving accurate spatial registration of the imaging data via one or more processors of the optical system; controlling, via the one or more processors of the optical system, a rotation motor controller of the optical system and a pullback motor controller of the optical system or sending commands thereto; as well as A synchronization processor via the one or more processors controls the first encoder signal and the second encoder signal before the synchronization processor interfaces with a data acquisition processor of the one or more processors so that each time a depth scan is acquired from the imaging data input, information from the first encoder signal and the second encoder signal is recorded for each of the rotation motor and the retraction motor to record the beam position for the depth scan, and the synchronization processor operates to use a single synchronization signal for the data acquisition processor to capture the position of the catheter or probe for each measured depth scan profile, wherein the optical system also includes a first encoder signal operative for use by the rotation motor controller and a second encoder signal operative for use by the retraction motor controller.
Citation Information
Patent Citations
Detection of atherosclerosis using indocyanine green
US20100092389A1
Systems, devices, methods, apparatus and computer-accessible media for providing optical imaging of structures and compositions
US20120101374A1
Hybrid systems and methods for multi-modal acquisition of intravascular imaging data and counteracting the effects of signal absorption in blood
US20160228097A1
Devices, systems, methods and storage mediums using full range optical coherence tomography
US20180003481A1
Coherence range imaging using common path interference
US20180045501A1
