Ultrasonic beacon visualization using optical sensors
The integration of an ultrasound array with optical sensors for emitting acoustic beamforming and beacon pulses addresses the limitations of PZT transducers, enabling compact and high-sensitivity imaging for precise medical instrument tracking and visualization.
Patent Information
- Application Number
- JP2024520698
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-10-08
- Filing Date
- 2022-10-07
- Publication Date
- 2024-11-06
AI Technical Summary
Conventional ultrasound imaging techniques using piezoelectric (PZT) transducers are limited by low power and require bulky circuitry, making them unsuitable for compact medical applications due to size constraints.
The use of an ultrasound array with optical sensors that emit acoustic beamforming and beacon pulses, allowing for compact and high-sensitivity visualization and tracking of objects, such as needles and catheters, by generating ultrasound images and target indicators using optical sensors.
Enables safe and reliable medical procedures by providing precise visualization and tracking of medical instruments, reducing the risk of unintended tissue damage through compact and sensitive imaging.
Smart Images

Figure 2024540838000001_ABST
Abstract
Description
[Technical field]
[0001] Cross-reference of related applications This application claims the benefit of U.S. Provisional Patent Application No. 62 / 253,846, filed October 8, 2021, the contents of which are incorporated herein by reference in their entirety.
[0002] The present invention relates generally to the field of visualizing and / or tracking objects using ultrasonic beacon signals. [Background technology]
[0003] Acoustic imaging is used in a variety of industries, including medical imaging. For example, acoustic imaging techniques can be used to visualize objects (e.g., needles, catheters, guidewires) used in clinical procedures such as biopsy, drug delivery, catheter placement, device implantation, etc. The use of acoustic imaging in medical applications offers several advantages. Acoustic imaging, such as ultrasound imaging, is a non-invasive form of imaging. Furthermore, ultrasound imaging uses ultrasound signals, which are known to have significant penetration depth.
[0004] Some existing acoustic imaging techniques use piezoelectric (PZT) transducers to visualize and track objects (e.g., needles, catheters, drug delivery pumps, etc.). However, PZT transducers are generally limited by low power. In addition, imaging techniques that include PZT transducers often require bulky circuitry. Thus, due to these size limitations (e.g., physical size), it can be difficult to use PZT transducers for medical applications. Thus, there is a need for new and improved compact techniques with high sensitivity for visualizing and tracking objects, particularly for medical applications. Summary of the Invention
[0005] Systems and methods for visualizing the location of an object are described herein. In some variations, a method for visualizing the location of an object may include emitting acoustic beamforming pulses and acoustic beacon pulses from an ultrasonic array, receiving acoustic beamforming signals corresponding to the acoustic beamforming pulses and acoustic beacon signals corresponding to the acoustic beacon pulses with one or more optical sensors disposed on the object, generating an ultrasound image based on the acoustic beamforming signals, and generating an object indicator based on the acoustic beacon signals. The ultrasonic array may include two or more transducers offset in a first dimension of the ultrasonic array.
[0006] In some variations, emitting an acoustic beacon pulse may include emitting a first acoustic beacon pulse from a first transducer and emitting a second acoustic beacon pulse from a second transducer. In some variations, the second transducer may be offset from the first transducer in a first dimension of the ultrasonic array. In some variations, receiving an acoustic beacon signal may include receiving, with a single optical sensor of the one or more optical sensors, a first acoustic signal corresponding to the first acoustic beacon pulse and a second acoustic signal corresponding to the second acoustic beacon pulse.
[0007] In some variations, the method may further include receiving, with at least one transducer, an acoustic beamforming signal corresponding to the beamforming pulse. In some variations, emitting a beacon pulse may further include emitting a third acoustic beacon pulse from a third transducer. In some variations, the method may further include emitting a first acoustic beacon pulse from the first transducer at a first time and emitting a second acoustic beacon pulse from the second transducer at a second time after the first time.
[0008] The method may further include substantially simultaneously emitting a first acoustic beacon pulse from the first transducer and emitting a second acoustic beacon pulse from the second transducer. In some variations, the first acoustic beacon pulse may have a first transmission frequency and the second acoustic beacon pulse may have a second transmission frequency different from the first transmission frequency. In some variations, generating the target indicator may include filtering the received acoustic beacon signal based on the first transmission frequency into a first acoustic beacon signal corresponding to the first acoustic beacon pulse and filtering the received acoustic beacon signal based on the second transmission frequency into a second acoustic beacon signal corresponding to the second acoustic pulse. In some variations, filtering the received acoustic beacon signal into the first and second acoustic beacon signals may include applying a comb filter to the received acoustic beacon signal having a first filtering band centered on the first transmission frequency and a second filtering band centered on the second transmission frequency.
[0009] In some variations, the first and second transducers may be excited with different coded excitation parameters. In some variations, generating the target indicator may include applying a matched filter to decode the received acoustic beacon signal into a first acoustic beacon signal corresponding to the first acoustic beacon pulse and a second acoustic beacon signal corresponding to the second acoustic beacon pulse. The coded excitation parameters may include parameters forming an orthogonal code pair. In some variations, the orthogonal code pair may be an orthogonal Golay code pair. In some variations, the coded excitation parameters may include parameters forming a Barker code. In some variations, the coded excitation parameters may include parameters forming a Chirp code. In some variations, the coded excitation parameters may include parameters forming a windowed nonlinear frequency modulation code.
[0010] In some variations, the method may further include alternating between emitting an acoustic beamforming pulse and emitting an acoustic beacon pulse. In some variations, the method may further include alternating between generating an ultrasound image based on the acoustic beamforming signal and generating a target indicator based on the acoustic beacon signal. In some variations, the method may further include emitting the acoustic beamforming pulse and the acoustic beacon pulse substantially simultaneously. The acoustic beamforming pulse may have a third transmit frequency and the acoustic beacon pulse has a fourth transmit frequency different from the third frequency. In some variations, the method may further include filtering the received acoustic beamforming signal based on the third transmit frequency and filtering the received acoustic beacon signal based on the fourth transmit frequency.
[0011] In some variations, the method may include generating the target indicator includes resolving the received acoustic beacon signal into a current target location. In some variations, the method may further include combining the target indicator with an ultrasound image. In some variations, the one or more optical sensors may comprise an interference-based optical sensor. In some variations, the one or more optical sensors may comprise an optical resonator or an optical interferometer. In some variations, the one or more optical sensors may comprise a whispering gallery mode (WGM) resonator.
[0012] In some variations, the one or more transducers may comprise a piezoelectric sensor, a single crystal material sensor, a piezoelectric micromachined ultrasonic transducer (PMUT) sensor, or a capacitive micromachined ultrasonic transducer (CMUT) sensor.
[0013] In some variations, the first dimension is a height dimension of the ultrasound array. In some variations, the first dimension is a lateral dimension of the ultrasound array.
[0014] A system for visualizing a position of an object may include an ultrasound array, at least one optical sensor, and at least one processor. In some variations, the ultrasound array may include a plurality of transducers configured to emit acoustic beamforming pulses and acoustic beacon pulses. In some variations, the plurality of transducers may include two or more transducers offset in a first dimension of the ultrasound array. In some variations, the at least one sensor may be disposed on the object and configured to detect an acoustic beamforming signal corresponding to the acoustic beamforming pulses and an acoustic beacon signal corresponding to the acoustic beacon pulses. In some variations, the at least one processor may be configured to generate an ultrasound image based on the acoustic beamforming signal and an object indicator based on the acoustic beacon signal.
[0015] In some variations, the plurality of transducers may include a first transducer configured to emit a first acoustic beacon pulse and a second transducer configured to emit a second acoustic beacon pulse. The second transducer may be offset from the first transducer in a first dimension of the ultrasonic array. The plurality of transducers may include a third transducer configured to emit a third acoustic beacon pulse. A distance between the first transducer and the second transducer in a second dimension of the ultrasonic array may be different from a distance between the third transducer and the second transducer in the second dimension of the ultrasonic array. In some variations, the optical sensor may include an interference-based optical sensor. In some variations, the optical sensor may include an optical resonator or an optical interferometer. In some variations, the optical sensor may be a whispering gallery mode (WGM) resonator.
[0016] In some variations, the plurality of transducers may comprise one or more of piezoelectric sensors, single crystal material sensors, piezoelectric micromachined ultrasonic transducer (PMUT) sensors, and capacitive micromachined ultrasonic transducer (CMUT) sensors. The at least one processor may be further configured to combine the ultrasound image and the subject indicator. In some variations, the system may further comprise a display configured to display one or more of the ultrasound image and the subject indicator.
[0017] In some variations, the ultrasound array may be disposed on the object. In some variations, the at least one optical sensor may be coupled to the object. In some variations, the at least one optical sensor may be integrally formed with the object. In some variations, the object may comprise an elongated member and a distal end. In some variations, the at least one optical sensor may be disposed on a distal end of the object. In some variations, the at least one optical sensor may be disposed on an elongated member of the object. In some variations, two or more optical sensors may be disposed on an elongated member of the object. In some variations, the object may comprise a needle. In some variations, the first dimension may be a height dimension of the ultrasound array. In some variations, the second dimension may be a lateral dimension of the ultrasound array. In some variations, the first dimension may be lateral to the second dimension. [Brief description of the drawings]
[0018] [Figure 1] 1 is an exemplary variation of a system for ultrasound visualization of an object. [Figure 2A] 1 illustrates a portion of an example variation of a system having a needle and an optical sensor attached to the needle for tracking and / or determining the needle's position. [Figure 2B] 1 illustrates a portion of an example variation of a system having a needle and two optical sensors attached to the needle for tracking and / or determining the needle's position. [Diagram 3]1 illustrates an exemplary variation of a 1.5D array including three elements configured to emit acoustic beacon pulses. [Figure 4] 1 illustrates an exemplary variation of a 1.5D array including three elements configured to emit acoustic beacon pulses. [Diagram 5] 1 is an exemplary schematic diagram illustrating the location of an element configured to emit an acoustic beacon pulse and illustrating the location of an optical sensor in a Cartesian coordinate system for locating an object; [Figure 6] 1 is an exemplary variation of a system for ultrasound beacon visualization of an object. [Figure 7] 1 illustrates an exemplary variation of the transmitter. [Figure 8] 1 illustrates a portion of an exemplary variation of a system for ultrasound beacon visualization for receiving signals and generating an ultrasound image and a target indicator. [Figure 9] FIG. 1 is a flow diagram illustrating an exemplary variation of a method for tracking and visualizing an object. [Figure 10] 11 is a flow diagram illustrating an exemplary variation of a needle visualization mode of operation. [Figure 11A] 1 illustrates an exemplary variation of a simultaneously occurring acoustic beacon signal spectrum and an acoustic beamforming signal spectrum. [Figure 11B] 11B illustrates a filter response of an exemplary variation of the dual filter for separating an acoustic beacon signal and an acoustic beamformed signal shown in FIG. 11A. [Figure 12] 2 illustrates an exemplary variation of a comb filter having three different frequency subbands. [Figure 13] 1 illustrates an exemplary schematic diagram of a combined ultrasound image and target indicator. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] Non-limiting examples of various aspects and variations of the present invention are described herein and illustrated in the accompanying drawings.
[0020] Systems, devices, and methods for ultrasonic beacon visualization using optical sensors are described herein. For example, the techniques described herein may use acoustic beacon signals using optical sensors to track and monitor objects during medical procedures. The techniques described herein may be compact in size and have high sensitivity, thereby improving visualization for medical applications such as medical imaging for tracking objects (e.g., needles, catheters, guidewires) during biopsies, drug delivery, catheter placement, combinations thereof, and the like.
[0021] Visualization of an object in medical applications can be an important component for performing a medical procedure in a safe and reliable manner. For example, a physician may visualize and track the tip of a needle while administering anesthesia to ensure safety. In such cases, proper visualization of the needle tip can reduce and / or prevent unintended vascular, nerve, or visceral damage. Similarly, visualization of the needle can be useful when performing medical procedures such as the Seldinger technique or catheter placement to facilitate access to blood vessels and / or other organs in a safe and consistent manner.
[0022] There are several drawbacks associated with conventional ultrasound imaging techniques for medical applications. For example, conventional ultrasound may use an imaging probe configured to emit ultrasound waves, but due to the smooth surface of the needle, incident ultrasound waves reflected from the needle surface may be steered away from the ultrasound receiver, thus weakening the deflection of the reflected waves. A piezoelectric (PZT) transducer is traditionally placed at the tip of the needle and configured to emit ultrasound waves to track the tip of the needle. However, PZT transducers have low power and low sensitivity due to their size requirements. PZT transducers may require bulky circuitry for visualization, thereby limiting their application in medical procedures.
[0023] In contrast, the systems and devices described herein may be compact in size and have high sensitivity. In some variations, a method for visualizing the position of an object (e.g., an end effector such as a needle, catheter, drug delivery pump, etc.) may use an ultrasonic array including one or more optical sensors disposed on the object (e.g., coupled to the object and integrally formed with the object). In some variations, the ultrasonic array may include two or more transducers in a first dimension (e.g., a predetermined direction, height dimension, lateral dimension) of the ultrasonic array and the optical sensor. For example, the height dimension may correspond to the y-axis and the lateral dimension may correspond to the x-axis of a Cartesian coordinate system. For example, the transducers in the ultrasonic array may be positioned such that the two or more transducers may be spaced apart (e.g., offset) from one another in at least a first dimension (e.g., separated from one another by a predetermined height relative to the ground and separated by different distances relative to the lateral midline). In some variations, these two or more transducers may be offset (e.g., in a first dimension) from the center of the ultrasonic array. The method may include emitting acoustic beamforming pulses and acoustic beacon pulses from an ultrasound array. An acoustic beamforming signal corresponding to the acoustic beamforming pulses may be received using one or more optical sensors. An acoustic beacon signal corresponding to the acoustic beacon pulses may be received using one or more optical sensors. An ultrasound image may be generated based on the acoustic beamforming signals. Additionally or alternatively, an object indicator (e.g., a graph, trace, grid, visual indicator) may be generated based on the acoustic beacon signals. The object indicator may represent a current location of the object. Additionally, the current location of the object may be stored and / or tracked over time to facilitate display and / or other visualization of the object's location and / or trajectory.
[0024] Exemplary System FIG. 1 is an exemplary variation of a system 101 for ultrasonic visualization of an object. While the system 101 may be used for ultrasonic beacon visualization of a needle 10, it should be understood that in other variations, the system 101 may be used for ultrasonic visualization of other objects (e.g., end effectors), such as catheters, guidewires, endoscopes, trocars, implants, combinations thereof, and the like. In some variations, the system 101 may include a processing system 200 coupled to the probe 100, one or more end effectors 10 (e.g., needles), and an optional display 300. In some variations, the end effector 10 may include one or more sensors 20, and the end effector 10 may be advanced into a medium 5 (e.g., body tissue, body cavity). In some variations, the processing system 200 may be operably coupled to the probe 100 and the needle 10. The needle 10 may be configured to generate an electrical signal configured to excite a set of transducers of the sensor 20 of the probe 100. A transducer (e.g., an ultrasonic array) in the probe 100 may be configured to emit acoustic beamforming pulses and / or acoustic beacon pulses toward the medium 5. In some variations, the medium 5 may comprise a nonlinear medium, such as, for example, body tissue. One or more optical sensors 20 disposed on at least a portion of the end effector may be configured to receive acoustic beacon signals corresponding to the acoustic beacon pulses emitted by the transducers of the probe 100. The acoustic beacon signals may include optical signals that may be transmitted to the processing system 200 via optical fibers or other suitable waveguides. In some variations, the probe 100 may be configured to receive acoustic beamforming signals reflected in response to the interaction of the acoustic beamforming pulses with the medium 5 and / or the needle 10. In some variations, the probe 100 may be configured to transmit the received acoustic beamforming signals to the processing system 200. The processing system 200 may be configured to generate an ultrasound image based on the received acoustic beamforming signals. The processing system 200 may be configured to analyze the optical signals to generate a target indicator corresponding to the location of the end effector 10.The ultrasound image and the interest indicator may optionally be displayed on the display 300. Additionally or alternatively, the interest indicator may be output as one or more of an audio signal and a tactile signal.
[0025] 1 is shown to be a needle 10, it should be readily understood that any suitable object (e.g., an end effector) may be visualized and / or tracked using system 101. For example, system 101 may be used to visualize and / or track a set of objects including a catheter as the catheter is advanced into a blood vessel and / or organ.
[0026] probe In general, the probe 100 of the system 101 may be configured to couple to a medium (e.g., placed outside of body tissue) to emit and receive ultrasonic signals. In some variations, the probe 100 may include an ultrasonic array having one or more elements (e.g., transducers) to output (e.g., generate) acoustic pulses and / or receive acoustic signals (e.g., echo signals) corresponding to the acoustic pulses. For example, the ultrasonic array may include one or more elements (e.g., transducers) configured to emit a set of acoustic beamforming pulses (e.g., ultrasonic signals) and / or receive a set of acoustic beamforming signals (e.g., ultrasonic echoes) corresponding to the set of acoustic beamforming pulses. Furthermore, the probe 100 may also include one or more elements (e.g., transducers) configured to emit a set of acoustic beacon pulses. In some variations, only the optical sensor may be configured to receive a set of acoustic beacon signals (e.g., ultrasonic echoes) corresponding to the set of acoustic beacon pulses, although in some variations, one or more transducers may additionally or alternatively be configured to receive a set of acoustic beacon signals corresponding to the set of acoustic beacon pulses. A set of beamforming signals corresponding to the set of beamforming pulses may be used to generate an ultrasound image. In some variations, a set of beacon signals corresponding to the set of emitted beacon pulses may be used for object tracking. For example, as discussed above, the set of beacon signals may be converted into a set of optical signals that may be analyzed to determine the location of the object and / or to generate an object indicator.
[0027] In some variations, the elements of the probe 100 may be arranged in an array, such as an ultrasonic array. The probe 100 may be configured to accommodate a variety of transducers, including, for example, piezoelectric transducers, lead zirconate titanate (PZT) transducers, polymer thick film (PTF) transducers, polyvinylidene fluoride (PVDF) transducers, capacitive micromachined ultrasonic transducers (CMUT), piezoelectric micromachined ultrasonic transducers (PMUT), photoacoustic transducers, single crystal materials (e.g., LiNbO3 (LN)), Pb(Mg 1 / 3 Nb 2 / 3 )-PbTiO3(PMN-PT), and Pb(In 1 / 2 Nb 1 / 2 )-Pb(Mg 1 / 3 Nb 2 / 3 The ultrasonic array may include one or more transducers, such as one or more of transducers based on PIN-PbTiO3 (PIN-PMN-PT), combinations thereof, and the like. It should be understood that the probe 100 may include any of a plurality of transducer types. In some variations, the ultrasonic array may include elements of the same type. Alternatively, the ultrasonic array may include elements of different types. Additionally, in some variations, the ultrasonic array may include one or more optical sensors, such as an interference-based optical sensor, which may be one or more of an optical interferometer and an optical resonator (e.g., a whispering gallery mode (WGM) resonator).
[0028] In some variations, the probe 100 may include one or more housings (e.g., enclosures) with corresponding ultrasound arrays that may have the same or different configurations and / or functions. For example, different portions of the probe 100 may be placed externally on different portions of the tissue 5.
[0029] The ultrasound transducer arrays described herein may have various dimensionalities. For example, the arrays may be configured for operation in a one-dimensional (1D) array configuration, a one-half dimensional (1.25D) array configuration, a one-half dimensional (1.5D) array configuration, a one-seventh dimensional (1.75D) array configuration, and a two-dimensional (2D) array configuration, as described in more detail below. In general, the dimensionality of the ultrasound transducer array relates to one or more of the elevation beam width (e.g., elevation beam slice thickness), aperture size, focus, and steering range across the imaging field of view (e.g., across the imaging depth).
[0030] In some variations, the 1D array may include only one row of elements in a first dimension (e.g., height dimension) and a given (e.g., fixed) height aperture size. For example, the 1D array may include a plurality of array elements arranged in a single (e.g., only one) row extending in a single (e.g., first) dimension (e.g., lateral dimension). In some variations of linear arrays, the spacing between two adjacent elements may be equal to about one wavelength of the transmitted acoustic wave. In some variations of phased arrays, the spacing between two adjacent elements may be about half the wavelength of the transmitted acoustic wave. Due to the single dimension of the 1D array, both the height aperture size and the height focus may be fixed. Thus, a thin slice thickness in the height dimension cannot be maintained throughout the entire imaging depth.
[0031] In some variations, the 1.25D array may have multiple rows of elements in a first dimension (e.g., height dimension), a variable height aperture size, and a predetermined (e.g., fixed) height focus via an acoustic lens. In some variations, the height aperture size may be electronically adjusted (e.g., varied, modified, controlled) to control (e.g., narrow) the height beam width and height beam slice thickness. In some variations, the height beam width may be further reduced by adding rows to the array in the height dimension. However, because the 1.25D array has a predetermined height focus, it may not be possible to control the beam thickness over the entire imaging field of view (e.g., imaging depth).
[0032] In some variations, the 1.5D array may include multiple rows of elements in a first dimension (e.g., height dimension), variable height aperture size, and variable height focus via electronic delay control. In some variations, the number of array elements may be greater than the number of channels of the imaging system. Furthermore, one or more analog switches (e.g., high voltage switches) may be configured to select a set of sub-apertures of the 1.5D array. Thus, the 1.5D array may be configured to provide a relatively narrow height beam width across the imaging field of view, enabling imaging of smaller lesions at various imaging depths. For example, the 1.5D array may include a relatively thin height beam slice thickness to resolve smaller objects (e.g., blood vessels, cysts). Furthermore, the 1.5D array may provide more uniform image quality for near-field and far-field images.
[0033] In some variations, the 1.75D array may comprise a 1.5D array with additional elevation beam steering capabilities (e.g., up to about 5 degrees in at least one dimension, up to about 10 degrees in at least one dimension, up to about 15 degrees in at least one dimension, or up to about 20 degrees in at least one dimension).
[0034] In some variations, the 2D array may comprise multiple elements in a first and second dimension (e.g., both lateral and elevational dimensions) to meet minimum pitch requirements for large beam steering angles. As with 1.5D arrays, systems incorporating 2D arrays may include one or more analog switches to select a predetermined set of subapertures of the array.
[0035] In some variations, the transducers of an ultrasonic array may be spaced (e.g., offset) from one another in one or more dimensions (e.g., directions). For example, an array in the probe 100 may have a height characteristic that is greater than that of a 1D ultrasonic array. For example, in some variations, the array may be a 1.25D ultrasonic array, a 1.5D ultrasonic array, and / or a 2D ultrasonic array.
[0036] In some variations, one or more acoustic beacon pulse emitting elements in the array may be offset in a first dimension (e.g., height dimension) of the array relative to other acoustic beacon pulse emitting elements. In some variations, at least one acoustic beacon pulse emitting element is located in a location that forms a triangle with two of the other acoustic beacon pulse emitting elements. In some variations, one or more elements in the first dimension may be configured to emit an acoustic beacon pulse. Additionally or alternatively, one or more elements in the first dimension may emit an acoustic beamforming pulse. Additionally or alternatively, one or more elements in the first dimension may receive an acoustic beamforming signal corresponding to the acoustic beamforming pulse. In some variations, the array may be a 1D array, but may include at least one element that may be offset from other elements in the array in the first dimension. In some variations, at least one element may be offset from the center of the array. Further examples of 1.5D arrays are described in more detail below with respect to FIGS. 3 and 4. In some variations, the array in the probe 100 may be a phased array of elements.
[0037] Exemplary 1.5D Array As discussed above, a probe (e.g., probe 100 of FIG. 1) may include an array of elements for generating acoustic beamforming pulses and acoustic beacon pulses and receiving acoustic beamforming signals. The array may have a height dimension greater than one. In some variations, the array may be a 1.5D array. The elements of the 1.5D array may be any suitable elements or combinations of elements, such as piezoelectric transducers, CMUT transducers, PMUT transducers, transducers based on single crystal materials, combinations thereof, and / or the like.
[0038] In some variations, the same transducer element may be used to emit a set of acoustic beamforming pulses, emit a set of acoustic beacon pulses, receive a set of acoustic beamforming signals, and / or receive a set of acoustic beacon signals (e.g., in combination with an optical sensor receiving the acoustic beacon signals).
[0039] For example, a first set of transducers may be configured to emit both acoustic beamforming pulses and acoustic beacon pulses. In some variations, one or more transducers in the set of transducers may be configured to receive one or more of acoustic beamforming signals and acoustic beacon signals. Additionally or alternatively, a second set of transducers different from the first set of transducers may be configured to receive one or more of acoustic beamforming signals and acoustic beacon signals.
[0040] Alternatively, different transducers may be configured to emit acoustic beamforming pulses and acoustic beacon pulses. For example, a first set of transducers may be used to emit acoustic beamforming pulses and a second set of transducers may be used to emit acoustic beacon pulses. One or more transducers of the first and second sets of transducers may be configured to receive one or more of the acoustic beamforming signals and the acoustic beacon signals. Additionally or alternatively, a third set of transducers different from the first and second sets of transducers may be configured to receive one or more of the acoustic beamforming signals and the acoustic beacon signals.
[0041] The transducer elements configured to emit acoustic beamforming pulses and / or acoustic beacon pulses may be excited in any suitable manner. For example, the array elements may be excited in such a way that acoustic beamforming pulses and acoustic beacon pulses are emitted in alternating (e.g., interleaved) fashion. For example, elements configured to emit acoustic beamforming pulses may be excited first, followed by elements configured to emit acoustic beacon pulses, and then tail elements configured to emit acoustic beamforming pulses may be excited again. Similarly, elements configured to emit acoustic beacon pulses may be excited, followed by elements configured to emit acoustic beamforming pulses, and then elements configured to emit acoustic beacon pulses may be excited again. Additionally or alternatively, elements in the array may be excited in such a way that acoustic beamforming pulses and acoustic beacon pulses may be configured to be emitted substantially simultaneously. In some variations, the acoustic beamforming pulses may have a different frequency than the acoustic beacon pulses, and the different frequency may be used to distinguish between corresponding acoustic beamforming signals and acoustic beacon signals.
[0042] [In some variations, the 1.5D array may include elements arranged in two or more rows (e.g., two, three, four, etc.). In some variations, each row of the 1.5D array may have the same number of elements. Alternatively, each row of the 1.5D array may have a different number of elements. Two or more elements of the 1.5D array may be configured to emit acoustic beacon pulses ("beacon elements"). One or more of these beacon elements may be offset in a height dimension from one or more other beacon elements. For example, a first beacon element may be offset in a height dimension from a second beacon element. In some variations, at least one beacon element may be located in a location that forms a triangle with at least two of the other acoustic beacon pulse emitting elements. The offset of the beacon elements in the height dimension and / or the offset of the beacon elements in the lateral dimension of the array may help to facilitate triangulation algorithms for determining the location of a target based, for example, on an acoustic beacon signal corresponding to an acoustic beacon pulse.
[0043] In some variations, each element configured to emit an acoustic beacon pulse may emit a beacon pulse at a different frequency. For example, a first element configured to emit an acoustic beacon pulse may be excited at a first frequency, and a second element configured to emit an acoustic beacon pulse may be excited at a second frequency. For example, each element configured to emit an acoustic beacon pulse may be excited with different coded excitation parameters. Some non-limiting examples of coded excitation parameters include parameters forming orthogonal code pairs, Barker codes, Chirp codes, windowed nonlinear frequency modulation, combinations thereof, and the like.
[0044] In some variations, the elements configured to emit acoustic beacon pulses may be excited sequentially. For example, a first element configured to emit acoustic beacon pulses may be excited at a first time, and a second element configured to emit acoustic beacon pulses may be excited at a second time after the first time. For example, if three elements in a 1.5D array are configured to emit acoustic beacon pulses, the first element may be excited at a first time, the second element may be excited at a second time after the first time, the third element may be excited at a third time after the second time, and the first element may be excited again at a fourth time after the third time. In some variations, the sequential excitation may occur in a periodic manner. For example, the first element, the second element, and the third element may be excited at periodic (e.g., regular) time intervals. In some variations, the elements configured to emit acoustic beacon pulses may be excited substantially simultaneously (e.g., at different frequencies).
[0045] In some variations, the element configured to emit an acoustic beacon pulse may be configured to emit an acoustic beamforming pulse. In some variations, the element configured to emit an acoustic beacon pulse may be configured to receive an acoustic beamforming signal corresponding to the acoustic beamforming pulse emitted from the array. Thus, the element configured to emit an acoustic beacon pulse may enable the generation of an ultrasound image in addition to the generation of the interest indicator.
[0046] FIG. 3 illustrates an example variation of a 1.5D array that includes a set of three elements 120 configured to emit a set of acoustic beacon pulses. In FIG. 3, the 1.5D array includes two rows of elements (e.g., a top row and a bottom row). In some variations, each row in the array may have a different number of elements. For example, in FIG. 3, the top row has more elements than the bottom row. Further, in FIG. 3, the top row includes one beacon element 120a configured to emit an acoustic beacon pulse, and the bottom row includes two elements 120b and 120c configured to emit acoustic beacon pulses at opposite ends of the array.
[0047] In some variations, the beacon element 120a may be offset from the beacon elements 120b and 120c in a first dimension (e.g., height dimension). Additionally, the beacon element 120a may be offset from a midline (not shown) between the beacon elements 120b and 120c such that the distance between the beacon elements 120a and 120b in a second dimension (e.g., lateral dimension) is different from the distance between the beacon elements 120a and 120c in the second dimension. The first distance between the beacon elements 120a and 120b may be different from the second distance between the beacon elements 120a and 120c. The other elements 110 in the top and bottom rows may be configured to emit acoustic beamforming pulses and receive acoustic beamforming signals corresponding to the acoustic beamforming pulses. In some variations, the beacon elements 120a, 120b, 120c may be configured to emit acoustic beamforming pulses and / or receive acoustic beamforming signals. Thus, while element 110 allows for the generation of only ultrasound images, the beacon elements 120a, 120b, 120c may allow for the generation of ultrasound images in addition to the generation of the target indicator. Although only three beacon elements are shown, it should be understood that in some variations, the array may include any suitable number of beacon elements. It should be understood that the first dimension may be in any direction and the second dimension may be transverse (e.g., perpendicular) to the first dimension. For example, the first dimension may correspond to a height dimension or a lateral dimension and the second dimension may rotate circumferentially around the first dimension. Thus, in some variations, the first dimension may be a lateral dimension and the second dimension may be a corresponding height dimension.
[0048] FIG. 4 illustrates an example variation of a 1.5D array including three beacon elements (e.g., beacon element 120 and beacon element 122) configured to emit acoustic beacon pulses. Beacon element 122 in FIG. 4 is shown offset from beacon element 120 in a first dimension (e.g., height dimension) of the array and offset from a midline (not shown) between beacon elements 120 in a second dimension (e.g., lateral dimension) of the array. In some variations, beacon element 122 may be a beacon transducer configured to emit acoustic beacon pulses alone. In addition to emitting acoustic beacon pulses, beacon element 120 may be configured to emit acoustic beamforming pulses and / or receive acoustic beamforming signals. Thus, beacon element 120 may contribute to generating an ultrasound image (e.g., in addition to generating an interest indicator by emitting a beacon signal), while beacon element 122 may only contribute to generating an interest indicator. In some variations, element 122 can be the same type of element as element 120 (e.g., all three can be PZT transducers). Alternatively, element 122 can be a different type of element than element 120.
[0049] In FIG. 4, the 1.5D array includes two rows. The top row includes beacon elements 122 specialized in emitting acoustic beacon pulses and optical sensor elements 112. The optical sensor elements 112 may be configured to receive acoustic beamforming signals. In some variations, the optical sensor elements 112 may include any suitable optical sensor described herein. The bottom row of FIG. 4 includes transducer elements 110 configured to emit acoustic beamforming pulses and receive acoustic beamforming signals, and beacon elements 120 configured to emit acoustic beacon pulses. In FIG. 4, the beacon elements 120 are shown positioned at opposite ends of the array, but may alternatively be positioned in any suitable location in the bottom row.
[0050] 3 and 4 are described as 1.5D arrays for illustrative purposes only. As discussed above, a 1.5D array may have any suitable number of rows and any suitable number of elements. Additionally, an ultrasound array may include mixed type elements (e.g., optical and non-optical sensors). Examples of such suitable mixed arrays are described in more detail in International Patent Application No. PCT / US2021 / 033715, which is incorporated herein by reference. Elements configured to emit acoustic beacon pulses may also be configured to emit acoustic beamforming pulses and / or receive acoustic beamforming signals. Alternatively, at least some elements configured to emit acoustic beacon pulses may be dedicated solely to emitting acoustic beacon pulses. Beacon elements configured to emit acoustic beacon pulses may be positioned at any suitable location within the array, where at least one beacon element is offset within the height dimension of the array and / or offset from a midline between at least two other beacon elements within the lateral dimension of the array.
[0051] Processing System The processing system 200 may be configured to transmit electrical signals to excite one or more of the elements in the probe 100. Additionally, the processing system 200 may be configured to receive electrical signals from the probe 100 corresponding to a representation of the converted ultrasound echoes (e.g., a set of beamformed signals). The processing system 200 may be configured to process these electrical signals to generate a set of ultrasound images. The processing system 200 may also be configured to receive a set of optical signals corresponding to the set of beacon signals via the optical fibers of one or more of the optical sensors 20. The processing system 200 may be configured to process the set of optical signals to generate an object indicator and / or determine the location of the object (e.g., the needle 10).
[0052] FIG. 6 illustrates another exemplary variation of a system 601 (e.g., structurally and / or functionally similar to system 101 of FIG. 1) for ultrasonic beacon visualization of a target. FIG. 6 shows components of a processing system 200 according to some variations. For example, as seen in FIG. 6, the processing system may include a transmitter 220, a receiver 230, a waveform generator 240, and one or more processors (e.g., signal processor 250 and processor 260). The waveform generator 240 may be configured to generate a set of digital waveforms for acoustic beamforming pulses and acoustic beacon pulses. One or more processors (e.g., processor 260) included in the processing system 200 may be configured to control the waveform generator 240. The waveform generator 240 may be configured to generate and send digital waveforms to one or more of the transmitters 220 and / or matched filters (not shown in FIG. 6).
[0053] In some variations, the transmitter 220 may be configured to convert a set of digital waveforms into a set of electrical signals (e.g., high-voltage electrical signals) configured to excite elements in the ultrasonic array of the probe 100. FIG. 7 illustrates an exemplary variation of the transmitter 220. In some implementations, the transmitter 220 may include one or more of a bipolar transmitter and a multi-level transmitter. It should be understood that the transmitter 220 may include any of a plurality of transmitter types. In some variations, the transmitter 220 may include a set of custom-made transmitters (e.g., for generating a continuous signal). As seen in FIG. 7, the transmitter 220 may include one or more of a digital-to-analog converter (DAC) 226, a gain controller 228, a low-pass filter 224, and power amplifiers 221, 222. In some variations, the gain controller 228 may be omitted. The DAC 226 may be configured to convert the digital waveform into an analog signal. The low-pass filter 224 may be configured to smooth the analog signal. The gain controller 228 may be configured to transmit power (e.g., electrical signals) to excite elements in the probe 100 to emit acoustic beamforming pulses. In some variations, one or more of the set of transmit channels that transmit electrical signals to the probe 100 may include the same drive voltage. Such variations may not require a gain controller 228. In some variations, the power amplifier 222 may be configured to adjust the voltage of the electrical signals of the individual channels based on the output of the gain controller 228. For example, the power amplifier 221 may be configured to increase the amplitude of the acoustic beacon pulse.
[0054] 8 illustrates an example variation of at least some components of a processing system 200 configured to generate an ultrasound image and an object indicator. As seen in FIG. 8, the processing system 200 may include one or more of a receiver 232, a beamformer 234, a digital signal processor (DSP) 236 (e.g., signal processor 250 of FIG. 6), a digital scan converter (DSC) 238, an image combiner 239, a beacon receiver 231, a matched filter 233, a position calculator 235, and an object indicator generator 237.
[0055] In some variations, the receiver 232 may be configured to receive a set of beamformed signals (e.g., ultrasound echoes) from the probe 100. The receiver 232 may be configured to convert the beamformed signals (e.g., analog beamformed signals) into corresponding digital signals. The beamformer 234 may be configured to process the digitized beamformed signals received from the receiver 232. The DSP 236 may be configured to process the digitized beamformed signals, for example, by filtering, envelope detection, log compression, combinations thereof, and the like. The DSC 238 may be configured to convert the individual scan lines generated after processing of the digitized beamformed signals into a set of two-dimensional images.
[0056] In some variations, the beacon receiver 231 may be configured to receive a set of optical signals from the optical sensor 20. The beacon receiver 231 may be configured to convert the set of optical signals into a set of digital signals. In some variations, the matched filter 233 may be configured to process the digitized signals to maximize the signal-to-noise ratio. For example, the matched filter 233 may be configured to compress the set of digitized signals. The position calculator 235 may be configured to estimate a location of one or more of the optical sensors 20, as described in more detail below. In some variations, the object indicator generator 237 may be configured to generate an object indicator corresponding to a location of at least a portion (e.g., needle tip, needle body, etc.) of the object (e.g., needle 10). The image combiner 239 may be configured to combine (e.g., overlay or otherwise merge) the ultrasound image and the object indicator to form a final display image.
[0057] As discussed above, one or more processors included in the processing system 200 (e.g., signal processor 250, processor 260, etc.) may be configured to perform one or more of data management, signal processing, image processing, waveform generation (e.g., beamforming, beacon, etc.), filtering, user interface, combinations thereof, and / or the like. The processor(s) may be any suitable processing device configured to operate and / or execute a set of instructions or code and may include one or more data processors, image processors, graphic processing units, digital signal processors, and / or central processing units. The processors may be, for example, general purpose processors, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), etc. The processor(s) may be configured to operate and / or execute application processes and / or other modules, processes and / or functions associated with the system 101.
[0058] In some variations, the processing system 200 may be configured to run and / or execute application processes and / or other modules. When executed by a processor, these processes and / or modules may be configured to perform specific tasks. Collectively, these specific tasks may enable the processing system 200 to transmit electrical signals to excite one or more elements of the probe 100, generate an ultrasound image from a beamformed signal, and generate a target indicator from a beacon signal. In some variations, the application processes and / or other modules may be software modules. The software modules (which execute on the hardware) may be expressed in a variety of software languages (e.g., computer code), including C, C++, Java, Python, Ruby, Visual Basic, and / or other object-oriented, procedural, or other programming languages and development tools. Examples of computer code include, but are not limited to, microcode or microinstructions, machine instructions such as those generated by a compiler, code used to generate a web service, and files containing high-level instructions executed by a computer using an interpreter. Additional examples of computer code include, but are not limited to, control signals, encrypted code, and compressed code.
[0059] In some variations, the processing system 200 may comprise a memory configured to store data and / or information. In some variations, the memory may comprise one or more of random access memory (RAM), static RAM (SRAM), dynamic RAM (DRAM), memory buffer, erasable programmable read-only memory (EPROM), electrically erasable read-only memory (EEPROM), read-only memory (ROM), flash memory, volatile memory, non-volatile memory, combinations thereof, and the like. Some variations described herein may relate to a computer storage product having a non-transitory computer-readable medium (which may also be referred to as a non-transitory processor-readable medium) having thereon instructions or computer code for performing various computer-implemented operations. The computer-readable medium (or processor-readable medium) is non-transitory in the sense that it does not itself include a transitory propagating signal (e.g., a propagating electromagnetic wave that propagates information over a transmission medium such as space or cable). The media and computer code (which may also be referred to as code or algorithms) may be designed and constructed for a specific purpose or multiple purposes.
[0060] display In some variations, the display 300 may be configured to receive output from the processing system 200. The display 300 may be operatively coupled to the processing system 200 and configured to display one or more of an ultrasound image (e.g., a real-time ultrasound image) and one or more object indicators (e.g., a graphic or other icon, trace, grid, visual indicator) representing the location of the object. In some variations, the display 300 may be configured to display the ultrasound image and the set of object indicators in real-time. In some variations, the set of object indicators may be overlaid on the ultrasound image. For example, the ultrasound image may be displayed on the display 300 and the set of object indicators may be displayed over the ultrasound image on the display 300. The set of object indicators may be any suitable visual indicators representing the location of the object (e.g., needle 10). For example, the set of object indicators may include a graphic positioned over the ultrasound image to represent the current location of the object relative to other objects (e.g., tissue features) in the ultrasound image. Thus, the location of the object indicators may communicate a location within the field of view of the ultrasound probe.
[0061] As discussed above, output from the processing system 200 may be sent to the display 300. The connection between the processing system 200 and the display 300 may be via a wired electrical medium (e.g., High Definition Multimedia Interface (HDMI), Digital Visual Interface (DVI), Video Graphics Array (VGA), and / or the like) and / or a wireless electromagnetic medium (e.g., WIFI™, Bluetooth®, and / or the like), and / or the like. The display 300 may be any suitable display, such as a liquid crystal display (LCD) monitor, an organic light emitting diode monitor (OLED), a cathode ray tube monitor (CRT), or any suitable type of monitor. In some variations, the display 300 may include an interactive user interface (e.g., a touch screen) and may be configured to send a set of commands (e.g., pause, resume, and / or the like) to the processing system 200.
[0062] Optical Sensors As discussed herein, a set of acoustic beacon signals corresponding to a set of acoustic beacon pulses may be received by one or more optical sensors 20. In some variations, the optical sensor 20 may include one or more of interference-based optical sensors, such as an optical interferometer, an optical resonator, and the like. Examples of optical interferometers include Mach-Zehnder interferometers, Michelson interferometers, Fabry-Perot interferometers, Sagnac interferometers, and the like. For example, a Mach-Zehnder interferometer may include two nearly identical optical paths (e.g., fibers, on-chip silicon waveguides, etc.) that contain finely tuned acoustic waves (e.g., by acoustic wave-induced physical motion, acoustic wave-induced refractive index adjustments, etc.) to effect a distribution of optical power at the output of the Mach-Zehnder interferometer and thus detect the presence or magnitude of the acoustic waves.
[0063] Additionally or alternatively, one or more of the optical sensors 20 may include an optical resonator. The optical resonator may include a closed loop of a transparent medium that allows some allowed frequencies of light to propagate continuously within the closed loop and accumulates optical energy of the allowed frequencies of light within the closed loop. For example, the optical resonator may be a whispering gallery mode (WGM) resonator that may permit the propagation of a set of whispering gallery modes (WGMs) traveling on a concave surface of the optical resonator where the allowed frequencies circulate around the circumference of the optical resonator. Each mode from the WGMs may correspond to the propagation of a frequency of light from the set of allowed frequencies. The set of allowed frequencies of light and quality factor of the optical resonator may be based at least in part on one or more of a set of geometric parameters of the optical resonator, a refractive index of the transparent medium, and a refractive index of an environment surrounding the optical resonator.
[0064] In some variations, the WGM resonator may include a substantially curved portion (e.g., a spherical portion, a toroid-shaped portion, a ring-shaped portion). Furthermore, the substantially curved portion may be supported by a stem portion. The shape of the WGM resonator (e.g., the shape of the substantially curved portion of the WGM resonator) may be any suitable shape. For example, the shape of the WGM resonator may be spherical (e.g., a solid sphere), bubble-shaped (e.g., a sphere with a cavity), cylindrical, elliptical, ring, disk, toroid, and the like. Some non-limiting examples of WGM resonators include microring resonators (e.g., circular microring resonators, non-circular microring resonators such as resonators having a shape of a racetrack, ellipse), microbottle resonators, microbubble resonators, microsphere resonators, microcylinder resonators, microdisk resonators, microtoroid resonators, combinations thereof, and the like.
[0065] Further examples of optical sensors that may be used for beacon visualization (e.g., types of optical sensors, manufacturing and packaging of optical sensors) are described in International Patent Application No. PCT / US2020 / 064094, International Patent Application No. PCT / US2021 / 022412, and International Patent Application No. PCT / US2021 / 039551, each of which is incorporated by reference herein.
[0066] Input / Output Devices In some variations, system 101 may further include a set of input / output devices (not shown) configured to receive information input to or output information from system 101. The set of input / output devices may include, for example, one or more of a keyboard, a mouse, a monitor, a webcam, a microphone, a touch screen, a printer, a scanner, a virtual reality (VR) head mounted display, a joystick, a biometric reader, and the like. Additionally or alternatively, in some variations, system 101 may include or be communicatively coupled to one or more storage devices (e.g., local or remote memory device(s)).
[0067] End effector The optical sensor 20 may be disposed on (e.g., coupled, attached, integral, or otherwise located) at least a portion of the end effector 10 (e.g., needle) to be tracked. In some variations, the end effector may include a needle 10 including a cylindrical body (e.g., barrel, tube, lumen), an elongated member (e.g., plunger, shaft), and a distal tip. The elongated member may be configured to translate (e.g., slidably move) within the cylindrical body (e.g., the elongated member may translate within the cylindrical body). The elongated member may be coupled to any suitable actuation mechanism (e.g., actuator) configured to inject and / or withdraw fluid from the cylindrical body. For example, the elongated member may be manually moved within the cylindrical body to inject and / or withdraw fluid from the cylindrical body. Additionally or alternatively, the elongated member may be coupled to an actuator, such as, for example, a motor, to move the elongated member within the cylindrical body to inject and / or withdraw fluid from the cylindrical body. The cylindrical body may be open at one end and tapered at a distal end (e.g., a hollow tip) at the other end. In some variations, the tip of the needle 10 may include an attachment (e.g., a connector) for a stem having a piercing tip configured to pierce a given medium (e.g., the patient's skin). In some variations, the stem may be elongated to be narrower in diameter than the needle 10. The tip may be any suitable type of tip, such as a Slip-Tip®, Luer-Lok®, eccentric, etc.
[0068] In some variations, the optical sensor may be disposed (e.g., bonded, attached, integrated, or otherwise located) on the end effector 10 in any suitable manner, such as with an epoxy or mechanical interfit features. FIG. 2A illustrates an exemplary variation of a system in which an optical sensor 20 is attached to a needle 10 to facilitate needle tracking and position determination. In FIG. 2A, the optical sensor 20 may be attached, bonded, integrated, or otherwise attached to the tip (e.g., distal tip) of the needle 10. The optical sensor 20 may be configured to detect an acoustic beacon signal generated from a probe (e.g., the probe 100 of FIG. 1). The optical sensor 20 may be configured to receive the acoustic beacon signal through a photoelastic effect and / or physical deformation of the optical sensor 20. For example, in the presence of an acoustic beacon pulse, the light and / or sound waves (e.g., WGM) received by the optical sensor 20 may undergo a spectral shift caused by a change in the refractive index and shape of the optical sensor 20. The optical sensor 20 may be configured to transmit a set of optical signals representative of the received acoustic beacon signals to a processing system (e.g., processing system 200 of FIG. 1). In some variations, the optical sensor 20 may be coupled to one or more optical waveguides 22 (e.g., optical fibers, photonic integrated circuit waveguides) for transmitting the set of optical signals to the processing system. The processing system may be configured to generate an object indicator based on the optical signals. In some variations, the object indicator may represent a position of the tip of the needle 10 and / or may be used to track the tip of the needle 10. For example, the tip of the needle 10 may be visualized and tracked based on the object indicator. Thus, the needle 10 may be reliably visualized and tracked during a medical procedure using at least a single optical sensor 20.
[0069] FIG. 2B illustrates a cross-sectional view of an exemplary variation of a system in which two optical sensors 20 are attached to an end effector 10 (e.g., a needle) to track and / or determine the position of the end effector (e.g., the needle 10). As seen in FIG. 2B, the first optical sensor 20 may be disposed on the distal tip of the needle 10, while the second optical sensor 20 may be proximal to the first optical sensor 20 (e.g., disposed on the elongated member of the needle 10). Thus, the first and second optical sensors 20 may be configured to receive an acoustic beacon signal generated by a probe (e.g., the probe 100 of FIG. 1). The first and second optical sensors 20 (e.g., the first optical sensor at the distal tip and the second optical sensor on the elongated member) may be coupled to the same waveguide 22 (e.g., an optical fiber, a photonic integrated circuit waveguide) to transmit (e.g., propagate) an optical signal to a processing system (e.g., the processing system 200 of FIG. 1). The processing system may be configured to generate a first object indicator representative of the position of the tip of the needle 10 (e.g., where the first optical sensor is located) based on the optical signal received from the first optical sensor 20, and a second object indicator representative of the position of the elongated member of the needle 10 (e.g., where the second optical sensor is located) based on the optical signal received from the second optical sensor 20. Additionally or alternatively, the processing system may be configured to generate a single object indicator based on both the position of the tip of the needle 10 and the position of the elongated member using the first and second optical sensors. For example, the object indicator may include a vector. Thus, the needle 10 may be reliably visualized and tracked during a medical procedure by visualizing and tracking the tip and / or elongated member of the needle 10.
[0070] Although FIG. 2A illustrates a single optical sensor 20 for visualizing and tracking the end effector 10 and FIG. 2B illustrates two optical sensors 20 for visualizing and tracking the end effector 10, it should be readily understood that any suitable number of optical sensors may be used to visualize and track the end effector (e.g., three or more optical sensors, such as three, four, five, or more optical sensors). These optical sensors may be attached, coupled, integrated, or otherwise mounted to any suitable portion of the end effector. For example, using three optical sensors on a single needle 10 (e.g., one at the needle tip and two along the elongated member of the needle) may facilitate tracking the bending of the needle 10 in addition to visualizing and tracking the position of the needle tip. As discussed above, the system 101 of FIG. 1 is described solely for purposes of illustration to depict needle tracking. It should be readily understood that any other object (e.g., end effector, catheter, guidewire, endoscope, trocar, implant) may be visualized and / or tracked using the systems and methods described herein.
[0071] Exemplary Methods FIG. 9 is a flow diagram illustrating an example variation of a method 900 for tracking and visualizing an object. At 902, the method 900 may include emitting acoustic beamforming pulses and acoustic beacon pulses. The acoustic beamforming pulses and acoustic beacon pulses may be emitted by a probe (e.g., probe 100 of FIG. 1) including an array of elements (e.g., a 1.5D ultrasound array) including any of the arrays described herein. In some variations, two or more elements of the array may emit acoustic beacon pulses. For example, two or more elements of the array may be excited using an electrical signal generated by a processing system (e.g., processing system 200 of FIG. 1) and configured to emit a set of acoustic beacon pulses. In some variations, one or more of these elements may be configured to independently emit acoustic beacon pulses at different frequencies. Additionally or alternatively, one or more of these elements may be configured to emit a set of acoustic beacon pulses at the same frequency.
[0072] In some variations, one or more of the elements may be configured to emit acoustic beacon pulses sequentially. For example, if there are three beacon elements in the array configured to emit acoustic beacon pulses, the first beacon element may be configured to emit a first acoustic beacon pulse at a first time, the second beacon element may be configured to emit a second acoustic beacon pulse at a second time, and the third beacon element may be configured to emit a third acoustic beacon pulse at a third time. In some variations, the first, second, and third beacon elements may be arranged to form a triangle. In some variations, the elements may be excited by an electrical signal at different times to emit individual acoustic beacon pulses. These acoustic beacon pulses may be emitted periodically and / or sequentially. For example, the acoustic beacon pulses may be emitted sequentially in succession at regular or irregular intervals. Additionally or alternatively, the beacon elements may be configured to emit acoustic beacon pulses substantially simultaneously. In such variations, the reflected acoustic beacon signal corresponding to the emitted acoustic beacon pulse may be differentiated as described further below.
[0073] In some variations, at least two elements of the plurality of elements configured to emit acoustic beacon pulses may be offset (e.g., spaced apart) from one another in a first dimension (e.g., height dimension, lateral dimension). In some variations, one or more beacon elements may be configured to emit acoustic beacon pulses alone. One or more beacon elements may be further configured to emit acoustic beamforming pulses and / or receive acoustic beamforming signals. In some variations, the set of acoustic beamforming pulses may be emitted at a different frequency than the set of acoustic beacon pulses.
[0074] At 904, the method 900 may include receiving an acoustic beamforming signal corresponding to the acoustic beamforming pulse and receiving an acoustic beacon signal corresponding to the acoustic beacon pulse. For example, the acoustic beacon signal corresponding to the acoustic beacon pulse may be received by an optical sensor (e.g., optical sensor 20 of FIG. 1). The optical sensor may be configured to transmit an optical signal via an optical fiber or other waveguide to a processing system as described herein. The acoustic beamforming signal corresponding to the acoustic beamforming pulse may be received by a probe. For example, at least one or more elements of an array of the probe may be configured to receive the acoustic beamforming signal. A representation of the acoustic beamforming signal may be transmitted to the processing system.
[0075] At 906, the method 900 may include generating an ultrasound image based on the acoustic beamforming signal. In some variations, one or more elements configured to emit acoustic beacon pulses may be further configured to emit acoustic beamforming pulses and / or receive acoustic beamforming signals. Thus, such elements may also contribute to ultrasound image generation. More specifically, such elements may contribute to both the target indicator and ultrasound image generation.
[0076] At 908, the method 900 may include generating a target indicator based on the acoustic beacon signal. As discussed above, in some variations, the elements configured to emit acoustic beacon pulses may do so individually and / or sequentially. In such variations, the beacon signals corresponding to the acoustic beacon pulses may be detected sequentially by one or more optical sensors. For example, in the embodiment discussed above, the first beacon element may be configured to emit a first beacon pulse at a first time, the second beacon element may be configured to emit a second beacon pulse at a second time after the first time, and the third beacon element may be configured to emit a third beacon pulse at a third time after the second time. The durations of the beacon pulses may be the same or different. The optical sensor may be configured to detect a first beacon signal corresponding to the first beacon pulse. After the optical sensor detects the first beacon signal, the second beacon element may be configured to emit a second beacon pulse at a second time. The optical sensor may be configured to detect a second beacon signal corresponding to the second beacon pulse. After the optical sensor detects the second beacon signal, the third beacon element may be configured to emit a third beacon pulse at a third time. The optical sensor may be configured to detect a third beacon signal corresponding to the third acoustic pulse. In this manner, the location of the object may be tracked by emitting the acoustic beacon pulse and detecting the acoustic beacon signals individually and / or sequentially. The processing system may be configured to determine a position of one or more of the optical sensors based on the acoustic beacon signal and generate a corresponding object indicator.
[0077] Alternatively, as discussed herein, beacon elements configured to emit acoustic beacon pulses may do so substantially simultaneously. In such variations, detected acoustic beacon signals may be differentiated in various ways. For example, in one approach, each of the beacon elements may be excited such that each beacon element emits its respective acoustic beacon pulse at a different frequency. For example, if there are three beacon elements in an array configured to emit acoustic beacon pulses, the elements may be excited such that the first beacon element emits a first acoustic beacon pulse at a first frequency, the second beacon element emits a second acoustic beacon pulse at a second frequency, and the third beacon element emits a third acoustic beacon pulse at a third frequency, with the first, second, and third frequencies being different. In some variations, the first, second, and third acoustic beacon pulses may be emitted simultaneously. The one or more optical sensors may be configured to detect beacon signals corresponding to the beacon pulses in parallel, and the detected acoustic beacon signals may be separated or differentiated from one another using one or more suitable filters, such as comb filters having center frequencies corresponding to different frequencies of the acoustic beacon pulses. Thus, the comb filters may be configured to filter the detected acoustic beacon signals into a first acoustic beacon signal corresponding to the first acoustic beacon pulse, a second acoustic beacon signal corresponding to the second acoustic beacon pulse, and a third acoustic beacon signal corresponding to the third acoustic beacon pulse. FIG. 12 illustrates an exemplary variation of a comb filter having three distinct frequency ranges. For example, the first range has a center around 1.5 MHz, the second range has a center around 2.25 MHz, and the third range has a center around 3 MHz. The comb filters may be configured to separate a set of acoustic beacon signals having center frequencies of approximately 1.5 MHz, 2.25 MHz, and 3 MHz. In some variations, the processing system may be configured to determine the position of one or more of the optical sensors based on the filtered acoustic beacon signal (e.g., as described below) and generate a corresponding target indicator.
[0078] In some variations, differentiating the acoustic beacon signals may include exciting each of the elements configured to emit an acoustic beacon pulse with different coded excitation parameters. The coded excitation parameters may include parameters forming an orthogonal code pair, such as, for example, an orthogonal Golay code pair. In some variations, one or more optical sensors may be configured to simultaneously detect the beacon signals corresponding to the beacon pulses, and a suitable matched filter may be configured to decode the received beacon signals into a first acoustic beacon signal corresponding to the first acoustic beacon pulse, a second acoustic beacon signal corresponding to the second acoustic beacon pulse, and a third acoustic beacon signal corresponding to the third acoustic beacon pulse based on the coded parameters. In some variations, the matched filter may correspond to, for example, the coded excitation parameters. Thus, as shown in FIG. 6, in some variations, the waveform generator 240 (which generates the excitation signals for substantially simultaneously exciting the beacon elements) may be configured to provide data to the signal processor 250 for decoding the acoustic beacon signals into discrete acoustic beacon signals via filters that match the coded excitations. In some variations, the processing system may be configured to determine the position of one or more optical sensors based on the acoustic beacon signals and generate a corresponding target indicator.
[0079] Additionally or alternatively, the coded excitation parameters may include one or more parameters forming a barker code, parameters forming a chirp code, parameters forming a windowed nonlinear frequency modulation code, combinations thereof, and the like. A suitable matched filter corresponding to the coded excitation parameters may be used to decode the received beacon signal as described herein. In some variations, the coded excitation parameters may provide a higher signal-to-noise ratio and improved detection accuracy. As an example, one or more beacon elements may be configured to be excited with windowed nonlinear frequency modulation code parameters as described in more detail in International Patent Application No. PCT / US2022 / 018515, which is incorporated herein by reference.
[0080] In some variations, the received acoustic beacon signal may be used in a triangulation approach to determine the location of one or more of the optical sensors disposed on the object. FIG. 5 is a schematic diagram illustrating an example location of a beacon element 122 configured to emit an acoustic beacon pulse and an example location of an optical sensor 20 in a Cartesian coordinate system. The optical sensor 20 may be disposed on a tracked object (not shown). The location of the object may be determined using the Cartesian coordinate system as described in the following examples. In FIG. 5, three beacon elements 122 may be configured to emit an acoustic beacon pulse. The beacon elements 122 may form an array (e.g., a 1.5D ultrasound array) of a probe (e.g., the probe 100). The probe may be configured to emit acoustic beamforming pulses and acoustic beacon pulses (e.g., using the elements 122 of FIG. 5) and receive acoustic beamforming signals. The optical sensor 20 may be configured to detect an acoustic beacon signal corresponding to the acoustic beacon pulse.
[0081] 5, the three beacon elements 122 are located at P1:(-a,0,0), P2:(a,0,0), P3:(0,b,0), and the optical sensor is located at P:(x,y,z). The distances between the three elements 122 and the sensor 20 can be calculated by the following equation: r1=((x+a) 2 +y 2 +z 2 ) 1 / 2 Formula (1) r2 = ((xa) 2 +y 2 +z 2 ) 1 / 2 Formula (2) r3=(x 2 +(yb) 2 +z 2 ) 1 / 2 Formula (3)
[0082] Simultaneously solving equations 1 and 2 gives: x=(r1 2 -r2 2 ) / 4a formula (4)
[0083] Equation 4 shows that a ≠ 0, i.e. the distance between the first and second elements cannot be zero. Solving equations 1 and 3 simultaneously gives: y=(r1 2 -r3 2 -a 2 +b 2 -2ax) / 2b Equation (5)
[0084] x in Equation 5 can be determined from Equation 4. Equation 5 shows that b≠0. That is, the third element cannot be on the line determined by the first and second elements. For example, the first, second, and third elements may form a triangle. Thus, the third element is offset in the first dimension (e.g., the elevation dimension). Thus, from Equation 1, z=(r1 2 -(x+a) 2 -y 2 ) 1 / 2 Formula (6) where x and y are determined from Equations 4 and 5.
[0085] If the acoustic speed is c and the time required for the acoustic beacon pulse to travel from the first element to the optical sensor is t1, then: r1=ct1 formula (7)
[0086] r2 and r3 may be determined in a similar manner as r1. Thus, the location of the optical sensor 20 may be determined based on the time required for the acoustic beacon pulse to travel from the element 122 to the optical sensor 20.
[0087] The location of the optical sensor 20 may be determined by detecting acoustic beacon signals (e.g., echoes) corresponding to acoustic beacon signal pulses from three beacon elements 122, although in some variations, more than three elements 122 may be used to determine the location of the optical sensor. The elements 122 may be positioned in any suitable manner. However, in such triangulation techniques, all of the elements may not be on a single straight line (e.g., at least one element is offset along a different dimension). For example, the first and second elements may be positioned along a lateral dimension and the third element may be positioned along a height dimension that is transverse to the lateral dimension such that the third element does not intersect the lateral dimension (e.g., positioned as the apex of a triangle). Thus, the third element in this example is not aligned with respect to the lateral dimension of the first and second elements. The first and second elements are offset with respect to each other but aligned in the lateral dimension. In some variations, using more than two elements 122 may improve the accuracy of the determined location of the optical sensor 20. In some variations, more than one optical sensor 20 may be used to detect acoustic beacon signals. The position of each optical sensor may be determined similarly as described above.
[0088] At 910, the method 900 may include combining or otherwise merging the ultrasound image and the target indicator. In some variations, one or more target indicators may be overlaid on the ultrasound image. For example, the schematic diagram of FIG. 13 illustrates an example variation of a combined ultrasound image 1310 and a target indicator 1320. The target indicator 1320 shown in FIG. 13 may include a graphic icon in the form of an arrow pointing at the target (e.g., a needle) to be tracked. However, the target indicator may have any suitable form suitable for indicating the exact location of the target, as determined by processing the acoustic beacon signal. For example, the target indicator may be colored and / or animated (e.g., blinking) in a predetermined manner to convey additional information regarding the target's location (e.g., proximity to the imaging plane) and / or to enhance the visibility of the target indicator. In some variations, the target indicator may comprise one or more visual, audio, and tactile indicators. For example, an audio notification may be output when the target indicator reaches a predetermined location or is within a predetermined distance of a predetermined target (e.g., tissue).
[0089] The techniques disclosed herein may support different imaging modes, such as brightness mode (B mode), harmonic imaging mode, color Doppler mode, pulsed wave mode (PW mode), and continuous wave mode (CW mode). FIG. 10 is a flow chart illustrating an example variation of a needle visualization mode (NV mode) of operation, but it should be understood that other modes may be equivalently used to visualize other objects. After entering the needle visualization mode 1002, the method 1000 may include emitting (e.g., transmitting) an acoustic beacon pulse 1004 as described above. In some variations, the acoustic beacon pulse may be emitted by exciting a set of elements in an array of a probe (e.g., probe 100 of FIG. 1) that is configured to emit an acoustic beacon pulse. In some variations, the method 1000 may include receiving an acoustic beacon signal 1006 corresponding to the acoustic beacon pulse. For example, an optical sensor may be configured to detect the acoustic beacon signal and transmit the acoustic beacon signal to a processing system (e.g., processing system 200 of FIG. 1).
[0090] The method 1000 may include determining the location of the needle using the received acoustic beacon signal and generating an interest indicator 1008. In some variations, the method 1000 may switch to another mode, such as B-mode, to generate an ultrasound image. For example, the method 1000 may include generating an ultrasound image 1010 based on the received beamformed signal. In some variations, the method may further include combining 1012 the ultrasound image and the interest indicator (e.g., a graph) before displaying them to a user (e.g., a display mode). If the needle visualization mode has not been exited (1014-No), the method 1000 may continue to transmit acoustic beacon pulses 1004. Otherwise, the method 1000 may include exiting the needle visualization mode 1016.
[0091] In some variations, the needle visualization mode may include a frame-based interleaf mode of operation. For example, ultrasound image data acquisition and needle visualization data acquisition may be performed in an alternating manner to generate one or more frames of ultrasound images and one or more frames associated with object tracking (e.g., generating an object indicator). The interleaf mode may occur in any suitable manner. For example, two or more ultrasound frame image acquisitions may occur per needle visualization data acquisition. Additionally or alternatively, needle visualization may include a line-based interleaf mode of operation. For example, ultrasound image data acquisition and needle visualization data acquisition may be performed in an alternating manner to generate one or more lines of frames of ultrasound images and one or more lines of frames associated with object tracking.
[0092] In some variations, needle visualization data and image data may be generated simultaneously if the acoustic beacon signal and the acoustic beamforming signal are separated, such as by using a filter. Figure 11A illustrates two spectra, where the solid line represents the acoustic beacon signal spectrum and the dashed line represents the acoustic beamforming signal spectrum. The two spectra have no overlap and may be separated by two filters (e.g., bandpass filter BPF1 and bandpass filter BPF2) having different frequency bands, as shown in Figure 11B. Although bandpass filters are shown in Figure 11B, any suitable filter may be used to separate the two spectra.
[0093] The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the invention. However, it will be apparent to one skilled in the art that specific details are not required to practice the present invention. Thus, the foregoing descriptions of specific embodiments of the present invention have been presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed, and obviously, many modifications and variations are possible in light of the above teachings. The embodiments have been chosen and described in order to explain the principles of the invention and its practical application, thereby enabling those skilled in the art to utilize the invention and its various embodiments with various modifications as suited to the particular use contemplated. It is intended that the following claims and their equivalents define the scope of the invention.
Claims
1. 1. A method for visualizing a location of an object, comprising: emitting acoustic beamforming pulses and acoustic beacon pulses from an ultrasonic array, the ultrasonic array comprising two or more transducers offset in a first dimension of the ultrasonic array; receiving, with one or more optical sensors disposed on the object, an acoustic beamforming signal corresponding to the acoustic beamforming pulse and an acoustic beacon signal corresponding to the acoustic beacon pulse; generating an ultrasound image based on the acoustic beamformed signals; generating an interest indicator based on the acoustic beacon signal; A method comprising:
2. emitting the acoustic beacon pulse; emitting a first acoustic beacon pulse from a first transducer; and emitting a second acoustic beacon pulse from a second transducer.
3. The method of claim 2 , wherein the second transducer is offset from the first transducer in the first dimension of the ultrasound array.
4. 3. The method of claim 2, wherein receiving the acoustic beacon signal includes receiving, with a single optical sensor of the one or more optical sensors, a first acoustic signal corresponding to the first acoustic beacon pulse and a second acoustic signal corresponding to the second acoustic beacon pulse.
5. The method of claim 1 , further comprising receiving, with at least one transducer, the acoustic beamformed signal corresponding to the beamformed pulse.
6. The method of claim 2 , wherein emitting the acoustic beacon pulse further comprises emitting a third acoustic beacon pulse from a third transducer.
7. emitting the first acoustic beacon pulse from the first transducer at a first time; 3. The method of claim 2, further comprising: emitting the second acoustic beacon pulse from the second transducer at a second time after the first time.
8. substantially simultaneously emitting the first acoustic beacon pulses from the first transducers; and emitting the second acoustic beacon pulse from the second transducer.
9. the first acoustic beacon pulse having a first transmission frequency; The method of claim 8 , wherein the second acoustic beacon pulse has a second transmission frequency that is different than the first transmission frequency.
10. generating the interest indicator, filtering the received acoustic beacon signal based on the first transmission frequency into a first acoustic beacon signal corresponding to the first acoustic beacon pulse; 10. The method of claim 9, further comprising filtering the received acoustic beacon signal based on the second transmission frequency into a second acoustic beacon signal corresponding to the second acoustic pulse.
11. 11. The method of claim 10, wherein filtering the received acoustic beacon signal into the first and second acoustic beacon signals comprises applying a comb filter to the received acoustic beacon signal having a first filtering band centered on the first transmission frequency and a second filtering band centered on the second transmission frequency.
12. The method of claim 8 , further comprising exciting the first and second transducers with different encoded excitation parameters.
13. 13. The method of claim 12, wherein generating the interest indicator includes applying a matched filter to decode the received acoustic beacon signal into a first acoustic beacon signal corresponding to the first acoustic beacon pulse and a second acoustic beacon signal corresponding to the second acoustic beacon pulse.
14. The method of claim 12 , wherein the encoded excitation parameters include parameters forming an orthogonal code pair.
15. The method of claim 14 , wherein the orthogonal code pair is an orthogonal Golay code pair.
16. The method of claim 12 , wherein the encoded excitation parameters include parameters forming a Barker code.
17. The method of claim 12 , wherein the encoded excitation parameters include parameters forming a chirp code.
18. The method of claim 12 , wherein the encoded excitation parameters include parameters forming a windowed nonlinear frequency modulation code.
19. The method of claim 1 , comprising alternating between emitting acoustic beamforming pulses and emitting acoustic beacon pulses.
20. 20. The method of claim 19, comprising alternating between generating an ultrasound image based on the acoustic beamformed signals and generating the target indicator based on the acoustic beacon signals.
21. The method of claim 1 , comprising emitting the acoustic beamforming pulse and the acoustic beacon pulse substantially simultaneously.
22. the acoustic beamforming pulse has a third transmit frequency; 22. The method of claim 21, wherein the acoustic beacon pulse has a fourth transmission frequency different from the third frequency.
23. filtering the received acoustic beamformed signal based on the third transmit frequency; and 23. The method of claim 22, further comprising filtering the received acoustic beacon signal based on the fourth transmission frequency.
24. The method of claim 1 , wherein generating the target indicator comprises resolving the received acoustic beacon signal into a current target location.
25. The method of claim 1 , further comprising combining the ultrasound image and the target indicator.
26. The method of claim 1 , wherein the one or more optical sensors comprise an interferometric-based optical sensor.
27. 27. The method of claim 26, wherein the one or more optical sensors comprise an optical resonator or an optical interferometer.
28. 30. The method of claim 27, wherein the one or more optical sensors comprise a whispering gallery mode (WGM) resonator.
29. 10. The method of claim 1, wherein the one or more transducers include one or more of a piezoelectric sensor, a single crystal material sensor, a piezoelectric micromachined ultrasonic transducer (PMUT) sensor, and a capacitive micromachined ultrasonic transducer (CMUT) sensor.
30. The method of claim 1 , wherein the first dimension is a height dimension of the ultrasound array.
31. The method of claim 1 , wherein the first dimension is a lateral dimension of the ultrasound array.
32. 1. A system for visualizing a location of an object, comprising:
1. An ultrasound array comprising: an ultrasonic array comprising a plurality of transducers configured to emit acoustic beamforming pulses and acoustic beacon pulses, the plurality of transducers including two or more transducers offset in a first dimension of the ultrasonic array; at least one optical sensor disposed on the object and configured to detect an acoustic beamforming signal corresponding to the acoustic beamforming pulse and an acoustic beacon signal corresponding to the acoustic beacon pulse; at least one processor configured to generate an ultrasound image based on the acoustic beamformed signals and a target indicator based on the acoustic beacon signals.
33. The plurality of transducers include: a first transducer configured to emit a first acoustic beacon pulse; a second transducer configured to emit a second acoustic beacon pulse; 33. The system of claim 32, wherein the second transducer is offset from the first transducer in the first dimension of the ultrasound array.
34. the plurality of transducers comprises a third transducer configured to emit a third acoustic beacon pulse; 34. The system of claim 33, wherein a distance between the first transducer and the second transducer in a second dimension of the ultrasonic array is different from a distance between the third transducer and the second transducer in the second dimension of the ultrasonic array.
35. The system of claim 32 , wherein the optical sensor is an interferometric-based optical sensor.
36. 36. The system of claim 35, wherein the optical sensor is an optical resonator or an optical interferometer.
37. 37. The system of claim 36, wherein the optical sensor is a whispering gallery mode (WGM) resonator.
38. 33. The system of claim 32, wherein the plurality of transducers comprises one or more of a piezoelectric sensor, a single crystal material sensor, a piezoelectric micromachined ultrasonic transducer (PMUT) sensor, and a capacitive micromachined ultrasonic transducer (CMUT) sensor.
39. 33. The system of claim 32, wherein the at least one processor is further configured to combine the ultrasound image and the interest indicator.
40. 33. The system of claim 32, further comprising a display configured to display one or more of the ultrasound image and the subject indicator.
41. The system of claim 32 , wherein the ultrasound array is positioned on the subject.
42. The system of claim 32 , wherein the at least one optical sensor is coupled to the object.
43. 33. The system of claim 32, wherein the at least one optical sensor is integrally formed with the object.
44. 44. The system of claim 43, wherein the object comprises an elongate member and a distal end.
45. 45. The system of claim 44, wherein the at least one optical sensor is disposed on the distal end of the object.
46. The system of claim 44 , wherein the at least one optical sensor is disposed on the elongated member.
47. 47. The system of claim 46, wherein the two or more optical sensors are disposed on the elongated member.
48. 42. The system of claim 41, wherein the object comprises a needle.
49. 33. The system of claim 32, wherein the first dimension is a height dimension of the ultrasound array.
50. 33. The system of claim 32, wherein the second dimension is a lateral dimension of the ultrasound array.
51. 37. The system of claim 36, wherein the first dimension is transverse to the second dimension.
Citation Information
Patent Citations
Three-dimensional needle positioning using a two-dimensional imaging probe
JP2014516738A
A method and apparatus for determining the location of a medical instrument with respect to ultrasound imaging, and a medical instrument to facilitate such determination
US20160038119A1
