Modular endoscopic system for visualization of disease
A handheld endoscopic imaging system uses excitation light and optical filters to enhance visualization of surgical margins and wounds, addressing the limitations of current assessment methods by accurately identifying residual cancer cells and improving surgical outcomes.
Patent Information
- Application Number
- JP2024110804
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2019-06-04
- Filing Date
- 2024-07-10
- Publication Date
- 2024-11-13
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Current methods for assessing surgical margins and wound assessment are inadequate for accurately identifying residual cancer cells, pre-cancerous cells, and satellite lesions, leading to high recurrence rates and increased health care costs, while existing wound assessment techniques lack standardization and accuracy.
A portable, handheld endoscopic imaging system that utilizes excitation light sources to induce autofluorescence and fluorescence in tissue cells, combined with optical filters and sensors to capture and differentiate between tissue types, providing real-time imaging of surgical margins and wounds.
Enhances the ability to visualize and target residual cancer cells, pre-cancerous cells, and satellite lesions during surgery, reducing recurrence rates and improving surgical precision.
Smart Images

Figure 2024160225000001_ABST
Abstract
Description
[Technical Field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation of U.S. Provisional Application No. 62 / 793,846, entitled "ENDOSCOPIC SYSTEM FOR VISUALIZATION OF DISEASE," filed January 17, 2019, and U.S. Provisional Application No. 62 / 793,846, entitled "MODULAR ENDOSCOPIC SYSTEM This application claims priority to U.S. Provisional Application No. 62 / 857,183, filed June 4, 2019, entitled "A Method for Visualizing Disease," the entire contents of each of which are incorporated herein by reference. [Background technology]
[0002] Technical Field The present disclosure relates to devices, systems, and methods for visualization and removal of diseases, including, for example, tumors. The disclosed devices, systems, and methods may be used to stage tumors and evaluate surgical margins, such as the tissue margins of resected tissue and the margins of tissue / surgical beds within surgical cavities from which tumors and / or tissue have been removed. The disclosed devices, systems, and methods may also be used to identify and provide guidance for the removal and / or treatment of one or more of residual cancerous cells, precancerous cells, and satellite lesions. The disclosed systems may also be used to visualize wounds, particularly those within confined anatomical spaces such as body lumens, hollow organs during surgery, etc. The devices and systems may be used to evaluate and quantify components present in the visualized area, such as bacteria, disease, infection, etc. The systems and methods may be suitable for collecting data regarding biochemical, biological, and / or non-biological substances. The data may include, for example, one or more of white light data, fluorescent data, thermal data, infrared data, such as in wound care, for both human and veterinary applications. preface Surgery is one of the oldest types of cancer treatment and is an effective treatment for many types of cancer. Oncological surgery can take different forms depending on the purpose of the surgery. For example, oncological surgery can include biopsy procedures to diagnose or determine the type or stage of cancer, tumor removal to remove some or all of the tumor or cancerous tissue, exploratory surgery to locate or identify the tumor or cancerous tissue, debulking surgery to reduce the size or remove as much of the tumor as possible without adversely affecting other body structures, and palliative surgery to address conditions caused by the tumor, such as pain or pressure on body organs.
[0003] In surgeries where the goal is to remove tumors or cancerous tissue, surgeons often face uncertainty in determining whether all of the cancer has been removed. Even when a surgical bed or tissue bed has had a tumor removed from it, it may contain residual cancer cells, i.e., cancer cells that remain at the surgical margins of the area from which the tumor was removed. If these residual cancer cells remain in the body, they increase the likelihood of recurrence and metastasis. Often, the suspected presence of residual cancer cells based on examination of the surgical margins of the resected tissue during pathological analysis of the tumor leads to subsequent surgery to remove additional tissue from the surgical margins.
[0004] For example, breast cancer, the most common cancer in women, is typically treated by breast-conserving surgery (BCS), e.g., lumpectomy, which removes the tumor while sparing as much healthy breast tissue as possible. The effectiveness of BCS treatment depends on the complete removal of malignant tissue, while sufficient Sparing healthy breast tissue ensures adequate breast reconstruction, but it may be insufficient if excess breast tissue is removed. Visualizing tumor margins under standard white-light (WL) operating room conditions is challenging due to low tumor-to-normal tissue contrast, leading to reoperation (i.e., secondary surgery) in approximately 23% of patients with early-stage invasive breast cancer and 36% of patients with ductal carcinoma in situ. Re-excision is associated with a higher risk of recurrence, and inadequate patient outcomes include decreased breast cosmesis and increased healthcare costs. Positive surgical margins (i.e., margins that contain cancer cells) following BCS are also associated with decreased disease-specific survival.
[0005] Current best practices in BCS involve palpation and / or specimen radiography, and rarely, intraoperative histopathology to guide resection. Specimen radiography assesses resection tissue margins using x-ray images, while intraoperative histopathology (touch prep or frozen) assesses a small sample of specimen tissue for cancer cells, both of which are limited by the time delay (~20 minutes) they cause and inaccurate colocalization of the positive margins of the resected tissue to the surgical bed. Thus, there is an urgent clinical need for real-time intraoperative imaging techniques to assess resection specimen margins and surgical bed margins and to provide guidance for removing one or more of the remaining cancerous cells, precancerous cells, and satellite lesions.
[0006] Additionally, conventional clinical evaluation methods for acute and chronic wounds remain suboptimal. They are typically based on a thorough patient history, qualitative and subjective clinical assessment using ambient white light and simple visual judgment using the "naked eye," and sometimes involve the use of color photography to capture the overall appearance of the wound under white light illumination (Perednia (1991) J Am Acad Dermatol. 25: 89-108). Regular reassessment of progress toward healing and appropriate modification of interventions are also necessary. Wound assessment terminology is not uniform, many questions surrounding wound assessment remain unanswered, consensus has already been reached on important wound parameters to measure in clinical practice, and the accuracy and reliability of available wound assessment techniques vary. Visual evaluation is frequently combined with swabs and / or tissue biopsies for bacteriological culture for diagnosis. Bacterial swabs are collected at the time of wound examination and have the well-known advantage of providing identification of specific bacterial / microbial species (Bowler, 2001; Cutting, 1994; Dow, 1999; Dow G. In: Krasner et al., Chronic Wound Care: A Clinical Source Book for Healthcare Professionals, 3rd Edition, Wayne Pa.: HMP Communications 2001, pp. 343-356). However, in many cases, multiple swabs and / or biopsies are collected randomly from the wound site, and some swabbing techniques can actually spread microorganisms around the wound during the collection process, thus affecting patient healing time and morbidity (Dow, 1999). This can be particularly problematic for large, chronic (non-healing) wounds, where detection yields for the presence of bacteria using current swab and biopsy protocols are suboptimal (diagnostically dull), despite the large number of swabs collected. Thus, current methods for obtaining swabs or tissue biopsies from wound sites for subsequent bacterial culture are based on "non-targeted" or "blind" swab or punch biopsy approaches and are not optimized to minimize trauma to the wound or maximize the diagnostic yield of bacteriological testing. Summary of the Invention [Problem to be solved by the invention]
[0007] overview The present disclosure may solve one or more of the problems set forth above and / or demonstrate one or more of the desirable features set forth above. Other Features and / or Advantages This will become clear from the following explanation. [Means for solving the problem]
[0008] According to one aspect of the present disclosure, an endoscopic imaging device is provided. The device includes a body portion configured to be held in a user's hand and an endoscopic portion configured to direct light onto a target. At least one excitation light source is configured to excite autofluorescence emissions of tissue cells and fluorescent emissions of derivatized porphyrins in the tissue cells of the target. A white light source is configured to illuminate a surgical margin during white light imaging of the target. The device also includes an imaging sensor and a first optical filter configured to filter optical signals emitted by the target in response to illumination with the excitation light and allow the autofluorescence emissions of the tissue cells and the fluorescent emissions of the derivatized porphyrins in the tissue cells to pass to the imaging sensor. A second optical filter is configured to filter optical signals emitted by the surgical margin in response to illumination with the white light and allow the white light emissions of tissue within the surgical margin to pass to the imaging sensor.
[0009] According to another aspect of the present disclosure, a method of imaging a target tissue is provided, the method including illuminating the target tissue with a first excitation light source configured to emit excitation light having a first wavelength, receiving an optical signal emitted by the target tissue through a first optical filter in an endoscope optical housing of an imaging device, illuminating the target tissue with a second excitation light source configured to emit excitation light having a second wavelength, and receiving an optical signal emitted by tissue at a surgical margin through a second optical filter in an endoscope optical housing of the imaging device.
[0010] According to an additional aspect of the present disclosure, a portable, handheld endoscopic imaging system is provided. The system includes at least one excitation light source configured to emit excitation light during fluorescence imaging. A first filter is configured to detect optical signals having wavelengths corresponding to one or more of bacterial fluorescence, bacterial autofluorescence, tissue fluorescence, and tissue autofluorescence in response to illumination of the target surface with the excitation light and enable them to pass to an image sensor located within the endoscopic portion of the system. A white light source is configured to emit white light during white light imaging. A second filter is configured to detect optical signals having wavelengths within the visible light range in response to illumination of the target surface with the white light and enable them to pass to an image sensor located within the endoscopic portion of the system. A processor is configured to receive the detected fluorescent and white light optical signals and output a representation of the target surface to a display based on the detected optical signals.
[0011] According to yet another aspect of the present disclosure, a portable modular endoscopic handheld imaging system is provided. The system includes an endoscope housing portion. The endoscope housing portion includes at least one excitation light source configured to emit excitation light during fluorescence imaging, a first filter configured to detect and enable passage of optical signals having wavelengths corresponding to one or more of bacterial fluorescence, bacterial autofluorescence, tissue fluorescence, and tissue autofluorescence in response to illumination of the target surface with the excitation light, to the image sensor; a white light source configured to emit white light during white light imaging, and a second filter configured to detect and enable passage of optical signals having wavelengths within the visible light range in response to illumination of the target surface with the white light. The system further includes a base body portion configured to releasably receive the endoscope housing portion. The base body portion includes a display and a processor configured to receive the detected fluorescent and white light optical signals and output a representation of the target surface to the display based on the detected optical signals.
[0012] The present disclosure can be understood from the following detailed description, either alone or in conjunction with the accompanying drawings. The drawings are included to provide a further understanding, and are incorporated into and constitute a part of this specification. The drawings illustrate one or more exemplary embodiments of the present disclosure and, together with the description, serve to explain various principles and operations. [Brief explanation of the drawings]
[0013] [Figure 1A] FIG. 1 illustrates the conversion of ALA to PpIX in tumor cells. [Figure 1B] FIG. 10 is a diagram of peak absorption and emission for PpIX. [Figure 2] FIG. 1 is a user-facing (front) view of an endoscopic handheld imaging device for disease visualization according to the present disclosure. [Figure 3] FIG. 3 is a front perspective view of an endoscopic handheld imaging device for visualization of the disease of FIG. 2. [Figure 4] FIG. 3 is a rear perspective view of an endoscopic handheld imaging device for visualization of the disease of FIG. 2. [Figure 5] FIG. 3 is a rear (patient-facing) view of the handheld imaging device of FIG. 2. [Figure 6] FIG. 3 is a side view of the handheld imaging device of FIG. 2. [Figure 7] 1 illustrates an endoscope housing portion and a base body portion of a modular embodiment of an endoscopic imaging device in a disconnected configuration according to the present disclosure. [Figure 8] FIG. 8 is a cross-sectional view of the modular endoscopic handheld imaging device of FIG. 7. [Figure 9] FIG. 8 is a perspective view of the modular endoscopic imaging device of FIG. 7. [Figure 10] FIG. 8 is an end view of the endoscope of the modular device of FIG. 7 in a first position. [Figure 11] FIG. 8 is another end view of the endoscope of the modular device of FIG. 7 in a second position. [Figure 12] FIG. 8 is an end view of the endoscope of the modular device of FIG. 7, identifying the visible components at the end of the endoscope. [Figure 13] FIG. 1 is a diagram of a PCB board for an endoscope of a handheld imaging device. [Figure 14] 1A and 1B are photographic illustrations of a prototype of an endoscopic handheld imaging device according to an embodiment of the present disclosure. [Figure 15] FIG. 15 is a photograph of the prototype of FIG. 14 equipped with a surgical drape according to the present disclosure. [Figure 16] FIG. 15 is a close-up view of the endoscope tip of the prototype of FIG. 14. [Figure 17] FIG. 1 is an exemplary schematic diagram of an electronics configuration for an endoscopic imaging system according to the present disclosure. [Figure 18] FIG. 1 is a chart illustrating exemplary bandpasses of various filters configured to detect emissions stimulated by excitation light that may be incorporated into an embodiment of a handheld device according to the present disclosure. [Figure 19]FIG. 1 is a chart illustrating exemplary bandpasses of various filters configured to detect emissions stimulated by excitation light that may be incorporated into an embodiment of a handheld device according to the present disclosure. [Figure 20] FIG. 1 is a chart illustrating exemplary bandpasses of various filters configured to detect emissions stimulated by excitation light that may be incorporated into an embodiment of a handheld device according to the present disclosure. [Figure 21] FIG. 1 is a chart illustrating exemplary bandpasses of various filters configured to detect emissions stimulated by excitation light that may be incorporated into an embodiment of a handheld device according to the present disclosure. [Figure 22] FIG. 1 is a chart illustrating exemplary bandpasses of various filters configured to detect emissions stimulated by excitation light that may be incorporated into an embodiment of a handheld device according to the present disclosure. [Figure 23] FIG. 1 is a chart illustrating exemplary bandpasses of various filters configured to detect emissions stimulated by excitation light that may be incorporated into an embodiment of a handheld device according to the present disclosure. [Figure 24] FIG. 1 illustrates an embodiment of a handheld endoscopic imaging system that includes separate endoscopic optical heads for white light imaging, fluorescence imaging, and infrared imaging. [Figure 25] FIG. 1 shows the absorption and emission peaks for PpIX for fluorescence imaging according to one embodiment of the present disclosure. [Figure 26A] FIG. 1 is a chart illustrating the characteristics of an embodiment of a fluorescent LED used for fluorescent imaging according to one aspect of the present disclosure. [Figure 26B] FIG. 1 is a chart illustrating the characteristics of an embodiment of a fluorescent LED used for fluorescent imaging according to one aspect of the present disclosure. [Figure 26C] FIG. 1 is a chart illustrating the characteristics of an embodiment of a fluorescent LED used for fluorescent imaging according to one aspect of the present disclosure. [Figure 27A] FIG. 1 is a chart illustrating the characteristics of an embodiment of a fluorescence emission filter used for fluorescence imaging according to one aspect of the present disclosure. [Figure 27B] FIG. 1 is a chart illustrating the characteristics of an embodiment of a fluorescence emission filter used for fluorescence imaging according to one aspect of the present disclosure. [Figure 27C] FIG. 1 is a chart illustrating the characteristics of an embodiment of a fluorescence emission filter used for fluorescence imaging according to one aspect of the present disclosure. [Figure 28] FIG. 1 shows the absorption and emission peaks for an ICG dye to be used in infrared imaging according to one embodiment of the present disclosure. [Figure 29A] FIG. 1 is a chart illustrating the characteristics of an embodiment of an infrared LED used for thermal imaging according to one aspect of the present disclosure. [Figure 29B] FIG. 1 is a chart illustrating the characteristics of an embodiment of an infrared LED used for thermal imaging according to one aspect of the present disclosure. [Figure 30A] FIG. 2 is a chart illustrating the characteristics of an embodiment of an infrared emission filter used for infrared imaging according to one aspect of the present disclosure. [Figure 30B] FIG. 2 is a chart illustrating the characteristics of an embodiment of an infrared emission filter used for infrared imaging according to one aspect of the present disclosure. [Figure 30C] FIG. 2 is a chart illustrating the characteristics of an embodiment of an infrared emission filter used for infrared imaging according to one aspect of the present disclosure. [Figure 31] 1A-1C illustrate the transmission characteristics of an embodiment of a lens of a handheld endoscopic imaging device. [Figure 32A] 1A-1C illustrate various aspects of an embodiment of a custom sterile drape with a lens cap for use with a handheld endoscopic imaging device according to one aspect of the present disclosure. [Figure 32B] 1A-1C illustrate various aspects of an embodiment of a custom sterile drape with a lens cap for use with a handheld endoscopic imaging device according to one aspect of the present disclosure. [Figure 32C]1A-1C illustrate various aspects of an embodiment of a custom sterile drape with a lens cap for use with a handheld endoscopic imaging device according to one aspect of the present disclosure. [Figure 33] FIG. 1 is a perspective view of a handheld endoscopic imaging device resting on a docking station according to an exemplary embodiment of the present disclosure. [Figure 34] FIG. 34 is a perspective view of the handheld endoscopic imaging device and docking station of FIG. 33 shown separated to illustrate other features of the docking station. [Figure 35] FIG. 34 is a front orthogonal view of the docking station of FIG. 33. [Figure 36] FIG. 1 is a schematic diagram illustrating various components of a handheld endoscopic imaging device according to an exemplary embodiment of the present disclosure. [Figure 37] FIG. 1 is a perspective view of an interconnect cable according to an exemplary embodiment of the present disclosure. [Figure 38] FIG. 1 is a perspective view of a portion of a handheld endoscopic imaging device including an interconnection port according to an exemplary embodiment of the present disclosure. [Figure 39] FIG. 1 is a perspective view of a lens of a sterile drape according to an exemplary embodiment of the present disclosure. [Figure 40] FIG. 40 is a cross-sectional side view of a handheld endoscopic imaging device with a sterile drape including the lens of FIG. 39 according to an exemplary embodiment of the present disclosure. [Figure 41] FIG. 1 is a perspective view of a darkening drape adapter according to an exemplary embodiment of the present disclosure. [Figure 42] FIG. 42 is a perspective view of a handheld endoscopic imaging device with a darkening drape including the adapter of FIG. 41 according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0014] Description of Various Exemplary Embodiments Existing margin assessment techniques focus on resected samples to determine whether the surgical margins contain residual cancer cells. These techniques are limited by their inability to precisely spatially co-localize positive margins detected on resected samples to the surgical bed; the present disclosure overcomes this limitation by directly imaging the surgical cavity. In addition to testing surgical margins, the disclosed devices and methods can be used to visualize the surgical bed, visualize wounds, access any confined space such as organs, body lumens, etc., and visualize diseases other than cancer.
[0015] Other non-targeted techniques for reducing re-excisions include studies combining non-targeted margin shaving with standard BCS care. While this technique can reduce the overall number of re-excisions, this approach has several potential drawbacks. For example, larger resections are associated with poorer cosmetic outcomes, and the non-targeted removal of additional tissue contradicts the intent of BCS. Additionally, the end result of using such techniques appears to conflict with the recently updated ASTRO / SSO guidelines, which defined positive margins as "tumor in ink" and acknowledged no additional benefit of wider margins. Moran MS, Schnitt SJ, Giuliano AE, Harris JR, Khan SA, Horton J, et al., "Society of Surgical Oncology-American Society for Radiation Oncology consensus guideline on margins for breast-conserving surgery with “Whole-breast irradiation in stages I and II invasive breast cancer,” Ann Surg Oncol. 2014;21(3):704-716. A recent retrospective study found no significant difference in re-excision following cavity shaving versus standard BCS. Pata G, Bartoli M, Bianchi A, Pasini M, Roncali S, Ragni F. “Additional Cavity Shaving at the Time of Breast-Conserving Surgery Enhances Accuracy of Margin Status Examination,” Ann Surg Oncol. 2016;23(9):2802-2808. If margin shaving is ultimately proven effective, FL-guided surgery can be used to refine the process by adding the ability to target specific areas within the surgical margin for shaving, thus redirecting a non-targeted approach that indiscriminately removes additional tissue toward a targeted approach that is more in line with the intent of BCS.
[0016] The present application discloses devices, systems, and methods for fluorescence-based tumor visualization, including visualization and / or assessment of ex vivo, in vivo, and in vitro tumors, multifocal disease, surgical beds and margins, and intraoperative guidance for removal of residual tumor, satellite lesions, pre-cancerous cells, and / or cancerous cells within the surgical margins. In certain embodiments, the devices disclosed herein are handheld and can be placed within a small surgical cavity. In other embodiments, the device is portable and has no wired connections. However, it is within the scope of this disclosure that the device can be larger than a handheld device and can instead include handheld components. In such embodiments, it is contemplated that the handheld components can be connected to a larger device housing or system by a wired connection.
[0017] Also disclosed are methods for intraoperative in vivo imaging using the devices and / or systems. The imaging devices can be multispectral. Also contemplated is that the devices can be hyperspectral. In addition to providing information about the type of cells contained within the surgical margin, the disclosed devices and systems also provide information about the location (i.e., anatomical context) of the cells contained within the surgical margin. Additionally, methods are disclosed that provide guidance for intraoperative treatment of surgical margins using the devices, such as fluorescence-based image guidance of surgical margin resection. The devices, systems, and methods disclosed herein can be used on subjects, including humans and animals.
[0018] According to one embodiment of the present disclosure, some disclosed methods combine the use of the disclosed devices and / or systems with the administration of a non-activated, non-targeted compound configured to induce porphyrins in tumor / cancer cells, precancerous cells, and / or satellite lesions. For example, a subject may be given a diagnostic dose (i.e., not a therapeutic dose) of a compound (imaging / contrast agent) such as the prodrug aminolevulinic acid (ALA). As will be understood by those skilled in the art, doses of ALA less than 60 mg / kg are generally considered diagnostic, while doses greater than 60 mg / kg are generally considered therapeutic. As disclosed herein, a diagnostic dose of ALA can be greater than 0 mg / kg and less than 60 mg / kg, between about 10 mg / kg and about 50 mg / kg, between about 20 mg / kg and 40 mg / kg, and can be administered to a subject at doses of 5 mg / kg, 10 mg / kg, 15 mg / kg, 20 mg / kg, 25 mg / kg, 30 mg / kg, 35 mg / kg, 40 mg / kg, 45 mg / kg, 50 mg / kg, or 55 mg / kg. ALA can be administered orally, intravenously, by aerosol, by immersion, by lavage, and / or topically. While the diagnostic dose is intended for visualization of residual cancer cells, precancerous cells, and satellite lesions, the use of the disclosed devices, systems, and methods within the scope of this disclosure is to provide guidance during treatment and / or removal of these cells and / or lesions. In such cases, a surgeon's preferred treatment method may vary based on the individual surgeon's preferences. Such treatments may include, for example, photodynamic therapy (PDT). In cases where PDT or other light-based treatments are potentially contemplated, administration of higher doses of ALA, i.e., therapeutic doses rather than diagnostic doses, may be desirable. In these cases, subjects may be prescribed doses of ALA greater than 60 mg / kg.
[0019] ALA induces porphyrin formation (protoporphyrin IX (PpIX)) in tumor / cancer cells, resulting in red fluorescence emission from cells containing PpIX when excited with appropriate excitation light, enhancing the red-to-green fluorescence contrast between tumor / cancer tissue cells and normal tissue cells (e.g., collagen) imaged with the device. While ALA is nonfluorescent by itself, PpIX is fluorescent at approximately 630 nm, 680 nm, and 710 nm, with the strongest emission at 630 nm. Figure 1B illustrates the fluorescence emission of PpIX when excited with excitation light having a wavelength of 405 nm. Alternatively, the intrinsic fluorescence difference between tumor / cancer or precancerous cells and normal / healthy cells can be used without imaging / contrast agents.
[0020] In an exemplary embodiment, the present invention provides a method for detecting polymorphisms in tumor / cancerous cells, precancerous cells, and / or satellite lesions. A non-activated, non-targeted compound configured to induce porphyrin is administered to a subject between about 15 minutes and about 6 hours before surgery, between about 1 hour and about 5 hours before surgery, between about 2 hours and about 4 hours before surgery, or between about 2.5 hours and about 3.5 hours before surgery. These exemplary time frames allow sufficient time for ALA to be converted to porphyrin in tumor / cancer cells, precancerous cells, and / or satellite lesions. ALA or other suitable compounds can be administered orally, intravenously, by aerosol, immersion, lavage, and / or topically.
[0021] In cases where administration of the compound falls outside the desired or preferred time frame, it is possible that PpIX can be further induced (or initially induced if the compound was not administered before surgery) by applying the compound via an aerosol composition, i.e., spraying it into the surgical cavity or onto the excised tissue (before or after incision for examination). Additionally or alternatively, the compound can be administered in liquid form, for example, as a surgical cavity irrigation. Additionally or alternatively, for removed specimens, PpIX can be induced into the excised specimen if it is immersed in a liquid compound, such as liquid ALA, almost immediately after excision. The sooner the excised tissue is immersed, the greater the chance that PpIX or additional PpIX will be induced into the excised tissue.
[0022] During surgery, the tumor is removed by the surgeon, if possible. A handheld fluorescence-based imaging device is then used to identify, locate, and guide treatment of any remaining cancerous, precancerous, and / or satellite lesions in the surgical bed from which the tumor was removed. The device can also be used to examine the resected tumor / tissue specimen to determine whether tumor / cancerous and / or precancerous cells are present in the outer margins of the resection specimen. The presence of such cells may indicate a positive margin, which should be considered by the surgeon when determining whether further resection of the surgical bed should be performed. The location of any tumor / cancerous cells identified in the outer margins of the resection specimen can be used to identify corresponding locations on the surgical bed, which can be targeted for further resection and / or treatment. This can be particularly beneficial in situations where visualization of the surgical bed itself does not identify any remaining tumor / cancerous, precancerous, or satellite lesions.
[0023] According to one aspect of the present disclosure, a handheld endoscopic fluorescence-based imaging device for disease visualization is provided, which device and method can be adapted for wound monitoring in humans and animals.
[0024] The device can be a modular handheld imaging device. In such an embodiment, the device includes a base body portion, also referred to herein as a base portion or base housing. The device also includes an endoscope optical portion, also referred to herein as an endoscope optical housing. The endoscope optical portion is releasably received by the base body portion and is interchangeable with other optical portions depending on the performance desired for imaging in a given situation.
[0025] An exemplary embodiment of a handheld endoscopic imaging device 100 is shown in FIGS. 2-6. As shown in FIGS. 2-6, in some example embodiments, a base body portion 110 of the device 100 can have a generally square or rectangular shape. The front or user-facing side 115 of the base body portion 110 includes a display screen 120 for displaying images and video captured by the device. In one example embodiment, the touchscreen display has a protective glass with an anti-reflective coating over its entire surface. While depicted as a square or rectangle, the device can take on any shape that would reasonably support a display screen, such as a touchscreen. In addition to disclosing images captured by the imaging device 100, the display screen also operates as a user interface, allowing a user to interact with the device via touchscreen input. The handheld device 100 may include a power button 112. The power button 112 may be configured to allow the handheld device 100 to control its functions. Located above the display screen 120 may be a power button 112. In one example embodiment, a ring of LEDs may surround the power button and be used to indicate system status. A battery status LED 114 may be provided in the same area where the power button 112 is located. A universal serial bus (USB) port (not shown) may be provided on the top surface of the device to facilitate connection of the handheld device 100 to external devices, such as computers (e.g., PC workstations), tablets, phones, or other devices, for various tasks such as updating the handheld device 100's software or firmware, downloading images stored in the handheld device 100's memory, etc. The USB port (not shown) may be protected by a cover 116 (see FIG. 7 ). Additionally or alternatively, the USB port of the handheld device 100 may be directly connected to a storage device (not shown), such as a USB stick, USB flash drive, or thumb drive, for direct data transfer. For example, handheld device 100 can download data, images, and / or other material to a storage device. In another example, a storage device can be used to load new software or instructions onto the handheld device. Alternatively, such activities can be accomplished using a wireless communication link between handheld device 100 and an external device, such as a computer, tablet, phone, or other device. In some embodiments, handheld device 100 can include both USB connectivity and wireless communication (such as Wi-Fi, Bluetooth, etc.) functionality.
[0026] Located on the opposite side of the device, the patient-facing side 125 of the device, can be a hand-holding area 130 configured to facilitate user holding of the device during imaging. As shown in FIG. 4 , the hand-holding area can include a protrusion or area that extends away from the base body portion 110, sufficient to allow a user's fingers to grasp or wrap around the protrusion. Various other types of handholds and hand-holding arrangements can be utilized. One consideration regarding the location of such a handhold is the user's ability to balance the device while using it for imaging and while inputting commands via the touchscreen display. The weight distribution of the device may also be a consideration to provide an ergonomic device that is easy to use. The patient-facing side 125 of the device can also incorporate contacts 135 for wireless charging of the device.
[0027] According to one aspect of the present disclosure, the patient-facing side 125 of the device 100 also includes an endoscope 140. The endoscope 140 can be mounted to and / or integrally formed with an endoscope housing portion 145. As illustrated in the exemplary embodiment of FIG. 7, the endoscope housing portion 145 can be removable from the base body portion 110. The endoscope housing portion 145 includes a base 150 that supports the endoscope 140. While illustrated as a rectangular base, it is contemplated that the base 150 can take on other shapes, such as a square, circle, or oval. The base 150 is shaped and configured to be received in an opening 155 in the base body portion 110. The opening 155 is configured to releasably receive the endoscope optical housing 145. When the base 150 of the endoscope housing portion 150 is positioned in the opening 155, the endoscope housing portion 145 can be locked in position such that the endoscope housing portion 145 is locked to the base body portion 110. In this configuration, electrical contact is made between the body portion 110 and the optical components contained in the endoscope housing portion 145, and the components of the endoscope housing portion are powered by a power source, such as a battery, contained in the base body portion 110. A battery pack (not shown) can be located in the base area of the base body portion 110. In various example embodiments, the base body portion 110 includes a heat sink for dissipating heat from the electronic device. In one example embodiment, a heat sink 132 (FIG. 4) is disposed around an opening 155 in the base body portion 110 that is configured to receive the endoscope optical housing. The endoscope housing portion 145 may include a lip or wall formed therein. Additionally, the endoscope housing portion 145 may be made of a material configured to draw heat away from the optics found at the distal tip of the endoscope portion, such as, for example, aluminum. The base body portion may also include a Wi-Fi antenna (not shown) to enable the handheld device 100 to transmit and / or receive wireless communications. In one example embodiment, the Wi-Fi antenna is located near the outer shell or housing of the base body portion 110 to maintain Wi-Fi performance.
[0028] Base body portion 110 includes an interface configured to releasably receive endoscope optics housing portion 145. The endoscope optics housing includes a portion configured to be received in the base body in a manner that provides electrical and power connections between components of the endoscope optics housing and the battery and processor of the base body portion, as described below.
[0029] Systems according to the present disclosure can include a docking station, such as a stand, on which a handheld device can rest when not in use. The docking station can include one or more electrical connection areas, such as electrical contacts configured to provide charging current to a battery in the handheld device. The docking station can also include a data connection, such as one or more ports (e.g., USB ports) for connecting the docking station to a workstation, such as a computer.
[0030] For example, referring now to FIG. 33 , an embodiment of a handheld device 3300 and a docking station 3302 is shown. In FIG. 33 , the handheld device 3300 is resting on the docking station 3302. The docking station 3302 includes a receptacle 3304 configured to receive an endoscopic portion 3340 of the handheld device 3300. The docking station 3302 can include various features configured to provide secure placement of the handheld device 3300 on the docking station 3302. For example, in this embodiment, the docking station 3302 includes a retaining loop 3306 positioned to at least partially enclose the endoscopic portion 3340 when the handheld device 3300 is placed on the docking station 3302 and to ensure that inadvertent contact with the handheld device 3300 does not dislodge the handheld device 3300 from the docking station 3302. The docking station 3302 may also include rubber feet (not shown) to ensure that the docking station 3302 has sufficient grip to the surface, such as a counter or table, on which the docking station is placed.
[0031] 34, a handheld device 3300 and a docking station 3302 are shown separated from one another. In FIG. 34, a pair of electrical contacts 3308 are visible on the docking station 3302. The handheld device 3300 may include corresponding contacts 3310 (shown schematically in FIG. 36) that contact the contacts 3308 when the handheld device 3300 is placed on the docking station 3302, forming an electrical connection between the handheld device 3300 and the docking station 3302 and providing an electrical path for charging the handheld device's battery. Optionally, the contacts 3308 and 3310 (FIG. 36) may form an interface across which data may be transferred to or from the handheld device.
[0032] 35, a front orthogonal view of the docking station 3302 is shown. Visible in the view of FIG. 35 is a universal serial bus (USB) port 3503. The USB port 3503 allows the battery of the handheld device 3300 (FIG. 33) to be charged, such as by connecting the docking station 3302 to a computer or AC power adapter. The docking station 3302 can be used to connect to a power source for charging. The USB port 3503 can be or include, without limitation, a mini-USB, micro-USB, USB Type-C, or other standard USB connector configurations. In other embodiments, other types of connector devices for connecting the docking station 3302 to a power source are contemplated within the scope of this disclosure, such as other types of AC / DC converters or other types of power supplies. Alternatively, the docking station can include a built-in AC / DC converter and can include a power cable configured to be plugged into an AC mains line, such as a conventional wall outlet that supplies AC power.
[0033] An endoscope optical housing can include various optical components configured to facilitate collection of optical signals from a target to be visualized. Characteristics that may vary from one optical housing to another include the following non-limiting examples, which may be included in any combination within each optical housing: the number of image sensors, the number of image sensors configured for white light imaging (i.e., combined with filters for white light imaging), and the number of image sensors configured for fluorescence imaging, where different image sensors for fluorescence imaging can be paired with different filters to allow passage of different ranges of fluorescent emissions, each range configured to capture a particular feature of the target (e.g., vasculature or microvasculature, collagen, elastin, blood, bone, bacteria, malignant, healthy or diseased cartilage, ligament, tendon, connective tissue, lymph, nerve, muscle, etc.).
[0034] In the example embodiment illustrated in FIGS. 8-13, the electrical components are located at the distal tip of the endoscope 140 and may include one or more fluorescent excitation light sources (FLLEDs 160), white light sources (WLLEDs 165), infrared light sources (IRLEDs 170), digital temperature sensors 180, digital range finders 175, and digital ambient light sensors 185. The fluorescent excitation light sources and white light sources may be embodied as LEDs with wires to the LED cathode and anode terminals. The digital sensors may be powered from a DC regulator located in the base body. A microcontroller unit (MCU) in the base body 110 communicates with the sensors via I2C (an industry standard communication scheme). A camera sensor 190 is also provided at the distal tip 142 of the endoscope 140. The camera sensor 190 connects to the MCU located in the base body 110 using MIPICSI (an industry standard camera interface scheme). 8-13 are illustrated with a single camera sensor 190, other exemplary embodiments may optionally include two or more camera sensors, as described below. The endoscope may also include built-in polarization optics for reflectance and fluorescence polarization imaging.
[0035] The image sensor is configured to capture still images or video. Although disclosed herein as including a single image sensor, it is contemplated that different endoscope designs may include more than one image sensor. As a non-limiting example, a device according to the present disclosure may include a first camera sensor configured for white light and infrared imaging and a second camera sensor configured for fluorescence imaging.
[0036] As will be appreciated by those skilled in the art, the arrangement of components at the distal end of an imaging device can take many configurations. Such configurations can be driven by the size of the device, the footprint of the device, and the number of components used. However, functional factors should also be considered when arranging components. For example, issues such as light leakage from the device's light source and / or ambient light entering the optical housing at the distal end can interfere with proper or optimal operation of the device and can cause less than desirable output, such as image artifacts. The configuration illustrated in Figures 8-13 is one possible configuration, and the camera sensor can accommodate light leakage from the light source and ambient light. The equipment is isolated to prevent
[0037] It may be desirable to have different components within the endoscope depending on the type of imaging to be performed and the type of characteristics to be captured during imaging. Thus, it is possible that several different versions of the endoscope optical housing can be provided for use with a single base body 110. Each different endoscope housing can include a different combination of optical components, each tailored to produce images that show particular characteristics of the area being imaged. Depending on the number of types of components included at the distal tip 142 of the endoscope 140, as well as the intended use of the particular endoscope, the size, shape, or material of the endoscope can vary. Thus, it is contemplated that the base body portion 110 can interchangeably receive several different endoscope components, each with different characteristics.
[0038] For example, according to one example embodiment, each type of light source and / or imaging mode may be provided in a separate endoscope housing. For example, as shown in FIG. 24 , handheld endoscopic imaging device 200 includes base body 210 and three endoscopic optical heads (imaging heads) 245a, 245b, and 245c. Each endoscopic imaging head is configured for a particular imaging mode. In the illustrated embodiment, white light endoscopic optical head 245a is configured for the white light imaging mode. Distal tip 252a of endoscope 240a includes one or more white light LEDs and an optical sensor configured to receive a white light image. White light endoscopic optical head 245a is received in opening 255 of base body 210, and when white light endoscopic optical head 245a is operably connected to base body 210, handheld endoscopic imaging device 200 is configured for the WL imaging mode. WL imaging illuminates the entire field of view (FOV) to observe and capture images of breast tissue under standard lighting conditions similar to those present in an operating room setting. In one example embodiment, the WL endoscope housing includes multiple white light LEDs and an image sensor, such as the Omni Vision sensor OV8865, with an 8MP resolution, a 2-15cm focal range, a 3.05mm focal length, an F-number of 2.2, an 85° field of view, and a TV distortion of <1.0%. In another example embodiment, the WL endoscope housing includes multiple white light LEDs and an image sensor, such as the Sony sensor IMX219, with an 8MP resolution, a 2-15cm focal range, a 2.5mm focal length, an F-number of 2.2, an 84° field of view, and a TV distortion of <1.5%. The white light imaging endoscope optical head 245a may also include additional components, such as a temperature sensor, a light sensor, and / or a rangefinder.
[0039] 24 further illustrates a fluorescence imaging endoscopic optical head 245b configured for a fluorescence imaging mode. The distal tip 252b of the endoscope 240b includes one or more fluorescence LEDs configured to emit excitation light to illuminate a target and an optical sensor configured to receive an optical signal in response to illumination of the target by the excitation light. The fluorescence endoscopic optical head 245b is received in the opening 255 of the base body 210, and when the fluorescence imaging endoscopic optical head 245b is operably connected to the base body 210, the handheld endoscopic imaging device 200 is configured for a fluorescence (FL) imaging mode. In one example embodiment, the fluorescence imaging endoscopic optical head includes multiple blue / violet LEDs and an image sensor, such as the Omni Vision sensor OV8865, with an 8MP resolution, a 2-15cm focal range, a 3.05mm focal length, an F-number of 2.2, an 85° angle of view, and a TV distortion of <1.0%. In another example embodiment, a fluorescence imaging endoscope optical head includes multiple blue / violet LEDs and an image sensor, such as the Sony sensor IMX219, with a resolution of 8MP, a focal range of 2-15cm, a focal length of 2.5mm, an F-number of 2.2, an angle of view of 84 degrees, and a TV distortion of <1.5%. The goal of FL imaging is to visualize cancerous tissue in breast tissue. Cancerous tissue can be visualized by imaging the breast tissue with violet light (405nm) to excite protoporphyrin (PpIX) accumulated in cancer cells following ingestion of 5-aminolevulinic acid (ALA) by the patient. Localized PpIX within cancerous tumors absorbs excitation light (405 nm) and then emits light at a longer wavelength (peak at 635 nm), allowing visualization of cancerous species in breast tissue. See, for example, Figure 25.
[0040] In one example embodiment, a fluorescence imaging endoscope optical head 245b for use with a handheld endoscopic imaging device 200 has two violet LED illumination sources emitting excitation light having a 405 nm±15 nm bandwidth at FWHM for stimulating PpIX fluorescence. See FIGS. 26A-26C. A fluorescence imaging endoscope optical head 245b for use with a handheld endoscopic imaging device 200 can have four different power settings for the fluorescence illumination source: low, low medium, high medium, and high. In one example embodiment, the irradiance of the four settings is approximately 2.3 mW / cm for low when the distal end 245b of the endoscopic imaging device is 10 cm away from the imaging target. 2 , low medium is about 5.2mW / cm 2 , the higher one is about 8.1mW / cm 2 , and high is about 11.0 mW / cm 2 is.
[0041] The fluorescence imaging endoscope optical head 245b for use with the handheld endoscopic imaging device 200 also includes a filter configured to allow passage of a signal to an optical sensor (camera) in response to illumination of a target with FL excitation light. In one example, the fluorescence imaging endoscope optical head has a fixed dual-bandpass emission filter for visualizing PpIX emission light (635 nm) and green autofluorescence from connective tissue (500-550 nm). In one example embodiment, the dual-bandpass emission filter has the following characteristics: diameter 6 mm (+ / - 0.1 mm), thickness 1 mm (+ / - 0.1 mm), and average transmission greater than 95% for the following emission ranges: 502 nm to 543 nm and 600 nm to 660 nm. The dual-bandpass emission filter is also configured to completely block (absolutely block) light at the following wavelengths: 300 nm to 492 nm and 553 nm to 589 nm. The dual bandpass emission filter is also configured to block light with wavelengths averaging 675 nm to 1000 nm and 1000 to 1200 nm. The properties of this example fixed dual bandpass emission filter are illustrated in Figures 27A, 27B, and 27C.
[0042] The fluorescence imaging endoscope optical head 245b may also include additional components such as a temperature sensor, an ambient light sensor, and / or a range finder.
[0043] 24 further illustrates an infrared (IR) imaging endoscopic optical head 245c configured for an infrared imaging mode. The distal tip 252c of the endoscope 240c includes one or more infrared LEDs configured to emit excitation light to illuminate a target and an optical sensor configured to receive an optical signal in response to illumination of the target by the excitation light. The infrared endoscopic optical head 245c is received in the opening 255 of the base body 210, and when the infrared imaging endoscopic optical head 245c is operably connected to the base body 210, the handheld endoscopic imaging device 200 is configured for an infrared (IR) imaging mode. In one example embodiment, the infrared imaging endoscopic optical head includes one or more infrared LEDs and an image sensor, such as the Omni Vision sensor OV8865, with a resolution of 8 MP, a focal range of 2-15 cm, a focal length of 3.05 mm, an F-number of 2.2, an angle of view of 85 degrees, and a TV distortion of <1.0%. In another example embodiment, an infrared imaging endoscope optical head includes one or more infrared LEDs and an image sensor such as the Sony sensor IMX219, with a resolution of 8MP, a focal range of 2-15cm, a focal length of 2.5mm, an F-number of 2.2, an angle of view of 84 degrees, and a TV distortion of <1.5%.
[0044] IR imaging combined with the use of indocyanine green (ICG) dye allows visualization of biological structures such as lymph nodes and blood vessels during breast-conserving surgery. ICG is a cyanine dye that is administered intravenously to patients and binds tightly to β-lipoproteins and, in particular, albumin. Albumin is a family of globular proteins commonly found in plasma and the circulatory system. Additionally, due to the high protein content of lymph nodes, ICG accumulates in lymphatic channels and lymph nodes. The accumulation of ICG makes it possible to visualize lymph nodes and vascular structures using IR imaging. ICG is a dye that fluoresces after excitation under near-infrared light with a peak absorption at 763 nm and a peak emission at 817 nm when measured in a 60 μM aqueous solution. See Figure 28.
[0045] In one example embodiment, an infrared imaging endoscope optical head 245c for use with a handheld endoscopic imaging device 200 has two violet LED illumination sources emitting excitation light having a 760 nm ± 15 nm bandwidth at FWHM for stimulating fluorescence. See Figures 29A and 29B.
[0046] The infrared imaging endoscopic optical head 245c for use with the handheld endoscopic imaging device 200 also includes a filter configured to allow passage of a signal to an optical sensor (camera) in response to illumination of a target with IR excitation light. In one example, the infrared imaging endoscopic optical head has a dual bandpass emission filter for blocking 760 nm excitation light and capturing the resulting optical emission. In one example embodiment, the dual bandpass emission filter has the following characteristics: diameter 6 mm (+ / - 0.1 mm), thickness 1 mm (+ / - 0.1 mm), and greater than 95% average transmission for the following emission ranges: 420 nm to 700 nm and 815 nm to 895 nm. The dual bandpass emission filter is also configured to completely block (absolutely block) light at the following wavelengths: 300 nm to 412 nm, 707 nm to 804 nm, and 912 nm to 1100 nm. The characteristics of this example fixed dual bandpass emission filter are illustrated in Figures 30A, 30B, and 30C. In this embodiment, the IR passband is not centered around the peak of the emission light to ensure that all excitation light is blocked by the emission filter.
[0047] The infrared imaging endoscope optical head 245c may also include additional components such as a temperature sensor, an ambient light sensor, and / or a range finder.
[0048] Although discussed herein with respect to use during breast-conserving surgery, device 200 can also be used to image wounds within confined spaces where the field of view may be partially or completely blocked without an endoscopic attachment, such as wounds contained within a body canal or organ. Additionally, while described herein as having three endoscopic optical heads for imaging, one each for white light, fluorescent, and infrared imaging, it is contemplated that additional endoscopic optical heads for fluorescent and / or infrared imaging can be provided. The three endoscopic optical heads 245a, 245b, 245c can be provided together as a kit for use with base body 210 or can be sold with base body 210 as a system. Additionally or alternatively, a kit can be provided that includes more than one fluorescent imaging endoscopic optical head 245b, each having an excitation light source configured to emit excitation light having a different wavelength. Such additional fluorescent imaging endoscopic optical heads 245b may also be sold separately as supplemental or replacement parts. Similarly, kits including more than one infrared imaging endoscopic optical head 245c may be provided, with each infrared imaging endoscopic optical head 245c having an excitation light source configured to emit excitation light having a different wavelength. Such additional infrared imaging endoscopic optical heads 245c may also be sold separately as supplemental or replacement parts. Kits or systems including a white light imaging endoscopic optical head 245a, more than one fluorescent imaging endoscopic optical head 245b, and / or more than one infrared imaging endoscopic optical head 245c are also contemplated.
[0049] In another example embodiment, three separate imaging systems are provided for white light imaging, fluorescence imaging, and infrared imaging. Instead of providing a single optical head, a three-piece or three-prong imaging endoscope optical head can be provided, with each of the three pieces or prongs including a different light source for imaging. For example, a first piece or prong can include a white light source for white light imaging and an optical sensor for receiving a signal responsive to illumination of a target with white light during white light imaging, a second piece or prong can include a fluorescence excitation light source for fluorescence imaging, a fluorescence emission filter for filtering a signal responsive to illumination of a target with the fluorescence excitation light, and an optical sensor for receiving a filtered signal responsive to illumination of a target with the fluorescence excitation light during fluorescence imaging, and a third piece or third prong can include an infrared excitation light source for infrared imaging, an infrared emission filter for filtering a signal responsive to illumination of a target with the infrared excitation light, and an optical sensor for receiving a filtered signal responsive to illumination of a target with the infrared excitation light during infrared imaging. Each of the fluorescent and infrared pieces (prongs) can be configured to emit excitation light at one or more wavelengths of fluorescent and infrared excitation light, respectively. The three pieces / prongs can be joined together in a single mounting structure, which can be rotatably connected to the endoscopic portion of the endoscope optical head. In this manner, the pieces / prongs can be rotated relative to the endoscope to select the desired light source for the desired imaging mode. Rotation can be motorized or manual. Rotation of the light source to the "in use" position can operably connect the light source to a battery pack contained in the base body to power the light source.
[0050] In alternative embodiments, the optical sensor can be contained in the endoscope portion or the base body portion of the handheld endoscopic imaging device, with only the light source and filter, if desired, being included in each of the prongs. In either embodiment, the prongs can include additional components such as a temperature sensor, an ambient light sensor, and / or a rangefinder.
[0051] It is also contemplated that only two prongs may be provided, with the white light source and the infrared light source being contained on the same prong.
[0052] In another example, instead of separate imaging heads or separate prongs, the distal tip of the endoscopic portion of the handheld endoscopic imaging device can be detachable or interchangeable with other distal tips, each having different characteristics, such as white light imaging, fluorescence imaging, and / or infrared imaging. As discussed above with respect to separate endoscopic optical heads, more than one fluorescence and / or infrared imaging tip can be provided, each having a respective light source configured to emit excitation light at a predetermined wavelength. Kits of distal tips can be sold with the handheld endoscopic imaging device to create a system or can be sold separately as replacement or replacement parts.
[0053] The number and type of excitation light sources included in the endoscope optical housing can vary. The excitation light sources configured to emit excitation light have wavelengths ranging from about 350 nm to about 400 nm, about 400 nm to about 450 nm, about 450 nm to about 500 nm, about 500 nm to about 550 nm, about 550 nm to about 600 nm, about 600 nm to about 650 nm, about 650 nm to about 700 nm, about 700 nm to about 750 nm, about 750 nm to about 800 nm, about 800 nm to about 850 nm, about 850 nm to about 900 nm, and / or combinations thereof. The shape of the optical housing can also vary from one housing to another depending on the particular application. In particular, the endoscopic portion of the optical housing can be flexible, rigid, articulating, long, short, etc. For example, specialized shapes can be used for specific applications, such as accessing confined anatomical spaces, such as cavities, the oral cavity, the nasal cavity, the ear, etc. The size of the endoscope optical housing can vary depending on the size and number of components contained therein. Various exemplary embodiments of the optical housing can also include features such as ambient light sensors, range finders, thermal imaging sensors, infrared radiation sources to be used for three-dimensional imaging, lasers for taking measurements, etc., in any combination.
[0054] The handheld endoscopic imaging device has a protective window that covers the optical components within the endoscope head. In one example embodiment, the window can be made from Corning-Fused Silica 7980 and has a thickness of approximately 1.1 mm. The transmission characteristics of the window are illustrated in FIG. 31. In addition to the protective window, an optically clear lens can be provided on a custom sterile drape configured for use with the device, as discussed further below. All excitation light and resulting emission light must pass through the optically clear lens of the drape.
[0055] The endoscopic portion of the endoscope optical housing is configured to direct light to a surgical site when a tumor is resected, into a wound, into a surgical cavity where the tumor / tissue is resected, on one or more sections of the resected tumor, on the outer surface of the resected tumor, at a surgical margin, or into a confined anatomical space. The endoscope tip can be further configured to be positioned within a surgical cavity encompassing the surgical margin. The base body portion of the device can include one or more materials suitable for sterilization, such as autoclaving, so that the device body can undergo sterilization. An example of a suitable material is polypropylene. Those skilled in the art will be familiar with other suitable materials. Components within the device body that may not be able to withstand autoclave conditions, such as electronics, can be secured or otherwise housed in a protective housing, e.g., a metal or ceramic housing.
[0056] The device can be configured for use with a surgical drape or shield. Additional details regarding such drapes can be found in PCT / CA2019 / 000061, filed May 9, 2019, entitled "IMAGING DRAPES, PACKAGING FOR DRAPES, METHODS OF USE OF IMAGING DRAPES, AND METHODS FOR DEPLOYING DRAPE," and in U.S. Design Application No. 29 / 676,893, filed January 15, 2019, entitled "Adaptor for Supporting a Darkening Drape," the entire contents of each of which are incorporated herein by reference. In addition to the darkening drapes disclosed in the above-referenced applications, drapes for use with the imaging devices of the present application can be configured to maintain a sterile surgical field and / or to maintain the distal tip of an endoscope from contamination with bodily fluids. These two drape properties, darkening and sterility, can be combined into a single drape or can be styled as two different drape components as discussed below. An example drape embodiment is illustrated in FIG.
[0057] In one embodiment shown in Figures 32A-32C, a custom sterile drape fits over the endoscope head and encloses the entire handheld endoscopic imaging device. See Figures 32A and 32C. The sterile drape will maintain the sterility of the device during use. In one example embodiment, the custom sterile drape includes a lens found at the distal tip of the custom sterile drape. The lens can be optically clear and can be, for example, a 1.8 mm lens. The drape can be made of Sabic 9440 color 112 (clear), with a thickness of 92% at 0° AOI and 88% at 45° AOI. The custom sterile drape can have a lens holder to securely attach the drape to the distal tip of the endoscopic portion of the handheld endoscopic imaging device. Once attached, the only way to remove the lens holder and drape is to break the holder. An example embodiment of a lens holder is illustrated in FIG. 32B. The optical housing can be configured so that a single adapter will fit over the entire endoscope optical housing to attach the darkening drape. Alternatively, separate adapters can be provided to engage each type of endoscope optical housing.
[0058] For example, the inventors have found that image quality improves when ambient and artificial light is reduced in the area of imaging. This is achieved by reducing or eliminating ambient and / or artificial light sources during use. This can be achieved by using a drape or shield. Alternatively, a drape or shield can be used to block at least a portion of the ambient and / or artificial light from the surgical site where imaging is occurring. In one exemplary embodiment, the shield can be configured to fit over the endoscopic end of the device and can be moved over the device toward and away from the surgical cavity to vary the amount of ambient and / or artificial light that may enter the surgical cavity. The shield can be shaped like a cone or umbrella. Alternatively, the device itself can be enclosed within a drape, with a clear sheath portion covering the end of the device configured to illuminate the surgical site with excitation light. The surgical drape can include an optically clear or transparent window that fits over the distal tip 142 of the endoscope 140 so as not to interfere with imaging. The drape can provide protection for the handheld device to allow it to be sterilized, such as by autoclaving or other sterilization methods. The drape can cover the handheld device and can extend from its distal end to provide a darkening shield covering the area adjacent to the surgical cavity, protecting the surgical cavity area from light intrusion from sources other than the handheld device. The drape can also include or be coupled to a rigid optical window, such as a lens cap, that covers the distal end of the handheld device to ensure accurate transmission of light emitted from the light source and corresponding transmission of light returning to the imaging device. The body of the drape can include a polymeric material, such as polyethylene, polyurethane, or other polymeric materials. Optionally, the lens cap can include a different material, such as polymethyl methacrylate (PMMA), or other rigid, optically clear polymers, glass, or other materials.
[0059] Another exemplary embodiment of a lens for a sterile drape is shown in FIG. 39. The lens 3980 includes a shape configured to mate with the distal tip 142 of the endoscope 140. The lens 3980 may include a material selected to minimize (e.g., eliminate) optical artifacts in images generated by the endoscope when the lens is positioned over the distal tip 142. The lens 3980 may also include features configured to couple the lens 3980 to the distal tip 142. For example, the lens 3980 may include one or more snap-fit arms 3982 that couple the lens 3980 to the distal tip 142 of the endoscope 140.
[0060] The lens 3980 can comprise an optically clear material, such as, for example, Sabic 9440 color 112 (clear) or other optically clear polymer or glass material. The lens 3980 can be coupled to a sterile drape that covers the handheld device and forms a sterile barrier between the handheld device and the surgical field. For example, referring now to FIG. 40 , a cross-sectional view of a handheld device 100 is shown with the lens 3980 in place over the distal tip 142 and a sterile drape 4084 surrounding the handheld device 100. The sterile drape 4084 can comprise a flexible polymer sheet material and can be connected to the lens 3980, for example, by adhesive, a heat-based connection such as laser welding, a mechanical connection, or any other type of connection sufficient to bond the lens 3980 to the sterile drape 4084.
[0061] As mentioned above, handheld devices can be used with darkening drapes configured to limit ambient light from entering the surgical field. Such drapes can include multiple components, such as a darkening drape adapter portion that couples the drape to the handheld device and a drape portion that includes the drape material. For example, FIG. 41 provides an example embodiment of a darkening drape adapter portion 4186. The adapter portion 4186 includes an opening 4188 configured to receive the endoscope 140 of the handheld device and a mating feature 4190 in the opening 4188 configured to engage the endoscope 140 and hold the adapter portion 4186 to the endoscope 140. The mating feature 4190 can include a snap-fit feature or other engagement feature configured to hold the adapter portion 4186 to the endoscope 140.
[0062] The adapter portion 4186 further includes one or more arms 4192 configured to spread a darkening drape material over the surgical field, so that the endoscope 140 can be positioned and moved within the surgical field without the drape material interfering with the endoscope 140. For example, referring now to FIG. 42 , the adapter portion 4186 is shown installed in the handheld device 100. The arms 4192 of the adapter portion 4186 spread a drape material 4294 over the endoscope 140, so that the drape material 4294 does not interfere with the use of the endoscope 140 within the area surrounded by the darkening drape material 4294.
[0063] 42 also shows a sterile drape 4084 placed on device 100. The sterile drape 4084 and associated lens 3980 can be placed on top of device 100 as discussed above, and endoscopic portion 140 covered by lens 3980 and sterile drape 4084 can be inserted through aperture 4188 in adapter portion 4186, and a darkening drape can be placed on top of device 100. Device 100 is thereby covered by the sterile drape, and the darkening drape reduces the intrusion of ambient light into the surgical field.
[0064] Other variations on drapes configured to reduce or eliminate ambient and / or artificial light are available, as would be understood by one skilled in the art. Additionally or alternatively, the handheld fluorescence-based imaging device can include a sensor (e.g., ambient light sensor 185) configured to identify whether lighting conditions are satisfactory for imaging. The device can also be used in conjunction with a surgical drape to maintain sterility of the surgical field and / or to protect the tip of the device from bodily fluids. The surgical drape and the ambient light-reducing drape can be combined into a single drape design. Alternatively, the surgical drape can encase the device, and the ambient light-reducing drape or shield can be positioned over the surgical drape.
[0065] The endoscope optical housing contains several components at the tip of the device that facilitate white light imaging, tissue autofluorescence imaging, PpIX fluorescence imaging, and infrared imaging. These components include a white LED, a 405 nm LED, an infrared LED (between 750 and 800 nm), a heat sink, at least one camera module consisting of an image sensor and lens assembly, at least one imaging filter to facilitate fluorescence imaging, an ambient light sensor, a temperature sensor, and a rangefinder. The temperature sensor is used to ensure that the device is operating within a safe temperature range. The temperature sensor is used to provide feedback to the control loop, modulating the LED setup current to compensate for temperature-induced efficiency changes in the LED. The LED radiant flux at a constant drive current varies with LED temperature.
[0066] The base body portion 110 of this device has a built-in display but can also allow for wireless image / data transmission to an external display. It can also allow for automatic digital data storage. It is also possible for the optical components of the endoscopic attachment to be housed near the base body (i.e., not at the distal tip) and incorporate fiber optics to provide imaging capabilities. In such embodiments, the endoscope may or may not be permanently attached to the base body.
[0067] As discussed above, the endoscope optical housing can include at least one excitation light source configured to excite autofluorescence emissions of tissue cells and fluorescent emissions of derivatized porphyrins in tissue cells of the surgical margin. The at least one excitation light source can be located at, around, and / or adjacent to the distal end of the device. Each light source can include, for example, one or more LEDs configured to emit light at selected wavelengths. It can be done.
[0068] The excitation light source can provide excitation light of a selected single wavelength to excite tissue autofluorescence emissions and fluorescence emissions of derived porphyrins in tumor / cancer cells contained within the surgical margins of the resected tumor / tissue and / or the surgical margins of the resected surgical bed of tumor / tissue cells. In one example, the excitation light can have a wavelength in the range of about 350 nm to about 600 nm, or in the ranges of 350 nm to about 450 nm and 550 nm to about 600 nm, or, for example, 405 nm, or, for example, 572 nm.
[0069] Alternatively, the excitation light source can be configured to provide excitation light of two or more wavelengths. The wavelength of the excitation light can be selected for different purposes, as will be understood by those skilled in the art. For example, by varying the wavelength of the excitation light, the depth to which the excitation light penetrates the surgical bed can be varied. Because penetration depth increases with a corresponding increase in wavelength, different wavelengths of light can be used to excite tissue below the surface of the surgical bed / surgical margin. In one example, excitation light having a wavelength in the range of 350 nm to 450 nm, e.g., 405 nm, and excitation light having a wavelength in the range of 550 nm to 600 nm, e.g., 572 nm, can excite the tissue forming the surgical bed / surgical margin to different depths, e.g., from about 500 μm to about 1 mm and about 2.5 mm. This allows the device user, e.g., a surgeon or pathologist, to visualize tumor / cancer cells at or below the surface of the surgical bed / surgical margin. Additionally or alternatively, excitation light having a wavelength in the near-infrared / infrared region can be used, e.g., between about 750 nm and about 800 nm, e.g., 760 nm or 780 nm. In addition, to penetrate tissue to deeper levels, the use of this type of light source can be utilized in conjunction with a second type of imaging / contrast agent, such as an infrared dye (e.g., IRDye800, ICG). This would allow visualization of, for example, angiogenesis, vascular perfusion, and blood pools within the surgical margin / surgical bed, and this information can be used by the surgeon in making decisions about the possibility of residual tumor / cancer cells remaining in the surgical bed. Additionally, the utility of visualizing vascular perfusion is to improve anastomosis during reconstruction.
[0070] The device can include an additional light source, such as a white light source for white light (WL) imaging of the surgical margins / surgical bed. In at least some instances, such as during BCS, e.g., lumpectomy, tumor removal will create a fossa encompassing the surgical bed / surgical margins. WL imaging can be used to obtain images or videos of the interior of the fossa and / or surgical margins to provide visualization of the fossa. The white light source can include one or more white light LEDs. Other white light sources can be used as needed. As will be understood by one of ordinary skill in the art, the white light source should be stable and reliable and should not generate excessive heat during prolonged use.
[0071] The base body portion 110 of the device 100 can include controls to enable switching / toggling between white light imaging and fluorescence imaging. The controls can also enable the use of various excitation light sources, together or separately, in various combinations, and / or sequentially. The controls can cycle through various different light source combinations, sequentially control the light sources, strobe the light sources, or otherwise control the timing and duration of light source use. The controls can be automatic, manual, or a combination thereof, as would be understood by one skilled in the art. As discussed above, the touchscreen display 120 of the base body portion 110 can function as a user interface to enable control of the device 100. Alternatively, it is contemplated that separate controls, such as hand-operated buttons, can be used in place of or in addition to the touchscreen controls. Such hand-operated buttons allow the user to easily operate the controls while holding and using the device. For example, it can be located on the hand grip to allow
[0072] The endoscope optical housing portion 145 of the device 100 can also include one or more optical imaging filters configured to prevent the passage of reflected excitation light and allow the passage of emission having wavelengths corresponding to the autofluorescence emission of tissue cells and the fluorescent emission of derivatized porphyrins in the tissue cells. In one example embodiment, the device includes one filter for white light (WL) imaging and infrared (IR) imaging, and another filter for fluorescence (FL) imaging. The device can be configured to switch between different imaging filters based on the desired imaging mode and the excitation light emitted by the handheld device.
[0073] The endoscope optical housing can be modified using optical or variably oriented polarization filters (e.g., linear or circular, combined with optical waveplates) attached to the excitation / illumination light source and imaging sensor in a streamlined manner. In this way, the device can be used to image tissue surfaces using either white-light reflectance and / or fluorescence imaging with polarized illumination and non-polarized detection, or vice versa, or polarized illumination and polarized detection. This allows imaging of tissues with minimal specular reflection (e.g., glare from white-light imaging) and imaging of fluorescence polarization and / or anisotropy-dependent changes in connective tissue (e.g., collagen and elastin) within the tissue. The ability to use polarization optics in the endoscope optical housing allows polarization of either reflected light or fluorescence from the target. This can potentially provide improved image contrast, as tumor tissue versus normal tissue reflects 405 nm excitation light differently or emits different polarization information from emitted fluorescence light at 500-550 nm and 600-660 nm.
[0074] The handheld fluorescence-based imaging device also includes an imaging lens and an imaging sensor within the device's endoscopic optical housing. The imaging lens or lens assembly can be configured to focus filtered autofluorescence and fluorescence emissions onto the image sensor. A wide-angle imaging lens or fisheye imaging lens is an example of a suitable lens. A wide-angle lens can provide a 180-degree field of view. The lens can also provide optical magnification. Very high resolution is desirable for the imaging device, so that differentiation between very small cell groups is possible. This is desirable to achieve the goal of maximizing the amount of healthy tissue retained during surgery while simultaneously maximizing the possibility of removing substantially all remaining cancerous, precancerous, and satellite lesions. The image sensor is configured to detect filtered autofluorescence emissions from tissue cells and fluorescent emissions from derived porphyrins in tissue cells at the surgical margins. The image sensor can have 4K video capabilities, as well as autofocus and optical or digital zoom capabilities. CCD or CMOS imaging sensors can be used. In one example, a CMOS sensor combined with a filter can be used, i.e., a hyperspectral image sensor such as those sold by Ximea Company. Example filters include a visible light filter (https: / / www.ximea.com / en / products / hyperspectral-cameras-based-on-usb3-xispec / mq022hg-im-sm4x4-vis) and an IR filter (https: / / www.ximea.com / en / products / hyperspectral-cameras-based-on-usb3-xispec / mq022hg-im-sm4x4-vis). The handheld device includes a processor. The processor may be configured to receive the detected emissions and output data related to the detected autofluorescence emissions of the filtered tissue cells and the fluorescent emissions of the derived porphyrins in the tissue cells of the surgical margin. The processor may be capable of seamlessly executing concurrent programs (including, but not limited to, wireless signal monitoring, battery monitoring and control, temperature monitoring, image reception / compression, and button press monitoring). The processor interfaces with internal storage, buttons, optics, and the wireless module. The processor also has the ability to read analog signals.
[0075] The device can also include a wireless module and can be configured for fully wireless operation. It can utilize high-throughput wireless signals and have the capability to transmit high-resolution video with minimal latency. The device is both Wi-Fi and Bluetooth enabled (Wi-Fi for data transmission, Bluetooth for high-speed connectivity). The device can utilize 5 GHz wireless transmission band operation for isolation from other devices. Furthermore, the device can be enabled as a soft access point, which eliminates the need for an internet connection and keeps connected devices and modules separate from other devices related to patient data security. The device can be configured for wireless charging and can include an inductive charging coil. Additionally or alternatively, the device can include a port configured to receive a charging connection.
[0076] According to one aspect of the present disclosure, an endoscopic handheld device can be used to obtain three-dimensional fluorescence images of a target. Systems and methods for obtaining such three-dimensional images are disclosed in U.S. Provisional Application No. 62 / 793,837, filed January 17, 2019, entitled "Systems, Methods, and Devices for Three-Dimensional Imaging, Measurement, and Display of Wounds and Tissue Specimens," the entire contents of which are incorporated herein by reference.
[0077] Additional details regarding the structure, function, and operation of the exemplary devices described herein are found in U.S. Provisional Application Nos. 62 / 625,983 (filed February 3, 2018, and entitled "Devices, Systems, and Methods for Tumor Visualization and Removal") and 62 / 625,967 (filed February 2, 2018, and entitled "Devices, Systems, and Methods for Tumor Visualization and Removal"), which are incorporated herein by reference. and "Methods for Tumor Visualization and Removal," the entire contents of each of which are incorporated herein by reference.
[0078] As embodied in one example (see FIGS. 9-12), the distal end of the endoscope includes one or more light sources, such as light-emitting diodes (LEDs), configured to emit light having particular wavelengths. For example, the one or more light sources can be configured to emit wavelengths of 405 nm, 760 nm, 780 nm, or other wavelengths. The distal end further includes an imaging device, such as a camera assembly, configured to capture images of the surgical cavity illuminated by the one or more light sources. The distal end further includes one or more spectral filters positioned to filter light entering the imaging device, as discussed in more detail below.
[0079] In some exemplary embodiments, the handheld device can include a channel formed in the sidewall of the distal end. The channel can be used to facilitate the insertion of additional tools, such as optical fibers for auxiliary light sources or auxiliary imaging sensors, cauterization tools, biopsy forceps, tagging tools (for marking tissue with clips, optical tags, dyes or paints, etc.), or other tools, while the handheld device 100 is positioned within the surgical site. Alternatively or additionally, some embodiments can include a channel formed within the distal tip of the device, i.e., an internal channel within the device, for introducing any of the above-mentioned tools into the surgical site while the handheld device is in use.
[0080] As discussed in more detail below, the handheld device includes various electrical subsystems, including one or more imaging devices such as one or more camera sensors, one or more fluorescent LEDs, one or more infrared LEDs, one or more white light LEDs, and various sensors such as temperature sensors, ambient light sensors, and ranging sensors. In an exemplary embodiment, the handheld device includes two camera sensors, each configured to support image capture based on a different wavelength range. Other components may include one or more LED drivers that generate drive voltages to drive the LEDs on demand to achieve a setpoint drive current; one or more accelerometers and gyroscopes to enable the video stream to be tagged with the handheld device's location, e.g., to provide spatial orientation of features within a surgical cavity; flash memory to provide local storage of video and still images; a USB hub to provide an interface for factory loading of the handheld device's software testing and calibration; an inductive battery charging system; motor drive electronics to provide automatic switching of optical filters as discussed below; a Wi-Fi radio subsystem; a user interface to provide information to the user regarding the device's mode; a rechargeable battery (e.g., a lithium-ion battery); an audio device, such as a speaker, to provide audible feedback to the user about the system status; an audio recording device; and other components. Such components may be operably coupled to one or more controllers, such as a computer processor, housed within the handheld device.
[0081] For example, in one embodiment, the handheld device includes one or both of an application processor and a microcontroller unit. The application processor can perform functions including, but not limited to, a camera interface and sending a video stream (e.g., still images and motion video) to a wireless transmission function for display or transmission of the data to a computer terminal, interfacing with an accelerometer, gyroscope, and on-board flash memory, interfacing with the microcontroller unit, driving a speaker for audible feedback to the user, and managing the wireless communication subsystem.
[0082] The microcontroller unit can provide functions such as controlling the LED drive electronics, including a temperature compensation loop, communicating with temperature sensors, ambient light sensors, and range finders, and interfacing with an application processor for communicating and receiving system usage and context state. The microcontroller unit can also monitor the system for exception conditions, control indicator LEDs, monitor pushbuttons or other user interface devices, control motor drives to switch between optical filters, monitor wireless battery charging and charge status, and control power management and other functions.
[0083] The handheld device may include one or more printed circuit board (PCB) components to facilitate manufacturing and assembly of the handheld device. The handheld device includes an LED PCB that may include one or more light emitting diodes (LEDs) and associated electronic components. The LED PCB may be operably coupled to other electronic systems within the handheld device via wiring (such as a bus) and may also be connected to a control system of the handheld device, such as a controller for a power source such as a battery, etc.
[0084] The distal PCB can be located adjacent to the imaging device and can include components that support the imaging device, such as components that interface the imaging device to a controller, a power source for the handheld device, e.g., a battery, etc. In some embodiments, a light source for the handheld device can be included on the distal PCB.
[0085] For example, an exemplary layout for a distal end PCB can include first and second LED devices. By way of non-limiting example, the first and second LED devices can include LEDs configured to emit light having a wavelength of 405 nm, while the second LED device emits light at a wavelength of 760 nm, 780 nm, or other wavelengths. The PCB may further include a white light LED configured to provide visual illumination to the area to be imaged.
[0086] The distal PCB is operably coupled to the handheld device's control system and can include other components configured to provide other information to the control system to support effective operation of the handheld device. For example, the distal PCB can include a temperature sensor used to provide feedback to the LED setpoint temperature compensation loop to ensure the system is operating within a safe temperature range. In addition to ensuring the system is operating within a safe temperature range, the temperature sensor provides feedback to the LED setpoint temperature compensation loop to minimize changes in LED radiant flux as temperature changes. The rangefinder can measure the distance between the camera sensor and the target to be imaged and can be used to provide feedback to the user to guide the user in imaging at the correct distance. Changes in the measured target distance can optionally be used to trigger refocusing of the camera sensor. The ambient light sensor can provide feedback to the user regarding ambient light levels, as fluorescence imaging is only effective in appropriately dark environments. The measured ambient light level can also be useful during white light imaging mode to enable or control the intensity of the white light LED. The distal PCB may be operatively coupled to other portions of the handheld device, such as a controller, a power source such as a battery, one or more processors such as a microcontroller unit and an application processor, or other components.
[0087] The LED device can be controlled by a closed-loop system using information from a temperature sensor as input to a control loop that adjusts the LED drive current set point. In some embodiments, low- and high-range LED intensity modes can be supported for different applications. Examples include closed-range imaging within a surgical cavity and long-range lumpectomy imaging in a pathology suite.
[0088] 36 provides an example layout of hardware components of a device according to various embodiments of the present disclosure. Referring to FIG. 36, the hardware components of a handheld device according to an exemplary embodiment of the present disclosure are grouped into an optical printed circuit board (PCB) 3600 (which may correspond to the distal end PCB discussed herein) and an electronics system 3602. The optical PCB 3600 includes a fluorescent LED 3604, an infrared LED 3606, and a white light LED 3608. The optical PCB 3600 may also include an ambient light sensor 3610, a rangefinder such as a laser rangefinder 3612, and a temperature sensor 3614.
[0089] The optical PCB 3600 is operably coupled to an electronics system 3602. The electronics system can include electronic control components such as an application processor module 3616, a real-time microcontroller unit (MCU) 3618, and a power management subsystem 3620. The electronics system 3602 can also include components and systems that interface with other electronic components of the handheld imaging device. For example, the electronics system 3602 can include a CMOS camera interface 3622 and LED drivers 3624 for fluorescent, infrared, and white light LEDs.
[0090] Other supporting electronic systems and components of the electronics system 3602 may include memory, such as a flash memory device 3626, space and motion sensors 3628, such as one or more of a magnetometer, an accelerometer, and a gyroscope, a Wi-Fi wireless subsystem 3630, and a USB hub 3632. The contacts 3310 are configured to contact the contacts 3308 ( FIG. 34 ) of the docking station 3302 when the handheld device 3300 is placed in the docking station 3302, as discussed above in connection with FIG.
[0091] The electronics system 3602 may include various connections and / or associated connectors to facilitate coupling of the electronics system 3602 to other components of the handheld device. For example, the electronics system 3602 may include one or more of a fluorescence camera connector 3634 configured to operably couple a fluorescence camera 3635 to the electronics system 3602, a white light / infrared camera connector 3636 configured to operably couple a white light / infrared camera 3637 to the electronics system 3602, a display connector 3638, a speaker connector 3640, a Wi-Fi antenna connector 3642, and a battery pack connector 3644. The various connectors may provide electrical coupling from the electronics system 3602 to respective components of the handheld device, such as various camera devices, displays, speakers or other audio devices, Wi-Fi antennas, and battery packs as discussed herein.
[0092] The electronics system 3602 can include various user controls and associated indicators, such as a power switch 3646 and associated indicator 3648, a charge status indicator 3650, a picture capture switch 3652, a video capture switch 3654, and fluorescent, white light, and infrared imaging mode switches 3656, 3658, and 3660, respectively.
[0093] The electronics system may further include one or more connectors, such as, for example, a universal serial bus (USB) connector, to facilitate coupling of the handheld device to a computer. In the exemplary embodiment of FIG. 36, the connector is a USB Type-C (USB-C) connector 3662. The USB connection provided by the USB connector may provide an alternative to wireless transmission of data over Wi-Fi or other wireless protocols, such as Bluetooth, which may be required due to wireless device limitations in some operating rooms. Additionally, the USB connection may be used for software and / or firmware updates, battery charging, and other functions.
[0094] The electronics system 3602 can be operably coupled to a computer by a detachable USB connection cable, such as cable 3764 shown in FIG. 37. Cable 3764 can include various features configured to ensure that the cable does not interfere with the surgical field and to ensure that the cable is not inadvertently detached from the handheld device during use. While the description herein may refer to a Universal Serial Bus (USB) type connection, it should be understood that the present disclosure is not limited to any particular connection protocol, and that connection protocols other than various types of USB interfaces are within the scope of the present disclosure.
[0095] The cable 3764 can include a shaped strain relief feature 3766 to facilitate keeping the cable out of interference with the surgical field. For example, in the embodiment of FIG. 37 , the cable 3764 is configured to be inserted into a connection port on the back of a handheld device according to the present disclosure. The strain relief 3766 is shaped to create a substantially 90-degree curvature in the cable 3764 when in an unstressed state. The curvature of the cable 3764 facilitates routing the cable 3764 away from the surgical field. The cable curvature can be less than or greater than 90 degrees. As an exemplary range, the cable curvature can be, but is not limited to, 70 degrees to 110 degrees. Curves less than 70 degrees or greater than 110 degrees are within the scope of the present disclosure. The particular shape of the cable imparted by the strain relief feature 3766 may depend on the location of the connection port on the handheld device. For example, for a handheld device with a side connection port, the strain relief can be straight for routing the cable away from the surgical field.
[0096] The cable 3764 may also include a connection interface 3768 configured to electrically and mechanically couple the cable 3764 to a handheld device. The connection interface 3768 may include a locking ring 3770 that provides a positive mechanical engagement between the cable 3764 and the handheld device, preventing the cable 3764 from being inadvertently pulled from the handheld device during use.
[0097] 38 , a portion of a housing 3872 is shown including a connection port 3874 configured to receive a connection interface 3768 of a cable 3764. The connection port 3874 includes a peripheral portion including a slot 3878 configured to receive a corresponding tab 3780 of a locking ring 3770. After the locking ring 3770 is inserted such that the tab 3780 of the locking ring 3770 is received in the slot 3878, the locking ring 3770 is rotated such that the tab 3780 rotates into the circumferentially extending portion 3879 of the slot 3878, and the locking ring 3770 retains the connection interface 3768 within the connection port 3874.
[0098] The locking ring 3770 and surrounding portion may comprise a material having sufficient mechanical strength to withstand forces that may be applied to the connection interface 3768 during use. For example, one or both of the locking ring 3770 and the surrounding portion of the connection port 3874 may comprise a metal such as an aluminum alloy, a high strength polymer, a composite material, or other material.
[0099] Because the strain relief feature 3766 routes the cable away from the handheld device, application of force to the cable 3764 and / or strain relief feature 3766 can generate a relatively large torque at the connection interface 3768 thanks to the strain relief feature 3766 acting as a moment arm. The connection interface 3768 of the cable 3764 and the corresponding connection port on the housing of the handheld device can include features configured to withstand such torque and other forces without applying these forces to the more sensitive electrical contact components of the connection interface 3768 and the corresponding connection port.
[0100] For example, the connection port 3874 may include a pin 3876 extending from a face of the port 3874. The connection interface 3768 of the cable 3764 includes recesses 3778 (only one of which is shown in FIG. 37 ) into which the pin 3876 is received. The pin 3876 and recess 3778 form a mechanical interface between the connection port 3874 and the connection interface 3768 that has sufficient mechanical strength to withstand typical forces to which the cable 3764 and the connection port 3874 are subjected during use and also prevents excessive stress from being placed on the electrical interface components of the connection port 3874 and the connection interface 3768.
[0101] Additionally, in some exemplary embodiments, one or both of the connection port 3874 and the connection interface 3768 can include a seal to prevent ingress of various contaminants, such as biological or therapeutic fluids or substances, into the electrical contacts of the connection port 3874 and the connection interface 3768. For example, in the embodiment of FIG. 38 , the connection port 3874 includes a gasket 3880 that forms a seal against the connection interface 3768 when the connection interface 3768 is secured to the connection port 3874 using the locking ring 3770. Additionally, in some embodiments, the gasket or other seal can be configured to provide a preload force between the connection port 3874 and the connection interface 3768, helping to secure the locking ring 3770 in a mated state of the connection interface 3768 at the connection port 3874. When in a mated state, the cable 3764 is connected to the handheld device 3874, as discussed above. The cable 3764 can provide a data and / or power transmission conduit for connecting the handheld device 100 to the surgical field when the cable 3764 is coupled to the connection port 3874. Additionally, the cable 3764 can include a sterile sheath configured to be attached to a sterile drape 4084 (FIG. 40) to maintain a sterile barrier between the handheld device 100 and the surgical field when the cable 3764 is coupled to the connection port 3874.
[0102] As mentioned above, the handheld device can include one or more optical filters configured to allow the passage of specific wavelengths or wavelength bands of light while blocking other wavelengths. By placing such a filter between the imaging device 520 (FIG. 6) and the area to be imaged, a specific wavelength or band of wavelengths is isolated in the image, allowing visualization of areas emitting light of that wavelength or wavelength band. For example, the handheld device can include one or more of a notch filter configured to pass specified wavelengths, an mCherry filter (as used herein, an mCherry filter can refer to a filter that transmits green (emission light at wavelengths of approximately 500-550 nm) and red (emission light at wavelengths of approximately 600-660 nm)), or other types of optical spectral filters. The spectrum of an mCherry filter is shown in FIG. 20, and more information may be found at https: / / www.chroma.com / products / parts / 59022m.
[0103] The one or more filters may be configured to allow a user to switch between one or more filters when using different light sources, different compounds or dyes, etc. Such filter switching may be performed automatically based on other user-defined settings of the handheld device, such as the user's selected mode.
[0104] The handheld device can include components configured to allow filters to be rapidly switched in a manual or automatic manner. For example, a filter wheel according to one embodiment of the present disclosure is shown. The filter wheel can be positioned in the handheld device between an imaging device (e.g., imaging device) and the area to be imaged. For example, the filter wheel can be at the distal end of the handheld device, distal to the imaging device. For example, as illustrated in FIGS. 10 and 11 , the filter 195 can be rotated between a first configuration in which the filter is positioned above the fluorescence excitation light source 160 and a second position in which the filter 195 is positioned above the camera sensor 190.
[0105] The filter wheel includes a first optical filter configured to support white light and infrared (WL / IR) imaging and a second optical filter configured to support fluorescence (FL) imaging. The first and second filters are positioned opposite each other across a filter wheel rotation axis AR about which the filter wheel is rotatable. As discussed above, the imaging device can be offset, so that the first and second filters can be alternately positioned in front of the imaging device as desired by a user. The filter wheel can be rotated manually by a user or can be automated. As discussed in more detail below with reference to Figures 18-23, a user can select one of the first and second filters based on the compound or dye used and / or the wavelength of excitation light applied to the surgical cavity. Additionally or alternatively, rotation of the filter wheel can be performed manually, such as by providing the filter wheel with a user-graspable periphery. Although the filter wheel is described as including two filters, other embodiments of the filter wheel can include three filters, four filters, or any desired number of desired filters that can fit onto the filter wheel.
[0106] In an exemplary embodiment, the first filter blocks light having wavelengths between 675 nm and 825 nm and allows wavelengths less than 675 nm and greater than 825 nm to pass. In various embodiments, the first filter can include a notch filter configured to block light having wavelengths between 690 nm and 840 nm and allow the passage of wavelengths less than 690 nm and greater than 825 nm. The second filter can include an mCherry filter having the properties discussed below in connection with Figures 18-23.
[0107] 18-23 provide examples of potential usage scenarios for handheld devices according to various embodiments of the present disclosure. Referring now to FIG. 18, in this usage scenario, tissue is illuminated with a light source (e.g., one or more LEDs in a handheld device) that provides an excitation light wavelength of 760 nm. The tissue is treated with an IR dye, such as ICG. A filter positioned to filter light entering an imaging device, such as an imaging device, includes a 760 nm notch filter to filter the excitation light from capture by the imaging sensor. The filter has a notch between 675 nm and 825 nm. As can be seen in the chart in FIG. 18, light emitted from the ICG-treated tissue has an emission wavelength of 835 nm and thus passes through the notch filter and is captured by the image sensor, thereby generating an image revealing the ICG-treated tissue.
[0108] 19, tissue is illuminated with a light source having a wavelength of 780 nm. A notch filter with a short pass wavelength of 690 nm and a long pass wavelength of 840 nm is used to filter the light returning to the imaging device. The tissue is treated with an IR dye, such as ICG, and when excited by the 780 nm light source, emits light having a peak intensity wavelength of 835 nm, which passes through the notch filter and is captured by the imaging device, again revealing the ICG-treated tissue in the resulting image.
[0109] 20-23 illustrate an example usage scenario in which a handheld device is used for fluorescence imaging to improve tumor-to-normal contrast. Referring now to FIG. 20, a subject may receive a diagnostic dose of aminolevulinic acid (ALA) to induce PpIX formation in tumor tissue. The tissue is illuminated with a light source having a wavelength of 405 nm. A chroma mCherry filter is used to filter the light captured by the imaging device. As shown in FIG. 20, PpIX emits light having a wavelength of 635 nm within the red transmission band of the mCherry filter, and thus can be captured by the imaging device, revealing the tissue in which PpIX formation has been induced in the resulting image.
[0110] FIGS. 21-23 present examples similar to the example in FIG. 20, in which various modifications are made to the mCherry filter to improve tumor-to-normal contrast. In FIG. 21, the mCherry filter is modified to reduce the green band transmission. The amount of transmission can be reduced, for example, by between about 10% and about 60%, and in the example shown, by about 50%. In FIG. 22, the mCherry filter is modified to broaden the red transmission band to 600-725 nm (from about 600-675 nm shown in FIGS. 20 and 21). In FIG. 23, the mCherry filter is modified to both reduce the green band transmission by 50% and broaden the red band transmission to 725 nm.
[0111] According to embodiments of the present disclosure, changing from the white light and infrared imaging modes discussed in connection with FIGS. 18 and 19 to the fluorescence imaging mode discussed in connection with FIGS. 20-23 can be accomplished by rotating the filter wheel 195 so that the desired filter (e.g., a notch filter or mCherry filter) is placed in front of the imaging device to filter out the light wavelengths returning to the handheld device. The controls of the handheld device, such as a controller, can include a switch, button, etc., to switch the light source from a 760 nm or 780 nm LED to a 405 nm LED or a white LED. Some embodiments of the present disclosure can include a filter wheel 195 such that the desired filter (e.g., a notch filter or mCherry filter) is placed in front of the imaging device to filter out the light wavelengths returning to the handheld device. In some embodiments, the filter wheel can be configured to automatically rotate from one filter to another based on the selected mode of the handheld device, for example, input by a user on a controller.
[0112] The handheld device can be further configured to provide imaging modes in addition to those described above. For example, the handheld device can include a mode in which the image sensor, light source, and filter are configured to provide three-dimensional imaging for topographical mapping of the imaged surface. Additional details regarding the use of three-dimensional imaging can be found in "Systems, Methods, and Devices for Three-Dimensional Imaging, Measurement, and No. 62 / 793,837, entitled "Display of Wounds and Tissue Specimens," the entire contents of which are incorporated herein by reference.
[0113] As another example of an imaging mode, a handheld device can be configured to provide fluorescence lifetime imaging of tissue. Fluorophores, such as PpIX, have fluorescence emission decay profiles that dictate how quickly visible fluorescent light dissipates once the excitation source is removed. Thus, by capturing an image immediately after the excitation source is removed or stopped, different fluorophores can be imaged in isolation by tailoring the image capture time for each unique fluorophore after the excitation source that excited that particular fluorophore is removed. For example, if PpIX and another fluorophore have decay times of 9 ns and 5 ns, respectively, PpIX can be imaged in isolation by capturing an image between 5 and 9 ns after the excitation source is removed. In this manner, fluorescence lifetime imaging can enable the detection of multiple unique fluorophores by their respective fluorescence lifetime signatures based on differences in the exponential decay rates of fluorescence from the fluorophores. Such time-resolved fluorescence imaging can be achieved by pulsing LEDs with different excitation wavelengths and gating the imaging sensor to detect the fluorophore lifetimes of interest. Fluorescence lifetime imaging of tissue can be used to identify and distinguish between healthy and diseased tissues, as well as between different tissue components, including other biological components such as microorganisms and intrinsically fluorescent agents or drugs.
[0114] Other possible imaging modes can include various combinations of white light imaging, infrared imaging, and fluorescence imaging. For example, in one possible imaging mode, both white light and an IR light source are used to illuminate the tissue. An infrared dye, such as ICG, can be excited by the IR light source, and the resulting IR image can be superimposed on the white light image to place the IR image in an anatomical context.
[0115] In another imaging mode, white light illumination is followed by 405 nm light illumination. An imaging filter for WL / IR is used during white light illumination, and an FL filter is used during 405 nm illumination. Sequential white light and fluorescent images can be captured and superimposed to provide anatomical context for tumor location (white light image).
[0116] It will be understood by those skilled in the art having the benefit of this disclosure that the present disclosure provides various exemplary devices, systems, and methods for intraoperative and / or in vitro visualization of tumor and / or residual cancer cells at surgical margins. Further modifications and alternative embodiments of various aspects of the present disclosure will be apparent to those skilled in the art in view of this description.
[0117] Furthermore, the devices and methods may include additional components or steps that are omitted from the figures for clarity of illustration and / or operation. The following description should be construed as merely illustrative and for the purpose of teaching those skilled in the art the general manner of carrying out the present disclosure. It should be understood that the various embodiments shown and described herein are to be construed as illustrative. Elements and materials, and the arrangements of these elements and materials, may be substituted for those illustrated and described herein, parts and processes may be reversed, and certain features of the present disclosure may be utilized independently, all as would become apparent to those skilled in the art after having the benefit of the present description. Changes may be made in the elements described herein without departing from the spirit and scope of the present disclosure and the scope of the following claims, including equivalents thereof.
[0118] It should be understood that the particular examples and embodiments described herein are not limiting, and modifications in construction, dimensions, materials, and methodologies may be made without departing from the scope of the present disclosure.
[0119] Furthermore, the terminology of this description is not intended to limit the present disclosure. For example, spatially relative terms such as "lower," "belower," "lower side," "upper," "top," "bottom," "right," "left," "proximal," "distal," "front," and the like may be used to describe the relationship of one element or feature to another element or feature as illustrated in the figures. It is intended that these spatially relative terms encompass different positions (i.e., locations) and orientations (i.e., rotational orientations) of the device in use or operation in addition to the positions and orientations shown in the figures.
[0120] For purposes of this specification and the appended claims, unless otherwise indicated, all numbers expressing quantities, percentages or proportions, and other numerical values used in the specification and claims should be understood as being modified in all instances, unless already so indicated, by the term "about." Accordingly, unless indicated to the contrary, the numerical parameters set forth in the following specification and appended claims are approximations that may vary depending upon the desired properties sought to be obtained by the present disclosure. At the very least, and not as an attempt to limit the application of the doctrine of equivalents to the scope of the claims, each numerical parameter should at least be construed in light of the number of significant digits conveyed and by applying ordinary rounding techniques.
[0121] Notwithstanding that the numerical ranges and parameters setting forth the broad scope of the present disclosure are approximations, the numerical values set forth in the specific examples are reported as precisely as possible. However, any numerical value inherently contains certain errors necessarily resulting from the standard deviation found in their respective testing measurements. Moreover, all ranges disclosed herein are to be understood to encompass any and all subranges subsumed therein.
[0122] It should be noted that, as used in this specification and the appended claims, the singular forms "a," "an," and "the," as well as any singular use of any word, include plural referents unless the use is clearly and unambiguously limited to one referent. As used herein, the term "comprises" and grammatical variations thereof are intended to be non-limiting, and thus the recitation of items in a specification does not exclude other similar items that may be substituted for or added to the specified items.
[0123] It is to be understood that while the present disclosure has been described in detail with reference to various exemplary embodiments thereof, it is not to be construed as limited to such and is capable of numerous modifications without departing from the broad scope of the appended claims, including equivalents which they encompass.
Claims
1. a body portion configured to be held in a user's hand and an endoscopic portion configured to direct light toward a surgical margin; at least one excitation light source configured to excite autofluorescence emission of tissue cells and fluorescence emission of derived porphyrins in tissue cells of said surgical margin; a white light source configured to illuminate the surgical margin during white light imaging of the surgical margin; An imaging sensor; a first optical filter configured to filter light signals emitted by the surgical margin in response to illumination by excitation light to allow autofluorescence emissions of tissue cells and fluorescence emissions of the derived porphyrins in the tissue cells to pass to the imaging sensor; a second optical filter configured to filter light signals emitted by the surgical margin in response to illumination with white light to allow passage of white light emissions of tissue within the surgical margin to the imaging sensor; 1. An endoscopic imaging device comprising:
2. The imaging device of claim 1 , wherein the first optical filter and the second optical filter are configured to be interleaved to filter optical signals passing through the filters to the imaging sensor.
3. The imaging device of claim 2 , wherein the first optical filter and the second optical filter are disposed on a filter wheel that is rotatable relative to the imaging sensor.
4. The imaging device of claim 3 , wherein the rotatable filter wheel is disposed distal to the imaging sensor.
5. The imaging device according to any one of claims 1 to 4, wherein the excitation light source comprises a first excitation light source and a second excitation light source.
6. 6. The imaging device of claim 5, wherein the first excitation light source is configured to emit excitation light having a wavelength of about 350 nm to about 400 nm, about 400 nm to about 450 nm, about 450 nm to about 500 nm, about 500 nm to about 550 nm, about 550 nm to about 600 nm, about 600 nm to about 650 nm, about 650 nm to about 700 nm, about 700 nm to about 750 nm, about 750 nm to about 800 nm, about 800 nm to about 850 nm, about 850 nm to about 900 nm, and / or combinations thereof.
7. The imaging device of claim 6 , wherein the first excitation light source is configured to emit excitation light having a wavelength of about 400 nm to about 450 nm.
8. The imaging device of claim 7 , wherein the first excitation light source is configured to emit excitation light having a wavelength of about 405 nm±10 nm.
9. 7. The imaging device of claim 6, wherein the second excitation light source is configured to emit excitation light having a wavelength of about 350 nm to about 400 nm, about 400 nm to about 450 nm, about 450 nm to about 500 nm, about 500 nm to about 550 nm, about 550 nm to about 600 nm, about 600 nm to about 650 nm, about 650 nm to about 700 nm, about 700 nm to about 750 nm, about 750 nm to about 800 nm, about 800 nm to about 850 nm, about 850 nm to about 900 nm, and / or combinations thereof.
10. The imaging device of claim 9 , wherein the second excitation light source is configured to emit excitation light having a wavelength of about 750 nm to 800 nm.
11. The imaging device of claim 10 , wherein the second excitation light source is configured to emit excitation light having a wavelength between about 760 nm and about 780 nm.
12. The imaging device of claim 11 , wherein the second excitation light source is configured to emit excitation light having a wavelength of about 760 nm±10 nm.
13. The imaging device of claim 11 , wherein the second excitation light source is configured to emit excitation light having a wavelength of about 770 nm ± 10 nm.
14. The imaging device of claim 11 , wherein the second excitation light source is configured to emit excitation light having a wavelength of about 780 nm ± 10 nm.
15. The imaging device of claim 1 , wherein the first optical filter is configured to allow passage of optical signals having wavelengths from about 500 nm to about 550 nm and / or from about 600 nm to about 675 nm.
16. The imaging device of claim 1 , wherein the first optical filter is configured to allow passage of optical signals having wavelengths from about 500 nm to about 550 nm and / or from about 600 nm to about 725 nm.
17. The imaging device of claim 1 , wherein the first optical filter is configured to allow passage of an optical signal having a wavelength of about 635 nm.
18. 18. The imaging device of claim 16 or claim 17, wherein the first optical filter is configured to attenuate the passage of optical signals having wavelengths from about 500 nm to about 550 nm by about 10% and about 90%.
19. The imaging device of claim 1 , wherein the second optical filter is configured to allow passage of optical signals having wavelengths below about 675 nm and above about 825 nm.
20. The imaging device of claim 1 , wherein the second optical filter is configured to allow passage of optical signals having wavelengths below about 690 nm and above about 840 nm.
21. 21. The imaging device of claim 19 or claim 20, wherein the second optical filter is configured to allow passage of an optical signal having a wavelength of about 835 nm.
22. The imaging device according to any one of claims 1 to 21, wherein the imaging sensor comprises a complementary metal oxide semiconductor (CMOS) sensor.
23. The imaging device of any one of claims 1 to 22, further comprising a sterile drape configured to form a sterile barrier between the imaging device and an environment in which the imaging device is used.
24. 24. The imaging device of claim 23, wherein the sterile drape includes a first portion configured to form a sterile barrier between the imaging device and the environment in which the imaging device is used and a second portion configured to shield a surgical cavity from ambient light.
25. 25. The imaging device of claim 23 or claim 24, wherein the sterile drape includes an optically transparent lens cap positioned over the imaging sensor when the sterile drape is placed over the imaging device.
26. The imaging device of claim 25 , wherein the lens cap is configured to engage a feature at the second end of the device.
27. The imaging device of claim 26 , wherein the feature at the second end of the device includes a circumferential groove.
28. The endoscopic imaging device according to any one of claims 1 to 22; a sterile drape configured to surround a body of the imaging device; 1. An endoscopic imaging system comprising:
29. 30. The endoscopic imaging system of claim 28, wherein the sterile drape includes a lens configured to connect to an endoscopic portion of the imaging device and be positioned in front of the imaging sensor.
30. 30. The endoscopic imaging system of claim 28 or claim 29, wherein the sterile drape includes a portion configured to provide access to a connection port in a body of the imaging device.
31. An endoscopic imaging system according to any one of claims 28 to 30, further comprising a connection cable configured to be received in a connection port of a body of the imaging device and provide communication between the imaging device and an external device.
32. The endoscopic imaging system of claim 31 , wherein the connecting cable includes strain relief features configured to keep the cable out of a surgical field during use of the system.
33. The endoscopic imaging system of claim 32 , wherein the strain relief feature comprises a shaped bend in the cable.
34. 34. The endoscopic imaging system of claim 33, wherein the shaped bend forms an angle between about 70 degrees and about 110 degrees.
35. 34. The endoscopic imaging system of claim 33, wherein the shaped bend forms an angle of approximately 90 degrees.
36. The endoscopic imaging system of claim 31 , wherein the connection cable and the connection port include complementary features configured to prevent rotation of the connection cable and the connection port relative to one another.
37. The endoscopic imaging system of claim 31 , wherein the connection cable includes a retaining ring configured to engage a portion of the connection port.
38. The endoscopic imaging system of any one of claims 31 to 37, further comprising a sterile sheath configured to cover the connecting cable to shield the connecting cable from a surgical field.
39. to reduce or eliminate ambient light during imaging of a target by the endoscopic imaging device; The endoscopic imaging system of any one of claims 28 to 38, further comprising a configured darkening drape.
40. The endoscopic imaging system of any one of claims 37 to 39, wherein the darkening drape includes a portion configured to hold the darkening drape out of a field of view of the imaging device.
41. The endoscopic imaging system of any one of claims 28 to 40, further comprising a docking station configured to support the endoscopic imaging device.
42. 42. The endoscopic imaging system of claim 41, wherein the docking station is configured to wirelessly charge the endoscopic imaging device.
43. 43. The endoscopic imaging system of claim 41 or claim 42, wherein the docking station includes features configured to maintain the endoscopic imaging device in contact with the docking station.
44. 44. The endoscopic imaging system of claim 43, wherein the feature configured to maintain the endoscopic imaging device in contact with the docking station is a retaining loop configured to receive the endoscopic portion of the imaging device.
45. 1. A method of imaging tissue at a surgical site, comprising: illuminating the tissue at the surgical site with a first excitation light source configured to emit excitation light having a first wavelength; receiving an optical signal emitted by the tissue at the surgical site through a first optical filter within an endoscope optical housing of an imaging device; illuminating the tissue at the surgical site with a second excitation light source configured to emit excitation light having a second wavelength; receiving an optical signal emitted by the tissue at the surgical site through a second optical filter within the endoscope optical housing of the imaging device; The method includes:
46. moving the first optical filter away from a position between the tissue at the surgical site and the imaging device; moving the second optical filter to a position between the tissue at the surgical site and the imaging device; 46. The method of claim 45, further comprising:
47. 47. The method of claim 45 or claim 46, wherein illuminating the tissue at the surgical site with a first excitation light source configured to emit excitation light having a first wavelength comprises illuminating the tissue with a first excitation light source having a wavelength of about 405 nm ± 10 nm.
48. 48. The method of any one of claims 45 to 47, wherein illuminating the tissue at the surgical site with a second excitation light source configured to emit excitation light having a second wavelength comprises illuminating the tissue with a second excitation light source having a wavelength of about 750 nm to 800 nm.
49. Receiving an optical signal emitted by the tissue at the surgical site through a first optical filter includes filtering an optical signal from about 500 nm to about 550 nm and / or from about 600 nm to about 675 nm.
49. A method according to any one of claims 45 to 48, comprising filtering optical signals emitted by the tissue through a filter that allows the passage of optical signals having a wavelength of m.
50. 50. The method of any one of claims 45 to 49, wherein receiving optical signals emitted by the tissue at the surgical site through a first optical filter comprises filtering optical signals emitted by the tissue through a filter that allows the passage of optical signals having wavelengths from about 500 nm to about 550 nm and / or from about 600 nm to about 725 nm.
51. 51. The method of any one of claims 45 to 50, wherein receiving optical signals emitted by the tissue at the surgical site through a second optical filter comprises filtering optical signals emitted by the tissue through a filter that allows passage of optical signals having wavelengths below about 675 nm and above about 825 nm.
52. 52. The method of any one of claims 45-51, wherein receiving optical signals emitted by the tissue at the surgical site through a second optical filter comprises filtering optical signals emitted by the tissue through a filter that allows passage of optical signals having wavelengths below about 690 nm and above about 840 nm.
53. The method of any one of claims 45 to 52, further comprising placing a sterile drape around the imaging device prior to illuminating the tissue at the surgical site.
54. 54. The method of claim 53, wherein placing the sterile drape around the imaging device includes placing a lens on the endoscopic portion of the imaging device.
55. 55. The method of any one of claims 45 to 54, further comprising reducing or eliminating ambient light at the surgical site.
56. 56. The method of claim 55, wherein reducing or eliminating ambient light at the surgical site comprises placing a darkening drape over or around the surgical site connected to the imaging device.
57. 57. The method of claim 56, wherein placing a darkening drape connected to the imaging device over or around the surgical site comprises positioning the darkening drape such that the surgical site is visible by a portion of the imaging device disposed within an interior of the darkening drape.
58. 46. The method of claim 45, further comprising connecting the imaging device to a connecting cable.
59. 60. The method of claim 58, further comprising transferring data from the imaging device to a computer via the connecting cable.
60. The method of any one of claims 45 to 59, wherein the surgical site is a breast cancer surgical site.
61. The method according to any one of claims 45 to 60, wherein the surgical site is a surgical margin of a surgical site from which a tissue specimen has been removed.
62. at least one excitation light source configured to emit excitation light during fluorescence imaging; a first filter configured to detect an optical signal having a wavelength corresponding to one or more of bacterial fluorescence, bacterial autofluorescence, tissue fluorescence, and tissue autofluorescence in response to illumination of a target surface with the excitation light and to enable passage thereof to an image sensor disposed within an endoscopic portion of the system; a white light source configured to emit white light during white light imaging; a second filter configured to detect light signals having wavelengths within the visible light range in response to illumination of the target surface with the white light and to enable passage thereof to the image sensor located within the endoscopic portion of the system; and a processor configured to receive the detected fluorescent light signal and the white light light signal and to output to a display a representation of the target surface based on the detected light signals; 1. A portable, handheld endoscopic imaging system comprising:
63. 63. The system of claim 62, wherein the at least one excitation light source is configured to emit excitation light having a wavelength of about 350 nm to about 400 nm, about 400 nm to about 450 nm, about 450 nm to about 500 nm, about 500 nm to about 550 nm, about 550 nm to about 600 nm, about 600 nm to about 650 nm, about 650 nm to about 700 nm, about 700 nm to about 750 nm, about 750 nm to about 800 nm, about 800 nm to about 850 nm, about 850 nm to about 900 nm, and / or combinations thereof.
64. 64. The system of claim 63, wherein the at least one excitation light source is configured to emit excitation light having a wavelength of about 400 nm to about 450 nm.
65. 65. The system of claim 64, wherein the at least one excitation light source is configured to emit excitation light having a wavelength of about 405 nm ± 10 nm.
66. 63. The system of claim 62, wherein the first filter is configured to allow optical signals having a wavelength between about 500 nm and about 550 nm and / or optical signals having a wavelength between about 600 nm and about 660 nm to pass through the first filter to the image sensor.
67. 63. The system of claim 62, wherein the at least one excitation light source includes first and second violet / blue LEDs, each LED configured to emit light having a wavelength of 405 nm ± 10 nm.
68. 63. The system of claim 62, further comprising a thermal sensor configured to detect thermal information about the target surface.
69. 63. The system of claim 62, further comprising an ambient light sensor configured to indicate when ambient lighting conditions are sufficient to enable fluorescent imaging.
70. 63. The system of claim 62, further comprising a rangefinder.
71. 63. The system of claim 62, further comprising a third filter configured to detect light signals having wavelengths within the visible light range in response to illumination of the target surface with the white light and enable their passage to the image sensor located within the endoscopic portion of the system.
72. The processor receives data from the infrared sensor and outputs a three-dimensional image.
72. The system of claim 71 further comprising:
73. 63. The system of claim 62, further comprising a Wi-Fi and / or Bluetooth antenna.
74. 63. The system of claim 62, wherein the processor is configured to wirelessly transmit and / or receive data.
75. 63. The system of claim 62, further comprising a power source.
76. 63. The system of claim 62, further comprising an infrared radiation source.
77. 77. The system of claim 76, wherein the system is configured to project infrared radiation onto the target surface and detect infrared radiation reflected from the target surface.
78. 80. The system of claim 77, wherein the processor is further configured to generate a three-dimensional map of the target surface based on the detected reflected infrared radiation.
79. 80. The system of claim 78, wherein the processor is further configured to generate a three-dimensional fluorescence image of the target surface based on the three-dimensional map, a two-dimensional white light image of the target surface, and a two-dimensional fluorescence image of the target surface.
80. 1. An endoscope housing portion, comprising: at least one excitation light source configured to emit excitation light during fluorescence imaging; a first filter configured to detect and enable passage of an optical signal having a wavelength corresponding to one or more of bacterial fluorescence, bacterial autofluorescence, tissue fluorescence, and tissue autofluorescence in response to illumination of the target surface with the excitation light to an image sensor; a white light source configured to emit white light during white light imaging; a second filter configured to detect and enable passage of light signals having wavelengths within the visible light range to the image sensor in response to illumination of the target surface with the white light; a base body portion configured to releasably receive the endoscope housing portion, A display and a base body portion including: a processor configured to receive the detected fluorescent light signal and the white light light signal and to output a representation of the target surface to the display based on the detected light signals; A portable modular endoscopic handheld imaging system comprising:
81. 81. The system of claim 80, wherein the at least one excitation light source is configured to emit excitation light having a wavelength of about 350 nm to about 400 nm, about 400 nm to about 450 nm, about 450 nm to about 500 nm, about 500 nm to about 550 nm, about 550 nm to about 600 nm, about 600 nm to about 650 nm, about 650 nm to about 700 nm, about 700 nm to about 750 nm, about 750 nm to about 800 nm, about 800 nm to about 850 nm, about 850 nm to about 900 nm, and / or combinations thereof.
82. 82. The system of claim 81, wherein the at least one excitation light source is configured to emit excitation light having a wavelength of about 400 nm to about 450 nm.
83. The at least one excitation light source emits excitation light having a wavelength of about 405 nm±10 nm.
83. The system of claim 82, configured to output.
84. 81. The system of claim 80, wherein the first filter is further configured to block the passage of optical signals having a wavelength of 405 nm ± 10 nm.
85. 81. The system of claim 80, wherein the first filter is configured to allow optical signals having a wavelength between about 500 nm and about 550 nm and / or optical signals having a wavelength between about 600 nm and about 660 nm to pass through the first filter to the image sensor.
86. 81. The system of claim 80, wherein the at least one excitation light source includes first and second purple / blue LEDs, each LED configured to emit light having a wavelength of 405 nm ± 10 nm.
87. 81. The system of claim 80, wherein the base body portion further comprises a power source.
88. 88. The system of claim 87, wherein the base body portion further includes an exterior surface with contacts for charging the power source.
89. 81. The system of claim 80, wherein the base body portion further comprises a heat sink.
90. 90. The system of claim 89, wherein the heat sink defines an opening in the base body portion configured to releasably receive the endoscope housing portion.
91. 81. The system of claim 80, wherein the endoscope housing portion further comprises a thermal sensor configured to detect thermal information about the target surface.
92. 81. The system of claim 80, wherein the endoscope housing portion further comprises an ambient light sensor configured to indicate when ambient lighting conditions are sufficient to enable fluorescence imaging.
93. 81. The system of claim 80, wherein the endoscope housing portion further comprises a rangefinder.
94. 81. The system of claim 80, wherein the endoscope housing portion further comprises a polarizing filter.
95. 81. The system of claim 80, further comprising a sterile drape configured to enclose one or both of the endoscope housing portion and the base body portion.
96. 81. The system of claim 80, further comprising a darkening drape attached to the endoscope housing portion and configured to reduce or eliminate ambient light during imaging of a target by the handheld imaging system.
97. 81. The system of claim 80, further comprising a docking station configured to receive the handheld imaging system.
98. 81. The system of claim 80, further comprising a connecting cable configured to operably couple with the handheld imaging system.
99. 1. A first endoscope optical head, comprising: at least one excitation light source configured to emit excitation light during fluorescence imaging; a fluorescence imaging filter configured to allow passage through the fluorescence imaging filter of optical signals having wavelengths corresponding to one or more of bacterial fluorescence, bacterial autofluorescence, tissue fluorescence, and tissue autofluorescence in response to illumination of the target surface with the excitation light; a fluorescent imaging sensor configured to detect the filtered fluorescent light signal; and a second endoscope optical head, at least one white light source configured to emit white light during white light imaging; a white light imaging sensor configured to detect a white light optical signal in response to illumination of the target surface with the white light; and a base body portion configured to releasably receive each of the first and second endoscope optical heads, one at a time; A display and a processor configured to receive the detected fluorescent light signal and / or the white light light signal and output a representation of the target surface to the display based on the detected light signal; A portable modular endoscopic handheld imaging system comprising:
100. and a third endoscope optical head, the third endoscope optical head comprising: at least one excitation light source configured to emit excitation light during infrared imaging; an infrared imaging filter configured to allow passage of optical signals corresponding to biological structures including lymph nodes, blood vessels, lymphatic pathways, and circulatory system elements in response to illumination of a target surface with the excitation light; an infrared imaging sensor configured to detect the filtered infrared light signal.
101. 101. The system of claim 99 or 100, wherein the at least one excitation light source of the first endoscope optical head is configured to emit excitation light having a wavelength of about 350 nm to about 400 nm, about 400 nm to about 450 nm, about 450 nm to about 500 nm, about 500 nm to about 550 nm, about 550 nm to about 600 nm, about 600 nm to about 650 nm, about 650 nm to about 700 nm, about 700 nm to about 750 nm, about 750 nm to about 800 nm, about 800 nm to about 850 nm, about 850 nm to about 900 nm, and / or combinations thereof.
102. 102. The system of claim 101, wherein the at least one excitation light source of the first endoscope optical head is configured to emit excitation light having a wavelength of about 400 nm to about 450 nm.
103. 103. The system of claim 102, wherein the at least one excitation light source of the first optical head is configured to emit excitation light having a wavelength of approximately 405 nm ± 10 nm.
104. 104. A system according to any one of claims 99 to 103, wherein the fluorescence imaging filter is further configured to block the passage of optical signals having a wavelength of 405 nm ± 10 nm.
105. 105. The system of any one of claims 99 to 104, wherein the fluorescence imaging filter is configured to allow optical signals having a wavelength between about 500 nm and about 550 nm and / or optical signals having a wavelength between about 600 nm and about 660 nm to pass through the fluorescence filter to the fluorescence imaging optical sensor.
106. The at least one excitation light source of the first endoscope optical head includes first and second ultraviolet 106. A system according to any one of claims 99 to 105, comprising colour / blue LEDs, each LED configured to emit light having a wavelength of 405nm±10nm.
107. The system of any one of claims 99 to 106, wherein the base body portion further comprises a power source.
108. A system according to any one of claims 99 to 107, wherein the base body portion further comprises an exterior surface having contacts for charging the power source.
109. The system of any one of claims 99 to 108, wherein the base body portion further comprises a heat sink.
110. 110. The system of claim 109, wherein the heat sink defines an opening in the base body portion configured to releasably receive an individual one of the endoscope optical heads.
111. The system of any one of claims 100 to 110, wherein one or more of the first, second and third endoscopic optical heads further include a thermal sensor configured to detect thermal information about the target surface.
112. A system according to any one of claims 100 to 111, wherein the first endoscope optical head further comprises an ambient light sensor configured to indicate when ambient lighting conditions are sufficient to enable fluorescence imaging.
113. The system of any one of claims 100 to 112, wherein one or more of the first, second and third endoscope optical heads further include a rangefinder.
114. A system according to any one of claims 100 to 113, wherein one or more of the first, second and third endoscope optical heads further comprise a polarising filter.
115. A system according to any one of claims 99 to 114, further comprising an infrared radiation source.
116. 116. The system of claim 115, wherein the system is configured to project infrared radiation onto the target surface and detect infrared radiation reflected from the target surface.
117. 81. The system of claim 80, wherein the processor is further configured to generate a three-dimensional map of the target surface based on the detected reflected infrared radiation.
118. 118. The system of claim 117, wherein the processor is further configured to generate a three-dimensional fluorescence image of the target surface based on the three-dimensional map, a two-dimensional white light image of the target surface, and a two-dimensional fluorescence image of the target surface.
119. 100. The system of claim 99, further comprising a docking station configured to receive the handheld imaging system.
120. 100. The system of claim 99, further comprising a connecting cable configured to operably couple the handheld imaging system to a computer.
121. 100. The system of claim 99, further comprising a sterile drape configured to enclose the handheld imaging system.
122. 100. The system of claim 99, wherein the endoscope housing portion further comprises a rangefinder.
123. 100. The system of claim 99, wherein the endoscope housing portion further comprises a polarizing filter.
Citation Information
Patent Citations
Fluorescence observing endoscope device
JP1996224208A
Fluorescent endoscope device
JP1998151104A
Endoscope and endoscope system
JP2005124776A
Sentinel lymph node detection system
JP2006340796A
Device for testing bladder cancer and control method of the device
JP2009045148A
Cited By
Devices, systems, and methods for tumor visualization and removal
US12575735B2
Modular handheld imaging device
USD1117133S
