Surgical navigation system and method for coaxially realizing near-infrared two-region imaging and visible light projection
By designing a coaxial near-infrared two-zone imaging and visible light projection light path in the surgical navigation system, and combining computer deformation processing, the problem of inaccurate near-infrared image projection is solved, achieving high accuracy of surgical navigation and flexibility of visible light projection sex.
Patent Information
- Application Number
- CN202410961210.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-17
- Publication Date
- 2024-11-12
AI Technical Summary
In the prior art, it is difficult to accurately project the near-infrared second-zone fluorescent images to the captured lesion site, resulting in the problem of inaccurate position recognition in complex operations.
By designing the imaging module and deformation processing module, the coaxial of the near-infrared two-zone imaging and visible light projection light path is realized, and aberration is eliminated using spectroscopic devices and visible to near-infrared urge films. Combined with computer deformation processing, we ensure in-situ projection of near-infrared images. .
Real-time in-situ projection of near-infrared second-zone fluorescent images is achieved, which improves the accuracy of lesion position recognition and the reliability of surgical navigation, and solves the projection error caused by parallax and distortion differences.
Smart Images

Figure CN118924424A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of biomedical imaging equipment, and in particular to a surgical navigation system and method for coaxially realizing near-infrared two-zone imaging and visible light projection. Background Art
[0002] In modern surgery, intraoperative navigation technology plays an increasingly important role. Traditional navigation methods usually use visible (400-700nm) and near-infrared zone I (700-900nm) bands, but the penetration ability of photons in this band in biological tissues is limited, and it is impossible to obtain clear images of deep tissues, so it is difficult to meet the needs of some complex operations. In recent years, near-infrared zone II (900-1880nm) fluorescence imaging technology has gradually become a research hotspot in the field of surgical navigation. Near-infrared zone II fluorescence imaging technology uses excitation light of a specific wavelength to illuminate biological tissues, excite fluorescent substances in the tissues to emit near-infrared zone II fluorescence, and captures fluorescence signals through near-infrared cameras to form fluorescence images, thereby realizing non-invasive imaging of deep tissues. Compared with visible and near-infrared zones I, near-infrared zone II fluorescence bioimaging can achieve greater penetration depth, higher signal-to-background ratio, clearer imaging effects, and stronger lesion recognition capabilities.
[0003] At present, there is a patent (CN113974832A) that proposes a near-infrared fluorescence surgical navigation method with a projection navigation function. By projecting a near-infrared second-zone fluorescence image onto the observation target, navigation surgery can be achieved without frequent observation of the display screen. However, similar to the phenomenon of parallax when observing the same target from different spatial positions, imaging and projecting from different spatial positions will also cause the projected image and the real object to not completely coincide (because the cause is that the lenses are not coaxial, the present invention also refers to it as parallax). This patent does not take into account the parallax caused by the non-coaxiality of the imaging and projection optical paths and the problem that "in-situ projection" cannot be achieved due to the difference in distortion between the two lenses. Since the actual surgical object is often not a flat surface morphology, it is difficult to completely correct the parallax effect through software, so the imaging and projection optical paths need to be coaxial; in addition, it is necessary to control the distortion difference between imaging and projection during optical design, or compensate for the influence of the distortion difference in the image processing program to ensure the in-situ projection effect. Summary of the invention
[0004] The purpose of the present invention is to provide a surgical navigation system and method for coaxially realizing near-infrared two-zone imaging and visible light projection in view of the deficiencies of the prior art. The present invention aims to solve the problem in the prior art that the near-infrared two-zone fluorescence image of the lesion site is difficult to accurately project to the photographed lesion site. The present invention can effectively improve the in-situ projection effect. It can be used in navigation surgery for removing sentinel lymph nodes, for example.
[0005] The object of the present invention is achieved through the following technical solution: a surgical navigation system for coaxially realizing near-infrared two-zone imaging and visible light projection, the system comprising an imaging module and a deformation processing module:
[0006] The imaging module is used to simultaneously realize near-infrared second-zone imaging and visible light projection of the observed object, and the near-infrared second-zone imaging and visible light projection optical paths are coaxial, and the distortion of the two paths is consistent;
[0007] The deformation processing module is used to deform the near-infrared image when the distortion is inconsistent, obtain a black and white checkerboard pattern that is visible to both visible light and near-infrared, use a visible light camera to shoot the black and white checkerboard pattern, and shoot the checkerboard pattern after visible light projection based on the imaging module, extract corner points respectively, obtain a one-to-one correspondence between the corner points of the two patterns, obtain a one-to-one mapping relationship for each point through interpolation, deform the near-infrared image, and eliminate the distortion difference.
[0008] Furthermore, the imaging module includes an imaging lens, a near-infrared camera, a liquid crystal display module and an excitation light source; the excitation light source emits excitation light to illuminate the observed object, the imaging lens receives the near-infrared fluorescence signal of the observed object, and simultaneously realizes near-infrared second-zone imaging and visible light projection, the near-infrared camera captures the near-infrared second-zone fluorescence image, and displays it in real time on the liquid crystal display module after image processing.
[0009] Furthermore, the visible light image of the liquid crystal display module is located on the focal plane of the visible light path of the imaging lens, and is projected in situ onto the observed object by the imaging lens, thereby realizing fluorescence navigation of surgical operations.
[0010] Furthermore, the imaging lens is composed of a focusing lens group, a spectrometer, a visible light projection lens group and a near-infrared imaging lens group. The spectrometer can transmit / reflect near-infrared light signals and reflect / transmit visible light. The focusing lens group is shared by visible light projection and near-infrared imaging and is coated with a visible light to near-infrared anti-reflection film to eliminate aberrations. The visible light projection lens group and the near-infrared imaging lens group further correct the aberrations of the visible light projection optical path and the near-infrared imaging optical path, respectively.
[0011] Furthermore, the imaging lens is composed of a spectrometer, a visible light lens and a near-infrared lens. The spectrometer can transmit / reflect near-infrared light signals and reflect / transmit visible light, and simultaneously adjust the visible light projection lens and the near-infrared imaging lens to perform linked focusing, so that the detection surfaces of the visible light camera and the near-infrared camera can always remain conjugate to the same object plane.
[0012] Furthermore, the spectroscopic device makes the optical axis of the visible light projection optical path and the optical axis of the near-infrared light imaging optical path coaxial in the space where the observed object is located, thereby achieving imaging and projection without viewing angle difference.
[0013] Furthermore, a long-pass filter is added to the near-infrared light path to screen the second near-infrared band based on the imaging effect.
[0014] Furthermore, a deformation processing module is deployed on a computer for deforming the near-infrared image. The computer can also adjust the position, size, and angle parameters of the near-infrared zone II fluorescence image to ensure the conjugation of the image on the near-infrared camera detection surface and the liquid crystal display module to ensure in-situ projection.
[0015] On the other hand, the present invention also provides a surgical navigation method for coaxially realizing near-infrared two-zone imaging and visible light projection, the method comprising the following steps:
[0016] (1) Perform near-infrared second-zone imaging and visible light projection on the observed object simultaneously, with the near-infrared second-zone imaging and visible light projection optical paths being coaxial;
[0017] (2) Determine whether there is a distortion difference between the near-infrared second-zone imaging and the visible light projection; if so, execute step (3); if not, directly execute step (6);
[0018] (3) Printing a black and white checkerboard pattern by illuminating with a halogen lamp containing near-infrared zone II components;
[0019] (4) obtaining a black and white checkerboard pattern visible in both visible light and near infrared, photographing the black and white checkerboard pattern using a visible light camera, and photographing the checkerboard pattern after visible light projection based on an imaging module;
[0020] (5) extracting corner points respectively to obtain a one-to-one correspondence between the corner points of the two patterns, applying interpolation to obtain a one-to-one mapping relationship between each point of the two patterns; applying the mapping relationship to deform the near-infrared image to eliminate the distortion difference;
[0021] (6) The image is processed by a computer and then displayed in real time on a liquid crystal display module; the visible light image of the liquid crystal display module is located on the focal plane of the visible light projection optical path and is projected in situ onto the observed object, thereby realizing fluorescent navigation of the surgery.
[0022] Beneficial effects of the present invention:
[0023] 1. The present invention realizes the real-time in-situ projection of the near-infrared zone II fluorescence image of the lesion site onto the photographed lesion site, which solves the problem that it is inconvenient for the human eye to observe the near-infrared zone II fluorescence image on the screen, and can help the user obtain the location information of the lesion more accurately, and has great potential for use in scientific research and clinical medicine.
[0024] 2. The coaxial design of visible light projection and near-infrared imaging can realize flexible adjustment of imaging distance and eliminate projection position error caused by parallax, so that the near-infrared zone II fluorescence image can be projected to the lesion site accurately and completely in real time.
[0025] 3. When designing the lens, the distortion difference between visible light and near-infrared light is controlled, or the image is corrected through software to compensate for the influence of the optical distortion difference between the visible light path and the near-infrared light path, further ensuring that the near-infrared second zone fluorescence image can be projected in situ. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art.
[0027] Figure 1 The system structure diagram of the present invention is
[0028] Figure 2 In order to realize the specific application of the imaging navigation system for coaxial near-infrared zone II imaging and visible light projection in academic research, the mouse intestinal segment is marked in the figure, and the in situ projection of the near-infrared zone II image of the mouse intestinal segment is realized through the system. DETAILED DESCRIPTION
[0029] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.
[0030] like Figure 1 As shown, the present invention provides a surgical navigation system for coaxially realizing near-infrared two-zone imaging and visible light projection, specifically comprising:
[0031] The imaging lens 1, which is used as both a near-infrared imaging lens and a visible light projection lens, is mainly composed of a focusing lens group, a spectrometer 2, a visible light projection lens group, a near-infrared imaging lens group, and a filter. The focusing lens group is shared by visible light projection and near-infrared imaging, and is coated with a visible light to near-infrared anti-reflection film, and aberrations are eliminated as much as possible. The visible light projection lens group and the near-infrared imaging lens group further correct the aberrations of the visible light projection optical path and the near-infrared imaging optical path, respectively. During the design, through optimization, when imaging objects with different vertical axis heights, the vertical axis heights of the images of the two paths of near-infrared imaging and visible light projection are controlled to be as consistent as possible. The built-in spectrometer 2 of the imaging lens is a short-reflection long-pass spectrometer prism or a dichroic mirror, which can transmit near-infrared second-zone light signals (>900nm) and reflect visible light (400-700nm), so that the optical axis of the visible light projection optical path and the optical axis of the near-infrared light imaging optical path are coaxial in the space where the observed object is located, so as to achieve the effect of imaging and projection without viewing angle difference.
[0032] A 900nm long-pass filter or even a longer wavelength long-pass filter can be added to the near-infrared optical path to screen out the near-infrared second-zone band with good imaging effect. The filter can preferably be a 1000nm long-pass filter or a 1100nm long-pass filter.
[0033] The imaging lens can also be composed of a spectroscopic device, a visible light lens, a near-infrared lens and a filter. When using this solution, if the distance of the observed target changes, it is necessary to adjust the visible light projection lens and the near-infrared imaging lens at the same time. For convenience and practicality, it is necessary to add a linkage focusing device for the visible light lens and the near-infrared lens so that the detection surfaces of the visible light camera and the near-infrared camera can always remain conjugate to the same object surface. When designing the lens, the distortion of the visible light lens and the near-infrared lens is made as consistent as possible, that is, both lenses are regarded as imaging lenses. Through optimization, when imaging objects with different vertical axis heights, the vertical axis heights of the images of the two lenses are as consistent as possible; if they cannot be consistent, the feedback of the focus position can be increased, and according to different focus positions, the near-infrared image is deformed differently in the software, and then transmitted to the liquid crystal display module for display, so that the near-infrared light emitting position and the visible light projection position on the observed object can be accurately overlapped without being affected by the distortion difference of the visible light and near-infrared light paths of the lens. The deformation processing can be performed through the following steps: using a halogen lamp (containing near-infrared zone II components) to illuminate the printed black and white checkerboard pattern, using the system to image the checkerboard, and projecting the checkerboard pattern back. When there is a distortion difference, the projected pattern and the printed pattern cannot overlap well; using a visible light camera to photograph the original printed checkerboard pattern, and photograph the checkerboard pattern after visible light projection, extracting corner points respectively, and obtaining a one-to-one correspondence between the corner points of the two patterns; applying interpolation to obtain a one-to-one mapping relationship between each point of the projected image and the printed image; applying this mapping relationship, the near-infrared image can be deformed to eliminate the influence of the distortion difference.
[0034] The near-infrared camera 3 is used to capture the near-infrared second-zone fluorescence image. The detector of the near-infrared camera is an indium gallium arsenide detector, a mercury cadmium telluride detector or a silicon-based detector.
[0035] The computer 4 is used to process the image data captured by the near-infrared camera 3 and control the display of the liquid crystal display module 6. The computer adjusts the position, size, angle and other parameters of the near-infrared zone II fluorescence image to ensure the conjugation of the image on the camera detection surface and the liquid crystal display module to ensure the in-situ projection; it also adjusts the contrast and color scale to increase the brightness of the key area to ensure that it is clearly visible to the naked eye. The computer can be a complete independent computer that provides an operation interface for users to monitor the fluorescence image and adjust the parameters of image processing; it can also be composed of embedded devices such as DSP, FPGA and MCU to form an image processing unit as an onboard computer.
[0036] The display screen 5 displays the operation interface of the computer 4, is used to monitor the fluorescent image and the projected image, and provides a human-computer interaction interface for changing relevant image processing parameters.
[0037] The liquid crystal display module 6 is used to display visible light images. The liquid crystal display module includes a visible light source, a polarizer, a liquid crystal display screen, an analyzer and a corresponding liquid crystal display driving circuit. The visible light source becomes polarized light after passing through the polarizer, then changes the polarization direction through the liquid crystal display screen, and finally passes through the analyzer, wherein the liquid crystal display screen can be transmissive or reflective. The display area of the liquid crystal display module is larger than the detection surface of the near-infrared camera, and its pixel size is smaller than the pixel size of the near-infrared camera to ensure full utilization of the image information obtained by the near-infrared camera. The liquid crystal display module can use a green monochromatic light LED as a light source, and can achieve a projection that is clearly visible to the naked eye on most biological tissues. The liquid crystal display module can also use a red monochromatic light LED as a light source, and can achieve a projection that is clearly visible to the naked eye on dark tissues.
[0038] The excitation light source 7 is used to emit excitation light to illuminate the observed object. The peak wavelength of the excitation light source used is between 700-900nm, preferably a laser light source of 793nm or 808nm, or an LED light source of about 800nm. The light source can be equipped with a bandpass filter to optimize monochromaticity.
[0039] In the present invention, in the space where the observed object is located, the near-infrared zone II imaging and the visible light projection optical path are coaxial, and there is no parallax caused by the separation of imaging and projection lenses; the observed object is placed under the system, and the excitation light source 7 emits excitation light to illuminate the observed object, and the part of the observed object containing fluorescent dye emits a near-infrared zone II fluorescence signal, the imaging lens 1 collects the light signal and forms an image, the near-infrared camera 3 captures the near-infrared zone II fluorescence image, and the computer 4 performs image processing, and then displays it in real time on the liquid crystal display module 6. The visible light image of the liquid crystal display module 6 is located on the focal plane of the visible light path of the imaging lens 1, and is projected in situ by the lens 1 to the observed object, thereby realizing the fluorescence navigation of the operation.
[0040] Corresponding to the aforementioned embodiment of a surgical navigation system for coaxially realizing near-infrared two-zone imaging and visible light projection, on the other hand, the present invention further provides a surgical navigation method for coaxially realizing near-infrared two-zone imaging and visible light projection. For each step of the method, please refer to the specific implementation process of the aforementioned embodiment of the surgical navigation system, which specifically includes the following steps:
[0041] (1) Perform near-infrared second-zone imaging and visible light projection on the observed object simultaneously, with the near-infrared second-zone imaging and visible light projection optical paths being coaxial;
[0042] (2) Determine whether there is a distortion difference between the near-infrared second-zone imaging and the visible light projection; if so, execute step (3); if not, directly execute step (6);
[0043] (3) Printing a black and white checkerboard pattern by illuminating with a halogen lamp containing near-infrared zone II components;
[0044] (4) obtaining a black and white checkerboard pattern visible in both visible light and near infrared, photographing the black and white checkerboard pattern using a visible light camera, and photographing the checkerboard pattern after visible light projection based on an imaging module;
[0045] (5) extracting corner points respectively to obtain a one-to-one correspondence between the corner points of the two patterns, applying interpolation to obtain a one-to-one mapping relationship between each point of the two patterns; applying the mapping relationship to deform the near-infrared image to eliminate the distortion difference;
[0046] (6) The image is processed by a computer and then displayed in real time on a liquid crystal display module; the visible light image of the liquid crystal display module is located on the focal plane of the visible light projection optical path and is projected in situ onto the observed object, thereby realizing fluorescent navigation of the surgery.
[0047] Embodiment 1:
[0048] The mice were intra-intestinally injected with an aqueous solution of fluorescent contrast agent, indocyanine green (ICG, FDA-approved, with a fluorescence center wavelength of 810 nm, but fluorescence tailing above 1100 nm can still be used for clear near-infrared zone II imaging) 10 minutes before the examination. During imaging, the mice were placed in a suitable position under the imaging lens 1 and irradiated with 808 nm excitation light. After the near-infrared zone II fluorescence was collected by the imaging lens 1, it passed through the short-reflection and long-pass beam splitter prism 2 embedded in the imaging lens and entered the near-infrared zone II channel. It was then filtered through a 1100 nm long-pass filter (FELH1100, Thorlabs, USA), and finally captured by a near-infrared camera 3. The computer 4 performed operations such as size and position adjustment, color scale stretching, adaptive threshold segmentation, background pixel extraction, and background grayscale zeroing on the image. The processed image was displayed on the computer display 5 and the liquid crystal display of the liquid crystal display module 6. The image on the latter was projected onto the surface of the mouse intestine through the visible light path of the imaging lens. The liquid crystal display module uses a green LED with an electric power of 80W as the light source. The light source is adjusted by the lens group to form a uniform and bright liquid crystal backlight to ensure that the projected image on the tissue is bright enough. When imaging and projecting, the focus can be adjusted by adjusting the system position and the focusing lens group of the imaging lens 1. Figure 2 For the collection of shooting projection effects.
[0049] Embodiment 2:
[0050] A 1 mg / mL ICG solution is injected into the tumor-adjacent tissue of a cancer patient. 5-10 minutes after the injection, ICG is enriched in the sentinel lymph nodes near the tumor. Under the irradiation of 808 nm excitation light, the near-infrared zone II fluorescence emitted by the sentinel lymph node penetrates the skin and other tissues, is imaged by the same system as in Example 1, and is projected back to the sentinel lymph node, and the green sentinel lymph node image can be directly observed on the tissue covering the sentinel lymph node. The surgeon can expose and remove the sentinel lymph node under the guidance of the projection, without having to view the fluorescent image on the display throughout the process, and only needs to visually operate in the surgical area. If there is no near-infrared zone II image, it is difficult to rely on visual observation to observe the lymph nodes buried deep in the tissue. If there is no projection, the surgeon needs to switch back and forth between the screen and the surgical area to confirm whether the lymph node position is found. In addition, if the fluorescent image on the screen is observed throughout the operation, the lack of stereoscopic information and visible light information makes the operation inconvenient.
[0051] In summary, the present invention is based on a surgical navigation method that coaxially realizes near-infrared two-zone imaging and visible light projection, which realizes the real-time projection of the fluorescent image on the surface of the observed object. It can provide a near-infrared two-zone fluorescent image with a high signal-to-background ratio of the deep tissue and the projection of the surface of the observed object, and the projection position is precise, the focusing is convenient, and the cost is low.
[0052] The above embodiments are used to illustrate the present invention rather than to limit the present invention. Any modification and change made to the present invention within the spirit of the present invention and the protection scope of the claims shall fall within the protection scope of the present invention.
Claims
1. A surgical navigation system for coaxially realizing near-infrared two-zone imaging and visible light projection, characterized in that: The system includes an imaging module and a deformation processing module: The imaging module is used to simultaneously realize near-infrared second-zone imaging and visible light projection of the observed object, and the near-infrared second-zone imaging and visible light projection optical paths are coaxial, and the distortion of the two paths is consistent; The deformation processing module is used to deform the near-infrared image when the distortion is inconsistent, obtain a black and white checkerboard pattern that is visible to both visible light and near-infrared, use a visible light camera to shoot the black and white checkerboard pattern, and shoot the checkerboard pattern after visible light projection based on the imaging module, extract corner points respectively, obtain a one-to-one correspondence between the corner points of the two patterns, obtain a one-to-one mapping relationship for each point through interpolation, deform the near-infrared image, and eliminate the distortion difference.
2. The surgical navigation system for coaxially realizing near-infrared two-zone imaging and visible light projection according to claim 1, characterized in that: The imaging module includes an imaging lens, a near-infrared camera, a liquid crystal display module and an excitation light source; the excitation light source emits excitation light to illuminate the observed object, the imaging lens receives the near-infrared fluorescence signal of the observed object, and simultaneously realizes near-infrared second-zone imaging and visible light projection, the near-infrared camera captures the near-infrared second-zone fluorescence image, and displays it in real time on the liquid crystal display module after image processing.
3. The surgical navigation system for coaxially realizing near-infrared two-zone imaging and visible light projection according to claim 2, characterized in that: The visible light image of the liquid crystal display module is located on the focal plane of the visible light path of the imaging lens and is projected in situ onto the observed object by the imaging lens, thereby realizing fluorescent navigation of surgical operations.
4. The surgical navigation system for coaxially realizing near-infrared two-zone imaging and visible light projection according to claim 2, characterized in that: The imaging lens is composed of a focusing lens group, a spectrometer, a visible light projection lens group and a near-infrared imaging lens group. The spectrometer can transmit / reflect near-infrared light signals and reflect / transmit visible light. The focusing lens group is shared by visible light projection and near-infrared imaging and is coated with a visible light to near-infrared anti-reflection film to eliminate aberrations. The visible light projection lens group and the near-infrared imaging lens group further correct the aberrations of the visible light projection optical path and the near-infrared imaging optical path, respectively.
5. The surgical navigation system for coaxially implementing near-infrared two-zone imaging and visible light projection according to claim 2, characterized in that: The imaging lens is composed of a spectroscopic device, a visible light lens and a near-infrared lens. The spectroscopic device can transmit / reflect near-infrared light signals and reflect / transmit visible light, and simultaneously adjust the visible light projection lens and the near-infrared imaging lens to perform linked focusing, so that the detection surfaces of the visible light camera and the near-infrared camera can always remain conjugate to the same object plane.
6. A surgical navigation system for coaxially implementing near-infrared two-zone imaging and visible light projection according to claim 4 or 5, characterized in that: The spectroscopic device makes the optical axis of the visible light projection optical path and the optical axis of the near-infrared light imaging optical path coaxial in the space where the observed object is located, thereby achieving imaging and projection without viewing angle difference.
7. A surgical navigation system for coaxially implementing near-infrared two-zone imaging and visible light projection according to claim 4 or 5, characterized in that: A long-pass filter is added to the near-infrared light path to filter the second-region near-infrared band based on the imaging effect.
8. A surgical navigation system for coaxially implementing near-infrared two-zone imaging and visible light projection according to claims 1 and 2, characterized in that: The deformation processing module is deployed on the computer to perform deformation processing on the near-infrared image. The computer can also adjust the position, size, and angle parameters of the near-infrared zone II fluorescence image to ensure the conjugation of the image on the near-infrared camera detection surface and the liquid crystal display module to ensure in-situ projection.
9. A surgical navigation method for coaxially implementing near-infrared two-zone imaging and visible light projection based on the surgical navigation system according to any one of claims 1 to 8, characterized in that: The method comprises the following steps: (1) Perform near-infrared second-zone imaging and visible light projection on the observed object simultaneously, with the near-infrared second-zone imaging and visible light projection optical paths being coaxial; (2) Determine whether there is a distortion difference between the near-infrared second-zone imaging and the visible light projection; if so, execute step (3); if not, directly execute step (6); (3) Printing a black and white checkerboard pattern by illuminating with a halogen lamp containing near-infrared zone II components; (4) obtaining a black and white checkerboard pattern visible in both visible light and near infrared, photographing the black and white checkerboard pattern using a visible light camera, and photographing the checkerboard pattern after visible light projection based on an imaging module; (5) extracting corner points respectively to obtain a one-to-one correspondence between the corner points of the two patterns, applying interpolation to obtain a one-to-one mapping relationship between each point of the two patterns; applying the mapping relationship to deform the near-infrared image to eliminate the distortion difference; (6) The image is processed by a computer and then displayed in real time on a liquid crystal display module; the visible light image of the liquid crystal display module is located on the focal plane of the visible light projection optical path and is projected in situ onto the observed object, thereby realizing fluorescent navigation of the surgery.
Citation Information
Patent Citations
Near-infrared fluorescent surgical navigation system and method with projection navigation function
CN113974832A
Near-infrared optical lens system
CN105807402A
Navigation device and method for image projections of lesion positions with shared optical axis
CN107049491A
Visible light and near-infrared fluorescence 3D fusion image endoscope system
CN110811498A
Molecular image NIR-II fluorescence navigation system
CN113749771A
Cited By
Multi-mode wide-field microscopic imaging system for lymphatic vessel-vein anastomosis
CN119606329A
Multimodal wide-field microscopic imaging system for lymphatic-venous anastomosis
CN119606329B
