Imaging system

By using dichroic mirrors and filters in the imaging system to separate visible light and near-infrared fluorescence and perform image fusion, the problem of high signal-to-noise ratio same-view angle imaging in the prior art is solved, and accurate tumor resection is achieved, reducing the risk of tumor residual and healthy tissue resection.

CN223232791UActive Publication Date: 2025-08-19SHENZHEN INST OF RES & INNOVATION THE UNIV OF HONG KONG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202421411259.0
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-06-19
Publication Date
2025-08-19
Estimated Expiration
2034-06-19

AI Technical Summary

Technical Problem

The existing near-infrared fluorescence imaging system cannot achieve high signal-to-noise imaging with room lights on, and cannot achieve the same perspective imaging of the same scene, resulting in inaccurate tumor resection, which may lead to tumor residuals and excessive resection of healthy tissue.

Method used

The imaging system is adopted, including a light source, an imaging lens group, a dichroic mirror, a visible light camera and a near-infrared camera. The dichroic mirror is used to separate visible light and near-infrared fluorescence, and filter light of different wavelengths through the filter to achieve synchronous or sequential imaging, and combine the controller to perform image fusion to ensure imaging at the same viewing angle.

Benefits of technology

High signal-to-noise ratio imaging of near-infrared fluorescence is achieved with the room light on, reducing parallax problems, providing accurate surgical navigation images, and improving the accuracy and safety of tumor resection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN223232791U_ABST
    Figure CN223232791U_ABST
Patent Text Reader

Abstract

The utility model discloses an imaging system. The imaging system comprises a light source, an imaging lens group, a dichroscope, a visible light camera and a near-infrared camera, and the light source is used for emitting laser to a target object to excite the target object to generate near-infrared fluorescence; the imaging lens group is used for imaging a target object; the dichroscope is arranged on the optical axis of the imaging lens group and is used for dividing the light from the imaging lens group into near-infrared fluorescence and visible light; the visible light camera is used for imaging the visible light from the dichroscope; and the near-infrared camera is used for imaging the near-infrared fluorescence from the dichroscope. Thus, according to the embodiment of the invention, near-infrared fluorescence and visible light of the same scene are imaged by using the dichroscope, the influence of a room lamp of visible light on near-infrared fluorescence imaging is reduced, near-infrared fluorescence imaging can be realized under the condition that the room lamp is turned on, the parallax problem existing in dual-channel imaging is reduced, and the imaging efficiency is improved. Therefore, the same-view-angle imaging of the same scene is realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The utility model relates to the field of optical molecular imaging, in particular to an imaging system. Background Art

[0002] Since the birth of modern medicine, surgery has been an important means of treating a variety of human diseases. However, any inaccuracy or error in the operation may lead to fatal consequences. For more than a century, surgical removal of tumors has been an important means of fighting cancer. The main problem is that surgeons rely on visual inspection and experience to identify the margins between malignant tissue and healthy tissue, which can easily leave cancerous remnants or over-remove healthy tissue during surgery, resulting in huge medical expenses and even death. In tumor resection surgeries for various cancers such as breast cancer, colorectal cancer, brain cancer, head and neck cancer, tumor remnants have been found in 8% to 70% of cases, eventually leading to cancer recurrence. Near-infrared fluorescence imaging is currently used for preclinical and clinical intraoperative navigation, with advantages such as real-time and high spatial resolution.

[0003] Fluorescence imaging in the near-infrared (NIR) I band (800nm-1000nm) is characterized by strong fluorescence signals and a rich array of fluorescent dyes. Fluorescence imaging in the NIR II band (1000nm-3000nm) is subject to lower light scattering, has a deeper penetration depth, lower background, and higher spatial resolution. NIR II imaging-guided tumor resection in mice has been shown to improve signal-to-noise ratio and tumor edge detection, thereby enabling significantly more precise tumor resection and complete and non-excessive tumor removal at the level of a very small number of cells. This approach can significantly prevent residual tumors, avoid the removal of vital healthy tissue, reduce cancer recurrence rates, and improve survival rates. However, existing NIR fluorescence imaging systems have shortcomings such as short fluorescence imaging wavelengths, the inability of visible light and fluorescence imaging channels to image the same scene from the same perspective, and difficulty achieving high signal-to-noise ratio fluorescence imaging with room lights on. Utility Model Content

[0004] The utility model provides an imaging system.

[0005] The imaging system of an embodiment of the present application includes a light source, an imaging lens group, a dichroic mirror, a visible light camera and a near-infrared camera. The light source is used to emit laser light to a target object to excite the target object to produce near-infrared fluorescence; the imaging lens group is used to image the target object; the dichroic mirror is arranged on the optical axis of the imaging lens group, and is used to separate the light from the imaging lens group into near-infrared fluorescence and visible light; the visible light camera is used to image the visible light from the dichroic mirror; and the near-infrared camera is used to image the near-infrared fluorescence from the dichroic mirror.

[0006] In this way, the embodiment of the present application uses a dichroic mirror to achieve imaging of near-infrared fluorescence and visible light of the same scene, reducing the influence of visible light room lights on near-infrared fluorescence imaging. Near-infrared fluorescence imaging can be achieved when the room lights are turned on, reducing the parallax problem existing in dual-channel imaging, and achieving same-angle imaging of the same scene.

[0007] In certain embodiments, the visible light camera and the near infrared camera are imaged synchronously or sequentially.

[0008] In this way, visible light and near-infrared fluorescence imaging of the same scene can be achieved at the same viewing angle.

[0009] In certain embodiments, the wavelength of visible light is 400 nm to 700 nm, and the wavelength of near-infrared fluorescence is 800 nm to 3000 nm.

[0010] In certain embodiments, the dichroic mirror is a long-wave pass dichroic mirror and / or a short-wave pass dichroic mirror, and the cutoff wavelength of the dichroic mirror is 700 nm-1000 nm.

[0011] In this way, the dichroic mirror can separate the visible light and near-infrared fluorescence of the same scene according to the wavelength difference, ensuring that the imaging system can still achieve the same viewing angle imaging of the same scene when it is rotated to different angles.

[0012] In some embodiments, the imaging system includes a first filter and a second filter, the first filter being disposed between the visible light camera and the dichroic mirror and used to filter visible light entering the visible light camera; the second filter being disposed between the near-infrared camera and the dichroic mirror and used to filter near-infrared fluorescence entering the near-infrared camera.

[0013] In this way, the first filter and the second filter can filter light, allowing light of specific wavelengths to pass through and cutting off unnecessary light, thereby ensuring the effective separation of light of different wavelengths and improving the imaging quality of visible light cameras and near-infrared cameras.

[0014] In certain embodiments, the first optical filter is a short-wave pass filter, and the cut-off wavelength of the first optical filter is 700 nm-750 nm.

[0015] In this way, the first filter can filter out near-infrared fluorescence, allowing only visible light to enter the visible light camera, achieving effective separation of visible light and near-infrared fluorescence, thereby ensuring the imaging quality of the visible light camera.

[0016] In some embodiments, the second filter is a long-wave pass filter, and the cut-off wavelength of the second filter is greater than 800 nm; and / or the second filter is a band-pass filter, and the center wavelength of the second filter is greater than 800 nm.

[0017] In this way, the second filter can filter out visible light, so that only near-infrared fluorescence can enter the near-infrared camera, achieving effective separation of visible light and near-infrared fluorescence, thereby ensuring the imaging quality of the near-infrared camera.

[0018] In certain embodiments, the light source includes a laser or LED light source, a shaper, and an optical fiber. The laser is used to emit laser light, the LED light source is used to emit LED light, the shaper is used to shape the laser light, and the optical fiber connects the laser and the shaper to transmit the laser light to the shaper.

[0019] In this way, the light source can emit laser light toward the target object to stimulate the target object to generate near-infrared fluorescence.

[0020] In certain embodiments, the laser emits laser light in a continuous manner, and the visible light camera and the near-infrared camera perform imaging at the same preset frame rate; or, the laser emits laser light in a pulsed manner, and the visible light camera and the near-infrared camera perform imaging at the same pulse timing as the laser; or, the laser emits laser light in a pulsed manner, the near-infrared camera performs imaging at the same pulse timing as the laser, and the visible light camera performs imaging in the pulse intervals.

[0021] This allows both visible light and near-infrared cameras to image the same scene from the same viewing angle. Furthermore, pulsed imaging allows for high-intensity illumination while minimizing thermal impact on the target object. Sequential imaging with visible and near-infrared cameras further reduces the impact of laser or LED light on visible light imaging.

[0022] In some embodiments, the imaging system includes a controller, which is respectively connected to the light source, the visible light camera, and the near-infrared camera to control the operation of the light source, the visible light camera, and the near-infrared camera. The controller is used to fuse the images captured by the visible light camera and the images captured by the near-infrared camera.

[0023] In this way, the controller can realize separate imaging of visible light and near-infrared fluorescence as well as dual-channel fusion imaging of visible light and near-infrared fluorescence, providing accurate navigation images for surgery.

[0024] Additional aspects and advantages of the present invention will be given in part in the following description and will become apparent from the following description or learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments with reference to the following drawings, in which:

[0026] Figure 1 It is a schematic structural diagram of an imaging system according to an embodiment of the present utility model;

[0027] Figure 2 This is a schematic diagram of the controller control timing of an embodiment of the present utility model;

[0028] Figure 3 This is a schematic diagram of the controller control timing of another embodiment of the present invention;

[0029] Figure 4 This is a schematic diagram of the controller control timing of another embodiment of the present invention;

[0030] Figure 5 It is a near-infrared spectrum diagram of a room lamp according to an embodiment of the present invention.

[0031] Explanation of the accompanying drawings: 100, imaging system; 10, light source; 11, laser; 12, shaper; 13, optical fiber; 20, imaging lens group; 30, dichroic mirror; 40, visible light camera; 50, near-infrared camera; 60, first filter; 70, second filter; 80, controller; 200, target object. DETAILED DESCRIPTION

[0032] The embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be understood as limiting the present invention.

[0033] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like, indicating directions or positional relationships, are based on the directions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the said features. In the description of the present invention, "multiple" means two or more, unless otherwise clearly and specifically defined.

[0034] In the description of this utility model, it should be noted that, unless otherwise expressly specified or limited, the terms "installed," "connected," and "connected" should be understood in a broad sense. For example, they can refer to fixed connections, detachable connections, or integral connections; mechanical connections, electrical connections, or mutual communication; direct connections or indirect connections through an intermediate medium; and internal communication between two components or interaction between two components. Those skilled in the art will understand the specific meanings of the above terms in this utility model based on specific circumstances.

[0035] In the present invention, unless otherwise expressly specified or limited, a first feature being "above" or "below" a second feature may include the first and second features being in direct contact, or may include the first and second features being in contact not directly but through another feature between them. Moreover, a first feature being "above," "above," and "above" a second feature may include the first feature being directly above or obliquely above the second feature, or may simply mean that the first feature is higher in level than the second feature. A first feature being "below," "below," and "below" a second feature may include the first feature being directly below or obliquely below the second feature, or may simply mean that the first feature is lower in level than the second feature.

[0036] The disclosure below provides many different embodiments or examples for realizing different structures of the present invention. In order to simplify the disclosure of the present invention, the components and settings of specific examples are described below. Of course, they are merely examples and are not intended to limit the present invention. In addition, the present invention may repeat reference numbers and / or reference letters in different examples. Such repetition is for the purpose of simplicity and clarity and does not in itself indicate the relationship between the various embodiments and / or settings discussed. In addition, the present invention provides examples of various specific processes and materials, but a person of ordinary skill in the art will recognize the application of other processes and / or the use of other materials.

[0037] See also Figure 1 The imaging system 100 of the embodiment of the present application includes a light source 10, an imaging lens group 20, a dichroic mirror 30, a visible light camera 40 and a near-infrared camera 50. The light source 10 is used to emit a laser to the target object 200 to excite the target object 200 to produce near-infrared fluorescence; the imaging lens group 20 is used to image the target object 200; the dichroic mirror 30 is arranged on the optical axis of the imaging lens group 20, and is used to separate the light from the imaging lens group 20 into near-infrared fluorescence and visible light; the visible light camera 40 is used to image the visible light from the dichroic mirror 30; and the near-infrared camera 50 is used to image the near-infrared fluorescence from the dichroic mirror 30.

[0038] In this way, the embodiment of the present application uses a dichroic mirror 30 to achieve imaging of near-infrared fluorescence and visible light of the same scene, reducing the influence of visible light room lights on near-infrared fluorescence imaging. Near-infrared fluorescence imaging can be achieved when the room lights are turned on, reducing the parallax problem existing in dual-channel imaging, and achieving same-angle imaging of the same scene.

[0039] Specifically, light source 10 can be any number of light sources 10, including visible light sources and near-infrared light sources. The visible light source can be an indoor lighting fixture, such as a fluorescent lamp or a white LED. Visible light provided by light source 10 is primarily transmitted to visible light camera 40 through reflection from white light in the environment, achieving a realistic imaging scene. Near-infrared light provided by light source 10 illuminates fluorescent probes at the patient site, causing them to emit near-infrared fluorescence. This near-infrared fluorescence is received by near-infrared camera 50, which converts the received fluorescence into an image signal, thereby achieving near-infrared fluorescence imaging. Near-infrared light is an electromagnetic wave between visible light and mid-infrared light.

[0040] The imaging lens group 20 may be an electric focusing lens, which can achieve fast remote focusing. The focal length of the imaging lens group 20 may be designed according to the field of view size or viewing angle required for the actual observation scene.

[0041] The dichroic mirror 30 is a passive device that does not require external energy, but only needs input light. The dichroic mirror 30 can separate a specific spectrum from the light source 10 and change the direction of the light path of part of the spectrum. It can almost completely transmit light of a certain wavelength and almost completely reflect light of other wavelengths.

[0042] The optical axis of the visible light camera 40 may be perpendicular to the optical axis of the near-infrared camera 50 . For ease of use, the reflection angle of the dichroic mirror 30 may be set to 45°.

[0043] In some embodiments, the visible light camera 40 and the near-infrared camera 50 perform imaging synchronously or sequentially.

[0044] In this way, visible light and near-infrared fluorescence imaging of the same scene can be achieved at the same viewing angle.

[0045] Specifically, the synchronous imaging of the visible light camera 40 and the near-infrared camera 50 may be performed at the same preset frame rate or at the same pulse sequence. The sequential imaging of the visible light camera 40 and the near-infrared camera 50 may be performed by the visible light camera 40 first followed by the near-infrared camera 50, or by the near-infrared camera 50 followed by the visible light camera 40.

[0046] In certain embodiments, the wavelength of visible light is 400 nm to 700 nm, and the wavelength of near-infrared fluorescence is 800 nm to 3000 nm.

[0047] Specifically, near-infrared fluorescence includes near-infrared region 1 and near-infrared region 2. The wavelength of near-infrared region 1 is 800nm-1000nm. Near-infrared region 1 imaging has the characteristics of strong fluorescence signal and rich fluorescent dyes. The wavelength of near-infrared region 2 is 1000nm-3000nm. Near-infrared region 2 imaging is subject to lower light scattering, has deeper penetration depth, lower background and higher spatial resolution.

[0048] In some embodiments, the dichroic mirror 30 is a long-wave pass dichroic mirror and / or a short-wave pass dichroic mirror, and the cutoff wavelength of the dichroic mirror 30 is 700 nm-1000 nm.

[0049] In this way, the dichroic mirror 30 can separate the visible light and near-infrared fluorescence of the same scene according to the wavelength difference, ensuring that the imaging system 100 can still achieve the same viewing angle imaging of the same scene when rotating to different angles.

[0050] Specifically, the dichroic mirror 30 can transmit and reflect incident light according to wavelength. The long-wavelength-pass dichroic mirror can transmit incident light with wavelengths greater than a cutoff wavelength and reflect incident light with wavelengths less than the cutoff wavelength. The short-wavelength-pass dichroic mirror can transmit incident light with wavelengths less than the cutoff wavelength and reflect incident light with wavelengths greater than the cutoff wavelength. The cutoff wavelength of the dichroic mirror 30 can be any one of 700 nm, 750 nm, 800 nm, 850 nm, 900 nm, 950 nm, and 1000 nm, or a range of values therebetween.

[0051] In one embodiment, the dichroic mirror 30 is a long-wavelength-pass dichroic mirror with a cutoff wavelength of 750 nm. This means that the dichroic mirror 30 transmits incident light with a wavelength greater than 750 nm and reflects incident light with a wavelength less than 750 nm. In another embodiment, the dichroic mirror 30 is a short-wavelength-pass dichroic mirror with a cutoff wavelength of 800 nm. This means that the dichroic mirror 30 transmits incident light with a wavelength less than 800 nm and reflects incident light with a wavelength greater than 800 nm. The appropriate dichroic mirror 30 can be selected based on the target object and actual needs.

[0052] See also Figure 1In some embodiments, the imaging system 100 includes a first filter 60 and a second filter 70. The first filter 60 is disposed between the visible light camera 40 and the dichroic mirror 30 and is used to filter the visible light entering the visible light camera 40; the second filter 70 is disposed between the near-infrared camera 50 and the dichroic mirror 30 and is used to filter the near-infrared fluorescence entering the near-infrared camera 50.

[0053] In this way, the first filter 60 and the second filter 70 can filter light, allowing light of a specific wavelength to pass through and cutting off unnecessary light, thereby ensuring effective separation of light of different wavelength bands and improving the imaging quality of the visible light camera 40 and the near-infrared camera 50.

[0054] Specifically, the first filter 60 and the visible light camera 40 are respectively arranged vertically on the optical path of the visible light after being split by the dichroic mirror 30 . The visible light is filtered by the first filter 60 and then converged to the visible light camera 40 for imaging.

[0055] The second filter 70 and the near-infrared camera 50 are respectively arranged vertically on the optical path of the near-infrared fluorescence after being split by the dichroic mirror 30. The near-infrared fluorescence is filtered by the second filter 70 and then converged to the near-infrared camera 50 for imaging.

[0056] In some embodiments, the first optical filter 60 is a short-wave pass filter, and the cut-off wavelength of the first optical filter 60 is 700 nm-750 nm.

[0057] In this way, the first filter 60 can filter out the near-infrared fluorescence, so that only visible light can enter the visible light camera 40 , achieving effective separation of visible light and near-infrared fluorescence, thereby ensuring the imaging quality of the visible light camera 40 .

[0058] Specifically, the cutoff wavelength of the first filter 60 can be any one of 700 nm, 710 nm, 720 nm, 730 nm, 740 nm, and 750 nm, or a range of values between any two of them. In one embodiment, the cutoff wavelength of the first filter 60 is 730 nm, i.e., the first filter 60 allows light with a wavelength less than 730 nm to pass through, and cuts off light with a wavelength greater than 730 nm.

[0059] In some embodiments, the second filter 70 is a long-wave pass filter, and the cut-off wavelength of the second filter 70 is greater than 800 nm; and / or, the second filter 70 is a band-pass filter, and the center wavelength of the second filter 70 is greater than 800 nm.

[0060] In this way, the second filter 70 can filter out visible light, so that only near-infrared fluorescence can enter the near-infrared camera 50, achieving effective separation of visible light and near-infrared fluorescence, thereby ensuring the imaging quality of the near-infrared camera 50.

[0061] Specifically, the cutoff wavelength of the second filter 70 can be 800 nm, 850 nm, 900 nm, 950 nm, 1000 nm, 1100 nm, etc. In one embodiment, the cutoff wavelength of the second filter 70 is 900 nm, that is, the second filter 70 allows light with a wavelength greater than 900 nm to pass through, and cuts off light with a wavelength less than 900 nm.

[0062] See also Figure 1 In some embodiments, the light source 10 includes a laser 11 or an LED light source, a shaper 12 and an optical fiber 13. The laser 11 is used to emit laser light, the LED light source is used to emit LED light, the shaper 12 is used to shape the laser light, and the optical fiber 13 connects the laser 11 and the shaper 12 to transmit the laser light to the shaper 12.

[0063] In this way, the light source 10 can emit laser light toward the target object 200 to excite the target object 200 to generate near-infrared fluorescence.

[0064] Specifically, the laser 11 may be a power-adjustable semiconductor laser, which can help the imaging system 100 detect tiny tumors at high light emission power.

[0065] The LED light source can provide visible light illumination and near-infrared fluorescent illumination, and the LED light can be a mixed beam of visible light and near-infrared fluorescent light.

[0066] The shaper 12 may be a light homogenizing component, and the shaper 12 may uniformly process the laser light so that the intensity distribution of the light spot irradiated by the light source 10 on the surface of the target object 200 is more uniform.

[0067] The optical fiber 13 is made of glass. The length of the optical fiber 13 can be set according to actual needs, such as 2m, 2.5m, 3m, etc.

[0068] See also Figure 2-Figure 4 In some embodiments, the laser 11 emits laser light in a continuous manner, and the visible light camera 40 and the near-infrared camera 50 perform imaging at the same preset frame rate; or, the laser 11 emits laser light in a pulsed manner, and the visible light camera 40 and the near-infrared camera 50 perform imaging with the same pulse timing as the laser 11; or, the laser 11 emits laser light in a pulsed manner, the near-infrared camera 50 performs imaging with the same pulse timing as the laser 11, and the visible light camera 40 performs imaging in the pulse intervals.

[0069] This allows visible light camera 40 and near-infrared camera 50 to image the same scene from the same viewing angle. Furthermore, pulsed imaging can achieve high-intensity illumination while minimizing thermal impact on the target object. Sequential imaging by visible light camera 40 and near-infrared camera 50 further reduces the impact of laser or LED light on visible light imaging.

[0070] Specifically, the laser 11 emits laser light in a continuous manner, and the visible light camera 40 and the near infrared camera 50 can be controlled by the same controller 80, so that the visible light camera 40 and the near infrared camera 50 can perform imaging at the same preset frame rate.

[0071] The laser 11 emits laser light in a pulsed manner. The visible light camera 40, the near-infrared camera 50, and the laser 11 can be controlled by the same controller 80, so that the visible light camera 40 and the near-infrared camera 50 can perform imaging with the same pulse timing as the laser 11. Alternatively, the near-infrared camera 50 performs imaging with the same pulse timing as the laser 11, and the visible light camera 40 performs imaging in the pulse interval. In the present invention, a bandpass filter and a pulse imaging method are used before the near-infrared camera 50. The bandpass filter analyzes the room lamp spectrum (such as Figure 5 (As shown in the figure) Selecting the near-infrared band with weaker room light illumination intensity can effectively realize near-infrared fluorescence imaging with the room light on, thereby realizing visible light and near-infrared fluorescence dual-channel imaging with the room light on, reducing the need for traditional equipment to turn off the room light, thereby reducing the complexity of diagnosis and surgical navigation operations.

[0072] In some embodiments, the imaging system 100 includes a controller 80, which is respectively connected to the light source 10, the visible light camera 40 and the near-infrared camera 50 to control the operation of the light source 10, the visible light camera 40 and the near-infrared camera 50. The controller 80 is used to fuse the images captured by the visible light camera 40 and the images captured by the near-infrared camera 50.

[0073] In this way, the controller 80 can realize separate imaging of visible light and near-infrared fluorescence as well as dual-channel fusion imaging of visible light and near-infrared fluorescence, providing accurate navigation images for surgery.

[0074] Specifically, the controller 80 is coupled to the light source 10 to adjust the output of the light source 10. The controller 80 may be an independent controller for controlling the output of the light source 10. In one embodiment, the controller 80 may independently control the intensity of each light source 10 to balance the amount of emitted laser light and visible light.

[0075] The image captured by visible light camera 40 is a visible light image, and the image captured by near-infrared camera 50 is a near-infrared image. A specific method for fusing the visible light and near-infrared images can be to perform image denoising and image enhancement on the visible light and near-infrared images, calculate registration parameters based on the preliminarily processed visible light and near-infrared images, then perform pseudo-color mapping on the near-infrared image, and superimpose the pseudo-color on the visible light image to obtain a fused image of the visible light and near-infrared images. In one embodiment, imaging system 100 includes a display screen for displaying the visible light image, near-infrared image, and fused image.

[0076] In one embodiment, the imaging system 100 includes a 25 mm fixed focus short-wave near-infrared lens with high transmittance in the range of 400 nm to 1700 nm, a long-pass dichroic mirror with a wavelength of 800 nm, a 750 nm short-wave pass filter, a 1050 nm bandpass filter, a visible light camera 40, a short-wave near-infrared camera, a shaper 12, an optical fiber 13, an 808 nm laser, and a controller 80.

[0077] 808nm laser light, generated by an 808nm laser, is transmitted to shaper 12 via optical fiber 13. It then illuminates target object 200, stimulating near-infrared fluorescence with a wavelength greater than 800nm. When ambient light impinges on target object 200, it reflects visible light. The stimulated near-infrared fluorescence and reflected visible light are captured by a broadband 25mm fixed-focus short-wavelength near-infrared lens. The resulting light is then separated into visible light and near-infrared fluorescence by an 800nm long-wavelength pass dichroic filter. The visible light passes through a 750nm short-wavelength pass filter and is imaged on visible light camera 40. The near-infrared fluorescence, filtered through a 1050nm bandpass filter, is imaged on near-infrared camera 50.

[0078] In the continuous working mode, the 808nm laser is set to the continuous illumination mode, and the controller 80 controls the visible light camera 40 and the near infrared camera 50 to synchronously and continuously acquire the signal from the target object 200 at the set frame rate. The control timing diagram of the laser 11, the visible light camera 40 and the near infrared camera 50 during data acquisition is shown in FIG. Figure 2 shown.

[0079] In pulsed operating mode, the controller 80 will synchronously control the 808nm laser, visible light camera 40, and near-infrared camera 50. The 808nm laser is set to external triggering mode and will illuminate in the form of pulses. During the pulse illumination, the visible light camera 40 and near-infrared camera 50 will perform synchronous image acquisition with the same pulse timing as the laser 11. The control timing diagram of the laser 11, visible light camera 40, and near-infrared camera 50 during data acquisition is shown in the figure below. Figure 3 shown.

[0080] In pulsed operating mode, the controller 80 will synchronously control the 808nm laser, visible light camera 40, and near-infrared camera 50. The 808nm laser is set to external triggering mode and will illuminate in the form of pulses. During the pulse illumination, the near-infrared camera 50 will capture images with the same pulse timing as the laser 11, and the visible light camera 40 will capture images in the pulse intervals. The control timing diagram of the laser 11, visible light camera 40, and near-infrared camera 50 during data acquisition is shown in the figure below. Figure 4 shown.

[0081] Throughout this specification, reference to terms such as "one embodiment," "certain embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that a specific feature, structure, material, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0082] Although the embodiments of the present invention have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and purpose of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. An imaging system, characterized in that: include: a light source, configured to emit laser light toward a target object to excite the target object to generate near-infrared fluorescence; An imaging lens group, wherein the imaging lens group is used to image the target object; a dichroic mirror, the dichroic mirror being arranged on the optical axis of the imaging lens group and being used for separating the light from the imaging lens group into near-infrared fluorescence and visible light; a visible light camera for imaging the visible light from the dichroic mirror; and A near-infrared camera is used to image the near-infrared fluorescence from the dichroic mirror.

2. The imaging system according to claim 1, wherein: The visible light camera and the near-infrared camera perform imaging synchronously or sequentially.

3. The imaging system according to claim 1, wherein: The wavelength of the visible light is 400nm-700nm, and the wavelength of the near-infrared fluorescence is 800nm-3000nm.

4. The imaging system according to claim 1, wherein: The dichroic mirror is a long-wavelength-pass dichroic mirror and / or a short-wavelength-pass dichroic mirror, and the cutoff wavelength of the dichroic mirror is 700 nm-1000 nm.

5. The imaging system according to claim 1, wherein: The imaging system includes a first filter and a second filter. The first filter is arranged between the visible light camera and the dichroic mirror, and is used to filter the visible light entering the visible light camera; the second filter is arranged between the near-infrared camera and the dichroic mirror, and is used to filter the near-infrared fluorescence entering the near-infrared camera.

6. The imaging system according to claim 5, wherein: The first filter is a short-wave pass filter, and the cut-off wavelength of the first filter is 700nm-750nm.

7. The imaging system according to claim 5, wherein: The second filter is a long-wave pass filter, and the cut-off wavelength of the second filter is greater than 800 nm; and / or, The second filter is a bandpass filter, and the center wavelength of the second filter is greater than 800 nm.

8. The imaging system according to claim 1, wherein: The light source comprises: A laser or LED light source, used for emitting laser or LED light; a shaper, for shaping the laser; An optical fiber connects the laser and the shaper to transmit the laser light to the shaper.

9. The imaging system according to claim 8, wherein: The laser emits laser light in a continuous manner, and the visible light camera and the near-infrared camera perform imaging at the same preset frame rate; or, The laser emits laser light in a pulsed manner, and the visible light camera and the near-infrared camera perform imaging in the same pulse timing as the laser; or, The laser emits laser light in a pulsed manner, the near-infrared camera performs imaging in the same pulse sequence as the laser, and the visible light camera performs imaging in the pulse interval.

10. The imaging system according to claim 1, wherein: The imaging system includes a controller, which is respectively connected to the light source, the visible light camera and the near-infrared camera to control the operation of the light source, the visible light camera and the near-infrared camera. The controller is used to fuse the image captured by the visible light camera and the image captured by the near-infrared camera.