Tissue image enhancement method and system

By utilizing the differences in scattering and absorption of different bands of light by biological tissues, using two bands of light sources to generate and enhance images, the side effects and imaging complexity problems brought by exogenous contrast agents are solved, and high-resolution and high-contrast biological tissue imaging is achieved.

CN120302129AActive Publication Date: 2025-07-11XIAN INST OF OPTICS & PRECISION MECHANICS CHINESE ACAD OF SCI +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202510796400.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-06-16
Publication Date
2025-07-11
Estimated Expiration
2045-06-16

AI Technical Summary

Technical Problem

The prior art requires exogenous contrast agents in biological tissue imaging, which have side effects such as allergies and neurotoxicity, and the imaging process is complex and costly, and only specific biological tissues have fluorescence characteristics, resulting in the imaging method being uncommon.

Method used

Two band light sources (first band light and second band light) are used to irradiate biological tissues separately, and the target tissue uses the difference in scattering and absorption of different band lights to generate and enhance images through image sensors to achieve high resolution and high contrast imaging.

Benefits of technology

Without exogenous contrast agents, high resolution and high contrast biological tissue imaging results are obtained, reducing imaging complexity and cost, and clearly identifying the target tissue, reducing interference from other tissues.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120302129A_ABST
    Figure CN120302129A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a tissue image enhancement method and system, and relates to the technical field of optical imaging, the method is applied to the tissue image enhancement system, the system comprises a control assembly, a light source assembly, a lens assembly, an image sensor and a coupling device, the light source assembly comprises a first light source and a second light source, the first light source and the second light source are both connected with a light inlet of the coupling device, the method comprises the steps that the control assembly controls the light source assembly to emit first wave band light and second wave band light, the light emitted by the coupling device irradiates target tissue, and the lens assembly focuses light signals scattered by the target tissue irradiated by the light; the image sensor generates a first image and a second image based on a first optical signal and a second optical signal in the optical signals, and the control assembly performs image enhancement on the first image and the second image to obtain a target image of the target tissue. By applying the technical scheme provided by the embodiment of the invention, high-contrast imaging can be carried out on tissues without an exogenous contrast agent.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of optical imaging technology, and particularly to a method and system for enhancing tissue images. Background Art

[0002] With the continuous in-depth research and exploration of life sciences, there is a need for high-resolution and high-contrast optical imaging of biological tissues, so as to use the imaging results to detect, classify, etc. biological tissues.

[0003] In related technologies, by injecting an exogenous contrast agent into the body, near-infrared fluorescence imaging of biological tissues is performed based on the fluorescence characteristics of the exogenous contrast agent to obtain high-resolution and high-contrast imaging results of biological tissues.

[0004] However, when performing near-infrared fluorescence imaging of biological tissues based on an exogenous contrast agent, the participation of the exogenous contrast agent is required, and there are side effects such as allergies and neurotoxicity. The imaging process is relatively complex and the cost is relatively high. Summary of the Invention

[0005] The purpose of the embodiments of the present invention is to provide a method and system for enhancing tissue images, so as to obtain high-resolution and high-contrast imaging results of biological tissues without the need for an exogenous contrast agent. The specific technical solutions are as follows:

[0006] In a first aspect, the embodiments of the present invention provide a method for enhancing tissue images, which is applied to a tissue image enhancement system. The system includes: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component includes: a first light source and a second light source. Both the first light source and the second light source are connected to the light input port of the coupling device. The method includes:

[0007] The control component controls the light source component to emit light of a first wavelength band through the first light source and emit light of a second wavelength band through the second light source, wherein the emission times of the light of the first wavelength band and the second wavelength band are different, and the wavelengths of the light of the first wavelength band and the second wavelength band are both greater than the wavelength of visible light;

[0008] The light emitted by the coupling device irradiates a target tissue, and the degree of scattering and absorption of the target tissue for the light of the second wavelength band is lower than the degree of scattering and absorption of the target tissue for the light of the first wavelength band;

[0009] The lens component focuses the light signal scattered by the target tissue irradiated by the light;

[0010] The image sensor generates a first image based on a first optical signal in the optical signal, and generates a second image based on a second optical signal in the optical signal, and sends the first image and the second image to the control component, wherein the first optical signal is scattered after the target tissue is irradiated by light of the first wavelength band, and the second optical signal is scattered after the target tissue is irradiated by light of the second wavelength band;

[0011] The control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue.

[0012] In one embodiment of the present invention, the system further includes: a beam splitting component, an in-situ projection component, and the light source component further includes: a third light source, the third light source is connected to the light incident port of the coupling device, the light incident port of the beam splitting component is connected to the lens component, the light output ports of the beam splitting component are respectively connected to the in-situ projection component and the image sensor, and the method further includes:

[0013] The control component controls the light source component to continuously emit visible light through the third light source;

[0014] The beam splitting component obtains the optical signal collected by the lens component, and splits the optical signal into a first optical signal and a third optical signal, or splits it into a second optical signal and a third optical signal, wherein the third optical signal is excited after the target tissue is irradiated by the visible light;

[0015] The in-situ projection component receives the target image sent by the control component, and receives the third optical signal sent by the beam splitting component, modulates and controls the third optical signal based on the target image to generate a projection image beam, and sends the projection image beam to the beam splitting component;

[0016] The lens component receives the projection image beam reflected by the beam splitting component, and projects the projection image beam onto the target tissue.

[0017] In one embodiment of the present invention, the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue, including:

[0018] The control component performs differential processing and summation processing on the first image and the second image to obtain a normalized index;

[0019] Based on the normalized index, feature enhancement is performed on the position of the target tissue in the image to be enhanced to obtain a target image; wherein the image to be enhanced is any one of the first image and the second image.

[0020] In one embodiment of the present invention, the in-situ projection component, the lens component and the image sensor share the same optical axis.

[0021] In one embodiment of the present invention, the wavelength range of the first band of light is 760 - 900 nanometers, and the wavelength range of the second band of light is 980 - 2000 nanometers.

[0022] In a second aspect, an embodiment of the present invention provides a tissue image enhancement system, which includes: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component includes: a first light source and a second light source, and both the first light source and the second light source are connected to the light input port of the coupling device;

[0023] The control component is configured to control the light source component to emit light of a first band through the first light source and light of a second band through the second light source. Among them, the emission times of the first band of light and the second band of light are different, and the wavelengths of both the first band of light and the second band of light are greater than the wavelength of visible light;

[0024] The coupling device is configured to irradiate the emitted light onto a target tissue, and the scattering and absorption degrees of the target tissue for the second band of light are lower than those for the first band of light;

[0025] The lens component is configured to focus the light signal scattered by the target tissue when irradiated by light;

[0026] The image sensor is configured to generate a first image based on a first optical signal in the optical signal and generate a second image based on a second optical signal in the optical signal, and send the first image and the second image to the control component. Among them, the first optical signal is scattered after the target tissue is irradiated by the first band of light, and the second optical signal is scattered after the target tissue is irradiated by the second band of light;

[0027] The control component is configured to perform image enhancement on the first image and the second image to obtain a target image of the target tissue.

[0028] In one embodiment of the present invention, the system further includes: a beam splitting component and an in-situ projection component. The light source component further includes: a third light source, and the third light source is connected to the light input port of the coupling device. The light input port of the beam splitting component is connected to the lens component, and the light output ports of the beam splitting component are respectively connected to the in-situ projection component and the image sensor;

[0029] The control component is further configured to control the light source component to continuously emit visible light through the third light source;

[0030] The beam splitting component is configured to obtain the optical signal collected by the lens component, split the optical signal into a first optical signal and a third optical signal, or split it into a second optical signal and a third optical signal, wherein the third optical signal is excited after the target tissue is irradiated by the visible light;

[0031] The in-situ projection component is configured to receive the target image sent by the control component and receive the third optical signal sent by the beam splitting component, modulate and control the third optical signal based on the target image to generate a projection image beam, and send the projection image beam to the beam splitting component;

[0032] The lens component is configured to receive the projection image beam reflected by the beam splitting component and project the projection image beam onto the target tissue.

[0033] In one embodiment of the present invention, the control component is specifically configured to perform differential processing and summation processing on the first image and the second image to obtain a normalized index;

[0034] Based on the normalized index, perform feature enhancement on the position of the target tissue in the image to be enhanced to obtain a target image; wherein the image to be enhanced is any one of the first image and the second image.

[0035] In one embodiment of the present invention, the in-situ projection component, the lens component and the image sensor are coaxial.

[0036] In one embodiment of the present invention, the wavelength range of the first band of light is 760 - 900 nanometers, and the wavelength range of the second band of light is 980 - 2000 nanometers.

[0037] Advantageous effects of the embodiments of the present invention:

[0038] In the technical solution provided by the embodiment of the present invention, in the tissue image enhancement system, the control component controls the light source to emit light of a first wavelength band through the first light source and emit light of a second wavelength band through the second light source. Based on the coupling device, the emitted light is irradiated onto the target tissue. The lens component focuses the light signal scattered by the target tissue irradiated by the light, and the image sensor generates a first image based on the first light signal in the light signal and generates a second image based on the second light signal in the light signal. The control component performs image enhancement on the first image and the second image to obtain the target image of the target tissue. Since the water content of the target tissue is more than that of other tissues around the target tissue, such as other tissues like adipose tissue, the second wavelength band light has less scattering and absorption of water, and the first wavelength band light has more scattering and absorption of water. That is, the degree of scattering and absorption of the first wavelength band light by the target tissue is greater than that of the second wavelength band light, which can also indicate that the target tissue has a strong absorption and scattering effect on the first wavelength band light and a weak absorption and scattering effect on the second wavelength band light. The first image obtained by imaging the first light signal scattered by the target tissue irradiated by the first wavelength band light cannot clearly identify the target tissue, and the second image obtained by imaging the second light signal scattered by the target tissue irradiated by the second wavelength band light can relatively clearly identify the target tissue, but there will be interference from other non-target tissues in the second image. By performing image enhancement on the first image and the second image, the target image of the target tissue is obtained, and the target tissue can be clearly identified in the target image. Therefore, without any exogenous contrast agent, this solution can obtain high-resolution and high-contrast biological tissue imaging results, reducing the complexity and cost of biological tissue imaging.

[0039] In addition, in the technical solution provided by the embodiment of the present invention, since the emission times of the first wavelength band light and the second wavelength band light are different, that is, it is necessary to switch the first light source and the second light source in the light source component at different times to achieve the emission of the first wavelength band light and the second wavelength band light at different times. By connecting both the first light source and the second light source to the light input port of the coupling device and irradiating the target tissue based on the light emitted by the coupling device, in this way, when switching between the first light source and the second light source, there is no need for complicated operations to adjust the positions and irradiation angles of the first light source and the second light source, and the same field of view range of the first wavelength band light and the second wavelength band light irradiating the target tissue can be achieved, providing a basis for subsequent image enhancement of the first image and the second image.

[0040] Of course, it is not necessary for any product or method implementing the present invention to achieve all the above-mentioned advantages simultaneously. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other embodiments can also be obtained based on these drawings.

[0042] Figure 1 Schematic diagram of the structure of the first tissue image enhancement system provided by the embodiments of the present invention;

[0043] Figure 2 Schematic diagram of the structure of the second tissue image enhancement system provided by the embodiments of the present invention;

[0044] Figure 3 Schematic flow chart of the first tissue image enhancement method provided by the embodiments of the present invention;

[0045] Figure 4 Schematic diagram of a synchronous timing high-level trigger signal provided by the embodiments of the present invention;

[0046] Figure 5 Schematic flow chart of the second tissue image enhancement method provided by the embodiments of the present invention;

[0047] Figure 6 Schematic diagram of the second synchronous timing high-level trigger signal provided by the embodiments of the present invention;

[0048] Figure 7 Schematic flow chart of the third tissue image enhancement method provided by the embodiments of the present invention. Detailed implementation manners

[0049] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art based on the present invention belong to the scope of protection of the present invention.

[0050] With the continuous in-depth research and exploration of life sciences, it is necessary to perform high-resolution and high-contrast optical imaging on biological tissues, so as to use the imaging results to detect and classify biological tissues, etc. High-resolution and high-contrast biological tissue imaging technology also plays a key role in surgical navigation.

[0051] Currently, the mainstream technologies for tissue imaging rely on exogenous contrast agents (such as fluorescent dyes, molecular probes). By injecting exogenous contrast agents into the body, near-infrared fluorescence imaging of biological tissues is performed based on the fluorescence characteristics of the exogenous contrast agents to obtain high-resolution and high-contrast biological tissue imaging. However, this method has the following core defects: (1) The clinical application risks of exogenous contrast agents. Specifically, exogenous contrast agents (such as indocyanine green, sodium fluorescein) may cause neurotoxicity, allergic reactions, or liver and kidney damage. It is necessary to preoperatively evaluate the patient's tolerance, which increases the surgical risk. In addition, the injection of contrast agents requires precise control of the dose and time, prolonging the operation duration (an average increase of 30 - 60 minutes), and intraoperative leakage is likely to cause tissue contamination, affecting the imaging accuracy. (2) The contraindications of exogenous contrast agents. Specifically, exogenous contrast agents are prohibited for special populations such as those with impaired liver and kidney function and pregnant women, restricting the scope of application.

[0052] In addition, there is currently a method of irradiating biological tissues with near-infrared light to excite the fluorescence characteristics of the biological tissues themselves, and then capturing the fluorescence signals for imaging to obtain high-resolution and high-contrast biological tissue imaging results. However, this method has the following defects: Since only specific biological tissues have fluorescence characteristics, this tissue imaging method is not universal.

[0053] To solve at least one of the above technical problems, an embodiment of the present invention provides a method and system for enhancing tissue images.

[0054] First, the tissue image enhancement system provided by the embodiment of the present invention will be described.

[0055] See Figure 1 , which is a schematic structural diagram of the first tissue image enhancement system provided by the embodiment of the present invention. The system includes a control component 11, a light source component 12, a lens component 13, an image sensor 14, and a coupling device 15. The light source component 12 includes: a first light source 121 and a second light source 122, and both the first light source 121 and the second light source 122 are connected to the light input port of the coupling device 15;

[0056] The control component 11 is configured to control the light source component 12 to emit light of a first band through the first light source 121 and emit light of a second band through the second light source 122. Among them, the emission moments of the light of the first band and the light of the second band are different, and the wavelengths of the light of the first band and the light of the second band are both greater than the wavelength of visible light;

[0057] The coupling device 15 is configured to irradiate the target tissue with the emitted light, and the scattering and absorption degrees of the target tissue for the light of the second band are lower than those for the light of the first band;

[0058] The lens component 13 is configured to focus the light signals scattered by the target tissue irradiated by the light;

[0059] An image sensor 14 is configured to generate a first image based on a first optical signal in an optical signal and generate a second image based on a second optical signal in the optical signal, and send the first image and the second image to a control component 11, wherein the first optical signal is scattered after the target tissue is irradiated by light of a first wavelength band, and the second optical signal is scattered after the target tissue is irradiated by light of a second wavelength band;

[0060] The control component 11 is configured to perform image enhancement on the first image and the second image to obtain a target image of the target tissue.

[0061] In the technical solution provided by the embodiment of the present invention, in the tissue image enhancement system, the control component controls the light source to emit light of a first wavelength band through a first light source and emit light of a second wavelength band through a second light source, irradiate the emitted light onto the target tissue based on a coupling device, the lens assembly focuses the optical signal scattered by the target tissue irradiated by the light, the image sensor generates a first image based on the first optical signal in the optical signal and generates a second image based on the second optical signal in the optical signal, and the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue. Since the water content of the target tissue is more than that of other tissues around the target tissue, such as other tissues like adipose tissue, the second wavelength band of light has less scattering and absorption of water, and the first wavelength band of light has more scattering and absorption of water, that is, the degree of scattering and absorption of the target tissue to the first wavelength band of light is greater than that of the second wavelength band of light, which can also indicate that the target tissue has a strong absorption and scattering effect on the first wavelength band of light, and the target tissue has a weak absorption and scattering effect on the second wavelength band of light. The first image obtained by imaging with the first optical signal excited by the target tissue irradiated by the first wavelength band of light cannot clearly identify the target tissue, and the second image obtained by imaging with the second optical signal excited by the target tissue irradiated by the second wavelength band of light can relatively clearly identify the target tissue, but there will be interference from other non-target tissues in the second image. By performing image enhancement on the first image and the second image, a target image of the target tissue is obtained, and the target tissue can be clearly identified in the target image. Therefore, without any exogenous contrast agent, this solution can obtain high-resolution and high-contrast biological tissue imaging results, reducing the complexity and cost of biological tissue imaging.

[0062] In addition, in the technical solution provided by the embodiment of the present invention, since the emission times of the first-band light and the second-band light are different, that is, it is necessary to switch the first light source and the second light source in the light source assembly at different times to realize the emission of the first-band light and the second-band light at different times. By connecting both the first light source and the second light source to the light input port of the coupling device, and irradiating the target tissue based on the light emitted by the coupling device, in this way, when switching between the first light source and the second light source, there is no need for complicated operations to adjust the positions and irradiation angles of the first light source and the second light source, and the visual field ranges of the first-band light and the second-band light irradiating the target tissue can be made the same, providing a basis for subsequent image enhancement of the first image and the second image.

[0063] In an embodiment of the present invention, an organization image enhancement system is further provided. Refer to Figure 2 , which is a schematic structural diagram of the second organization image enhancement system provided by the embodiment of the present invention. Compared with the Figure 1 shown organization image enhancement system, this system further includes: a beam splitting component 16, an in-situ projection component 17, and the light source assembly 12 further includes: a third light source 123, the third light source 123 is connected to the light input port of the coupling device 15, the light input port of the beam splitting component 16 is connected to the lens assembly 13, and the light output ports of the beam splitting component 16 are respectively connected to the in-situ projection component 17 and the image sensor 14;

[0064] The control component 11 is further configured to control the light source assembly 12 to continuously emit visible light through the third light source 123;

[0065] The beam splitting component 16 is configured to obtain the optical signal collected by the lens assembly 13, and split the optical signal into a first optical signal and a third optical signal, or split it into a second optical signal and a third optical signal, where the third optical signal is scattered after the target tissue is irradiated by visible light;

[0066] The in-situ projection component 17 is configured to receive the target image sent by the control component 11, and receive the third optical signal sent by the beam splitting component 16, modulate and control the third optical signal based on the target image to obtain a projection image beam, and send the projection image beam to the beam splitting component 16;

[0067] The lens assembly 13 receives the projection image beam reflected by the beam splitting component 16, and projects the projection image beam onto the target tissue.

[0068] As can be seen from the above embodiments, in the embodiments of the present invention, the control component controls the third light source to emit visible light. The beam splitting component splits the first optical signal and the third optical signal, or the second optical signal and the third optical signal collected by the lens component, and emits the third optical signal to the in-situ projection component. The in-situ projection component generates a projection image beam based on the target image and the third optical signal. The projection image beam returns along the original incident optical path, is reflected by the beam splitting component to the lens component, and the lens component amplifies the beam and projects it onto the target tissue, so as to generate a projection image on the target tissue, thereby realizing projecting the target image of the target tissue to the actual location where the target tissue is located.

[0069] Next, in combination with the foregoing tissue image enhancement system, the tissue image enhancement method provided by the embodiments of the present invention will be described.

[0070] See Figure 3 , which is a schematic flowchart of the first tissue image enhancement method provided by the embodiments of the present invention. This method can be applied to any of the foregoing tissue image enhancement systems. The above tissue image enhancement system may include: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component may include: a first light source and a second light source. The first light source and the second light source are both connected to the light incident port of the coupling device. This method includes steps S31-S35.

[0071] S31, the control component controls the light source component to emit light of a first band through the first light source and emit light of a second band through the second light source.

[0072] Wherein, the emission times of the above first band light and the above second band light are different, and the wavelengths of the first band light and the second band light are both greater than the wavelength of visible light.

[0073] The above control component may be a component with certain computing and processing capabilities. For example, the control component may be a processor, a server, etc.

[0074] The above first light source and second light source may be laser diodes or light emitting diodes.

[0075] Since the penetration ability of visible light into biological tissues is weak, clear imaging of biological tissues cannot be performed. Therefore, in the embodiments of the present invention, in order to obtain high-resolution imaging of biological tissues, the wavelengths of the selected first band light and second band light are both greater than the wavelength of visible light.

[0076] Since the first-band light and the second-band light need to irradiate the biological tissue separately and image the biological tissue separately, the first-band light and the second-band light do not need to be emitted simultaneously. Therefore, in the embodiments of the present invention, the control component can control the first light source and the second light source to emit the first-band light and the second-band light at different times respectively, that is, the control component can control the light source component to output the first-band light and the second-band light in sequence.

[0077] Specifically, there are various ways to implement the control component to control the light source to output the first-band light and the second-band light in sequence, including but not limited to: the implementation method using hardware circuits such as a dedicated timing control chip, the implementation method of software programming in a microcontroller (control component), the implementation method combining the above hardware and software, the implementation method based on a synchronous timing high-level trigger signal, etc.

[0078] Now, take the implementation method based on a synchronous timing high-level trigger signal as an example for illustration. Refer to Figure 4 , which is a schematic diagram of a synchronous timing high-level trigger signal provided by the embodiments of the present invention. In a trigger signal time period, when signal 1 is at a high level (i.e., the signal amplitude is 1) and at the same time signal 2 is at a low level (i.e., the signal amplitude is 0), the control component controls the first light source to output the first-band light, and the second light source does not output the second-band light; when signal 1 is at a low level and at the same time signal 2 is at a high level, the control component controls the first light source not to output the first-band light, and the second light source outputs the second-band light. Generally speaking, within a trigger signal time period, the high-level time needs to be greater than the acquisition time of the image sensor, so as to meet the requirement of real-time imaging. It should be noted that the timing signal can include multiple cycles. When the timing signal enters the next cycle, the above steps can be repeated. In this way, the first image and the second image can be obtained in real time, and the target image for image enhancement based on the first image and the second image can be obtained in real time, so as to realize the real-time imaging of the target tissue.

[0079] In the embodiments of the present invention, the control component can control the light source component to emit the first-band light in sequence through the first light source and emit the second-band light in sequence through the second light source.

[0080] S32, the light emitted by the coupling device irradiates the target tissue.

[0081] The above target tissue can be any biological tissue. For example, the target tissue can be lymph node tissue. The target tissue can be an ex vivo tissue or a non-ex vivo tissue.

[0082] The degree of scattering and absorption of the second-band light by the above-mentioned target tissue is lower than that of the first-band light. Considering the natural water content differences between biological tissues and substances such as fat and muscle around biological tissues, as well as the absorption differences of light in different bands by water, the absorption and scattering procedures of light in different bands in biological tissues also vary. Therefore, in the embodiments of the present invention, the degree of scattering and absorption of the second-band light by the above-mentioned target tissue is set to be lower than that of the first-band light, that is, the degree of scattering and absorption of the second-band light by the target tissue is weak, and the degree of scattering and absorption of the first-band light by the target tissue is strong. Since the degree of scattering and absorption of the first-band light by the target tissue is strong, it results in its relatively limited penetration depth and spatial resolution, which cannot meet the requirements of precise visualization under deep biological tissues. That is, the imaging result of the target tissue obtained based on the first-band light may not be able to clearly image the target tissue and accurately identify the target tissue. While the degree of scattering and absorption of the second-band light by the target tissue is weak, compared with the first-band light, it has a higher tissue penetration depth and spatial resolution. That is, the imaging result of the target tissue obtained based on the second-band light can relatively clearly image the target tissue, but there will be interference from other biological tissues in the imaging result.

[0083] In one embodiment of the present invention, the first-band light can be near-infrared region I light, that is, the wavelength range of the first-band light can be 760 - 900 nm (nanometers), and the wavelength range of the second-band light can be 980 - 2000 nm. Preferably, the second-band light can be near-infrared region II light, that is, the wavelength range of the second-band light can be 1400 - 1600 nm. Of course, the wavelength ranges of the first-band light and the second-band light can also be set according to actual needs, and the embodiments of the present invention do not make specific limitations on this.

[0084] As can be seen from the above embodiments, in the embodiments of the present invention, considering that biological tissues have a strong absorption and scattering degree for near-infrared region I band light and a weak absorption and scattering degree for near-infrared region I band light, the first-band light is selected as near-infrared region I light and the second-band light is selected as near-infrared region II light, providing a basis for subsequent image enhancement.

[0085] Since the first-band light and the second-band light are emitted at different times, that is, it is necessary to switch the first light source that emits the first-band light and the second light source that emits the second-band light at different times. In the embodiments of the present invention, considering that the first light source and the second light source directly irradiate the biological tissue in space, when switching the light sources, complicated operations are required to adjust the position and irradiation angle of the light source to achieve the same field of view range of different light sources irradiating the biological tissue. Based on this, in the embodiments of the present invention, both the first light source and the second light source are connected to a coupling device. The first light source and the second light source are output through optical fibers, combined by the coupling device and output through one optical fiber, and irradiated onto the biological tissue. In this way, the field of view range of the light emitted through the coupling device irradiating the biological tissue is the same. When it is necessary to switch the light source, there is no need for complicated operations to adjust the position and irradiation angle of the light source, and the same field of view range of different light sources irradiating the biological tissue can be achieved. In an embodiment of the present invention, in order to better control the beam diameter and divergence angle of the light emitted by the light source, a beam expander can also be connected after the coupling device to expand the beam.

[0086] In the embodiments of the present invention, when the control component controls the first light source of the light source component to emit the first-band light, the first-band light irradiates the target tissue through the coupling device. When the control component controls the second light source of the light source component to emit the second-band light, the second-band light irradiates the target tissue through the coupling device.

[0087] S33, the lens assembly collects the optical signal excited by the target tissue irradiated by the light.

[0088] In the embodiments of the present invention, after the first-band light passing through the coupling device irradiates the target tissue, the target tissue will excite a first optical signal. The lens assembly can focus the first optical signal and send it to the image sensor. After the second-band light passing through the coupling device irradiates the target tissue, the target tissue will scatter a second optical signal. The lens assembly can focus the second optical signal and send it to the image sensor.

[0089] S34, the image sensor generates a first image based on the first optical signal in the optical signal, and generates a second image based on the second optical signal in the optical signal, and sends the first image and the second image to the control component.

[0090] Among them, the first optical signal is scattered after the target tissue is irradiated by the first-band light, and the second optical signal is scattered after the target tissue is irradiated by the second-band light. The above-mentioned first image is the image obtained by the image sensor imaging the target tissue based on the first optical signal, and the above-mentioned second image is the image obtained by the image sensor imaging the target tissue based on the second optical signal.

[0091] Considering that image sensors have different band parameters, for example, image sensors in the visible light band can only capture images illuminated by visible light. Based on this, in an embodiment of the present invention, when the image sensor receives the first light signal sent by the lens assembly, it can select an image sensor with suitable band parameters based on the band of the first band light, thereby generating a clear first image based on the first light signal. When the image sensor receives the second light signal sent by the lens assembly, it can select an image sensor with suitable band parameters based on the band of the second band light, thereby generating a clear second image based on the second light signal. The image sensor that selects the appropriate band parameters can be an image sensor that selects a band parameter that is completely consistent with the target band (such as the band of the first band light, the band of the second band light), or as close as possible.

[0092] After generating the first image and the second image, the image sensor sends the first image and the second image to the control component. In one embodiment of the present invention, the image sensor may send the first image or the second image to the control component immediately after generating the first image or the second image. In one embodiment of the present invention, the image sensor may also wait for the generation of another second image or the first image after generating the first image or the second image, and send the first image and the second image together to the control component.

[0093] S35, the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue.

[0094] Since the first image may not be able to clearly image the target tissue, and although the second image can image the target tissue relatively clearly, there will be interference from other biological tissues in the imaging result, it may not be possible to obtain a high-contrast imaging result of the biological tissue with only a single first image or a single second image. Therefore, in an embodiment of the present invention, after receiving the first image and the second image sent by the image sensor, the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue with high contrast.

[0095] In one embodiment of the present invention, the control component may perform differential processing on the first image and the second image, that is, compare pixel values ​​in the first image and the second image one by one to eliminate the difference between the first image and the second image.

[0096] In one embodiment of the present invention, in order to obtain a target image of a target tissue with high resolution that reduces the influence of other surrounding biological tissues, the principle of the Normalized Difference Vegetation Index (NDVI) is adopted, and the features of the target tissue in the image are enhanced by normalizing the difference and sum of the first image and the second image. Specifically, the target tissue can be subjected to image enhancement by the following steps 1 to 2.

[0097] Step 1, the control component performs difference processing and summation processing on the first image and the second image to obtain a normalized index.

[0098] Specifically, the control component can calculate the normalized index by using the following formula (1).

[0099]

[0100] Among them, and represent the first image and the second image respectively, represents the coordinate value of each pixel in the image, represents the normalized index.

[0101] Step 2, based on the normalized index, feature enhancement is performed on the position of the target tissue in the image to be enhanced to obtain a target image.

[0102] Among them, the image to be enhanced is any one of the first image and the second image. In one embodiment of the present invention, considering that the second image has clearly imaged the target tissue, the second image is used as the image to be enhanced, so that the imaging effect of the enhanced image is better.

[0103] Specifically, the control component can enhance the first image and the second image by using the following formula (2).

[0104]

[0105] Among them, represents the target image, represents the normalized index, represents the image to be enhanced, represents the brightening coefficient, which is a constant and its function is to brighten the image, and it can be adaptively adjusted according to the image enhancement result.

[0106] As can be seen from the above embodiments, the technical solution provided by the embodiments of the present invention obtains a normalized index by performing differential processing and summation processing on the first image and the second image, and based on the normalized index, enhances the features of the position where the target tissue is located in the image to be enhanced to obtain a target image. In this way, not only the different parts in the first image and the second image are eliminated, but also the features of the position where the target tissue is located in the image to be enhanced are enhanced. In this way, the target tissue can be clearly identified in the obtained target image, and a target image of the target tissue with high contrast and high definition is obtained.

[0107] In the embodiments of the present invention, after the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue, the above target image can be sent to a display device, and at the same time, the above steps are repeatedly executed to achieve adaptive real-time enhancement display of the target tissue image.

[0108] In one embodiment of the present invention, after obtaining the target image of the target tissue, deep learning technology can also be combined to further analyze the morphological features of the target tissue to implement operations such as automatic segmentation, counting, size tracking, and metastasis risk prediction of the target tissue.

[0109] In the technical solution provided by the embodiment of the present invention, in the tissue image enhancement system, the control component controls the light source to emit light of a first wavelength band through the first light source and light of a second wavelength band through the second light source. Based on the coupling device, the emitted light is irradiated onto the target tissue. The lens component collects the optical signal excited by the light irradiation on the target tissue, and the image sensor generates a first image based on the first optical signal in the optical signal and generates a second image based on the second optical signal in the optical signal. The control component performs image enhancement on the first image and the second image to obtain the target image of the target tissue. Since the water content of the target tissue is more than that of other tissues around the target tissue, such as other tissues like adipose tissue, the second wavelength band light has less scattering and absorption of water, and the first wavelength band light has more scattering and absorption of water. That is to say, the degree of scattering and absorption of the first wavelength band light by the target tissue is greater than that of the second wavelength band light, which can also indicate that the target tissue has a strong absorption and scattering effect on the first wavelength band light and a weak absorption and scattering effect on the second wavelength band light. The first image obtained by imaging with the first optical signal excited by the target tissue irradiated by the first wavelength band light cannot clearly identify the target tissue, and the second image obtained by imaging with the second optical signal excited by the target tissue irradiated by the second wavelength band light can relatively clearly identify the target tissue. However, there will be interference from other non-target tissues in the second image. By performing image enhancement on the first image and the second image, the target image of the target tissue is obtained, and the imaging of the target tissue can be clearly identified in the target image. Therefore, without any exogenous contrast agent, this solution can obtain high-resolution and high-contrast biological tissue imaging results, reducing the complexity and cost of biological tissue imaging.

[0110] In addition, in the technical solution provided by the embodiment of the present invention, since the emission times of the first wavelength band light and the second wavelength band light are different, that is, it is necessary to switch the first light source and the second light source in the light source component at different times to achieve the emission of the first wavelength band light and the second wavelength band light at different times. By connecting both the first light source and the second light source to the light input port of the coupling device and irradiating the target tissue based on the light emitted by the coupling device, in this way, when switching between the first light source and the second light source, there is no need for complicated operations to adjust the positions and irradiation angles of the first light source and the second light source, and the same field of view range of the first wavelength band light and the second wavelength band light irradiating the target tissue can be achieved, providing a basis for subsequent image enhancement of the first image and the second image.

[0111] See Figure 5, is a schematic flowchart of the second tissue image enhancement method provided by an embodiment of the present invention. This method can be applied to a tissue image enhancement system, and the tissue image enhancement system further includes: a spectroscopic component, an in-situ projection component. The light source component further includes: a third light source, and the third light source is connected to the light input port of the coupling device. The light input port of the spectroscopic component is connected to the lens component, and the light output ports of the spectroscopic component are respectively connected to the in-situ projection component and the image sensor. This method includes steps S51 - S59, where steps S51 - S55 are the same as the above steps S31 - S35, and will not be elaborated here. It should be noted that the present invention does not strictly limit the execution order of steps S51 - S59, and steps S51 - S59 can also be repeatedly executed to achieve adaptive real-time target tissue image enhancement display.

[0112] S56, the control component controls the light source component to continuously emit visible light through the third light source.

[0113] In an embodiment of the present invention, the light source component may further include a third light source, and the third light source is used to emit visible light to provide incident light for in-situ projection of the target tissue. And the third light source is also connected to the coupling device, and the visible light emitted by the third light source is also irradiated onto the target tissue based on the coupling device. In this way, the visual field range of the visible light irradiating the target tissue is the same as that of the first-band light and the second-band light irradiating the target tissue. Without adjusting the position and angle of the light source, the projection position can be made the same as the position areas of the first image and the second image, that is, the projection position is the same as the position area of the target image.

[0114] The control component can control the light source component to continuously emit visible light through the third light source, and control the first light source in the light source component to emit the first-band light in a time sequence, and control the second light source in the light source component to emit the second-band light in a time sequence. That is, the control component can, at a first moment, control the first light source in the light source component to emit the first-band light, and control the third light source in the light source component to emit visible light, and irradiate the first-band light and the visible light onto the target tissue based on the coupling device. The control component can, at a second moment, control the second light source in the light source component to emit the second-band light, and control the third light source in the light source component to emit visible light, and irradiate the second-band light and the visible light onto the target tissue based on the coupling device.

[0115] Continuing with the example where the control component realizes time-sequential output of the first-band light and the second-band light based on a synchronous time-sequence high-level trigger signal, see Figure 6, which is a schematic diagram of the second synchronous timing high-level trigger signal provided by the embodiment of the present invention. Within a trigger signal time period, signal 3 always maintains a high level, indicating that the third light source continuously outputs visible light. When signal 1 is at a high level and signal 2 is at a low level simultaneously, the control component controls the first light source to output light in the first band, the second light source does not output light in the second band, and at the same time signal 3 is at a high level, and the third light source continuously outputs visible light; when signal 1 is at a low level and signal 2 is at a high level simultaneously, the control component controls the first light source not to output light in the first band, the second light source is triggered to output light in the second band, and at the same time signal 3 is at a high level, and the third light source continuously outputs visible light.

[0116] S57, the beam splitting component obtains the optical signal collected by the lens component, and splits the optical signal into a first optical signal and a third optical signal, or splits it into a second optical signal and a third optical signal.

[0117] Among them, the above-mentioned third optical signal is scattered after the target tissue is irradiated by visible light. The above-mentioned beam splitting component can be a dichroic mirror, and the dichroic mirror can physically separate visible light and near-infrared light. The optical axis of the dichroic mirror and the incident optical axis of the in-situ projection component can be set to form an angle of 45°.

[0118] In an embodiment of the present invention, when the control component controls the first light source to output light in the first band and controls the third light source to output visible light, the lens component can collect the first optical signal excited by the first band light of the target tissue and the third optical signal scattered by the target tissue by visible light. The lens component transmits the first optical signal and the third optical signal to the beam splitting component, so that the beam splitting component can send the first optical signal to the image sensor, so that the image sensor generates a first image based on the first optical signal, and at the same time the beam splitting component can send the third optical signal to the imaging element of the in-situ projection component.

[0119] In another embodiment of the present invention, when the control component controls the second light source to output light in the second band and controls the third light source to output visible light, the lens component can collect the second optical signal excited by the second band light of the target tissue and the third optical signal scattered by the target tissue by visible light. The lens component transmits the second optical signal and the third optical signal to the beam splitting component, so that the beam splitting component can send the second optical signal to the image sensor, so that the image sensor generates a second image based on the second optical signal, and at the same time the beam splitting component can send the third optical signal to the imaging element of the in-situ projection component.

[0120] S58, the in-situ projection component receives the target image sent by the control component and the third optical signal sent by the beam splitting component, modulates and controls the third optical signal based on the target image, and generates a projection image beam.

[0121] S59. The lens assembly receives the projected image light beam reflected by the beam splitting assembly and projects the projected image light beam onto the target tissue.

[0122] In some cases, it is necessary to excise some lesion sites where the target tissue is located. Therefore, it is necessary to project the imaging result of the target tissue onto the actual position of the target tissue, that is, it is necessary to achieve in-situ projection of the target tissue to improve the efficiency and accuracy of excising some lesion sites where the target tissue is located.

[0123] Based on this, in the embodiment of the present invention, the beam splitting assembly sends the third optical signal to the imaging element of the in-situ projection assembly, and the control assembly transmits the obtained target image to the in-situ projection assembly, so that the imaging element of the in-situ projection assembly modulates and controls the third optical signal based on the target image, so that the visible light forms a corresponding image light beam according to the pixel information of the target image, and a visible light projected image light beam is obtained. Here, since the modulation and control process of the optical signal during the projection process is a technique known to those skilled in the art, it will not be elaborated here. Then, the modulated visible light projected image light beam is focused by the optical lens inside the in-situ projection assembly and returns along the incident light path, is reflected by the beam splitting assembly to the lens assembly, and the lens assembly amplifies the light beam and projects it onto the target tissue to form a projected image on the target tissue.

[0124] As can be seen from the above embodiments, in the embodiment of the present invention, the control assembly controls the third light source to emit visible light, the beam splitting assembly performs beam splitting processing on the first optical signal and the third optical signal, or the second optical signal and the third optical signal collected by the lens assembly, sends the third optical signal to the in-situ projection assembly, the in-situ projection assembly generates a projected image light beam based on the target image and the third optical signal, the projected image light beam returns along the incident light path, is reflected by the beam splitting assembly to the lens assembly, and the lens assembly amplifies the light beam and projects it onto the target tissue to generate a projected image on the target tissue, thereby realizing projecting the target image of the target tissue to the actual position where the target tissue is located.

[0125] In an embodiment of the present invention, the in-situ projection assembly, the lens assembly and the image sensor in the tissue image enhancement system are coaxial. The lens assembly can adopt a focus-adjustable lens, so that when the lens adjusts the focal length, it can ensure that the focal lengths of the projected image and the target image of the target tissue change simultaneously, thereby realizing projecting the target image of the target tissue to the actual position where the target tissue is located one-to-one and achieving the effect of in-situ projection.

[0126] As can be seen from the above embodiments, in the embodiments of the present invention, the in-situ projection component, the lens component and the image sensor in the tissue image enhancement system are coaxial, so that the in-situ projection of the target tissue can be realized. And the coaxial structural design can ensure that the fields of view of the projected image and the target image of the target tissue are exactly the same, and no image distortion occurs during the in-situ projection process.

[0127] To further understand the technical solution provided by the embodiments of the present invention, the following takes a specific application scenario as an example, where the target tissue is a lymph node, real-time imaging of the lymph node is required, and the tissue image of the lymph node is in-situ projected onto the lymph node tissue, to illustrate this solution.

[0128] See Figure 7 , which is a schematic flowchart of the third tissue image enhancement method provided by the embodiments of the present invention. This method is also applied to the tissue image enhancement system, and this method includes steps S71-S79.

[0129] S71, the control component provides a timing external trigger signal to control the first light source to output light of the first band.

[0130] In the embodiments of the present invention, since the control component controls the third light source to continuously emit visible light, that is, while the control component controls the first light source to output light of the first band, it controls the third light source to output visible light.

[0131] S72, the coupling device irradiates the light of the first band onto the target tissue.

[0132] S73, the first optical signal passes through the lens component to the image sensor for imaging to obtain a first image.

[0133] In the embodiments of the present invention, while the lens component collects the first optical signal, it also collects the third optical signal. The lens component transmits the first optical signal and the third optical signal to the beam splitting component. The beam splitting component transmits the first optical signal to the image sensor and the third optical signal to the in-situ projection component.

[0134] S74, the control component receives the first image and controls the light source to output light of the second band.

[0135] In the embodiments of the present invention, since the control component controls the third light source to continuously emit visible light, that is, while the control component controls the second light source to output light of the second band, it controls the third light source to output visible light.

[0136] S75, the coupling device irradiates the light of the second band onto the target tissue.

[0137] S76, the second optical signal passes through the lens component to the image sensor for imaging to obtain a second image.

[0138] In an embodiment of the present invention, while the lens assembly collects the second optical signal, it also collects the third optical signal. The lens assembly transmits the second optical signal and the third optical signal to the beam splitting assembly. The beam splitting assembly transmits the second optical signal to the image sensor and the third optical signal to the in-situ projection assembly.

[0139] S77. The control component receives the second image, performs image enhancement on the first image and the second image, and projects the enhanced target image onto the target tissue in-situ via the in-situ projection assembly.

[0140] S78. The control component determines whether the timing signal enters the next cycle.

[0141] S79. End.

[0142] If the determination result of the control component is yes, return to execute step S71. By repeating the above steps S71 - S78, real-time imaging of the target tissue is achieved. If the determination result of the control component is no, then execute step S79 and the solution execution ends.

[0143] The above steps S71 - S79 are described relatively simply. For specific details, refer to the relevant descriptions above.

[0144] In the technical solution provided by the embodiment of the present invention, in the tissue image enhancement system, the control component controls the light source to emit light of a first wavelength band through the first light source and emit light of a second wavelength band through the second light source. Based on the coupling device, the emitted light is irradiated onto the target tissue. The lens component collects the optical signal scattered by the light irradiation of the target tissue, and the image sensor generates a first image based on the first optical signal in the optical signal and generates a second image based on the second optical signal in the optical signal. The control component performs image enhancement on the first image and the second image to obtain the target image of the target tissue. Since the water content of the target tissue is more than the water content of other tissues around the target tissue, such as adipose tissue, the second wavelength band of light has less scattering and absorption of water, and the first wavelength band of light has more scattering and absorption of water. That is, the degree of scattering and absorption of the first wavelength band of light by the target tissue is greater than that of the second wavelength band of light, which also indicates that the target tissue has a strong absorption and scattering effect on the first wavelength band of light and a weak absorption and scattering effect on the second wavelength band of light. The first image obtained by imaging with the first optical signal excited by the target tissue irradiated by the first wavelength band of light cannot clearly identify the target tissue. The second image obtained by imaging with the second optical signal excited by the target tissue irradiated by the second wavelength band of light can more clearly identify the target tissue, but there will be interference from other non-target tissues in the second image. By performing image enhancement on the first image and the second image, the target image of the target tissue is obtained, and the target tissue can be clearly identified in the target image. Therefore, without any exogenous contrast agent, this solution can obtain high-resolution and high-contrast biological tissue imaging results, reducing the complexity and cost of biological tissue imaging.

[0145] In addition, in the technical solution provided by the embodiment of the present invention, since the emission times of the first wavelength band of light and the second wavelength band of light are different, that is, it is necessary to switch the first light source and the second light source in the light source component at different times to emit the first wavelength band of light and the second wavelength band of light at different times. By connecting both the first light source and the second light source to the light input port of the coupling device and irradiating the target tissue based on the light emitted by the coupling device, in this way, when switching between the first light source and the second light source, there is no need for complicated operations to adjust the positions and irradiation angles of the first light source and the second light source, and the visual field ranges of the first wavelength band of light and the second wavelength band of light irradiated onto the target tissue can be made the same, providing a basis for subsequent image enhancement of the first image and the second image.

[0146] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer, or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)).

[0147] It should be noted that, in this document, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise", or any other variation thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device that includes a series of elements includes not only those elements, but also other elements that are not explicitly listed, or elements that are inherent to such process, method, article, or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, method, article, or device that includes the element.

[0148] Each embodiment in this specification is described in a related manner. The same or similar parts among the embodiments can be referred to each other, and the differences between each embodiment and other embodiments are emphasized. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

[0149] The above are only the preferred embodiments of the present invention and are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention are all included within the protection scope of the present invention.

Claims

1. An organizational image enhancement method, characterized in that, Applied to an organization image enhancement system, the system includes: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component includes: a first light source and a second light source. Both the first light source and the second light source are connected to the light input port of the coupling device. The method includes: The control component controls the light source component to emit light of a first wavelength band through the first light source and emit light of a second wavelength band through the second light source. Among them, the emission times of the light of the first wavelength band and the second wavelength band are different, and the wavelengths of the light of the first wavelength band and the second wavelength band are both greater than the wavelength of visible light; The light emitted by the coupling device irradiates the target tissue, and the degree of scattering and absorption of the target tissue to the light of the second wavelength band is lower than the degree of scattering and absorption of the light of the first wavelength band; The lens component focuses the light signal scattered by the irradiation of the target tissue by light; The image sensor generates a first image based on the first light signal in the light signal and generates a second image based on the second light signal in the light signal, and sends the first image and the second image to the control component. Among them, the first light signal is scattered after the target tissue is irradiated by the light of the first wavelength band, and the second light signal is scattered after the target tissue is irradiated by the light of the second wavelength band; The control component performs image enhancement on the first image and the second image to obtain the target image of the target tissue.

2. The method according to claim 1, wherein The system further includes: a beam splitting component and an in-situ projection component. The light source component further includes: a third light source. The third light source is connected to the light input port of the coupling device. The light input port of the beam splitting component is connected to the lens component, and the light output ports of the beam splitting component are respectively connected to the in-situ projection component and the image sensor. The method further includes: The control component controls the light source component to continuously emit visible light through the third light source; The beam splitting component obtains the light signal collected by the lens component, and splits the light signal into a first light signal and a third light signal, or splits it into a second light signal and a third light signal. Among them, the third light signal is scattered after the target tissue is irradiated by the visible light; The in-situ projection component receives the target image sent by the control component and receives the third light signal sent by the beam splitting component, modulates and controls the third light signal based on the target image to generate a projection image beam, and sends the projection image beam to the beam splitting component; The lens component receives the projection image beam reflected by the beam splitting component and projects the projection image beam onto the target tissue.

3. The method according to claim 1 or 2, characterized in that, The control component performs image enhancement on the first image and the second image to obtain the target image of the target tissue, including: The control component performs differential processing and summation processing on the first image and the second image to obtain a normalized index; Based on the normalized index, feature enhancement is performed on the position of the target tissue in the image to be enhanced to obtain the target image. Among them, the image to be enhanced is any one of the first image and the second image.

4. The method according to claim 2, wherein The in-situ projection component, the lens component, and the image sensor share the same optical axis.

5. The method according to any one of claims 1, 2 and 4, characterized in that The wavelength range of the first band of light is 760 - 900 nanometers, and the wavelength range of the second band of light is 980 - 2000 nanometers.

6. An organization image enhancement system, characterized in that The system includes: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component includes: a first light source and a second light source, and both the first light source and the second light source are connected to the light input port of the coupling device; The control component is configured to control the light source component to emit light of the first band through the first light source and light of the second band through the second light source. Among them, the emission times of the first band of light and the second band of light are different, and the wavelengths of both the first band of light and the second band of light are greater than the wavelength of visible light; The coupling device is configured to irradiate the emitted light onto a target tissue, and the degree of scattering and absorption of the second band of light by the target tissue is lower than that of the first band of light; The lens component is configured to focus the light signal scattered by the target tissue when irradiated by light; The image sensor is configured to generate a first image based on the first optical signal in the optical signal and generate a second image based on the second optical signal in the optical signal, and send the first image and the second image to the control component. Among them, the first optical signal is scattered after the target tissue is irradiated by the first band of light, and the second optical signal is scattered after the target tissue is irradiated by the second band of light; The control component is configured to perform image enhancement on the first image and the second image to obtain the target image of the target tissue.

7. The system according to claim 6, wherein The system further includes: a beam splitting component and an in-situ projection component. The light source component further includes: a third light source, and the third light source is connected to the light input port of the coupling device. The light input port of the beam splitting component is connected to the lens component, and the light output ports of the beam splitting component are respectively connected to the in-situ projection component and the image sensor; The control component is further configured to control the light source component to continuously emit visible light through the third light source; The beam splitting component is configured to obtain the light signal collected by the lens component, and split the light signal into a first optical signal and a third optical signal, or split it into a second optical signal and a third optical signal. Among them, the third optical signal is scattered after the target tissue is irradiated by the visible light; The in-situ projection component is configured to receive the target image sent by the control component and receive the third optical signal sent by the beam splitting component, modulate and control the third optical signal based on the target image to generate a projection image beam, and send the projection image beam to the beam splitting component; The lens component is configured to receive the projection image beam reflected by the beam splitting component and project the projection image beam onto the target tissue.

8. The system according to claim 6 or 7, wherein The control component is specifically configured to perform differential processing and summation processing on the first image and the second image to obtain a normalized index; Based on the normalized index, perform feature enhancement on the location of the target tissue in the image to be enhanced to obtain a target image; wherein, the image to be enhanced is any one of the first image and the second image.

9. The system according to claim 7, wherein The in-situ projection component, the lens component, and the image sensor share the same optical axis.

10. The system according to any one of claims 6, 7, and 9, characterized in that The wavelength range of the first band of light is 760 - 900 nanometers, and the wavelength range of the second band of light is 980 - 2000 nanometers.

Citation Information

Patent Citations

  • SiPM-based ultrafast camera and imaging method thereof

    CN110971796A

  • Endoscope system, medical catheter, image processing method, and computer storage medium

    CN116269160A

  • Image processing method and device, electronic equipment and storage medium

    CN119520944A

  • Optical projection device used in parathyroid gland autofluorescence imaging system

    CN218684353U

  • Laser speckle contrast imaging system and applications of same

    WO2023283479A1