Tissue image enhancement method and system

Abstract

An embodiment of the present invention provides a tissue image enhancement method and system, which relates to the field of optical imaging technology. The method is applied to a tissue image enhancement system, which includes: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component includes: a first light source and a second light source, and the first light source and the second light source are both connected to the light input port of the coupling device. The method includes: the control component controls the light source component to emit light of a first wavelength band and a second wavelength band, the light emitted by the coupling device illuminates the target tissue, and the lens component focuses the light signal scattered by the target tissue by the light illumination; the image sensor generates a first image and a second image based on the first light signal and the second light signal in the light signal, and the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue. Applying the technical solution provided by the embodiment of the present invention, high-contrast imaging of tissue can be achieved without the need for exogenous contrast agents.

Description

Technical Field

[0001] The present invention relates to the field of optical imaging technology, and in particular to a tissue image enhancement method and system. Background Art

[0002] With the continuous deepening of research and exploration in life sciences, there is a need for high-resolution and high-contrast optical imaging of biological tissues, so as to use the imaging results to achieve the purpose of detecting and classifying biological tissues.

[0003] In related technologies, exogenous contrast agents are injected into the body and near-infrared fluorescence imaging of biological tissues is performed based on the fluorescence characteristics of the exogenous contrast agents to obtain high-resolution and high-contrast biological tissue imaging results.

[0004] However, near-infrared fluorescence imaging of biological tissues based on exogenous contrast agents requires the participation of exogenous contrast agents, which have side effects such as allergies and neurotoxicity. The imaging process is relatively complicated and costly. Summary of the Invention

[0005] The purpose of the embodiments of the present invention is to provide a tissue image enhancement method and system to achieve high-resolution and high-contrast biological tissue imaging results without the need for exogenous contrast agents. The specific technical solution is as follows:

[0006] In a first aspect, an embodiment of the present invention provides a tissue image enhancement method, which is applied to a tissue image enhancement system. The system includes: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component includes: a first light source and a second light source, both of which are connected to a light input port of the coupling device. The method includes:

[0007] The control component controls the light source component to emit light of a first wavelength band through the first light source and to emit light of a second wavelength band through the second light source, wherein the emission times of the light of the first wavelength band and the light of the second wavelength band are different, and the wavelengths of the light of the first wavelength band and the light of the second wavelength band are both greater than the wavelength of visible light;

[0008] The light emitted by the coupling device irradiates the target tissue, and the target tissue has a lower degree of scattering and absorption of the light in the second wavelength band than that of the light in the first wavelength band;

[0009] The lens assembly focuses the light signal scattered by the target tissue when irradiated with light;

[0010] The image sensor generates a first image based on a first light signal among the light signals, and generates a second image based on a second light signal among the light signals, and sends the first image and the second image to the control component, wherein the first light signal is scattered by the target tissue after being irradiated by the light of the first wavelength band, and the second light signal is scattered by the target tissue after being irradiated by the light of the second wavelength band;

[0011] The control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue.

[0012] In one embodiment of the present invention, the system further includes: a spectroscopic component and an in-situ projection component; the light source component further includes: a third light source, the third light source being connected to the light input port of the coupling device; the light input port of the spectroscopic component being connected to the lens component; and the light output port of the spectroscopic component being connected to the in-situ projection component and the image sensor, respectively. The method further includes:

[0013] The control component controls the light source component to continuously emit visible light through the third light source;

[0014] The light splitting component obtains the light signal collected by the lens component, and splits the light signal into a first light signal and a third light signal, or into a second light signal and a third light signal, wherein the third light signal is excited by the target tissue after being irradiated by the visible light;

[0015] The in-situ projection component receives the target image sent by the control component and the third light signal sent by the light splitting component, modulates and controls the third light signal based on the target image to generate a projection image beam, and sends the projection image beam to the light splitting component;

[0016] The lens assembly receives the projection image light beam reflected by the beam splitting assembly, and projects the projection image light beam onto a target tissue.

[0017] In one embodiment of the present invention, the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue, including:

[0018] The control component performs differential processing and summation processing on the first image and the second image to obtain a normalized index;

[0019] Based on the normalized index, feature enhancement is performed on the location of the target tissue in the image to be enhanced to obtain a target image; wherein the image to be enhanced is any one of the first image and the second image.

[0020] In one embodiment of the present invention, the in-situ projection assembly, the lens assembly and the image sensor share a common optical axis.

[0021] In one embodiment of the present invention, the wavelength range of the first wavelength band light is 760-900 nanometers, and the wavelength range of the second wavelength band light is 980-2000 nanometers.

[0022] In a second aspect, an embodiment of the present invention provides a tissue image enhancement system, the system comprising: a control assembly, a light source assembly, a lens assembly, an image sensor, and a coupling device, the light source assembly comprising: a first light source and a second light source, the first light source and the second light source both being connected to a light input port of the coupling device;

[0023] The control component is used to control the light source component to emit light of a first wavelength band through the first light source and emit light of a second wavelength band through the second light source, wherein the emission times of the first wavelength band and the second wavelength band are different, and the wavelengths of the first wavelength band and the second wavelength band are both greater than the wavelength of visible light;

[0024] The coupling device is used to illuminate a target tissue with the emitted light, wherein the target tissue has a lower degree of scattering and absorption of the light in the second wavelength band than that of the light in the first wavelength band;

[0025] The lens assembly is used to focus the light signal scattered by the target tissue when irradiated with light;

[0026] The image sensor is configured to generate a first image based on a first light signal among the light signals, and generate a second image based on a second light signal among the light signals, and send the first image and the second image to the control component, wherein the first light signal is scattered by the target tissue after being irradiated by light of the first wavelength band, and the second light signal is scattered by the target tissue after being irradiated by light of the second wavelength band;

[0027] The control component is used to perform image enhancement on the first image and the second image to obtain a target image of the target tissue.

[0028] In one embodiment of the present invention, the system further comprises: a beam splitting component, an in-situ projection component, and the light source component further comprises: a third light source, the third light source being connected to the light inlet of the coupling device, the light inlet of the beam splitting component being connected to the lens component, and the light outlet of the beam splitting component being connected to the in-situ projection component and the image sensor, respectively;

[0029] The control component is further used to control the light source component to continuously emit visible light through the third light source;

[0030] The light splitting component is used to obtain the light signal collected by the lens component, and split the light signal into a first light signal and a third light signal, or into a second light signal and a third light signal, wherein the third light signal is excited by the target tissue after being irradiated by the visible light;

[0031] The in-situ projection component is configured to receive the target image sent by the control component and the third optical signal sent by the optical splitter component, modulate and control the third optical signal based on the target image to generate a projection image beam, and send the projection image beam to the optical splitter component;

[0032] The lens assembly is used to receive the projection image light beam reflected by the beam splitting assembly and project the projection image light beam onto the target tissue.

[0033] In one embodiment of the present invention, the control component is specifically configured to perform differential processing and summation processing on the first image and the second image to obtain a normalized index;

[0034] Based on the normalized index, feature enhancement is performed on the location of the target tissue in the image to be enhanced to obtain a target image; wherein the image to be enhanced is any one of the first image and the second image.

[0035] In one embodiment of the present invention, the in-situ projection assembly, the lens assembly and the image sensor share a common optical axis.

[0036] In one embodiment of the present invention, the wavelength range of the first wavelength band light is 760-900 nanometers, and the wavelength range of the second wavelength band light is 980-2000 nanometers.

[0037] Beneficial effects of the embodiments of the present invention:

[0038] In the technical solution provided by an embodiment of the present invention, a control component in a tissue image enhancement system controls the light source to emit light of a first wavelength band through a first light source and to emit light of a second wavelength band through a second light source, and irradiates the emitted light to the target tissue based on a coupling device. The lens component focuses the light signal scattered by the target tissue by the light irradiation, the image sensor generates a first image based on the first light signal in the light signal, and generates a second image based on the second light signal in the light signal, and the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue. Because the target tissue contains more water than other surrounding tissues, such as fat tissue, the second-band light scatters and absorbs less water, while the first-band light scatters and absorbs more water. This means that the target tissue scatters and absorbs the first-band light more than the second-band light, indicating that the target tissue has a stronger absorption and scattering effect on the first-band light and a weaker absorption and scattering effect on the second-band light. A first image obtained by imaging the first light signal scattered by the target tissue when irradiated by the first-band light cannot clearly identify the target tissue. A second image obtained by imaging the second light signal scattered by the target tissue when irradiated by the second-band light can more clearly identify the target tissue, but the second image will be interfered with by other non-target tissues. By enhancing the first and second images, a target image of the target tissue is obtained, in which the target tissue can be clearly identified. Therefore, this solution can obtain high-resolution and high-contrast biological tissue imaging results without the need for any exogenous contrast agents, reducing the complexity and cost of biological tissue imaging.

[0039] In addition, in the technical solution provided by the embodiment of the present invention, since the emission times of the first-band light and the second-band light are different, it is necessary to switch the first light source and the second light source in the light source assembly at different times to achieve the emission of the first-band light and the second-band light at different times. By connecting the first light source and the second light source to the light input port of the coupling device, the target tissue is irradiated based on the light emitted by the coupling device. In this way, when switching between the first light source and the second light source, there is no need for complicated operations to adjust the positions and irradiation angles of the first light source and the second light source, so that the first-band light and the second-band light can have the same field of view of the target tissue, thereby providing a basis for subsequent image enhancement of the first image and the second image.

[0040] Of course, it is not necessary to achieve all of the advantages described above simultaneously in order to implement any product or method of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0042] Figure 1 A schematic structural diagram of a first tissue image enhancement system provided by an embodiment of the present invention;

[0043] Figure 2 A schematic structural diagram of a second tissue image enhancement system provided by an embodiment of the present invention;

[0044] Figure 3 A schematic flow chart of a first tissue image enhancement method provided by an embodiment of the present invention;

[0045] Figure 4 A schematic diagram of a synchronous timing high-level trigger signal provided by an embodiment of the present invention;

[0046] Figure 5 A schematic flow chart of a second tissue image enhancement method provided by an embodiment of the present invention;

[0047] Figure 6 A schematic diagram of a second synchronous timing high-level trigger signal provided by an embodiment of the present invention;

[0048] Figure 7 A schematic flow chart of a third tissue image enhancement method provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0049] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field based on the present invention are within the scope of protection of the present invention.

[0050] With the continuous deepening of research and exploration in life sciences, there is a need for high-resolution and high-contrast optical imaging of biological tissues, so as to use the imaging results to achieve the purpose of detecting and classifying biological tissues. High-resolution and high-contrast biological tissue imaging technology also plays a key role in surgical navigation.

[0051] The current mainstream technology for tissue imaging relies on exogenous contrast agents (such as fluorescent dyes and molecular probes). By injecting exogenous contrast agents into the body, near-infrared fluorescence imaging of biological tissues is performed based on the fluorescence properties of the exogenous contrast agents to obtain high-resolution and high-contrast biological tissue imaging. However, this method has the following core defects: (1) The clinical application risks of exogenous contrast agents. Specifically, exogenous contrast agents (such as indocyanine green and fluorescein sodium) may cause neurotoxicity, allergic reactions or liver and kidney damage, and the patient's tolerance needs to be assessed before surgery, which increases the risk of surgery. In addition, the injection of contrast agents requires precise control of the dose and time, which prolongs the operation time (an average increase of 30-60 minutes), and leakage during the operation can easily lead to tissue contamination, affecting the accuracy of imaging. (2) Contraindications and restrictions of exogenous contrast agents. Specifically, exogenous contrast agents are contraindicated for special groups such as those with liver and kidney dysfunction and pregnant women, which limits the scope of application.

[0052] Another approach currently uses near-infrared light to illuminate biological tissue, stimulating its own fluorescence properties. The fluorescence signal is then captured for imaging, resulting in high-resolution, high-contrast tissue imaging. However, this approach has drawbacks: since fluorescence is specific to specific biological tissues, it is not universally applicable.

[0053] In order to solve at least one of the above technical problems, an embodiment of the present invention provides a tissue image enhancement method and system.

[0054] First, the tissue image enhancement system provided by an embodiment of the present invention is described.

[0055] See also Figure 1 , which is a schematic structural diagram of a first tissue image enhancement system provided by an embodiment of the present invention, the system includes a control component 11, a light source component 12, a lens component 13, an image sensor 14, and a coupling device 15. The light source component 12 includes: a first light source 121 and a second light source 122. The first light source 121 and the second light source 122 are both connected to the light input port of the coupling device 15;

[0056] The control component 11 is used to control the light source component 12 to emit a first wavelength band of light through the first light source 121 and to emit a second wavelength band of light through the second light source 122, wherein the emission time of the first wavelength band of light and the second wavelength band of light are different, and the wavelengths of the first wavelength band of light and the second wavelength band of light are both greater than the wavelength of visible light;

[0057] A coupling device 15 is used to illuminate the target tissue with the emitted light, and the target tissue scatters and absorbs the light of the second wavelength band to a lower degree than the light of the first wavelength band;

[0058] The lens assembly 13 is used to focus the light signal scattered by the target tissue when it is illuminated by light;

[0059] The image sensor 14 is configured to generate a first image based on a first light signal in the optical signal and a second image based on a second light signal in the optical signal, and transmit the first image and the second image to the control component 11, wherein the first light signal is scattered by the target tissue after being irradiated by light of the first wavelength band, and the second light signal is scattered by the target tissue after being irradiated by light of the second wavelength band;

[0060] The control component 11 is used to perform image enhancement on the first image and the second image to obtain a target image of the target tissue.

[0061] In the technical solution provided by an embodiment of the present invention, a control component in a tissue image enhancement system controls the light source to emit light of a first wavelength band through a first light source and to emit light of a second wavelength band through a second light source, and irradiates the emitted light to the target tissue based on a coupling device. The lens component focuses the light signal scattered by the target tissue by the light irradiation, the image sensor generates a first image based on the first light signal in the light signal, and generates a second image based on the second light signal in the light signal, and the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue. Because the target tissue has a higher water content than other surrounding tissues, such as fat tissue, the second-band light has less scattering and absorption of water, while the first-band light has more scattering and absorption of water. In other words, the target tissue scatters and absorbs the first-band light more than the second-band light, which also indicates that the target tissue has a stronger absorption and scattering effect on the first-band light and a weaker absorption and scattering effect on the second-band light. The first image obtained by imaging the target tissue with the first light signal excited by the first-band light cannot clearly identify the target tissue. The second image obtained by imaging the target tissue with the second light signal excited by the second-band light can more clearly identify the target tissue, but there will be interference from other non-target tissues in the second image. By enhancing the first and second images, a target image of the target tissue is obtained, and the imaging of the target tissue can be clearly identified in the target image. Therefore, this scheme can obtain high-resolution and high-contrast biological tissue imaging results without any exogenous contrast agent, reducing the complexity and cost of biological tissue imaging.

[0062] In addition, in the technical solution provided by the embodiment of the present invention, since the emission times of the first-band light and the second-band light are different, it is necessary to switch the first light source and the second light source in the light source assembly at different times to achieve the emission of the first-band light and the second-band light at different times. By connecting the first light source and the second light source to the light input port of the coupling device, the target tissue is irradiated based on the light emitted by the coupling device. In this way, when switching between the first light source and the second light source, there is no need for complicated operations to adjust the positions and irradiation angles of the first light source and the second light source, so that the first-band light and the second-band light can have the same field of view of the target tissue, thereby providing a basis for subsequent image enhancement of the first image and the second image.

[0063] In one embodiment of the present invention, a tissue image enhancement system is also provided. Figure 2 , is a schematic structural diagram of a second tissue image enhancement system provided by an embodiment of the present invention. Figure 1 Compared to the tissue image enhancement system shown in FIG, this system further includes: a light splitting component 16, an in-situ projection component 17, and the light source component 12 further includes: a third light source 123, the third light source 123 is connected to the light input port of the coupling device 15, the light input port of the light splitting component 16 is connected to the lens component 13, and the light output port of the light splitting component 16 is connected to the in-situ projection component 17 and the image sensor 14 respectively;

[0064] The control component 11 is further used to control the light source component 12 to continuously emit visible light through the third light source 123;

[0065] a light splitting component 16 for obtaining the light signal collected by the lens component 13 and splitting the light signal into a first light signal and a third light signal, or into a second light signal and a third light signal, wherein the third light signal is scattered by the target tissue after being irradiated by visible light;

[0066] The in-situ projection component 17 is configured to receive the target image sent by the control component 11 and the third optical signal sent by the spectroscopic component 16, modulate and control the third optical signal based on the target image to obtain a projection image beam, and send the projection image beam to the spectroscopic component 16;

[0067] The lens assembly 13 receives the projection image beam reflected by the beam splitting assembly 16 and projects the projection image beam onto the target tissue.

[0068] As can be seen from the above embodiments, in the embodiments of the present invention, the control component controls the third light source to emit visible light, the spectroscopic component performs spectroscopic processing on the first light signal and the third light signal, or the second light signal and the third light signal, collected by the lens component, and transmits the third light signal to the in-situ projection component. The in-situ projection component generates a projection image light beam based on the target image and the third light signal. The projection image light beam returns along the original path of the incident light, is reflected to the lens component through the spectroscopic component, and the lens component amplifies the light beam and projects it onto the target tissue to generate a projection image on the target tissue, thereby realizing the projection of the target image of the target tissue to the actual location of the target tissue.

[0069] The tissue image enhancement method provided by the embodiment of the present invention is described below in conjunction with the aforementioned tissue image enhancement system.

[0070] See also Figure 3 , which is a flow chart of the first tissue image enhancement method provided in an embodiment of the present invention. The method can be applied to any of the aforementioned tissue image enhancement systems. The aforementioned tissue image enhancement system may include: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component may include: a first light source and a second light source. Both the first light source and the second light source are connected to the light input port of the coupling device. The method includes steps S31 to S35.

[0071] S31, the control component controls the light source component to emit light of a first wavelength band through the first light source, and emit light of a second wavelength band through the second light source.

[0072] The emission times of the first wavelength band light and the second wavelength band light are different, and the wavelengths of the first wavelength band light and the second wavelength band light are both greater than the wavelength of visible light.

[0073] The control component mentioned above may be a component with certain computing and processing capabilities, for example, the control component may be a processor, a server, etc.

[0074] The first light source and the second light source may be laser diodes or light emitting diodes.

[0075] Since visible light has a weak ability to penetrate biological tissues, it cannot clearly image biological tissues. Therefore, in order to obtain high-resolution biological tissue imaging, the wavelengths of the first and second wavelength bands of light are selected to be greater than the wavelength of visible light.

[0076] Since the first-band light and the second-band light need to illuminate the biological tissue separately and image the biological tissue separately, the first-band light and the second-band light do not need to be emitted at the same time. Therefore, in an embodiment of the present invention, the control component can control the first light source and the second light source to send the first-band light and the second-band light respectively at different times, that is, the control component can control the light source component to output the first-band light and the second-band light in a time sequence.

[0077] Specifically, the control component controls the light source to output the first-band light and the second-band light in a sequential manner, which can be implemented in a variety of ways, including but not limited to: using a dedicated timing control chip and other hardware circuits, implementing software programming in a microcontroller (control component), implementing a combination of the above hardware and software, and implementing based on a synchronous timing high-level trigger signal.

[0078] The following is an example of how to implement a high-level trigger signal based on synchronous timing. Figure 4 , is a schematic diagram of a synchronous timing high-level trigger signal provided by an embodiment of the present invention. Within a trigger signal time period, when signal 1 is at a high level (i.e., the signal amplitude is 1) and signal 2 is at a low level (i.e., the signal amplitude is 0), the control component controls the first light source to output light in the first band and the second light source not to output light in the second band; when signal 1 is at a low level and signal 2 is at a high level, the control component controls the first light source not to output light in the first band and the second light source to output light in the second band. Generally speaking, within a trigger signal time period, the high-level time must be greater than the image sensor acquisition time to meet the requirements of real-time imaging. It should be noted that the timing signal can include multiple cycles. When the timing signal enters the next cycle, the above steps can be repeated. In this way, the first image and the second image can be acquired in real time, as well as the target image enhanced based on the first image and the second image can be acquired in real time to achieve real-time imaging of the target tissue.

[0079] In the embodiment of the present invention, the control component can control the light source component to sequentially emit light of the first wavelength band through the first light source and sequentially emit light of the second wavelength band through the second light source.

[0080] S32, the light emitted by the coupling device irradiates the target tissue.

[0081] The target tissue can be any biological tissue. For example, the target tissue can be lymph node tissue. The target tissue can be in vitro tissue or in vitro tissue.

[0082] The target tissue scatters and absorbs the second-wavelength light less than the first-wavelength light. Considering the differences in natural water content between biological tissue and surrounding fat, muscle, and other substances, as well as the differences in water absorption by light of different wavelengths, the absorption and scattering processes of light of different wavelengths in biological tissue also vary. Therefore, in an embodiment of the present invention, the target tissue scatters and absorbs the second-wavelength light less than the first-wavelength light. That is, the target tissue scatters and absorbs the second-wavelength light less, while the target tissue scatters and absorbs the first-wavelength light more strongly. Due to the stronger scattering and absorption of the first-wavelength light by the target tissue, its penetration depth and spatial resolution are relatively limited, making it unable to meet the requirements for accurate visualization of deep biological tissues. In other words, the imaging results of the target tissue obtained based on the first-wavelength light may not clearly image the target tissue, and the target tissue cannot be accurately identified. The target tissue has a weaker degree of scattering and absorption of the second-band light, and compared with the first-band light, it has a higher tissue penetration depth and spatial resolution. That is, the imaging results of the target tissue obtained based on the second-band light can image the target tissue more clearly, but there will be interference from other biological tissues in the imaging results.

[0083] In one embodiment of the present invention, the first wavelength band light may be near-infrared light in the first region, that is, the wavelength range of the first wavelength band light may be 760-900 nm (nanometers), and the wavelength range of the second wavelength band light may be 980-2000 nm. Preferably, the second wavelength band light may be near-infrared light in the second region, that is, the wavelength range of the second wavelength band light may be 1400-1600 nm. Of course, the wavelength ranges of the first and second wavelength bands of light may also be set according to actual needs, and this embodiment of the present invention does not specifically limit this.

[0084] As can be seen from the above embodiments, in the embodiments of the present invention, considering that biological tissues have a strong absorption and scattering degree of light in the near-infrared region 1, and a weak absorption and scattering degree of light in the near-infrared region 1, the first band of light is selected as the near-infrared region 1 light, and the second band of light is selected as the near-infrared region 2 light, to provide a basis for subsequent image enhancement.

[0085] Since the first wavelength band light and the second wavelength band light are emitted at different times, that is, it is necessary to switch the first light source emitting the first wavelength band light and the second light source emitting the second wavelength band light at different times. In an embodiment of the present invention, considering that the first light source and the second light source are allowed to directly illuminate the biological tissue in space, when switching the light sources, complicated operations are required to adjust the position and illumination angle of the light source so that the different light sources can illuminate the biological tissue with the same field of view. Based on this, in an embodiment of the present invention, the first light source and the second light source are both connected to a coupling device, and the first light source and the second light source are output through optical fibers, and are combined by the coupling device and output from a single optical fiber to illuminate the biological tissue. In this way, the field of view of the biological tissue illuminated by the light emitted during the coupling period is the same. When it is necessary to switch the light source, there is no need to complicated operations to adjust the position and illumination angle of the light source, so that the different light sources can illuminate the biological tissue with the same field of view. In one embodiment of the present invention, in order to better control the beam diameter and divergence angle of the light emitted by the light source, a beam expander can be connected after the coupling device to expand the beam.

[0086] In an embodiment of the present invention, when the control component controls the first light source of the light source assembly to emit light of a first wavelength band, the light of the first wavelength band is irradiated to the target tissue via the coupling device; when the control component controls the second light source of the light source assembly to emit light of a second wavelength band, the light of the second wavelength band is irradiated to the target tissue via the coupling device.

[0087] S33, the lens assembly collects the light signal excited by the target tissue being irradiated with light.

[0088] In this embodiment of the present invention, after the target tissue is illuminated by light of a first wavelength band via the coupling device, the target tissue excites a first optical signal, which the lens assembly can focus and transmit to the image sensor. After the target tissue is illuminated by light of a second wavelength band via the coupling device, the target tissue scatters a second optical signal, which the lens assembly can focus and transmit to the image sensor.

[0089] S34, the image sensor generates a first image based on the first light signal in the light signal, and generates a second image based on the second light signal in the light signal, and sends the first image and the second image to the control component.

[0090] The first light signal is scattered by the target tissue after being irradiated with light of the first wavelength, and the second light signal is scattered by the target tissue after being irradiated with light of the second wavelength. The first image is the image obtained by the image sensor imaging the target tissue based on the first light signal, and the second image is the image obtained by the image sensor imaging the target tissue based on the second light signal.

[0091] Considering that image sensors have different wavelength parameters, for example, an image sensor in the visible light band can only capture images illuminated by visible light. Based on this, in embodiments of the present invention, upon receiving a first light signal transmitted by the lens assembly, the image sensor can select an image sensor with appropriate wavelength parameters based on the wavelength of the first wavelength band, thereby generating a clear first image based on the first light signal. Upon receiving a second light signal transmitted by the lens assembly, the image sensor can select an image sensor with appropriate wavelength parameters based on the wavelength of the second wavelength band, thereby generating a clear second image based on the second light signal. Selecting an image sensor with appropriate wavelength parameters can involve selecting an image sensor with wavelength parameters that fully match the target wavelength band (e.g., the wavelength of the first wavelength band or the wavelength of the second wavelength band), or one with wavelength parameters that are as close as possible to the target wavelength band.

[0092] After generating the first image and the second image, the image sensor sends the first image and the second image to the control component. In one embodiment of the present invention, the image sensor may immediately send the first image or the second image to the control component after generating the first image or the second image. In one embodiment of the present invention, the image sensor may also wait for the generation of another second image or the first image after generating the first image or the second image, and then send the first image and the second image together to the control component.

[0093] S35 , the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue.

[0094] Because the first image may not clearly image the target tissue, while the second image may clearly image the target tissue, but the imaging result may be interfered with by other biological tissues, a high-contrast imaging result of the biological tissue may not be obtained based on only the first image or the second image. Therefore, in an embodiment of the present invention, after receiving the first and second images from the image sensor, the control component performs image enhancement on the first and second images to obtain a high-contrast target image of the target tissue.

[0095] In one embodiment of the present invention, the control component may perform differential processing on the first image and the second image, that is, compare pixel values in the first image and the second image one by one to eliminate the difference between the first image and the second image.

[0096] In one embodiment of the present invention, to obtain a high-resolution image of a target tissue that reduces the influence of surrounding biological tissue, a principle similar to the Normalized Difference Vegetation Index (NDVI) is employed to enhance the characteristics of the target tissue in the image by normalizing the difference and sum of the first and second images. Specifically, the target tissue image can be enhanced using steps 1 and 2 below.

[0097] In step 1, the control component performs difference processing and summation processing on the first image and the second image to obtain a normalized index.

[0098] Specifically, the control component can use the following formula (1) to calculate the normalized index.

[0099]

[0100] in, and represent the first image and the second image respectively, Represents the coordinate value of each pixel in the image, Represents the normalized exponent.

[0101] Step 2: Based on the normalized index, feature enhancement is performed on the location of the target tissue in the image to be enhanced to obtain the target image.

[0102] The image to be enhanced is any one of the first image and the second image. In one embodiment of the present invention, considering that the second image has already clearly imaged the target tissue, the second image is used as the image to be enhanced, so that the enhanced image has a better imaging effect.

[0103] Specifically, the control component may enhance the first image and the second image using the following formula (2).

[0104]

[0105] in, represents the target image, represents the normalized exponent, represents the image to be enhanced, Represents the brightening coefficient, which is a constant. Its function is to brighten the image and can be adaptively adjusted according to the image enhancement results.

[0106] As can be seen from the above embodiments, the technical solution provided by the embodiments of the present invention performs differential processing and summation on the first and second images to obtain a normalized index. Based on the normalized index, the feature enhancement is performed at the location of the target tissue in the image to be enhanced to obtain the target image. This not only eliminates the difference between the first and second images, but also enhances the feature of the location of the target tissue in the image to be enhanced. As a result, the target tissue can be clearly identified in the obtained target image, resulting in a high-contrast, high-definition target image of the target tissue.

[0107] In an embodiment of the present invention, the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue. The target image can then be sent to a display device, and the above steps can be repeated to achieve adaptive real-time enhanced display of the target tissue image.

[0108] In one embodiment of the present invention, after obtaining the target image of the target tissue, deep learning technology can be combined to further analyze the morphological characteristics of the target tissue to achieve operations such as automatic segmentation, counting, size tracking, and metastasis risk prediction of the target tissue.

[0109] In the technical solution provided by an embodiment of the present invention, the control component in the tissue image enhancement system controls the light source to emit a first band of light through a first light source and to emit a second band of light through a second light source, and irradiates the emitted light to the target tissue based on a coupling device. The lens component collects the light signal excited by the target tissue by the light irradiation, the image sensor generates a first image based on the first light signal in the light signal, and generates a second image based on the second light signal in the light signal, and the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue. Because the target tissue contains more water than other surrounding tissues, such as fat tissue, the second-band light scatters and absorbs less water, while the first-band light scatters and absorbs more water. This means that the target tissue scatters and absorbs the first-band light more than the second-band light, indicating that the target tissue has a stronger absorption and scattering effect on the first-band light and a weaker absorption and scattering effect on the first-band light. A first image obtained by imaging the target tissue with the first-band light-excited light signal cannot clearly identify the target tissue. A second image obtained by imaging the target tissue with the second-band light-excited light signal can more clearly identify the target tissue, but there will be interference from other non-target tissues in the second image. By enhancing the first and second images, a target image of the target tissue is obtained, in which the target tissue can be clearly identified. Therefore, this solution can obtain high-resolution and high-contrast biological tissue imaging results without the need for any exogenous contrast agents, reducing the complexity and cost of biological tissue imaging.

[0110] In addition, in the technical solution provided by the embodiment of the present invention, since the emission times of the first-band light and the second-band light are different, it is necessary to switch the first light source and the second light source in the light source assembly at different times to achieve the emission of the first-band light and the second-band light at different times. By connecting the first light source and the second light source to the light input port of the coupling device, the target tissue is irradiated based on the light emitted by the coupling device. In this way, when switching between the first light source and the second light source, there is no need for complicated operations to adjust the positions and irradiation angles of the first light source and the second light source, so that the first-band light and the second-band light can have the same field of view of the target tissue, thereby providing a basis for subsequent image enhancement of the first image and the second image.

[0111] See also Figure 5, which is a flow chart of the second tissue image enhancement method provided by an embodiment of the present invention. The method can be applied to a tissue image enhancement system, which also includes: a spectroscopic component, an in-situ projection component, and the light source component also includes: a third light source, the third light source is connected to the light input port of the coupling device, the light input port of the spectroscopic component is connected to the lens component, and the light output port of the spectroscopic component is connected to the in-situ projection component and the image sensor respectively. The method includes steps S51-S59, wherein steps S51-S55 are the same as the above-mentioned steps S31-S35, and will not be repeated here. It should be noted that the present invention does not strictly limit the execution order of steps S51-S59, and steps S51-S59 can also be repeatedly executed to achieve adaptive real-time enhanced display of the target tissue image.

[0112] S56: The control component controls the light source component to continuously emit visible light through the third light source.

[0113] In one embodiment of the present invention, the light source assembly may further include a third light source configured to emit visible light, providing incident light for in-situ projection of the target tissue. The third light source is also connected to a coupling device, and the visible light emitted by the third light source is also irradiated onto the target tissue via the coupling device. Thus, the field of view of the target tissue illuminated by the visible light is the same as the field of view of the target tissue illuminated by the first and second wavelength bands. Without adjusting the position and angle of the light source, the projection position can be made identical to the positional region of the first and second images, thereby achieving the same positional region as the target image.

[0114] The control component can control the light source assembly to continuously emit visible light through the third light source, and control the first light source in the light source assembly to sequentially emit light of the first wavelength band, and control the second light source in the light source assembly to sequentially emit light of the second wavelength band. That is, the control component can control the first light source in the light source assembly to emit light of the first wavelength band, and control the third light source in the light source assembly to emit visible light at a first moment, and irradiate the first wavelength band light and visible light to the target tissue based on the coupling device. The control component can control the second light source in the light source assembly to emit light of the second wavelength band, and control the third light source in the light source assembly to emit visible light at a second moment, and irradiate the second wavelength band light and visible light to the target tissue based on the coupling device.

[0115] Continuing the above example of the control component realizing the sequential output of the first band light and the second band light based on the synchronous timing high level trigger signal, see Figure 6, is a schematic diagram of the second synchronous timing high-level trigger signal provided by an embodiment of the present invention. Within a trigger signal time period, Signal 3 always maintains a high level, indicating that the third light source continues to output visible light. When Signal 1 is high and Signal 2 is low, the control component controls the first light source to output light in the first band, and the second light source does not output light in the second band. At the same time, Signal 3 is high, and the third light source continues to output visible light. When Signal 1 is low and Signal 2 is high, the control component controls the first light source not to output light in the first band, triggers the second light source to output light in the second band, and at the same time, Signal 3 is high, and the third light source continues to output visible light.

[0116] S57 , the optical splitting component obtains the optical signal collected by the lens component, and splits the optical signal into a first optical signal and a third optical signal, or into a second optical signal and a third optical signal.

[0117] The third optical signal is scattered by visible light from the target tissue. The beam splitting component may be a dichroic mirror, which can physically separate visible light from near-infrared light. The optical axis of the dichroic mirror may be arranged at a 45° angle to the incident light axis of the in-situ projection component.

[0118] In one embodiment of the present invention, when the control component controls the first light source to output light of the first wavelength band, and controls the third light source to output visible light, the lens component can collect a first light signal excited by the target tissue by the light of the first wavelength band, and a third light signal scattered by the target tissue by the visible light. The lens component transmits the first light signal and the third light signal to the spectroscopic component, so that the spectroscopic component can send the first light signal to the image sensor, so that the image sensor generates a first image based on the first light signal. At the same time, the spectroscopic component can send the third light signal to the imaging element of the in-situ projection component.

[0119] In another embodiment of the present invention, when the control component controls the second light source to output second-band light, and controls the third light source to output visible light, the lens component can collect a second light signal excited by the target tissue by the second-band light, and a third light signal scattered by the target tissue by the visible light. The lens component transmits the second light signal and the third light signal to the spectroscopic component, so that the spectroscopic component can send the second light signal to the image sensor, so that the image sensor generates a second image based on the second light signal. At the same time, the spectroscopic component can send the third light signal to the imaging element of the in-situ projection component.

[0120] S58, the in-situ projection component receives the target image sent by the control component and the third light signal sent by the light splitting component, modulates and controls the third light signal based on the target image, and generates a projection image light beam.

[0121] S59, the lens assembly receives the projection image light beam reflected by the beam splitter assembly, and projects the projection image light beam onto the target tissue.

[0122] In some cases, it is necessary to resect some lesion sites where the target tissue is located, so the imaging results of the target tissue need to be projected to the actual position of the target tissue, that is, it is necessary to realize in situ projection of the target tissue to improve the efficiency and accuracy of resection of some lesion sites where the target tissue is located.

[0123] Based on this, in an embodiment of the present invention, the spectroscopic component sends the third light signal to the imaging element of the in-situ projection component, and the control component transmits the obtained target image to the in-situ projection component, so that the imaging element of the in-situ projection component modulates and controls the third light signal based on the target image, so that the visible light forms a corresponding image beam according to the pixel information of the target image, thereby obtaining a visible light projection image beam. Here, since the modulation and control process of the light signal during the projection process is a technology known to those skilled in the art, it will not be described in detail here. Then, the modulated visible light projection image beam is focused by the optical lens inside the in-situ projection component, returns along the original path of the incident light, is reflected by the spectroscopic component to the lens component, and the lens component amplifies the light beam and projects it onto the target tissue to form a projection image on the target tissue.

[0124] As can be seen from the above embodiments, in the embodiments of the present invention, the control component controls the third light source to emit visible light, the spectroscopic component performs spectroscopic processing on the first light signal and the third light signal, or the second light signal and the third light signal, collected by the lens component, and transmits the third light signal to the in-situ projection component. The in-situ projection component generates a projection image light beam based on the target image and the third light signal. The projection image light beam returns along the original path of the incident light, is reflected to the lens component through the spectroscopic component, and the lens component amplifies the light beam and projects it onto the target tissue to generate a projection image on the target tissue, thereby realizing the projection of the target image of the target tissue to the actual location of the target tissue.

[0125] In one embodiment of the present invention, the in-situ projection assembly, lens assembly, and image sensor of the tissue image enhancement system share a common optical axis. The lens assembly can utilize an adjustable focus lens. This ensures that when the lens is adjusted, the focal lengths of the projected image and the target image of the target tissue change simultaneously, thereby achieving a one-to-one projection of the target image of the target tissue at the actual location of the target tissue, achieving the effect of in-situ projection.

[0126] As can be seen from the above embodiments, in the tissue image enhancement system, the in-situ projection assembly, lens assembly, and image sensor are arranged to share a common optical axis, thereby enabling in-situ projection of the target tissue. Furthermore, this shared optical axis design ensures that the projected image and the target image of the target tissue have identical fields of view, thus preventing image distortion during the in-situ projection process.

[0127] To further understand the technical solution provided by the embodiments of the present invention, the following describes the solution in combination with a specific application scenario, taking the target tissue as a lymph node, the need to perform real-time imaging of the lymph node, and the in-situ projection of the lymph node tissue imaging onto the lymph node tissue as an example.

[0128] See also Figure 7 , which is a flow chart of a third tissue image enhancement method provided in an embodiment of the present invention. This method is also applied to a tissue image enhancement system, and includes steps S71-S79.

[0129] S71, the control component provides a timing external trigger signal to control the first light source to output light in the first wavelength band.

[0130] In the embodiment of the present invention, the control component controls the third light source to continuously emit visible light, that is, the control component controls the first light source to output the first wavelength band light while controlling the third light source to output visible light.

[0131] S72, the coupling device irradiates the target tissue with light in the first wavelength band.

[0132] S73: The first light signal is transmitted to the image sensor through the lens assembly for imaging to obtain a first image.

[0133] In an embodiment of the present invention, the lens assembly collects the first light signal while also collecting the third light signal. The lens assembly transmits the first light signal and the third light signal to the spectroscopic assembly. The spectroscopic assembly transmits the first light signal to the image sensor and transmits the third light signal to the in-situ projection assembly.

[0134] S74, the control component receives the first image and controls the light source to output light in the second wavelength band.

[0135] In the embodiment of the present invention, the control component controls the third light source to continuously emit visible light, that is, the control component controls the second light source to output the second wavelength band light while controlling the third light source to output visible light.

[0136] S75, the coupling device irradiates the target tissue with the light of the second wavelength band.

[0137] S76: The second light signal is sent to the image sensor through the lens assembly for imaging to obtain a second image.

[0138] In an embodiment of the present invention, the lens assembly collects the second light signal while also collecting the third light signal. The lens assembly transmits the second light signal and the third light signal to the spectroscopic assembly. The spectroscopic assembly transmits the second light signal to the image sensor and transmits the third light signal to the in-situ projection assembly.

[0139] S77, the control component receives the second image, performs image enhancement on the first image and the second image, and projects the enhanced target image in situ onto the target tissue via the in-situ projection component.

[0140] S78, the control component determines whether the timing signal enters the next cycle.

[0141] S79, end.

[0142] If the control component determines that the image is correct, the process returns to step S71 and repeats steps S71-S78 to achieve real-time imaging of the target tissue. If the control component determines that the image is correct, the process returns to step S79 and the protocol ends.

[0143] The description of the above steps S71-S79 is relatively simple, and please refer to the relevant description above for details.

[0144] In the technical solution provided by an embodiment of the present invention, the control component in the tissue image enhancement system controls the light source to emit a first band of light through a first light source and to emit a second band of light through a second light source, and irradiates the emitted light to the target tissue based on a coupling device. The lens component collects the light signal scattered by the target tissue by the light irradiation, the image sensor generates a first image based on the first light signal in the light signal, and generates a second image based on the second light signal in the light signal, and the control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue. Since the target tissue has a higher water content than other surrounding tissues, other tissues, such as adipose tissue, scatter and absorb less water in the second-band light, while scatter and absorb more water in the first-band light. In other words, the target tissue scatters and absorbs the first-band light more than the second-band light, which indicates that the target tissue has a stronger absorption and scattering effect on the first-band light and a weaker absorption and scattering effect on the first-band light. The first image obtained by imaging the target tissue with the first light signal excited by the first-band light cannot clearly identify the target tissue. The second image obtained by imaging the target tissue with the second light signal excited by the second-band light can more clearly identify the target tissue, but there will be interference from other non-target tissues in the second image. By enhancing the first and second images, a target image of the target tissue is obtained, and the imaging of the target tissue can be clearly identified in the target image. Therefore, this scheme can obtain high-resolution and high-contrast biological tissue imaging results without any exogenous contrast agent, reducing the complexity and cost of biological tissue imaging.

[0145] In addition, in the technical solution provided by the embodiment of the present invention, since the emission times of the first-band light and the second-band light are different, it is necessary to switch the first light source and the second light source in the light source assembly at different times to achieve the emission of the first-band light and the second-band light at different times. By connecting the first light source and the second light source to the light input port of the coupling device, the target tissue is irradiated based on the light emitted by the coupling device. In this way, when switching between the first light source and the second light source, there is no need for complicated operations to adjust the positions and irradiation angles of the first light source and the second light source, so that the first-band light and the second-band light can have the same field of view of the target tissue, thereby providing a basis for subsequent image enhancement of the first image and the second image.

[0146] In the above embodiments, all or part of the embodiments can be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with the embodiments of the present invention are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer, or a data storage device such as a server or data center that integrates one or more available media. The available medium can be magnetic media (e.g., floppy disk, hard disk, tape), optical media (e.g., DVD), or semiconductor media (e.g., solid-state disk (SSD)).

[0147] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0148] Each embodiment in this specification is described in a related manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiment is generally similar to the method embodiment, so the description is relatively simple. For related parts, refer to the description of the method embodiment.

[0149] The above description is only a preferred embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention are included in the scope of protection of the present invention.

Claims

1. A tissue image enhancement method, characterized in that: The invention is applied to a tissue image enhancement system, the system comprising: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component comprises: a first light source and a second light source, both of which are connected to a light input port of the coupling device. The method comprises: The control component controls the light source component to emit light of a first wavelength band through the first light source and to emit light of a second wavelength band through the second light source, wherein the emission times of the light of the first wavelength band and the light of the second wavelength band are different, and the wavelengths of the light of the first wavelength band and the light of the second wavelength band are both greater than the wavelength of visible light; The light emitted by the coupling device irradiates the target tissue, and the target tissue has a lower degree of scattering and absorption of the light in the second wavelength band than that of the light in the first wavelength band; The lens assembly focuses the light signal scattered by the target tissue when irradiated with light; The image sensor generates a first image based on a first light signal among the light signals, and generates a second image based on a second light signal among the light signals, and sends the first image and the second image to the control component, wherein the first light signal is scattered by the target tissue after being irradiated by the light of the first wavelength band, and the second light signal is scattered by the target tissue after being irradiated by the light of the second wavelength band; The control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue; The system further includes: a light splitting component and an in-situ projection component; the light source component further includes: a third light source, the third light source is connected to the light input port of the coupling device; the light input port of the light splitting component is connected to the lens component; the light output port of the light splitting component is connected to the in-situ projection component and the image sensor, respectively; and the method further includes: The control component controls the light source component to continuously emit visible light through the third light source; The light splitting component obtains the light signal collected by the lens component, and splits the light signal into a first light signal and a third light signal, or into a second light signal and a third light signal, wherein the third light signal is scattered by the target tissue after being irradiated by the visible light; The in-situ projection component receives the target image sent by the control component and the third light signal sent by the light splitting component, modulates and controls the third light signal based on the target image to generate a projection image beam, and sends the projection image beam to the light splitting component; The lens assembly receives the projection image light beam reflected by the beam splitting assembly, and projects the projection image light beam onto a target tissue.

2. The method according to claim 1, characterized in that The control component performs image enhancement on the first image and the second image to obtain a target image of the target tissue, including: The control component performs differential processing and summation processing on the first image and the second image to obtain a normalized index; Based on the normalized index, feature enhancement is performed on the location of the target tissue in the image to be enhanced to obtain a target image; wherein the image to be enhanced is any one of the first image and the second image.

3. The method according to claim 1, characterized in that The in-situ projection assembly, the lens assembly and the image sensor share a common optical axis.

4. The method according to any one of claims 1 to 3, characterized in that The wavelength range of the first wavelength band light is 760-900 nanometers, and the wavelength range of the second wavelength band light is 980-2000 nanometers.

5. A tissue image enhancement system, characterized in that: The system includes: a control component, a light source component, a lens component, an image sensor, and a coupling device. The light source component includes: a first light source and a second light source. The first light source and the second light source are both connected to the light entrance of the coupling device. The control component is used to control the light source component to emit light of a first wavelength band through the first light source and emit light of a second wavelength band through the second light source, wherein the emission times of the first wavelength band and the second wavelength band are different, and the wavelengths of the first wavelength band and the second wavelength band are both greater than the wavelength of visible light; The coupling device is used to illuminate a target tissue with the emitted light, wherein the target tissue has a lower degree of scattering and absorption of the light in the second wavelength band than that of the light in the first wavelength band; The lens assembly is used to focus the light signal scattered by the target tissue when irradiated with light; The image sensor is configured to generate a first image based on a first light signal among the light signals, and generate a second image based on a second light signal among the light signals, and send the first image and the second image to the control component, wherein the first light signal is scattered by the target tissue after being irradiated by light of the first wavelength band, and the second light signal is scattered by the target tissue after being irradiated by light of the second wavelength band; The control component is configured to perform image enhancement on the first image and the second image to obtain a target image of the target tissue; The system further includes: a light splitting component and an in-situ projection component; the light source component further includes: a third light source, the third light source is connected to the light inlet of the coupling device, the light inlet of the light splitting component is connected to the lens component, and the light outlet of the light splitting component is connected to the in-situ projection component and the image sensor respectively; The control component is further used to control the light source component to continuously emit visible light through the third light source; The light splitting component is used to obtain the light signal collected by the lens component, and split the light signal into a first light signal and a third light signal, or into a second light signal and a third light signal, wherein the third light signal is scattered by the target tissue after being irradiated by the visible light; The in-situ projection component is configured to receive the target image sent by the control component and the third optical signal sent by the optical splitter component, modulate and control the third optical signal based on the target image to generate a projection image beam, and send the projection image beam to the optical splitter component; The lens assembly is used to receive the projection image light beam reflected by the beam splitting assembly and project the projection image light beam onto the target tissue.

6. The system according to claim 5, characterized in that The control component is specifically configured to perform differential processing and summation processing on the first image and the second image to obtain a normalized index; Based on the normalized index, feature enhancement is performed on the location of the target tissue in the image to be enhanced to obtain a target image; wherein the image to be enhanced is any one of the first image and the second image.

7. The system according to claim 5, characterized in that The in-situ projection assembly, the lens assembly and the image sensor share a common optical axis.

8. The system according to any one of claims 5 to 7, characterized in that The wavelength range of the first wavelength band light is 760-900 nanometers, and the wavelength range of the second wavelength band light is 980-2000 nanometers.

Images