An endoscopic imaging system and hyperspectral endoscope

Abstract

The utility model relates to the technical field of endoscope, disclose a kind of endoscope imaging system and hyperspectral endoscope, system includes: light source device, including light source module, light source adjusting assembly, light source module emits light after passing through light source adjusting assembly and emits;Light source adjusting assembly is used to adjust the light intensity when irradiating to target object;Lens device, including light emitting component, imaging component;Light emitting component is used to emit the illumination light produced by light source device to target object, camera lens is used to receive the illumination light reflected from target object back, and image in image sensor;Data processing device is connected with image sensor communication, for obtaining the spectral data after image sensor, to generate the image data corresponding to target object.The utility model provides an endoscope imaging system by light source adjusting assembly adjusts light intensity, so that endoscope imaging system can be under different irradiation conditions Stable output suitable light intensity, improve the stability and imaging quality of endoscope imaging.

Description

Technical Field

[0001] This utility model relates to the field of endoscope technology, specifically to an endoscope imaging system and a hyperspectral endoscope. Background Technology

[0002] An endoscope is a medical instrument used to observe internal organs and tissues of the human body, while a hyperspectral endoscope is an endoscope that combines hyperspectral imaging technology. Hyperspectral endoscopes can acquire multi-band tissue reflectance data, and through reconstruction algorithms, can generate visualized images that fuse spectral characteristics. By utilizing its sensitivity to different wavelengths of light, a hyperspectral endoscope can provide richer image information than a conventional endoscope.

[0003] However, while the imaging systems used in current hyperspectral endoscopes can selectively transmit light of different wavelengths, they are easily affected by the reliability of the light source, such as the wavelength, intensity, and uniformity of the light source, which reduces the final image quality. Utility Model Content

[0004] In view of this, the present invention provides an endoscopic imaging system and a hyperspectral endoscope, which can reduce the influence of light source on imaging and improve the imaging quality of the endoscope.

[0005] In a first aspect, this utility model provides an endoscopic imaging system, which includes: The light source device includes a light source module and a light source adjustment component. The light emitted by the light source module is emitted after passing through the light source adjustment component. The light source adjustment component is used to adjust the light intensity when it shines on the target object. The lens assembly includes a light-emitting component and an imaging component. The imaging component includes a camera lens and an image sensor. The light-emitting component is used to emit illumination light generated by the light source device toward the target object, and the camera lens is used to receive the illumination light reflected back from the target object and image it onto the image sensor. The data processing device is communicatively connected to the imaging component and is used to acquire spectral data after passing through the imaging component in order to generate image data corresponding to the target object.

[0006] The endoscopic imaging system provided in this invention adjusts the light intensity through a light source adjustment component, enabling the system to stably output appropriate light intensity under different illumination conditions. This meets the imaging requirements under varying lighting conditions and avoids the impact on image quality caused by unstable light sources, such as changes in wavelength, intensity, and uniformity. By incorporating the light source adjustment component, endoscopic imaging becomes more stable, ensuring the quality of the endoscopic image.

[0007] In one optional implementation, the light source adjustment component includes: An electric aperture, positioned in the light-emitting direction of the light source module, is used to adjust the amount of light transmitted.

[0008] The motorized aperture in this embodiment can automatically and precisely adjust the brightness to cope with image brightness fluctuations caused by factors such as changes in the distance between the probe and the tissue during the examination.

[0009] In one optional implementation, the light source adjustment component includes: A rotating shutter is positioned in the light-emitting direction of the light source module; the rotation period of the rotating shutter is synchronized with the exposure period of the endoscopic imaging system.

[0010] The rotating shutter in this embodiment can significantly reduce the duty cycle of light energy without reducing the peak brightness at the moment of exposure and ensuring image quality. This significantly reduces the total average heat transmitted to the electronic endoscope, effectively reducing the temperature at the end of the endoscope lens and avoiding low-temperature burns to the patient.

[0011] In one optional embodiment, the light source device further includes: The light emitted by the focusing lens, after passing through the light source adjustment component, is focused by the focusing lens and then shines on the target object through the light output component.

[0012] In this embodiment, a focusing lens is used to precisely focus the adjusted light source, making the light in the irradiated area more concentrated and uniform. Furthermore, the focused light is transmitted through a light guide, ensuring that the light propagation path is not disturbed, thereby reducing light loss and achieving a more uniform illumination effect.

[0013] In one alternative embodiment, the light source device includes: A color temperature detection device is used to detect the color temperature of the light emitted by the light source module.

[0014] In one optional implementation, the color temperature detection device includes: An optical beam splitter is positioned in the light-emitting direction of the light source module to direct a portion of the light emitted by the light source module to the first spectral monitoring unit. The first spectral monitoring unit is connected to the data processing device and is used to collect spectral data from the light source module. The data processing unit is also used to adjust the operating current of the light source module based on the spectral data.

[0015] The color temperature detection system provided in this embodiment can further improve the stability of the light source and improve the final image quality.

[0016] In one optional implementation, the color temperature detection device includes: The second spectral monitoring unit is located in the non-controllable area of ​​the rotary shutter; the detection end face of the second spectral monitoring unit is set parallel to the optical axis of the light source module.

[0017] In one alternative implementation, the image sensor includes: A light sensor is positioned in the direction of light emission from the camera lens; A filter array is placed on the pixels of the photosensitive sensor and positioned between the camera lens and the photosensitive sensor. The filter array is used to filter the illumination light.

[0018] In this embodiment, a filter array is provided on the surface of the photosensitive sensor, which can selectively filter light of different wavelengths. Furthermore, the filter array also helps the operator view different fused images, providing image information of different tissue layers of the target object.

[0019] In one optional implementation, the filter array is an N×N array; wherein the value of N is in the range of 2≤N≤6.

[0020] In one alternative implementation, each filter unit of the filter array is a bandpass filter unit; the center wavelength of each bandpass filter unit ranges from 400 nm to 2500 nm.

[0021] Alternatively, each filter unit in the filter array is an all-pass filter unit; the response wavelength of the all-pass filter unit ranges from 400nm to 2500nm.

[0022] Secondly, this utility model provides a hyperspectral endoscope, which includes: a flexible catheter, a curved operating part, and an endoscope imaging system in any of the above embodiments; The bending operating part is connected to the flexible catheter; the lens device of the endoscopic imaging system is set inside the flexible catheter.

[0023] In this embodiment, by setting different filters, precise selection of light of different wavelengths can be achieved. The configuration of the filters effectively improves the spectral selectivity of the imaging system, enabling the system to capture the details of the target object more accurately while achieving high-precision imaging, reducing unnecessary spectral interference, and thus improving image quality, contrast, and detail resolution.

[0024] This invention provides a hyperspectral endoscope that avoids the impact of unstable light sources, such as variations in wavelength, intensity, and uniformity, on image quality, effectively improving the imaging quality of hyperspectral endoscopy. It also helps operators view different fused images, providing image information of different tissue layers of the target object. Attached Figure Description

[0025] To more clearly illustrate the specific embodiments of this utility model or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this utility model. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0026] Figure 1 This is a schematic diagram illustrating the composition of a specific example of an endoscopic imaging system according to an embodiment of the present utility model; Figure 2 This is yet another schematic diagram of a specific example of an endoscopic imaging system according to an embodiment of the present utility model; Figure 3 This is a schematic diagram of a filter unit according to an embodiment of the present utility model; Figure 4 This is a schematic diagram illustrating the relationship between the filter array and the photosensor according to an embodiment of the present invention; Figure 5 This is a schematic diagram of channel separation according to an embodiment of the present utility model; Figure 6 This is a schematic diagram of another channel separation according to an embodiment of the present utility model; Figure 7 This is a schematic diagram of channel fusion under different observation modes according to embodiments of the present utility model; Figure 8 This is a schematic diagram of a hyperspectral endoscope according to an embodiment of the present invention; Explanation of reference numerals in the attached drawings: 1-Light source device, 11-Light source module, 12-Light source adjustment component, 121-Electrically operated aperture, 122-Rotary shutter, 123-Focusing lens, 124-Optical path beam splitter, 125-First spectral monitoring unit, 126-Light guide, 127-Second spectral monitoring unit, 2-Lens device, 21-Light output component, 211-Illumination lens, 212-Illumination window, 22-Imaging component, 221-Camera lens, 222-Photosensitive sensor, 223-Filter array, 223F-Filter unit, 224-Encapsulation housing, 225-Camera window, 226-Cable, 227-Image sensor, 3-Data processing device, 4-Display, 5-Input device, 6-Flexible conduit, 61-Head end, 62-Bend section, 63-Flexible tube section, 7-Bend operation section, 8-Cable. Detailed Implementation

[0027] To make the objectives, technical solutions, and advantages of the embodiments of this utility model clearer, the technical solutions of the embodiments of this utility model will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this utility model, not all embodiments. Based on the embodiments of this utility model, all other embodiments obtained by those skilled in the art without creative effort are within the protection scope of this utility model.

[0028] In the description of this utility model, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the accompanying drawings and are only for the convenience of describing this utility model and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this utility model. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0029] In the description of this utility model, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can also refer to the internal connection of two components; and they can refer to a wireless connection or a wired connection. Those skilled in the art can understand the specific meaning of the above terms in this utility model based on the specific circumstances.

[0030] Furthermore, the technical features involved in the different embodiments of this utility model described below can be combined with each other as long as they do not conflict with each other.

[0031] This embodiment provides an endoscopic imaging system for obtaining images of a target object. Figure 1 This is a schematic diagram of the structure of an endoscopic imaging system according to an embodiment of the present invention, including a light source device 1, a lens device 2, and a data processing device 3, as detailed below.

[0032] The light source device 1 includes a light source module 11 and a light source adjustment component 12. The light emitted by the light source module 11 is emitted after passing through the light source adjustment component 12. The light source adjustment component 12 is used to adjust the light intensity when it shines on the target object. The target object is the part being observed.

[0033] In this embodiment, the light source module 11 preferably uses a broadband light source, such as a halogen lamp or a xenon lamp. The light source module 11 is powered by a power supply, and a light source driver continuously provides driving current to the light source module 11, thereby illuminating the light source module 11. Taking a xenon lamp as an example, it is typically equipped with a parabolic collimating cup with high reflectivity to form a parallel beam with high collimation. A light source adjustment component 12 is also provided in the optical path of this collimated beam. In this embodiment, the light source adjustment component 12 can be an aperture, an optical lens group, an adjustable filter, etc. The light source adjustment component 12 can adjust the intensity of the light source when illuminating the target object, ensuring that the final image generated by the endoscopic imaging system does not have problems such as overexposure or underexposure, thereby effectively improving the imaging quality of the endoscopic imaging system.

[0034] The lens device 2 includes a light-emitting component 21 and an imaging component 22. The imaging component 22 includes a camera lens 221 and an image sensor 227. The light-emitting component 21 is used to emit illumination light generated by the light source device 1 to the target object, and the camera lens 221 is used to receive the illumination light reflected back from the target object and image it onto the image sensor 227.

[0035] In this embodiment, the lens device 2 has two windows at its end 61: a light-emitting component 21 including an illumination window 212 and an image-emitting window 225. Light emitted from the light source module 11 passes through the light source adjustment component 12 and exits from the light-emitting component 21 at a predetermined light distribution angle. Reflected light carrying information about the target object's tissue passes through the image-emitting window 225 and the camera lens 221 before being captured by the image sensor 227. The imaging component 22 mainly includes the camera lens 221 and the image sensor 227 for imaging.

[0036] This embodiment employs a "snapshot" hyperspectral image sensor, which can simultaneously acquire a spectral data cube composed of a two-dimensional spatial image and the spectral curves of each pixel during a single exposure. This ensures the true real-time display of the hyperspectral fusion image and greatly improves the clinical operability of the system.

[0037] The data processing device 3 is communicatively connected to the imaging component 22 and is used to acquire spectral data after passing through the imaging component 22 in order to generate image data corresponding to the target object.

[0038] In this embodiment, the data processing device 3 includes both an image processor and a controller. This data processing device 3 is an image processor used to process, fuse, and form observation images from signals captured by the electronic endoscope. It is mainly used to generate image data corresponding to the target object based on the acquired spectral data of the target object and send it to the display 4 for display. The data processing device 3 is also used to adjust the light transmission of the light source adjustment component 12 based on acquired optical data, such as image brightness information.

[0039] In this embodiment, the data processing device 3 and the light source device 1 can be two independent devices that transmit signals via cables, or they can be integrated into the same host housing to form a complete endoscope host system.

[0040] In addition, the endoscopic imaging system also includes: a display 4 for displaying images observed by the endoscope and its associated input devices 5 such as a keyboard and mouse.

[0041] It should be noted that the present invention mainly describes the hardware structure of the endoscopic imaging system. The present invention also protects the structure and components of the endoscopic imaging system. As for the data processing method and control logic of the data processing device 3, the existing logic can be used completely, and no special limitation is made here.

[0042] The endoscopic imaging system provided in this embodiment adjusts the light intensity through a light source adjustment component, enabling the system to stably output appropriate light intensity under different illumination conditions. This meets the imaging requirements under varying lighting conditions and avoids the impact on image quality caused by unstable light sources, such as changes in wavelength, intensity, and uniformity. By setting up the light source adjustment component, endoscopic imaging becomes more stable, ensuring the quality of the endoscope's imaging.

[0043] Because the endoscopic imaging system in this embodiment has real-time synchronous image acquisition, this embodiment does not need to face the complex registration problem between various spectral images caused by time-series scanning. This not only greatly saves computing power and shortens the image fusion time, but also fundamentally guarantees the quality of the fused image.

[0044] In some alternative implementations, the light source adjustment assembly 12 includes: The motorized aperture 121 is set in the light-emitting direction of the light source module 11 and is used to adjust the amount of light transmitted.

[0045] The motorized aperture 121 provided in this embodiment can automatically perform fine brightness adjustment. Based on the image brightness information processed by the image processor, the motorized aperture 121 can smoothly and infinitely adjust the light flux through the continuous opening and closing of its blades under a closed-loop control system, in order to cope with image brightness fluctuations caused by factors such as changes in the distance between the probe and the tissue during the examination.

[0046] In some alternative implementations, the light source adjustment assembly 12 includes: The rotating shutter 122 is positioned in the light-emitting direction of the light source module 11; the rotation period of the rotating shutter 122 is synchronized with the exposure period of the endoscopic imaging system.

[0047] In this embodiment, the rotary shutter 122 can be used alone as a light source adjustment component 12, positioned on one side of the light emission direction of the light source module 11; or it can be used together with the motorized aperture 121 as a light source adjustment component 12, positioned on one side of the light emission direction of the light source module 11. When the rotary shutter 122 and the motorized aperture 121 are used together as a light source adjustment component 12, the rotary shutter 122 can be positioned between the motorized aperture 121 and the light source module 11, or it can be positioned on one side of the light emission direction of the motorized aperture 121. The specific configuration can be determined according to actual needs.

[0048] In this embodiment, the rotating shutter 122 rotates at high speed through a disk with a fan-shaped notch. Its rotation period is precisely synchronized with the exposure period of the image sensor 227 in the imaging assembly 22, so that the light path is opened only at the moment of imaging exposure, realizing pulse illumination. This rotating shutter 122 can significantly reduce the duty cycle of light energy without reducing the peak brightness at the moment of exposure and ensuring image quality, thereby significantly reducing the total average heat transmitted to the electronic endoscope. It can effectively reduce the temperature of the endoscope lens tip 61 and avoid low-temperature burns to the patient.

[0049] Taking the xenon lamp as an example of the light source module 11, in order to prevent the high-frequency noise generated at the moment of the broadband light source lighting from affecting the precision motors and controllers of the rotary shutter 122, the electric aperture 121, and the spectrometer module, the endoscopic imaging system can adopt a delayed start. When the user turns on the power of the main unit, the circuits of each part of the system are powered, the controller and the light source driver start running, while the light quantity driver that controls the light intensity adjustment mechanism is in a reset state. When the light source lighting command is received from the operator, the controller will control the light source driver to drive the xenon lamp to light up. During the high-frequency noise stage of the xenon lamp going through high-voltage triggering and arc establishment, the light quantity driver used to drive the rotary shutter 122, the electric aperture 121, and the first spectral monitoring unit 125 is still in a non-working state, so that the above components are not subject to any electromagnetic interference. Only after the lamp's power circuit confirms that the xenon lamp has entered a stable operating state will it generate a "completion of illumination" signal. This signal, together with the system stabilization signal from the controller, will activate the light driver, causing it to start the rotary shutter 122, the motorized aperture 121, and the first spectral monitoring unit 125 according to the controller's instructions. This delayed start-up strategy effectively solves the problem of xenon lamp start-up noise interfering with the precision control system, ensuring that the light source module 11 can continuously provide stable, safe, and high-quality illumination in various complex clinical examination environments.

[0050] The light source adjustment component 12 in this embodiment features a delayed start-up design that effectively isolates high-frequency electromagnetic noise during the xenon lamp ignition phase, fundamentally eliminating interference with the endoscopic video signal. This ensures immediate purity and stability of the image at the start of surgery, providing the doctor with the optimal initial field of vision. Simultaneously, this design reduces the later maintenance costs and the frequency of consumable replacements. The closed-loop control circuit based on image sensor brightness feedback in this composite light intensity adjustment mechanism can quickly respond to and compensate for any light intensity fluctuations caused by any reason, ensuring that the output illumination brightness remains consistent with the user-set value throughout the entire surgery or examination, thus providing reliable lighting for clinical operations.

[0051] In some optional embodiments, the light source device 1 further includes: The light emitted by the focusing lens 123, after passing through the light source adjustment assembly 12, is focused by the focusing lens 123 and then illuminates the target object through the light emitting assembly 21. The illumination light provided by the light source device 1 is guided by the light guide 126 to the illumination lens 211 in the light emitting assembly 21, and then illuminates the observation area through the illumination window 212. The rear of the imaging assembly 22 is connected to components such as a communication cable 226 for transmitting drive signals and image signals output by the sensor. The light emitting assembly 21 includes, in addition to the illumination window 212 and illumination lens 211 disposed within the lens device 2, the light guide 126 connected to the light source device 1.

[0052] In this embodiment, by setting a focusing lens 123, the adjusted light source is precisely focused, making the light in the irradiated area more concentrated and uniform. Furthermore, in this embodiment, the focused light is transmitted through a light guide, ensuring that the light propagation path is not disturbed, thereby reducing light loss and achieving a more uniform illumination effect.

[0053] In some alternative embodiments, the light source device 1 includes: A color temperature detection device is used to detect the color temperature of the light emitted by the light source module 11.

[0054] Specifically, in some optional implementations, the color temperature detection device includes: The optical beam splitter 124 is set in the light output direction of the light source module 11 and is used to guide part of the light emitted by the light source module 11 to the first spectral monitoring unit 125. The first spectral monitoring unit 125 is connected to the data processing device 3, and the first spectral monitoring unit 125 is used to collect spectral data of the light source module 11. The data processing device 3 is also used to adjust the operating current of the light source module 11 based on the spectral data.

[0055] When a broadband light source is used in the light source module 11, although its spectral characteristics are close to sunlight, its color temperature stability will drift with factors such as operating current, usage time, and lamp aging. In hyperspectral observation mode, fluctuations in color temperature will cause slight distortion in spectral images of different bands, resulting in inconsistencies in key diagnostic information such as mucosal color and vascular morphology, which may affect the accuracy of the doctor's judgment.

[0056] In this embodiment, a color temperature detection device is provided. The color temperature detection device consists of an optical path beam splitter 124 (e.g., a semi-transparent and semi-reflective mirror) and a first spectral monitoring unit 125 (e.g., a miniature spectrometer, a multi-channel spectral sensor, etc.).

[0057] The function of the optical beam splitter 124 is to direct a small portion (e.g., <5%) of the light energy from the main output optical path to the first spectral monitoring unit 125. The first spectral monitoring unit 125 can acquire complete spectral data within the corresponding wavelength range of the broadband light source at extremely high speed in real time and transmit it to the data processing device 3. The algorithm built into the controller in the data processing device 3 calculates the characteristic values ​​of the current spectrum in real time, including correlated color temperature, color rendering index, and other indicators, and compares the calculated real-time characteristic values ​​with preset target values. If the real-time color temperature value is higher than the target value (output light is bluish), the controller sends a command to the light source driver to slightly reduce the operating current of the light source module 11; conversely, if the real-time color temperature value is lower than the target value (output light is reddish), the controller sends a command to the light source driver to slightly increase the operating current of the light source module 11. The current adjustment amplitude is precisely calibrated to ensure smooth changes and to avoid perceptible disturbances to the illumination brightness.

[0058] It should be noted that the specific method for adjusting the operating current of the light source module 11 described above is only a specific example provided in this embodiment. Other existing adjustment methods can also be used for adjustment, and no particular limitation is made here.

[0059] Furthermore, in this embodiment, the color temperature detection device and the light source adjustment component 12 are independent of each other and do not interfere with each other. The color temperature detection device is responsible for color control, and the light source adjustment component 12 is responsible for brightness control. Together, they can further improve the stability of the light source and improve the final image quality.

[0060] The active color temperature stabilization control loop included in this embodiment fundamentally solves the color temperature drift problem caused by aging and slight power changes in light sources such as xenon lamps, ensuring that every beam of light output maintains a consistent color temperature and spectral characteristics from the time the device is started until the end of its lifespan. Through a current fine-tuning compensation mechanism, the light quality of the light source can be maintained within the standard range for a longer period of use, thereby objectively extending the effective lifespan of core consumables such as xenon lamps.

[0061] Reference Figure 2 As shown, in one optional embodiment, the color temperature detection device includes: The second spectral monitoring unit 127 is located in the non-control area of ​​the rotary shutter 122; the detection end face of the second spectral monitoring unit 127 is arranged parallel to the optical axis of the light source module 11.

[0062] This embodiment provides a more streamlined color temperature detection device, aiming to reduce the use of optical components and lower system complexity and cost.

[0063] and Figure 1In contrast, this embodiment omits a separate optical path beam splitter and changes the installation position of the spectral monitoring unit. In this embodiment, the detection end face of the second spectral monitoring unit 127 is arranged parallel to the optical axis of the light source module 11.

[0064] The same principle applies if an electrically driven aperture 121 is installed between the rotary shutter 122 and the light source module 11. The electrically driven aperture 121 is positioned on the optical path of the light source module 11, and the diameter D1 of the collimated beam output by the light source module 11 is designed to always be larger than the maximum aperture D2 of the electrically driven aperture 121 (i.e., the diameter when the aperture is fully open). The second spectral monitoring unit 127 is positioned on the non-adjustable end face of the electrically driven aperture 121, with its photosensitive surface facing the side of the electrically driven aperture 121. The installation position of the second spectral monitoring unit 127 needs to be precisely calculated to ensure that, regardless of the aperture size of the electrically driven aperture 121, the second spectral monitoring unit 127 will not directly receive direct light from the xenon lamp, thereby avoiding glare and damage.

[0065] Because the diameter D1 of the collimated beam is larger than the aperture D2, a portion of the light is always blocked by the blades of the motorized aperture 121. This blocked portion of the optical fiber illuminates the aperture blades and the surrounding cavity space through diffuse reflection. The signal received by the second spectral monitoring unit 127 is precisely this portion of light diffusely reflected by the motorized aperture blades. Although this light is diffusely reflected, its spectral composition is consistent with the main beam passing through the aperture, thus accurately reflecting the spectral characteristics of the output light and serving as a reliable input signal for color temperature control.

[0066] In some alternative implementations, the image sensor 227 includes: A photosensor 222 is positioned in the light-emitting direction of the camera lens 221. The photosensor 222 is preferably a monochrome photosensor.

[0067] The filter array 223 is disposed on the pixels of the photosensitive sensor 222 and between the camera lens 221 and the photosensitive sensor 222. The filter array 223 is used to filter the illumination light.

[0068] The image sensor 227 used in this embodiment includes a filter array 223, a photosensor 222, and a package housing 224. On the photosensitive surface of the photosensor 222, multiple photoelectric conversion elements, such as photodiodes, are arranged in a matrix as pixels. On each pixel element, a micro-filter unit is arranged at the pixel level, thus forming a two-dimensional filter array 223. After being filtered by the filter array 223, each pixel on the photosensor 222 performs photoelectric conversion on the received light signal and accumulates a signal charge corresponding to its respective light reception amount in each pixel. This signal charge is then converted into a voltage signal by an amplifier and output as an imaging signal from the imaging component 22. It is then transmitted to the camera drive module via the communication cable 226, and the camera drive module further transmits the signal to the storage unit in the data processing device 3.

[0069] In this embodiment, the data processing device 3 acquires the signal output by the image sensor 227 through the camera driving module. Specifically, the camera driving module is connected to the controller and synchronized with the reference clock signal input from the controller, sending a driving signal to the image sensor 227. The image sensor 227 then outputs the image signal at a predetermined frame rate based on the driving signal from the camera driving module.

[0070] In this embodiment, the specific imaging process is as follows: Taking a broadband light source as an example, the light source module 11, during the acquisition of a single frame image, performs sequential operations of accumulating signal charge in pixels and reading the accumulated signal charge. In hyperspectral observation mode, the broadband light source is illuminated, and the broadband illumination emitted by it illuminates the observation area. The reflected light from this area is incident on the camera window 225 and imaged onto the surface of the photosensitive sensor 222 of the image sensor 227 by the camera lens 221. Before reaching the surface of the photosensitive sensor 222, the reflected light is first filtered by the filter array 223 for spectral encoding. The light processed by each micro-filter unit is received by its corresponding photoelectric conversion pixel. The image sensor 227, in sync with the reading time, outputs the image signal of each pixel to the camera drive module according to the set frame rate, and the camera drive module transmits it to the storage unit. The operator can select a specific observation mode according to different clinical needs. The controller then provides the image processor with the band information required for image synthesis in the selected observation mode. The image processor then retrieves the two-dimensional image of the corresponding band from the storage unit and performs a spectral image fusion operation on it to form the display image in this observation mode.

[0071] Furthermore, the controller in this embodiment includes a CPU, a ROM storing the control program and the setting data required for control, and RAM functioning as working memory. By running the control program stored in the ROM via the CPU, the controller can control various parts of the image processing device. For example... Figure 3 and Figure 4 As shown, the storage unit first acquires the hyperspectral dataset output by the hyperspectral image sensor 227 and transmits it to the image processor. The image processor then separates the original image signal, which is a mixture of pixel signals (corresponding to each microfilter unit), into single-channel image signals corresponding to each single-channel microfilter unit. It then performs pixel interpolation processing on these single-channel image signals to form a single-channel full-resolution two-dimensional image (for hyperspectral image sensors using full-pass filter units, the above de-mosaicing and pixel interpolation processes are not necessary steps). In addition, the image processor can perform signal processing such as white balance correction on the generated monochrome two-dimensional image. It should be noted that the monochrome two-dimensional image can be as follows: Figure 5 As shown, the image signal is obtained by directly performing pixel interpolation processing on the separated image signal by the image processor; alternatively, it can be obtained as follows: Figure 6 As shown, the mapping parameters are obtained through calculation based on the existing monochrome two-dimensional image dataset and pre-measured mapping parameters.

[0072] After the necessary signal processing described above, the spectral image fusion unit in the image processor performs spectral fusion on the processed color images based on the currently selected viewing mode, thereby forming a complete fused image that highlights the target texture, and outputs this image to the storage unit. The storage unit is responsible for storing the fused image processed by the image processor. Finally, the display control circuit reads the synthesized image data from the storage unit, converts it into a standard video signal such as a composite signal or component signal, and outputs it to the display 4 for display.

[0073] by Figure 7The following example illustrates the processing flow under different observation modes. In observation mode 1 (e.g., simulated white light observation), the image processor generates a fused image M1 based on monochrome two-dimensional images F1 (blue G1), F3 (green G1), F6 (orange A1), and F7 (red R1), which is then output to the display 4. Simultaneously, the image processor evaluates the exposure value of the fused image. If the image is underexposed, the controller increases the output light intensity of the light source module 11; conversely, it reduces the light intensity of the light source module 11 when it is overexposed. When a suspected lesion is found in observation mode 1, the operator can switch to observation mode 2 (e.g., enhanced superficial capillary observation). In this mode, the image processor 222 generates a fused image M2 based on monochrome two-dimensional images F1 (blue B1), F3 (green G1), and F4 (green G2), and outputs the fused image M2 to the display 4.

[0074] Since the fused image in observation mode 1 has one more wavelength of signal than that in observation mode 2, when switching, in order to maintain constant brightness, the image processor will output a new exposure control signal based on the brightness requirements of the fused image M2 in observation mode 2, and the controller will control the light source device 1 to adjust the output light accordingly, so as to ensure that when the operator switches between different observation modes, the brightness of the image displayed on the display 4 in real time will not be affected by the change in observation mode and will not jump.

[0075] In other words, the endoscopic imaging system provided by this invention possesses a "hyperspectral observation mode" for performing spectral analysis on the observed area and generating three-dimensional hyperspectral data. In this mode, the hyperspectral endoscope system not only provides real-time white light images with the same visual effect as the white light observation mode of a conventional endoscope system, but also offers various special observation modes for emphasizing the texture features of the observed area, as well as functional observation modes for measuring physiological indicators of the observed area. For example, the system can use some purple and green band data from the three-dimensional hyperspectral data to synthesize an image emphasizing the observation of capillaries on the mucosal surface; or, using red, green, and blue spectral data with specific wavelengths from the three-dimensional data, an algorithm can be used to calculate a pseudo-color image of the blood oxygen saturation distribution in the corresponding tissue region, etc.

[0076] In this embodiment, a filter array is disposed on the surface of the photosensitive sensor, which can selectively filter light of different wavelengths. Furthermore, the filter array also helps the operator view different fused images, providing image information of different tissue layers of the target object.

[0077] In some alternative implementations, the filter array 223 is an N×N array; wherein the value of N is in the range of 2≤N≤6.

[0078] In this embodiment, the micro-filter units in the filter array 223 are arranged periodically using an N×N array as the basic repeating unit, such as... Figure 2 As shown in the dashed box, a set of 3×3 repeating micro-filter units and the filter array 223 they constitute are illustrated. Similar to a conventional Bayer array, the image sensor 227 equipped with an N×N filter array 223 requires interpolation processing of the pixels within the N×N array to obtain a high-resolution image. This operation is a conventional image de-mosaic process, which will not be described in detail here. For the image sensor 227 using an all-pass filter unit, the above-mentioned de-mosaic process is not a necessary step. Considering that a higher value of N is less conducive to restoring the original image through interpolation, this embodiment recommends that the value of N satisfy: 2≤N≤6; preferably, the value of N satisfies: 3≤N≤5.

[0079] In some alternative implementations, each filter unit 223F of the filter array 223 is a bandpass filter unit; the center wavelength of each bandpass filter unit ranges from 400 nm to 2500 nm.

[0080] In some alternative implementations, each filter unit 223F of the filter array 223 is an all-pass filter unit; the response wavelength of the all-pass filter unit ranges from 400 nm to 2500 nm.

[0081] In the filter array 223, the miniature filter units arranged in front of each pixel element can be bandpass filter units with different center wavelengths and full width at half maximum (FWHM), or all-pass filter units that transmit all wavelengths with different transmittances. By setting different filters, precise selection of light of different wavelengths can be achieved. The configuration of the filters effectively improves the spectral selectivity of the imaging system, enabling the system to capture the details of the target object more accurately while achieving high-precision imaging, reducing unnecessary spectral interference, and thus improving image quality, contrast, and detail resolution.

[0082] This embodiment also provides a hyperspectral endoscope, with reference to Figure 8 As shown, it includes a flexible catheter 6, a bending operating part 7, and an endoscopic imaging system according to any of the above embodiments.

[0083] The bending operation part 7 is connected to the flexible conduit 6; the lens device 2 of the endoscopic imaging system is installed inside the flexible conduit 6.

[0084] The hyperspectral endoscope in this embodiment comprises a flexible conduit 6 inserted into a body cavity, a bending operation section 7 located at the base of the insertion section, and the aforementioned endoscopic imaging system; the bending operation section 7 is connected to the endoscopic imaging system via a cable 8. The flexible conduit 6 of the hyperspectral endoscope consists of a distal tip 61, a bending section 62 capable of bending in multiple directions, and a flexible tube section 63 connecting the bending section 62 and the bending operation section. The bending section 62 is composed of multiple interconnected bending elements; by operating the bending knob on the operation section, it can be bent in the up-down, left-right, and other directions, thereby adjusting the orientation of the tip 61 to the operator's desired direction. The flexible tube section 63 possesses sufficient flexibility to allow it to be smoothly inserted into winding tubular cavities such as the digestive tract.

[0085] The cable 8 internally houses the communication cable 226 and the optical guide 126 extending from the insertion part. At the end of the cable that connects to the host (including the light source device 1 and the data processing device 3), a connector (not shown in the figure) is provided. This connector is a composite connector consisting of a communication connector and a light source connector. The communication connector and the light source connector are respectively connected to the communication cable 226 and the optical guide 126, and can be matched with the corresponding connector ports in the host, thereby establishing a reliable electrical communication and optical transmission path between the electronic endoscope and the host.

[0086] This invention provides a hyperspectral endoscope that avoids the impact of unstable light sources, such as variations in wavelength, intensity, and uniformity, on image quality, effectively improving the imaging quality of hyperspectral endoscopy. It also helps operators view different fused images, providing image information of different tissue layers of the target object.

[0087] Although embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations all fall within the scope defined by the appended claims.

Claims

1. An endoscopic imaging system, characterized in that, The endoscopic imaging system includes: A light source device (1) includes a light source module (11) and a light source adjustment component (12). The light emitted by the light source module (11) is emitted after passing through the light source adjustment component (12). The light source adjustment component (12) is used to adjust the light intensity when it is irradiated onto the target object. The lens device (2) includes a light-emitting component (21) and an imaging component (22). The imaging component (22) includes a camera lens (221) and an image sensor (227). The light-emitting component (21) is used to emit illumination light generated by the light source device (1) toward the target object. The camera lens (221) is used to receive illumination light reflected back from the target object and image it onto the image sensor (227). The data processing device (3) is communicatively connected to the imaging component (22) and is used to acquire spectral data after passing through the imaging component (22) to generate image data corresponding to the target object.

2. The endoscopic imaging system according to claim 1, characterized in that, The light source adjustment component (12) includes: An electric aperture (121) is set in the light-emitting direction of the light source module (11) to adjust the amount of light transmitted.

3. The endoscopic imaging system according to claim 1 or 2, characterized in that, The light source adjustment component (12) includes: A rotating shutter (122) is positioned in the light-emitting direction of the light source module (11); the rotation period of the rotating shutter (122) is synchronized with the exposure period of the endoscope imaging system.

4. The endoscopic imaging system according to claim 3, characterized in that, The light source device (1) further includes: The light emitted by the focusing lens (123) after passing through the light source adjustment component (12) is focused by the focusing lens (123) and then irradiated onto the target object through the light output component (21).

5. The endoscopic imaging system according to claim 4, characterized in that, The light source device (1) includes: A color temperature detection device is used to detect the color temperature of the light emitted by the light source module (11).

6. The endoscopic imaging system according to claim 5, characterized in that, The color temperature detection device includes: An optical beam splitter (124) is disposed in the light output direction of the light source module (11) and is used to guide part of the light emitted by the light source module (11) to the first spectral monitoring unit (125). The first spectral monitoring unit (125) is connected to the data processing device (3), and the first spectral monitoring unit (125) is used to collect the spectral data of the light source module (11); The data processing device (3) is also used to adjust the operating current of the light source module (11) according to the spectral data; Or the color temperature detection device may include: The second spectral monitoring unit (127) is located in the non-controlled area of ​​the rotary shutter (122); the detection end face of the second spectral monitoring unit (127) is arranged parallel to the optical axis of the light source module (11).

7. The endoscopic imaging system according to claim 1, characterized in that, The image sensor (227) includes: A photosensitive sensor (222) is disposed in the light-emitting direction of the camera lens (221); A filter array (223) is disposed on the pixels of the photosensitive sensor (222) and between the camera lens (221) and the photosensitive sensor (222). The filter array (223) is used to filter the illumination light.

8. The endoscopic imaging system according to claim 7, characterized in that, The filter array (223) is an N×N array; where the value of N is 2≤N≤6.

9. The endoscopic imaging system according to claim 7, characterized in that, Each filter unit (223F) of the filter array (223) is a bandpass filter unit; the center wavelength of each bandpass filter unit ranges from 400nm to 2500nm; Alternatively, each filter unit (223F) of the filter array (223) is an all-pass filter unit; the response wavelength of the all-pass filter unit ranges from 400nm to 2500nm.

10. A hyperspectral endoscope, characterized in that, The hyperspectral endoscope includes: a flexible catheter (6), a bending operating part (7), and the endoscope imaging system according to any one of claims 1-9; The bending operation part (7) is connected to the flexible conduit (6); the lens device (2) in the endoscopic imaging system is disposed inside the flexible conduit (6).

Images