Endoscope active coded hyperspectral imaging system and method
Patent Information
- Application Number
- CN202611150649.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-07-31
- Publication Date
- 2026-09-25
AI Technical Summary
[0004]然而,上述技术方案通常需要依次完成多个波长图像的采集,存在光谱采集效率较低、图像采集周期较长的问题,在内窥镜实时成像过程中容易受到组织运动、呼吸及器械抖动等因素的影响,导致不同波长图像之间出现配准误差,影响高光谱图像重建精度
[0030]与现有技术相比,本发明提供的技术方案具有如下有益效果:本发明的一种内窥镜主动编码高光谱成像系统及方法,通过主动编码照明单元、编码同步控制单元、图像采集单元以及图像重建单元之间的协同作用,使系统能够基于编码序列实现多波长光谱信息的获取与重建,能够在保证编码照明与图像采集同步性的基础上,实现多波长光谱信息的高效获取与解耦重建,提高高光谱内窥镜成像的整体一致性与可重复性。
Smart Images

Figure CN122805185A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the fields of medical endoscopic imaging and spectral imaging technology, and in particular to an endoscopic active coding hyperspectral imaging system and method. Background Technology
[0002] An endoscope is a medical device used for observing, diagnosing, and treating internal human tissues. It typically enters the target area through natural body cavities or tiny incisions to achieve real-time imaging of the lesion. With the development of medical imaging technology, hyperspectral imaging technology has been increasingly applied to the field of endoscopy. It can acquire reflectance spectral information of target tissues at multiple wavelengths, providing not only tissue morphology information but also reflecting the spectral characteristics of the tissue. This offers richer information for tissue identification, lesion detection, and intraoperative navigation, thus possessing high clinical application value.
[0003] In related technologies, hyperspectral endoscopic imaging systems typically include an illumination module, an image acquisition module, a control module, a data processing module, and a display module. The illumination module provides illumination light of different wavelengths, the image acquisition module acquires reflected images of the target tissue, the control module controls the illumination and image acquisition process, and the data processing module performs image processing and hyperspectral image reconstruction, thereby achieving hyperspectral imaging of the target tissue. Existing hyperspectral endoscopes typically employ methods such as filter wheel switching, tunable filter switching, or multi-sensor spectral acquisition to obtain image data of different wavelengths and then perform hyperspectral image reconstruction based on the acquisition results.
[0004] However, the aforementioned technical solutions typically require the sequential acquisition of multiple wavelength images, resulting in low spectral acquisition efficiency and long image acquisition cycles. During real-time endoscopic imaging, these solutions are susceptible to factors such as tissue movement, respiration, and instrument vibration, leading to registration errors between different wavelength images and affecting the accuracy of hyperspectral image reconstruction. Furthermore, in existing technologies, illumination control, image acquisition, and image processing are usually independent, making it difficult to ensure a stable correspondence between illumination status and the image acquisition process. This results in low utilization of encoded information, impacting the real-time performance, stability, and reconstruction accuracy of hyperspectral imaging. Summary of the Invention
[0005] The present invention aims to at least partially solve one of the technical problems in the related art.
[0006] Therefore, the purpose of this invention is to propose an endoscopic active coding hyperspectral imaging system and method. By introducing an active coding modulation mechanism at the illumination end and combining it with unified coding synchronization control and image acquisition timing control, information of different wavelengths is superimposed in a coded form within a single acquisition cycle. Then, the reflection information of each wavelength is recovered through decoding. This improves the efficiency of spectral information acquisition while ensuring the real-time performance of image acquisition, and reduces reconstruction errors caused by tissue movement or imaging asynchrony, thereby improving the stability and reconstruction accuracy of hyperspectral imaging.
[0007] To achieve the above objectives, this invention proposes an endoscopic active coding hyperspectral imaging system, comprising:
[0008] The active coding illumination unit is used to generate multiple illumination lights of different wavelengths and actively code and modulate each wavelength illumination light according to the coding sequence output by the coding synchronization control unit to form the coded illumination of the corresponding acquisition frame.
[0009] The encoding synchronization control unit is used to generate the encoding sequence corresponding to the active encoding illumination, and control the active encoding illumination unit to output the corresponding encoding illumination according to the preset encoding sequence. At the same time, it controls the image acquisition unit and the active encoding illumination unit to run synchronously according to the preset timing sequence, so as to establish the correspondence between the encoding illumination and the image acquisition.
[0010] The image acquisition unit is used to receive the reflected light signal formed by the target object under the action of coded illumination, and output the corresponding coded image according to the acquisition timing controlled by the coded synchronization control unit;
[0011] The image reconstruction unit is used to receive multiple coded images output by the image acquisition unit, and combine them with the corresponding coded sequences to recover the reflection information corresponding to multiple wavelengths, thereby generating a hyperspectral image of the target object.
[0012] In addition, the endoscopic active coding hyperspectral imaging system and method proposed above according to the present invention may also have the following additional technical features:
[0013] Specifically, the active coding illumination unit includes multiple illumination sources with different center wavelengths, each illumination source corresponding to a spectral channel. Each spectral channel can perform brightness modulation according to the coding information output by the coding synchronization control unit, and output coded illumination according to the coding state corresponding to different acquisition frames, so as to form an active coding light field for hyperspectral image acquisition.
[0014] Specifically, the encoding synchronization control unit includes an encoding generation module, a timing control module, and a drive control module. The encoding generation module is used to generate an encoding sequence corresponding to active coded lighting.
[0015] The drive control module controls the output of the corresponding encoding state of each spectral channel in the active encoding illumination unit according to the encoding sequence;
[0016] The timing control module is used to control the active coding illumination unit and the image acquisition unit to operate synchronously according to a preset timing sequence, so as to ensure that each acquisition frame corresponds to a unique coding state.
[0017] Specifically, the encoding generation module generates an encoding matrix that satisfies a predetermined encoding rule, and controls each spectral channel in the active encoding illumination unit to form different encoding states in different acquisition frames based on the encoding matrix, so that multiple wavelength information completes active encoding modulation according to a preset encoding relationship.
[0018] Specifically, the encoding synchronization control unit controls encoding loading, image acquisition unit exposure start, active encoding illumination unit output encoding illumination, exposure end and image readout in sequence according to a preset timing sequence, so that each frame of image corresponds to a unique encoding state and establishes a one-to-one correspondence between encoding state and acquired image.
[0019] Specifically, the image acquisition unit uses a synchronous exposure method to complete image acquisition, so that all pixels in the same acquisition frame start and end exposure synchronously under the same coded illumination conditions, thereby ensuring that each pixel corresponds to a consistent illumination environment and improving the accuracy of subsequent spectral recovery.
[0020] Specifically, the system also includes:
[0021] A state compensation unit is used to acquire the working state information of the active coding illumination unit and adjust the output parameters of the active coding illumination unit according to the working state information, so as to reduce the impact of environmental changes or device performance changes on the stability of coding illumination.
[0022] Specifically, the encoding synchronization control unit supports online configuration of at least one of the encoding parameters, exposure parameters, and illumination parameters, and regenerates the corresponding encoding control strategy based on the updated configuration parameters to adapt to the active encoding acquisition requirements of different imaging objects or different hyperspectral imaging modes.
[0023] Specifically, the image reconstruction unit recovers the reflection information corresponding to multiple wavelengths based on the coded image output by the image acquisition unit and the corresponding coding relationship, and constructs the hyperspectral data of the target object based on the recovered reflection information of multiple wavelengths to generate the corresponding hyperspectral image.
[0024] An endoscopic active coding hyperspectral imaging method includes the following steps:
[0025] S1. Establish an active coding sequence and generate coding control information for the corresponding acquisition frame based on the active coding sequence;
[0026] S2. Based on the active coding sequence, control multiple spectral channels to output corresponding coded illumination, so that illumination light of different wavelengths can be actively modulated according to a preset coding relationship;
[0027] S3. Synchronously control the image acquisition unit to complete the acquisition of the corresponding encoded image, so that each acquisition frame establishes a unique correspondence with the corresponding encoding state;
[0028] S4. Decode the multiple coded images acquired based on the active coding sequence to recover the reflectance spectral information corresponding to multiple wavelengths;
[0029] S5. Construct hyperspectral data of the target object based on the recovered multi-wavelength reflectance spectral information, and generate the corresponding hyperspectral image.
[0030] Compared with the prior art, the technical solution provided by the present invention has the following beneficial effects: The endoscope active coding hyperspectral imaging system and method of the present invention, through the synergistic effect between the active coding illumination unit, the coding synchronization control unit, the image acquisition unit and the image reconstruction unit, enables the system to acquire and reconstruct multi-wavelength spectral information based on the coding sequence. It can achieve efficient acquisition and decoupled reconstruction of multi-wavelength spectral information while ensuring the synchronization of coding illumination and image acquisition, thereby improving the overall consistency and repeatability of hyperspectral endoscope imaging. Attached Figure Description
[0031] The above and / or additional aspects and advantages of the present invention will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:
[0032] Figure 1 This is a structural diagram of an endoscope active coding hyperspectral imaging system according to the present invention.
[0033] Figure 2 This is a structural diagram of the coding illumination unit of an endoscope active coding hyperspectral imaging system according to the present invention;
[0034] Figure 3 This is a structural diagram of the coding synchronization control unit of an endoscope active coding hyperspectral imaging system according to the present invention;
[0035] Figure 4 This is a structural diagram of the image acquisition and synchronous exposure of an endoscope active coding hyperspectral imaging system according to the present invention;
[0036] Figure 5 This is a system flowchart of an endoscope active coding hyperspectral imaging system according to the present invention;
[0037] Figure 6 This is a diagram showing the coding, acquisition, and decoupling relationships of an endoscope active coding hyperspectral imaging system according to the present invention. Detailed Implementation
[0038] Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain the invention, and should not be construed as limiting the invention. Rather, embodiments of the invention include all variations, modifications, and equivalents falling within the spirit and scope of the appended claims.
[0039] The following description, in conjunction with the accompanying drawings, illustrates an endoscopic active coding hyperspectral imaging system and method according to an embodiment of the present invention.
[0040] Example 1
[0041] like Figure 1 As shown in the figure, an endoscopic active coding hyperspectral imaging system and method according to an embodiment of the present invention includes an active coding illumination unit, which generates multiple illumination lights of different wavelengths and performs active coding modulation on each wavelength illumination light according to the coding sequence output by the coding synchronization control unit to form the coded illumination of the corresponding acquisition frame.
[0042] The encoding synchronization control unit is used to generate the encoding sequence corresponding to the active encoding illumination, and control the active encoding illumination unit to output the corresponding encoding illumination according to the preset encoding sequence. At the same time, it controls the image acquisition unit and the active encoding illumination unit to run synchronously according to the preset timing sequence, so as to establish the correspondence between the encoding illumination and the image acquisition.
[0043] The image acquisition unit is used to receive the reflected light signal formed by the target object under the action of coded illumination, and output the corresponding coded image according to the acquisition timing controlled by the coded synchronization control unit;
[0044] The image reconstruction unit receives multiple coded images output by the image acquisition unit and combines them with the corresponding coded sequences to recover the reflection information corresponding to multiple wavelengths, thereby generating a hyperspectral image of the target object.
[0045] It should be noted that the active coded illumination unit is used to provide a multi-wavelength illumination source for endoscopic imaging. It may include multiple light source structures with different center wavelengths. Each light source can be modulated in brightness or on / off state according to a preset coded state under control to form a coded illumination light field for hyperspectral imaging.
[0046] Preferably, the light sources can be arranged in an array in space to meet the integration requirements of miniaturized endoscope front ends.
[0047] The encoding synchronization control unit is used to uniformly control the entire imaging process. It can generate encoding sequences to drive the active encoding illumination unit and organize the encoding sequences in a time sequence so that different acquisition frames correspond to different encoding states.
[0048] Meanwhile, the encoding synchronization control unit is also used to synchronize the working timing of the image acquisition unit, so that the lighting state and the image acquisition process maintain a corresponding relationship in the time dimension.
[0049] Preferably, the encoding synchronization control unit can adjust the encoding sequence according to different imaging modes to adapt to different spectral resolution requirements.
[0050] The image acquisition unit is used to receive the reflected light signal formed by the target object under coded illumination, and convert the light signal into image data in the form of an electrical signal for output.
[0051] During the acquisition process, the image acquisition unit operates according to the timing provided by the encoding synchronization control unit, so that each acquisition frame corresponds to a specific encoding illumination state, thereby forming an encoded image sequence that corresponds one-to-one with the encoding sequence.
[0052] Preferably, the image acquisition unit can adopt an array-type image sensing structure to improve the consistency of spatial information acquisition.
[0053] The image reconstruction unit is used to process multiple coded images output by the image acquisition unit. Based on the coding sequence information provided by the coding synchronization control unit, it parses and reconstructs the image data of different acquisition frames, thereby restoring the reflection information of the target object at multiple wavelengths and generating the corresponding hyperspectral image data.
[0054] Preferably, the image reconstruction unit can use matrix operations to decouple and restore the encoded information.
[0055] Specifically, during system operation, the encoding synchronization control unit first generates an encoding sequence corresponding to the imaging mode and outputs control signals to the active encoding illumination unit according to a preset timing sequence, so that the active encoding illumination unit outputs multi-wavelength encoded illumination light according to the corresponding encoding state. At the same time, the encoding synchronization control unit synchronously controls the image acquisition unit to acquire images according to the corresponding timing sequence, so that the acquisition result of each frame is consistent with the corresponding encoding state. The image acquisition unit outputs the acquired encoded image to the image reconstruction unit, which analyzes the encoded image based on the encoding sequence, thereby completing the recovery of multi-wavelength spectral information and the generation of hyperspectral images.
[0056] Example 2
[0057] like Figure 2As shown in the embodiment of the present invention, an endoscopic active coding hyperspectral imaging system and method are provided. The active coding illumination unit is used to generate multiple illumination lights of different wavelengths and to actively code and modulate each wavelength illumination light according to the coding sequence output by the coding synchronization control unit to form a coded illumination light field for the corresponding acquisition frame.
[0058] It should be noted that the active coding illumination unit is used to provide the basis for multi-wavelength optical illumination. It includes multiple illumination sources that can emit light of different center wavelengths. Each illumination source is used to cover different spectral channels, thereby providing basic spectral information input for hyperspectral imaging.
[0059] Preferably, each illumination source can be selected with different wavelength distributions according to actual imaging needs to cover the reflectance spectrum range of the target tissue.
[0060] Each illumination source is used to achieve adjustable output of brightness state under the control of the encoding synchronization control unit, so that each spectral channel changes according to the preset encoding state in different acquisition frames, thereby forming an encoded illumination light output with time-varying characteristics.
[0061] This coded lighting state is used to correspond to the acquisition timing of the image acquisition unit in order to establish a correspondence between lighting information and image information.
[0062] In one alternative implementation, each illumination source can be implemented using solid-state light-emitting devices, which have the characteristics of fast response speed and easy array integration, thus being suitable for the integration requirements of miniaturized endoscope spatial structures.
[0063] Preferably, each lighting source can be arranged in an array or modular manner to improve the integration of spectral channels and space utilization efficiency.
[0064] The active coding illumination unit is also used to modulate the brightness or on / off state of illumination light of different wavelengths under the control signal provided by the coding synchronization control unit, so that it presents different coding combination states in different acquisition frames, thereby forming a coding illumination sequence for hyperspectral imaging.
[0065] In some embodiments, the active coding illumination unit may also include a drive control structure for driving each illumination source to work, for receiving control signals output by the coding synchronization control unit, and converting the control signals into drive currents or drive duty cycles corresponding to each illumination source, thereby achieving precise control of the output state of illumination light of each wavelength.
[0066] During operation, each lighting source switches states in the time dimension according to the coding sequence, so that different wavelengths of light are combined and output in different acquisition frames according to a predetermined coding relationship, thereby forming a multi-wavelength composite lighting light field with coding characteristics.
[0067] During system operation, the active coding illumination unit outputs multi-wavelength illumination light corresponding to the coding state under the control of the coding synchronization control unit, and maintains time synchronization with the acquisition process of the image acquisition unit, so that each acquisition frame corresponds to a unique illumination coding state, thereby providing basic data conditions for the subsequent image reconstruction unit to recover spectral information.
[0068] Example 3
[0069] like Figure 3 As shown in the embodiment of the present invention, an endoscopic active coding hyperspectral imaging system and method are provided. The coding synchronization control unit is used to generate a coding sequence corresponding to the active coding illumination and control the active coding illumination unit to output the corresponding coding illumination according to the preset coding sequence. At the same time, the image acquisition unit and the active coding illumination unit are controlled to run synchronously according to the preset timing sequence to establish the correspondence between the coding illumination and the image acquisition.
[0070] It should be noted that:
[0071] The encoding synchronization control unit is used to perform unified timing control of the entire active encoding hyperspectral imaging process. Its core function is to synchronize and coordinate the encoding illumination process and the image acquisition process, so that the illumination state and the image acquisition state corresponding to different acquisition frames maintain a deterministic correspondence in the time dimension.
[0072] The encoding synchronization control unit includes an encoding generation module, a timing control module, and a drive control module. The encoding generation module generates an encoding sequence for hyperspectral imaging, which characterizes the state combination relationship of different spectral channels in different acquisition frames to construct a multi-frame coded illumination structure.
[0073] Preferably, the encoding sequence can be adjusted according to different imaging modes to adapt to different spectral resolutions or acquisition speed requirements.
[0074] The timing control module is used to schedule and control the entire imaging process. It defines the sequential relationship between encoding loading, image acquisition startup, exposure process control, and image readout process, so that each processing stage is executed in sequence according to the predetermined timing, thereby ensuring that the imaging conditions of each acquisition frame are consistent and repeatable.
[0075] The drive control module is used to convert the encoded sequence into control signals for the active coded illumination unit, and modulate the output state of each wavelength of illumination light according to the encoding state corresponding to the current acquisition frame, thereby realizing dynamic output control of coded illumination.
[0076] Preferably, the drive control module can differentiate the control signal according to the characteristics of different spectral channels to improve the consistency of lighting output.
[0077] In one optional embodiment, the encoding synchronization control unit is also used to synchronously control the exposure process of the image acquisition unit, so that the image acquisition unit completes the exposure during the stable period of the encoding illumination state and completes the image signal acquisition within the corresponding time window, thereby ensuring a one-to-one correspondence between the acquired image and the encoding state.
[0078] In another implementation, the encoding synchronization control unit can also dynamically adjust the encoding sequence and acquisition timing according to the externally input imaging parameters, enabling the system to achieve adaptive encoding control and synchronous acquisition in different working modes.
[0079] During system operation, the encoding synchronization control unit first generates an encoding sequence corresponding to the imaging task, and then controls the active encoding illumination unit to output the corresponding encoding illumination state according to the encoding sequence. At the same time, it controls the image acquisition unit to perform synchronous acquisition according to the corresponding time window, so that each frame of image data corresponds to a unique encoding state, and finally provides a stable encoding image input basis for the image reconstruction unit.
[0080] Example 4
[0081] like Figure 4 As shown in the embodiment of the present invention, an endoscopic active coding hyperspectral imaging system and method are provided. The image acquisition unit is used to receive the reflected light signal formed by the target object under the action of the active coding illumination unit, and convert it into a corresponding coded image and output it to the image reconstruction unit. The image reconstruction unit is used to recover the reflection information corresponding to multiple wavelengths based on the coded image and the corresponding coding sequence, and generate a hyperspectral image of the target object.
[0082] It should be noted that the image acquisition unit is used to acquire the reflected light signal of the target object under coded illumination. It includes an imaging structure for photoelectric conversion, which can convert the incident optical signal into image data in the form of an electrical signal for output.
[0083] During the acquisition process, the image acquisition unit operates according to the timing signal provided by the encoding synchronization control unit, so that different acquisition frames correspond to different encoding lighting states, thereby forming a set of encoded image data with time sequence characteristics.
[0084] The image acquisition unit uses a synchronous exposure method for image acquisition. The synchronous exposure method is used to ensure that all pixels in the image acquisition unit start and end exposure at the same time within the same time window, thereby ensuring that all pixels in the same acquisition frame are under the same lighting conditions.
[0085] Preferably, synchronous exposure can be achieved through a global triggering mechanism to reduce time deviations caused by line-by-line exposure or time-sharing exposure.
[0086] By adopting a synchronous exposure mechanism, the lighting conditions received by each pixel in a single acquisition frame remain consistent over time, thereby avoiding the problem of inconsistent lighting conditions caused by time differences and providing a consistent data foundation for subsequent encoding decoupling.
[0087] The image reconstruction unit processes the coded image output by the image acquisition unit. Based on the coding sequence provided by the coding synchronization control unit, it decouples the image data between different acquisition frames according to the coding relationship, thereby separating the multi-wavelength spectral information superimposed on the image data into the reflection intensity information corresponding to each independent wavelength.
[0088] In a preferred embodiment, the image reconstruction unit establishes a correspondence between the encoding matrix and the acquired images, and performs matrix-based decoupling processing on the encoded image sequence, so that the reflection information of each pixel at different wavelengths can be recovered from multiple frames of encoded images, thereby constructing a complete hyperspectral data structure.
[0089] During system operation, the image acquisition unit completes multi-frame synchronous exposure acquisition under the control of the encoding synchronization control unit, so that each frame of image corresponds to a unique encoded illumination state; the image reconstruction unit performs decoding operations on the encoded image based on this correspondence, realizes the separation and reconstruction of different wavelength information, and thus completes the generation of hyperspectral image of the target object.
[0090] When this system is in use, the encoding synchronization control unit first generates the encoding sequence corresponding to the active encoding illumination according to the preset imaging mode, and then sends the encoding sequence to the active encoding illumination unit and the image acquisition unit respectively.
[0091] Under the control of the encoding synchronization control unit, the active encoding illumination unit actively encodes and modulates multiple illumination lights of different wavelengths according to the encoding sequence, and outputs the encoded illumination light field of the corresponding acquisition frame, thereby providing the target object with multi-wavelength illumination conditions with time-encoded characteristics.
[0092] Under the timing control of the encoding synchronization control unit, the image acquisition unit receives the reflected light signal formed by the target object under the coded illumination and completes the image acquisition by using synchronous exposure mode, so that all pixels in the same acquisition frame are exposed at the same time window, thereby forming an encoded image that corresponds one-to-one with the encoding sequence.
[0093] The image acquisition unit outputs the acquired coded images to the image reconstruction unit in the order of acquisition.
[0094] The image reconstruction unit performs decoding operations on the encoded images corresponding to multiple acquisition frames based on the encoding sequence provided by the encoding synchronization control unit, separates the multi-wavelength spectral information superimposed on the image data, recovers the reflection information corresponding to multiple wavelengths, and generates a hyperspectral image of the target object.
[0095] Through the above process, a correspondence based on the coding sequence is formed between the active coding illumination unit, the coding synchronization control unit, the image acquisition unit, and the image reconstruction unit, thereby realizing the acquisition and reconstruction of multi-wavelength spectral information.
[0096] In summary, the endoscopic active coding hyperspectral imaging system and method of this invention enables the system to acquire and reconstruct multi-wavelength spectral information based on the coding sequence through the synergistic effect between the active coding illumination unit, the coding synchronization control unit, the image acquisition unit, and the image reconstruction unit.
[0097] By employing an active coding illumination method, multiple illumination lights of different wavelengths can be actively coded and modulated according to a coding sequence, thereby forming a multi-wavelength illumination light field with time-coded characteristics and maintaining temporal synchronization with the image acquisition process. A coding synchronization control unit performs unified temporal control on the active coding illumination unit and the image acquisition unit, ensuring a temporal correspondence between the coded illumination state and the image acquisition process, thus improving the deterministic matching degree between the illumination state and the acquired image. The image acquisition unit uses a synchronous exposure method, ensuring that all pixels within the same acquisition frame are exposed simultaneously within the same time window, thereby guaranteeing consistent illumination conditions for each pixel within the same acquisition frame and reducing illumination inconsistencies caused by time differences. The image reconstruction unit performs decoding operations on the coded images corresponding to multiple acquisition frames based on the coding sequence, separating the multi-wavelength spectral information superimposed on the image data and recovering the reflection information corresponding to multiple wavelengths, thereby generating a hyperspectral image.
[0098] Therefore, this invention can achieve efficient acquisition and decoupled reconstruction of multi-wavelength spectral information while ensuring the synchronization of coded illumination and image acquisition, thereby improving the overall consistency and repeatability of hyperspectral endoscopic imaging.
[0099] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.
Claims
1. An endoscopic active coding hyperspectral imaging system, characterized in that, include: The active coding illumination unit is used to generate multiple illumination lights of different wavelengths and actively code and modulate each wavelength illumination light according to the coding sequence output by the coding synchronization control unit to form the coded illumination of the corresponding acquisition frame. The encoding synchronization control unit is used to generate the encoding sequence corresponding to the active encoding illumination, and control the active encoding illumination unit to output the corresponding encoding illumination according to the preset encoding sequence. At the same time, it controls the image acquisition unit and the active encoding illumination unit to run synchronously according to the preset timing sequence, so as to establish the correspondence between the encoding illumination and the image acquisition. The image acquisition unit is used to receive the reflected light signal formed by the target object under the action of coded illumination, and output the corresponding coded image according to the acquisition timing controlled by the coded synchronization control unit; The image reconstruction unit is used to receive multiple coded images output by the image acquisition unit, and combine them with the corresponding coded sequences to recover the reflection information corresponding to multiple wavelengths, thereby generating a hyperspectral image of the target object.
2. The endoscopic active coding hyperspectral imaging system according to claim 1, characterized in that, The active coding illumination unit includes multiple illumination sources with different center wavelengths. Each illumination source corresponds to a spectral channel. Each spectral channel can perform brightness modulation according to the coding information output by the coding synchronization control unit, and output coded illumination according to the coding state corresponding to different acquisition frames to form an active coding light field for hyperspectral image acquisition.
3. The endoscopic active coding hyperspectral imaging system according to claim 1, characterized in that, The encoding synchronization control unit includes an encoding generation module, a timing control module, and a drive control module. The encoding generation module is used to generate an encoding sequence corresponding to active coded lighting. The drive control module controls the output of the corresponding encoding state of each spectral channel in the active encoding illumination unit according to the encoding sequence; The timing control module is used to control the active coding illumination unit and the image acquisition unit to operate synchronously according to a preset timing sequence, so as to ensure that each acquisition frame corresponds to a unique coding state.
4. The endoscopic active coding hyperspectral imaging system according to claim 3, characterized in that, The encoding generation module generates an encoding matrix that satisfies a predetermined encoding rule, and controls each spectral channel in the active encoding illumination unit to form different encoding states in different acquisition frames based on the encoding matrix, so that multiple wavelength information completes active encoding modulation according to a preset encoding relationship.
5. The endoscopic active coding hyperspectral imaging system according to claim 1, characterized in that, The encoding synchronization control unit controls the encoding loading, the image acquisition unit to start exposure, the active encoding illumination unit to output encoding illumination, the exposure to end, and the image readout in sequence according to a preset timing sequence, so that each frame of image corresponds to a unique encoding state and establishes a one-to-one correspondence between the encoding state and the acquired image.
6. The endoscopic active coding hyperspectral imaging system according to claim 1, characterized in that, The image acquisition unit uses a synchronous exposure method to complete image acquisition, so that all pixels in the same acquisition frame start and end exposure synchronously under the same coded illumination conditions, thereby ensuring that each pixel corresponds to a consistent illumination environment and improving the accuracy of subsequent spectral recovery.
7. The endoscopic active coding hyperspectral imaging system according to claim 1, characterized in that, The system also includes: A state compensation unit is used to acquire the working state information of the active coding illumination unit and adjust the output parameters of the active coding illumination unit according to the working state information, so as to reduce the impact of environmental changes or device performance changes on the stability of coding illumination.
8. The endoscopic active coding hyperspectral imaging system and method according to claim 1, characterized in that, The encoding synchronization control unit supports online configuration of at least one of the encoding parameters, exposure parameters, and illumination parameters, and regenerates the corresponding encoding control strategy based on the updated configuration parameters to adapt to the active encoding acquisition requirements of different imaging objects or different hyperspectral imaging modes.
9. An endoscopic active coding hyperspectral imaging system according to claim 1, characterized in that, The image reconstruction unit recovers the reflection information corresponding to multiple wavelengths based on the coded image output by the image acquisition unit and the corresponding coding relationship, and constructs the hyperspectral data of the target object based on the recovered reflection information of multiple wavelengths to generate the corresponding hyperspectral image.
10. An endoscopic active coding hyperspectral imaging method for implementing and operating the precise thermal runaway fire suppression system for an energy storage power station as described in claims 1-9, characterized in that: Includes the following steps: S1. Establish an active coding sequence and generate coding control information for the corresponding acquisition frame based on the active coding sequence; S2. Based on the active coding sequence, control multiple spectral channels to output corresponding coded illumination, so that illumination light of different wavelengths can be actively modulated according to a preset coding relationship; S3. Synchronously control the image acquisition unit to complete the acquisition of the corresponding encoded image, so that each acquisition frame establishes a unique correspondence with the corresponding encoding state; S4. Decode the multiple coded images acquired based on the active coding sequence to recover the reflectance spectral information corresponding to multiple wavelengths; S5. Construct hyperspectral data of the target object based on the recovered multi-wavelength reflectance spectral information, and generate the corresponding hyperspectral image.