Stable multimode fiber wide-field imaging method
By using a multimode fiber wide-field imaging system with dual-wavelength laser incident light, combined with image reconstruction and fiber morphology recognition models, the imaging stability problem of multimode fiber imaging systems under morphological changes is solved, achieving high-precision image reconstruction and improved system flexibility.
Patent Information
- Application Number
- CN202511624408.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-07
- Publication Date
- 2026-02-13
AI Technical Summary
Multimode fiber imaging systems exhibit poor imaging stability under changes in fiber morphology or external disturbances, making it difficult for existing methods to achieve high-precision image reconstruction, thus limiting their flexibility and practicality in real-world applications.
A multimode fiber wide-field imaging system based on dual-wavelength laser incident is adopted. By acquiring probe light and reference light signals, an image reconstruction model database and fiber optic morphology recognition model are established. The fiber optic morphology is identified in real time, and an appropriate image reconstruction model is selected for imaging.
It achieves high-precision image reconstruction of multimode fiber imaging systems under fiber morphology changes, improves imaging stability and flexibility, and is suitable for scenarios such as fiber bundle imaging and scattering medium imaging.
Smart Images
Figure CN121512418A_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of multimode fiber imaging technology, and in particular, a stable multimode fiber wide-field imaging method. Background Technology
[0002] Single-strand multimode optical fibers can be used as independent components for target imaging, and have the potential to serve as ultra-micro endoscopes for scanning-free wide-field imaging of small cavities in the human body, showing broad application prospects in the field of medical endoscopy. However, due to the inherent mode coupling and mode dispersion characteristics of multimode fibers, images transmitted through multimode fibers will form random speckle patterns, requiring image reconstruction. Based on a series of known input images and output speckle patterns, transfer matrices or deep learning methods are often used to calibrate the transmission characteristics of the fiber, thereby constructing an image reconstruction model. Currently, researchers have achieved high-fidelity multimode fiber imaging.
[0003] Despite the immense application potential of multimode fiber imaging, its imaging stability remains a significant bottleneck limiting its application. Currently, most research on wide-field image transmission based on multimode fibers is conducted with the fiber stationary. Changes in fiber morphology or external disturbances severely impact the light transmission process within the multimode fiber, altering the speckle pattern of the output and degrading the performance of existing image reconstruction models. In practical applications, fiber morphology changes and external disturbances are unavoidable, requiring recalibration of the multimode fiber's transmission characteristics, which severely restricts the flexibility and practicality of multimode fiber systems. Researchers have attempted to train general image reconstruction models using deep learning combined with extensive data on fiber morphologies, but have failed to achieve high-precision image reconstruction under unknown fiber morphologies. Furthermore, researchers have tried adding metasurface structures to the fiber endface and calibrating the multimode fiber's transmission characteristics by measuring reflected signals, but the computation time is very long. Therefore, existing methods are insufficient for achieving stable wide-field imaging with multimode fibers.
[0004] In summary, existing multimode fiber wide-field imaging methods require the fiber to remain stationary, resulting in poor flexibility and practicality of the imaging system. Therefore, it is necessary to develop a stable multimode fiber wide-field imaging method to reduce the impact of fiber morphology changes on imaging. Summary of the Invention
[0005] The purpose of this invention is to provide a stable multimode fiber wide-field imaging method to address the problems existing in the prior art.
[0006] The technical solution to achieve the objective of this invention is as follows: On the one hand, a stable multimode fiber wide-field imaging method is provided, the method comprising the following steps:
[0007] Step 1: Establish a multimode fiber wide-field imaging system based on dual-wavelength laser incident light;
[0008] Step 2: Based on the multimode fiber wide-field imaging system, acquire a large number of probe light signals and reference light signals of the target image under different fiber optic configurations;
[0009] Step 3: Establish an image reconstruction model database and a fiber optic morphology recognition model;
[0010] Step 4: For cases where the fiber optic morphology is unknown, the fiber optic morphology is identified using a fiber optic morphology recognition model, and an image reconstruction model is selected based on the fiber optic morphology results to calculate and obtain the reconstructed image.
[0011] Further, in step 1, the multimode fiber wide-field imaging system specifically comprises:
[0012] The illumination source consists of two lasers of different wavelengths, which emit probe light and reference light respectively;
[0013] Adding a filter to the imaging end face of a multimode fiber enables selective transmission and reflection of the probe light and the reference light.
[0014] The probe light and reference light are simultaneously coupled into the multimode fiber. The reference light is reflected by a filter at the imaging end face of the multimode fiber, and the returned reference light signal carries fiber morphology information and is collected by the first detector. The probe light is transmitted through a filter at the imaging end face of the multimode fiber and shines on the imaging target. The probe light signal carrying the target image information is collected by the multimode fiber, transmitted, and then collected by the second detector.
[0015] Furthermore, the laser is a continuous laser source.
[0016] Furthermore, the reference optical signal is an image signal or a spectral signal.
[0017] Furthermore, in step 3, an image reconstruction model database is established, specifically including:
[0018] Based on the "target image - probe light signal" data combination obtained in step 2 under a certain fiber optic configuration, an image reconstruction model adapted to a certain fiber optic configuration is established using a deep learning algorithm.
[0019] Further, an image reconstruction model database adapted to different fiber optic morphologies is constructed, namely {fiber optic morphology k — image reconstruction model k}, k∈[1, n]; n is the total number of fiber optic morphologies or the total number of image reconstruction models.
[0020] Furthermore, step 3 involves establishing a fiber optic morphology recognition model, specifically including:
[0021] Based on all the "fiber morphology-reference optical signal" data combinations obtained in step 2, a fiber morphology recognition model is established using machine learning algorithms.
[0022] Further, step 4 specifically includes: for the unknown "fiber morphology-reference optical signal-probe optical signal", the reference optical signal is processed using the fiber morphology recognition model to obtain the current fiber morphology, and then the image reconstruction model under the corresponding fiber morphology is selected from the image reconstruction model database to process the probe optical signal to obtain the reconstructed image.
[0023] On the other hand, a stable multimode fiber wide-field imaging system is provided, the system comprising:
[0024] The first module is used to establish a multimode fiber wide-field imaging system based on dual-wavelength laser incident;
[0025] The second module is used to acquire a large number of probe light signals and reference light signals of target images under different fiber optic configurations based on the multimode fiber wide-field imaging system.
[0026] The third module is used to establish an image reconstruction model database and a fiber optic morphology recognition model.
[0027] The fourth module is used to identify the fiber morphology using a fiber morphology recognition model when the fiber morphology is unknown, and to select an image reconstruction model based on the fiber morphology result to calculate and obtain the reconstructed image.
[0028] On the other hand, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the stable multimode fiber wide-field imaging method.
[0029] On the other hand, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the stable multimode fiber wide-field imaging method.
[0030] Compared with the prior art, the significant advantages of this invention are:
[0031] (1) The multimode fiber wide-field imaging system based on dual-wavelength laser incident can use the probe light and the reference light to record image information and fiber morphology information respectively.
[0032] (2) The morphological information of multimode fiber is implied in the reference optical signal. By establishing a model through deep learning algorithm, the unknown morphology of multimode fiber can be identified.
[0033] (3) An image reconstruction model database adapted to different fiber optic morphologies was established. During the imaging process, the image reconstruction model can be matched with the database by identifying the fiber optic morphology in real time, which greatly improves the imaging accuracy and stability.
[0034] (3) The method proposed in this invention can be applied to other imaging technologies, such as fiber bundle imaging and scattering medium imaging. The imaging effect of the system will be affected by the state changes of the transmission medium (fiber bundle, scattering medium, etc.). By constructing an imaging model database under different states, the appropriate model can be selected for stable imaging using real-time state perception.
[0035] The present invention will now be described in further detail with reference to the accompanying drawings. Attached Figure Description
[0036] Figure 1 This is a schematic diagram of a multimode fiber wide-field imaging system in one embodiment.
[0037] Figure 2 This is a schematic diagram illustrating the acquisition of a large number of probe optical signals and reference optical signals under different optical fiber configurations in one embodiment.
[0038] Figure 3 This is a schematic diagram illustrating the establishment of an image reconstruction model database in one embodiment.
[0039] Figure 4 This is a schematic diagram of establishing a fiber optic morphology recognition model in one embodiment.
[0040] Figure 5 This is a schematic diagram illustrating image reconstruction for an unknown fiber optic configuration in one embodiment.
[0041] Figure 6 This is a schematic diagram of the reconstructed image in one embodiment, wherein Figure 6 In the diagram, 'a' represents the image reconstruction model for a specific fiber optic configuration. When the fiber optic configuration is stationary, the diagram shows the reconstructed image result. Figure 6 In the figure, b is a schematic diagram of the imaging result obtained by using the method of the present invention to sense changes in the shape of optical fibers in real time and select the corresponding image reconstruction model. Detailed Implementation
[0042] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0043] It should be noted that if the embodiments of the present invention involve descriptions such as "first" and "second," these descriptions are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include at least one of those features. Furthermore, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. When the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed by the present invention.
[0044] In one embodiment, a stable multimode fiber wide-field imaging method is provided, the method comprising the following steps:
[0045] Step 1: Establish a multimode fiber wide-field imaging system based on dual-wavelength laser incident light;
[0046] Step 2: Based on the multimode fiber wide-field imaging system, acquire a large number of probe light signals and reference light signals of the target image under different fiber optic configurations;
[0047] Here, under a fixed multimode fiber configuration, a spatial light modulator projects a series of different target images, acquiring corresponding probe and reference optical signals. Each target image corresponds to a set of reference and probe optical signals. For example... Figure 2 As shown, the morphology of the multimode fiber was artificially altered to collect a large number of probe and reference optical signals under different fiber morphologies. Ultimately, a data combination of "fiber morphology - target image - probe optical signal - reference optical signal" was established.
[0048] Here, the reference optical signal is an image signal or a spectral signal.
[0049] Step 3: Establish an image reconstruction model database and a fiber optic morphology recognition model;
[0050] Step 4: For cases where the fiber optic morphology is unknown, the fiber optic morphology is identified using a fiber optic morphology recognition model, and an image reconstruction model is selected based on the fiber optic morphology results to calculate and obtain the reconstructed image.
[0051] Furthermore, in one embodiment, in step 1, combining Figure 1 The multimode fiber wide-field imaging system is specifically as follows:
[0052] The illumination source consists of two lasers of different wavelengths, which emit probe light and reference light respectively;
[0053] Adding a filter to the imaging end face of a multimode fiber enables selective transmission and reflection of the probe light and the reference light.
[0054] The probe light and reference light are simultaneously coupled into the multimode fiber. The reference light is reflected by a filter at the imaging end face of the multimode fiber, and the returned reference light signal carries fiber morphology information and is collected by the first detector. The probe light is transmitted through a filter at the imaging end face of the multimode fiber and shines on the imaging target. The probe light signal carrying the target image information is collected by the multimode fiber, transmitted, and then collected by the second detector.
[0055] Preferably, the laser can be a high-power continuous laser source or a low-power continuous laser source, and the spectral range of the laser can be wide or narrow, ensuring that the stable multimode fiber wide-field imaging method remains effective.
[0056] Furthermore, in one embodiment, combined with Figure 3 In step 3, an image reconstruction model database is established, which specifically includes:
[0057] Based on the "target image - probe light signal" data combination obtained in step 2 under a certain fiber optic configuration, an image reconstruction model adapted to a certain fiber optic configuration is established using a deep learning algorithm.
[0058] Further, an image reconstruction model database adapted to different fiber optic morphologies is constructed, namely {fiber optic morphology k — image reconstruction model k}, k∈[1, n]; n is the total number of fiber optic morphologies or the total number of image reconstruction models.
[0059] Here, the input data of the image reconstruction model is the probe light signal, and the output data is the corresponding known target image.
[0060] Here, based on the set loss function, the gradient descent algorithm is used to optimize the model parameters. After multiple rounds of iterative optimization, the image reconstruction model under this fiber optic morphology is obtained.
[0061] Here, any deep learning algorithm can be used to construct an image reconstruction model, such as convolutional neural networks, U-Net networks, etc. Different deep learning methods will not affect the stability of multimode fiber wide-field imaging.
[0062] Furthermore, in one embodiment, combined with Figure 4 Step 3 involves establishing a fiber optic morphology recognition model, specifically including:
[0063] Based on all the "fiber morphology-reference optical signal" data combinations obtained in step 2, a fiber morphology recognition model is established using machine learning algorithms or convolutional neural networks.
[0064] Here, the input data for the fiber optic morphology recognition model is the reference optical signal, and the output data is the known multimode fiber morphology category.
[0065] Here, based on the set loss function, the gradient descent algorithm is used to optimize the model parameters. After multiple rounds of iterative optimization, the fiber optic morphology recognition model is obtained.
[0066] Furthermore, in one embodiment, combined with Figure 5 Step 4 specifically includes: for the unknown "fiber morphology-reference light signal-probe light signal", the reference light signal is processed using the fiber morphology recognition model to obtain the current fiber morphology. Then, the image reconstruction model under the corresponding fiber morphology is selected from the image reconstruction model database to process the probe light signal and obtain the reconstructed image.
[0067] In one embodiment, a stable multimode fiber wide-field imaging system is provided, the system comprising:
[0068] The first module is used to establish a multimode fiber wide-field imaging system based on dual-wavelength laser incident;
[0069] The second module is used to acquire a large number of probe light signals and reference light signals of target images under different fiber optic configurations based on the multimode fiber wide-field imaging system.
[0070] The third module is used to establish an image reconstruction model database and a fiber optic morphology recognition model.
[0071] The fourth module is used to identify the fiber morphology using a fiber morphology recognition model when the fiber morphology is unknown, and to select an image reconstruction model based on the fiber morphology result to calculate and obtain the reconstructed image.
[0072] Specific limitations regarding stable multimode fiber wide-field imaging systems can be found in the limitations of stable multimode fiber wide-field imaging methods described above, and will not be repeated here. Each module in the aforementioned stable multimode fiber wide-field imaging system can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the computer device's memory as software, allowing the processor to call and execute the corresponding operations of each module.
[0073] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the stable multimode fiber wide-field imaging method.
[0074] For specific limitations on each step, please refer to the limitations on stable multimode fiber wide-field imaging methods mentioned above, which will not be repeated here.
[0075] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the stable multimode fiber wide-field imaging method.
[0076] For specific limitations on each step, please refer to the limitations on stable multimode fiber wide-field imaging methods mentioned above, which will not be repeated here.
[0077] As a specific example, the invention will be further described in one embodiment. For example... Figure 6 As shown in (a) of the diagram, for an image reconstruction model with a certain fiber optic configuration, a clear reconstructed image can be obtained when the fiber optic configuration is stationary. However, when the fiber optic configuration changes, the imaging quality of this image reconstruction model deteriorates significantly. Figure 6 As shown in (b) of this paper, when using the method proposed in this invention, the changes in the shape of the optical fiber can be sensed in real time to select the corresponding image reconstruction model for imaging.
[0078] It can be seen that, compared with existing methods, this method helps to reduce the impact of fiber morphology changes and improve the imaging stability of multimode fiber wide-field imaging systems.
[0079] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely illustrative of the principles of the invention. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention without departing from its spirit and scope should be included within the protection scope of the present invention.
Claims
1. A stable multimode fiber wide-field imaging method, characterized in that, The method includes the following steps: Step 1: Establish a multimode fiber wide-field imaging system based on dual-wavelength laser incident light; Step 2: Based on the multimode fiber wide-field imaging system, acquire a large number of probe light signals and reference light signals of the target image under different fiber optic configurations; Step 3: Establish an image reconstruction model database and a fiber optic morphology recognition model; Step 4: For cases where the fiber optic morphology is unknown, the fiber optic morphology is identified using a fiber optic morphology recognition model, and an image reconstruction model is selected based on the fiber optic morphology results to calculate and obtain the reconstructed image.
2. The stable multimode fiber wide-field imaging method according to claim 1, characterized in that, In step 1, the multimode fiber wide-field imaging system specifically refers to: The illumination source consists of two lasers of different wavelengths, which emit probe light and reference light respectively; Adding a filter to the imaging end face of a multimode fiber enables selective transmission and reflection of the probe light and the reference light. The probe light and the reference light are simultaneously coupled into the multimode fiber. The reference light is reflected by a filter at the imaging end face of the multimode fiber. The returned reference light signal carries fiber morphology information and is collected by the first detector. The probe light is transmitted through a filter at the imaging end face of the multimode fiber and shines onto the imaging target. The probe light signal carrying the target image information is collected by the multimode fiber, transmitted, and then collected by the second detector.
3. The stable multimode fiber wide-field imaging method according to claim 2, characterized in that, The laser is a continuous laser source.
4. The stable multimode fiber wide-field imaging method according to claim 1, characterized in that, The reference optical signal is an image signal or a spectral signal.
5. The stable multimode fiber wide-field imaging method according to claim 1, characterized in that, Step 3 involves establishing an image reconstruction model database, specifically including: Based on the "target image - probe light signal" data combination obtained in step 2 under a certain fiber optic configuration, an image reconstruction model adapted to a certain fiber optic configuration is established using a deep learning algorithm. Further, an image reconstruction model database adapted to different fiber optic morphologies is constructed, namely {fiber optic morphology k — image reconstruction model k}, k∈[1, n]; n is the total number of fiber optic morphologies or the total number of image reconstruction models.
6. The stable multimode fiber wide-field imaging method according to claim 1, characterized in that, Step 3 involves establishing a fiber optic morphology recognition model, specifically including: Based on all the "fiber morphology-reference optical signal" data combinations obtained in step 2, a fiber morphology recognition model is established using machine learning algorithms.
7. The stable multimode fiber wide-field imaging method according to claim 1, characterized in that, Step 4 specifically includes: for the unknown "fiber morphology-reference optical signal-probe optical signal", the reference optical signal is processed using the fiber morphology recognition model to obtain the current fiber morphology. Then, the image reconstruction model under the corresponding fiber morphology is selected from the image reconstruction model database to process the probe optical signal and obtain the reconstructed image.
8. A stable multimode fiber wide-field imaging system based on the method described in claims 1 to 7, characterized in that, The system includes: The first module is used to establish a multimode fiber wide-field imaging system based on dual-wavelength laser incident; The second module is used to acquire a large number of probe light signals and reference light signals of target images under different fiber optic configurations based on the multimode fiber wide-field imaging system. The third module is used to establish an image reconstruction model database and a fiber optic morphology recognition model. The fourth module is used to identify the fiber morphology using a fiber morphology recognition model when the fiber morphology is unknown, and to select an image reconstruction model based on the fiber morphology result to calculate and obtain the reconstructed image.
9. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 7.