Design method of photoelectric imaging system with laser protection and privacy protection functions

Through the combined optimization framework and phase modulation of the optical-algorithm, the damage and privacy leakage of the photoelectric imaging system during laser irradiation is solved, and high-quality imaging is achieved while laser protection and privacy protection are provided.

CN120507876AActive Publication Date: 2025-08-19NAT UNIV OF DEFENSE TECH
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202510580487.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-06
Publication Date
2025-08-19
Estimated Expiration
2045-05-06

AI Technical Summary

Technical Problem

Existing photoelectric imaging systems are prone to damage when facing laser irradiation and private information is easily leaked. It is difficult for the prior art to achieve laser protection and privacy protection at the same time.

Method used

Through the combined optical-algorithm optimization framework, the optimized point diffusion function is determined, and the phase distribution is adjusted using the Gerchberg-Saxton algorithm and the stochastic gradient descent algorithm, and the phase modulation component loaded on the optoelectronic imaging system to achieve laser protection and privacy protection.

Benefits of technology

It realizes high-quality photoelectric imaging, and has laser protection capabilities and privacy protection capabilities, reducing laser peak energy and protecting private information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120507876A_ABST
    Figure CN120507876A_ABST
Patent Text Reader

Abstract

The invention discloses a design method of a photoelectric imaging system with laser protection and privacy protection functions, and relates to the field of photoelectric imagines.The method comprises the steps that based on preset point diffusion distribution characteristics, target energy divergence and point diffusion radius, an optical-algorithm joint optimization framework is adopted to determine an optimized point diffusion function; based on the imaging parameters, a Gerchberg-Saxton algorithm is adopted to determine initial phase distribution; adjusting the initial phase distribution based on a stochastic gradient descent algorithm by taking the difference of the energy divergence of the point spread function as guidance so as to determine the optimized phase distribution corresponding to the optimized point spread function; the optimized phase distribution is used for being loaded on a phase modulation component of the photoelectronic imaging system. According to the invention, high-quality photoelectric imaging with laser protection capability and privacy protection capability can be realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of optoelectronic imaging, and in particular to a design method for an optoelectronic imaging system with laser protection and privacy protection functions. Background Art

[0002] Currently, optoelectronic imaging systems are widely used in various fields and are mainly composed of imaging lenses, sensors, and image processing modules. To achieve clear imaging, optoelectronic imaging systems typically have a point spread function that focuses energy. While this design provides the optoelectronic imaging system with extremely high optical gain, it also poses security risks in both hardware and software. In terms of hardware, when strong light, such as lasers, shines on the optoelectronic imaging system, the energy is highly concentrated due to the focusing effect of the imaging lens, which can easily damage the sensor and permanently degrade the imaging system's imaging capabilities. In terms of software, in the absence of strong light interference, the imaging system faces the problem of privacy information loss. Due to the clear imaging, hackers can obtain the captured images by attacking the data transmission link. These images generally contain private information such as faces and text. Directly obtaining clear images may lead to privacy leaks, which poses a huge security risk to the use of imaging systems.

[0003] Existing technologies can use spectral filtering technology on optoelectronic imaging devices to protect against specific wavelengths, but this requires predicting the wavelength of the interfering laser, making it difficult to effectively function when the interfering laser is unknown. A specific phase function can be set to improve the laser protection capabilities of the imaging system, but this process struggles to protect the privacy of captured images. Lensless imaging can hide private information, but this process struggles to achieve high-quality scene restoration from blurred captured images, resulting in poor quality. In short, while existing technologies offer either hardware or software protection, they focus on only one aspect and fail to address both. Summary of the Invention

[0004] The purpose of this application is to provide a design method for an optoelectronic imaging system with laser protection and privacy protection functions, which can achieve high-quality optoelectronic imaging with laser protection and privacy protection capabilities.

[0005] To achieve the above objectives, this application provides the following solutions:

[0006] This application provides a design method for an optoelectronic imaging system with laser protection and privacy protection functions, the method comprising:

[0007] Obtain target energy divergence, point spread radius and imaging parameters of the optoelectronic imaging system;

[0008] Based on the preset point spread distribution characteristics, the target energy divergence and the point spread radius, an optimized point spread function is determined using an optical-algorithm joint optimization framework;

[0009] Based on the imaging parameters, an initial phase distribution is determined using a Gerchberg-Saxton algorithm;

[0010] The initial phase distribution is adjusted based on a stochastic gradient descent algorithm guided by the difference in energy divergence of the point spread function to determine an optimized phase distribution corresponding to the optimized point spread function;

[0011] The optimized phase distribution is loaded onto the phase modulation component of the optoelectronic imaging system to complete the optimized design of the optoelectronic imaging system.

[0012] According to the specific embodiments provided by the present application, the present application has the following technical effects: the present application sets up an optical-algorithm joint optimization framework, based on which an optimized point spread function with an energy divergence close to the target energy divergence is obtained, which can ensure good photoelectric imaging performance; then, guided by the difference in the energy divergence of the point spread function, the initial phase distribution is adjusted according to the random gradient descent algorithm to obtain the optimized phase distribution corresponding to the optimized point spread function, thereby realizing hybrid phase retrieval. By loading the optimized phase distribution corresponding to the optimized point spread function into the phase modulation component of the photoelectric imaging system, an additional phase is introduced into the photoelectric imaging process, thereby achieving protection for specific wavelengths, so that it has laser protection capability; and due to the introduction of the additional phase, the imaging obtained by the photoelectric imaging system is a blurred image, thus having privacy protection capability. In summary, the present application can achieve high-quality photoelectric imaging with laser protection capability and privacy protection capability. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0014] Figure 1 This is an application environment diagram of a design method for an optoelectronic imaging system with laser protection and privacy protection functions in one embodiment of the present application.

[0015] Figure 2 A flowchart of a method for designing an optoelectronic imaging system with laser protection and privacy protection functions provided in one embodiment of the present application.

[0016] Figure 3A schematic diagram of a specific flow chart of the method steps provided in one embodiment of the present application.

[0017] Figure 4 A schematic diagram of the verification optical path provided in one embodiment of the present application.

[0018] Figure 5 Schematic diagram comparing the optimized point spread function obtained through the optical-algorithm joint design of this application and the point spread function after phase distribution optimization.

[0019] Figure 6 Schematic diagram of a conventional imaging system obtained by experimental measurement and the point spread function and energy distribution obtained in this application.

[0020] Figure 7 This is a comparison chart between simulation and experiment of the privacy protection capability of this application using text as an example.

[0021] Figure 8 A schematic diagram of the operation of a phase-modulated optoelectronic imaging device according to an embodiment of the present application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0023] The technical solution provided in this application has an optoelectronic imaging function with laser protection and privacy protection functions. By introducing phase modulation, the point spread function of the optoelectronic imaging system is much larger than that of a conventional imaging system, thereby greatly reducing the peak energy of the interfering laser in the focal plane and greatly reducing the risk of the imaging system being damaged by the laser. At the same time, by introducing large-area blur, privacy information is effectively protected.

[0024] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.

[0025] The design method of the optoelectronic imaging system with laser protection and privacy protection functions provided in the embodiment of the present application can be applied to Figure 1In the application environment shown, terminal 102 communicates with server 104 via a network. A data storage system can store data that server 104 needs to process. The data storage system can be set up separately, integrated on server 104, or placed on the cloud or other servers. Terminal 102 can send the target energy divergence, point spread radius, and imaging parameters of the optoelectronic imaging system to server 104. Upon receiving the data, server 104 uses an optical-algorithm joint optimization framework to determine the optimized point spread function based on preset point spread distribution characteristics, target energy divergence, and point spread radius. Based on the imaging parameters, the Gerchberg-Saxton algorithm is used to determine the initial phase distribution. Guided by the difference in energy divergence of the point spread function, the initial phase distribution is adjusted using a stochastic gradient descent algorithm to determine the optimized phase distribution corresponding to the optimized point spread function. Server 104 can feed back the obtained optimized phase distribution to terminal 102. Terminal 102 can be the phase modulation component of the optoelectronic imaging system. In addition, in some embodiments, the design method of an optoelectronic imaging system with laser protection and privacy protection functions of the present application can also be implemented independently by server 104 or terminal 102.

[0026] The terminal 102 may be, but is not limited to, various desktop computers, laptop computers, smart phones, tablet computers, and IoT devices. The server 104 may be implemented as an independent server or a server cluster consisting of multiple servers, or a cloud server.

[0027] In an exemplary embodiment, Figure 2 As shown, a design method for an optoelectronic imaging system with laser protection and privacy protection functions is provided. The method is executed by a computer device, specifically a computer device such as a terminal or a server, or a terminal and a server. In the embodiment of the present application, the method is applied to Figure 1 The server 104 in the example is used for explanation, including the following steps 201 to 205.

[0028] Step 201: Obtain target energy divergence, point spread radius, and imaging parameters of the optoelectronic imaging system. The imaging parameters include pupil aperture, wavelength, and lens focal length.

[0029] Step 202: Based on the preset point spread distribution characteristics, the target energy divergence and the point spread radius, an optical-algorithm joint optimization framework is used to determine the optimized point spread function. Figure 3FIGURE 2 shows a schematic diagram of the specific process of steps 202, 203, and 204, wherein a joint optical-algorithm optimization framework is constructed and the optimized phase distribution corresponding to the obtained optimized point spread function is retrieved. Based on this, step 202 includes the following (21)-(27) to complete the design of the optimized point spread function.

[0030] In a practical application, before executing step (21), it is necessary to initialize the target energy divergence and point spread radius, and also to set a first preset number of times to provide basic data for subsequent steps.

[0031] (21) Determine the point spread constraint conditions based on the preset point spread distribution characteristics and the point spread radius. Specifically, in order to maximize information transmission, the large-volume point spread function should have three characteristics, namely, the preset point spread distribution characteristics include: no directionality, high contrast, and small spatial size. In order to meet the above three characteristics, the point spread constraint conditions are set to include:

[0032] 1) The area corresponding to the point spread function is within the circular area determined by the point spread radius; based on this constraint, the size of the point spread function is limited to ensure that the optimized point spread function meets the characteristics of non-directionality and small spatial size. 2) The point spread function p is Represented by: b is a constant, h is an optimizable variable, and the sigmoid function is used to make the energy distribution of the point spread function meet the characteristics of high contrast.

[0033] (22) Based on the point spread constraint, an initial point spread function is randomly generated.

[0034] (23) Convolve the initial point spread function with the reference image to obtain a blurred image, thereby simulating the camera imaging process; specifically, the following formula is used: E =S(I*p+η); where I E is the image measured by the sensor, that is, the image detected by the imaging component; I is a clear scene, referring to the reference image; p is a learnable point spread function, and each pixel is a variable that can be optimized independently. η is Gaussian noise, and η~N(0,σ 2 ). S(·) is the shearing operation, and saturated pixels are set to 1.

[0035] (24) The blurred image is input into a preset image reconstruction model to obtain a decoded image, thereby restoring the blurred image. The preset image reconstruction model is obtained by training one of a MIMO-Unet network, a Uformer network, and a DeblurGAN network. The training process of the above network is a conventional neural network training process and will not be described here. In addition, traditional image deconvolution methods represented by Wiener filtering and the Lucy-Richardson algorithm can also be used.

[0036] (25) Calculate a first loss function value based on the decoded image, the reference image, the energy divergence of the initial point spread function, and the target energy divergence, and record the first iteration number plus one. Specifically, in order to enable the security camera to have both good security protection capabilities and imaging capabilities, the first loss function includes both the imaging part and the energy divergence. The calculation formula of the first loss function value is:

[0037]

[0038] in, is the first loss function value, α1, α2, α3 are weight coefficients; It is used to characterize the multi-scale L1 distance between the decoded image and the reference image, K is the number of scale levels of the image, t k is the number of pixels at level k. It should be noted that the preset image reconstruction model has multi-scale input and output. Taking the input as an example, there are three scales: the original blurred image, the 2x downsampled blurred image, and the 4x downsampled blurred image, and each scale is a level. is the decoded image, I is the reference image, || ||1 is the L1 norm symbol; It is used to characterize the multi-scale L1 distance between the decoded image and the reference image in the frequency domain. is the Fourier transform; The L1 distance used to characterize the energy divergence ESR of the initial point spread function and the target energy divergence ESR0. This loss is used to give the point spread function a specific energy divergence.

[0039] Energy divergence ESR is defined as the ratio of the energy peak at the focal plane of the imaging system to the energy peak of the security camera when there is no phase modulation. A larger energy divergence means better laser protection and better information hiding capabilities. Based on this, the energy divergence calculation formula is: ESR = max(p0) / max(p secure ); max() is the maximum value function, p0 is the point spread function of the photoelectric imaging system when there is no phase modulation, p secure is the initial point spread function.

[0040] (26) When the first iteration number does not reach the first preset number, the initial point spread function is updated by calculating the gradient using the first loss function, and then the process returns to the step of convolving the initial point spread function with the reference image.

[0041] (27) When the first iteration number reaches a first preset number, the initial point spread function is marked as an optimized point spread function.

[0042] Step 203: Based on the imaging parameters, the Gerchberg-Saxton algorithm is used to determine the initial phase distribution. Figure 3 As shown, before step 203, the pupil aperture, wavelength and lens focal length of the optoelectronic imaging system are used as initialization parameters.

[0043] Step 204 : Using the difference in energy divergence of the point spread function as a guide, the initial phase distribution is adjusted based on a stochastic gradient descent algorithm to determine an optimized phase distribution corresponding to the optimized point spread function.

[0044] In an exemplary application, step 204 includes the following steps (41)-(44).

[0045] (41) Using the angular spectrum method, the corresponding simulated point spread function is calculated according to the initial phase distribution; the simulated point spread function p est The calculation process includes:

[0046] Since the distance between the scene and the imaging component is far enough, the light field before reaching the pupil (the light field before reaching the phase modulation component) It can be regarded as a plane wave. After passing through the phase modulation component, the light field is:

[0047]

[0048] in, is the light field after passing through the phase modulation component of the optoelectronic imaging system; A(x,y) is a binary circular mask, specifically a binary circular mask with a diameter of D, which simulates the finite aperture size of the pupil; φ p and is the additional phase introduced by the phase modulation component. Since the phase modulation component includes a phase plate and a lens arranged in sequence, the above two additional phases are the additional phases introduced by the phase plate and the lens with a focal length of f respectively; j is an imaginary unit; (x, y) are the coordinate axes at the pupil.

[0049]

[0050] in, is the light field that has been diffracted and reaches the imaging component; is the inverse Fourier transform, is the Fourier transform; is the optical transmission kernel, λ is the wavelength, f x 、f y is the frequency domain coordinate; (x′, y′) is the coordinate axis at the imaging component.

[0051]

[0052] (42) Based on the simulated point spread function, the optimized point spread function, the energy divergence of the simulated point spread function, and the energy divergence of the optimized point spread function, calculate a second loss function value and record the second iteration number plus one. The calculation formula of the second loss function value is:

[0053]

[0054] in, is the second loss function value, β1, β2 are weight coefficients; p est To simulate the point spread function, p target To optimize the point spread function, ESR target To optimize the energy divergence of the point spread function, ESR(p est ) is the energy divergence of the simulated point spread function.

[0055] (43) When the second iteration number does not reach the second preset number, the initial phase distribution is updated by calculating the gradient using the second loss function, and then the step of returning to the step of using the angular spectrum method to calculate the corresponding simulated point spread function according to the initial phase distribution.

[0056] (44) When the second iteration number reaches a second preset number, the initial phase distribution is marked as an optimized phase distribution.

[0057] Step 205 : Loading the optimized phase distribution into the phase modulation component of the optoelectronic imaging system to complete the optimized design of the optoelectronic imaging system.

[0058] In a practical application, after obtaining the optimized phase distribution in the above steps, Figure 4 A verification optical path was constructed with the following parameters: the focal length of the lens was 50 mm, the operating wavelength was 633 nm, the imaging component size was 400 × 400, and the pixel size was 4.5 μm; the standard deviation of the Gaussian noise was uniformly distributed between 0.001 and 0.01; the point spread radius r = 50, and the target energy divergence ESR0 = 600.

[0059] like Figure 5The figure shows a comparison diagram of the optimized point spread function and optimized phase distribution obtained by the design method of the optoelectronic imaging system with laser protection and privacy protection functions of the present application and before optimization. Figure 5 (a) shows the designed point spread function and the point spread function obtained after phase retrieval (optimized point spread function) under the corresponding parameter settings. The two are highly consistent; Figure 5 The initialization phase and the final optimized phase distribution are shown in (b).

[0060] The above Figure 5 The optimized phase distribution in Figure 4 The verification optical path in the image processing system completes the functional verification of the security camera (i.e., the imaging component). The specific operating principle is as follows: 633nm laser light is emitted from a He-Ne laser (i.e., a He-Ne laser) and passes through a spatial filter SF. It then passes through a beamsplitter cube BS1 and an achromatic doublet lens L1, converting the light into parallel light, simulating a light source from infinity. The light then passes through a polarizer P, becomes linearly polarized, and then through a beamsplitter cube BS2. It then illuminates a phase-type liquid crystal spatial light modulator (SLM) (which has an optimized phase distribution) and is then reflected. After passing through a 4-f system consisting of two achromatic doublet lenses L2 and L3, the phase-modulated wavefront is relayed to the pupil of the composite lens. Finally, the imaging component (sensor) receives the point spread function (PSF) of the photoelectric imaging system. Similarly, after being illuminated by an LED, the reflected light from the object passes through a narrowband filter LF and propagates in the same manner, resulting in an encoded blurred scene on the imaging component. Finally, the acquired blurred image is processed by a deblurring network, ultimately reproducing a clear image.

[0061] Figure 6 The figure shows a schematic diagram of a conventional imaging system obtained by experimental measurement and the point spread function and energy distribution obtained by this application; the experimental results show that this application can reduce the peak energy by more than 99.73%, greatly reducing the peak energy and effectively ensuring the safety of the imaging system.

[0062] Figure 7 A simulation and experimental comparison diagram showing the application's ability to protect private information using text as an example shows that the application can effectively protect private information and, when the correct decoder parameters are available, can restore images with high quality.

[0063] In summary, this application proposes the distribution characteristics of a large-volume point spread function that can maximize information transmission. Under this guidance, an optical-algorithm joint optimization framework is constructed to realize the design of an ideal point spread function. Then, a hybrid phase retrieval algorithm based on a stochastic gradient descent algorithm is proposed to obtain the phase distribution of the camera. Finally, the phase distribution is loaded on the spatial light modulator to realize the proposed optoelectronic imaging system. The above-mentioned setting can ensure high-quality imaging, while having optoelectronic imaging with laser protection capabilities and privacy protection capabilities. Specifically, the present application can not only maintain the high imaging quality of large-array optoelectronic imaging systems, but also has laser protection capabilities that are far superior to conventional optoelectronic imaging systems. At the same time, privacy protection can be achieved at the optical end, which well overcomes the defects of existing optoelectronic imaging systems in laser protection and privacy security, and has wide application adaptability.

[0064] Based on the same inventive concept, an embodiment of the present application further provides a phase-modulated optoelectronic imaging device for implementing the aforementioned method. The solution to the problem provided by this device is similar to the solution described in the aforementioned method. Therefore, the specific limitations of one or more phase-modulated optoelectronic imaging device embodiments provided below can be found in the aforementioned method limitations and will not be further elaborated here.

[0065] In an exemplary embodiment, in order to design a high-performance phase distribution, the device of the present application includes an optoelectronic imaging system and a processor; the optoelectronic imaging system is a wavefront coded optoelectronic imaging system, including a phase modulation component, an imaging component, an image processing component, and an output display component; the processor is used to: execute a computer program to implement the design method of the optoelectronic imaging system with laser protection and privacy protection functions to obtain an optimized phase distribution, and then load the optimized phase distribution onto the phase modulation component. The phase modulation component includes a phase plate (or phase mask) and a lens arranged in sequence. The lens can be a composite lens, which provides information on the lens focal length and pupil aperture for the design method of the optoelectronic imaging system with laser protection and privacy protection functions.

[0066] When working, Figure 8 As shown, incident light is modulated by the phase modulation component before reaching the imaging component, where it captures a blurred image. The image processing component then applies a deblurring algorithm to the received blurred image to produce a clear image, which is then displayed on the output display component. The phase modulation introduced by the phase modulation component alters the point spread function of the imaging system, thus providing both laser protection and privacy protection.

[0067] In practical applications, the imaging component is a camera, and the corresponding imaging parameters of the camera can be changed, such as the main lens size, focal length, wavelength, energy divergence of the point spread function, etc.

[0068] In practical applications, the phase modulation component can be a liquid crystal spatial light modulator, a diffractive optical element or a metasurface to load the phase and realize the control of the light field.

[0069] Compared with the existing technology, this application also has the following advantages:

[0070] (1) This application utilizes the proposed large-volume PSF with good imaging performance as a constraint and utilizes a joint optical-algorithmic optimization framework to optimize the optimal point spread function under a specific energy divergence. Specifically, this application achieves both laser protection and privacy protection by designing the point spread function of the optoelectronic imaging system.

[0071] (2) This application uses the phase obtained by the Gerchberg-Saxton algorithm as the initial phase distribution, and uses the loss function as a guide to fine-tune the phase distribution based on the gradient descent method to obtain the optimized phase distribution corresponding to the optimized point spread function.

[0072] (3) This application introduces a method for implementing a phase modulation module to simultaneously perform laser protection and privacy protection, wherein the phase modulation module in the lens is not limited to a spatial light modulator, but can also be implemented using diffraction optical elements and metasurface components.

[0073] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0074] This document uses specific examples to illustrate the principles and implementation methods of this application. The description of the above examples is only intended to help understand the method and core concept of this application. At the same time, for those skilled in the art, based on the concept of this application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A design method for an optoelectronic imaging system with laser protection and privacy protection functions, characterized in that: The method comprises: Obtain target energy divergence, point spread radius and imaging parameters of the optoelectronic imaging system; Based on the preset point spread distribution characteristics, the target energy divergence and the point spread radius, an optimized point spread function is determined using an optical-algorithm joint optimization framework; Based on the imaging parameters, an initial phase distribution is determined using a Gerchberg-Saxton algorithm; The initial phase distribution is adjusted based on a stochastic gradient descent algorithm guided by the difference in energy divergence of the point spread function to determine an optimized phase distribution corresponding to the optimized point spread function; The optimized phase distribution is loaded onto the phase modulation component of the optoelectronic imaging system to complete the optimized design of the optoelectronic imaging system.

2. The design method of the optoelectronic imaging system with laser protection and privacy protection functions according to claim 1, characterized in that: Based on the preset point spread distribution characteristics, the target energy divergence and the point spread radius, an optical-algorithm joint optimization framework is used to determine the optimized point spread function, including: Determining a point spread constraint condition according to a preset point spread distribution characteristic and the point spread radius; Based on the point spread constraint, randomly generating an initial point spread function; Convolving the initial point spread function with a reference image to obtain a blurred image; Inputting the blurred image into a preset image reconstruction model to obtain a decoded image; Calculating a first loss function value and recording a first iteration number plus one based on the decoded image, the reference image, the energy divergence of the initial point spread function, and the target energy divergence; When the first iteration number does not reach a first preset number, updating the initial point spread function by calculating a gradient using a first loss function, and then returning to the step of convolving the initial point spread function with a reference image; When the first iteration number reaches a first preset number, the initial point spread function is marked as an optimized point spread function.

3. The design method of the optoelectronic imaging system with laser protection and privacy protection functions according to claim 2, characterized in that: The point diffusion constraints include: The area corresponding to the point spread function is: within a circular area determined based on the point spread radius; The point spread function p is Indicates that b is a constant and h is an optimizable variable.

4. The design method of the optoelectronic imaging system with laser protection and privacy protection functions according to claim 2, characterized in that: The preset image reconstruction model is obtained by training based on one of the MIMO-Unet network, Uformer network, and DeblurGAN network.

5. The design method of the optoelectronic imaging system with laser protection and privacy protection functions according to claim 2, characterized in that: The calculation formula of the first loss function value is: in, is the first loss function value, α1, α2, α3 are weight coefficients; It is used to characterize the multi-scale L1 distance between the decoded image and the reference image, K is the number of scale levels of the image, t k is the number of pixels at level k, is the decoded image, I is the reference image, || ||1 is the L1 norm symbol; It is used to characterize the multi-scale L1 distance between the decoded image and the reference image in the frequency domain, where F(·) is the Fourier transform; The L1 distance used to characterize the energy divergence ESR of the initial point spread function and the target energy divergence ESR0; the calculation formula of energy divergence ESR is: ESR=max(p0) / max(p secure ); max() is the maximum value function, p0 is the point spread function of the photoelectric imaging system when there is no phase modulation, p secure is the initial point spread function.

6. The design method of the optoelectronic imaging system with laser protection and privacy protection functions according to claim 1, characterized in that: The initial phase distribution is adjusted based on a stochastic gradient descent algorithm guided by the difference in energy divergence of the point spread function to determine an optimized phase distribution corresponding to the optimized point spread function, including: Calculating a corresponding simulated point spread function according to the initial phase distribution using an angular spectrum method; Calculating a second loss function value based on the simulated point spread function, the optimized point spread function, the energy divergence of the simulated point spread function, and the energy divergence of the optimized point spread function and recording a second number of iterations plus one; When the second iteration number does not reach a second preset number, update the initial phase distribution by calculating the gradient using a second loss function, and then return to the step of using the angular spectrum method to calculate the corresponding simulated point spread function according to the initial phase distribution; When the second iteration number reaches a second preset number, the initial phase distribution is marked as an optimized phase distribution.

7. The design method of the optoelectronic imaging system with laser protection and privacy protection functions according to claim 6, characterized in that: The simulated point spread function p est The calculation process includes: in, is the light field after passing through the phase modulation component of the optoelectronic imaging system, is the light field before reaching the phase modulation component, A(x,y) is a binary circular mask; φ p and φ l is the additional phase introduced by the phase modulation component; j is the imaginary unit; in, is the light field that has been diffracted and reaches the imaging component; is the inverse Fourier transform, is the Fourier transform; is the optical transmission kernel, λ is the wavelength, f x 、f y is the frequency domain coordinate; 8. The design method of the optoelectronic imaging system with laser protection and privacy protection functions according to claim 6, characterized in that: The calculation formula of the second loss function value is: in, is the second loss function value, β1, β2 are weight coefficients; p est To simulate the point spread function, p target To optimize the point spread function, ESR target To optimize the energy divergence of the point spread function, ESR(p est ) is the energy divergence of the simulated point spread function, and || ||1 is the symbol of the L1 norm.

Citation Information

Patent Citations

  • Laser imaging and defense method and system based on related Hartmann

    CN116299546A

  • Photoelectric imaging system with laser protection function

    CN116931283A

  • Method for improving efficiency in an optimizing predictive model using stochastic gradient descent

    US20140058991A1

  • Pair of phase modulation elements for imaging optical system, imaging optical system, illuminating device, and microscope apparatus

    US20170205613A1

  • System and method for polarization imaging

    US20230375462A1