Photoelectric imaging equipment anti-interference imaging method based on self-adaptive strategy
Through autocorrelation decoding and PRI algorithms, decoding the interfering signal cycle of vehicle lidar, generating anti-interference exposure sequences, solving the problem of blinding or damage caused by vehicle lidar interference in the fields of smart cars and autonomous driving, and realizing the autonomy of the equipment Improved anti-interference imaging and imaging effects.
Patent Information
- Application Number
- CN202411289501.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-14
- Publication Date
- 2024-12-03
AI Technical Summary
In the fields of smart cars and autonomous driving, optoelectronic imaging equipment is susceptible to interference from vehicle-mounted lidar, resulting in blinding or irreversible damage to imaging devices. The existing technology is not sufficient for anti-interference imaging in the non-military field, resulting in the equipment working in complex environments. Inadequate ability.
The anti-period interference signal imaging method of photoelectric imaging equipment based on adaptive strategies is adopted, and the pulse period of the interfering laser is decoded through autocorrelation decoding and PRI algorithm to generate an anti-interference exposure sequence to achieve effective control of the interfering laser and anti-interference imaging.
It improves the self-protection ability of the photoelectric imaging equipment in the actual environment, improves the imaging effect, improves the imaging performance of the equipment under the influence of low-frequency periodic interference light, and realizes the independent anti-interference imaging of the equipment.
Smart Images

Figure CN119071646A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of anti-interference imaging, and relates to an anti-interference imaging method of a photoelectric imaging device based on an adaptive strategy. Background Art
[0002] In recent years, the fields of smart cars and autonomous driving have been unprecedentedly hot. Major automakers have increased their investment in related software and hardware, and the shipments of upstream hardware suppliers, including LiDAR, have been rising year by year. At the same time, discussions about whether LiDAR will damage human eyes and shooting equipment have gradually aroused people's concerns. According to the different energy densities, the impact of interference lasers on imaging devices can be divided into two types: pixel saturation and local damage. Pixel saturation refers to the phenomenon that when the imaging device works based on the photoelectric effect, some pixels are saturated due to overexposure under the influence of strong power lasers; local damage refers to the local damage of the imaging device CMOS after the imaging device is irradiated by high-power interference lasers, and its surface thermal effect continues to increase, exceeding the maximum temperature that some structural materials can withstand. Compared with the two types of damage, the former is generally a short-term and recoverable temporary blindness, and the latter is often irreversible permanent damage. At present, there have been similar news such as Huawei's M7 LiDAR burning out the basement night vision camera, and car reviewers shooting new car LiDAR causing bad pixels in the mobile phone CMOS, which have aroused widespread concern and concern.
[0003] Anti-interference imaging refers to the ability of optoelectronic imaging equipment to adopt appropriate anti-interference strategies when encountering different forms of incoming interference lasers in the environment, and to achieve continuous observation of the target while protecting its own imaging devices from damage. Adaptive strategy decoding is based on the characteristics of easy decoding of pulse-coded interference light, using the autocorrelation function to decode the laser pulse signal, restore the pulse-coded signal of the interfering laser, confirm the cycle period, and on this basis, combined with the optimized and improved form of the autocorrelation function, namely the pulse repetition interval (PRI) algorithm, to achieve the collection, decoding, and control of the interfering pulse laser within the acceptable time, control the laser interference pulse to make advance predictions, and thus achieve the purpose of anti-interference imaging of the imaging device.
[0004] As a highly integrated system integrating optoelectronic interference, signal processing, anti-interference control imaging, and anti-interference attack, the most cutting-edge progress and application of anti-interference imaging are mostly concentrated in the military field, but the integration and application in non-military fields is not sufficient. As the road environment becomes more and more complex, the probability of related imaging equipment being blinded or even damaged will greatly increase. In order to ensure that optoelectronic imaging devices, including vehicle-mounted optoelectronic imaging devices, can still work normally under the influence of unknown external interference, the relevant equipment should have autonomous anti-interference imaging capabilities. Summary of the invention
[0005] Based on existing research, this paper proposes an anti-interference imaging method for optoelectronic imaging equipment based on an adaptive strategy for interference signals with regular periodicity, which can be used to solve the problem that optoelectronic imaging equipment is likely to be blinded or even damaged by vehicle-mounted laser radar in the context of intelligent driving. This method is based on the basic principle of autocorrelation decoding, and realizes anti-interference imaging of such periodic coded interference lasers including vehicle-mounted laser radars, which can improve the self-protection and anti-interference imaging capabilities of optoelectronic imaging equipment in actual environments and improve imaging effects.
[0006] The technical solution adopted by the present invention to solve the technical problem is: a method for imaging a photoelectric imaging device against periodic interference signals based on an adaptive strategy, comprising: setting the photoelectric imaging device to stop exposure immediately after receiving an interference pulse emitted by a vehicle-mounted laser radar, and starting a counter to start recording the number of pulse interval clocks; Set the counter to count the pulse time intervals of the 16-bit interference pulses after the interference signal is detected, and record the number of clocks of the time intervals between the arrivals of adjacent interference pulses; Determine the time difference k between adjacent pulse intervals n ; Use autocorrelation transform and PRI transform to update the corresponding k n The autocorrelation intensity value and PRI intensity value at the value; Using pipeline binary search, quickly compare the maximum intensity values and sort them to determine the interference signal period; According to the decoding results, the camera generates a new anti-interference exposure sequence to complete the anti-interference exposure imaging.
[0007] Preferably, the method for detecting the acquisition pulse interference interval is: setting the photoelectric imaging device to stop exposure immediately after receiving the interference pulse emitted by the vehicle-mounted laser radar, and starting the counter to start recording the pulse interval clock tick, and when the next interference pulse arrives, the counter value at this time is stored in the array tau and reset to zero. This method selects to receive 16-bit interference pulses as samples for period discrimination, so as to achieve a balance between efficiency and effect in the actual anti-vehicle laser radar interference scenario.
[0008] Preferably, a maximum of 4 consecutive pulse intervals are selected as possible period interval values for calculation.
[0009] Preferably, in the autocorrelation transformation process, the integer k n The independent variable after discrete autocorrelation transformation of the pulse function is the time difference between the n pulse intervals.
[0010] Preferably, the autocorrelation transformation process specifically traverses any two sample pulses, and adds 1 to the autocorrelation strength at the offset in each iteration to obtain the autocorrelation strength value at the offset.
[0011] Preferably, the PRI transformation process specifically traverses any two sample pulses, and adds a complex exponential phase factor to the PRI intensity at the offset in each iteration to obtain the PRI intensity value at the offset.
[0012] Preferably, the pipeline binary method is used, and the data is divided into two groups at each level of comparison, and the internal elements are compared with each other and the larger one is taken to obtain the maximum value.
[0013] The anti-interference imaging method of the optoelectronic imaging device based on the adaptive strategy of the present invention uses a front photoelectric detection module to receive the interference laser signal and convert it into an electrical signal, obtain the interference pulse signal and input it into the camera FPGA control module. The adaptive strategy in the module analyzes and processes the received interference signal interval, decodes to obtain the incoming interference laser pulse period, and generates an anti-interference sequence.
[0014] The anti-interference imaging method of the optoelectronic imaging device based on the adaptive strategy of the present invention has the following beneficial effects: 1. Apply the autocorrelation PRI technology to the field of anti-interference imaging, and improve the imaging effect of optoelectronic imaging equipment under the influence of low-repetition-rate periodic interference light; 2. The implementation of adaptive technology is based on the camera's own FPGA control module, which is simple and convenient to implement and can achieve good results; 3. Flexibly adjust the number of adjacent pulse intervals n selected, and select different numbers of k according to the scene needs n The sampling value is used to balance accuracy and efficiency, and can effectively achieve anti-interference imaging. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 is a flow chart of the method of the present invention; Figure 2 Implementation flow chart for the PRI algorithm. DETAILED DESCRIPTION
[0016] In order to facilitate the understanding of the present invention, the present invention is described in more detail below in conjunction with the accompanying drawings and specific embodiments. Preferred embodiments of the present invention are provided in the accompanying drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described in this specification. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present invention more thorough and comprehensive.
[0017] Embodiment 1 The present invention provides an anti-interference imaging method for an optoelectronic imaging device based on an adaptive strategy, such as Figure 1 As shown, including: The photoelectric imaging device is set to stop exposure immediately after receiving the interference pulse, and start the counter to start recording the pulse interval clock number tick; Set a counter to count the pulse time intervals of 16-bit interference pulses after the interference signal is detected, and record the clock number tau of the time intervals between the arrival of adjacent interference pulses; Determine the time difference k between adjacent pulse intervals n ; Use autocorrelation transform and PRI transform to update the corresponding k n The autocorrelation intensity value C and PRI intensity value D at the value; Using pipeline binary search, quickly compare the transformation intensity values and sort them, and determine the transformation intensity value sorting s n _max_k; and for sequence s n _max_k decoding to determine the interference signal period; According to the decoding results, the camera generates a new anti-interference exposure sequence to complete the anti-interference exposure imaging.
[0018] The adaptive decoding process of optoelectronic imaging equipment is the process in which the imaging system decodes and determines the law of interfering laser pulses, and controls the camera exposure based on this law to achieve the purpose of anti-interference imaging. The adaptive strategy refers to the process of performing autocorrelation and PRI transformation on a collected interference sample, and after traversing the time difference between any two pulses within the minimum to maximum time difference, taking the maximum intensity value to obtain the decoding result.
[0019] Generally speaking, both autocorrelation and PRI can achieve accurate decoding results, but the autocorrelation transform is simple to operate and the PRI transform has better results.
[0020] Adaptive transformation requires the following parameters: counter signal tick, adjacent interference pulse arrival time interval tau, pulse interval time recording signal k n , autocorrelation intensity storage array C, PRI intensity storage array D, transformation intensity maximum value sorting s n _max_k.
[0021] The autocorrelation transformation process can be interpreted as traversing any two sample pulses and adding one to the autocorrelation intensity at the offset to obtain the autocorrelation intensity value at the offset, that is, . In the autocorrelation transformation process, the integer k n As the independent variable after discrete autocorrelation transformation of the pulse function, it means the time difference between n pulse intervals. For example, k1, k2, k3, and k4 refer to the single pulse interval, the sum of two consecutive pulse intervals, the sum of three consecutive pulse intervals, and the sum of four consecutive pulse intervals, respectively.
[0022] In actual situations, the interval between two pulses with an offset exceeding a certain number of pulses is basically impossible to become the final decoded pulse interval. In the autocorrelation process, the strong autocorrelation intensity of the large pulse interval will also correspond to an integer multiple of the actual interfering laser pulse interval, which is not the final decoding result. Therefore, the present invention selects the offset of up to four consecutive pulses for calculation, which greatly simplifies the program complexity, reduces program resource consumption, and improves the overall efficiency of the system.
[0023] like Figure 2 As shown in Figure 1, the PRI transformation process can be interpreted as traversing any two sample pulses and adding a complex exponential phase factor to the PRI intensity at the offset to obtain the PRI intensity value at the offset, that is, .in, is the arrival time of the nth interference pulse, τ is the interval between adjacent interference pulses. In the figure, m and n are the interference pulse location numbers, D is the PRI intensity value, and t m ,t n is the arrival time of the two interference pulses numbered m and n, τ max , τ min is the value range of the PRI independent variable, τ is the time interval between the two selected pulses, and N is the upper limit of the number of pulses involved in decoding.
[0024] The transformation intensity comparison process uses pipeline binary search. The pipeline binary search method in FPGA pipelines each operation stage of the traditional binary search algorithm and utilizes the parallel processing capability of FPGA. The pipeline design can reduce operation delays, improve the response speed of the system, and improve search efficiency and processing capabilities. This method takes advantage of FPGA in processing large amounts of data and complex computing tasks. The series of intensity values obtained in the previous step are divided into multiple pipelines. Each pipeline divides the existing data into two groups. The internal elements are compared and the larger one is taken, so that the maximum value can be obtained efficiently. For example, in the process of comparing and taking the maximum value of 32 data, a 5-stage pipeline needs to be set up, and the amount of data in each stage is 32, 16, 8, 4, 2, and 1 respectively. Multiple search steps can be executed in parallel, thereby reducing the total search time.
[0025] Example 2 The anti-interference imaging method of the InGaAs short-wave infrared camera based on the adaptive strategy of this embodiment requires instruments and equipment including a pulse laser as an analog interference source, an APD photoelectric detection module, a high-speed comparison control module and an InGaAs short-wave infrared camera. The pulse laser can be programmed to generate a pulse laser with a wavelength of 1550nm and an adjustable period pulse width. The APD photoelectric detection module has a response band of 800nm-1700nm. The high-speed comparison control module converts the analog signal into a digital differential signal, and the threshold is adjustable. The InGaAs short-wave infrared camera has a response band of 900nm-1700nm, a resolution of 640×512, and 14 bits of raw data.
[0026] To achieve a better adaptive anti-interference imaging effect, it is necessary to ensure that the detected interference laser has periodicity and the interference laser pulse width is much smaller than the period. In this embodiment, the period of the simulated interference laser is set to 100μs and the pulse width is 20μs. An InGaAs short-wave infrared camera is used to detect the simulated interference light and the surrounding environment.
[0027] First, for the scene to be photographed, turn off the external control exposure. Set the camera's integration time T1 to 100μs and T2 to 250μs. Since the external control exposure is not turned on, the camera exposure is not performed according to the adaptive strategy. At this time, there is an interference spot in the image captured by the camera. Set the camera to turn on the external control exposure. At this time, the camera calculates the incoming simulated interference laser according to the adaptive strategy and generates an anti-interference exposure sequence. At this time, the interference spot of the image captured by the camera disappears, and the anti-interference imaging is completed.
Claims
1. An anti-interference imaging method for optoelectronic imaging equipment based on adaptive strategy, It is characterized in that include: The photoelectric imaging device is set to stop exposure immediately after receiving the interference pulse, and start the counter to start recording the pulse interval clock number; Set the counter to count the pulse time intervals of the 16-bit interference pulses after the interference signal is detected, and record the number of clocks of the time intervals between the arrivals of adjacent interference pulses; Determine the time difference k between adjacent pulse intervals n ; Use autocorrelation transform and PRI transform to update the corresponding k n The autocorrelation intensity value and PRI intensity value at the value; Using pipeline binary search, quickly compare the maximum intensity values and sort them to determine the interference signal period; According to the decoding results, the camera generates a new anti-interference exposure sequence to complete the anti-interference exposure imaging.
2. The anti-interference imaging method of optoelectronic imaging equipment based on adaptive strategy according to claim 1, It is characterized in that The method for detecting and collecting 16-bit pulse interference intervals is: set the photoelectric imaging device to stop exposure immediately after receiving the interference pulse, and start the counter to start recording the pulse interval clock number tick. When the next interference pulse arrives, the counter value at this time is stored in the array tau and reset to zero.
3. The anti-interference imaging method of optoelectronic imaging equipment based on adaptive strategy according to claim 1, It is characterized in that Select up to 4 consecutive pulse intervals as possible period interval values for calculation.
4. The anti-interference imaging method of optoelectronic imaging equipment based on adaptive strategy according to claim 1, It is characterized in that In the autocorrelation transformation process, the integer k n The independent variable after discrete autocorrelation transformation of the pulse function is the time difference between n consecutive pulse intervals.
5. The anti-interference imaging method of optoelectronic imaging equipment based on adaptive strategy according to claim 1, It is characterized in that The autocorrelation transformation process is specifically to traverse any two sample pulses, and add 1 to the autocorrelation strength at the offset in each iteration to obtain the autocorrelation strength value at the offset.
6. The anti-interference imaging method of optoelectronic imaging equipment based on adaptive strategy according to claim 1, It is characterized in that The PRI transformation process is specifically to traverse any two sample pulses, and add a complex exponential phase factor to the PRI intensity at the offset in each iteration to obtain the PRI intensity value at the offset.
7. The anti-interference imaging method of optoelectronic imaging equipment based on adaptive strategy according to claim 1, It is characterized in that Using pipeline binary search, each level of comparison divides the data into two groups, and the internal elements are compared with each other to obtain the larger one, thus obtaining the maximum value.
Citation Information
Cited By
Image imaging method based on anti-ambient light interference technology and image acquisition equipment thereof
CN120602791A
Image imaging method and image acquisition device based on anti-ambient light interference technology
CN120602791B
