Method for compensating large-area array infrared focal plane scanning image motion in real time by applying fast reflecting mirror

By using fast reflector real-time compensation technology in infrared detectors, the image blur problem caused by image shift in large-area array gaze focal plane infrared detectors is solved, and the image resolution is improved, and the dynamic resolution is from 22LP/mm is increased to 26lp/mm.

CN118938463APending Publication Date: 2024-11-12CHINESE PEOPLES LIBERATION ARMY UNIT 91977 +1
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411327315.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-23
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

In high-speed scanning photography, large-area array gaze focal plane infrared detectors have a long integration time, resulting in image shift of more than 1/3 of the pixel, resulting in image blurring.

Method used

The method of using fast reflectors to compensate large-plan infrared focal plane scanning image shift in real time is used. By rigidly connecting the scanning image shift compensation mirror with the infrared detector, the compensation time is ensured to be greater than the integral time, and the DC servo motor, encoder, and reflector are used. It realizes real-time compensation with the controller, and combines the composite control strategy of speed feedforward compensation to eliminate scanning image shift.

Benefits of technology

The dynamic resolution of the image is effectively improved, from 22LP/mm to 26lp/mm, verified the effectiveness of the compensation method and ensured the improvement of image quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118938463A_ABST
    Figure CN118938463A_ABST
Patent Text Reader

Abstract

The invention discloses a method for compensating scanning image motion of a large-area array infrared focal plane in real time by using a fast reflector, which is characterized in that an infrared detector of a large-area array staring focal plane is rigidly connected with a rotating lens barrel, and the rotating direction of a scanning image motion compensating mirror is opposite to the scanning image motion direction of the infrared detector; the compensation time of the scanning image motion compensation mirror is ensured to be longer than the integral time of the infrared detector; during scanning imaging, after the scanning image motion compensating mirror receives a photographing pulse sent by the rotating lens barrel, the rotating scanning image motion compensating mirror starts to compensate and lock an optical axis, after the infrared detector completes integral imaging, the rotating scanning image motion compensating mirror returns to an initial compensation position to wait for a next photographing pulse, and then the process is repeated. The whole scanning imaging process is completed according to the set sequence. According to the invention, the problem of image blurring caused by the fact that the image motion exceeds 1 / 3 pixel in the integration time in high-speed scanning photography due to the fact that the integration time of a large-area array staring focal plane infrared detection device is long is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of image imaging, and relates to a method for using a fast reflection mirror to compensate for large-area array infrared focal plane scanning image displacement in real time. Background Art

[0002] The resolution requirements of cameras are getting higher and higher. In the past, panoramic cameras mainly used linear array detectors or small area array infrared detectors, but their pixel size was small, the resolution was low and the image quality was poor. Large area array staring focal plane infrared detectors will replace linear array or small area array infrared detectors in the field of aerial reconnaissance in recent years due to their high-quality imaging capabilities.

[0003] Large-area array staring focal plane infrared detectors have good imaging performance and are therefore widely used in long-distance infrared oblique photography systems. However, the integration time of large-area array staring focal plane infrared detectors is relatively long. In high-speed scanning photography, if the image shift exceeds 1 / 3 of the pixel during the integration time, the image will be blurred. In order to ensure image quality and reduce or even eliminate the impact of image shift, compensation technology must be used to ensure that the image remains stable on the focal plane during the integration time of the large-area array staring focal plane infrared detector. Motion compensation of scanning image shift is essentially a spatial velocity matching problem, so it has become a hot research direction in this field. Summary of the invention

[0004] The purpose of the present invention is to provide a method for real-time compensation of large-area array infrared focal plane scanning image motion using a fast reflector, so as to solve the problem that due to the long integration time of large-area array staring focal plane infrared detection devices, the image motion exceeds 1 / 3 of the pixel within the integration time in high-speed scanning photography, which will cause image blur.

[0005] In order to achieve the above-mentioned purpose, the technical solution adopted by the present invention is: a method of using a fast reflection mirror to compensate for the scanning image shift of a large-area array infrared focal plane in real time, so that the infrared detector of the large-area array staring focal plane is rigidly connected to the rotating lens barrel, and the rotation direction of the scanning image shift compensation mirror is opposite to the scanning image shift direction of the infrared detector, ensuring that the compensation time of the scanning image shift compensation mirror is greater than the integration time of the infrared detector; during scanning imaging: when the scanning image shift compensation mirror receives a photographic pulse emitted by the rotating lens barrel, the rotating scanning image shift compensation mirror starts to compensate and lock the optical axis, and when the infrared detector completes the integral imaging, the rotating scanning image shift compensation mirror returns to the initial compensation position to wait for the next photographic pulse, and then repeats the process until the entire scanning imaging process is completed according to the set order.

[0006] As a preferred technical solution of the present invention, the scanning image motion compensation mirror includes a DC servo motor, an encoder, a reflector, a mirror frame and a controller; the reflector is embedded in the mirror frame; the controller obtains the rotation speed of the camera barrel in real time through RS422 serial communication, and the compensation speed of the scanning image motion compensation mirror matches the rotation speed of the lens barrel to realize the scanning image motion compensation function of the camera.

[0007] As a preferred technical solution of the present invention, the DC servo motor is a limited-angle brushless motor.

[0008] As a preferred technical solution of the present invention, a scanning image motion compensation mirror control system is established to realize the control of the speed and position of the scanning image motion compensation mirror, thereby eliminating the scanning image motion caused by the rotation of the compensation lens barrel, specifically:

[0009] The equation for the armature voltage of a DC servo motor is established based on Kirchhoff's law:

[0010]

[0011] Establish the electromagnetic torque equation of the DC servo motor:

[0012] T e =K t I

[0013] Establish the mechanical equation of the scanning image motion compensation mirror:

[0014] Jω=T e -T f

[0015] Establish the armature back electromotive force equation of the scanning image motion compensation mirror:

[0016] E=K e ω

[0017] Establish the drag torque equation of the scanning image motion compensation mirror:

[0018] T f =K f ω+T0

[0019] In the formula, U is the winding terminal voltage, E is the back electromotive force of the motor armature, R is the motor armature resistance, L is the motor armature inductance, I is the current flowing through the motor armature, ω is the motor speed, J is the equivalent moment of inertia of the load, and K is t is the moment coefficient, T f is the resistance torque, K f is the drag coefficient, T a is the contact resistance torque, K e is the back EMF coefficient.

[0020] As a preferred technical solution of the present invention, the scanning image motion compensation mirror control system adopts a current loop as an inner loop, a speed loop as an intermediate loop, and a position loop as an outer loop feedback control, combined with a composite control strategy of speed feedforward compensation, the encoder is used for positioning feedback in the position loop, and the difference of the encoder is used as speed feedback.

[0021] The beneficial effects of the present invention are as follows: a method of the present invention using a fast reflector to compensate for large-area array infrared focal plane scanning image motion in real time is intended to solve the problem caused by scanning image motion of large-area array infrared detector scanning photography. The mechanism of scanning image motion compensation is analyzed. An image motion compensation control method based on a fast reflector, an image motion compensation control method experiment and an on-board experiment for verifying the matching of image motion and fast reflector speed. Compared with the traditional fixed speed compensation method, the dynamic resolution can be increased from 22LP / mm to 26lp / mm, which verifies the effectiveness of the compensation method. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a layout principle diagram of a method for real-time compensation of large-area array infrared focal plane scanning image shift using a fast reflector according to the present invention;

[0023] Figure 2 This is an imaging principle diagram of a method for real-time compensation of large-area array infrared focal plane scanning image shift using a fast reflector according to the present invention;

[0024] Figure 3 A schematic diagram of a scanning image motion compensation mirror control system established by a method of using a fast reflection mirror to compensate for large-area array infrared focal plane scanning image motion in real time according to the present invention;

[0025] Figure 4 This is the principle diagram of the current loop in the control system of the scanning image motion compensation mirror;

[0026] Figure 5 This is the principle diagram of the speed loop in the control system of the scanning image motion compensation mirror;

[0027] Figure 6 This is the principle diagram of the position loop in the control system of the scanning image motion compensation mirror;

[0028] Figure 7 It is a position-speed control data curve diagram of a method of using a fast reflector to compensate for large-area array infrared focal plane scanning image shift in real time when working at 33Hz in an application example;

[0029] Figure 8 It is a position-speed control data curve diagram of a method of using a fast reflector to compensate for large-area array infrared focal plane scanning image shift in real time when working at 100 Hz in an application example;

[0030] Fig. 9 This is a comparison diagram of the effects of a method of using a fast reflector to compensate for large-array infrared focal plane scanning image motion in real time in an application example of the present invention. DETAILED DESCRIPTION

[0031] The technical solution of the present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0032] like Figure 1 As shown, a method for real-time compensation of scanning image shift of a large-area array infrared focal plane using a fast reflector is characterized in that the infrared detector of the large-area array staring focal plane is rigidly connected to the rotating lens barrel, the rotation direction of the scanning image shift compensation mirror is opposite to the direction of scanning image shift of the infrared detector, and the compensation time of the scanning image shift compensation mirror is ensured to be greater than the integration time of the infrared detector; during scanning imaging: when the scanning image shift compensation mirror receives the photographic pulse emitted by the rotating lens barrel, the rotating scanning image shift compensation mirror starts to compensate and lock the optical axis, and when the infrared detector completes the integral imaging, the rotating scanning image shift compensation mirror returns to the initial compensation position to wait for the next photographic pulse, and then repeats the process until the entire scanning imaging process is completed according to the set sequence. The scanning image shift compensation mirror includes a DC servo motor, an encoder, a reflector, a lens frame and a controller; the reflector is embedded in the lens frame; the controller obtains the rotation speed of the camera lens barrel in real time through RS422 serial communication, and the compensation speed of the scanning image shift compensation mirror matches the rotation speed of the lens barrel to realize the scanning image shift compensation function of the camera.

[0033] Scanning image motion is a unique image motion generated by the camera swing imaging. As shown in Figure 2, when the camera is stationary, the image is reflected by the scanning image motion compensation mirror and imaged at point A on the infrared detector. When the scanning mirror scans and photographs the object to be tested on the ground through the rotation of the lens barrel, the image point will move from point A to point A' during the integration time, thus forming an image motion. Figure 2 As shown in the figure, if the scanning image motion compensation mirror is fixed at 45 degrees, the focal plane Σ1 of the infrared detector can be equivalent to the focal plane Σ2 on the lens axis of the infrared detector. The reasons for the image offset are as follows: Point A is the image point on the focal plane at the beginning of integration. When the lens barrel scans at a uniform speed ω, and during the integration time Δt, the image point on the focal plane Σ1 moves from point A to point A', thereby forming an image movement. By rotating the scanning image motion compensation mirror during the detector integration time, the point A' on the focal plane Σ2 moves to point A, which can eliminate the image movement caused by scanning.

[0034] The scanning image motion is compensated as shown in the formula:

[0035]

[0036] Where: θ ωis the compensation angular velocity of the scanning image motion compensation mirror; f is the focal length of the outer infrared lens; ω is the scanning rate of the lens barrel; R cm It is the distance from the center of the reflector in the scanning image motion compensation mirror to the infrared detector.

[0037] The scanning image motion compensation mirror is placed between the optical lens (the optical lens consists of an infrared lens, a scanning mirror, etc.) and the infrared detector. The structural dimensions of the scanning image motion compensation mirror mainly depend on the diameter of the optical lens's exit pupil and the diameter of the scanning beam. The moment of inertia of the scanning image motion compensation mirror is mainly determined by its size and material density. The load torque of the DC servo motor of the scanning image motion compensation mirror must have sufficient redundancy to achieve the required acceleration and speed. This determines the scanning frequency and bandwidth of the compensation.

[0038] A scanning image motion compensation mirror control system is established to realize the control of the speed and position of the scanning image motion compensation mirror, thereby eliminating the scanning image motion caused by the rotation of the compensation lens barrel. Specifically:

[0039] The equation for the armature voltage of a DC servo motor is established based on Kirchhoff's law:

[0040]

[0041] Establish the electromagnetic torque equation of the DC servo motor:

[0042] T e =K t I

[0043] Establish the mechanical equation of the scanning image motion compensation mirror:

[0044] Jω=T e -T f

[0045] Establish the armature back electromotive force equation of the scanning image motion compensation mirror:

[0046] E=K e ω

[0047] Establish the drag torque equation of the scanning image motion compensation mirror:

[0048] T f =K f ω+T0

[0049] In the formula, U is the winding terminal voltage, E is the back electromotive force of the motor armature, R is the motor armature resistance, L is the motor armature inductance, I is the current flowing through the motor armature, ω is the motor speed, J is the equivalent moment of inertia of the load, and K is t is the moment coefficient, T f is the resistance torque, K f is the drag coefficient, T ais the contact resistance torque, K e is the back electromotive force coefficient. Therefore, the transfer function of the entire controlled object can be shown in Figure 3 middle.

[0050] The essence of the scanning image motion compensation mirror control system is to use the current loop as the inner loop, the speed loop as the middle loop, and the position loop as the outer loop feedback control, combined with a composite control strategy of speed feedforward compensation. The absolute encoder is used for positioning feedback in the position loop, and the difference of the encoder is used as speed feedback.

[0051] Current loop design: The current loop uses a high-precision sampling resistor as a current feedback element, and the current loop is an I-type system. The current loop can improve the dynamic response speed of the system and reduce the dynamic error of the system current output. The controller is used as the current inner loop correction link. The control block diagram of the current loop is as follows Figure 4 As shown, I* is the input of the current loop, ω is the output angular velocity of the speed loop, G CC K is the correction link of the current inner loop. PMW is the gain of the PWM power amplifier, K Ω is the transfer function of the current feedback.

[0052] Speed ​​loop design: The current loop is equivalent to an inertia link, and the encoder position difference is used as a speed feedback speed loop. The speed loop reduces the system and improves the system response bandwidth. Therefore, lead-lag compound correction is applied in the speed loop. The speed loop control principle is as follows Figure 5 As shown. Among them, I* is the input angular velocity of the speed loop, ω is the output angular velocity of the speed loop, G cc For the feedback series correction link, K e is the angular velocity feedback transfer function.

[0053] Position loop design: The velocity loop is equivalent to the transfer function loop. The position loop is designed to achieve stable and high-precision tracking of the barrel space velocity. The position loop is designed as a type II system. Therefore, a composite control method is adopted. The position loop control principle is as follows Figure 6 As shown in the figure, θ* is the angle input of the scanning image motion compensation mirror, and θ is the angle output of the position ring. θC and G θPC It is a series feedback and feedforward correction link, K θ is the position feedback transfer function.

[0054] The parameters of the position control system of the DC servo motor are as follows: armature resistance (46Ω); inductor enhancement (50μH); equivalent moment of inertia (5.14×10 2kgm2); electromotive force coefficient (44.879V / rad / s); electromagnetic torque (0.2); coefficient (Nm / a); rated voltage (28V); rated current (0.2A); sampling resistance (0.2Ω); encoder resolution (1.236 arc seconds); pulse width modulation switching frequency (45 kHz).

[0055] The closed-loop bandwidth of the current loop is 2627Hz (1.65×10 5 rad / s), which is equivalent to the inertia link. Therefore, the closed-loop transfer function can be expressed as follows:

[0056]

[0057] In the design of the speed loop, attention should be paid to the stability and dynamic performance of the entire control system. Therefore, the speed loop is designed as a lag-advance compound correction link. The correction link of the speed loop is shown in the formula:

[0058]

[0059] The bandwidth of the current loop exceeds 2000Hz. Based on the series correction method in typical classical control theory, the current loop controller is designed as follows:

[0060]

[0061] The bandwidth of the speed loop is 260Hz (1.36×10 3 rad / s), which is a second-order system. Therefore, the equivalent closed-loop transfer function can be expressed as follows:

[0062]

[0063] Design of the position loop controller In order to ensure dynamic performance, the position loop is designed as a composite series correction correction method, designed as a lag link. And the feedforward correction link is designed as a leading chain compensation position loop controller design rearview mirror control system needs to consider the characteristics of dynamic quality control and dynamic error requirements of the system. The position loop is designed as a typical type II system, and the transfer function is as follows:

[0064]

[0065] The closed-loop bandwidth of the system in the position loop design is 95Hz. The feedforward correction link adopts the feedforward control mode of speed compensation. Because the differential link amplifies the high-frequency noise, the small inertia link is added with the differential link to suppress the high-frequency noise. The transfer function of the position loop is as follows:

[0066]

[0067] Application Examples

[0068] The scanning image motion compensation function is a key technology for high-precision imaging of scanning cameras. The position and speed of the scanning image motion compensation mirror are measured under the maximum frequency conditions of the camera. The frame rate of the panoramic camera is 33Hz, and the limit of the scanning image motion compensation mirror working frame frequency is 100 Hz.

[0069] The controller of the scanning image motion compensation mirror communicates with the servo controller of the camera lens barrel. The spatial speed of the lens barrel and the photographic synchronization pulse signal are received in real time. The lens barrel servo controller integrates the scanning speed of the lens barrel and uses the position signal generated by the integration as the criterion for sending the photographic synchronization pulse. The photographic synchronization pulse signal is generated by the lens barrel servo controller as a switch signal for scanning compensation and reset. The position-speed response curve is set to 33Hz and 100Hz respectively. The speed response curve at 33Hz is as follows Figure 7 As shown, the speed response curve at 100Hz is as follows Figure 8 shown.

[0070] Figure 7 The position-speed control data curve when working at 33Hz. The position error generated by the integration of the angular position of the compensation mirror and the barrel speed is 1‰. According to the focal length of the infrared camera lens and the size of the infrared detector pixel, the compensation error requirement should be less than 5‰ to obtain a clear image. Therefore, the compensation mirror control system meets the accuracy requirements.

[0071] The infrared camera uses a compensation mirror to compensate for the scanning image movement. The scanning speed of the mirror barrel is set to 30° / s, and the compensation mirror is used in no compensation, fixed speed compensation, and dynamic tracking compensation to obtain three photos. Fig. 9 The first is that when the compensation mirror does not compensate, the photo is blurred in the up and down directions; the second is to compensate at a fixed speed, and the photo can be recognized below 22LP / mm; the third uses the mirror barrel tracking speed compensation, which can reach 26lp / mm.

[0072] According to the characteristics of infrared camera scanning image motion compensation, a current-speed-position three-closed-loop composite controller is designed. This controller not only ensures the dynamic accuracy of the compensation mirror, but also ensures the high response bandwidth of the compensation mirror. Finally, compared with the traditional fixed speed compensation method, this speed-dependent compensation can greatly improve the dynamic resolution of the camera. By comparing the traditional fixed type, the compensation method is improved and the effectiveness of the compensation method is verified through dynamic photography experiments.

Claims

1. A method for real-time compensation of image motion of large array infrared focal plane scanning using a fast reflector, characterized in that: The infrared detector of the large-area array staring focal plane is rigidly connected to the rotating lens barrel, and the rotation direction of the scanning image shift compensation mirror is opposite to the scanning image shift direction of the infrared detector, ensuring that the compensation time of the scanning image shift compensation mirror is greater than the integration time of the infrared detector; during scanning imaging: when the scanning image shift compensation mirror receives the photographic pulse emitted by the rotating lens barrel, the rotating scanning image shift compensation mirror starts to compensate and lock the optical axis, and when the infrared detector completes the integral imaging, the rotating scanning image shift compensation mirror returns to the initial compensation position to wait for the next photographic pulse, and then repeats the process until the entire scanning imaging process is completed according to the set order.

2. The method for real-time compensation of large array infrared focal plane scanning image motion using a fast reflector according to claim 1, characterized in that: The scanning image motion compensation mirror comprises a DC servo motor, an encoder, a reflector, a mirror frame and a controller; the reflector is embedded in the mirror frame; the controller obtains the rotation speed of the camera barrel in real time through RS422 serial communication, and the compensation speed of the scanning image motion compensation mirror matches the rotation speed of the lens barrel to realize the scanning image motion compensation function of the camera.

3. The method for real-time compensation of large array infrared focal plane scanning image motion using a fast reflector according to claim 2, characterized in that: The DC servo motor is a limited-angle brushless motor.

4. The method for real-time compensation of large array infrared focal plane scanning image motion using a fast reflector according to claim 3, characterized in that: A scanning image motion compensation mirror control system is established to realize the control of the speed and position of the scanning image motion compensation mirror, thereby eliminating the scanning image motion caused by the rotation of the compensation lens barrel. Specifically: The equation for the armature voltage of a DC servo motor is established based on Kirchhoff's law: Establish the electromagnetic torque equation of the DC servo motor: T e =K t I Establish the mechanical equation of the scanning image motion compensation mirror: Jω=T e -T f Establish the armature back electromotive force equation of the scanning image shift compensation mirror motor: E=K e oh Establish the drag torque equation of the scanning image motion compensation mirror: T f =K f ω+T0 In the formula, U is the winding terminal voltage, E is the back electromotive force of the motor armature, R is the motor armature resistance, L is the motor armature inductance, I is the current flowing through the motor armature, ω is the motor speed, J is the equivalent moment of inertia of the load, and K is t is the moment coefficient, T f is the resistance torque, K f is the drag coefficient, T a is the contact resistance torque, K e is the back EMF coefficient.

5. The method for real-time compensation of large array infrared focal plane scanning image motion using a fast reflector according to claim 4, characterized in that: The scanning image motion compensation mirror control system adopts a current loop as an inner loop, a speed loop as an intermediate loop, and a position loop as an outer loop feedback control, combined with a composite control strategy of speed feedforward compensation, an encoder is used for positioning feedback in the position loop, and the difference of the encoder is used as speed feedback.

Citation Information

Cited By

  • Distributed image motion compensation mechanism and method

    CN119882220A

  • Miniature rapid reflecting mirror equipment based on miniaturized platform

    CN121657277A