Electronic system for compensating an aerial camera for an anamorphic image shift, method for compensating an anamorphic image shift

Abstract

The present application provides a kind of allometry image shift compensation aerial camera electronic system, allometry image shift imaging compensation method.The aerial camera electronic system includes control computer module, interface module, main control module, support allometry image shift camera body module, support allometry image shift compensation function imaging module;Support allometry image shift compensation function imaging module can convert optical signal into electrical signal, drive detector imaging, while, when needing to carry out allometry image shift compensation, allometry image shift compensation is carried out, overcome the defect that existing aerial camera does not have allometry image shift compensation function;And the allometry image shift compensation aerial camera electronic system of the present application, can realize aerial allometry image shift compensation under the premise of not additional increase system hardware equipment, and can reduce imaging system quality, volume, power consumption, cost.

Description

Technical Field

[0001] This invention relates to the field of aerospace technology, and in particular to an electronic system for compensating for allometric image shift in an aerial camera and an imaging compensation method for allometric image shift. Background Technology

[0002] During reconnaissance operations, reconnaissance aircraft need to fly at high speed and low altitude to evade enemy radar surveillance. Low-altitude, high-speed flight significantly improves the aircraft's battlefield survivability and deep reconnaissance and surveillance capabilities. However, this causes severe image shift on the target surface of aerial imaging, resulting in blurred aerial images and affecting the effectiveness of aerial reconnaissance. Furthermore, during forward flight, adjustments to the aircraft's attitude (such as side-flying) or the pitch angle of the aerial camera lens can cause the aerial camera to be in a certain position... Figure 1 The oblique viewing working state is shown. A schematic diagram on the target surface is shown below. Figure 2 As shown, its characteristic is that the image movement direction of pixels on the target surface is the same, but the magnitude of image movement varies in different pixel regions. This type of image movement is called allometric image movement. Aerial cameras have significant technical and tactical importance for oblique-view operations, therefore, allometric image movement occupies an important position in aerial image movement.

[0003] Driven by the broader digital environment, photogrammetry is rapidly developing into a digital field. Aerial photography, thanks to advancements in large-scale CCD devices, high dynamic range positioning and attitude determination technologies, and the inherent advantages of digital aerial cameras, will undoubtedly see high-resolution digital aerial cameras gradually replace film-based aerial cameras. Aerial digital cameras have significant applications and broad prospects in both military and civilian sectors. In the national economy, my country is vigorously developing high-altitude Earth observation technology. High-resolution area-array CCD aerial cameras have already played a crucial role in aerial mapping, resource surveys, and disaster assessment, demonstrating their clear advantages over film aerial cameras. Therefore, there is an urgent need for aerial imaging motion compensation technology to evolve towards electronic and digital transformation.

[0004] As the resolution of spaceborne remote sensing cameras increases, so do their focal length and relative aperture, leading to a continuous increase in camera size and weight. This contradicts the limited carrying capacity of satellite platforms. Therefore, it is essential to consider reducing camera size and weight while simultaneously improving resolution—that is, miniaturization and lightness. Currently, camera electronics systems are becoming a key factor limiting the overall size, weight, and power consumption of cameras. Therefore, reducing the weight and improving the performance of electronics systems—that is, increasing the integration of electronics systems—has become a major trend in the development of spaceborne remote sensing cameras. Furthermore, current aerial cameras lack anomalous image shift compensation capabilities, severely hindering the development of my country's aerial camera research and development capabilities.

[0005] Given the current limitations of cameras, such as large size, heavy weight, and lack of compensation functionality, improvements are necessary. Summary of the Invention

[0006] Based on this, the present invention proposes an electronic system for compensating for all-velocity image shift in an aerial camera and an imaging compensation method for all-velocity image shift, in order to solve or partially solve the problems existing in the prior art.

[0007] In a first aspect, the present invention provides an electronic system for compensating for all-velocity image shift in an aerial camera, comprising:

[0008] The control computer module is used to input the data required for all-velocity image shift compensation and the control signal data required for controlling the aerial camera to capture images.

[0009] An interface module, which is electrically connected to the control computer module, is used to receive data input from the control computer module and perform interface conversion.

[0010] The main control module is electrically connected to the interface module, and the main control module is used to receive data from the interface module and process and distribute it.

[0011] It supports the camera body module of the different speeds of image movement, which is used to receive the control signal data required for the aerial camera to take pictures after being sorted and distributed by the main control module and to collect light signals;

[0012] An imaging module supporting allometric image shift compensation is electrically connected to the main control module and the camera body module supporting allometric image shift compensation. The imaging module supporting allometric image shift compensation is used to convert the acquired light signal into an electrical signal and perform imaging. The imaging module supporting allometric image shift compensation is used to receive the data required for allometric image shift compensation after being sorted and allocated by the main control module and to perform allometric image shift compensation.

[0013] Preferably, the electronic system for the aerial camera with allometric image shift compensation further includes an allometric image shift data processing module, which is electrically connected to the imaging module supporting the allometric image shift compensation function. The allometric image shift data processing module is used to process the image signal generated by the imaging module supporting the allometric image shift compensation function.

[0014] Preferably, the allometric image motion compensation aerial camera electronic system further includes a data transmission module and a data recording module. The data transmission module is electrically connected to the allometric image motion data processing module and the data recording module, respectively. The data transmission module is used to transmit the image signal processed by the allometric image motion data processing module, and the data recording module is used to save the image signal transmitted by the data transmission module.

[0015] Preferably, the allometric image shift compensation aerial camera electronic system further includes a data display module electrically connected to the data recording module, which is used to display the image signal stored by the data recording module.

[0016] Preferably, the aerial camera electronic system for allometric image shift compensation further includes a power supply module, which is electrically connected to the camera body module supporting allometric image shift and the imaging module supporting allometric image shift compensation, respectively. The power supply module is used to supply power to the camera body module supporting allometric image shift and the imaging module supporting allometric image shift compensation.

[0017] Secondly, the present invention also provides a method for compensating for all-velocity image shift based on the aforementioned all-velocity image shift compensation aerial camera electronic system, comprising the following steps:

[0018] Input the data required for all-velocity image shift compensation and the control signal data required for controlling the aerial camera to take pictures into the control computer module;

[0019] The interface module is used to receive data input from the control computer module and perform interface conversion;

[0020] The main control module is used to receive data from the interface modules and process and distribute it.

[0021] The camera module supports receiving control signal data and acquiring light signals required for aerial camera shooting after being processed and allocated by the main control module.

[0022] The imaging module supporting allometric image shift compensation converts the acquired optical signal into an electrical signal and performs imaging. The imaging module supporting allometric image shift compensation is used to receive the data required for allometric image shift compensation after being sorted and allocated by the main control module and to perform allometric image shift compensation.

[0023] The allometric image motion data processing module will process the image signals generated by the imaging module that supports allometric image motion compensation.

[0024] The data recording module stores the signal data processed by the allometric image motion data processing module;

[0025] The data display module shows the signal data saved by the data recording module.

[0026] Preferably, the data required for the allometric image shift compensation method includes shooting time, frame rate, flight altitude, flight speed, and number of blocks.

[0027] Preferably, the aforementioned allometric image shift compensation method controls the control signal data required for aerial camera shooting, including dimming, focusing, power on, and power off.

[0028] The electronic system and method for compensating for all-velocity image shift in an aerial camera of the present invention have the following advantages over the prior art:

[0029] 1. The aerial camera electronic system for allometric image shift compensation of the present invention includes a control computer module, an interface module, a main control module, a camera body module supporting allometric image shift compensation, and an imaging module supporting allometric image shift compensation function. The imaging module supporting allometric image shift compensation function can convert light signals into electrical signals to drive the detector to image. At the same time, it can perform allometric image shift compensation when needed, overcoming the defect that existing aerial cameras do not have allometric image shift compensation function. Moreover, the aerial camera electronic system for allometric image shift compensation of the present invention can realize aerial allometric image shift compensation without adding additional system hardware equipment, and can reduce the quality, size, power consumption and cost of the imaging system.

[0030] 2. The electronic system for compensating for image shift at different speeds in the aerial camera of the present invention further includes an image shift at different speeds data processing module, a data transmission module, a data recording module, and a data display module. The image shift at different speeds data processing module performs correction, compression, data conversion, and other processing on the image signal generated by the imaging module supporting the image shift at different speeds compensation function, and performs image shift at different speeds compensation data processing, and inputs the processed signal to the data transmission module. The data transmission module is used to transmit the image signal processed by the image shift at different speeds data processing module, the data recording module is used to save the image signal transmitted by the data transmission module, and the data display module is used to display the image signal saved by the data recording module.

[0031] 3. The allometric image shift imaging compensation method of the present invention acquires light signals by supporting the allometric image shift camera body module, and uses the allometric image shift compensation function imaging module to convert the acquired light signals into electrical signals and perform imaging. The allometric image shift compensation function imaging module is used to receive the data after being sorted and allocated by the main control module and perform allometric image shift compensation, so as to overcome the problem that aerial cameras in the prior art cannot perform allometric image shift compensation. Attached Figure Description

[0032] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0033] Figure 1 A schematic diagram of the principle of allometric image shift in aviation and a schematic diagram of allometric image shift on the target surface;

[0034] Figure 2 This is a schematic diagram of allotropic image shift on the target surface.

[0035] Figure 3 This is a schematic diagram of the electronic system for compensating for image shift at different speeds in this application.

[0036] Figure 4 This is a flowchart illustrating the image motion compensation method for the aerial camera electronic system of the present application. Detailed Implementation

[0037] To facilitate understanding of this application, a more complete description will be provided below with reference to the accompanying drawings. Preferred embodiments of this application are shown in the drawings. However, this application can be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided to provide a thorough and complete understanding of the disclosure of this application.

[0038] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.

[0039] This application provides an electronic system for compensating for image shift at different speeds in an aerial camera, such as... Figure 3 As shown, it includes:

[0040] The control computer module 10 is used to input the data required for all-velocity image shift compensation and the control signal data required for controlling the aerial camera to capture images.

[0041] Interface module 11 is electrically connected to control computer module 10. Interface module 11 is used to receive data input from control computer module 10 and perform interface conversion.

[0042] The main control module 12 is electrically connected to the interface module 11. The main control module 12 is used to receive data from the interface module 11 and process and distribute it.

[0043] Supports the camera body module 13 of different speeds, which is used to receive the control signal data required for the aerial camera to capture images after being sorted and distributed by the main control module and to collect light signals.

[0044] An imaging module 14 that supports allometric image shift compensation is electrically connected to the main control module 12 and the camera body module 13 that supports allometric image shift compensation. The imaging module 14 that supports allometric image shift compensation is used to convert the acquired light signal into an electrical signal and perform imaging. The imaging module 14 that supports allometric image shift compensation is used to receive the data required for allometric image shift compensation after being sorted and allocated by the main control module 12 and to perform allometric image shift compensation.

[0045] It should be noted that the electronic system for the aerial camera with allometric image shift compensation in this application includes: a control computer module 10, an interface module 11, a main control module 12, a camera body module 13 supporting allometric image shift compensation, and an imaging module 14 supporting allometric image shift compensation. The control computer module 10 is used to input the data required for allometric image shift compensation and the control signal data required for controlling the aerial camera to take pictures. The control computer module 10 is developed using a C51 microcontroller. The interface module 11 is used to provide a bus interface for sending configuration data to the main control module 12. Specifically, the interface module 11 sends the data required for allometric image shift compensation and the control signal data required for controlling the aerial camera to take pictures, which are input through the control computer module 10, to the main control module 12, such as aerial camera initialization data: focal length, azimuth, pitch, working mode, array size, and pixel size. The interface utilizes an ASM fiber optic interface and is developed using an STM32F103 ARM chip. The main control module 12 is responsible for organizing and distributing the data transmitted by the interface module 11 and sending it to the imaging module with toroidal motion compensation function to control imaging and toroidal motion parameters. Specifically, the main control module 12 transmits the control signal data required for controlling the aerial camera to the camera body module supporting toroidal motion compensation function, and transmits the data required for toroidal motion compensation to the imaging module supporting toroidal motion compensation function. The main control module 12 is developed using a dedicated DSP chip DSP28335. The camera body module 13 supporting toroidal motion compensation function is used to collect light signals, control the exposure time, and transmit the light signals to the imaging module 14 supporting toroidal motion compensation function. The imaging module 14 supporting toroidal motion compensation function is used to convert the light signals into electrical signals, drive the detector to image, perform toroidal motion compensation when required, amplify the signals, drive them, and transmit them to the toroidal motion data processing module. Both the camera body module 13 and the imaging module 14, which support the function of all-velocity image shift compensation, are integrated devices.

[0046] The aerial camera electronic system for allometric image shift compensation disclosed in this application supports an imaging module that can convert light signals into electrical signals to drive the detector to form an image. At the same time, it can perform allometric image shift compensation when needed, overcoming the deficiency of existing aerial cameras that do not have allometric image shift compensation function. Moreover, the aerial camera electronic system for allometric image shift compensation disclosed in this application can realize aerial allometric image shift compensation without adding additional system hardware equipment, and can reduce the quality, size, power consumption and cost of the imaging system.

[0047] In some embodiments, the system further includes an allometric image motion data processing module 15, which is electrically connected to the imaging module 14 that supports allometric image motion compensation. The allometric image motion data processing module 15 is used to process the image signal generated by the imaging module that supports allometric image motion compensation.

[0048] Specifically, the allometric image shift data processing module 15 performs correction, compression, data conversion, and other processing on the image signal generated by the imaging module that supports allometric image shift compensation function, as well as allometric image shift compensation data processing, and inputs the processed signal to the data transmission module; the allometric image shift data processing module 15 is developed using the FPGA development board AXU5EV-P.

[0049] In some embodiments, the system further includes a data transmission module 16 and a data recording module 17. The data transmission module 16 is electrically connected to the allometric image motion data processing module 15 and the data recording module 17, respectively. The data transmission module 16 is used to transmit the image signal processed by the allometric image motion data processing module 15, and the data recording module 17 is used to save the image signal transmitted by the data transmission module 16.

[0050] Specifically, the data transmission module 16 is used to transmit the digital image signal processed by the allometric image motion data processing module, and the data transmission module 16 adopts an I2C bus interface; the data recording module 17 saves the transmitted digital image signal for later data retrieval, and the data recording module can be developed using a USB flash drive or hard drive.

[0051] In some embodiments, a data display module 18 is also included, which is electrically connected to the data recording module 17, and the data display module 18 is used to display the image signal stored in the data recording module 17.

[0052] The data display module 18 is used to display the digital image signals stored in the data recording module 17. The upper computer display software is developed using a computer and the development language is VS2010.

[0053] In some embodiments, a power supply module 19 is further included. The power supply module 19 is electrically connected to the camera body module 13 supporting allometric image shift and the imaging module 14 supporting allometric image shift compensation function, respectively. The power supply module 19 is used to supply power to the camera body module 13 supporting allometric image shift and the imaging module 14 supporting allometric image shift compensation function. The power supply module 19 is a VPT power supply VXR7-2805S.

[0054] Based on the same inventive concept, embodiments of this application also provide a method for compensating for anomalous image shift based on the above-described anomalous image shift compensation aerial camera electronic system, such as... Figure 4 As shown, it includes the following steps:

[0055] S1. Input the data required for all-velocity image shift compensation and the control signal data required for controlling the aerial camera to take pictures into the control computer module.

[0056] S2. The interface module is used to receive data input from the control computer module and perform interface conversion;

[0057] S3, The main control module is used to receive data from the interface module and process and distribute it.

[0058] S4, Supports the use of the camera body module to receive the control signal data required for the aerial camera to capture images after being sorted and distributed by the main control module, and to collect light signals.

[0059] S5, The imaging module that supports the function of all-velocity image shift compensation converts the acquired light signal into an electrical signal and performs imaging. The imaging module that supports the function of all-velocity image shift compensation is used to receive the data required for all-velocity image shift compensation after being sorted and allocated by the main control module and to perform all-velocity image shift compensation.

[0060] S6, the allometric image motion data processing module will process the image signals generated by the imaging module that supports allometric image motion compensation.

[0061] S7. The data recording module saves the signal data processed by the allotropic image motion data processing module.

[0062] S8, the data display module displays the signal data saved by the data recording module.

[0063] Specifically, the causes of allometric image shift in aerial cameras are as follows:

[0064] During reconnaissance, reconnaissance aircraft need to fly at high speed and low altitude to evade enemy radar surveillance. High-speed, low-altitude flight greatly improves the aircraft's battlefield survivability and deep reconnaissance and surveillance capabilities. However, this causes severe image shift on the target surface during aerial imaging, resulting in blurred aerial images and affecting the effectiveness of aerial reconnaissance. During forward flight, due to the aircraft's attitude adjustments (such as side-flying) or the adjustment of the aerial camera lens's pitch angle, the aerial camera operates in an oblique viewing state. A schematic diagram of the target surface is shown below. Figure 2 As shown, when a CCD camera with an area array is tilted during imaging, due to the aircraft's tilt, within a single ground area, the forward image migration velocity of a near target on the image plane is the same in direction but different in magnitude compared to the forward image migration velocity of a far target. This forward image migration velocity, which is equal in direction but unequal in magnitude, is defined as heterogeneous image migration.

[0065] The allometric image shift compensation method of this application acquires light signals by supporting the allometric image shift camera body module, and uses the allometric image shift compensation function imaging module to convert the acquired light signals into electrical signals and perform imaging. The allometric image shift compensation function imaging module is used to receive the data after being sorted and allocated by the main control module and perform allometric image shift compensation, so as to overcome the problem that aerial cameras in the prior art cannot perform allometric image shift compensation.

[0066] Specifically, the data required for allometric motion compensation includes shooting time, frame rate, flight altitude, flight speed, and number of blocks.

[0067] The control signals required for aerial camera shooting include dimming, focusing, power on, and power off.

[0068] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. An electronic system for compensating for image shift at different speeds in an aerial camera, characterized in that, include: The control computer module is used to input the data required for all-velocity image shift compensation and the control signal data required for controlling the aerial camera to capture images. The data required for the allometric image shift compensation includes shooting time, frame rate, flight altitude, flight speed, and number of blocks to control the aerial camera; the control signal data required for shooting includes dimming, focusing, power on, and power off. An interface module, which is electrically connected to the control computer module, is used to receive data input from the control computer module and perform interface conversion. The main control module is electrically connected to the interface module, and the main control module is used to receive data from the interface module and process and distribute it. It supports the camera body module of the different speeds of image movement, which is used to receive the control signal data required for the aerial camera to take pictures after being sorted and distributed by the main control module and to collect light signals; An imaging module supporting allometric image shift compensation is electrically connected to the main control module and the camera body module supporting allometric image shift. The imaging module supporting allometric image shift compensation is used to convert the acquired light signal into an electrical signal and perform imaging. The imaging module supporting allometric image shift compensation is used to receive the data required for allometric image shift compensation after being sorted and allocated by the main control module and perform allometric image shift compensation. The system also includes a heterogeneous image motion data processing module, which is electrically connected to the imaging module that supports heterogeneous image motion compensation function. The heterogeneous image motion data processing module is used to process the image signal generated by the imaging module that supports heterogeneous image motion compensation function. The control computer module is developed using a C51 microcontroller; the interface module provides a bus interface for sending configuration data to the main control module; its interface uses an ASM fiber optic interface and is developed using an STM32F103 ARM chip; the main control module is developed using a dedicated DSP chip DSP28335; the camera body module supporting all-velocity image shift compensation is used to acquire light signals, control exposure time, and transmit the light signals to the imaging module supporting all-velocity image shift compensation; both the camera body module and the imaging module supporting all-velocity image shift compensation are integrated devices; the all-velocity image shift data processing module is developed using an AXU5EV-P FPGA development board. The main control module is responsible for organizing and distributing the data transmitted by the interface module and sending it to the imaging module with allometric image shift compensation function to control the imaging and allometric image shift parameters; the main control module transmits the control signal data required for controlling the aerial camera to the camera body module with allometric image shift compensation function, and transmits the data required for allometric image shift compensation to the imaging module with allometric image shift compensation function. The imaging module that supports all-velocity image shift compensation is used to convert optical signals into electrical signals, drive the detector to image, perform all-velocity image shift compensation during all-velocity image shift compensation, amplify the signal, drive it, and send it to the all-velocity image shift data processing module. The system also includes a data transmission module and a data recording module. The data transmission module is electrically connected to the allometric image motion data processing module and the data recording module, respectively. The data transmission module is used to transmit the image signal processed by the allometric image motion data processing module, and the data recording module is used to save the image signal transmitted by the data transmission module. The data transmission module adopts an I2C bus interface, and the data recording module can be developed using a USB flash drive or a hard drive. The system also includes a data display module, which is electrically connected to the data recording module. The data display module is used to display the image signals stored by the data recording module. The host computer display software is developed using a computer and the development language is VS2010. The system also includes a power supply module, which is electrically connected to the camera body module supporting all-velocity image shift and the imaging module supporting all-velocity image shift compensation function, respectively. The power supply module is used to supply power to the camera body module supporting all-velocity image shift and the imaging module supporting all-velocity image shift compensation function. The power supply module adopts a VPT power supply VXR7-2805S.

2. A method for compensating for all-velocity image shift based on the all-velocity image shift compensation aerial camera electronic system as described in claim 1, characterized in that, Includes the following steps: Input the data required for all-velocity image shift compensation and the control signal data required for controlling the aerial camera to take pictures into the control computer module; The interface module is used to receive data input from the control computer module and perform interface conversion; The main control module is used to receive data from the interface modules and process and distribute it. The camera module supports receiving control signal data and acquiring light signals required for aerial camera shooting after being processed and allocated by the main control module. The imaging module supporting allometric image shift compensation converts the acquired optical signal into an electrical signal and performs imaging. The imaging module supporting allometric image shift compensation is used to receive the data required for allometric image shift compensation after being sorted and allocated by the main control module and to perform allometric image shift compensation. The allometric image motion data processing module will process the image signals generated by the imaging module that supports allometric image motion compensation. The data recording module stores the signal data processed by the allometric image motion data processing module; The data display module shows the signal data saved by the data recording module.

Images