A photoelectric tracking imaging system, method and medium

By adjusting the turntable speed and image acquisition frequency in real time in the photoelectric tracking imaging system and performing pixel compensation processing, the problem of mismatch between image acquisition frequency and target movement speed was solved, resulting in a clearer imaging effect.

CN117156280BActive Publication Date: 2026-11-06TIANJIN JINHANG INST OF TECH PHYSICS
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311120422.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-08-31
Publication Date
2026-11-06
Estimated Expiration
2043-08-31

Smart Images

  • Figure CN117156280B_ABST
    Figure CN117156280B_ABST
Patent Text Reader

Abstract

This application discloses a photoelectric tracking imaging system, comprising: a turntable mechanism for supporting an image acquisition mechanism, a turntable drive module for driving the turntable to rotate according to an adaptive rotation speed, and a rotation speed acquisition module for obtaining the adaptive rotation speed based on the moving speed of the tracked target; an image acquisition mechanism including an information conversion module and an image acquisition module, wherein the information conversion module obtains a corresponding image acquisition frequency based on the adaptive rotation speed, and the image acquisition module acquires an image of the tracked target according to the image acquisition frequency to obtain an initial image; an image processing mechanism for performing pixel compensation processing on the initial image according to the image acquisition frequency to obtain a processed image; and an imaging mechanism for displaying the processed image. The photoelectric tracking imaging system achieves higher imaging clarity.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application generally relates to the field of imaging technology, and more particularly to a photoelectric tracking imaging system, method, and medium. Background Technology

[0002] In the context of modernization, photoelectric tracking imaging systems are primarily used for real-time monitoring and precise tracking of moving targets. These passive image tracking devices operate in the visible light, low-light, or mid-infrared bands, enabling timely, accurate, and covert acquisition of image information of the tracked moving target. A typical photoelectric tracking imaging system includes a rotation mechanism, an image acquisition mechanism, an image processing mechanism, and an imaging mechanism. The rotation mechanism supports the image acquisition mechanism, allowing it to rotate according to the moving speed of the tracked target. Simultaneously, the image acquisition mechanism acquires images of the tracked target and outputs them to the image processing mechanism for processing. The processed image is then displayed by the imaging mechanism, thus completing the tracking and imaging of the target. Existing photoelectric tracking imaging systems use image acquisition mechanisms with preset discrete frequencies for image acquisition. However, the moving speed of the tracked target is often continuously changing. Therefore, when an image is acquired at a certain frequency at a specific moment, that frequency often cannot perfectly match the moving speed of the tracked target. Furthermore, the probability of the acquisition frequency matching the target's speed decreases even further when the target's moving speed changes subsequently. When the image acquisition frequency is mismatched with the moving speed of the tracked target, the acquired image will still have a strong blurriness even after pixel compensation processing, and this blurriness will increase as the mismatch worsens. Therefore, how to make the image of the tracked moving target clearer has become an urgent problem to be solved in this field. Summary of the Invention

[0003] In view of the above-mentioned defects or deficiencies in the prior art, it is desirable to provide a photoelectric tracking imaging system, method and medium with higher imaging clarity.

[0004] The specific technical solution is as follows:

[0005] First aspect

[0006] This application provides a photoelectric tracking imaging system, including:

[0007] A turntable mechanism, comprising a turntable, a turntable drive module, and a rotation speed acquisition module, wherein the turntable is used to support an image acquisition mechanism, the turntable drive module is used to drive the turntable to rotate according to an adaptive rotation speed, and the rotation speed acquisition module is used to acquire the adaptive rotation speed according to the moving speed of the tracked target, wherein the adaptive rotation speed corresponds to and continuously changes with the moving speed of the tracked target relative to the turntable.

[0008] An image acquisition mechanism is provided, comprising an information conversion module and an image acquisition module. The information conversion module is used to obtain a corresponding image acquisition frequency based on the adaptive rotation speed. The image acquisition module is used to acquire images of the tracked target based on the image acquisition frequency to obtain an initial image, wherein the image acquisition frequency changes continuously with the adaptive rotation speed.

[0009] An image processing mechanism is used to perform pixel compensation processing on the initial image according to the image acquisition frequency to obtain a processed image;

[0010] An imaging mechanism for displaying the processed image.

[0011] As a further limitation of this application, the image processing mechanism includes a TDI processing module for performing pixel compensation processing on the initial image to obtain a processed image.

[0012] As a further limitation of this application, a transmission mechanism is connected between the image processing mechanism and the imaging mechanism, the transmission mechanism comprising:

[0013] A first conversion module is used to convert the processed image into an optical signal;

[0014] Optical fiber, used to transmit the optical signal;

[0015] The second conversion module is used to convert the optical signal into a data signal that can be displayed by the imaging mechanism.

[0016] As a further limitation of this application, it also includes a power supply mechanism, which includes a power distribution module and an internal power supply, the input terminal of which is connected to an external power supply; the power distribution module is used to supply the electrical energy output by the internal power supply to the power-consuming components within the photoelectric tracking imaging system.

[0017] Second aspect

[0018] This application provides a photoelectric tracking imaging method using the photoelectric tracking imaging system described above, comprising the following steps:

[0019] The adaptive rotational speed of the turntable drive module for driving the turntable to rotate is obtained. The adaptive rotational speed corresponds to and continuously changes with the moving speed of the tracked target relative to the turntable.

[0020] Based on the adaptive rotation speed, obtain the image acquisition frequency of the image acquisition module for acquiring images of the tracked target, which corresponds to the adaptive rotation speed and changes continuously thereafter;

[0021] The tracked target is image acquired according to the image acquisition frequency to obtain an initial image;

[0022] The initial image is subjected to pixel compensation processing to obtain the processed image;

[0023] The processed image is then displayed.

[0024] Third aspect

[0025] This application provides a photoelectric tracking imaging medium, which uses the photoelectric tracking imaging method described above to achieve imaging of the tracked target.

[0026] The beneficial effects of this application are:

[0027] In this solution, the adaptive rotation speed of the turntable driven by the turntable drive module changes continuously and in real time according to the movement speed of the tracked target relative to the turntable; simultaneously, the frequency at which the image acquisition module acquires images of the tracked target also changes continuously and in real time with the adaptive rotation speed. Therefore, the number of initial images of the tracked target acquired by the image acquisition module per unit time will be more closely matched with the movement speed of the tracked target. Consequently, the processed image obtained after pixel compensation will be displayed more clearly in the imaging mechanism. Compared to existing technologies where the image acquisition mechanism acquires images at only a few discrete values, the photoelectric tracking imaging system in this application has stronger adaptability to moving tracked targets and higher imaging clarity. Attached Figure Description

[0028] Other features, objects, and advantages of this application will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings:

[0029] Figure 1 This is a connection diagram of the photoelectric tracking imaging system provided in the embodiments of this application;

[0030] Figure 2 for Figure 1 A schematic diagram of the functional modules of the Zhongguang Optoelectronic Tracking Imaging System in practice;

[0031] Figure 3 for Figure 1 A schematic diagram of the TDI processing timing of the image processing mechanism in the image processing unit;

[0032] Figure 4 A flowchart illustrating the steps of the photoelectric tracking imaging method provided in this application embodiment; Detailed Implementation

[0033] The present application will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings.

[0034] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0035] Example 1

[0036] Please refer to Figure 1 This is a connection diagram of a photoelectric tracking imaging system provided in this embodiment, including:

[0037] A turntable mechanism, comprising a turntable, a turntable drive module, and a rotation speed acquisition module, wherein the turntable is used to support an image acquisition mechanism, the turntable drive module is used to drive the turntable to rotate according to an adaptive rotation speed, and the rotation speed acquisition module is used to acquire the adaptive rotation speed according to the moving speed of the tracked target, wherein the adaptive rotation speed corresponds to and continuously changes with the moving speed of the tracked target relative to the turntable.

[0038] An image acquisition mechanism is provided, comprising an information conversion module and an image acquisition module. The information conversion module is used to obtain a corresponding image acquisition frequency based on the adaptive rotation speed. The image acquisition module is used to acquire images of the tracked target based on the image acquisition frequency to obtain an initial image, wherein the image acquisition frequency changes continuously with the adaptive rotation speed.

[0039] An image processing mechanism is used to perform pixel compensation processing on the initial image according to the image acquisition frequency to obtain a processed image;

[0040] An imaging mechanism for displaying the processed image.

[0041] In this solution, the adaptive rotation speed of the turntable driven by the turntable drive module changes continuously and in real time according to the movement speed of the tracked target relative to the turntable; simultaneously, the frequency at which the image acquisition module acquires images of the tracked target also changes continuously and in real time with the adaptive rotation speed. Therefore, the number of initial images of the tracked target acquired by the image acquisition module per unit time will be more closely matched with the movement speed of the tracked target. Consequently, the processed image obtained after pixel compensation will be displayed more clearly in the imaging mechanism. Compared to existing technologies where the image acquisition mechanism acquires images at only a few discrete values, the photoelectric tracking imaging system in this application has stronger adaptability to moving tracked targets and higher imaging clarity.

[0042] Furthermore, with Figure 2 Let's take an example to illustrate this in detail. Figure 2 The DTDI imaging device, obtained by implementing the above-described scheme, includes a CMOS camera for image data acquisition. After acquisition, the image data is transmitted to an image processing circuit board. The image processing circuit board performs decoding, DTDI processing, and encoding operations on the image data. The image data is then transmitted in Camera Link format to the Camera Link acquisition box. In the Camera Link acquisition box, the image data is converted into a gigabit Ethernet signal and transmitted to an information conversion circuit board. Here, the image signal is converted into an optical signal and transmitted via a turntable slip ring to an external information conversion circuit board on the turntable. The optical signal is then received and converted to a gigabit Ethernet signal, which is input to the host computer. In this device, the turntable's internal power supply is connected to an external power supply to power the power distribution module.

[0043] The image processing circuit board consists of field-programmable logic devices (FPGAs), a data receiving circuit, and a data driving circuit. It uses a Xilinx FPGA XC7K325TFFG625 as the main controller, connected to a crystal oscillator and program memory, forming the minimum FPGA system. The data receiving circuit uses a DS90CR286MTD chip, and the data driving circuit uses a DS90CR285MTD chip. The program memory uses Micron's SPI FLASH, model MT25QL256ABA8ESF-0SIT.

[0044] The image processing mechanism includes a TDI processing module, which performs pixel compensation processing on the initial image to obtain a processed image.

[0045] Specific examples Figure 3The diagram illustrates the timing sequence of image data transmission to the information processing circuit board, where it undergoes TDI processing via a field-programmable logic chip and related circuits. Taking a 3-stage integral series as an example, the process is extended to an N-stage integral series.

[0046] During pushbroom imaging, in the first row cycle, the CMOS sensor outputs pixel matrix P1, and the FPGA controls the first three rows of data to be written into memory M. After one row cycle, the sensor moves one pixel width along the pushbroom direction and outputs the second frame image P2. At this time, the object corresponding to linear array 1 is the same as the object corresponding to linear array 2 in the previous frame. Therefore, the FPGA controls the first three rows of data in P2 to be superimposed with the corresponding data in P1 and stored in memory. Similarly, in the third row cycle, memory M1 stores the superposition of imaging data of the same object from linear array 1 in the current frame, linear array 2 in the previous frame, and linear array 3 in the previous two frames. Memory M2 stores the sum of imaging data from linear array 2 in the current frame and linear array 3 in the previous frame. Memory M3 temporarily stores the imaging data of linear array 3 in the current frame. After the data in M1 is superimposed in each row cycle, it is output under the control of the FPGA. At this time, the 3-stage integral output signal is:

[0047] N signal (3) = P3(1) + P2(2) + P1(3)

[0048] Therefore, the grayscale value of the output signal of the M-level CMOS digital domain TDI algorithm can be derived:

[0049]

[0050] The nth image data storage, P k (j) represents the image data of the j-th row of the k-th image.

[0051] The FPGA can use the above timing parameter derivation formulas to process image data, obtain the processed image data, and output it to the backend.

[0052] This invention utilizes the RAM storage resource module and cache output principle of field-programmable logic devices to implement time delay integration technology at the software level, thus solving the problems of image trailing and blurring of area array detectors under relative motion.

[0053] Practice has proven that the DTDI imaging device proposed in this invention, while ensuring clear imaging of the array detector, has good real-time performance, high integration, and strong versatility, and plays a positive role in the practical application of DTDI.

[0054] Example 2

[0055] like Figure 4 The diagram shown is a flowchart of the steps of a photoelectric tracking imaging method provided in this embodiment. Using the photoelectric tracking imaging system described above, the method includes the following steps:

[0056] S1: Obtain the adaptive rotation speed of the turntable drive module for driving the turntable to rotate. The adaptive rotation speed corresponds to the moving speed of the tracked target relative to the turntable and changes continuously thereafter.

[0057] S2: Based on the adaptive rotation speed, obtain the image acquisition frequency of the image acquisition module for acquiring images of the tracked target, which is corresponding to the adaptive rotation speed and changes continuously thereafter;

[0058] S3: Acquire images of the tracked target according to the image acquisition frequency to obtain an initial image;

[0059] S4: Perform pixel compensation processing on the initial image to obtain the processed image;

[0060] S5: Display the processed image.

[0061] Example 3

[0062] This embodiment provides a photoelectric tracking imaging medium, which uses the photoelectric tracking imaging method described above to achieve imaging of the tracked target.

[0063] The above description is merely a preferred embodiment of this application and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the inventive concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this application.

Claims

1. A photoelectric tracking imaging system, characterized in that, include: A turntable mechanism, comprising a turntable, a turntable drive module, and a rotation speed acquisition module, wherein the turntable is used to support an image acquisition mechanism, the turntable drive module is used to drive the turntable to rotate according to an adaptive rotation speed, and the rotation speed acquisition module is used to acquire the adaptive rotation speed according to the moving speed of the tracked target, wherein the adaptive rotation speed corresponds to and continuously changes with the moving speed of the tracked target relative to the turntable. An image acquisition mechanism is provided, comprising an information conversion module and an image acquisition module. The information conversion module is used to obtain a corresponding image acquisition frequency based on the adaptive rotation speed. The image acquisition module is used to acquire images of the tracked target based on the image acquisition frequency to obtain an initial image, wherein the image acquisition frequency changes continuously with the adaptive rotation speed. An image processing mechanism is used to perform pixel compensation processing on the initial image according to the image acquisition frequency to obtain a processed image; An imaging mechanism for displaying the processed image.

2. The photoelectric tracking imaging system according to claim 1, characterized in that, The image processing mechanism includes a TDI processing module, which performs pixel compensation processing on the initial image to obtain a processed image.

3. The photoelectric tracking imaging system according to claim 1, characterized in that, A transmission mechanism is connected between the image processing mechanism and the imaging mechanism, and the transmission mechanism includes: A first conversion module is used to convert the processed image into an optical signal; Optical fiber, used to transmit the optical signal; The second conversion module is used to convert the optical signal into a data signal that can be displayed by the imaging mechanism.

4. The photoelectric tracking imaging system according to claim 1, characterized in that, It also includes a power supply mechanism, which includes a power distribution module and an internal power supply. The input terminal of the internal power supply is connected to an external power supply. The power distribution module is used to supply the electrical energy output by the internal power supply to the power-consuming components within the photoelectric tracking imaging system.

5. A photoelectric tracking imaging method, characterized in that, Using the photoelectric tracking imaging system as described in any one of claims 1-4, the following steps are included: The adaptive rotational speed of the turntable drive module for driving the turntable to rotate is obtained. The adaptive rotational speed corresponds to and continuously changes with the moving speed of the tracked target relative to the turntable. Based on the adaptive rotation speed, obtain the image acquisition frequency of the image acquisition module for acquiring images of the tracked target, which corresponds to the adaptive rotation speed and changes continuously thereafter; The tracked target is image acquired according to the image acquisition frequency to obtain an initial image; The initial image is subjected to pixel compensation processing to obtain the processed image; The processed image is then displayed.

Citation Information

Patent Citations

  • Image adaptive centering scheme during target tracking of photoelectric turntable

    CN116149384A

  • Target detection and tracking method and system, and movable platform, camera and medium

    WO2021072696A1