A data synchronization system and method for an optoelectronic pod

The satellite positioning unit outputs synchronous second pulse signal and satellite positioning information, and the timer module is initialized to synchronize with UTC time to generate data collection and generation time, which solves the problem of poor synchronization in traditional photoelectric pod data acquisition and transmission systems. High-precision data synchronization is achieved.

CN115865300BActive Publication Date: 2024-11-19CHENGDU JOUAV AUTOMATION TECH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202211508049.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-29
Publication Date
2024-11-19
Estimated Expiration
2042-11-29

AI Technical Summary

Technical Problem

Traditional optoelectronic pod data acquisition and transmission systems have poor data synchronization, resulting in a video pixel positioning offset of dozens or hundreds of meters, which cannot meet the requirements of high-precision applications.

Method used

The satellite positioning unit is used to output synchronous second pulse signals and satellite positioning information, initialize and update the timer module to synchronize with UTC time, and generate a data compressed packet containing the collected data and its generation time to ensure data synchronization.

Benefits of technology

Through the synchronization mechanism of the satellite positioning unit, the synchronization of data acquisition and transmission is achieved, the pixel positioning offset is reduced, and the synchronization requirements of high-precision applications are met.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115865300B_ABST
    Figure CN115865300B_ABST
Patent Text Reader

Abstract

The present invention discloses a data synchronization system for an optoelectronic pod, comprising: a satellite positioning unit, a data acquisition unit and a coding and control unit, wherein the coding and control unit can initialize the timer module of the coding and control unit based on a synchronous second pulse signal, and update the timer module based on the UTC time information contained in the satellite positioning information, so that the timer module is synchronized with the UTC time. When encoding the collected data, the coding and control unit adds the recorded generation time of the control signal corresponding to the collected data to generate a data compression package containing the collected data and its corresponding generation time. This patent is supported by the 2021 Industrial Technology Basic Public Service Platform - Construction of a Public Service Platform for Regionalized Artificial Intelligence Application Development Project, project number 2021‑0166‑1‑2.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of unmanned aerial vehicle data collection, and in particular to a data synchronization system and method for an optoelectronic pod. Background Art

[0002] With the large-scale application of drones in industries such as emergency response, security, and inspection, drone optoelectronic pods are no longer limited to visible light video sensors, but are beginning to incorporate more infrared light video and multi-spectral video sensors. The depth of application is no longer limited to simple viewing of airborne pod videos, but is beginning to require more in-depth applications such as real-time reception by ground stations, fast and dynamic regional orthogonal stitching and three-dimensional modeling, and intelligent recognition and analysis. Therefore, it is required that the onboard multi-channel videos are basically synchronized and have POS (position, attitude, etc.) attribute information.

[0003] However, the current synchronization mechanism is usually that airborne video, inertial sensors, rangefinders and other sensors are simply transmitted to ground equipment through data links such as image transmission and digital transmission, and the ground receiving equipment synchronizes the data through data alignment through file association. However, the acquisition and transmission delays of current video cameras, inertial sensors, rangefinders and POS (position, attitude) systems vary, ranging from tens to hundreds of milliseconds, which can cause the pixel positioning in the video screen to shift by tens or hundreds of meters. In high-precision situations, it is impossible to meet application requirements.

[0004] In summary, the data acquisition and transmission system of the traditional optoelectronic pod has the problem of poor data synchronization. Summary of the invention

[0005] In view of this, the present invention provides a data synchronization system and method for an optoelectronic pod, which solves the problem of poor data synchronization in the traditional data acquisition and transmission system of the optoelectronic pod.

[0006] To solve the above problems, the technical solution of the present invention is to adopt a data synchronization system for an optoelectronic pod, including: a satellite positioning unit, used to output a synchronous second pulse signal and satellite positioning information to an encoding and control unit; a data acquisition unit, capable of generating acquisition data based on a control signal and transmitting the acquisition data to the encoding and control unit; the encoding and control unit, used to output the control signal to the data acquisition unit, record the generation time of the control signal based on a timer module and encode the acquisition data, wherein the encoding and control unit can initialize the timer module of the encoding and control unit based on the synchronous second pulse signal, and update the timer module based on the UTC time information contained in the satellite positioning information, so that the timer module is synchronized with the UTC time, and the encoding and control unit adds the recorded generation time of the control signal corresponding to the acquisition data when encoding the acquisition data, and generates a data compression package containing the acquisition data and its corresponding generation time.

[0007] Optionally, the encoding and control unit also includes a second pulse error tracking controller. After the timer module completes the initial update, each time the satellite positioning unit outputs the synchronous second pulse signal and the satellite positioning information to the encoding and control unit, the timer module outputs the second pulse signal to be calibrated to the second pulse error tracking controller based on the satellite positioning information. The second pulse error tracking controller generates an error time adjustment amount based on the synchronous second pulse signal and the second pulse signal to be calibrated, and updates the timer module based on the error time adjustment amount.

[0008] Optionally, the encoding and control unit also includes a synchronization trigger module. When the data acquisition unit includes multiple types of data acquisition modules, the encoding and control unit can generate a synchronization control signal for synchronously triggering the operation of at least two types of data acquisition modules based on the task type.

[0009] Optionally, the data acquisition unit includes a video acquisition module, wherein, after the encoding and control unit calculates the exposure interval of the video acquisition module, the encoding and control unit generates a video exposure control signal to trigger an exposure signal and records the generation time of the video exposure control signal, and after the video acquisition module feeds back the acquired frame of video image data to the encoding and control unit, it encodes the video image data and adds the generation time to generate a data compression package containing the video image data and its corresponding generation time.

[0010] Optionally, the data acquisition unit includes a video acquisition module and an inertial acquisition module, wherein, after the encoding and control unit calculates the exposure interval of the video acquisition module and the acquisition interval of the inertial acquisition module, the encoding and control unit generates the synchronization control signal to trigger the exposure signal of the video acquisition module. At the same time, the encoding and control unit triggers the inertial acquisition module based on the synchronization control signal and records the generation time of the synchronization control signal. After the inertial acquisition module feeds back the collected inertial measurement data to the encoding and control unit, the inertial measurement data is encoded and added to the generation time to generate a first data compression package including the inertial measurement data and the corresponding generation time. After the video acquisition module feeds back the collected frame of video image data to the encoding and control unit, the video image data is encoded and added to the generation time to generate a second data compression package including the video image data and the corresponding generation time.

[0011] Optionally, the optoelectronic pod synchronization system further includes a data transmission unit for outputting the data compression package.

[0012] Optionally, the video acquisition module includes at least a visible light camera, an infrared camera, a multi-spectral camera and a low-light camera.

[0013] Optionally, the satellite positioning information includes the UTC time information, the drone position information and the drone speed information. The encoding and control unit encodes the satellite positioning information and then transmits the data compression package to the data transmission unit.

[0014] Correspondingly, the present invention provides a data synchronization method for an optoelectronic pod, comprising: outputting a synchronous second pulse signal and satellite positioning information to an encoding and control unit; initializing the timer module of the encoding and control unit based on the synchronous second pulse signal, and updating the timer module based on the UTC time information contained in the satellite positioning information, so that the timer module is synchronized with the UTC time; outputting a control signal to the data acquisition unit; generating acquisition data based on the control signal and transmitting the acquisition data to the encoding and control unit; encoding the acquisition data, and adding the recorded generation time of the control signal corresponding to the acquisition data to generate a data compression package containing the acquisition data and its corresponding generation time.

[0015] Optionally, the data synchronization method also includes: after the timer module completes the initial update, each time the satellite positioning unit outputs the synchronized second pulse signal and the satellite positioning information to the encoding and control unit, the timer module outputs the second pulse signal to be calibrated to the second pulse error tracking controller based on the satellite positioning information; the second pulse error tracking controller generates an error time adjustment amount based on the synchronized second pulse signal and the second pulse signal to be calibrated; and the timer module is updated based on the error time adjustment amount.

[0016] The primary improvement of the present invention is the data synchronization system of the optoelectronic pod provided. By setting the satellite positioning unit to output a synchronous second pulse signal and satellite positioning information, the encoding and control unit can initialize the timer module of the encoding and control unit based on the synchronous second pulse signal, and update the timer module based on the UTC time information contained in the satellite positioning information, so that the timer module is synchronized with the UTC time, thereby enabling the encoding and control unit to output a data packet containing the collected data and its generation time that is synchronized with the UTC time information of the satellite positioning information, which is convenient for the back-end to perform data synchronization association, and solves the problem of poor data synchronization in the data collection and transmission system of the traditional optoelectronic pod. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a simplified unit connection diagram of the data synchronization system of the optoelectronic pod of the present invention;

[0018] Figure 2 It is a simplified flow chart of the data synchronization method of the optoelectronic pod of the present invention. DETAILED DESCRIPTION

[0019] In order to enable those skilled in the art to better understand the technical solution of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0020] like Figure 1As shown, a data synchronization system of an optoelectronic pod includes: a satellite positioning unit, which is used to output a synchronous second pulse signal and satellite positioning information to an encoding and control unit; a data acquisition unit, which can generate acquisition data based on a control signal and transmit the acquisition data to the encoding and control unit; the encoding and control unit is used to output the control signal to the data acquisition unit, record the generation time of the control signal based on a timer module and encode the acquisition data, the encoding and control unit can initialize the timer module of the encoding and control unit based on the synchronous second pulse signal, and update the timer module based on the time information contained in the satellite positioning information, so that the timer module is synchronized with the UTC time, the encoding and control unit adds the recorded generation time of the control signal corresponding to the acquisition data when encoding the acquisition data, generates a data compression package containing the acquisition data and its corresponding generation time, and transmits it to the data transmission unit; the satellite positioning information includes the time information, the drone position information and the drone speed information, and the encoding and control unit encodes the satellite positioning information and transmits the data compression package to the data transmission unit. Among them, the data transmission unit is used to output the data compression package to the back end; the satellite positioning information includes the time information, drone location information and drone speed information; the satellite positioning unit can be a satellite positioning board, and depending on the manufacturer and type, the interface for accessing the coding and control module can be RS232, TTL serial port, network and USB interfaces; the synchronous second pulse signal can be a PPS signal.

[0021] In order to further improve the synchronization accuracy of the timer module and UTC time, the present invention further reduces the error by setting a negative feedback adjustment mechanism. Specifically: the encoding and control unit also includes a pulse-second error tracking controller. After the timer module completes the initial update, each time the satellite positioning unit outputs the synchronized pulse-second signal and the satellite positioning information to the encoding and control unit, the timer module outputs the pulse-second signal to be calibrated to the pulse-second error tracking controller based on the satellite positioning information. The pulse-second error tracking controller generates an error time adjustment amount based on the synchronized pulse-second signal and the pulse-second signal to be calibrated, and updates the timer module based on the error time adjustment amount. Wherein, when the synchronized pulse-second signal and the pulse-second signal to be calibrated are less than a first threshold, the pulse-second error tracking controller does not generate an error time adjustment amount and the timer module does not need to be updated, and outputs a signal that the timer module considers to be credible, so that the encoding and control unit can output a control signal. The first threshold can be 100 picoseconds.

[0022] Furthermore, in order to ensure that the data collected by various types of data acquisition modules can be synchronized in time and avoid interpolation and other operations that may introduce additional errors when the back-end performs data processing, the present invention sets all data acquisition modules to be triggered by the encoding and control unit based on the same clock, and then sets a synchronization trigger module. When the data acquisition unit includes multiple types of data acquisition modules, the encoding and control unit can generate a synchronization control signal for synchronously triggering at least two of the data acquisition modules based on the task type, so that the data acquisition module collects data in strict synchronization. When the back-end receives different types of data compression packages, it can perform associated synchronization based on the generation time contained in the different types of data compression packages, thereby realizing operations such as accurate image stitching / map drawing / geographic information element labeling.

[0023] Furthermore, in the case where the data acquisition unit only includes a video acquisition module, after the encoding and control unit calculates the exposure interval of the video acquisition module, the encoding and control unit generates a video exposure control signal to trigger the exposure signal and records the generation time of the video exposure control signal. After the video acquisition module feeds back the acquired frame of video image data to the encoding and control unit, the video image data is encoded and added to the generation time to generate a data compression package containing the video image data and its corresponding generation time. Wherein, due to different types and manufacturers of video acquisition modules, the video transmission interface can be HDMI, LVDS, MIPI, CVBS, etc.

[0024] Furthermore, in the case where the data acquisition unit includes a video acquisition module and an inertial acquisition module, after the encoding and control unit calculates the exposure interval of the video acquisition module and the acquisition interval of the inertial acquisition module, the encoding and control unit generates the synchronization control signal to trigger the exposure signal of the video acquisition module, and at the same time, the encoding and control unit triggers the inertial acquisition module based on the synchronization control signal and records the generation time of the synchronization control signal. After the inertial acquisition module feeds back the collected inertial measurement data to the encoding and control unit, the inertial measurement data is encoded and added to the generation time to generate a first data compression packet containing the inertial measurement data and the corresponding generation time. After the video acquisition module feeds back the collected frame of video image data to the encoding and control unit, the video image data is encoded and added to the generation time to generate a second data compression packet containing the video image data and the corresponding generation time. The encoding and control unit generates the first data compression packet and the second data compression packet and transmits them to the back end through the data transmission unit respectively. When the back end receives the first data compression packet and the second data compression packet, it can perform association synchronization based on the generation time not included in the first data compression packet and the second data compression packet. Wherein, the video acquisition module includes at least one or more of a visible light camera, an infrared camera, a multi-spectral camera and a low-light camera. When the video acquisition module includes multiple cameras among the visible light camera, the infrared camera, the multi-spectral camera and the low-light camera, if the standard acquisition frequencies of different cameras are different, the lowest common multiple of the standard acquisition frequencies of different cameras is used as the reference acquisition frequency, and the encoding and control unit controls the operation of the inertial measurement module based on the integer multiples of the reference acquisition frequency. Wherein, the inertial acquisition module can be connected to the encoding and control unit through interfaces such as SPI, I2C and RS422 due to different types and manufacturers. At the same time, the inertial acquisition module can be a three-axis or six-axis inertial measurement device according to different actual usage conditions. The three-axis inertial measurement device outputs a three-axis angular velocity, and the six-axis inertial measurement device outputs a three-axis angular velocity and a three-axis acceleration.

[0025] It should be noted that the above examples are provided to facilitate understanding of the technical solution of the present application. The types of data acquisition modules included in the data acquisition unit should not be considered as limited to video acquisition modules and inertial acquisition modules, but can also include other types of data acquisition modules commonly used in the art, such as ranging modules, etc.

[0026] The present invention sets a satellite positioning unit to output a synchronous second pulse signal and satellite positioning information, so that the encoding and control unit can initialize the timer module of the encoding and control unit based on the synchronous second pulse signal, and update the timer module based on the UTC time information contained in the satellite positioning information, so that the timer module is synchronized with the UTC time, so that the encoding and control unit can output a data packet containing the collected data and its generation time that is synchronized with the UTC time information of the satellite positioning information, which is convenient for the back end to perform data synchronization association, and solves the problem of poor data synchronization in the data collection and transmission system of the traditional optoelectronic pod.

[0027] Accordingly, the present invention provides a data synchronization method for an optoelectronic pod, comprising: outputting a synchronous second pulse signal and satellite positioning information to an encoding and control unit; initializing the timer module of the encoding and control unit based on the synchronous second pulse signal, and updating the timer module based on the time information contained in the satellite positioning information, so that the timer module is synchronized with the UTC time; outputting a control signal to the data acquisition unit; generating acquisition data based on the control signal and transmitting the acquisition data to the encoding and control unit; encoding the acquisition data, and adding the recorded generation time of the control signal corresponding to the acquisition data to generate a data compression package containing the acquisition data and its corresponding generation time.

[0028] Furthermore, the data synchronization method also includes: after the timer module completes the initial update, each time the satellite positioning unit outputs the synchronized second pulse signal and the satellite positioning information to the encoding and control unit, the timer module outputs the second pulse signal to be calibrated to the second pulse error tracking controller based on the satellite positioning information; the second pulse error tracking controller generates an error time adjustment amount based on the synchronized second pulse signal and the second pulse signal to be calibrated; and the timer module is updated based on the error time adjustment amount.

[0029] Furthermore, the data synchronization method also includes: when the data acquisition unit includes multiple types of data acquisition modules, the encoding and control unit can generate a synchronization control signal for synchronously triggering the operation of at least two of the data acquisition modules based on the task type, so that the time for the data acquisition modules to collect data is strictly synchronized, and the back end can perform associated synchronization based on the generation time contained in the different types of data compression packages when receiving different types of data compression packages, thereby realizing accurate image stitching / map drawing / geographic information element labeling and other operations.

[0030] The data synchronization system and method of the optoelectronic pod provided in the embodiment of the present invention are introduced in detail above. The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the embodiments can refer to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can refer to the method part description. It should be pointed out that for ordinary technicians in this technical field, without departing from the principle of the present invention, several improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the scope of protection of the claims of the present invention.

[0031] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0032] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

Claims

1. A data synchronization system for an optoelectronic pod, characterized in that: include: A satellite positioning unit, used for outputting a synchronous second pulse signal and satellite positioning information to the encoding and control unit; A data acquisition unit, capable of generating acquisition data based on a control signal and transmitting the acquisition data to the encoding and control unit; The encoding and control unit is used to output the control signal to the data acquisition unit, record the generation time of the control signal based on the timer module and encode the acquired data, wherein: The coding and control unit can initialize the timer module of the coding and control unit based on the synchronous second pulse signal, and update the timer module based on the UTC time information contained in the satellite positioning information, so that the timer module is synchronized with the UTC time. The encoding and control unit adds the recorded generation time of the control signal corresponding to the collected data when encoding the collected data, and generates a data compression package including the collected data and the corresponding generation time. The encoding and control unit further comprises a pulse-per-second error tracking controller. After the timer module completes the initial update, each time the satellite positioning unit outputs the synchronous pulse-per-second signal and the satellite positioning information to the encoding and control unit, the timer module outputs the pulse-per-second signal to be calibrated to the pulse-per-second error tracking controller based on the satellite positioning information. The pulse-per-second error tracking controller generates an error time adjustment amount based on the synchronous pulse-per-second signal and the pulse-per-second signal to be calibrated, and updates the timer module based on the error time adjustment amount. The encoding and control unit further comprises a synchronous triggering module. When the data acquisition unit comprises multiple types of data acquisition modules, the encoding and control unit can generate a synchronous control signal for synchronously triggering at least two types of the data acquisition modules based on the task type. The data acquisition unit includes a video acquisition module and an inertial acquisition module, wherein after the encoding and control unit calculates the exposure interval of the video acquisition module and the acquisition interval of the inertial acquisition module, the encoding and control unit generates the synchronization control signal to trigger the exposure signal of the video acquisition module, and at the same time, the encoding and control unit triggers the inertial acquisition module based on the synchronization control signal and records the generation time of the synchronization control signal. After the inertial acquisition module feeds back the collected inertial measurement data to the encoding and control unit, the inertial measurement data is encoded and added with the generation time to generate a first data compression package including the inertial measurement data and the corresponding generation time. After the video acquisition module feeds back the acquired frame of video image data to the encoding and control unit, the video image data is encoded and added with the generation time to generate a second data compression package including the video image data and the corresponding generation time.

2. The optoelectronic pod synchronization system according to claim 1, characterized in that: The optoelectronic pod synchronization system also includes a data transmission unit for outputting the data compression package.

3. The optoelectronic pod synchronization system according to claim 1, characterized in that: The video acquisition module at least includes a visible light camera, an infrared camera, a multi-spectral camera and a low-light camera.

4. The optoelectronic pod synchronization system according to claim 1, characterized in that: The satellite positioning information includes the UTC time information, the drone position information and the drone speed information, The encoding and control unit encodes the satellite positioning information and then transmits the data compression package to the data transmission unit.

5. A data synchronization method for an optoelectronic pod, characterized in that: include: Output synchronous second pulse signal and satellite positioning information to the encoding and control unit; Initializing a timer module of the encoding and control unit based on the synchronous second pulse signal, and updating the timer module based on the UTC time information included in the satellite positioning information, so that the timer module is synchronized with the UTC time; Output control signal to the data acquisition unit; generating acquisition data based on the control signal and transmitting the acquisition data to the encoding and control unit; The collected data is encoded, and the recorded generation time of the control signal corresponding to the collected data is added to generate a data compression package including the collected data and the corresponding generation time.

6. The data synchronization method according to claim 5, characterized in that: The data synchronization method further includes: After the timer module completes the initial update, each time the satellite positioning unit outputs the synchronous second pulse signal and the satellite positioning information to the encoding and control unit, the timer module outputs the second pulse signal to be calibrated based on the satellite positioning information to the second pulse error tracking controller; The pulse-per-second error tracking controller generates an error time adjustment amount based on the synchronous pulse-per-second signal and the pulse-per-second signal to be calibrated; The timer module is updated based on the error time adjustment.

Citation Information

Patent Citations

  • GPS time reference-based multi-point synchronous communication method and device

    CN106341879A

  • Incoherent distributed deep coupling anti-interference integrated navigation method and system

    CN110864686A

  • Data acquisition time synchronization system and method

    CN111007554A

  • Photoelectric pod collimation axis error correction method based on integrated navigation post-processing

    CN114608611A

  • Millisecond-level data synchronization device and method for photoelectric pod

    CN115269718A