A method for time synchronization and information fusion of optical measurement equipment

By using data interaction core units and embedded hardware in optical measurement equipment to handle serial port and network interruptions, the real-time problem of data synchronization and information fusion of optical measurement equipment is solved, and efficient collection and synchronization of multi-sensor data is achieved to meet the high-quality Frequency processing requirements improve the real-time processing capabilities of the equipment.

CN118503166BActive Publication Date: 2024-11-01CHANGCHUN INST OF OPTICS FINE MECHANICS & PHYSICS CHINESE ACAD OF SCI
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410949189.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-16
Publication Date
2024-11-01
Estimated Expiration
2044-07-16

AI Technical Summary

Technical Problem

When existing optical measurement equipment is synchronized and fusion of data, the computer interface is limited and cannot access multiple sensor information at the same time. The real-time performance of the computer operating system cannot meet the complete storage and alignment of high-frequency sensor data information at frequencies of 1000hz and above. need.

Method used

The data interaction core unit is adopted to realize information synchronization and fusion between the subsystems of the optical measurement equipment through embedded hardware, and the serial interrupt and network interrupt processing mechanisms are used to ensure the accurate reception and processing of data packets, and realize time synchronization and information resolution. Meet the needs of collecting and synchronizing multi-sensor data.

Benefits of technology

It realizes efficient collection, synchronization and storage of multi-sensor data by optical measurement equipment, meets the sensor information processing needs of updating frequencies of 1000hz and above, ensures the same timing and fixed format transmission of different sensor information, and improves real-time processing capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118503166B_ABST
    Figure CN118503166B_ABST
Patent Text Reader

Abstract

The present invention relates to a method for time synchronization and information fusion of optical measurement equipment, which belongs to the field of data processing technology, and solves the problems that the existing solutions cannot collect information of multiple sensors at the same time and the real-time performance cannot meet the requirements. When the external trigger interrupt is the interrupt of the serial port where the encoder is located and the encoder data is received, the encoder data packet is used as the minimum time unit accumulated by the counter, and the encoder data is stored in the cache for storing superimposed information. When the encoder system is not in the setting state, the system that needs to superimpose information is selected, the current frame rate of the system is determined, and the serial port of the selected system is assigned a time information value and sent; when the external trigger interrupt is the network data distribution and receiving serial port interruption, it is divided into two situations: network data distribution interruption and non-network data distribution interruption. The present invention is based on embedded hardware implementation, has high scalability, can meet the application requirements of optical measurement equipment for data collection and synchronization of multiple sensors, and has strong real-time performance.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a method for time synchronization and information fusion of optical measurement equipment. Background Art

[0002] When the range optical measurement equipment is used to track and measure the flight target, each subsystem needs to work in high coordination in real time, and the time information synchronization, data image information fusion, and real-time data interaction of each subsystem all require fast and accurate data communication as support. After the mission, the data of the equipment intersection solution must be obtained according to the selected station location. The accuracy of the solution is closely related to the time synchronization between the devices. This requires the data communication system of the optical measurement equipment to have good data communication capabilities.

[0003] The current solution to achieve information synchronization and fusion of optical measurement equipment is to use a computer to collect multi-source information and store it in the form of continuous data packets on the computer hard disk. Multiple sensor data information and digital image information are stored on the same hard disk at the same time and aligned afterwards.

[0004] However, the main disadvantage of this method of using computers for data alignment and storage is that the computer interface is limited and cannot access multiple sensor information at the same time. At the same time, the real-time performance of the computer operating system cannot meet the complete storage and alignment of high-frequency sensor data information with a frequency of 1000 Hz and above. Summary of the invention

[0005] In view of the above problems existing in the prior art, the present invention provides a method for time synchronization and information fusion of optical measurement equipment, which can accurately fuse data according to system time and distribute it to various subsystems of the optical measurement equipment.

[0006] In order to solve the above technical problems, the present invention adopts the following technical solutions:

[0007] A method for time synchronization and information fusion of optical measurement equipment, wherein the optical measurement equipment comprises a data interaction core unit, and the data interaction core unit performs information synchronization and fusion between subsystems of the optical measurement equipment by executing the following steps:

[0008] Step 1: When an external trigger interrupt enters, determine whether the external trigger interrupt is an interrupt of the serial port where the encoder is located or an interrupt of the network data distribution and receiving serial port. If the external trigger interrupt is an interrupt of the serial port where the encoder is located, execute step 2; if the external trigger interrupt is an interrupt of the network data distribution and receiving serial port, execute step 7;

[0009] Step 2: The interface receives encoder information in interrupt mode and determines whether encoder data is currently entering the interface. If encoder data is received, step 3 is executed; if encoder data is not received, the time system terminal is used as an external trigger to count the time;

[0010] Step 3: Use the received encoder data packet as the minimum time unit for the counter to accumulate, and store the received encoder data into the buffer for storing the superposition information;

[0011] Step 4: Determine whether the current main control system has sent an encoder setting instruction to the encoder system. If so, jump back to step 2 and receive the encoder data again. Otherwise, execute step 5.

[0012] Step 5: Select the system that needs to overlay information, and determine the current frame rate of the selected overlay information system according to the main control information;

[0013] Step 6: assign a time information value to the serial port of the selected overlay information system and send it, and then execute step 12;

[0014] Step 7: Read the interrupt status register again to enter the interrupt selection entry;

[0015] Step 8: Determine whether the external trigger interrupt is a network data distribution interrupt, if so, execute step 9, otherwise execute step 11;

[0016] Step 9: Clear the receiving encoder buffer and read the watchdog counter value, and accumulate the time information and the counter;

[0017] Step 10: Read the delay time calculated by the watchdog counter to determine whether the delay time is greater than the delay time. If so, perform network data distribution and time information solution, and then execute step 12;

[0018] Step 11: Determine whether the external trigger interrupt is an interrupt for receiving serial ports other than the encoder. If so, enter the serial port interrupt handler to receive serial port signals from other systems in interrupt or query mode.

[0019] Step 12: After all interrupts are completed, enter the next interrupt waiting state.

[0020] Compared with the prior art, the present invention has the following beneficial effects:

[0021] The present invention is based on embedded hardware implementation, with a data interaction core unit as the embedded hardware board on which the method of the present invention relies, which has high scalability and can meet the application requirements of optical measurement equipment for data collection and synchronization of multiple sensors. At the same time, due to the strong real-time performance of the embedded system, it can meet the requirements of packaging and storage of sensor information with an update frequency of 1000hz and above. In addition, through a good synchronization signal processing mechanism, it can be ensured that different sensor information is sent to the outside in the same timing and fixed format after processing, which can meet certain real-time processing requirements. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a time synchronization information flow diagram of each subsystem in the optical measurement equipment in the embodiment of the present invention;

[0023] Figure 2 The present invention is a flowchart of time synchronization and information fusion according to the method described in the embodiment of the present invention. DETAILED DESCRIPTION

[0024] The present invention provides a method for time synchronization and information fusion of optical measurement equipment. The method is used in the process of using the optical measurement equipment in the target field, and the information of each subsystem of the optical measurement equipment is integrated and time-aligned, so that the data distributed to each subsystem is consistent in time, ensuring the normal and precise operation of the optical measurement equipment, and can process the data exchanged between systems in real time, and realize the functions of gathering, aligning and transmitting various types of data on and off the equipment. The method of the present invention can be implemented by using ADS1.2 (ARMDeveloper Suite) software development, and mainly includes functions such as program initialization, serial port interrupt processing, network interrupt processing, etc., which can ensure the coordinated work of each subsystem.

[0025] First, the information flow between the various subsystems of the optical measurement equipment in the present invention is introduced. Figure 1 The figure shows the time synchronization information flow diagram, which describes in detail the data flow when the data interaction core unit performs time synchronization and information fusion. As the information interaction center of images and data, the data interaction core unit uses ARM9 as the processor chip to complete the functions of image packaging and forwarding, adding timestamps, etc., accurately fuses data according to the system time, and forwards the image data information of each sensor to each subsystem, thereby realizing data sharing. In addition to the data interaction core unit, the subsystems of the optical measurement equipment include the time synchronization terminal control system, the main control computer, the encoder system, the lens control system, the inclinometer, the laser rangefinder, the camera, the image storage computer, the image enhancement computer, the image processing computer, the fusion tracking computer and the servo system.

[0026] The time synchronization terminal control system is used to provide time information and external synchronization trigger signals to the data interaction core unit, and receive frequency selection parameters, exposure time, time correction time and other information sent by the data interaction core unit. The functions of the time synchronization terminal control system include receiving and decoding GPS data; receiving and decoding DC and AC signals; encoding and sending DC and AC signals, which is the benchmark for time unification. After receiving the selected external time source, the time synchronization terminal control system extracts the second synchronization signal and time information as the synchronization benchmark of the system, and transmits the second synchronization signal and time information to the data interaction core unit. On the one hand, the data interaction core unit distributes the time information to each subsystem, and on the other hand, it uses the second synchronization signal as the benchmark to generate the external synchronization trigger signal required by the camera and each subsystem.

[0027] The interaction between the main control computer and the data interaction core unit includes providing the data interaction core unit with camera parameter control information, site number, exposure time, focal length, repair time, T0 moment, distance information, etc. All this information will be displayed in the superimposed information after timing processing, wherein the camera parameter control information is forwarded to the timing terminal control system by the data interaction core unit, and the data interaction core unit then gives a timing-aligned external synchronization trigger signal to the camera according to the camera frame rate selected by the current operator, and the camera responds to the external synchronization trigger signal and outputs the image to the data interaction core unit.

[0028] The lens control system receives lens dimming commands, focus commands, zoom commands, filter commands, etc. These commands are sent by the main control system and forwarded to the lens control system in real time through the data interaction core unit. At the same time, the feedback information corresponding to these commands, such as the current focal length, is transmitted back to the data interaction core unit through the opposite path and added to the required superimposed information. Among them, the main control system refers to the system of the main control computer. This system is a software system that the optical measurement equipment directly connects to the user for operation. According to the user's operation, the system sends control commands to manage and control the relevant subsystems, and completes the equipment's data collection, processing and recording functions for each subsystem.

[0029] After the encoder system sends the encoder information to the data interaction core unit, the data interaction core unit synchronously sends the encoder information to the system that requires superimposed information according to the time frequency.

[0030] The inclinometer and laser rangefinder receive the inclination information and laser ranging information sent by the data exchange core unit on board respectively.

[0031] The image storage computer, image enhancement computer, and image processing computer are all industrial computers that need to receive high-speed images sent by the data interaction core unit and perform real-time processing. The image processing computer also needs to transmit the azimuth miss amount and pitch miss amount of the target in the image back to the data interaction core unit and display them in the superimposed information.

[0032] The data transmitted between the fusion tracking computer and the servo system through the data exchange core unit include guidance information, tracking commands, azimuth single-rod value, pitch single-rod value, azimuth tracking error, pitch tracking error, etc., so as to control the optical measurement equipment to track and stare at the target. The fusion tracking computer outputs single-rod value, tracking error and guidance information to the data exchange core unit, and the data exchange core unit forwards the guidance information to the servo system. The servo system controls the posture of the camera according to the guidance information and feeds back the tracking command, azimuth single-rod value, pitch single-rod value, and tracking error to the data exchange core unit.

[0033] Figure 2 The flowchart shown is a method for performing time synchronization and information fusion according to the present embodiment. The flowchart shows in detail the process of completing time synchronization and information fusion in the data interaction core unit, which specifically includes the following steps 1 to 12.

[0034] Step 1: First, when an external trigger interrupt enters, determine whether the external trigger interrupt is an interrupt to the serial port where the encoder is located or an interrupt to the network data distribution and receiving serial port. If the external trigger interrupt is an interrupt to the serial port where the encoder is located, execute step 2; if the external trigger interrupt is an interrupt to the network data distribution and receiving serial port, execute step 7.

[0035] Step 2: When the serial port where the receiving encoder is located is interrupted, the interface receives the encoder information according to the interrupt mode, and determines whether there is encoder data entering the interface. If there is no encoder data entering the interface, that is, no encoder data is received, the time terminal is used as an external trigger for time counting; if there is encoder data entering the interface, that is, the encoder data is received, then execute step 3.

[0036] Step 3: After receiving the encoder data, the received data packet is used as the minimum time unit for accumulating the counter, and the received encoder data is stored in the buffer for storing the superposition information.

[0037] Step 4: Determine whether the current main control system has sent an encoder setting instruction to the encoder system. If the encoder system is setting the number, jump back to step 2 and receive the encoder data again. Otherwise, execute step 5.

[0038] Step 5: Select the system that needs to superimpose information, and determine the current frame rate of the system that needs to superimpose information based on the main control information; the main control system of the main control computer sends control commands to manage and control the relevant subsystems according to user operations, and completes the equipment's data collection, processing and recording functions for each subsystem, that is, after the user operates on the visual interface, the main control software packs this information into data packets to form the main control information.

[0039] Step 6: Assign time information, encoder information, miss distance information and other data to the serial port of the selected overlay information system and send it, and then execute step 12.

[0040] Step 7: When entering network data distribution and receiving serial port interrupt, you need to read the interrupt status register again to enter the interrupt selection entry.

[0041] Step 8: Determine whether the external trigger interrupt is a network data distribution interrupt. If it is a network data distribution interrupt, execute step 9; if it is not a network data distribution interrupt, execute step 11.

[0042] Step 9: Clear the receiving encoder buffer and read the watchdog counter value, and accumulate the time information and the counter. For example, accumulate the time information by 5ms and the 200Hz counter by 1.

[0043] Step 10: Read the delay time calculated by the watchdog counter, and determine whether the delay time is greater than the delay time. If so, perform network data distribution and time information solution, and then execute step 12; otherwise, return to step 9.

[0044] Step 11: When the external trigger interrupt is not a network data distribution interrupt, determine whether the external trigger interrupt is an interrupt to enter and receive serial ports other than the encoder. If so, enter the serial port interrupt handler and start receiving serial port signals from other systems in interrupt or query mode; otherwise, return to step 1 and continue waiting for the external trigger interrupt.

[0045] Step 12: After all interrupts are completed, enter the next interrupt waiting state.

[0046] The present invention is based on embedded hardware implementation, with a data interaction core unit as the embedded hardware board on which the method of the present invention relies. It has high scalability and can meet the application requirements of optical measurement equipment for data collection and synchronization of multiple sensors. At the same time, due to the strong real-time performance of the embedded system, it can meet the requirements of packaging and storage of sensor information with an update frequency of 1000hz and above. In addition, through a good synchronization signal processing mechanism, it can be ensured that different sensor information is sent to the outside in the same timing and fixed format after processing, which can meet certain real-time processing requirements. And after simulating the present invention, the simulation results show that the optical measurement equipment time synchronization and information fusion method proposed in the present invention is practical and effective.

[0047] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0048] The above-mentioned embodiments only express several implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A method for time synchronization and information fusion of optical measurement equipment, characterized in that: The optical measurement device includes a data interaction core unit, and the data interaction core unit performs information synchronization and fusion between subsystems of the optical measurement device by executing the following steps: Step 1: When an external trigger interrupt enters, determine whether the external trigger interrupt is an interrupt of the serial port where the encoder is located or an interrupt of the network data distribution and receiving serial port. If the external trigger interrupt is an interrupt of the serial port where the encoder is located, execute step 2; if the external trigger interrupt is an interrupt of the network data distribution and receiving serial port, execute step 7; Step 2: The interface receives encoder information in interrupt mode and determines whether encoder data is currently entering the interface. If encoder data is received, step 3 is executed; if encoder data is not received, the time system terminal is used as an external trigger to count the time; Step 3: Use the received encoder data packet as the minimum time unit for the counter to accumulate, and store the received encoder data into the buffer for storing the superposition information; Step 4: Determine whether the current main control system has sent an encoder setting instruction to the encoder system. If so, jump back to step 2 and receive the encoder data again. Otherwise, execute step 5. Step 5: Select the system that needs to overlay information, and determine the current frame rate of the selected overlay information system according to the main control information; Step 6: assign a time information value to the serial port of the selected overlay information system and send it, and then execute step 12; Step 7: Read the interrupt status register again to enter the interrupt selection entry; Step 8: Determine whether the external trigger interrupt is a network data distribution interrupt, if so, execute step 9, otherwise execute step 11; Step 9: Clear the receiving encoder buffer and read the watchdog counter value, and accumulate the time information and the counter; Step 10: Read the delay time calculated by the watchdog counter to determine whether the delay time is greater than the delay time. If so, perform network data distribution and time information solution, and then execute step 12; otherwise, return to step 9; Step 11: Determine whether the external trigger interrupt is an interrupt for receiving serial ports other than the encoder. If so, enter the serial port interrupt handler to receive serial port signals from other systems in interrupt or query mode; otherwise, return to step 1 and wait for the external trigger interrupt; Step 12: After all interrupts are completed, enter the next interrupt waiting state.

2. A method for time synchronization and information fusion of optical measurement equipment according to claim 1, characterized in that: The subsystem of the optical measurement equipment includes a time-controlled terminal control system, a main control computer, an encoder system, a lens control system, an inclinometer, a laser rangefinder, a camera, an image storage computer, an image enhancement computer, an image processing computer, a fusion tracking computer and a servo system; The time system terminal control system provides time information and external synchronization trigger signals to the data interaction core unit, and receives frequency selection parameters, exposure time and time correction time sent by the data interaction core unit; The main control computer provides the data interaction core unit with camera parameter control information, site number, exposure time, focal length, time adjustment, T0 time and distance information. The information provided by the main control computer will be displayed in the superposition information after time sequence processing. The camera parameter control information is forwarded to the time system terminal control system by the data interaction core unit. The data interaction core unit then gives a time sequence aligned external synchronization trigger signal to the camera according to the currently selected camera frame rate. The camera responds to the external synchronization trigger signal and outputs the image to the data interaction core unit. The lens dimming command, focus command, zoom command, and filter command issued by the main control system are forwarded to the lens control system in real time through the data interaction core unit. The feedback information corresponding to the command forwarded by the data interaction core unit is transmitted back to the data interaction core unit through the opposite path, and the feedback information is also added to the required superposition information. After the encoder system sends the encoder information to the data interaction core unit, the data interaction core unit synchronously sends the encoder information to the system that needs to superimpose information according to the time frequency; The inclinometer and the laser rangefinder respectively receive the inclination information and the laser rangefinder information sent by the data exchange core unit; The image storage computer, the image enhancement computer, and the image processing computer respectively receive the images sent by the data interaction core unit and perform real-time processing, wherein the image processing computer also needs to transmit the azimuth miss amount and the pitch miss amount of the target in the image back to the data interaction core unit for display in the superimposed information; The data transmitted between the fusion tracking computer and the servo system through the data interaction core unit include guidance information, tracking commands, azimuth single-rod value, pitch single-rod value, azimuth tracking error, and pitch tracking error.

3. A method for time synchronization and information fusion of optical measurement equipment according to claim 1 or 2, characterized in that: In step 9, the time information is accumulated by 5 ms and the 200 Hz counter is accumulated by 1.

4. A method for time synchronization and information fusion of optical measurement equipment according to claim 1 or 2, characterized in that: The data interaction core unit adopts an ARM9 processor chip.