Communication protocol signal acceleration processing method based on general-purpose computer
By designing the communication protocol signal processing module and using distributed computing technology to split and parallelize IQ intermediate frequency data of communication protocol signals, the problem that traditional single-node processing methods are difficult to meet the needs of high performance and high real-time is solved, and rapid detection, processing, identification and positioning of communication protocol signals is achieved.
Patent Information
- Application Number
- CN202411840312.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-13
- Publication Date
- 2025-03-28
- Estimated Expiration
- 2044-12-13
AI Technical Summary
In a centralized convergence architecture, traditional single-node processing methods are difficult to meet the needs of high performance and high real-time, especially when processing IQ mid-frequency data of large amounts of communication protocol signals.
By designing the communication protocol signal processing module, splitting the processing links, and using distributed computing technology and efficient communication protocol processing algorithms, fast signal detection, signal processing, identification and positioning of IQ intermediate frequency data of communication protocol signals is realized. Specific steps include timing matching, detection, processing and batch combination, using multi-threading technology and parallel computing of multiple computers.
It significantly improves the timeliness of communication protocol signal processing, and can process the data of the previous beat before the next beat, meeting the needs of high performance and high real-time.
Smart Images

Figure CN119728503A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the fields of computer technology, communication technology and distributed system processing technology, and is particularly suitable for use in scenarios where a large number of communication protocol signals need to be quickly detected, parsed and processed in general-purpose computers. The present invention specifically relates to a communication protocol signal acceleration processing method based on a general-purpose computer. Background Art
[0002] In a centralized fusion architecture, each sensor transmits raw data to a computing center for centralized processing. As the electromagnetic environment becomes increasingly complex, the electromagnetic signal data generated every second is becoming increasingly complex and large in scale. In particular, for the communication protocol signal acquisition sensors on the end side, a large amount of background spectrum data and IQ intermediate frequency data need to be quickly processed in the center, including signal detection, signal processing, signal positioning, etc.; some of these links are time-consuming, and without the support of dedicated high-speed processing chips such as FPGA, they need to be quickly processed on a general-purpose computer to obtain analysis results. The traditional single-node processing method has been unable to meet the requirements of high performance and high real-time performance. Therefore, a method is needed that can make full use of distributed computing resources to realize fast signal detection, signal processing, and identification and positioning of IQ intermediate frequency data of communication protocol signals. Summary of the invention
[0003] The present invention proposes a communication protocol signal acceleration processing method based on a general-purpose computer. By splitting the processing links of the communication protocol signal and based on distributed computing technology and an efficient communication protocol processing algorithm, rapid signal detection, signal processing and identification and positioning of the IQ intermediate frequency data of the communication protocol signal are realized, thereby significantly improving the timeliness of the communication protocol signal processing.
[0004] The technical solution to realize the present invention is: a communication protocol signal acceleration processing method based on a general-purpose computer, the steps are as follows:
[0005] Step 1: Design the communication protocol signal processing module:
[0006] The communication protocol signal processing module includes a communication signal timing matching plug-in, a communication signal detection plug-in, a communication signal processing plug-in, and a communication signal batching plug-in.
[0007] Step 2: Collect background spectrum data, IQ intermediate frequency data, and attitude and trajectory data of multiple sensors, and obtain the classification data of the same beat with time and space registration through the communication signal timing matching plug-in, and publish the data of the same beat.
[0008] Step 3: The communication signal detection plug-in adopts multi-threading technology to monopolize the resources of each computer. At the same time, through resource scheduling, multiple computers are used to realize the distributed parallel computing processing of multiple processes of the communication signal detection plug-in.
[0009] Step 4: The communication signal processing plug-in breaks down the processing steps into smaller parts, and each sub-plug-in runs on multiple computers for parallel processing according to the classification of known communication protocol signals and unknown communication protocol signals.
[0010] Step 5: The communication signal batching plug-in batches the processing results of the communication signal processing plug-in.
[0011] Step 6: Under the resource coordination and scheduling of external scheduling, the processing task is completed.
[0012] Compared with the prior art, the present invention has the following significant advantages:
[0013] (1) Based on general-purpose computers, it can be divided into exclusive use of multiple computer resources and distributed shared use of multiple computer resources;
[0014] (2) Each plug-in template is a fixed hierarchical structure, including data subscription layer, data processing logic layer, and result publishing layer. The data subscription layer and result publishing layer use external message middleware to implement message subscription and publishing functions. The data processing logic layer mainly involves the data processing logic of each plug-in. When developing a plug-in, you can only focus on the design of the data processing logic layer.
[0015] (3) It has the ability to quickly identify new protocol signals through configuration. Specifically, the conventional parameters (frequency, bandwidth, baud rate, modulation style, etc.) analyzed by the parameter measurement sub-plug-in and the identification sub-plug-in will be compared with all the records in the signal specification table. Once a match is made, the new protocol signal can be identified. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 This is a timing diagram of the overall processing flow.
[0017] Figure 2 This is a schematic diagram of the plug-in structure.
[0018] Figure 3 Processing flow chart for communication signal processing plug-in. DETAILED DESCRIPTION
[0019] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0020] It should be noted that all directional indications in the embodiments of the present invention (such as up, down, left, right, front, back, etc.) are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.
[0021] The technical solutions between the various embodiments of the present invention can be combined with each other, but it must be based on the fact that ordinary technicians in the field can implement it. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by the present invention.
[0022] The following will further introduce the specific implementation method, as well as the technical difficulties and inventive points of this invention in combination with this design example.
[0023] In the centralized fusion architecture, the end side has a large number of communication protocol signal acquisition sensors, which do not have signal processing capabilities. A large amount of background spectrum data and IQ intermediate frequency data generated every second are transmitted back to the computing center via the network. When the computing center only has a general-purpose computer, the communication protocol signal acceleration processing method based on a general-purpose computer described in the present invention is proposed, which can quickly and efficiently process the data of the previous beat before the next beat, so as to realize efficient processing of communication protocol signals.
[0024] Combination Figure 1 to Figure 3 The communication protocol signal acceleration processing method based on a general-purpose computer of the present invention comprises the following steps:
[0025] Step 1: Design the communication protocol signal processing module:
[0026] The communication protocol signal processing module includes a communication signal timing matching plug-in, a communication signal detection plug-in, a communication signal processing plug-in, and a communication signal batching plug-in. The communication signal processing plug-in is divided into a digital down-conversion sub-plug-in, a communication signal identification sub-plug-in, a communication signal parameter measurement sub-plug-in, a communication signal demodulation sub-plug-in, a communication signal interpretation sub-plug-in, and a communication signal positioning sub-plug-in.
[0027] The template of each plug-in and sub-plug-in is a fixed hierarchical structure, including data subscription layer, data processing logic layer, and result publishing layer. The data subscription layer and result publishing layer use external message middleware to implement message subscription and publishing functions. The data processing logic layer mainly involves the data processing logic of each plug-in. When developing a plug-in, you can only focus on the design of the data processing logic layer.
[0028] External scheduling starts the timing matching plug-in, signal detection plug-in, signal processing plug-in, and signal batching plug-in through resource coordination and scheduling.
[0029] Step 2: Collect background spectrum data, IQ intermediate frequency data, and attitude and trajectory data of multiple sensors, and obtain the classification data of the same beat with time and space registration through the communication signal timing matching plug-in, and publish the data of the same beat.
[0030] Step 3: The communication signal detection plug-in adopts multi-threading technology to monopolize resources for each computer. At the same time, through resource scheduling, multiple computers are used to realize distributed parallel computing and processing of multiple processes of the communication signal detection plug-in; specifically, the plug-in is externally scheduled, subscribes to the same beat data through the message queue, and caches it; parses it into IQ intermediate frequency data, receiving frequency (calculated according to the receiver frequency and the frequency detected by the digital signal processing module), acquisition frequency, acquisition bandwidth start time and other parameters, provides conventional detection, cross-correlation detection and other functions, and publishes the detection results through the message queue.
[0031] The communication signal detection plug-in uses the background spectrum data and waveform signal data collected by the sensor to quickly estimate the approximate number of communication protocol signals, request external scheduling, start the corresponding number of communication signal processing plug-ins, and adapt to the number of adaptive signals, which not only improves the computing processing speed, but also tries to avoid the waste of computing resources; specifically:
[0032] Peak detection is performed on the waveform signal data, and the number of peaks detected is m. Peak detection is performed on the background spectrum data, and the number of peaks detected is n. The number of communication signal processing plug-ins to be started for this processing task is w, w = k*(am+bn)+1, where a is the coefficient of m, b is the coefficient of n, and according to experience, the value of b is greater than a. k is set according to the computing resources of the system. Parallel computing of k communication signal processing plug-ins is one way to achieve accelerated processing.
[0033] Step 4: The communication signal processing plug-in breaks down the processing steps into smaller parts, and each sub-plug-in runs on multiple computers for parallel processing according to the classification of known communication protocol signals and unknown communication protocol signals. Specifically, the plug-in is externally scheduled, subscribes to the same-beat data through the message queue, and caches it. It parses the IQ intermediate frequency data, sampling rate, acquisition frequency, sampling bandwidth, sensor posture and other parameters, provides digital down-conversion, signal recognition, signal demodulation and decompression, parameter measurement, signal interpretation and positioning functions, and publishes the processing results.
[0034] The communication signal recognition sub-plug-in uses communication signal frequency, bandwidth, modulation method, communication standard and other parameters to build a feature space, and trains a classifier based on known classification data in the signal specification table for the classification of known categories. The classifier trained with known classification data can identify the specifications of known classification signals, that is, the communication protocol; the classifier is trained based on unknown classification data in the signal specification table for the classification of unknown categories. According to the newly collected data and feedback, the algorithm is continuously iterated and optimized to improve the accuracy and efficiency of unknown category recognition.
[0035] Step 5: The communication signal batching plug-in batches the processing results of the communication signal processing plug-in. Specifically, the plug-in is externally scheduled and subscribes to the processing results of the communication signal processing plug-in through the message queue. It batches the results according to multiple dimensions such as attributes and targets to form a communication protocol signal processing data product, and then publishes the data product.
[0036] Step 6: Under the resource coordination and scheduling of external scheduling, the processing task is ended, specifically, the external scheduling remotely closes the timing matching plug-in, signal detection plug-in, signal processing plug-in and signal batching plug-in.
Claims
1. A communication protocol signal acceleration processing method based on a general-purpose computer, characterized in that: Here are the steps: Step 1: Design the communication protocol signal processing module: The communication protocol signal processing module includes a communication signal timing matching plug-in, a communication signal detection plug-in, a communication signal processing plug-in, and a communication signal batching plug-in; Step 2: Collect background spectrum data, IQ intermediate frequency data and attitude and trajectory data of multiple sensors, and obtain the classification data of the same beat with time and space registration through the communication signal timing matching plug-in, and publish the data of the same beat; Step 3: The communication signal detection plug-in adopts multi-threading technology to monopolize the resources of each computer. At the same time, through resource scheduling, multiple computers are used to realize the distributed parallel computing processing of multiple processes of the communication signal detection plug-in; Step 4: The communication signal processing plug-in breaks down the processing steps into smaller parts, and each sub-plug-in runs on multiple computers for parallel processing according to the classification of known communication protocol signals and unknown communication protocol signals; Step 5: The communication signal batching plug-in batches the processing results of the communication signal processing plug-in; Step 6: Under the resource coordination and scheduling of external scheduling, the processing task is completed.
2. The method for accelerating the processing of communication protocol signals based on a general-purpose computer according to claim 1, characterized in that: In step 1, the communication protocol signal processing module includes a communication signal timing matching plug-in, a communication signal detection plug-in, a communication signal processing plug-in, and a communication signal batching plug-in, as follows: The communication signal processing plug-in is divided into a digital down-conversion sub-plug-in, a communication signal identification sub-plug-in, a communication signal parameter measurement sub-plug-in, a communication signal demodulation sub-plug-in, a communication signal interpretation sub-plug-in, and a communication signal positioning sub-plug-in; The template of each plug-in and sub-plug-in is a fixed hierarchical structure, including data subscription layer, data processing logic layer, and result publishing layer. The data subscription layer and result publishing layer use external message middleware to implement message subscription and publishing functions. The data processing logic layer mainly involves the data processing logic of each plug-in. When developing a plug-in, you can only focus on the design of the data processing logic layer. External scheduling starts the timing matching plug-in, signal detection plug-in, signal processing plug-in, and signal batching plug-in through resource coordination and scheduling.
3. The method for accelerating the processing of communication protocol signals based on a general-purpose computer according to claim 2, characterized in that: In step 3, the communication signal detection plug-in adopts multi-threading technology to monopolize resources of each computer. At the same time, through resource scheduling, multiple computers are used to realize distributed parallel computing processing of multiple processes of the communication signal detection plug-in, as follows: The communication signal detection plug-in is scheduled externally, subscribes to the same-beat data through the message queue, and caches it; it parses the IQ intermediate frequency data, receiving frequency, acquisition frequency, acquisition bandwidth start time, provides conventional detection and cross-correlation detection, and publishes the detection results through the message queue; The communication signal detection plug-in estimates the number of communication protocol signals by utilizing the background spectrum data and waveform signal data collected by the sensor, requests external scheduling, and starts the corresponding number of communication signal processing plug-ins to adapt to the number of signals.
4. The method for accelerating the processing of communication protocol signals based on a general-purpose computer according to claim 3, characterized in that: The communication signal detection plug-in estimates the number of communication protocol signals by using the background spectrum data and waveform signal data collected by the sensor, requests external scheduling, and starts the corresponding number of communication signal processing plug-ins to adapt to the number of signals, as follows: Perform peak detection on the waveform signal data and detect m peaks. Perform peak detection on the background spectrum data and detect n peaks. The number of communication signal processing plug-ins to be started for this processing task is w, w=k*(am+bn)+1, where a is the coefficient of m and b is the coefficient of n. According to experience, the value of b is greater than a, and k is set according to the computing resources of the system. Parallel computing of k communication signal processing plug-ins is one of the ways to achieve accelerated processing.
5. The method for accelerating the processing of communication protocol signals based on a general-purpose computer according to claim 4, characterized in that: In step 4, the communication signal processing plug-in breaks down the processing steps into smaller parts, and each sub-plug-in runs on multiple computers for parallel processing according to the classification of known communication protocol signals and unknown communication protocol signals.
6. The method for accelerating the processing of communication protocol signals based on a general-purpose computer according to claim 5, characterized in that: The communication signal processing plug-in is scheduled externally, subscribes to the same-beat data through the message queue, and caches it; it parses the IQ intermediate frequency data, sampling rate, acquisition frequency, sampling bandwidth, sensor posture and other parameters, provides digital down-conversion, signal recognition, signal demodulation and translation, parameter measurement, signal interpretation and positioning functions, and publishes the processing results; The communication signal identification sub-plug-in uses the communication signal frequency, bandwidth, modulation mode, and communication standard to build a feature space, and trains a classifier based on the known classification data in the signal specification table to classify known categories. The classifier trained with the known classification data can identify the specifications of the known classification signal, that is, the communication protocol; The classifier is trained based on the unknown classification data in the signal specification table to classify the unknown categories. According to the newly collected data and feedback, the algorithm is continuously iterated and optimized to improve the accuracy and efficiency of unknown category recognition.
7. The method for accelerating the processing of communication protocol signals based on a general-purpose computer according to claim 6, characterized in that: In step 5, the communication signal batching plug-in batches the processing results of the communication signal processing plug-in, as follows: The communication signal batching plug-in is scheduled externally and subscribes to the processing results of the communication signal processing plug-in through the message queue. It performs batch processing according to multiple dimensions such as attributes and targets to form communication protocol signal processing data products and publish the data products.
8. The method for accelerating the processing of communication protocol signals based on a general-purpose computer according to claim 7, characterized in that: In step 6, under the resource coordination and scheduling of external scheduling, the processing task is ended, as follows: the external scheduling remotely closes the timing matching plug-in, signal detection plug-in, signal processing plug-in and signal batching plug-in.
Citation Information
Patent Citations
ARM and FPGA based distributed vibration signal processing acceleration method
CN109708746A
Method for parallel acceleration of electroencephalogram signal processing process based on GPU
CN113420672A
Packet processing method, programmable network card device, physical server, and storage medium
WO2024067336A1