A multi-node data storage and interaction method
By employing a multi-node collaborative data acquisition and transmission method, signal-to-noise separation and signal classification are performed. Data flow is facilitated by utilizing the redundancy differences between nodes, thus solving the storage and transmission bottlenecks of monitoring data in remote areas. This enables the accurate acquisition and transmission of important signals, ensuring data integrity and efficient network operation.
Patent Information
- Application Number
- CN202210247097.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-06
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2041-12-06
AI Technical Summary
In remote areas with insufficient signal coverage, the collection and storage of monitoring data become bottlenecks. Insufficient satellite communication bandwidth prevents data transmission, and the limited storage capacity of mobile nodes affects the ability to perceive the electromagnetic environment.
By employing a multi-node collaborative data acquisition and transmission method, signal-to-noise separation and signal classification are performed. Data flow is facilitated by utilizing the redundancy differences between nodes, and a local signal database is established and updated to achieve accurate data acquisition and transmission.
It solves the problems of insufficient node storage capacity and data transmission blockage, and enables accurate acquisition and transmission of important signals, ensuring data integrity and efficient network operation.
Smart Images

Figure CN114513764B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of communication technology, and in particular to a multi-node data storage and interaction method. Background Art
[0002] In remote areas where mobile communication signal coverage is insufficient, a monitoring network consisting of fixed nodes and mobile nodes is used. Some monitoring data or environmental collection data needs to be transmitted back to the command center, such as Figure 1 As shown in the figure, the current method is to use satellite Internet and 4G network as backup for each other and transmit data back, but the radio monitoring data is collected in a wide frequency band and has a large amount of spectrum data. The satellite communication bandwidth is insufficient, and full-band real-time data transmission cannot be achieved. The mobile data collection nodes have limited storage capacity, making data collection and storage an important bottleneck, which seriously restricts my country's ability to grasp the situational awareness of the electromagnetic environment in remote areas.
[0003] Common methods to solve the above problems are: 1. While increasing the data storage capacity of the collection nodes, strengthen the processing capabilities of the edge nodes, store the results of signal processing at the monitoring site instead of storing the original data; 2. Introduce a data compression algorithm and use the data compression algorithm to compress the monitoring data. There are mainly two types, one is called lossless compression and the other is called lossy compression. Among them, the lossless compression algorithm data can be completely restored, but the compression rate is very limited. Lossy compression can compress the noise data while also causing distortion of sensitive signals. Summary of the invention
[0004] The purpose of the present invention is to overcome the problems of data collection and storage in remote signal blind areas in the prior art, and to provide a multi-node data storage and interaction method.
[0005] The objective of the present invention is achieved through the following technical solutions:
[0006] A data collection and transmission method based on multi-hop collaboration is provided, the method comprising:
[0007] Collecting spectrum data through different nodes, and performing signal-noise separation on the spectrum data to obtain a collection signal;
[0008] Establishing a set of local signal libraries in different nodes respectively, and classifying the collected signals;
[0009] Compare the signal libraries of different nodes respectively to obtain the data to be transmitted, and compare the redundancy of different nodes, so that the data to be transmitted is transmitted from the node with low redundancy level to the node with high redundancy level;
[0010] After the data transmission is successful, the signal libraries of different nodes are updated respectively.
[0011] As an option, the different nodes include a monitoring center node, a fixed anchor node, a dedicated mobile node and a general mobile node.
[0012] As an option, the redundancy is calculated as follows:
[0013] Fi=P is / P i +P j ,
[0014] Among them, P is represents the remaining space of node i, P i represents the total storage space of node i, P j Represents the total storage space of node j.
[0015] As an option, the classification of the collected signals includes:
[0016] The collected signal is compared with the local signal library. If there is no abnormality in the characteristics of the collected signal, it is classified as a whitelist signal. If the collected signal is an illegal sensitive signal, it is classified as a blacklist signal. If the collected signal is an unknown signal, it is classified as a graylist signal.
[0017] As an option, the step of comparing signal libraries of different nodes to obtain data to be transmitted includes:
[0018] For the two nodes participating in the exchange, the whitelist signals, blacklist signals and graylist signals of the two nodes are integrated, and the blacklist signals and graylist signals that need to be transmitted are extracted.
[0019] As an option, the respectively updating of signal libraries of different nodes includes:
[0020] The integrated whitelist signal, blacklist signal and greylist signal are added to the signal library of each node respectively.
[0021] As an option, the updating of the signal libraries of different nodes respectively further includes:
[0022] Gather data from fixed anchor nodes, dedicated mobile nodes and general mobile nodes to the monitoring center node;
[0023] If a blacklist signal or a greylist signal is verified or tracked over a long period of time and is proven to be a legitimate signal, it will be converted to a whitelist signal;
[0024] If the greylist signal contains signals with the same frequency characteristics in multiple nodes, it is converted to a blacklist signal.
[0025] The present invention also provides a multi-node data storage and interaction system, the system comprising:
[0026] Multiple nodes;
[0027] An acquisition module is used to acquire spectrum data at different nodes and perform signal-noise separation on the spectrum data to obtain acquisition signals;
[0028] Local signal libraries located in different nodes;
[0029] A comparison module is used to compare the signal libraries of different nodes, obtain the data to be transmitted, and compare the redundancy of different nodes;
[0030] A data transmission module, used for transmitting data to be transmitted from a node with a low redundancy level to a node with a high redundancy level;
[0031] The data update module is used to update the signal libraries of different nodes respectively after the data transmission is successful.
[0032] As an option, the data transmission module includes wireless sensors arranged between nodes.
[0033] As an option, the system further includes a broadcast module, configured to broadcast updated data to each node.
[0034] It should be further explained that the technical features corresponding to the above options can be combined or replaced with each other to form a new technical solution if there is no conflict.
[0035] Compared with the prior art, the present invention has the following beneficial effects:
[0036] (1) The present invention classifies and identifies the collected signals and compares the signal libraries of different nodes to reduce the amount of data collected. Through the collaboration between nodes, the collected signals automatically flow to nodes with large storage space and less storage pressure, thus solving the problems of insufficient storage capacity of nodes in communication blind spots and data transmission blockage, and collecting monitoring data of important signals to the maximum extent.
[0037] (2) For the two nodes involved in the exchange, the whitelist signals, blacklist signals, and graylist signals of the two nodes are integrated, and the blacklist signals and graylist signals that need to be transmitted are extracted, so that more sensitive and critical information can be collected accurately and the amount of collection can be reduced.
[0038] (3) By establishing and updating a local database, the original data of the signal can be recorded and updated in real time to ensure data integrity.
[0039] (4) Important signal characteristics are fed back to all nodes through broadcasting. Since the amount of signal characteristic information is extremely small, it will not cause network congestion. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] Figure 1 It is a schematic diagram of the prior art of the present invention;
[0041] Figure 2 A schematic diagram of a multi-node data storage and interaction method of the present invention;
[0042] Figure 3 A schematic diagram of data transmission between nodes of the present invention;
[0043] Figure 4 It is a schematic diagram of a specific implementation of the method of the present invention. DETAILED DESCRIPTION
[0044] The technical solution of the present invention is described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0045] In addition, the technical features involved in the different embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.
[0046] The present invention mainly reduces the amount of data collection by classifying and identifying the collected signals and comparing the signal libraries of different nodes. Through the collaboration between nodes, the collected signals automatically flow to the nodes with large storage space and smaller storage pressure, thus solving the problems of insufficient storage capacity of nodes in communication blind spots and data transmission blockage, and collecting the monitoring data of important signals to the maximum extent, achieving the purpose of convenient collection and transmission.
[0047] Example 1
[0048] In an exemplary embodiment, a multi-node data storage and interaction method is provided, such as Figure 2 As shown, the method includes:
[0049] Collecting spectrum data through different nodes, and performing signal-noise separation on the spectrum data to obtain a collection signal;
[0050] Establishing a set of local signal libraries in different nodes respectively, and classifying the collected signals;
[0051] Compare the signal libraries of different nodes respectively to obtain the data to be transmitted, and compare the redundancy of different nodes, so that the data to be transmitted is transmitted from the node with low redundancy level to the node with high redundancy level;
[0052] After the data transmission is successful, the signal libraries of different nodes are updated respectively.
[0053] Furthermore, the different nodes include a monitoring center node, a fixed anchor node, a dedicated mobile node and a general mobile node.
[0054] Specifically, the remote area signal blind spot monitoring network consists of four types of nodes: monitoring center nodes, fixed anchor nodes, dedicated mobile nodes and general mobile nodes. The storage capacity of the four types of nodes is different. Among them, the monitoring center node has strong data storage capacity and transmission bandwidth, which can realize the real-time transmission of a large amount of data and serve as the center of data fusion processing and transmission; the fixed anchor node has strong transmission capacity and certain data storage capacity; the dedicated mobile node has a large activity area, and has strong data storage capacity and transmission capacity; the general mobile node has the largest number, but its storage capacity and transmission capacity are very limited.
[0055] Furthermore, specifically, fixed nodes and mobile monitoring nodes start scanning spectrum data, and according to the background noise data, data that is 3dB higher than the background noise is recorded as the acquisition signal. Each node classifies and processes the globally sensitive acquisition signal based on the stored signal to achieve accurate acquisition, and then compares the redundancy of different nodes based on their data storage capacity and transmission capacity. Nodes with high redundancy have strong storage capacity, so that sensitive data to be transmitted is transmitted from nodes with low redundancy levels to nodes with high redundancy levels, so that data can flow to nodes with less storage pressure, achieve more accurate data acquisition, solve the problem of data transmission blockage, and maximize the acquisition of monitoring data of important signals.
[0056] Example 2
[0057] Based on Example 1, a specific implementation scheme is given, specifically, as follows: Figure 4 As shown, firstly, data collection is performed, and a signal library and data classification are constructed to classify the collected signals, including:
[0058] Compare the collected signal with the local signal library. If the collected signal features are normal, it is classified as a whitelist signal, that is, a legal signal. If the collected signal is an illegal sensitive signal, it is classified as a blacklist signal. If the collected signal is an unknown signal, it is classified as a graylist signal. Then maintain a local signal library at each node.
[0059] Furthermore, for each signal collected and discovered, it is compared with the local signal library. If it is a whitelist signal, it is ignored and not stored; if it is a blacklist signal, all the original signal data, including spectrum, audio and direction, are recorded and added to the blacklist signal in the local signal library; for newly discovered signals, they are added to the graylist signals (unknown signals that are not included in the whitelist and blacklist signals). If it is an instantaneous clutter, the signal characteristics are recorded; if it is a broadband radar signal or an unknown communication signal, the signal is recorded in the database, and the original data of the signal (spectrum, audio, IQ data) is fully recorded to ensure the integrity of the characteristics.
[0060] Furthermore, the node redundancy is determined, and the calculation formula of the redundancy is:
[0061] Fi=P is / P i +P j ,
[0062] Among them, P is represents the remaining space of node i, P i represents the total storage space of node i, P j Represents the total storage space of node j.
[0063] For two nodes, if the distance between them is within a certain area (about 10Kmm), wireless sensors can be used for data transmission, and the node with low redundancy will transmit cache data to the node with high redundancy. If node Fi>Fj, it means that the data is transmitted from node j to node i. Usually, the redundancy of the monitoring center node is the largest, and the redundancy of the mobile general node is the smallest. The redundancy between the general mobile node and the fixed anchor node should be compared according to the actual situation.
[0064] Comparing the signal libraries between nodes, wherein the signal libraries of different nodes are compared to obtain the data to be transmitted, includes:
[0065] For the two nodes participating in the exchange, the whitelist signals, blacklist signals and graylist signals of the two nodes are integrated, and the blacklist signals and graylist signals that need to be transmitted are extracted.
[0066] Specifically, first compare the signal S in the whitelist w =S wi ∪S wj , for the gray list signal S in node i and node j gi CS wj If the "grey list" of node i is in the white list of node j, delete the data. Determine the white list library.
[0067] Then compare the signals in the gray list of the two nodes, according to S g =S gi ∪S gj , determine the gray list signal library of the two nodes. Determine the original data transmission volume,
[0068] Finally, compare the signals in the blacklist of the two nodes, D tb =D bj . Determine the blacklist signal library S b =S bi ∪S bj .
[0069] According to the determined redundancy function, the node flow direction is determined. Taking the transmission of data from node j to node i as an example, the transmitted data is D tg and D tb .
[0070] Further, the respectively updating of the signal libraries of different nodes includes:
[0071] The integrated whitelist signal, blacklist signal and graylist signal are added to the signal library of each node respectively. Specifically, after the data transmission is successful, according to S w , S g , S b , respectively update the whitelist, graylist and blacklist of the two node signal libraries. By extracting the blacklist and graylist signals that need to be transmitted, more sensitive and critical information can be collected, accurate collection can be achieved, and the amount of collection can be reduced.
[0072] Furthermore, the updating of the signal libraries of different nodes respectively further includes:
[0073] like Figure 3 As shown, the data of fixed anchor nodes, dedicated mobile nodes and general mobile nodes are collected to the monitoring center node. The data collected by all nodes are finally collected to the monitoring center node, and the monitoring center node performs unified fusion processing. The fused data includes a white list, a black list and a gray list based on the signal database.
[0074] If a blacklist signal or a greylist signal is verified or tracked over a long period of time and is proven to be a legitimate signal, it will be converted to a whitelist signal;
[0075] If the greylist signal contains signals with the same frequency characteristics in multiple nodes, such as continuous radar signals, demodulated communication signals, etc., it will be converted into a blacklist signal.
[0076] The blacklist and whitelist signals of the monitoring center nodes are continuously updated based on the node summary data. Finally, the updated signal library is broadcast to all nodes. The above whitelist signal library is updated once an hour, and the blacklist signal library is updated in real time after the change. The update method is to use the monitoring center broadcast.
[0077] The monitoring center node broadcasts the signal characteristics (including frequency, bandwidth, field strength, and modulation method) to all nodes. Since the amount of signal characteristic information data is extremely small, it will not cause network congestion.
[0078] Furthermore, if Figure 4 As shown, when the next node transmitted by a node is not the monitoring center node, the database continues to be updated and the data transmission continues.
[0079] Example 3
[0080] In an exemplary embodiment, the present invention further provides a multi-node data storage and interaction system, the system comprising:
[0081] Multiple nodes;
[0082] An acquisition module is used to acquire spectrum data at different nodes and perform signal-noise separation on the spectrum data to obtain acquisition signals;
[0083] Local signal libraries located in different nodes;
[0084] A comparison module is used to compare the signal libraries of different nodes, obtain the data to be transmitted, and compare the redundancy of different nodes;
[0085] A data transmission module, used for transmitting data to be transmitted from a node with a low redundancy level to a node with a high redundancy level;
[0086] The data update module is used to update the signal libraries of different nodes respectively after the data transmission is successful.
[0087] Furthermore, the data transmission module includes wireless sensors arranged between nodes.
[0088] Furthermore, the system also includes a broadcast module, and the broadcast module is used to broadcast the updated data to each node.
[0089] The above specific implementation methods are detailed descriptions of the present invention. It cannot be determined that the specific implementation methods of the present invention are limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions and substitutions can be made without departing from the concept of the present invention, which should be regarded as belonging to the protection scope of the present invention.
Claims
1. A multi-node data storage and interaction method, characterized in that: The method comprises: Collecting spectrum data through different nodes, and performing signal-noise separation on the spectrum data to obtain a collection signal; A set of local signal libraries are established in different nodes respectively, and the collected signals are classified; the classification of the collected signals includes: Compare the collected signal with the local signal library. If the collected signal features are normal, it is classified as a whitelist signal. If it is a whitelist signal, it is ignored and not stored. If the collected signal is an illegal sensitive signal, it is classified as a blacklist signal. If the collected signal is an unknown signal, it is classified as a graylist signal. Compare the signal libraries of different nodes respectively to obtain the data to be transmitted, and compare the redundancy of different nodes, so that the data to be transmitted is transmitted from the node with low redundancy level to the node with high redundancy level; The calculation formula of the redundancy is: Fi=P is / P i +P j , Among them, P is represents the remaining space of node i, P i represents the total storage space of node i, P j Represents the total storage space of node j; The comparing the signal libraries of different nodes to obtain the data to be transmitted includes: For the two nodes participating in the exchange, the whitelist signals, blacklist signals and graylist signals of the two nodes are integrated, and the blacklist signals and graylist signals to be transmitted are extracted; if the graylist signal in the node with a low redundancy level is in the whitelist of the node with a high redundancy level, the graylist signal in the node with a low redundancy level is deleted, and the remaining graylist signals and blacklist signals in the node with a low redundancy level are transmitted to the node with a high redundancy level; After the data transmission is successful, the signal libraries of different nodes are updated respectively; the different nodes include the monitoring center node, the fixed anchor node, the dedicated mobile node and the general mobile node, wherein the monitoring center node broadcasts the blacklist signal characteristics to all nodes, and the signal characteristics include frequency, bandwidth, field strength and modulation mode; The respectively updating of the signal libraries of different nodes comprises: When the next node transmitted by a node is not the monitoring center node, the database continues to be updated and data transmission continues; The monitoring center node performs unified fusion processing on the data collected by all nodes to obtain fused data, which includes a white list, a black list and a gray list based on the signal database.
2. A multi-node data storage and interaction method according to claim 1, characterized in that: The updating of the signal libraries of different nodes respectively also includes: The blacklist signals and whitelist signals of the monitoring center node are continuously updated according to the node summary data. Among them, the whitelist signal library is updated once an hour, and the blacklist signal library is updated in real time after changes.
3. A multi-node data storage and interaction method according to claim 1, characterized in that: The classification of the collected signals further includes: If it is a blacklist signal, all the original data of the signal are recorded; if it is an instantaneous clutter, the signal characteristics are recorded; if it is a broadband radar signal or an unknown communication signal, the signal is recorded in the database and the original data of the signal is fully recorded.
