Wireless transmission system and method for data integrity protection in unstable signal environment

Abstract

The invention discloses a wireless transmission system and method for data integrity protection in an unstable signal environment, and aims to solve the problem that the real-time performance and integrity of data are difficult to consider in the prior art. The system comprises a sending end and a receiving end, the sending end comprises a data acquisition module, a double-copy generation module, a high-capacity nonvolatile storage module, a signal detection module and a wireless transmission module, and the receiving end comprises a wireless transmission module, a data processing module and a storage module. The core of the method is that when data are collected, a low-guarantee-rate real-time copy (instant transmission for checking) and a high-guarantee-rate cache copy (large-capacity storage) are generated through a DMA synchronous replication algorithm; and after acquisition is finished, the cache copy is sent again when the signal is stable, and the receiving end integrates data based on the timestamp and the serial number. The data integrity is realized, the real-time viewing requirement is considered, the power consumption and the cost of equipment are reduced, and the method is suitable for scenes such as field measurement, hydrological monitoring and emergency communication.

Description

A wireless transmission system and method for protecting data integrity under unstable signal environments Technical Field

[0001] This invention belongs to the field of wireless communication technology, specifically relating to a wireless transmission system and method for protecting data integrity under unstable signal environments. Background Technology

[0002] With the large-scale application of technologies such as unmanned remote measurement and emergency communication, the requirements for the accuracy and integrity of real-time data transmission are increasing. However, wireless signal transmission is susceptible to various factors that can lead to data packet loss, such as terrain obstruction, electromagnetic interference, and physical phenomena like frequency-selective fading, multipath effects, and time delay spread. These problems are particularly prominent in unstable signal scenarios such as field measurement and hydrological monitoring.

[0003] To address the aforementioned issues, existing technologies have proposed various data transmission integrity assurance schemes, but they still suffer from the following drawbacks: 1) Cache-delayed transmission scheme: When the network is unstable, the acquisition device caches the data in the local storage module and transmits it after the network stabilizes. However, this scheme is limited by the device's storage capacity. When the signal is continuously interrupted, the storage module may overwrite earlier data due to insufficient memory, resulting in unrecoverable data; at the same time, it cannot meet the user's need for real-time data viewing.

[0004] 2) Real-time transmission + data interpolation solution: The device transmits the collected data in real time, and uses a high-performance microprocessor and algorithm to filter out lost data or interpolate missing data. However, data interpolation is essentially based on mathematical model predictions and cannot completely restore the original data, posing an accuracy risk. Furthermore, the application of high-performance processors increases the cost and power consumption of the device, making it unsuitable for portable measurement devices.

[0005] 3) Multi-channel redundant transmission scheme: Data is transmitted simultaneously through multiple channels, and the system switches to a backup channel when the main channel fails. However, there is a brief connection interruption during the channel switching process, which can still lead to data packet loss; moreover, multi-channel deployment increases hardware complexity and communication costs, making it difficult to apply on a large scale in complex environments such as the field.

[0006] Therefore, there is an urgent need for a wireless transmission technology that can ensure both real-time data transmission and data integrity in environments with unstable signals. Summary of the Invention

[0007] The purpose of this invention is to overcome the shortcomings of the prior art and provide a wireless transmission system and method for protecting data integrity in unstable signal environments. This invention solves the technical problems of easy data loss, insufficient interpolation accuracy, and difficulty in balancing real-time performance and integrity in the prior art, and achieves the dual goals of real-time viewing and complete transmission of data in unstable signal scenarios.

[0008] To solve the above-mentioned technical problems, the present invention adopts the following technical solution: a wireless transmission system for data integrity protection under unstable signal environment, comprising a transmitting end and a receiving end; the transmitting end includes a data acquisition module, a dual-copy generation module, a large-capacity storage module, a signal detection module, and a first wireless transmission module; the receiving end includes a second wireless transmission module, a data processing module, and a data storage module.

[0009] The data acquisition module is used to collect raw data in the target scenario, which is a field measurement, emergency communication, or hydrological monitoring scenario with unstable signals; the data acquisition module is an acoustic Doppler current profiler (ADCP), a field environment sensor, or an emergency communication data acquisition terminal.

[0010] The dual-copy generation module is communicatively connected to the data acquisition module and is used to synchronously generate a first data copy and a second data copy from the original data. The first data copy is low-reliability data that meets the requirements for real-time viewing and allows for loss due to signal interference, while the second data copy is high-reliability data that ensures integrity and has no loss.

[0011] The high-capacity storage module is communicatively connected to the dual-copy generation module, uses non-volatile storage media, and supports persistent storage of data when power is off. The storage capacity is no less than 1TB, and it integrates LZ4 data compression algorithm and SSD wear leveling mechanism to extend the service life of storage media.

[0012] The signal detection module is used to detect the signal quality parameters of the current wireless communication environment in real time. The signal quality parameters include signal strength, bit error rate, and transmission rate, and to determine whether the signal quality parameters meet a preset stability threshold. The first wireless transmission module is communicatively connected to the dual-copy generation module, the large-capacity storage module, and the signal detection module. It is used to send a first data copy to the receiving end in real time during the data acquisition phase, and also to send a second data copy stored in the large-capacity storage module to the receiving end when the data acquisition ends and the signal quality parameters meet the preset stability threshold.

[0013] The second wireless transmission module is matched with the first wireless transmission module and is used to receive the first data copy and the second data copy and transmit them to the data processing module.

[0014] The data processing module is used to present the first data copy in real time, calculate the loss rate of the first data copy in real time, and when the loss rate is greater than 30%, a pop-up window prompts the user that "the current real-time data reliability is low, and it is recommended to wait for the complete data to be resent." It is also used to integrate the first and second data copies based on preset unique identifier information, remove duplicate data and supplement missing data to obtain complete target data. The data storage module is used to store the complete target data for subsequent user analysis.

[0015] Further optimization is achieved by setting the preset stability thresholds as follows: signal strength ≥ -70dBm, bit error rate ≤ 10. -5 And the transmission rate is ≥1Mbps.

[0016] Further optimization involves the dual-replica generation module employing a synchronous replication algorithm based on direct memory access (DMA). The generation time delay between the first and second data replicas is ≤10ms, ensuring data consistency between the two replicas.

[0017] Further optimization involves adding a unique identifier, which includes a data collection timestamp and a data sequence number. The data sequence number is a continuously increasing integer used to uniquely identify each piece of original data.

[0018] Further optimization involves using a solid-state drive (SSD) or an embedded multimedia card (eMMC) as the non-volatile storage medium, which supports persistent data storage even when power is off.

[0019] Further optimizations include the fact that both the first and second wireless transmission modules support 4G, 5G, or LoRa communication protocols, with the communication mode switching priority being: 5G > 4G > LoRa; the switching trigger condition is: switch to 4G when the 5G signal strength is < -85dBm, switch to LoRa when the 4G signal strength is < -90dBm, and automatically switch back to the higher priority protocol after the signal is restored.

[0020] Further optimization includes a power management module for providing stable power to the data acquisition module, dual-copy generation module, large-capacity storage module, signal detection module, and first wireless transmission module, supporting a battery life of ≥24 hours.

[0021] A wireless transmission method based on the above system includes the following steps: Step S1: The data acquisition module of the transmitting end starts to acquire raw data, wherein the target data is field measurement data, emergency communication data, or hydrological monitoring data under unstable signal conditions; Step S2: The dual-copy generation module of the transmitting end synchronously generates a first data copy and a second data copy from the acquired raw data, wherein the first data copy is low-guarantee-rate real-time transmission data, and the second data copy is high-guarantee-rate complete cached data; Step S3: During the data acquisition phase, the first wireless transmission module of the transmitting end transmits the first data copy to the receiving end in real time, and at the same time, the large-capacity storage module of the transmitting end stores the second data copy, wherein the large-capacity storage module adopts a non-volatile storage medium with a storage capacity of ≥1TB; Step S4: The second wireless transmission module of the receiving end receives the first data copy and processes it through the data processing module. Step S5: The signal detection module of the transmitting end detects the current wireless signal quality parameters in real time. The signal quality parameters include signal strength, bit error rate, and transmission rate. After data acquisition is completed, it is determined whether the signal quality parameters meet the preset stability threshold. If the signal quality parameters meet the preset stability threshold, the first wireless transmission module sends the second data copy stored in the large-capacity storage module to the receiving end. If not, the transmitting end continues to detect the signal quality parameters until the preset stability threshold is met, and then executes the transmission of the second data copy. Step S6: The second wireless transmission module of the receiving end receives the second data copy. The data processing module integrates the first data copy and the second data copy based on the preset unique identifier information, removes duplicate data, and supplements missing data to obtain complete target data. The data storage module stores the complete target data.

[0022] In a further optimization, during step S5, the transmitting end continuously detects signal quality parameters and performs signal quality detection every 30 seconds. If no signal environment meeting the preset stability threshold is detected for 24 hours, an alarm message is sent to the receiving end through the first wireless transmission module.

[0023] Further optimization is achieved by the integration process in step S6 as follows: the data processing module identifies missing data segments in the first data copy by comparing data sequence numbers, and supplements them with corresponding data segments in the second data copy, while removing duplicate data segments in the first and second data copies.

[0024] Compared with the prior art, the beneficial effects of the present invention are as follows: 1. Significantly improved data integrity: Through a large-capacity non-volatile storage module and a dual-copy mechanism, the complete storage of the second data copy is achieved, avoiding the problem of data overwriting and loss in existing caching schemes; without relying on data interpolation algorithms, it ensures that the data is completely consistent with the original collected data, and the accuracy is not affected.

[0025] 2. Balancing real-time performance and data integrity: The real-time transmission of the first data copy meets the user's need for immediate data viewing, facilitating real-time monitoring of measurement progress and data trends; the delayed retransmission of the second data copy ensures the integrity of the final data, resolving the contradiction that existing technologies struggle to balance these two aspects.

[0026] 3. Wide range of applicable scenarios and controllable cost: Supports multiple communication protocols such as 4G, 5G, and LoRa, and is suitable for various signal unstable scenarios such as field measurement, emergency communication, and hydrological monitoring; No need to deploy multi-channel hardware or high-performance processors, reducing equipment cost and power consumption, and facilitating integration into portable devices.

[0027] 4. Improved work efficiency and reduced risks: Taking hydrological monitoring as an example, this invention avoids retesting due to data loss, reduces field operation time and costs, reduces safety hazards in water-related measurement scenarios, and promotes the modernization of related fields. Attached Figure Description

[0028] Figure 1 is a block diagram of the wireless transmission system for data integrity protection under unstable signal conditions according to the present invention; Figure 2 is a schematic diagram of low-guarantee-rate real-time data; Figure 3 is a schematic diagram of high-guarantee-rate buffered data; Explanation of the markings in the figures: 1-transmitter; 11-data acquisition module; 12-dual-copy generation module; 13-large-capacity storage module; 14-signal detection module; 15-first wireless transmission module (including compression and wear leveling unit); 16-power management module (including low-power and solar energy adaptation unit); 2-receiver; 21-second wireless transmission module; 22-data processing module; 23-data storage module. Detailed Implementation

[0029] The present invention will be further described below with reference to the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present invention, and should not be used to limit the scope of protection of the present invention.

[0030] This embodiment takes a hydrological monitoring scenario as an example and uses an acoustic Doppler current profiler (ADCP) as a data acquisition module to explain the specific implementation of the present invention in detail.

[0031] The hardware configuration of the wireless transmission system for data integrity protection under unstable signal environments is shown in Figure 1. Specifically, the transmitter 1 integrates an ADCP (model: RDIWorkHorse) as the data acquisition module 11, used to collect river flow velocity and flow data. The dual-copy generation module 12 uses an ARM Cortex-A9 processor and implements dual-copy generation of data based on the DMA synchronous replication algorithm; the large-capacity storage module 13 uses a 2TB SSD (model: Samsung 870EVO) to support data persistence after power failure; the signal detection module 14 uses a Huawei ME909S-8214G module to read signal strength, bit error rate, and transmission rate in real time; the first wireless transmission module 15 shares a 4G module with the signal detection module and supports TD-LTE / FDD-LTE communication protocols.

[0032] Receiver 2: The second wireless transmission module 21 is a Huawei ME909S-8214G module, which is matched with the transmitter; the data processing module 22 uses an Intel Core i7 processor and runs a custom integration algorithm; the data storage module 23 uses a 4TB mechanical hard drive to store complete hydrological data.

[0033] The software implementation of a wireless transmission system for data integrity protection under a stable signal environment is as follows: Dual copy generation: The DMA controller directly accesses the acquisition buffer of the ADCP and synchronously writes the raw data into two independent memory buffers to generate a first data copy (real-time transmission buffer) and a second data copy (storage buffer). The generation delay is controlled within 5ms to ensure data consistency.

[0034] Signal detection: The 4G module reads the signal strength RSSI, bit error rate BER, and transmission rate throughput using AT commands, updating the parameters every 100ms. Signal stability is determined according to the communication protocol: 1.4G / 5G mode: RSSI ≥ -70dBm, BER ≤ 10 -5 1. Throughput ≥ 1Mbps; 2. LoRa mode: RSSI ≥ -120dBm, BER ≤ 10 -3 Throughput ≥ 50kbps.

[0035] When all three parameters simultaneously satisfy RSSI≥-70dBm and BER≤10 -5 When Throughput ≥ 1 Mbps, it is considered a stable signal environment.

[0036] Data integration: Both the first and second data copies carry a unique identifier, a collection timestamp (accurate to milliseconds) and a sequence number (incrementing continuously from 1). The data processing module identifies missing segments in the first data copy by comparing the sequence numbers and fills them in with the corresponding segments from the second data copy. At the same time, duplicate data is removed. A multi-threaded parallel integration algorithm is used, and the integration time is less than or equal to 3 seconds / GB. During integration, the device ID and restart count are checked first to avoid data identifier conflicts across devices / restart cycles.

[0037] Application Example: In a river hydrological monitoring operation, the transmitting end (an unmanned survey vessel equipped with an ADCP) collects flow velocity data in the central area of ​​the river where the signal is unstable. Due to terrain obstruction in this area, the signal strength fluctuates between -85dBm and -75dBm. During the data acquisition phase: The ADCP collects a set of flow velocity data every 1 second. The dual-copy generation module simultaneously generates the first and second data copies. The first data copy is transmitted to the receiving end in real time via a 4G module. The data displayed at the receiving end is intermittent due to signal interference, as shown in Figure 2, but the user can still monitor the flow velocity trend in real time. The second data copy is simultaneously stored in a 2TB SSD (model: Samsung 870EVO, with built-in wear leveling and integrated LZ4 data compression algorithm), ensuring no data loss. During data acquisition, if the signal meets the corresponding protocol stability threshold, the untransmitted second data copy is immediately retransmitted in stages.

[0038] After data acquisition, the unmanned survey vessel moved away from the center of the river and entered a region with stable signal (signal strength ≥ -65dBm, bit error rate = 10). -6 (Transmission rate = 2Mbps) The signal detection module determines that the stability threshold is met, and the first wireless transmission module sends the second data copy (complete flow rate data) stored in the SSD to the receiving end in one go.

[0039] Data integration: The receiving end data processing module integrates the first and second data copies based on the timestamp and sequence number, and supplements the missing data in the first data copy to obtain a complete flow rate and flow rate dataset, as shown in Figure 3. The integrated data has no loss or duplication, and its accuracy is consistent with the original collected data.

[0040] Application effect comparison: After adopting the technology of this invention, the retesting rate of hydrological monitoring operations has been reduced from 35% of the existing technology to 0, the single operation time has been shortened by more than 2 hours, and the safety hazards of water-related operations have been significantly reduced; the data transmission integrity has reached 100%, and the accuracy is consistent with the data read directly on site, meeting the high precision requirements of hydrological monitoring.

[0041] The technical solution of this invention is not only applicable to hydrological monitoring scenarios, but can also be widely applied to all wireless data transmission scenarios with unstable signals, such as field environmental monitoring, emergency communication, and geological exploration. In other embodiments, the data acquisition module can be replaced with corresponding professional acquisition equipment (such as environmental sensors, emergency communication terminals, etc.), the wireless transmission module can be replaced with communication modules such as LoRa and 5G according to scenario requirements, and the capacity of the large-capacity storage module can be adjusted according to the amount of data collected. All these modifications are within the protection scope of this invention.

[0042] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the technical principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A wireless transmission system for protecting data integrity under unstable signal environments, characterized in that, The system includes a transmitting end and a receiving end. The transmitting end includes a data acquisition module, a dual-copy generation module, a large-capacity storage module, a signal detection module, and a first wireless transmission module. The receiving end includes a second wireless transmission module, a data processing module, and a data storage module. The data acquisition module is used to acquire raw data in a target scenario, such as a field measurement, emergency communication, or hydrological monitoring scenario with unstable signals. The dual-copy generation module is communicatively connected to the data acquisition module and is used to synchronously generate a first data copy and a second data copy from the acquired raw data. The first data copy is low-reliability data that meets real-time viewing requirements and allows for loss due to signal interference, while the second data copy is high-reliability data that ensures integrity and eliminates data loss. The large-capacity storage module is communicatively connected to the dual-copy generation module and uses a non-volatile storage medium for long-term storage of the second data copy. The signal detection module is used to detect the signal quality parameters of the current wireless communication environment in real time and determine whether the signal quality parameters meet the preset stability threshold. The signal quality parameters include signal strength, bit error rate, and transmission rate. The first wireless transmission module is communicatively connected to the dual-copy generation module, the large-capacity storage module, and the signal detection module. It is used to send the first data copy to the receiving end in real time during the data acquisition phase, and also to send the second data copy stored in the large-capacity storage module to the receiving end when the data acquisition ends and the signal quality parameters meet the preset stability threshold. The second wireless transmission module is used to receive the first data copy and the second data copy and transmit them to the data processing module. The data processing module is used to present the first data copy in real time and to integrate the first data copy and the second data copy based on preset unique identifier information, remove duplicate data, and supplement missing data to obtain complete target data. The data storage module is used to store the complete target data.

2. The wireless transmission system according to claim 1, characterized in that, The preset stability threshold is classified according to the communication protocol as follows: 1) 4G / 5G protocol: signal strength ≥ -70dBm, bit error rate ≤ 10 -5 1) Transmission rate ≥ 1Mbps; 2) LoRa protocol: signal strength ≥ -120dBm, bit error rate ≤ 10 -3 And the transmission rate is ≥50kbps.

3. The wireless transmission system according to claim 1, characterized in that, The dual-replica generation module adopts a synchronous replication algorithm based on direct memory access (DMA), and the generation time delay of the first data replica and the second data replica is ≤10ms.

4. The wireless transmission system according to claim 1, characterized in that, The unique identification information includes device ID, restart count, data acquisition timestamp, and data sequence number. The data sequence number is a continuously increasing integer within a single operating cycle of the device, and the restart count increases synchronously with device restarts.

5. The wireless transmission system according to claim 1, characterized in that, The non-volatile storage medium is a solid-state drive or an embedded multimedia card, which supports persistent data storage even when power is off.

6. The wireless transmission system according to claim 1, characterized in that, Both the first and second wireless transmission modules support 4G, 5G, or LoRa communication protocols and adaptively switch communication modes according to the signal environment.

7. The wireless transmission system according to claim 1, characterized in that, The transmitting end also includes a power management module, which provides stable power to the data acquisition module, the dual-copy generation module, the large-capacity storage module, the signal detection module, and the first wireless transmission module.

8. A wireless transmission method for a wireless transmission system based on data integrity protection under unstable signal conditions as described in any one of claims 1-7, characterized in that, Includes the following steps: Step S1: The data acquisition module of the transmitting end starts to acquire raw data, which is field measurement data, emergency communication data or hydrological monitoring data under unstable signal scenarios; Step S2: The dual-copy generation module of the transmitting end synchronously generates a first data copy and a second data copy from the acquired raw data. The first data copy is low-guarantee-rate real-time transmission data, and the second data copy is high-guarantee-rate complete cached data. Step S3: During the data acquisition phase, the first wireless transmission module of the transmitting end sends a first data copy to the receiving end in real time. Simultaneously, the large-capacity storage module of the transmitting end stores a second data copy. The large-capacity storage module uses a non-volatile storage medium with a storage capacity ≥ 1TB. Step S4: The second wireless transmission module of the receiving end receives the first data copy and presents it in real time through the data processing module. Step S5: The signal detection module of the transmitting end detects the current wireless signal quality parameters in real time. The signal quality parameters include signal strength, bit error rate, and transmission rate. Real-time judgment is made during and after data acquisition. Whether the signal quality parameters meet the preset stability threshold: If the signal quality parameters meet the preset stability threshold, the first wireless transmission module sends the second data copy stored in the large-capacity storage module to the receiving end; if not, the transmitting end continues to detect the signal quality parameters until the preset stability threshold is met, and then executes the transmission of the second data copy; Step S6: The second wireless transmission module of the receiving end receives the second data copy, and the data processing module integrates the first data copy and the second data copy based on the preset unique identification information, removes duplicate data and supplements missing data to obtain complete target data, and the data storage module stores the complete target data.

9. The wireless transmission method according to claim 8, characterized in that, In step S5, during the continuous detection of signal quality parameters by the transmitting end, a signal quality detection is performed every 30 seconds. If a signal environment that meets the preset stable threshold is not detected for 24 hours, an alarm message containing the device ID, current location, remaining storage capacity, and amount of collected data is sent through the first wireless transmission module. If the device supports satellite communication, the satellite channel is simultaneously activated to retransmit key data at a low rate.

10. The wireless transmission method according to claim 8, characterized in that, The integration process in step S6 is as follows: the data processing module identifies the missing data segments in the first data copy by comparing the data sequence numbers, and supplements them with the corresponding data segments in the second data copy, while removing duplicate data segments in the first data copy and the second data copy.

Images