Multi-source heterogeneous data acquisition method, system and device based on Beidou short message communication transmission and medium

Abstract

The invention discloses a multi-source heterogeneous data acquisition method, system and device based on Beidou short message communication transmission and a medium, and relates to the technical field of data acquisition, and the method comprises the steps: constructing a regional wireless network in a target monitoring region, the regional wireless network being composed of a plurality of wireless node modules; according to a deployed sensor data interface protocol, the wireless node module is connected with a corresponding sensor; the wireless node module collects data from different sensors and gathers the data to the edge computing server; the method comprises the following steps: preprocessing sensor data in an edge computing server, performing unified multi-source heterogeneous data coding on the preprocessed data, and packaging the data into a main frame format according to a Beidou short message communication protocol; and sending the packaged short message data to a remote master station system through a Beidou short message communication link for data transmission. According to the invention, a self-organizing wireless network is constructed in an area without public network coverage, so that local convergence and stable transmission of various sensor data are realized.

Description

Technical Field

[0001] This invention relates to the field of data acquisition technology, and in particular to a method, system, device and medium for acquiring multi-source heterogeneous data based on BeiDou short message communication transmission. Background Technology

[0002] Currently, in industries such as power systems and water conservancy systems, field-side equipment generally relies on public network communication methods such as 4G and 5G to upload monitoring data to remote master stations. Each monitoring device typically needs to be equipped with a separate communication card and a wireless module. In application scenarios with complex equipment types and diverse manufacturers, different devices often connect independently to the public network, resulting in high system construction costs and significant waste of communication resources. At the same time, public networks suffer from uneven signal coverage and unstable latency, especially in mountainous or remote areas where 4G signals are often weak or even nonexistent, leading to ineffective transmission of monitoring data and posing potential risks to the operational safety and status monitoring of transmission lines, distribution network equipment, small hydropower stations, and hydrological facilities.

[0003] While some systems have attempted to improve coverage by adding high-power communication equipment or deploying private communication links, these methods are costly, complex to deploy, and difficult to meet the flexible needs of temporary or distributed monitoring tasks. On the other hand, with the full completion of the BeiDou-3 satellite navigation system, BeiDou short message communication technology has the capability for bidirectional data transmission without a public network, making it particularly suitable for low-data-rate, low-volume scenarios. However, current technologies lack a data acquisition and transmission method that can uniformly collect, fuse, and process data from multiple heterogeneous sensors and adapt it to the BeiDou short message communication standard. Furthermore, there is a lack of a complete system solution that supports local area networking, autonomous adaptation, edge computing, and frame format encapsulation.

[0004] Therefore, there is an urgent need for a technical solution that is suitable for areas without public network coverage, and can achieve unified collection, intelligent processing and highly reliable remote transmission of multiple types of monitoring data, so as to improve the monitoring capabilities and communication efficiency of power, water conservancy and other systems in complex environments. Summary of the Invention

[0005] In view of the above-mentioned problems, the present invention is proposed.

[0006] Therefore, the problem to be solved by this invention is that the existing technology lacks a data acquisition and transmission method that can uniformly collect, fuse and process multi-source heterogeneous sensor data and adapt to the BeiDou short message communication standard. It also lacks a complete system solution that can support local area networking, autonomous adaptation, edge computing and frame format encapsulation.

[0007] To address the aforementioned technical problems, this invention provides the following technical solution: a multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission, comprising: constructing a regional wireless network within a target monitoring area, the regional wireless network consisting of several wireless node modules; connecting the wireless node modules to corresponding sensors via reserved interfaces for data interaction according to the sensor data interface protocol deployed on-site; collecting data from different sensors by each wireless node module and aggregating the data to an edge computing server via the regional wireless network; preprocessing the collected sensor data on the edge computing server, performing unified multi-source heterogeneous data encoding on the preprocessed data, and encapsulating it into a main frame format according to the BeiDou short message communication protocol; and transmitting the encapsulated short message data to a remote master station system via the BeiDou short message communication link for data transmission.

[0008] As a preferred embodiment of the multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission described in this invention, the step of constructing a regional wireless network within the target monitoring area includes configuring several wireless node modules with node connection capabilities within the target monitoring area, and constructing a wireless communication network covering the entire monitoring area through the connection relationship between the nodes; each wireless node module initializes the network through a self-organizing network protocol to form a regional wireless local area network that does not rely on public network base stations; the wireless node module supports dynamic reconstruction of the network topology and has automatic reconnection after network exit and network self-healing capabilities.

[0009] The beneficial effects of this preferred technical solution are: it realizes local self-organizing communication capability in areas without public network coverage, automatically forms a network through wireless node modules, and ensures that data between sensors can be effectively aggregated without relying on mobile base stations or operator networks.

[0010] As a preferred embodiment of the multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission described in this invention, the step of connecting the wireless node module to the corresponding sensor through a reserved interface includes: the wireless node module having a reserved data interface that supports communication standards and data protocols; configuring communication parameters between the wireless node module and the sensor according to the communication characteristics of the connected sensor, and establishing a communication link; after the wireless node module is started, establishing a communication link with the sensor through the configured physical interface, periodically or responsively sending data reading commands to the sensor, and receiving the raw measurement data returned by the sensor.

[0011] As a preferred embodiment of the multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission described in this invention, the step of aggregating data to an edge computing server includes: after receiving raw measurement data, the wireless node module initially encapsulates the raw measurement data according to an internally preset instruction protocol to form raw data packets with sensor identifiers and timestamps; the wireless node module forwards the encapsulated raw data packets along the constructed network path to the aggregation node directly connected to the edge computing server; after receiving data from the wireless node module, the aggregation node forwards the data to the edge computing server through the network port; the server's built-in access resolution module classifies and stores the data according to the node identifier and triggers the corresponding data processing flow.

[0012] As a preferred embodiment of the multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission described in this invention, the preprocessing of the acquired sensor data includes: after the edge computing server receives data packets from different wireless node modules, it identifies the sensor type and corresponding communication protocol specification based on the sensor identification field in the packet; it performs format recognition and structured processing on the received data content to extract data fields reflecting physical quantity measurements; for data from different sensors within the same time period, it adopts a unified fusion strategy to perform data alignment and aggregation processing to construct a standardized data structure; and it performs static calculations on raw observation data that cannot be directly used to obtain directly usable displacement results.

[0013] The beneficial effects of this preferred technical solution are: by using field extraction and fusion strategies, redundant information is effectively removed, and only core monitoring indicators are retained, thereby achieving standardization and simplification of data content.

[0014] As a preferred embodiment of the multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission described in this invention, the step of uniformly encoding the preprocessed data into multi-source heterogeneous data includes: defining a corresponding data encoding structure for each type of data based on the preprocessed data; using hexadecimal encoding to compress and reconstruct the fields of physical measurements; formatting and encapsulating the encoded data content to form a data frame structure that supports BeiDou short message link transmission, including communication control fields and data integrity verification information; and performing adaptation judgment on the encapsulated data content according to the BeiDou short message communication bandwidth constraints. If the length of a single frame exceeds a preset limit, the data is divided into frames and packaged using splicing encoding or grouping encoding, and the corresponding total number of frames and current frame number fields are set, ultimately generating a data frame structure that conforms to the BeiDou inbound signal communication protocol.

[0015] The beneficial effects of this preferred technical solution are: the introduction of control fields and check fields into the encoding structure improves the manageability and error resistance of data during link transmission.

[0016] As a preferred embodiment of the multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission described in this invention, the step of sending the encapsulated short message data to the remote master station system via the BeiDou short message communication link includes: inputting the encapsulated data frame into the BeiDou short message sending module; performing standard format framing, forward error correction coding, encryption processing, and pseudo-code spread spectrum modulation on the data frame according to the short message communication protocol; the modulated digital signal is processed by radio frequency to form a modulated signal conforming to the BeiDou incoming signal standard band, and then sent to the BeiDou satellite through the transmitting antenna; after receiving the incoming signal, the satellite forwards the message to the ground control center; the ground center completes the reception, demodulation, and decoding of the short message, and forwards the data to the remote master station system through a dedicated network link, completing the final delivery of the data.

[0017] To address the aforementioned technical problems, this invention provides the following technical solution: a multi-source heterogeneous data acquisition system based on BeiDou short message communication transmission, comprising: a network construction module, a wireless node module, a parsing module, and a BeiDou short message transmission module; the network construction module is used to construct a regional wireless network within the target monitoring area, the regional wireless network being composed of several wireless node modules; the wireless node modules, according to the sensor data interface protocol deployed on-site, connect to corresponding sensors through reserved interfaces for data interaction, with each wireless node module collecting data from different sensors and aggregating the data to an edge computing server via the regional wireless network; the parsing module is used to preprocess the collected sensor data in the edge computing server, perform unified multi-source heterogeneous data encoding on the preprocessed data, and encapsulate it into a main frame format according to the BeiDou short message communication protocol; the BeiDou short message transmission module is used to send the encapsulated short message data to a remote master station system via the BeiDou short message communication link for data transmission.

[0018] A computer device includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the steps of the multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described above.

[0019] A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of a multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described above.

[0020] The beneficial effects of this invention are as follows: By constructing a self-organizing wireless network in areas without public network coverage, this invention achieves local aggregation and stable transmission of various sensor data. Combined with edge computing servers, it performs protocol parsing, field extraction, and fusion processing on multi-source heterogeneous data, effectively improving the standardization and lightweighting of the data. Furthermore, through unified data encoding and main frame encapsulation methods, it adapts to the BeiDou short message communication link, ultimately realizing low-cost, high-reliability remote acquisition and transmission of key parameters such as power and water conservancy in complex environments such as mountainous areas. It has significant beneficial effects such as flexible system deployment, low communication cost, strong adaptability, and high transmission efficiency. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a flowchart of a multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission in Example 1.

[0023] Figure 2 This is a diagram of the main frame format of a multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission in Example 2.

[0024] Figure 3 This is a diagram illustrating the basic format of the BeiDou inbound signal air link message frame transmission in Example 2, which is a multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission. Detailed Implementation

[0025] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0026] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0027] Example 1, referring to Figure 1 and Figure 2 This is the first embodiment of the present invention, which provides a method for acquiring multi-source heterogeneous data based on BeiDou short message communication transmission, including, for example... Figure 1 As shown:

[0028] S1: Construct a regional wireless network within the target monitoring area. The regional wireless network consists of several wireless node modules.

[0029] S2: Based on the sensor data interface protocol deployed on site, connect the wireless node module to the corresponding sensor through the reserved interface to exchange data.

[0030] S3: Data from different sensors is collected by each wireless node module and aggregated to the edge computing server through the regional wireless network.

[0031] S4: The collected sensor data is preprocessed in the edge computing server, and the preprocessed data is uniformly encoded into multi-source heterogeneous data and encapsulated into a main frame format according to the BeiDou short message communication protocol.

[0032] S5: The encapsulated short message data is sent to the remote master station system through the BeiDou short message communication link for data transmission.

[0033] It should be noted that in mountainous or remote areas, there are often situations where 4G signals are weak or even nonexistent, resulting in the inability to effectively transmit monitoring data. This poses a threat to the operational safety and status monitoring of power transmission lines, distribution network equipment, small hydropower stations, hydrological facilities, etc. Although some systems have attempted to improve coverage by adding high-power communication equipment or deploying private communication links, these methods are costly, complex to deploy, and difficult to meet the flexible needs of temporary or distributed monitoring tasks. On the other hand, existing technologies lack a data acquisition and transmission method that can uniformly collect, fuse, and process multi-source heterogeneous sensor data and adapt it to the BeiDou short message communication standard. There is also a lack of a complete system solution that can support local area networking, autonomous adaptation, edge computing, and frame format encapsulation.

[0034] Therefore, to address the aforementioned issues, through steps S1-S5, multiple wireless node modules are deployed in monitoring areas without public network signal coverage to construct a regional wireless network with self-organizing capabilities. Subsequently, each node connects to different types of sensors through various reserved interfaces and collects raw data. The collected data is aggregated step by step to the edge computing server in the on-site equipment room. Within the server, multi-source heterogeneous data undergoes protocol parsing, key field extraction, and fusion processing. Simultaneously, static calculations are performed on data requiring high-precision computation. The processed results are uniformly encoded and encapsulated into main frames according to the BeiDou short message communication standard, and finally sent to the remote master station system via the BeiDou link, achieving reliable and efficient transmission of key monitoring data in remote areas.

[0035] Example 2, refer to Figure 2 and Figure 3This is the second embodiment of the present invention, which differs from the first embodiment in that: a multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission further includes, in step S1, constructing a regional wireless network within the target monitoring area, including the following steps A1-A2:

[0036] A1: Configure several wireless node modules with node connection capabilities within the target monitoring area, and construct a wireless communication network covering the entire monitoring area through the connection relationship between the nodes.

[0037] A2: Each wireless node module initializes the network through a self-organizing network protocol, forming a regional wireless local area network that does not rely on public network base stations.

[0038] Specifically, the wireless node module supports dynamic reconstruction of the network topology, has automatic reconnection after network disconnection and network self-healing capabilities, ensuring that the network structure can be automatically restored when some nodes fail or are interrupted; the regional wireless LAN has multi-level relay forwarding capabilities, supports high-speed wireless data transmission and reception between multiple nodes, has high air communication rate, long transmission distance, and high receiving sensitivity, and is suitable for networking needs of multiple sensors within a radius of 1 kilometer.

[0039] In this embodiment of the application, in step A1, the connection relationship between nodes adopts the automatic neighbor discovery and connection method, including the following steps A111-A112:

[0040] A111: A neighbor discovery algorithm is pre-installed in each wireless node module deployed on-site, and each node actively sends a broadcast message after power-on.

[0041] A112: By receiving response messages from neighboring nodes and measuring the received signal strength or link quality indicators, it automatically identifies neighboring nodes and establishes point-to-point connections, gradually building a self-organizing wireless network topology covering the entire monitoring area.

[0042] In an optional implementation, the connection relationships between nodes can also be pre-configured using a fixed list of nodes, including the following steps A121-A122:

[0043] A121: Before system deployment, the operation and maintenance personnel shall, based on the sensor distribution, pre-set the neighbor node list and communication parameters for each node, and write the configuration into the wireless node module via serial port.

[0044] A122: After powering on, the node actively establishes a connection with the designated neighbor node according to the preset configuration table to achieve network initialization.

[0045] In another alternative implementation, the connection between nodes can also be achieved through a method of centralized broadcasting by the master node and registration by the slave nodes, including the following steps A131-A132:

[0046] A131: Set up one or more master nodes in the target area. The master node broadcasts network access request signals at regular intervals, and other nodes listen to the channel as slave nodes and initiate access requests.

[0047] A132: The master node allocates resources and establishes connections according to the access rules, and all slave nodes achieve network networking and management through the master node.

[0048] It should be noted that the constructed wireless communication network enables local self-organizing communication in areas without public network coverage. Through automatic networking via wireless node modules, it ensures that data between sensors can be effectively aggregated without relying on mobile base stations or operator networks. This reduces the data acquisition system's dependence on public network communication cards, saves communication costs, and is particularly suitable for remote mountainous areas, small hydropower stations, and other areas with complex terrain. The network has self-healing and multi-hop forwarding capabilities, improving system robustness and fault resistance, making the data acquisition link more stable and reliable in the field environment.

[0049] Furthermore, in step S2, connecting the wireless node module to the corresponding sensor via the reserved interface includes the following steps B1-B3:

[0050] B1: The wireless node module has a reserved data interface to support access to communication standards and data protocols.

[0051] B2: Based on the communication characteristics of the connected sensors, configure the communication parameters between the wireless node module and the sensors, and establish a communication link.

[0052] B3: After the wireless node module is started, it establishes a communication link with the sensor through the configured physical interface, periodically or responsively sends data reading commands to the sensor, and receives the raw measurement data returned by the sensor.

[0053] In this embodiment of the application, step B2 involves manually setting the communication parameters, including the following steps B211-B213:

[0054] B211: Maintenance personnel should identify the communication interface type and protocol standard of each sensor according to the product manual, such as RS485 (Recommended Standard 485), RS422 (Recommended Standard 422), Ethernet, etc.

[0055] B212: In the configuration interface of the wireless node module, manually input and set the communication parameters of the sensor, including baud rate, data bits, parity bits, stop bits, and Modbus address (Modbus is an abbreviation for "Modular Digital Control Protocol").

[0056] B213: After completing the parameter configuration, save the settings, initialize the communication port, and establish a stable serial or network communication link with the sensor.

[0057] In an optional implementation, the communication parameter configuration can also employ an automatic identification method, including the following steps B221-B223:

[0058] B221: The wireless node module has an embedded communication parameter self-identification algorithm. After startup, it automatically polls and sends multiple sets of standard initialization commands on the serial port or network port, covering common baud rates, data formats and protocol types.

[0059] B222: The system automatically determines whether the communication was successful based on the received receipt data, and locks down the best matching parameter combination by comparing the response format and verification rules.

[0060] B223: Once recognition is successful, the system automatically applies the parameter configuration and establishes a communication link with the sensor, while saving the recognition result locally for subsequent rapid initialization.

[0061] In another alternative implementation, communication parameter configuration can also be achieved by centrally configuring parameter templates and remotely distributing them, including the following steps B231-B233:

[0062] B231: Maintenance personnel create corresponding communication parameter templates for different types of sensors on the main station system or host computer management platform, including fields such as interface type, baud rate, data format, and Modbus address.

[0063] B232: Through the OTA (Over-The-Air) remote configuration mechanism, each template is uniformly distributed to the corresponding wireless node module. The node matches the applicable template according to its own sensor type and completes the communication initialization.

[0064] B233: After communication is established, the node will send the successful connection status back to the master station for configuration confirmation, enabling batch deployment and centralized management.

[0065] Furthermore, in step S3, aggregating the data to the edge computing server includes the following steps C1-C3:

[0066] C1: After receiving the raw measurement data, the wireless node module performs preliminary encapsulation of the raw measurement data according to the internally preset instruction protocol to form a raw data packet with sensor identification and timestamp.

[0067] C2: The wireless node module forwards the encapsulated raw data packets along the constructed network path to the aggregation node that is directly connected to the edge computing server.

[0068] C3: After receiving data from the wireless node module, the aggregation node forwards it to the edge computing server through the network port. The server's built-in access resolution module classifies and stores the data according to the node identifier and triggers the corresponding data processing flow.

[0069] Specifically, the aggregation node and the server use an Ethernet wired connection to achieve high-speed data communication.

[0070] Furthermore, in step S4, the preprocessing of the collected sensor data includes the following steps D1-D4:

[0071] D1: After receiving data packets from different wireless node modules, the edge computing server identifies the sensor type and corresponding communication protocol specification based on the sensor identification field in the packet.

[0072] D2: Perform format recognition and structuring processing on the received data content, and extract data fields that reflect the measured values ​​of physical quantities.

[0073] D3: For data from different sensors within the same time period, a unified fusion strategy is used for data alignment and aggregation to build a standardized data structure.

[0074] D4: Perform static calculations on raw observation data that cannot be used directly to obtain displacement results that can be used directly.

[0075] Specifically, the fusion strategy in step D3 adopts a time window-based alignment and field standardization method to achieve unified processing of multi-source heterogeneous data. This includes: the edge computing server timestamps the data packets from different sensors within a set time window, fills in missing items, and transforms the data from different sources into unified field naming and unit standards according to the field mapping relationship, and finally reconstructs them into a standardized data structure for subsequent calculations or BeiDou link framing transmission.

[0076] The static solution in step D4 uses a multi-baseline carrier phase difference solution method combined with a fixed integer ambiguity solution method to perform local high-precision solution on the satellite observation data collected by the deformation monitoring equipment. Specifically, it involves constructing a multi-baseline observation model, constructing a virtual observation equation by combining baseline length constraints, and using least squares estimation and a fixed integer ambiguity solution method to jointly solve the integer ambiguity. Finally, it obtains the precise coordinates and displacement of each antenna, realizing high-precision deformation monitoring and anomaly identification of structures such as dams.

[0077] In this embodiment of the application, in step D2, format recognition and structured processing use a protocol template library to perform structured field matching, including the following steps D211-D213:

[0078] D211: A library of parsing templates for various sensor communication protocols is pre-set in the edge computing server. Each template includes information such as protocol type identifier, data frame structure, key field offset, and parsing rules.

[0079] D212: The server automatically matches the corresponding parsing template based on the protocol type identifier field in the data packet, and performs structured parsing of the packet according to the template rules to extract physical quantity measurement fields such as temperature, humidity, water level, wind speed, and rainfall.

[0080] D213: Output the extracted field content to the fusion module according to a unified format standard, and associate it with the timestamp and node number of the original message to provide a data foundation for subsequent fusion and processing.

[0081] In an optional implementation, format recognition and structured processing can also use a regular expression rule base for dynamic pattern matching, including the following steps D221-D223:

[0082] D221: Build a regular expression rule base for a multi-source data protocol in the edge computing server. Each rule is used to match the structural features and content patterns of target fields in a specific protocol.

[0083] D222: After receiving a data message, the server automatically traverses the rule base, performs regular expression matching on each message, identifies the location and content of key fields in the message, and extracts core physical quantity data such as water level and wind speed.

[0084] D223: The matching extraction results are converted into a standardized field structure and sent to the downstream fusion module. At the same time, the rule ID and sensor ID of the successfully matched rule are recorded to facilitate subsequent optimization and debugging.

[0085] In another alternative implementation, format recognition and structure processing can also utilize machine learning models for field extraction and structure recognition, including the following steps D231-D233:

[0086] D231: Construct a sample dataset by collecting a large amount of historical raw message data from different sensors, and manually annotate field boundaries and corresponding physical quantity labels; train the model using a Bi-LSTM (Bidirectional Long Short-Term Memory) model, with input being byte sequences or character encoded sequences, and output being a label indicating whether each position is a key field boundary; optimize using the cross-entropy loss function, and introduce a Dropout (random deactivation) mechanism during training to improve the model's generalization ability; save the model parameters and weights after training is complete.

[0087] D232: Deploy the trained model within an edge computing server. Input the received raw messages into the model by bytes or characters. The model predicts whether each input position is a field start / end marker and determines the range of key fields accordingly. At the same time, use the label confidence scores output by the model to perform field filtering and confidence scoring.

[0088] D233: Extract core physical quantity fields (such as wind speed, water level, and rainfall) based on the model recognition results; convert the extracted results into a standardized field structure; and associate the model recognition results with timestamps and sensor numbers for subsequent fusion and framing processing.

[0089] It should be noted that the structured processing of this invention can achieve unified identification and parsing of data formats from different manufacturers and with different protocols, enhancing the system's compatibility with multi-source heterogeneous devices; through field extraction and fusion strategies, redundant information is effectively removed, retaining only core monitoring indicators, thus achieving standardization and simplification of data content; it provides support for subsequent lightweight transmission, reduces communication load, and is particularly suitable for data requirements in scenarios where BeiDou short message bandwidth is limited.

[0090] Furthermore, in step S4, the preprocessed data undergoes unified multi-source heterogeneous data encoding, including the following steps D5-D7:

[0091] D5: Based on the preprocessed data, define the corresponding data encoding structure for each type of data, and use hexadecimal encoding to compress the physical measurement values ​​and reconstruct the fields.

[0092] D6: The encoded data content is formatted and encapsulated to form a data frame structure that supports BeiDou short message link transmission, and includes communication control fields and data integrity verification information.

[0093] D7: Based on the bandwidth constraints of BeiDou short message communication, the encapsulated data content is adapted and judged. If the length of a single frame exceeds the preset limit, the data is divided into frames and packaged using splicing encoding or grouping encoding. The corresponding total number of frames and current frame number fields are set, and finally a data frame structure that conforms to the BeiDou inbound signal communication protocol is generated.

[0094] In this embodiment of the application, in D6, the formatted encapsulation adopts a master frame structure (three segments: frame header segment, data segment, and check segment), such as... Figure 2 As shown, the steps include D611-D613:

[0095] D611: Multi-source heterogeneous data after edge computing and unified encoding is embedded as a "business data field" in the data segment of the frame, along with "protocol type" and "reserved bit" fields to indicate the data source type and processing status.

[0096] D612: Constructs the frame header segment, which includes control fields such as frame identifier, instruction type, multi-frame identifier, emergency identifier, link selection, encoding method, communication address, data length, total number of frames and current frame number, and is used to manage the identification, fragmentation and transmission strategies of data frames.

[0097] D613: The XOR operation is used to verify the order of all bytes in the frame header and data segments, generating a 1-byte check bit and adding it to the frame tail as a check segment to form a complete three-segment structure. This structure is compatible with the BeiDou short message link and can be parsed and verified at the receiving end according to the structure.

[0098] In an optional implementation, the formatted encapsulation may also employ a TLV structure frame (Type-Length-Value structure), including the following steps D621-D623:

[0099] D621: Encapsulate each type of data to be transmitted in the encoding format of "Type + Length + Value", where the "Type" field identifies the sensor category or data attribute, the "Length" field indicates the number of bytes in the Value field, and the "Value" field is the actual physical quantity data.

[0100] D622: Multiple TLV units can be chained together to form a complete business data segment without relying on a fixed field order.

[0101] D623: The entire TLV frame structure is further expanded by adding frame header control fields (such as frame ID, timestamp, and frame sequence number) and end check bits to form a data frame structure with flexible expansion capabilities.

[0102] In another alternative implementation, the formatted encapsulation can also employ a compressed JSON (JavaScriptObjectNotation) encoded structure, including the following steps D631-D633:

[0103] D631: Assembles the structured data fields to be transmitted into JSON format key-value pairs, including field names, values, and units.

[0104] D632: Uses lightweight compression algorithms such as GZIP (GNU zip, GNU compression algorithm) to compress JSON text, reducing its length and adapting it to the data length limit of BeiDou short messages.

[0105] D633: The compressed data body is encapsulated in a BeiDou frame. The frame header may include control fields such as format type identifier (e.g., "JSON+GZIP"), data length and timestamp, and a hash check value is added at the end to ensure content integrity.

[0106] It should be noted that by designing a unified encapsulation format, data from different sensors can be compatiblely transmitted through a unified channel, avoiding parsing difficulties caused by inconsistent formats; multiple encoding strategies (direct, splicing, and framing) flexibly match different data volume requirements, achieving optimal utilization of communication resources; control and check fields are introduced into the encoding structure to improve the manageability and error resistance of data during link transmission; the encapsulation format is fully compatible with the BeiDou short message communication standard, ensuring that data can be directly uploaded through the BeiDou link without secondary conversion, improving overall transmission efficiency and system integration.

[0107] Furthermore, in step S5, sending the encapsulated short message data to the remote master station system via the BeiDou short message communication link includes the following steps E1-E3:

[0108] E1: Input the encapsulated data frame into the BeiDou short message transmission module. According to the short message communication protocol, the data frame is subjected to standard format framing, forward error correction coding, encryption processing and pseudo-code spread spectrum modulation.

[0109] E2: The modulated digital signal is processed by radio frequency to form a modulated signal that conforms to the BeiDou inbound signal standard band, and then transmitted to the BeiDou satellite through the transmitting antenna.

[0110] E3: After receiving the incoming signal, the satellite forwards the message to the ground control center. The ground control center completes the reception, demodulation and decoding of the short message, and forwards the data to the remote master station system through the private network link to complete the final delivery of the data.

[0111] Specifically, BeiDou short message communication transmission has its own dedicated protocol specifications. The frame format must be assembled and encoded according to the BeiDou short message communication protocol. The basic format of BeiDou incoming signal air link message frame transmission is as follows: Figure 3 As shown.

[0112] When transmitting BeiDou short messages, message types can be divided into three methods: Chinese characters, code, and mixed encoding. The Chinese character method converts the machine code of Chinese characters into the area code before framing. The code method frames the message content as a code in every 4 bits (Binary Digit). The mixed encoding method allows the message content to contain both Chinese characters and codes. The message content is converted into ASCII (American Standard Code for Information Interchange) code and framed directly in units of 8 bits. The multi-source heterogeneous data format is based on hexadecimal encoding and is suitable for framing using the code method. The processed multi-source heterogeneous data frames are then converted according to the above BeiDou frame format to a frame format that can be recognized by the BeiDou system standard before being transmitted through the BeiDou link.

[0113] Example 3, the third embodiment of the present invention, differs from the previous two embodiments in that it is a multi-source heterogeneous data acquisition system based on BeiDou short message communication transmission, comprising a network construction module, a wireless node module, a parsing module, and a BeiDou short message transmission module. The network construction module is used to construct a regional wireless network within the target monitoring area, which consists of several wireless node modules. The wireless node modules, according to the sensor data interface protocol deployed on-site, connect to corresponding sensors through reserved interfaces for data interaction. Each wireless node module collects data from different sensors and aggregates the data to an edge computing server via the regional wireless network. The parsing module preprocesses the collected sensor data in the edge computing server, performs unified multi-source heterogeneous data encoding on the preprocessed data, and encapsulates it into a main frame format according to the BeiDou short message communication protocol. The BeiDou short message transmission module transmits the encapsulated short message data to a remote master station system via the BeiDou short message communication link for data transmission.

[0114] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0115] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0116] More specific examples of computer-readable media (a non-exhaustive list) include: electrical connections (electronic devices) having one or more wires, portable computer disk drives (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0117] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented in combination with any of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0118] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A method for acquiring multi-source heterogeneous data based on BeiDou short message communication transmission, characterized in that: include, A regional wireless network is constructed within the target monitoring area, and the regional wireless network consists of several wireless node modules; According to the sensor data interface protocol deployed on site, the wireless node module is connected to the corresponding sensor through the reserved interface to exchange data; Data from different sensors is collected by each wireless node module and aggregated to the edge computing server through the regional wireless network; The collected sensor data is preprocessed in the edge computing server, and the preprocessed data is uniformly encoded into multi-source heterogeneous data and encapsulated into a main frame format according to the BeiDou short message communication protocol. The encapsulated short message data is sent to the remote master station system via the BeiDou short message communication link for data transmission.

2. The multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described in claim 1, characterized in that: The construction of a regional wireless network within the target monitoring area includes, Several wireless node modules with node connectivity are configured within the target monitoring area, and a wireless communication network covering the entire monitoring area is constructed through the connection relationship between the nodes. Each wireless node module initializes the network through a self-organizing network protocol, forming a regional wireless local area network that does not rely on public network base stations; The wireless node module supports dynamic reconstruction of network topology and has the ability to automatically reconnect after network disconnection and network self-healing.

3. The multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described in claim 2, characterized in that: The step of connecting the wireless node module to the corresponding sensor through the reserved interface includes... The wireless node module has a reserved data interface to support access to communication standards and data protocols. Based on the communication characteristics of the connected sensors, configure the communication parameters between the wireless node module and the sensors, and establish a communication link; After the wireless node module is started, it establishes a communication link with the sensor through the configured physical interface, periodically or responsively sends data reading commands to the sensor, and receives the raw measurement data returned by the sensor.

4. The multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described in claim 3, characterized in that: The process of aggregating data to an edge computing server includes, After receiving the raw measurement data, the wireless node module initially encapsulates the raw measurement data according to the internally preset instruction protocol to form a raw data packet with sensor identification and timestamp. The wireless node module forwards the encapsulated raw data packets along the constructed network path to the aggregation node that is directly connected to the edge computing server; After receiving data from the wireless node module, the aggregation node forwards it to the edge computing server via the network port. The server's built-in access resolution module categorizes and stores the data according to the node identifier and triggers the corresponding data processing flow.

5. The multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described in claim 4, characterized in that: The preprocessing of the collected sensor data includes, After receiving data packets from different wireless node modules, the edge computing server identifies the sensor type and corresponding communication protocol specification based on the sensor identification field in the packet. The received data content is formatted and structured to extract data fields that reflect physical quantity measurements. For data from different sensors within the same time period, a unified fusion strategy is used for data alignment and aggregation to build a standardized data structure; Static calculations are performed on raw observation data that cannot be used directly to obtain displacement results that can be used directly.

6. The multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described in claim 5, characterized in that: The step of performing unified multi-source heterogeneous data encoding on the preprocessed data includes... Based on the preprocessed data, a corresponding data encoding structure is defined for each type of data, and the physical measurement values ​​are numerically compressed and the fields are reconstructed using hexadecimal encoding. The encoded data content is formatted and encapsulated to form a data frame structure that supports BeiDou short message link transmission, and includes communication control fields and data integrity verification information; Based on the bandwidth constraints of BeiDou short message communication, the encapsulated data content is adapted and judged. If the length of a single frame exceeds the preset limit, the data is divided into frames and packaged using splicing encoding or grouping encoding. The corresponding total number of frames and current frame number fields are set, and finally a data frame structure that conforms to the BeiDou inbound signal communication protocol is generated.

7. The multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described in claim 6, characterized in that: The step of sending the encapsulated short message data to the remote master station system via the BeiDou short message communication link includes... The encapsulated data frame is input into the BeiDou short message sending module. According to the short message communication protocol, the data frame is subjected to standard format framing, forward error correction coding, encryption processing and pseudo-code spread spectrum modulation. The modulated digital signal is processed by radio frequency to form a modulated signal that conforms to the BeiDou inbound signal standard band, and then transmitted to the BeiDou satellite through the transmitting antenna; After receiving the incoming signal, the satellite forwards the message to the ground control center. The ground control center then receives, demodulates, and decodes the short message, and forwards the data to the remote master station system via a dedicated network link, thus completing the final delivery of the data.

8. A multi-source heterogeneous data acquisition system based on BeiDou short message communication transmission, employing the multi-source heterogeneous data acquisition method based on BeiDou short message communication transmission as described in any one of claims 1 to 7, characterized in that: It includes a network construction module, a wireless node module, a parsing module, and a BeiDou short message sending module; The network construction module is used to construct a regional wireless network within the target monitoring area, and the regional wireless network consists of several wireless node modules; According to the sensor data interface protocol deployed on site, the wireless node module connects to the corresponding sensor through the reserved interface to exchange data. Each wireless node module collects data from different sensors and aggregates the data to the edge computing server through the regional wireless network. The parsing module is used to preprocess the collected sensor data in the edge computing server, encode the preprocessed data into unified multi-source heterogeneous data, and encapsulate it into a main frame format according to the BeiDou short message communication protocol. The BeiDou short message sending module is used to send the encapsulated short message data to the remote master station system through the BeiDou short message communication link for data transmission.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, it implements the steps of the multi-source heterogeneous data acquisition method based on Beidou short message communication transmission as described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, it implements the steps of the multi-source heterogeneous data acquisition method based on Beidou short message communication transmission as described in any one of claims 1 to 7.

Images