Reference station data transmission method and system

Abstract

The invention provides a reference station data transmission method and system, and the method comprises the steps: obtaining a reference station identification sequence of a target region, and obtaining the total number of reference stations; carrying out coding binding under a preset coding rule based on the total number of the reference stations to obtain a code-reference station identification sequence corresponding to the reference station identification sequence; configuring under a preset Kafka transmission theme based on the total number of the reference stations to obtain a coding partition sequence; mapping based on the code-base station identifier sequence and the code partition sequence to obtain a base station identifier-code partition sequence; observation data collected by each reference station is sent to a coding partition, corresponding to the coding partition sequence, of each reference station under the reference station identifier-coding partition sequence; and obtaining a reference station identifier sequence to be processed, obtaining a coding partition sequence to be pulled based on the reference station identifier sequence to be processed and the reference station identifier-coding partition sequence, and transmitting observation data of the coding partition sequence to be pulled. According to the invention, the data transmission efficiency can be improved.

Description

Technical Field

[0001] This invention belongs to the field of data processing technology, and in particular relates to a method and system for transmitting data from a reference station. Background Technology

[0002] Currently, continuously operating reference stations are mainly divided into single-machine mode and cluster mode based on their service coverage and base station scale. In cluster mode, a large amount of observation data from base stations needs to be processed simultaneously.

[0003] To improve the real-time performance of base station data transmission, existing solutions receive data through a distributed message queue, perform parsing and computation using a stream computing framework, and finally store the observation data in a distributed database. Furthermore, these solutions perform a modulo operation on the base station sequence number to allocate observation data to a limited number of cache partitions. However, in scenarios with a large number of base stations, a single cache partition can contain observation data from multiple unrelated base stations. Therefore, when a client terminal needs observation data from a specific base station, it must retrieve observation data from all cache partitions to select the relevant data. Consequently, in large-scale base station scenarios, existing solutions often transmit a large amount of non-target base station observation data to the client terminal, consuming significant local area network bandwidth and greatly reducing data transmission efficiency. Summary of the Invention

[0004] The present invention aims to provide a method and system for data transmission from a reference station to solve the above-mentioned technical problems and improve the efficiency of data transmission.

[0005] To address the aforementioned technical problems, this invention provides a base station data transmission method, comprising the following steps: Obtain the base station identifier sequence for the target area, and based on the base station identifier sequence, obtain the total number of base stations; Based on the total number of base stations, encoding binding is performed under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence; Based on the total number of base stations, configuration processing is performed under a preset Kafka transmission topic to obtain an encoded partition sequence; Based on the mapping between the encoding-base station identifier sequence and the encoding partition sequence, the base station identifier-encoding partition sequence is obtained; The observation data collected by each base station in the base station identifier sequence are sent to the corresponding coding partition of each base station under the base station identifier-coding partition sequence. Obtain the base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, obtain the coded partition sequence to be pulled, and transmit the observation data of the coded partition sequence to be pulled.

[0006] In the above scheme, a unique code is assigned to each base station under preset coding rules, forming a code-base station identifier sequence. Furthermore, a number of coding partitions, equal to the total number of base stations, are created under the Kafka transmission topic, forming a coding partition sequence. Subsequently, this scheme establishes a mapping relationship between the base station identifier sequence and the coding partition sequence, ensuring that the observation data collected by each base station is accurately sent to the corresponding coding partition. Therefore, after obtaining the base station identifier sequence to be processed by the client terminal, this scheme can directly locate the observation data stored in the corresponding coding partition of the base station to be processed and directly transmit the required observation data. Compared to the traditional scheme that requires transmitting a large amount of non-target base station observation data to the client terminal, this scheme can significantly reduce local area network bandwidth usage and improve data transmission efficiency.

[0007] Further, the step of encoding binding based on the total number of base stations under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence includes: obtaining an encoding sequence based on the total number of base stations under a preset encoding step size; the number of encodings in the encoding sequence is consistent with the total number of base stations; and performing encoding binding processing based on the encoding sequence and the base station identifier sequence to obtain the encoding-base station identifier sequence.

[0008] The above scheme assigns a unique code to each base station in the base station identifier sequence, that is, binds the base station identifier with the corresponding code to obtain a code-base station identifier sequence that reflects the mapping relationship between the code and the base station identifier. This ensures that during the subsequent transmission of observation data corresponding to the base station identifier sequence that needs to be processed, the code partition corresponding to the base station identifier sequence that needs to be processed can be quickly located through the code, and the problem of observation data matching errors due to code duplication or disorder will not occur, thus improving the accuracy of data transmission.

[0009] Further, the step of configuring the encoding partition sequence based on the total number of base stations and the encoding-base station identifier sequence under a preset Kafka transmission topic to obtain the encoding partition sequence includes: performing partitioning processing based on the total number of base stations under a preset Kafka transmission topic to obtain a preliminary encoding partition sequence; and performing replication processing on each preliminary encoding partition of the preliminary encoding partition sequence under a preset number of replicas to obtain the encoding partition sequence.

[0010] Further, the step of sending the observation data collected by each base station in the base station identifier sequence to the corresponding coding partition of each base station under the base station identifier-coding partition sequence further includes: obtaining the partition working status of each coding partition in the coding partition sequence; confirming that there is a single node failure in the partition working status, then obtaining the fault partition sequence in the coding partition sequence where the partition working status is a single node failure; performing a switching step on each fault partition in the fault partition sequence to obtain several replacement codes, and obtaining a replacement code-coding partition sequence based on the several replacement codes; updating the base station identifier-coding partition sequence based on the replacement code-coding partition sequence; the switching step includes: obtaining the synchronization rate of each replica in the fault partition; and using the code of the replica corresponding to the maximum synchronization rate in the fault partition as the replacement code.

[0011] The above scheme first divides the data under the Kafka transmission topic based on the total number of base stations, generating an initial coded partition sequence consistent with the number of base stations. This ensures that each base station has a unique coded partition, allowing collected observation data to be transmitted to its corresponding coded partition, thus avoiding conflicts when transmitting data from different observation stations. Building on this, this scheme adds replicas to each initial coded partition with a preset number of replicas, forming a coded partition sequence containing at least one replica. Therefore, this scheme ensures that each numbered partition has at least one replica, which serves as a redundant backup of the observation data stored in the coded partition. If subsequent corresponding observation data is corrupted, the redundant backup observation data can be used for transmission, improving the reliability of data transmission.

[0012] Furthermore, the above scheme obtains the partition working status of each coded partition in the coded partition sequence in real time. Once a single node failure is confirmed, the coded partition with the single node failure is quickly located, and the faulty partition sequence is obtained. Subsequently, this scheme uses the code of the replica with the highest synchronization rate in the faulty partition as the replacement code corresponding to the faulty partition, and obtains the replacement code-coded partition sequence. This can ensure the consistency of the corresponding observation data after the switching step is performed, and effectively avoid data loss or out-of-order processing.

[0013] Further, the step of sending the observation data collected by each base station in the base station identifier sequence to the coding partition corresponding to each base station in the coding partition sequence under the base station identifier-coding partition sequence includes: performing lightweight compression on the observation data collected by each base station in the base station identifier sequence to obtain compressed observation data corresponding to each base station; and synchronously sending the compressed observation data corresponding to each base station to the coding partition corresponding to each base station in the coding partition sequence under the base station identifier-coding partition sequence.

[0014] In the above scheme, before sending the observation data collected by each base station to the corresponding coded partition, the observation data collected by each base station is also lightly compressed, which can reduce the local area network bandwidth usage and thus improve the efficiency of subsequent data transmission.

[0015] Further, the process involves obtaining a base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, obtaining a coded partition sequence to be retrieved, and transmitting the observation data in the coded partition sequence to be retrieved. This includes: obtaining a base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, obtaining a coded partition sequence to be retrieved corresponding to the base station identifier sequence to be processed; and transmitting the observation data in the coded partition sequence to be retrieved.

[0016] In the above scheme, after obtaining the base station identifier sequence to be processed, the corresponding code partition sequence to be pulled can be obtained based on the base station identifier-code partition sequence, and the corresponding code partition observation data can be transmitted. Compared with the traditional scheme that requires a large amount of non-target base station observation data of all partitions to be transmitted to the client terminal, this scheme can reduce the local area network bandwidth occupation and improve the data transmission efficiency.

[0017] This invention also provides a base station data transmission system for implementing any of the base station data transmission methods described above, comprising: a base station counting module for acquiring a base station identifier sequence for a target area and obtaining a total number of base stations based on the base station identifier sequence; a base station encoding binding module for encoding binding based on the total number of base stations under a preset encoding rule to obtain an encoding-base station identifier sequence corresponding to the base station identifier sequence; a topic encoding partitioning module for configuration processing based on the total number of base stations under a preset Kafka transmission topic to obtain an encoding partitioning sequence; an encoding identifier mapping module for mapping based on the encoding-base station identifier sequence and the encoding partitioning sequence to obtain a base station identifier-encoding partitioning sequence; an observation data partitioning storage module for sending the observation data collected by each base station in the base station identifier sequence to the encoding partition corresponding to each base station in the encoding partitioning sequence under the base station identifier-encoding partitioning sequence; and an observation data transmission module for acquiring a base station identifier sequence to be processed, obtaining a code partitioning sequence to be pulled based on the base station identifier sequence to be processed and the base station identifier-encoding partitioning sequence, and transmitting the observation data of the code partitioning sequence to be pulled.

[0018] Further, the step of encoding binding based on the total number of base stations under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence includes: obtaining an encoding sequence based on the total number of base stations under a preset encoding step size; the number of encodings in the encoding sequence is consistent with the total number of base stations; and performing encoding binding processing based on the encoding sequence and the base station identifier sequence to obtain the encoding-base station identifier sequence.

[0019] Further, the step of configuring and processing under a preset Kafka transmission topic based on the total number of base stations to obtain the encoding partition sequence includes: performing partitioning processing under a preset Kafka transmission topic based on the total number of base stations to obtain a preliminary encoding partition sequence; and performing replication processing on each preliminary encoding partition of the preliminary encoding partition sequence under a preset number of replicas to obtain an encoding partition sequence.

[0020] Further, the step of sending the observation data collected by each base station in the base station identifier sequence to the corresponding coding partition of each base station under the base station identifier-coding partition sequence further includes: obtaining the partition working status of each coding partition in the coding partition sequence; confirming that there is a single node failure in the partition working status, then obtaining the fault partition sequence in the coding partition sequence where the partition working status is a single node failure; performing a switching step on each fault partition in the fault partition sequence to obtain several replacement codes, and obtaining a replacement code-coding partition sequence based on the several replacement codes; updating the base station identifier-coding partition sequence based on the replacement code-coding partition sequence; the switching step includes: obtaining the synchronization rate of each replica in the fault partition; and using the code of the replica corresponding to the maximum synchronization rate in the fault partition as the replacement code.

[0021] In the above scheme, a unique code is assigned to each base station under preset coding rules, forming a code-base station identifier sequence. Furthermore, a number of coded partitions, equal to the total number of base stations, are created under the Kafka transmission topic, forming a coded partition sequence. Subsequently, this scheme establishes a mapping relationship between the base station identifier sequence and the coded partition sequence, ensuring that the observation data collected by each base station is accurately sent to the corresponding coded partition. Therefore, after obtaining the base station identifier sequence to be processed by the client terminal, this scheme can directly locate the observation data stored in the corresponding coded partition of the base station to be processed and directly transmit the required observation data, without needing to transmit a large amount of observation data from non-target base stations, greatly reducing local area network bandwidth consumption and improving data transmission efficiency. Attached Figure Description

[0022] Figure 1 A flowchart illustrating the steps of a base station data transmission method provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of the structure of a base station data transmission system provided in an embodiment of the present invention. Detailed Implementation

[0023] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0024] Please see Figure 1 This embodiment provides a base station data transmission method, including the following steps: Step S1: Obtain the base station identifier sequence of the target area, and based on the base station identifier sequence, obtain the total number of base stations; Step S2: Based on the total number of base stations, perform encoding binding under the preset encoding rules to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence; Step S3: Based on the total number of base stations, perform configuration processing under the preset Kafka transmission topic to obtain the encoded partition sequence; Step S4: Map the encoded-base station identifier sequence and the encoded partition sequence to obtain the base station identifier-encoded partition sequence; Step S5: The observation data collected by each base station in the base station identifier sequence is sent to the corresponding coding partition of each base station under the base station identifier-coding partition sequence; Step S6: Obtain the base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, obtain the coded partition sequence to be pulled, and transmit the observation data of the coded partition sequence to be pulled.

[0025] In the above embodiments, a unique code is assigned to each base station under preset coding rules, forming a code-base station identifier sequence. Furthermore, a number of coding partitions, equal to the total number of base stations, are created under the Kafka transmission topic, forming a coding partition sequence. Subsequently, this embodiment establishes a mapping relationship between the base station identifier sequence and the coding partition sequence, ensuring that the observation data collected by each base station can be accurately sent to the corresponding coding partition. Therefore, after obtaining the base station identifier sequence to be processed by the client terminal, this embodiment can directly locate the observation data stored in the corresponding coding partition of the base station to be processed and directly transmit the required observation data. Compared to the traditional solution that requires transmitting a large amount of non-target base station observation data to the client terminal, this embodiment can significantly reduce local area network bandwidth usage and improve data transmission efficiency.

[0026] It should be noted that the observation data includes raw satellite positioning observations, almanac data, equipment status messages, etc. The data format must be standardized into JSON or binary stream before subsequent transmission.

[0027] Further, the step of encoding binding based on the total number of base stations under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence includes: obtaining an encoding sequence based on the total number of base stations under a preset encoding step size; the number of encodings in the encoding sequence is consistent with the total number of base stations; and performing encoding binding processing based on the encoding sequence and the base station identifier sequence to obtain the encoding-base station identifier sequence.

[0028] The above embodiment assigns a unique code to each base station in the base station identifier sequence, that is, binds the base station identifier with the corresponding code to obtain a code-base station identifier sequence that reflects the mapping relationship between the code and the base station identifier. This ensures that during the subsequent transmission of observation data corresponding to the base station identifier sequence that needs to be processed, the code partition corresponding to the base station identifier sequence that needs to be processed can be quickly located through the code, and the problem of observation data matching errors due to code duplication or disorder will not occur, thus improving the accuracy of data transmission.

[0029] In one embodiment, the base station identifier in the base station identifier sequence is the physical device identifier of the base station, and the physical device can be a unique ID of the base station or a device serial number. In this embodiment, the base station identifier sequence corresponds to a total of 3000 base stations, with a preset encoding step size of 1. The encoding sequence obtained in this embodiment is [0,1,2,…,2999]. Subsequently, a continuously operating reference system (CORS) data transmission topic is created in the Kafka cluster, and the Kafka transmission topic is named "cors_base_station_data". Then, in this embodiment, the number of partitions for the transmission topic is equal to the total number of base stations, and each partition is encoded based on the encoding sequence, so that the encoding of each partition corresponds to the encoding mapped to each base station identifier in the encoding-base station identifier sequence.

[0030] Further, the step of configuring the encoding partition sequence based on the total number of base stations and the encoding-base station identifier sequence under a preset Kafka transmission topic to obtain the encoding partition sequence includes: performing partitioning processing based on the total number of base stations under a preset Kafka transmission topic to obtain a preliminary encoding partition sequence; and performing replication processing on each preliminary encoding partition of the preliminary encoding partition sequence under a preset number of replicas to obtain the encoding partition sequence.

[0031] Further, the step of sending the observation data collected by each base station in the base station identifier sequence to the corresponding coding partition of each base station under the base station identifier-coding partition sequence further includes: obtaining the partition working status of each coding partition in the coding partition sequence; confirming that there is a single node failure in the partition working status, then obtaining the fault partition sequence in the coding partition sequence where the partition working status is a single node failure; performing a switching step on each fault partition in the fault partition sequence to obtain several replacement codes, and obtaining a replacement code-coding partition sequence based on the several replacement codes; updating the base station identifier-coding partition sequence based on the replacement code-coding partition sequence; the switching step includes: obtaining the synchronization rate of each replica in the fault partition; and using the code of the replica corresponding to the maximum synchronization rate in the fault partition as the replacement code.

[0032] The above embodiment first divides the data under the Kafka transmission topic based on the total number of base stations, generating an initial coded partition sequence consistent with the number of base stations. This ensures that each base station has a unique coded partition, allowing the collected observation data to be transmitted to the corresponding coded partition, thus avoiding conflicts when transmitting different observation data. Building on this, this embodiment adds a replica to each initial coded partition with a preset number of replicas, forming a coded partition sequence containing at least one replica. Therefore, this embodiment ensures that each numbered partition has at least one replica, which serves as a redundant backup of the observation data stored in the coded partition. If subsequent corresponding observation data is corrupted, the redundantly backed-up observation data can be used for transmission, improving the reliability of data transmission.

[0033] Furthermore, the above embodiments obtain the partition working status of each coded partition in the coded partition sequence in real time. Once a single node failure is confirmed, the coded partition with the single node failure is quickly located, and the faulty partition sequence is obtained. Subsequently, this embodiment uses the code of the replica with the highest synchronization rate in the faulty partition as the replacement code corresponding to the faulty partition, and obtains the replacement code-coded partition sequence. This can ensure the consistency of the corresponding observation data after the switching step is performed, and effectively avoid data loss or out-of-order processing.

[0034] It should be noted that when a single node failure occurs in the working state of the encoded partition, such as a hardware failure or network interruption, the partition originally used for data read and write requests will be unable to continue processing read and write requests.

[0035] In one embodiment, each Kafka channel topic's coded partition can be configured with multiple replicas, which are distributed across different Kafka broker nodes. After a coded partition receives observation data, its corresponding replicas synchronize the observation data to maintain data consistency. Furthermore, when the preset number of replicas is greater than one, multiple replicas are created for each coded partition, and these replicas are distributed across different nodes.

[0036] In one embodiment, the deployed Kafka cluster consists of three nodes: A, B, and C. Each encoded partition of a Kafka channel topic is configured with two replicas. In this case, the partition for which data read / write requests are made—that is, the partition that stores baseline observation data by default when no single node failure occurs—is stored on node A, with one replica on node B and the other on node C. When a single node failure occurs in the partition for which data read / write requests are made, the In-Sync Replicas (ISRs) of the replicas stored on nodes B and C are retrieved, and the encoding of the replica with the highest data synchronization rate as reflected in the ISR is used as the replacement encoding.

[0037] It should be noted that when transmitting observation data stored in a coded partition with a single node failure, the corresponding copy of the replacement code will be located based on the replacement code-coded partition sequence and the base station identifier-coded partition sequence, and the observation data of the copy will be transmitted.

[0038] Further, the step of sending the observation data collected by each base station in the base station identifier sequence to the coding partition corresponding to each base station in the coding partition sequence under the base station identifier-coding partition sequence includes: performing lightweight compression on the observation data collected by each base station in the base station identifier sequence to obtain compressed observation data corresponding to each base station; and synchronously sending the compressed observation data corresponding to each base station to the coding partition corresponding to each base station in the coding partition sequence under the base station identifier-coding partition sequence.

[0039] In the above embodiments, before sending the observation data collected by each base station to the corresponding coded partition, the observation data collected by each base station is also lightly compressed, which can reduce the local area network bandwidth usage and thus improve the efficiency of subsequent data transmission.

[0040] In one embodiment, lightweight compression is performed using the Gzip algorithm.

[0041] Further, the process involves obtaining a base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, obtaining a coded partition sequence to be retrieved, and transmitting the observation data in the coded partition sequence to be retrieved. This includes: obtaining a base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, obtaining a coded partition sequence to be retrieved corresponding to the base station identifier sequence to be processed; and transmitting the observation data in the coded partition sequence to be retrieved.

[0042] In the above embodiments, after obtaining the base station identifier sequence to be processed, the corresponding code partition sequence to be pulled can be obtained based on the base station identifier-code partition sequence, and the corresponding code partition observation data can be transmitted. Compared with the traditional solution that requires a large amount of non-target base station observation data of all partitions to be transmitted to the client terminal, this embodiment can reduce the local area network bandwidth occupation and improve the data transmission efficiency.

[0043] In one embodiment, the observation data for which the coded partition sequence needs to be retrieved is transmitted to the client terminal, which then processes the observation data to generate the client terminal's positioning result.

[0044] Please see Figure 2 This embodiment also provides a base station data transmission system for implementing any of the base station data transmission methods described above, comprising: a base station counting module for acquiring a base station identifier sequence for a target area and obtaining a total number of base stations based on the base station identifier sequence; a base station encoding binding module for encoding binding based on the total number of base stations under a preset encoding rule to obtain an encoding-base station identifier sequence corresponding to the base station identifier sequence; a topic encoding partitioning module for configuration processing based on the total number of base stations under a preset Kafka transmission topic to obtain an encoding partitioning sequence; an encoding identifier mapping module for mapping based on the encoding-base station identifier sequence and the encoding partitioning sequence to obtain a base station identifier-encoding partitioning sequence; an observation data partitioning storage module for sending the observation data collected by each base station in the base station identifier sequence to the encoding partition corresponding to each base station in the encoding partitioning sequence under the base station identifier-encoding partitioning sequence; and an observation data transmission module for acquiring a base station identifier sequence to be processed, obtaining a code partitioning sequence to be pulled based on the base station identifier sequence to be processed and the base station identifier-encoding partitioning sequence, and transmitting the observation data of the code partitioning sequence to be pulled.

[0045] Further, the step of encoding binding based on the total number of base stations under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence includes: obtaining an encoding sequence based on the total number of base stations under a preset encoding step size; the number of encodings in the encoding sequence is consistent with the total number of base stations; and performing encoding binding processing based on the encoding sequence and the base station identifier sequence to obtain the encoding-base station identifier sequence.

[0046] Further, the step of configuring and processing under a preset Kafka transmission topic based on the total number of base stations to obtain the encoding partition sequence includes: performing partitioning processing under a preset Kafka transmission topic based on the total number of base stations to obtain a preliminary encoding partition sequence; and performing replication processing on each preliminary encoding partition of the preliminary encoding partition sequence under a preset number of replicas to obtain an encoding partition sequence.

[0047] Further, the step of sending the observation data collected by each base station in the base station identifier sequence to the corresponding coding partition of each base station under the base station identifier-coding partition sequence further includes: obtaining the partition working status of each coding partition in the coding partition sequence; confirming that there is a single node failure in the partition working status, then obtaining the fault partition sequence in the coding partition sequence where the partition working status is a single node failure; performing a switching step on each fault partition in the fault partition sequence to obtain several replacement codes, and obtaining a replacement code-coding partition sequence based on the several replacement codes; updating the base station identifier-coding partition sequence based on the replacement code-coding partition sequence; the switching step includes: obtaining the synchronization rate of each replica in the fault partition; and using the code of the replica corresponding to the maximum synchronization rate in the fault partition as the replacement code.

[0048] In the above embodiments, a unique code is assigned to each base station under preset coding rules, forming a code-base station identifier sequence. Furthermore, a number of coding partitions, equal to the total number of base stations, are created under the Kafka transmission topic, forming a coding partition sequence. Subsequently, this embodiment establishes a mapping relationship between the base station identifier sequence and the coding partition sequence, ensuring that the observation data collected by each base station can be accurately sent to the corresponding coding partition. Therefore, after obtaining the base station identifier sequence to be processed by the client terminal, this embodiment can directly locate the observation data stored in the corresponding coding partition of the base station to be processed and directly transmit the required observation data, without needing to transmit a large amount of non-target base station observation data, greatly reducing local area network bandwidth usage and improving data transmission efficiency.

[0049] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications are also considered to be within the scope of protection of the present invention.

Claims

1. A method for transmitting data from a base station, characterized in that, Includes the following steps: Obtain the base station identifier sequence for the target area, and based on the base station identifier sequence, obtain the total number of base stations; Based on the total number of base stations, encoding binding is performed under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence; Based on the total number of base stations, configuration processing is performed under a preset Kafka transmission topic to obtain an encoded partition sequence; Based on the mapping between the encoding-base station identifier sequence and the encoding partition sequence, the base station identifier-encoding partition sequence is obtained; The observation data collected by each base station in the base station identifier sequence are sent to the corresponding coding partition of each base station under the base station identifier-coding partition sequence. Obtain the base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, obtain the coded partition sequence to be pulled, and transmit the observation data of the coded partition sequence to be pulled.

2. The base station data transmission method as described in claim 1, characterized in that, The step of encoding and binding based on the total number of base stations under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence includes: Based on the total number of base stations, an encoding sequence is obtained under a preset encoding step size; the number of codes in the encoding sequence is consistent with the total number of base stations. Based on the encoded sequence and the base station identifier sequence, an encoding binding process is performed to obtain the encoded-base station identifier sequence.

3. The base station data transmission method as described in claim 2, characterized in that, Based on the total number of base stations, configuration processing is performed under a preset Kafka transmission topic to obtain an encoded partition sequence, including: Based on the total number of base stations, the system is divided under a preset Kafka transmission topic to obtain a preliminary encoded partition sequence. Based on each preliminary coding partition of the preliminary coding partition sequence, a copy addition process is performed at a preset number of copies to obtain the coding partition sequence.

4. The base station data transmission method as described in claim 3, characterized in that, The step of sending the observation data collected by each base station in the base station identifier sequence to the corresponding coding partition of each base station in the coding partition sequence under the base station identifier-coding partition sequence further includes: Obtain the partitioning status of each coded partition in the coded partitioning sequence; If it is confirmed that there is a single node failure in the working state of the partition, then obtain the fault partition sequence in the encoded partition sequence whose working state is a single node failure; For each fault partition in the fault partition sequence, a switching step is performed to obtain several replacement codes, and based on the several replacement codes, a replacement code-code partition sequence is obtained; Based on the replacement encoding-encoding partition sequence, update the base station identifier-encoding partition sequence; The switching steps include: Obtain the synchronization rate of each replica in the faulty partition; The encoding of the replica corresponding to the highest synchronization rate in the faulty partition is used as the replacement encoding.

5. The base station data transmission method as described in claim 1, characterized in that, The step of sending the observation data collected by each base station in the base station identifier sequence to the corresponding coding partition of each base station under the base station identifier-coding partition sequence includes: Based on the observation data collected by each base station in the base station identifier sequence, lightweight compression is performed to obtain the compressed observation data corresponding to each base station. The compressed observation data corresponding to each base station will be synchronously sent to the corresponding coding partition of each base station under the base station identifier-coding partition sequence.

6. The base station data transmission method as described in claim 1, characterized in that, Obtain the base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, obtain the coded partition sequence to be retrieved, and transmit the observation data of the coded partition sequence to be retrieved, including: Obtain the base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-encoded partition sequence, obtain the coded partition sequence to be retrieved corresponding to the base station identifier sequence to be processed; The observation data in the required coded partition sequence is transmitted.

7. A base station data transmission system, characterized in that, A method for implementing a base station data transmission method as described in any one of claims 1 to 6, comprising: The base station counting module is used to obtain the base station identification sequence of the target area and, based on the base station identification sequence, obtain the total number of base stations; The base station encoding binding module is used to perform encoding binding based on the total number of base stations under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence; The topic encoding partitioning module is used to perform configuration processing based on the total number of base stations and under a preset Kafka transmission topic to obtain an encoding partitioning sequence. The encoding identifier mapping module is used to map the encoding-base station identifier sequence and the encoding partition sequence to obtain the base station identifier-encoding partition sequence. The observation data partition storage module is used to send the observation data collected by each base station in the base station identifier sequence to the corresponding coding partition of each base station under the base station identifier-coding partition sequence; The observation data transmission module is used to acquire the base station identifier sequence to be processed, and based on the base station identifier sequence to be processed and the base station identifier-coded partition sequence, to obtain the coded partition sequence to be pulled, and to transmit the observation data of the coded partition sequence to be pulled.

8. A base station data transmission system as described in claim 7, characterized in that, The step of encoding and binding based on the total number of base stations under a preset encoding rule to obtain the encoding-base station identifier sequence corresponding to the base station identifier sequence includes: Based on the total number of base stations, an encoding sequence is obtained under a preset encoding step size; the number of codes in the encoding sequence is consistent with the total number of base stations. Based on the encoded sequence and the base station identifier sequence, an encoding binding process is performed to obtain the encoded-base station identifier sequence.

9. A base station data transmission system as described in claim 8, characterized in that, Based on the total number of base stations, configuration processing is performed under a preset Kafka transmission topic to obtain an encoded partition sequence, including: Based on the total number of base stations, the system is divided under a preset Kafka transmission topic to obtain a preliminary encoded partition sequence. Based on each preliminary coding partition of the preliminary coding partition sequence, additional copies are added at a preset number of copies to obtain the coding partition sequence.

10. A base station data transmission system as described in claim 9, characterized in that, The step of sending the observation data collected by each base station in the base station identifier sequence to the corresponding coding partition of each base station in the coding partition sequence under the base station identifier-coding partition sequence further includes: Obtain the partitioning status of each coded partition in the coded partitioning sequence; If it is confirmed that there is a single node failure in the working state of the partition, then obtain the fault partition sequence in the encoded partition sequence whose working state is a single node failure; For each fault partition in the fault partition sequence, a switching step is performed to obtain several replacement codes, and based on the several replacement codes, a replacement code-code partition sequence is obtained; Based on the replacement encoding-encoding partition sequence, update the base station identifier-encoding partition sequence; The switching steps include: Obtain the synchronization rate of each replica in the faulty partition; The encoding of the replica corresponding to the highest synchronization rate in the faulty partition is used as the replacement encoding.

Images