Method for Streaming Data Parsing, Parallel Acquisition and Storage in Wireless Communication System

Abstract

The present invention discloses a method for data streaming parsing, parallel acquisition and storage in a wireless communication system, which is applicable to a wireless communication network entity with software and hardware decoupling; by controlling the parallel operation of the control information parsing functional unit and the data acquisition functional unit, as well as the parallel operation of the payload data processing functional unit and the data acquisition functional unit, the dual objectives of synchronously executing data processing and acquisition are achieved; according to the time consumed by control information parsing, payload data processing and data acquisition in different layers of the wireless communication network, dynamic resource scheduling is performed on the control information parsing functional unit, the payload data processing functional unit and the data acquisition functional unit; according to the source of data, the collected data is stored in different databases to construct a hierarchical data storage system. The present invention effectively solves the problem that streaming acquisition cannot be achieved in a wireless communication system, and improves the efficiency and applicability of data acquisition and storage.

Description

Technical Field

[0001] The present invention relates to the technical field of mobile communication data acquisition and storage, and particularly relates to a method for data streaming parsing, parallel acquisition and storage in a wireless communication system. Background Art

[0002] Traditional wireless communication networks are composed of dedicated hardware devices, such as base stations, routers, switches, and terminal devices, etc. These devices undertake core functions such as signal transmission, data processing, and resource management. However, these devices face problems such as high replacement costs, inefficient device update cycles, and high human maintenance costs. With the rapid development of mobile communication technologies, the continuous improvement of computer computing power, and the continuous evolution of network architectures, traditional wireless communication network devices are gradually shifting towards advanced technologies such as software-defined networking (SDN) and network function virtualization (NFV), and turning to virtualized and software-based methods running on general-purpose computer devices. The softwareization and virtualization of hardware can not only effectively reduce costs such as hardware updates and human maintenance, but also significantly improve update efficiency and system flexibility. At the same time, this transformation brings convenience to the acquisition and storage of wireless communication network data and provides a basic condition for realizing intelligence. The traditional data acquisition process is achieved through two sets of mechanisms. That is, after the terminal device, base station, or core network element receives the corresponding communication data, their respective operating hardware systems will parse the received data layer by layer (physical layer, data link control layer, core network, network layer, etc.). At the same time, it is also necessary to capture these wireless communication data, and then realize data acquisition through packet parsing. Although this approach can achieve data acquisition, it cannot achieve real-time data acquisition of wireless communication networks. In addition, repeated parsing will not only cause a large amount of resource waste, but also face cost and flexibility issues.

[0003] At the same time, for the problem of data acquisition and storage, the existing data storage methods for mobile communication data do not store data in separate databases according to the source of the acquired data, which is not convenient for model training and application. Therefore, studying how to store these data in separate databases to better support research and application is an important issue. Summary of the Invention

[0004] Object of the Invention: The object of the present invention is to propose a method for data streaming parsing, parallel acquisition and storage in a wireless communication system, which has the advantages of streaming data acquisition and parsing, dynamic resource scheduling, and storing the acquired data in separate databases according to different sources and types of data, so as to solve the problem that traditional data acquisition needs to use two sets of mechanisms for data acquisition and cannot achieve real-time data acquisition, and to realize a hierarchical data storage system with dynamic resource scheduling and convenient model training and application.

[0005] Technical solution: In view of the deficiencies of the prior art, the present invention adopts the following technical solutions:

[0006] In a first aspect, the present invention provides a method for data streaming parsing, parallel acquisition and storage in a wireless communication system, including the following steps:

[0007] A wireless communication network entity receives wireless communication network digital domain signal data;

[0008] The wireless communication network entity performs layer-by-layer processing and parallel storage on the digital domain signal data. For each layer of processing, timing is performed by a timer, and the data in the header part and the payload part of the digital domain signal data are respectively transmitted to the control information parsing functional unit and the payload data processing functional unit. While performing control information parsing and payload data processing on the header part and the payload part, the control information parsed from the digital domain signal data in the header part, as well as the environmental parameter information, control information at different levels, and service data statistical information generated during the payload data processing, are collected in parallel and stored in the basic database;

[0009] The wireless communication network entity performs dynamic resource scheduling on the control information parsing functional unit, the payload data processing functional unit, and the data acquisition functional unit by monitoring the time consumed for control information parsing, payload data processing, and data acquisition at each layer of the protocol stack, so that the data generated after each layer of processing is timely stored in the basic database.

[0010] Preferably, the timer has a switch function and can control the transfer of the digital domain signal data stream to the control information parsing functional unit or the payload data processing functional unit according to the time lengths of the header parts at different levels specified by the protocol.

[0011] Preferably, the dynamic resource scheduling strategy of the data acquisition functional unit includes the dynamic resource scheduling strategy of the control information parsing functional unit and the data acquisition functional unit, specifically including:

[0012] When the digital domain signal data of the first header part enters the control information parsing functional unit, the parsing time of this part of the data by the control information parsing functional unit is t1, the time for transferring the control information data to the data acquisition functional unit after processing is t2, and the data acquisition time is t3; when the digital domain signal data of the second header part enters the control information parsing functional unit, the parsing time of this part of the data by the control information parsing functional unit is t1', the time for transferring the control information data to the data acquisition functional unit after processing is t2', and the data acquisition time is t3'; if t2 + t3 ≤ t1' + t2', then there is no need to increase the resources of the data acquisition functional unit, otherwise the resources of the data acquisition functional unit are dynamically increased;

[0013] Preferably, the dynamic resource scheduling strategy of the data acquisition functional unit includes the dynamic resource scheduling strategy of the payload data processing functional unit and the data acquisition functional unit, specifically including:

[0014] When the digital domain signal data of the first segment of the payload part enters the payload data processing functional unit, the processing time of this part of the data by the payload data processing functional unit is tp1, the time to transfer the data to the data acquisition functional unit after processing is tp2, and the data acquisition time is tp3; when the digital domain signal data of the second segment of the payload part enters the payload data processing functional unit, the processing time of this part of the data by the payload data processing functional unit is tp1', the time to transfer the data to the data acquisition functional unit after processing is tp2', and the data acquisition time is tp3'; if tp2 + tp3 > tp1' + tp2', then dynamically increase the resources of the data acquisition functional unit, otherwise there is no need to increase the resources of the data acquisition functional unit.

[0015] Preferably, the wireless communication network entity stores the received wireless communication network digital domain signal data into the original database; the wireless communication network entity also stores the status parameter data of the operation and maintenance management platform and the operating system into the status parameter database.

[0016] In a second aspect, the present invention provides a wireless communication network entity for realizing data streaming parsing, parallel acquisition and storage, including a timer, a control information parsing functional unit, a data payload processing functional unit, a data acquisition functional unit for layer-by-layer processing and parallel storage of the received wireless communication network digital domain signal data, and a dynamic resource scheduling module;

[0017] The timer is used to transmit the data in the frame header part and the payload part in the digital domain signal data to the control information parsing functional unit and the payload data processing functional unit respectively through timing;

[0018] The control information parsing functional unit runs in parallel with the data acquisition functional unit, and during the process of parsing the control information from the digital domain signal data in the frame header part, transmits the control information data to the payload data processing functional unit and the data acquisition functional unit in parallel;

[0019] The payload data processing functional unit runs in parallel with the data acquisition functional unit, and during the process of parsing and processing the digital domain signal data in the payload part according to the control information, transmits the environmental parameter information, control information at different levels, and service data statistical information generated during the processing to the data acquisition functional unit running in parallel;

[0020] The data acquisition functional unit is used to store the control information data parsed by the control information parsing functional unit into the basic database in real time, and store the environmental parameter information, control information at different levels, and business data statistical information generated during the payload data processing process into the basic database in real time;

[0021] The storage module is used to store the received wireless communication network digital domain signal data into the original database;

[0022] The dynamic resource scheduling module is used to monitor the time consumed by the control information parsing, payload data processing, and data acquisition of each layer of the protocol stack, and perform dynamic resource scheduling on the control information parsing functional unit, payload data processing functional unit, and data acquisition functional unit, so that the data generated after each layer is processed is stored into the basic database in time.

[0023] Preferably, the wireless communication network entity further includes a storage module for storing the received wireless communication network digital domain signal data into the original database; a status parameter data acquisition module for storing the status parameter data of the operation and maintenance management platform and the operating system into the status parameter database.

[0024] Preferably, the wireless communication network entity is a software-defined network and network function virtualization-based software and hardware decoupled wireless communication network entity, including each network element in the terminal device, base station, or core network.

[0025] In a third aspect, the present invention provides a wireless communication network data streaming acquisition and storage system, including an access network data acquisition and storage module and a core network data acquisition and storage module;

[0026] The access network data acquisition and storage module is used to acquire and store the original data and basic data of the wireless access network; the wireless access network includes a terminal device and a base station, and the acquisition methods of the original data and basic data of the terminal device and the base station adopt the data streaming parsing, parallel acquisition and storage method in the wireless communication system to acquire the originally received wireless communication network digital domain signal data, as well as the basic data from the physical layer to the application layer;

[0027] The core network data acquisition and storage module is used to acquire and store the core network basic data, and each network element in the core network adopts the data streaming parsing, parallel acquisition and storage method in the wireless communication system to acquire the basic data from the network layer to the application layer.

[0028] Preferably, the storage system includes an original database, a basic database, and a status parameter database;

[0029] The original database is used to store the digital domain signal data of the wireless communication network that has not been processed by the physical layer control information parsing functional unit and the payload data processing functional unit;

[0030] The basic database is used to store the control information parsed from the digital domain signal data in the frame header part, as well as the environmental parameter information, control information at different levels, and service data statistical information generated during the parsing of the digital domain signal data in the payload part according to the control information during the payload data processing;

[0031] The status parameter database is used to store the status parameter data of the operation and maintenance management software and the operating system.

[0032] Advantageous effects: Compared with the prior art, the advantages of the present invention are as follows:

[0033] 1) In the present invention, the control information parsing functional unit in the wireless communication network entity parses the digital domain signal data in the frame header part, and further processes the digital domain signal data in the payload part according to the parsed control information. At the same time, the parallel data acquisition functional unit is started to collect in real time the control information generated during the control information parsing process, as well as the environmental parameter information, control information at different levels, and service data statistical information generated during the payload data processing. This method realizes the real-time acquisition of data, avoiding the cumbersome process of the traditional data acquisition method that needs to first capture data packets and then parse and store them. The traditional wireless communication network data acquisition method not only requires the network to perform a parsing process on the communication data once, but also requires additional data parsing and acquisition after packet capture. This approach not only lacks real-time performance but also consumes additional computing resources. Through the method of the present invention, the real-time performance of data acquisition can be effectively improved, and additional resource consumption can be reduced.

[0034] 2) The present invention proposes a dynamic resource adjustment strategy. According to the time consumed by the control information parsing functional unit, the payload data processing functional unit, and the data acquisition functional unit in different layers of the wireless communication network, dynamic resource scheduling is performed on the control information parsing functional unit, the payload data processing functional unit, and the data acquisition functional unit, which can solve the problem of the mismatch between the data acquisition speed and the speeds of control information parsing and payload data processing.

[0035] 3) The present invention stores the collected data in different databases according to the data source, and proposes a data storage system composed of an original database, a basic database, and a status parameter database, so as to implement a hierarchical data storage system that is convenient for model training and application. Description of the Drawings

[0036] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for the embodiments of the present invention will be briefly introduced below.

[0037] Figure 1 It is a flowchart of the method for data streaming parsing, parallel acquisition and storage in a wireless communication system.

[0038] Figure 2 It is an architecture diagram of the method for data streaming parsing, parallel acquisition and storage in a wireless communication system.

[0039] Figure 3 It is a schematic diagram of data streaming parsing and parallel acquisition in a wireless communication system.

[0040] Figure 4 It is a schematic diagram of data acquisition in a wireless communication network. Specific Embodiments

[0041] The technical solutions of the present invention will be clearly and completely described below. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0042] Embodiment 1

[0043] Please refer to Figure 1 , the method for data streaming parsing, parallel acquisition and storage in the wireless communication system disclosed in the embodiments of the present invention mainly includes:

[0044] Step 101: The wireless communication network entity receives the digital domain signal data of the wireless communication network.

[0045] In this embodiment, the wireless communication network entity is implemented by wireless communication software, including the implementation of terminal functions, base station functions and core network functions. The digital domain signal data of the wireless communication network is the digital domain signal data converted from analog signal data by an analog-to-digital converter (ADC), and consists of digital domain signal data of the header part and payload part at different levels. A device with general computing capabilities is equipped with a wireless communication network data interface and supports the operation of the operating system and dynamic resource scheduling. That is, the device with general computing capabilities receives the digital domain signal data of the wireless communication network through the data interface, and the operating system runs on the device with general computing capabilities.

[0046] Step 102: The wireless communication network entity stores the received digital domain signal data of the wireless communication network into the original database, and performs layer-by-layer processing and parallel storage on the digital domain signal data.

[0047] In this embodiment, the wireless communication network entity simultaneously activates the control information parsing functional unit, the payload data processing functional unit, and the data acquisition functional unit through a message passing mechanism or an event triggering mechanism. The received wireless communication network digital domain signal data is stored in the original database, and through timer timing, the data in the header part and the payload part of the digital domain signal data are respectively transmitted to the control information parsing functional unit and the payload data processing functional unit. Subsequently, the digital domain signal data is processed layer by layer (physical layer, data link control layer, core network, network layer, etc.).

[0048] The wireless network entity triggers the data storage module to store the wireless communication network digital domain signal data in the original database through a message passing mechanism or an event triggering mechanism. The original database stores the wireless communication network digital domain signal data without physical layer control information parsing and payload data processing. The timer has a switch function and can control the transfer of the digital domain signal data stream to the control information acquisition or payload data processing functional unit according to the time lengths of the header parts at different layers specified by the protocol.

[0049] The resources of the general computing hardware with computing capabilities are determined by the operating system scheduling mechanism, software design, and the parallelism of the task itself. The operating system has the ability to manage the general computing hardware with computing capabilities, thread scheduling, resource management, and the ability to provide a running environment for software.

[0050] Specifically, the wireless communication network entity includes a control information parsing functional unit, a payload data processing functional unit, and a data acquisition functional unit for the physical layer, data link control layer, radio frequency resource control layer, core network, network layer, transport layer, and application layer. The control information parsing functional unit can transfer the control information data generated during the parsing of the digital domain signal data in the header part to the data acquisition functional unit for acquisition. The payload data processing functional unit can transfer the environmental parameter information, control information at different levels, service data statistical information, etc. generated during the processing of the digital domain signal data in the payload part to the data acquisition functional unit for acquisition.

[0051] After the control information parsing functional unit obtains the control information by parsing the digital domain signal data in the header part, it will be passed to the payload data processing functional unit and simultaneously to the data acquisition functional unit;

[0052] The wireless communication network digital domain signal data consists of two parts: the digital domain signal data in the header part at different levels and the digital domain signal data in the payload part.

[0053] The data acquisition functional unit will collect the control information data generated during the control information parsing process in parallel and store the control information data in the basic database;

[0054] The basic database stores the control information data parsed from the control information, as well as the environmental parameter information, control information at different levels, business data statistical information, etc. generated by the load data processing functional unit during the processing process.

[0055] The load data processing functional unit processes the digital domain signal data of the load part according to the control information, and transmits the environmental parameter information, control information at different levels, business data statistical information, etc. generated during the processing process to the data acquisition functional unit;

[0056] The data acquisition functional unit concurrently acquires the environmental parameter information, control information at different levels, business data statistical information, etc. generated during the data load processing process, and stores this information data in the basic database;

[0057] The load data processing functional unit transmits the processed environmental parameter information, control information, and digital domain signal data of the load part to the next-level data processing part for reading and parsing until the application layer data stream is processed.

[0058] Step 103: The wireless communication network entity dynamically schedules resources for the control information parsing functional unit, load data processing functional unit, and data acquisition functional unit by monitoring the time consumed by the control information parsing, load data processing, and data acquisition of each layer of the protocol stack, so that the data generated after each layer is processed is timely stored in the basic database.

[0059] In this embodiment, the data acquisition functional unit can dynamically adjust the system resources and change the acquisition speed of the data acquisition functional unit by adjusting the system resources. In this way, the environmental parameter information, control information at different levels, business data statistical information, etc. generated during the control information parsing and load data processing process are stored in the basic database in real time through the concurrently operating data acquisition functional unit. This avoids the problem of untimely data acquisition caused by the speed matching problem between the data stream processing functional unit and the data acquisition functional unit.

[0060] Embodiment 2

[0061] Please refer to Figure 2, the wireless communication network entity for realizing data streaming analysis, parallel acquisition and storage in a wireless communication system disclosed in the embodiments of the present invention includes: general computing hardware with computing capabilities, an operating system, an operation and maintenance management platform (OAM), and wireless communication software. The general computing hardware with computing capabilities runs an operating system, and supports the operating system to perform resource scheduling according to requirements. The operating system supports the operation of the OAM software and has the capabilities of thread scheduling, resource management, and providing support for software operation. Specifically, the operating system can dynamically allocate processor core resources according to the resource requirements during software operation, so as to meet the performance requirements of software operation. The wireless communication software runs in the environment provided by the OAM. The OAM software has the capabilities of operation, maintenance, and management. The wireless communication software provides support for the implementation of users, base stations, and core networks. The parsing and acquisition storage of data in users, base stations, and core networks that can be realized through the wireless communication software can parse the digital domain signal data of the wireless communication network from the physical layer to the application layer. Specifically, the wireless communication software is provided with a timer, a control information parsing functional unit, a data payload processing functional unit, and a data acquisition functional unit for layer-by-layer processing and parallel storage of the received digital domain signal data of the wireless communication network.

[0062] The timer transmits the data in the frame header part and the payload part in the digital domain signal data to the control information parsing functional unit and the payload data processing functional unit respectively through timing and switches; the control information parsing functional unit and the data acquisition functional unit run in parallel, and during the process of the control information parsing functional unit parsing the control information from the digital domain signal data in the frame header part, the control information data is transmitted to the payload data processing functional unit and the data acquisition functional unit in parallel. Then, the control information data parsed by the control information parsing functional unit is stored in the basic database in real time through the data acquisition functional unit. The payload data processing functional unit and the data acquisition functional unit run in parallel, and during the process of the payload data processing functional unit parsing and processing the digital domain signal data in the payload part according to the control information, the environmental parameter information, control information at different levels, service data statistical information, etc. generated during the processing process are transmitted to the data acquisition functional unit running in parallel. Then, the environmental parameter information, control information at different levels, service data statistical information, etc. generated during the payload data processing process are stored in the basic database in real time through the data acquisition functional unit; the acquisition speed of the data acquisition functional unit can change dynamically according to the system resource situation of the data acquisition functional unit. Each layer of data stream processing functional unit receives the digital domain signal data from the wireless communication network entity or the digital domain signal data processed by the upper layer data stream processing functional unit.

[0063] The wireless network entity triggers the data storage module to store the digital domain signal data of the wireless communication network into the original database through a message passing mechanism or an event triggering mechanism. The wireless network entity also sets up a dynamic resource scheduling module, which is used to monitor the time consumed by the control information parsing, payload data processing, and data acquisition at each layer of the protocol stack, and perform dynamic resource scheduling on the control information parsing functional unit, payload data processing functional unit, and data acquisition functional unit, so that the data generated after each layer is processed is stored in the basic database in a timely manner. All the above collected data is stored in the data storage system, which consists of an original database, a basic database, and a status parameter database.

[0064] The original database stores the digital domain signal data of the wireless communication network, which is collected in real time by the data storage module of the terminal or the base station entity.

[0065] The data in the basic database is collected in real time by the data acquisition functional unit from the process of control information parsing and payload data processing. Specifically, the control information parsing functional unit generates control information when parsing the digital domain signal data in the frame header part, and the payload data processing functional unit generates environmental parameter information, control information at different levels, service data statistical information, etc. when processing the digital domain signal data in the payload part. These information data will be collected in real time by the data acquisition functional unit running in parallel into the basic database.

[0066] The status parameter database is the data obtained by the status parameter data acquisition module through real-time monitoring of the operating status and resource consumption of OAM and the operating system, and the data is stored in the status parameter database.

[0067] Embodiment 3

[0068] The embodiment of the present invention discloses a dynamic resource scheduling strategy in the data streaming parsing, parallel acquisition, and storage method in a wireless communication system.

[0069] Exemplarily, such as Figure 3As shown in (a), when the digital domain signal data of the first - stage frame header part enters the control information parsing functional unit, the parsing time of this part of the data by the control information parsing functional unit is t1, the time to transfer the control information data to the data acquisition functional unit after processing is t2, and the data acquisition time is t3. When the digital domain signal data of the second - stage frame header part enters the control information parsing functional unit, the parsing time of this part of the data by the control information parsing functional unit is t1', the time to transfer the control information data to the data acquisition functional unit after processing is t2', and the data acquisition time is t3'. At this time, if t2 + t3 ≤ t1' + t2', it means that when the data is transferred to the data acquisition functional unit after the second - stage control information is parsed, the data acquisition functional unit has already completed processing the control information data transferred from the first - stage and has been acquired. At this time, there is no need to increase the resources of the data acquisition functional unit. Otherwise, it means that the data of the data acquisition functional unit has not been acquired completely, and the control information data parsed from the digital domain signal data of the second - stage frame header part has been transferred to the data acquisition functional unit. At this time, the system needs to dynamically increase the resources of the data acquisition functional unit, thereby increasing the processing efficiency of the data acquisition functional unit.

[0070] Similarly, as Figure 3 shown in (b), when the digital domain signal data of the first - stage payload part enters the payload data processing functional unit, the processing time of this part of the data by the payload data processing functional unit is tp1, the time to transfer data such as environmental parameter information, control information at different levels, and service data statistical information to the data acquisition functional unit after processing is tp2, and the data acquisition time is tp3. When the digital domain signal data of the second - stage payload part enters the payload data processing functional unit, the processing time of this part of the data by the payload data processing functional unit is tp1', the time to transfer data such as environmental parameter information, control information at different levels, and service data statistical information to the data acquisition functional unit after processing is tp2', and the data acquisition time is tp3'. At this time, if tp2 + tp3 > tp1' + tp2', it means that when the data is transferred to the data acquisition functional unit after the second - stage control information is parsed, the data acquisition functional unit has not yet acquired all the environmental parameter information, control information at different levels, and service data statistical information transferred from the first - stage. At this time, the system needs to dynamically increase the resources of the data acquisition functional unit, thereby increasing the processing efficiency of the data acquisition functional unit. Otherwise, it means that the data of the data acquisition functional unit has been acquired completely, and the environmental parameter information, control information at different levels, and service data statistical information obtained from the payload processing of the second - stage data can be directly transferred to the data acquisition functional unit for acquisition.

[0071] Embodiment 4

[0072] The wireless communication network data streaming acquisition and storage system disclosed in the embodiments of the present invention includes an access network data acquisition and storage module and a core network data acquisition and storage module. The access network data acquisition and storage module is used to acquire and store the raw data and basic data of the wireless access network; the wireless access network includes terminal devices and base stations, and the acquisition methods of the raw data and basic data of the terminal devices and base stations adopt the data streaming parsing, parallel acquisition and storage method in the wireless communication system described in Embodiment 1 to acquire the raw received wireless communication network digital domain signal data, as well as the basic data from the physical layer to the application layer. The core network data acquisition and storage module is used to acquire and store the core network basic data, and each network element in the core network adopts the data streaming parsing, parallel acquisition and storage method in the wireless communication system described in Embodiment 1 to acquire the basic data from the network layer to the application layer.

[0073] The following uses a specific simulation example to elaborate in detail on the system implementation steps of the embodiments of the present invention. Specifically, the data acquisition and storage process of the wireless communication network data streaming acquisition and storage system described in the embodiments of the present invention includes:

[0074] Step 201: Acquire and store the raw data and basic data of the wireless access network.

[0075] Exemplarily, as Figure 4 shown, the wireless access network consists of terminal devices and base stations, and the acquisition methods of the raw data and basic data of the terminals and base stations are the same.

[0076] In this embodiment, the terminal device and the base station are composed of a computer with the operating system Ubuntu20.04, a USRPb210 radio peripheral, wireless communication software, and a database. The computer with the operating system Ubuntu20.04 and the USRPb210 provide the operating environment for the devices and software with general computing capabilities of the terminal device. OpenAirInterface runs in the operating system to realize the softwareization of the terminal and the base station.

[0077] Specifically, in the wireless access network, the terminal and the base station continuously send the uplink wireless communication network digital domain signal data and receive the downlink wireless communication network digital domain signal data through the air interface, and initialize the received wireless communication network digital domain signal data into the terminal and the base station entities.

[0078] At this time, the terminal or the base station stores the received wireless communication network digital domain signal data in the raw database and simultaneously transmits it to the timer. The timer will transmit the digital domain signal data of the frame header part received according to the time lengths of the frame header parts at different layers specified by the protocol to the control information parsing functional unit, and then transmit the payload part of the data to the payload data processing functional unit through the switch after transmitting the digital domain signal data of the frame header part.

[0079] The control information parsing functional unit parses the digital domain signal data in the digital domain signal frame header part of the received wireless communication network signal to obtain the control information data required for the execution of the payload data processing process. Such as: resource allocation information, modulation and coding information, cyclic redundancy check (CRC) check information, demodulation reference signal (DM-RS) position, and packet identifier, etc.

[0080] The data acquisition functional unit runs in parallel with the control information parsing functional unit, and stores the control information data generated during the control information parsing process into the basic database.

[0081] After the payload data processing functional unit receives the digital domain signal data in the payload part, it executes the payload data processing process according to the control information obtained by parsing the digital domain signal data in the frame header part. During this process, environmental parameter information, control information at different levels, and service data statistical information, etc., will be generated in real time, including demodulated symbol data, soft information, channel estimation results, de-scheduled data, and equalized data.

[0082] The data acquisition functional unit runs in parallel with the payload data processing functional unit, and stores the control information data generated during the payload data processing process into the basic database.

[0083] After the physical layer data stream processing is completed, the processed environmental parameter information, control information, and digital domain signal data in the payload part will be passed to the data processing part of the next layer. The data stream processing part of the data link control layer will read the data passed from the data stream processing part of the previous layer, and parse and process these data according to the rules of the data link control layer. And so on, layer by layer (physical layer, data link control layer, core network, network layer, etc.) until the application layer is parsed and the data is stored in the basic database.

[0084] Step 202: Collect and store core network basic data.

[0085] Exemplarily, as Figure 4 shown, the core network is composed of a computer with an operating system of Ubuntu 20.04, Kubernetes, Docker, Open5gs and other software. The computer with an operating system of Ubuntu 20.04, Kubernetes and Docker, etc. provide a general computing ability and a running environment for software for terminal devices. Open5gs runs in the container environment provided by Kubernetes and Docker to implement the functions of the core network. Each network element of the core network runs in a container, and the containers interact through a service-based interface (SBI).

[0086] Specifically, the consumer network element initiates a request to the producer network element in the core network through SBI. The producer network element receives the requested data through the virtual network interface, and sends the digital domain signal data of the frame header part and the digital domain signal data of the payload part to the control information parsing functional unit and the payload data processing functional unit respectively through the timer in the wireless communication network entity.

[0087] The message transmission mechanism or event triggering mechanism in the wireless communication network entity triggers the control information parsing functional unit, the payload data processing functional unit and the data collection functional unit at the same time. The control information parsing functional unit of the network layer will parse the digital domain signal data of the received network layer frame header part to obtain the control information data required to execute the payload data processing process. Such as: source IP address, destination IP address, protocol field, identification, fragment offset and flag field, etc. And pass these data to the network layer data collection functional unit while parsing and processing.

[0088] The network layer data acquisition functional unit and the network layer control information analysis functional unit run in parallel. Control information will be gradually generated during the control information analysis process, and the parallel running data acquisition functional unit will store these gradually generated control information data in real time into the basic database.

[0089] The network layer payload data processing functional unit performs payload data processing according to the control information obtained by parsing the digital domain signal data of the frame header, which will generate some environmental parameter information, control information of different levels, business data statistics, etc., such as: extracted transport layer data segments, discarded error data, checksum verification results, and forwarding or transmission statistics. While processing, these information data are passed to the network layer data collection functional unit. Finally, the network layer data collection functional unit running in parallel stores these information data in the basic database.

[0090] The network layer data collection function unit runs in parallel with the network layer load processing. During the load processing, environmental parameter information, control information at different levels, and business data statistics will be gradually generated. The parallel running data collection function unit will store these gradually generated environmental parameter information, control information at different levels, and business data statistics in real time into the basic database.

[0091] After the payload data processing is completed, the processed environmental parameter information, control information, and digital domain signal data of the payload part will be passed to the data processing part of the next layer. The data processing part of the transport layer reads the data passed from the previous layer and parses and processes the data according to the protocol of the transport layer. And so on, parse layer by layer (network layer, transport layer, application layer, etc.) to the application layer and store the data in the basic database.

[0092] After processing and storing the application layer data, the data is transmitted to the producer network element through the SBI interface, and the producer network element responds to the service requested by the consumer according to the request information.

[0093] The preferred specific embodiments of the present invention have been described in detail above. It should be understood that those of ordinary skill in the art can make many modifications and variations based on the concept of the present invention without creative efforts. Therefore, all technical solutions that can be obtained by those skilled in the art in the technical field based on the concept of the present invention through logical analysis, reasoning, or limited experiments on the basis of the prior art should fall within the protection scope determined by the claims.

Claims

1. A method for data stream parsing, parallel acquisition and storage in a wireless communication system, characterized in that, The steps are as follows: A wireless communication network entity receives digital domain signal data of the wireless communication network; The wireless communication network entity performs layer-by-layer processing and parallel storage on the digital domain signal data. For each layer of processing, timing is carried out by a timer. The data of the header part and the payload part in the digital domain signal data are respectively transmitted to the control information parsing functional unit and the payload data processing functional unit. While parsing the control information of the header part and processing the payload data, the control information parsed from the digital domain signal data of the header part, as well as the environmental parameter information, control information at different levels, and service data statistical information generated during the payload data processing, are collected in parallel and stored in the basic database; the timer has a switch function and can control the transfer of the digital domain signal data stream to the control information parsing functional unit or the payload data processing functional unit according to the time lengths of the header parts at different levels specified by the protocol; The wireless communication network entity performs dynamic resource scheduling on the control information parsing functional unit, the payload data processing functional unit, and the data collection functional unit by monitoring the time consumed for parsing the control information, processing the payload data, and collecting data at each layer of the protocol stack, so that the data generated after each layer of processing can be timely stored in the basic database.

2. The method for data streaming parsing, parallel acquisition and storage in the wireless communication system according to claim 1, wherein The dynamic resource scheduling strategy of the data collection functional unit includes the dynamic resource scheduling strategy between the control information parsing functional unit and the data collection functional unit, specifically including: When the digital domain signal data of the first header part enters the control information parsing functional unit, the parsing time of this part of the data by the control information parsing functional unit is t1, the time for transmitting the control information data to the data collection functional unit after processing is t2, and the data collection time is t3; when the digital domain signal data of the second header part enters the control information parsing functional unit, the parsing time of this part of the data by the control information parsing functional unit is t1', the time for transmitting the control information data to the data collection functional unit after processing is t2', and the data collection time is t3'; if t2 + t3 ≤ t1' + t2', then there is no need to increase the resources of the data collection functional unit, otherwise the resources of the data collection functional unit are dynamically increased.

3. The method for data streaming parsing, parallel acquisition and storage in the wireless communication system according to claim 1, wherein The dynamic resource scheduling strategy of the data collection functional unit includes the dynamic resource scheduling strategy between the payload data processing functional unit and the data collection functional unit, specifically including: When the digital domain signal data of the first segment of the payload part enters the payload data processing functional unit, the processing time of this part of the data by the payload data processing functional unit is tp1, the time for transferring the data to the data acquisition functional unit after processing is tp2, and the data acquisition time is tp3; when the digital domain signal data of the second segment of the payload part enters the payload data processing functional unit, the processing time of this part of the data by the payload data processing functional unit is tp1', the time for transferring the data to the data acquisition functional unit after processing is tp2', and the data acquisition time is tp3'; if tp2 + tp3 > tp1' + tp2', then dynamically increase the resources of the data acquisition functional unit, otherwise there is no need to increase the resources of the data acquisition functional unit anymore.

4. The method for data stream parsing, parallel acquisition and storage in the wireless communication system according to claim 1, wherein The wireless communication network entity stores the received wireless communication network digital domain signal data in the original database; the wireless communication network entity also stores the status parameter data of the operation and maintenance management platform and the operating system in the status parameter database.

5. A wireless communication network entity that realizes data stream parsing, parallel acquisition, and storage, characterized in that, It includes a timer, a control information parsing functional unit, a data payload processing functional unit, a data acquisition functional unit for layer-by-layer processing and parallel storage of the received wireless communication network digital domain signal data, and a dynamic resource scheduling module; The timer is used to transmit the data of the frame header part and the payload part in the digital domain signal data to the control information parsing functional unit and the payload data processing functional unit respectively through timing; the timer has a switch function and can control the transfer of the digital domain signal data stream to the control information parsing functional unit or the payload data processing functional unit according to the time lengths of the frame header parts at different layers specified by the protocol; The control information parsing functional unit runs in parallel with the data acquisition functional unit and transfers the control information data to the payload data processing functional unit and the data acquisition functional unit in parallel during the process of parsing the control information from the digital domain signal data of the frame header part; The payload data processing functional unit runs in parallel with the data acquisition functional unit and transfers the environmental parameter information, control information at different levels, and service data statistical information generated during the processing to the data acquisition functional unit running in parallel during the process of parsing and processing the digital domain signal data of the payload part according to the control information; The data acquisition functional unit is used to store the control information data parsed by the control information parsing functional unit in the basic database in real time, and store the environmental parameter information, control information at different levels, and service data statistical information generated during the payload data processing process in the basic database in real time; The dynamic resource scheduling module is used to monitor the time consumed by the control information parsing, payload data processing, and data acquisition of each layer of the protocol stack, and perform dynamic resource scheduling on the control information parsing functional unit, the payload data processing functional unit, and the data acquisition functional unit, so that the data generated after each layer of processing is stored in the basic database in time.

6. The wireless communication network entity according to claim 5, wherein It also includes a storage module for storing the received wireless communication network digital domain signal data in the original database; The status parameter data acquisition module is used to store the status parameter data of the operation and maintenance management platform and the operating system into the status parameter database.

7. The wireless communication network entity according to claim 5, characterized in that, The wireless communication network entity is a software and hardware decoupled wireless communication network entity based on software-defined network and network function virtualization, including each network element in the terminal device, base station or core network.

8. A data streaming acquisition and storage system for a wireless communication network, characterized in that, It includes an access network data acquisition and storage module and a core network data acquisition and storage module; The access network data acquisition and storage module is used to acquire and store the raw data and basic data of the radio access network; the radio access network includes a terminal device and a base station, and the raw data and basic data of the terminal device and the base station are acquired by using the data streaming parsing, parallel acquisition and storage method in the wireless communication system according to any one of claims 1-4 to acquire the originally received wireless communication network digital domain signal data and the basic data from the physical layer to the application layer; The core network data acquisition and storage module is used to acquire and store the core network basic data, and each network element in the core network uses the data streaming parsing, parallel acquisition and storage method in the wireless communication system according to any one of claims 1-4 to acquire the basic data from the network layer to the application layer.

9. The wireless communication network data streaming acquisition and storage system according to claim 8, wherein It includes a raw database, a basic database and a status parameter database; The raw database is used to store the wireless communication network digital domain signal data that has not been processed by the physical layer control information parsing functional unit and the payload data processing functional unit; The basic database is used to store the control information parsed from the digital domain signal data in the frame header part, as well as the environmental parameter information, control information at different levels and service data statistical information generated when parsing the digital domain signal data in the payload part according to the control information during the payload data processing; The status parameter database is used to store the status parameter data of the operation and maintenance management software and the operating system.

Images