Data stream analysis, parallel acquisition and storage method in wireless communication system

Abstract

The invention discloses a data stream type analysis, parallel acquisition and storage method in a wireless communication system, which is suitable for a wireless communication network entity for software and hardware decoupling. By controlling the parallel operation of the information analysis function unit and the data acquisition function unit and the parallel operation of the load data processing function unit and the data acquisition function unit, the dual purposes of synchronously executing data processing and data acquisition are achieved; dynamic resource scheduling is carried out on the control information analysis function unit, the load data processing function unit and the data acquisition function unit according to time consumed by control information analysis, load data processing and data acquisition in different levels of the wireless communication network; according to the source of the data, the collected data are stored in different libraries, and a hierarchical data storage system is constructed. According to the invention, the problem that streaming acquisition cannot be realized in a wireless communication system is effectively solved, and the efficiency and applicability of data acquisition and storage are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of mobile communication data collection and storage, and in particular to a method for data streaming analysis, parallel collection and storage in a wireless communication system. Background Art

[0002] Traditional wireless communication networks are composed of dedicated hardware devices, such as base stations, routers, switches, and terminal devices, which undertake core functions such as signal transmission, data processing, and resource management. However, these devices face problems such as high replacement costs, inefficient equipment update cycles, and high labor maintenance costs. With the rapid development of mobile communication technology, the continuous improvement of computer computing power, and the continuous evolution of network architecture, traditional wireless communication network equipment has gradually shifted to the direction of advanced technologies such as software-defined networking (SDN) and network function virtualization (NFV), and turned to virtualization and software-based methods running on general-purpose computer devices. The softwareization and virtualization of hardware can not only effectively reduce the costs of hardware updates and human maintenance, but also significantly improve update efficiency and system flexibility. At the same time, this transformation has brought convenience to the collection and storage of wireless communication network data, and also provided the basic conditions for realizing intelligence. The traditional data collection process is realized through two sets of mechanisms, that is, after the terminal equipment, base station, or core network element receives the corresponding communication data, the respective operating hardware system will analyze the received data layer by layer (physical layer, data link control layer, core network, network layer, etc.). At the same time, it is also necessary to capture the wireless communication data and then collect the data through packet analysis. Although this method can collect data, it cannot collect data in real time from the wireless communication network. In addition, repeated analysis will not only waste a lot of resources, but also face cost and flexibility issues.

[0003] At the same time, in terms of data collection and storage, the existing data storage methods for mobile communication data do not store data in separate libraries according to the source of the collected data, which is not convenient for model training and application. Therefore, it is an important issue to study how to store these data in separate libraries to better support research and application. Summary of the invention

[0004] Purpose of the invention: The purpose of the present invention is to propose a method for data streaming analysis, parallel collection and storage in a wireless communication system, which has the advantages of streaming data analysis, dynamic resource scheduling and storage of collected data in separate libraries according to different sources and types of data, so as to solve the problem that traditional data collection requires the use of two sets of mechanisms for data collection and cannot achieve real-time data collection, and realizes dynamic resource scheduling and a hierarchical data storage system that is convenient for model training and application.

[0005] Technical solution: In view of the shortcomings of the prior art, the present invention adopts the following technical solution:

[0006] In a first aspect, the present invention provides a method for data streaming parsing, parallel collection and storage in a wireless communication system, comprising the following steps:

[0007] The wireless communication network entity receives the wireless communication network digital domain signal data;

[0008] The wireless communication network entity processes the digital domain signal data layer by layer and stores them in parallel. For each layer of processing, the frame header part and the payload part of the digital domain signal data are transmitted to the control information parsing function unit and the payload data processing function unit respectively through the timer. While the control information parsing and payload data processing are performed on the frame header part and the payload part, the control information parsed from the digital domain signal data of the frame header part, as well as the environmental parameter information, control information of different levels, and business data statistics generated during the payload data processing are collected in parallel and stored in the basic database.

[0009] The wireless communication network entity monitors the time consumed by control information parsing, payload data processing and data collection at each layer of the protocol stack, and dynamically schedules resources for the control information parsing functional unit, payload data processing functional unit and data collection functional unit, so that the data generated after each layer of processing is completed is stored in the basic database in a timely manner.

[0010] Preferably, the timer has a switch function, and can control the digital domain signal data stream to be transmitted to the control information parsing function unit or the payload data processing function unit according to the time length of the frame header part at different levels specified by the protocol.

[0011] Preferably, the dynamic resource scheduling strategy of the data acquisition functional unit includes a control information parsing functional unit and a dynamic resource scheduling strategy of the data acquisition functional unit, specifically including:

[0012] When the digital domain signal data of the first frame header enters the control information parsing functional unit, the time for the control information parsing functional unit to parse this part of data is t1, and the time for passing the control information data to the data acquisition functional unit after processing is t2, and the time for data acquisition is t3; when the digital domain signal data of the second frame header enters the control information parsing functional unit, the time for the control information parsing functional unit to parse this part of data is t1', and the time for passing the control information data to the data acquisition functional unit after processing is t2', and the time for data acquisition is t3'; if t2+t3≤t1'+t2', there is no need to increase the resources of the data acquisition functional unit, otherwise the resources of the data acquisition functional unit are dynamically increased;

[0013] Preferably, the dynamic resource scheduling strategy of the data acquisition functional unit includes the dynamic resource scheduling strategy of the load data processing functional unit and the data acquisition functional unit, specifically including:

[0014] When the digital domain signal data of the first segment of the payload enters the payload data processing functional unit, the payload data processing functional unit takes tp1 to process this data, and after the processing, the data is transferred to the data acquisition functional unit in tp2, and the data acquisition time is tp3; when the digital domain signal data of the second segment of the payload enters the payload data processing functional unit, the payload data processing functional unit takes tp1' to process this data, and after the processing, the data is transferred to the data acquisition functional unit in tp2', and the data acquisition time is tp3'; if tp2+tp3>tp1'+tp2', the resources of the data acquisition functional unit are dynamically increased, otherwise there is no need to increase the resources of the data acquisition functional unit.

[0015] Preferably, the wireless communication network entity stores the received wireless communication network digital domain signal data in an original database; the wireless communication network entity also stores the state parameter data of the operation and maintenance management platform and the operating system in a state parameter database.

[0016] In a second aspect, the present invention provides a wireless communication network entity for implementing data streaming parsing, parallel collection and storage, including a timer for layer-by-layer processing and parallel storage of received wireless communication network digital domain signal data, a control information parsing functional unit, a data load processing functional unit and a data collection functional unit, and a dynamic resource scheduling module;

[0017] The timer is used to transmit the data of the frame header part and the payload part in the digital domain signal data to the control information parsing function unit and the payload data processing function unit respectively by timing;

[0018] The control information parsing functional unit runs in parallel with the data acquisition functional unit, and in the process of parsing the control information from the digital domain signal data of the frame header part, transmits the control information data to the payload data processing functional unit and the data acquisition functional unit in parallel;

[0019] The payload data processing functional unit runs in parallel with the data acquisition functional unit, and in the process of analyzing and processing the digital domain signal data of the payload part according to the control information, transmits the environmental parameter information, control information of different levels and business data statistical information generated in the processing process to the data acquisition functional unit running in parallel;

[0020] The data acquisition functional unit is used to store the control information data parsed by the control information parsing functional unit in real time into the basic database, and to store the environmental parameter information, control information of different levels and business data statistical information generated in the load data processing process in real time into the basic database;

[0021] The storage module is used to store the received wireless communication network digital domain signal data into the original database;

[0022] The dynamic resource scheduling module is used to monitor the time consumed by control information analysis, load data processing and data collection at each layer of the protocol stack, and dynamically schedule resources for the control information analysis function unit, load data processing function unit and data collection function unit, so that the data generated after each layer of processing is completed is stored in the basic database in a timely manner.

[0023] Preferably, the wireless communication network entity also includes a storage module for storing the received wireless communication network digital domain signal data into the original database; and a state parameter data acquisition module for storing the state parameter data of the operation and maintenance management platform and the operating system into the state parameter database.

[0024] Preferably, the wireless communication network entity is a wireless communication network entity with software and hardware decoupling based on software defined networking and network function virtualization, including terminal equipment, base stations or various network elements in the core network.

[0025] In a third aspect, the present invention provides a wireless communication network data streaming collection and storage system, including an access network data collection and storage module and a core network data collection and storage module;

[0026] The access network data collection and storage module is used to collect and store the original data and basic data of the wireless access network; the wireless access network includes terminal equipment and base stations, and the original data and basic data of the terminal equipment and base stations are collected by using the data streaming analysis, parallel collection and storage method in the wireless communication system to collect the original received wireless communication network digital domain signal data and the basic data from the physical layer to the application layer;

[0027] The core network data collection and storage module is used to collect and store the core network basic data. Each network element in the core network uses the data streaming analysis, parallel collection and storage method in the wireless communication system to collect basic data from the network layer to the application layer.

[0028] Preferably, the storage system includes an original database, a basic database and a state parameter database;

[0029] The original database is used to store wireless communication network digital domain signal data that has not been processed by the physical layer control information parsing functional unit and the payload data processing functional unit;

[0030] The basic database is used to store control information parsed from the digital domain signal data of the frame header part, as well as environmental parameter information, control information of different levels and business data statistics information generated when the digital domain signal data of the payload part is parsed according to the control information during the payload data processing process;

[0031] The state parameter database is used to store state parameter data of operation and maintenance management software and operating system.

[0032] Beneficial effects: Compared with the prior art, the advantages of the present invention are:

[0033] 1) The present invention parses the digital domain signal data of the frame header part through the control information parsing function unit in the wireless communication network entity, and further processes the digital domain signal data of the load part according to the control information obtained by the parsing. At the same time, the parallel data acquisition function unit is started to collect the control information generated during the control information parsing process, as well as the environmental parameter information, control information of different levels and business data statistics generated during the load data processing process in real time. The method realizes the real-time acquisition of data and avoids the cumbersome process of the traditional data acquisition method that needs to capture the data packet first, and then parse and store it. The traditional wireless communication network data acquisition method not only requires the network to perform a parsing process on the communication data once, but also requires additional data parsing and acquisition after the packet is captured. This approach not only lacks real-time performance, but also consumes additional computing resources. Through the method of the present invention, the real-time performance of data acquisition can be effectively improved and the additional resource consumption can be reduced.

[0034] 2) The present invention proposes a dynamic resource adjustment strategy, which dynamically schedules resources for the control information parsing functional unit, the payload data processing functional unit and the data acquisition functional unit according to the time consumed by the control information parsing functional unit, the payload data processing functional unit and the data acquisition functional unit in different layers of the wireless communication network, thereby solving the problem of mismatch between the data acquisition speed and the speed of control information parsing and payload data processing.

[0035] 3) The present invention stores the collected data in separate databases based on the source of the data, and proposes a data storage system consisting of an original database, a basic database, and a state parameter database, so as to realize a hierarchical data storage system that is convenient for model training and application. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the embodiments of the present invention are briefly introduced below.

[0037] Figure 1 The present invention is a flow chart of a method for data streaming analysis, parallel collection and storage in a wireless communication system.

[0038] Figure 2 The diagram is an architecture diagram of a method for data streaming parsing, parallel acquisition and storage in a wireless communication system.

[0039] Figure 3 Schematic diagram of data streaming analysis and parallel collection in wireless communication systems.

[0040] Figure 4 Schematic diagram of wireless communication network data collection. DETAILED DESCRIPTION

[0041] The technical solution of the present invention is described clearly and completely below. Obviously, the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] Example 1

[0043] See also Figure 1 The method for data streaming parsing, parallel collection and storage in a wireless communication system disclosed in an embodiment of the present invention mainly includes:

[0044] Step 101: A wireless communication network entity receives wireless communication network digital domain signal data.

[0045] In this embodiment, the wireless communication network entity is implemented by wireless communication software, including the implementation of terminal functions, base station functions and core network functions. The wireless communication network digital domain signal data is the digital domain signal data converted by the analog signal data through the digital-to-analog converter (ADC), and is composed of digital domain signal data of the frame header part and the payload part at different levels. The device with general computing capability is equipped with a wireless communication network data interface, and supports the operation of the operating system and dynamic resource scheduling. That is, the device with general computing capability receives the wireless communication network digital domain signal data through the data interface, and runs the operating system on the device with general computing capability.

[0046] Step 102: The wireless communication network entity stores the received wireless communication network digital domain signal data into an original database, and processes and stores the digital domain signal data layer by layer in parallel.

[0047] In this embodiment, the wireless communication network entity starts the control information parsing function unit, the load data processing function unit and the data acquisition function unit at the same time through a message transmission mechanism or an event triggering mechanism. The received wireless communication network digital domain signal data is stored in the original database, and the frame header part and the load part of the digital domain signal data are transmitted to the control information parsing function unit and the load data processing function unit respectively through a timer. Subsequently, the digital domain signal data is processed layer by layer (physical layer, data link control layer, core network, network layer, etc.).

[0048] The wireless network entity triggers the data storage module to store the digital domain signal data of the wireless communication network into the original database through the message transmission mechanism or event trigger mechanism. The original database stores the digital domain signal data of the wireless communication network that has not been parsed by the physical layer control information and the payload data processing. The timer has a switch function, which can control the digital domain signal data flow to be transmitted to the control information acquisition or payload data processing functional unit according to the time length of the frame header part at different levels specified by the protocol.

[0049] The resources of general-purpose computing hardware with computing power are determined by the operating system scheduling mechanism, software design and the parallelism of the task itself. The operating system has the ability to manage general-purpose computing hardware with computing power, thread scheduling, resource management and provide a running environment for software.

[0050] Specifically, the wireless communication network entity includes a control information parsing functional unit, a payload data processing functional unit, and a data collection functional unit in the physical layer, data link control layer, radio frequency resource control layer, core network, network layer, transport layer, and application layer. The control information parsing functional unit can pass the control information data generated in the digital domain signal data parsing process of the frame header part to the data collection functional unit for collection. The payload data processing functional unit can pass the environmental parameter information, control information of different levels, business data statistics, etc. generated in the digital domain signal data processing process of the payload part to the data collection functional unit for collection.

[0051] After the control information parsing function unit parses the digital domain signal data of the frame header part to obtain the control information, it will be transmitted to the payload data processing function unit and simultaneously transmitted to the data acquisition function unit;

[0052] The digital domain signal data of the wireless communication network consists of two parts: the digital domain signal data of the frame header part at different levels and the digital domain signal data of the payload part.

[0053] The data acquisition function unit will collect the control information data generated by the control information analysis process in parallel, and store the control information data in the basic database;

[0054] The basic database stores the control information data generated by the control information analysis and the environmental parameter information, control information of different levels, business data statistics, etc. generated by the load data processing functional unit during the processing process.

[0055] The payload data processing functional unit processes the digital domain signal data of the payload part according to the control information, and transmits the environmental parameter information, control information of different levels, business data statistics, etc. generated during the processing to the data acquisition functional unit;

[0056] The data collection function unit will collect the environmental parameter information, control information at different levels, business data statistics, etc. generated during the data load processing in parallel, and store this information data in the basic database;

[0057] The payload data processing functional unit transmits the processed environmental parameter information, control information, and digital domain signal data of the payload part to the data processing part of the next layer for reading and parsing until the application layer data stream is processed.

[0058] Step 103, the wireless communication network entity performs dynamic resource scheduling on the control information parsing function unit, the load data processing function unit and the data collection function unit by monitoring the time consumed by the control information parsing, load data processing and data collection of each layer of the protocol stack, so that the data generated after each layer of processing is completed is stored in the basic database in time.

[0059] In this embodiment, the data acquisition functional unit can dynamically adjust system resources and change the acquisition speed of the data acquisition functional unit by adjusting system resources. In this way, the environmental parameter information, control information of different levels, business data statistics and other data generated during the control information analysis and load data processing are stored in the basic database in real time through the parallel running data acquisition functional units. The problem of delayed data acquisition due to the speed matching problem of the data flow processing functional unit and the data acquisition functional unit is avoided.

[0060] Example 2

[0061] See also Figure 2The wireless communication network entity for realizing data streaming parsing, parallel collection and storage in a wireless communication system disclosed in an embodiment of the present invention includes: general computing hardware with computing capabilities, an operating system, an operation and maintenance management platform (OAM) and wireless communication software. The general computing hardware with computing capabilities runs an operating system, which supports the operating system to perform resource scheduling according to demand. The operating system supports the operation of the OAM software and has the ability to schedule threads, manage resources and provide support for software operation. Specifically, the operating system can dynamically allocate processor core resources according to the resource requirements of the software during operation, so as to meet the performance requirements of the software operation. The wireless communication software is run in the environment provided by the OAM. The OAM software has the ability of operation, maintenance and management. The wireless communication software provides support for the implementation of users, base stations and core networks. The parsing, collection and storage of data in users, base stations and core networks can be realized by the wireless communication software, and the digital domain signal data of the wireless communication network is parsed from the physical layer to the application layer. Specifically, the wireless communication software is provided with a timer, a control information parsing function unit, a data load processing function unit and a data collection function unit for layer-by-layer processing and parallel storage of the received digital domain signal data of the wireless communication network.

[0062] The timer transmits the data of the frame header part and the payload part in the digital domain signal data to the control information parsing function unit and the payload data processing function unit respectively through timing and switching; the control information parsing function unit runs in parallel with the data acquisition function unit, and in the process of the control information parsing function unit parsing the control information from the digital domain signal data of the frame header part, the control information data is transmitted to the payload data processing function unit and the data acquisition function unit in parallel. Then, the control information data parsed by the control information parsing function unit is stored in the basic database in real time through the data acquisition function unit. The payload data processing function unit runs in parallel with the data acquisition function unit, and in the process of the payload data parsing and processing the digital domain signal data of the payload part according to the control information, the environmental parameter information, control information of different levels, business data statistics, etc. generated in the processing process are transmitted to the parallel running data acquisition function unit. Then, the environmental parameter information, control information of different levels, business data statistics, etc. generated in the payload data processing process are stored in the basic database in real time through the data acquisition function unit; the acquisition speed of the data acquisition function unit can be dynamically changed according to the system resource situation of the data acquisition function unit. The data stream processing functional unit of each layer receives digital domain signal data from the wireless communication network entity or digital domain signal data processed by the data stream processing functional unit of the previous layer.

[0063] The wireless network entity triggers the data storage module through a message passing mechanism or an event triggering mechanism to store the digital domain signal data of the wireless communication network into the original database. The wireless network entity also sets up a dynamic resource scheduling module to monitor the time consumed by the control information parsing, load data processing and data collection of each layer of the protocol stack, and dynamically schedules the control information parsing functional unit, the load data processing functional unit and the data collection functional unit, so that the data generated after each layer of processing is completed is stored in the basic database in time. All the above-mentioned collected data is stored in the data storage system, which consists of an original database, a basic database and a state parameter database.

[0064] The original database stores the digital domain signal data of the wireless communication network, which is collected in real time through the data storage module of the terminal or base station entity.

[0065] The data in the basic database is collected in real time by the data acquisition functional unit during the process of control information parsing and payload data processing. Specifically, the control information parsing functional unit generates control information when parsing the digital domain signal data of the frame header, and the payload data processing functional unit generates environmental parameter information, control information of different levels, business data statistics, etc. when processing the digital domain signal data of the payload. These information data will be collected in real time into the basic database by the data acquisition functional unit running in parallel.

[0066] The state parameter database is a data obtained by the state parameter data acquisition module through real-time monitoring of the operating status and resource consumption of OAM and operating system, and the data is stored in the state parameter database.

[0067] Example 3

[0068] The embodiment of the invention discloses a dynamic resource scheduling strategy in a data streaming analysis, parallel collection and storage method in a wireless communication system.

[0069] For example, Figure 3As shown in (a), when the digital domain signal data of the first segment of the frame header enters the control information parsing functional unit, the control information parsing functional unit parses this part of the data for t1, and after the processing is completed, the control information data is transferred to the data acquisition functional unit for t2, and the data acquisition time is t3. When the digital domain signal data of the second segment of the frame header enters the control information parsing functional unit, the control information parsing functional unit parses this part of the data for t1', and after the processing is completed, the control information data is transferred to the data acquisition functional unit for t2', and the data acquisition time is t3'. At this time, if t2+t3≤t1'+t2', it means that at the moment when the second segment of the control information is parsed and transferred to the data acquisition functional unit, the data acquisition functional unit has already processed the first segment of the control information data transferred to the data acquisition functional unit and has already collected it, and there is no need to increase the data acquisition functional unit resources. Otherwise, it means that the data acquisition function unit has not completed data acquisition, and the control information data parsed from the digital domain signal data in the second frame header has been transmitted to the data acquisition function unit. At this time, the system needs to dynamically increase the resources of the data acquisition function unit to increase the processing efficiency of the data acquisition function unit.

[0070] Similarly, if Figure 3 As shown in (b), when the digital domain signal data of the first payload portion enters the payload data processing functional unit, the payload data processing functional unit processes this portion of data for a time period of tp1, and after the processing is completed, the time for transmitting the environmental parameter information, control information of different levels, business data statistics information and other data to the data acquisition functional unit is tp2, and the time for data acquisition is tp3. When the digital domain signal data of the second payload portion enters the payload data processing functional unit, the payload data processing functional unit processes this portion of data for a time period of tp1', and after the processing is completed, the time for transmitting the environmental parameter information, control information of different levels, business data statistics information and other data to the data acquisition functional unit is tp2', and the time for data acquisition is tp3'. At this time, if tp2+tp3>tp1'+tp2', it means that when the data is parsed and transmitted to the data acquisition functional unit after the second portion of the control information is parsed, the data acquisition functional unit has not yet completed the collection of the first portion of the environmental parameter information, control information of different levels, business data statistics information and other information transmitted to the data acquisition functional unit. At this time, the system needs to dynamically increase the resources of the data acquisition functional unit, thereby increasing the processing efficiency of the data acquisition functional unit. Otherwise, it means that the data of the data collection function unit has been collected, and the environmental parameter information, control information of different levels, business data statistics information and other data obtained by the payload processing of the second segment of data can be directly transmitted to the data collection function unit for collection.

[0071] Example 4

[0072] The wireless communication network data streaming collection and storage system disclosed in the embodiment of the present invention includes an access network data collection and storage module and a core network data collection and storage module. The access network data collection and storage module is used to collect and store the original data and basic data of the wireless access network; the wireless access network includes terminal equipment and base stations, and the original data and basic data of the terminal equipment and the base station are collected by using the data streaming parsing, parallel collection and storage method in the wireless communication system described in Example 1 to collect the original received wireless communication network digital domain signal data, as well as the basic data from the physical layer to the application layer. The core network data collection and storage module is used to collect and store the basic data of the core network. Each network element in the core network uses the data streaming parsing, parallel collection and storage method in the wireless communication system described in Example 1 to collect the basic data from the network layer to the application layer.

[0073] The following is a detailed description of the system implementation steps of the embodiment of the present invention using a specific simulation example. Specifically, the data collection and storage process of the wireless communication network data streaming collection and storage system according to the embodiment of the present invention includes:

[0074] Step 201: Collect and store original data and basic data of the wireless access network.

[0075] For example, Figure 4 As shown, the wireless access network is composed of terminal equipment and base stations, and the original data and basic data of the terminal and the base station are collected in the same way.

[0076] In this embodiment, the terminal device and the base station are composed of a computer with an operating system of Ubuntu 20.04, a USRPb210 radio peripheral, wireless communication software and a database. The computer with an operating system of Ubuntu 20.04 and the USRPb210 provide the terminal device with a general computing device and a software operating environment. OpenAirInterface runs in the operating system to realize the softwareization of the terminal and the base station.

[0077] Specifically, in the wireless access network, the terminal and the base station continuously send uplink wireless communication network digital domain signal data and receive downlink wireless communication network digital domain signal data through the air interface, and initialize the received wireless communication network digital domain signal data into the terminal and base station entities.

[0078] At this time, the terminal or base station stores the received digital domain signal data of the wireless communication network into the original database and transmits it to the timer at the same time. The timer will transmit the received digital domain signal data of the frame header part to the control information parsing function unit according to the time length of the frame header part of different layers specified by the protocol, and after transmitting the digital domain signal data of the frame header part, the load part of the data will be transmitted to the load data processing function unit through the switch.

[0079] The control information parsing function unit will parse the digital domain signal data of the frame header of the received wireless communication network digital domain signal to obtain the control information data required for the payload data processing process, such as resource allocation information, modulation and coding information, cyclic redundancy check (CRC) check information, demodulation reference signal (DM-RS) position and group identifier, etc.

[0080] The data acquisition function unit runs in parallel with the control information analysis function unit, and stores the control information data generated in the control information analysis process into the basic database.

[0081] After the payload data processing functional unit receives the digital domain signal data of the payload part, it will perform the payload data processing process according to the control information obtained by parsing the digital domain signal data of the frame header part. In this process, environmental parameter information, control information of different levels, and service data statistics will be generated in real time, including demodulated symbol data, soft information, channel estimation results, de-scheduled data, and equalized data.

[0082] The data acquisition functional unit runs in parallel with the load data processing functional unit, and stores the control information data generated during the load data processing into the basic database.

[0083] After the physical layer data stream is processed, the processed environmental parameter information, control information, and digital domain signal data of the payload part will be passed to the data processing part of the next layer. The data stream processing part of the data link control layer will read the data passed by the data stream processing part of the previous layer, and parse and process the data according to the rules of the data link control layer. And so on, parse layer by layer (physical layer, data link control layer, core network, network layer, etc.) to the application layer and store the data in the basic database.

[0084] Step 202: Collect and store core network basic data.

[0085] For example, Figure 4 As shown in the figure, the core network is composed of a computer with Ubuntu 20.04 operating system, Kubernetes, Docker, Open5gs and other software. The computer with Ubuntu 20.04 operating system, Kubernetes and Docker provide general computing power and software operating environment for terminal devices. Open5gs runs in the container environment provided by Kubernetes and Docker to realize the functions of the core network. Each network element of the core network runs in a container, and the containers interact with each other through a service-based interface (SBI).

[0086] Specifically, the consumer network element initiates a request to the producer network element in the core network through SBI. The producer network element receives the requested data through the virtual network interface, and sends the digital domain signal data of the frame header part and the digital domain signal data of the payload part to the control information parsing functional unit and the payload data processing functional unit respectively through the timer in the wireless communication network entity.

[0087] The message transmission mechanism or event triggering mechanism in the wireless communication network entity triggers the control information parsing functional unit, the payload data processing functional unit and the data collection functional unit at the same time. The control information parsing functional unit of the network layer will parse the digital domain signal data of the received network layer frame header part to obtain the control information data required to execute the payload data processing process. Such as: source IP address, destination IP address, protocol field, identification, fragment offset and flag field, etc. And pass these data to the network layer data collection functional unit while parsing and processing.

[0088] The network layer data acquisition functional unit and the network layer control information analysis functional unit run in parallel. Control information will be gradually generated during the control information analysis process, and the parallel running data acquisition functional unit will store these gradually generated control information data in real time into the basic database.

[0089] The network layer payload data processing functional unit performs payload data processing according to the control information obtained by parsing the digital domain signal data of the frame header, which will generate some environmental parameter information, control information of different levels, business data statistics, etc., such as: extracted transport layer data segments, discarded error data, checksum verification results, and forwarding or transmission statistics. While processing, these information data are passed to the network layer data collection functional unit. Finally, the network layer data collection functional unit running in parallel stores these information data in the basic database.

[0090] The network layer data collection function unit runs in parallel with the network layer load processing. During the load processing, environmental parameter information, control information at different levels, and business data statistics will be gradually generated. The parallel running data collection function unit will store these gradually generated environmental parameter information, control information at different levels, and business data statistics in real time into the basic database.

[0091] After the payload data processing is completed, the processed environmental parameter information, control information, and digital domain signal data of the payload part will be passed to the data processing part of the next layer. The data processing part of the transport layer reads the data passed from the previous layer and parses and processes the data according to the protocol of the transport layer. And so on, parse layer by layer (network layer, transport layer, application layer, etc.) to the application layer and store the data in the basic database.

[0092] After processing and storing the application layer data, the data is passed to the producer network element through the SBI interface. The producer network element responds to the service requested by the consumer based on the request information.

[0093] The preferred specific embodiments of the present invention are described in detail above. It should be understood that a person skilled in the art can make many modifications and changes based on the concept of the present invention without creative work. Therefore, any technical solution that can be obtained by a person skilled in the art through logical analysis, reasoning or limited experiments based on the concept of the present invention on the basis of the prior art should be within the scope of protection determined by the claims.

Claims

1. A method for data streaming analysis, parallel collection and storage in a wireless communication system, characterized in that: The steps include: The wireless communication network entity receives the wireless communication network digital domain signal data; The wireless communication network entity processes the digital domain signal data layer by layer and stores them in parallel. For each layer of processing, the frame header part and the payload part of the digital domain signal data are transmitted to the control information parsing function unit and the payload data processing function unit respectively by timing the timer. While the control information parsing and payload data processing are performed on the frame header part and the payload part, the control information parsed from the digital domain signal data of the frame header part, as well as the environmental parameter information, control information of different levels and business data statistics generated during the payload data processing are collected in parallel and stored in the basic database. The wireless communication network entity monitors the time consumed by control information parsing, payload data processing and data collection at each layer of the protocol stack, and dynamically schedules resources for the control information parsing functional unit, payload data processing functional unit and data collection functional unit, so that the data generated after each layer of processing is completed is stored in the basic database in a timely manner.

2. The method for data streaming parsing, parallel collection and storage in a wireless communication system according to claim 1, characterized in that: The timer has a switch function and can control the digital domain signal data stream to be transmitted to the control information analysis function unit or the payload data processing function unit according to the time length of the frame header part of different layers specified by the protocol.

3. The method for data streaming analysis, parallel collection and storage in a wireless communication system according to claim 1, characterized in that: The dynamic resource scheduling strategy of the data acquisition functional unit includes the dynamic resource scheduling strategy of the control information analysis functional unit and the data acquisition functional unit, which specifically includes: When the digital domain signal data of the first frame header enters the control information parsing functional unit, the time for the control information parsing functional unit to parse this part of data is t1, and the time for passing the control information data to the data acquisition functional unit after processing is t2, and the time for data acquisition is t3; when the digital domain signal data of the second frame header enters the control information parsing functional unit, the time for the control information parsing functional unit to parse this part of data is t1', and the time for passing the control information data to the data acquisition functional unit after processing is t2', and the time for data acquisition is t3'; if t2+t3≤t1'+t2', there is no need to increase the resources of the data acquisition functional unit, otherwise the resources of the data acquisition functional unit are dynamically increased; 4. The method for data streaming parsing, parallel collection and storage in a wireless communication system according to claim 1, characterized in that: The dynamic resource scheduling strategy of the data acquisition functional unit includes the dynamic resource scheduling strategy of the load data processing functional unit and the data acquisition functional unit, which specifically includes: When the digital domain signal data of the first segment of the payload enters the payload data processing functional unit, the payload data processing functional unit takes tp1 to process this data, and after the processing, the data is transferred to the data acquisition functional unit in tp2, and the data acquisition time is tp3; when the digital domain signal data of the second segment of the payload enters the payload data processing functional unit, the payload data processing functional unit takes tp1' to process this data, and after the processing, the data is transferred to the data acquisition functional unit in tp2', and the data acquisition time is tp3'; if tp2+tp3>tp1'+tp2', the resources of the data acquisition functional unit are dynamically increased, otherwise there is no need to increase the resources of the data acquisition functional unit.

5. The method for data streaming analysis, parallel collection and storage in a wireless communication system according to claim 1, characterized in that: The wireless communication network entity stores the received wireless communication network digital domain signal data in an original database; the wireless communication network entity also stores the state parameter data of the operation and maintenance management platform and the operating system in a state parameter database.

6. A wireless communication network entity for implementing data streaming analysis, parallel collection and storage, characterized in that: It includes a timer for layer-by-layer processing and parallel storage of received wireless communication network digital domain signal data, a control information parsing function unit, a data load processing function unit and a data acquisition function unit, and a dynamic resource scheduling module; The timer is used to transmit the data of the frame header part and the payload part in the digital domain signal data to the control information parsing function unit and the payload data processing function unit respectively by timing; The control information parsing functional unit runs in parallel with the data acquisition functional unit, and in the process of parsing the control information from the digital domain signal data of the frame header part, transmits the control information data to the payload data processing functional unit and the data acquisition functional unit in parallel; The payload data processing functional unit runs in parallel with the data acquisition functional unit, and in the process of analyzing and processing the digital domain signal data of the payload part according to the control information, transmits the environmental parameter information, control information of different levels and business data statistical information generated in the processing process to the data acquisition functional unit running in parallel; The data acquisition functional unit is used to store the control information data parsed by the control information parsing functional unit in real time into the basic database, and to store the environmental parameter information, control information of different levels and business data statistical information generated in the load data processing process in real time into the basic database; The dynamic resource scheduling module is used to monitor the time consumed by control information analysis, load data processing and data collection at each layer of the protocol stack, and dynamically schedule resources for the control information analysis function unit, load data processing function unit and data collection function unit, so that the data generated after each layer of processing is completed is stored in the basic database in a timely manner.

7. The wireless communication network entity according to claim 6, characterized in that: Also included is a storage module for storing the received wireless communication network digital domain signal data into an original database; The state parameter data collection module is used to store the state parameter data of the operation and maintenance management platform and the operating system into the state parameter database.

8. The wireless communication network entity according to claim 6, characterized in that: The wireless communication network entity is a wireless communication network entity with software and hardware decoupling based on software defined networking and network function virtualization, including terminal equipment, base stations or various network elements in the core network.

9. A wireless communication network data streaming collection and storage system, characterized in that: Including access network data collection and storage module and core network data collection and storage module; The access network data collection and storage module is used to collect and store the original data and basic data of the wireless access network; the wireless access network includes terminal equipment and base stations, and the original data and basic data of the terminal equipment and the base station are collected by using the data streaming parsing, parallel collection and storage method in the wireless communication system according to any one of claims 1 to 5 to collect the original received wireless communication network digital domain signal data, as well as the basic data from the physical layer to the application layer; The core network data collection and storage module is used to collect and store core network basic data. Each network element in the core network uses the data streaming parsing, parallel collection and storage method in the wireless communication system according to any one of claims 1-5 to collect basic data from the network layer to the application layer.

10. The wireless communication network data streaming collection and storage system according to claim 9, characterized in that: Including original database, basic database and state parameter database; The original database is used to store wireless communication network digital domain signal data that has not been processed by the physical layer control information parsing functional unit and the payload data processing functional unit; The basic database is used to store control information parsed from the digital domain signal data of the frame header part, as well as environmental parameter information, control information of different levels and business data statistics information generated when the digital domain signal data of the payload part is parsed according to the control information during the payload data processing process; The state parameter database is used to store state parameter data of operation and maintenance management software and operating system.

Images