A data transmission and storage system and method based on 5G communication technology
By real-time monitoring and optimization of data transmission priority of data acquisition nodes and service processing nodes, and combining network slicing technology to allocate resources, the problem of difficult to optimize data transmission priority in the existing technology is solved, the consistency and balance of system services are achieved, and the efficiency of data transmission and automated management capabilities are improved.
Patent Information
- Application Number
- CN202411958991.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-30
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2044-12-30
AI Technical Summary
In a data transmission storage management system based on 5G communication technology, it is difficult for the existing technology to effectively optimize data transmission priority, resulting in high human resources pressure, many labeling deviations, and network link status adjustments cannot ensure service consistency and balance.
By monitoring the data information of all data acquisition nodes and service processing nodes in the system in real time, calculate the data upload and acquisition priority of each node, comprehensively analyze the data transmission priority of each time point, and use network slicing technology to distribute real-time resources to optimize the data transmission link.
It realizes scientific and reasonable allocation of data requirements for each business node of the system, optimizes data transmission priority, reduces human resources pressure, ensures the consistency and balance of system services, and improves data transmission efficiency and automated management capabilities.
Smart Images

Figure CN119402918B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data transmission storage management, and specifically to a data transmission storage system and method based on 5G communication technology. Background Art
[0002] With the development and popularization of 5G technology, many fields such as smart water management and smart site supervision have begun to widely use 5G communication technology for data transmission, storage and management;
[0003] In many data transmission and storage management systems based on 5G communication technology, multi-modal data needs to be transmitted in multiple directions. The physical links involved are complex, and the source and destination nodes of the data packets carried in each physical link are also different. Therefore, in many comprehensive systems with complex data dimensions, the use of manual static labeling and allocation for data transmission priority will undoubtedly lead to great human resource pressure. In systems with complex business types, labeling deviations are inevitable. If the priority is dynamically adjusted according to the network link status, there is a lack of consideration for the data requirements of each business node in the system, and the continuity and balance of the system business cannot be ensured.
[0004] Therefore, a data transmission storage system and method based on 5G communication technology is needed to comprehensively analyze the data requirements of various services in the data monitoring transmission system and optimize the management of data transmission priority allocation in the physical link. Summary of the invention
[0005] The purpose of the present invention is to provide a data transmission and storage system and method based on 5G communication technology to solve the problems raised in the prior art.
[0006] To achieve the above object, the present invention provides the following technical solutions:
[0007] A data transmission and storage method based on 5G communication technology, the method comprising the following analysis steps:
[0008] Step S100: real-time monitoring of data collection information of all data collection nodes and business processing information of business processing nodes in the system;
[0009] Step S200: Analyze and calculate the data upload priority of each data collection node according to the data collection information of each data collection node;
[0010] Step S300: Analyze and calculate the data acquisition priority of each business processing node according to the business processing information of each business processing node;
[0011] Step S400: Combining the data upload priority of each data collection node and the data acquisition priority of each business processing node, analyzing the data transmission priority between each data collection node and each business processing node in the system at each time point;
[0012] Step S500: Real-time supervision of data transmission in the data transmission link in the system is performed according to the data transmission priority between each data collection node and each business processing node.
[0013] In the above technical solution, step S100 includes the following contents:
[0014] Through the 5G edge computing cloud platform, the data collection and transmission behaviors of all data collection nodes and business processing nodes in the system are monitored in real time, the data collection information of all data collection nodes and the business processing information of business processing nodes are obtained, and data transmission weights are allocated to each data collection node and each business processing node; by monitoring and analyzing the data collection end and the data usage end in the system, the acquisition and use of data are fully considered, providing a data basis for the priority analysis and calculation of subsequent data transmission;
[0015] The data acquisition node data acquisition information includes the data information type T acquired by the data acquisition node a , the size of the data packet collected in a single time S a , data collection time t, for any data collection node a, its data collection information is recorded as: [T a , S a , AT a (t1, t2, ..., t m )]; among them, AT a is the data collection time set of data collection node a, t1, t2, ..., t m is the data collection time of each data collection node a;
[0016] The service processing information of the service processing node includes the source data collection node of the service processing node, the number of data packets provided by each source data collection node for a single service processing, and the service processing time. For any service processing node b, its service processing information is recorded as: [(D1, N1), (D2, N2), ..., (D A , N A ), PT b (t1, t2, ..., t n )]; where D1, D2, ..., D A Identify the data collection nodes of each source, N1, N2, ..., N A The number of data packets provided by each source data collection node for a single business processing of business processing node b, PT bis the service processing time set of service processing node b, t1, t2, ..., t n is the service processing time of each service processing node b.
[0017] In the above technical solution, step S200 includes the following contents:
[0018] For any data collection node a, obtain the data collection information of the node collected in real time through the 5G edge computing cloud platform, and calculate the data upload priority of the data collection node a according to the formula:
[0019] P a =k a ×Δt a ×S a +C a ;
[0020] Among them, P a is the data upload priority of data collection node a, k a is the data transmission weight of data acquisition node a, Δt a is the time interval between two consecutive data collections of data collection node a, S a is the size of a single data packet collected by data collection node a, C a Constant for data collection node priority evaluation.
[0021] In the above technical solution, step S300 includes the following contents:
[0022] For any business processing node b, obtain the business processing information of the node collected in real time through the 5G edge computing cloud platform, and calculate the data acquisition priority of the business processing node b according to the formula:
[0023]
[0024] Among them, P b The data acquisition priority of the business processing node b, k b is the data transmission weight of service processing node b, Δt b is the service processing time interval of service processing node b, i is the source data collection node number of service processing node b, A is the number of data packets provided by source data collection node i for a single service processing of service processing node b, P i is the data upload priority of source data collection node i, N i The number of data packets provided by source data collection node i, C b A constant for evaluating the priority of a business processing node;
[0025] The data upload priorities of data collection nodes from various sources are calculated comprehensively to ensure that the calculation of the acquisition priority of various business data in the system has sufficient data support.
[0026] In the above technical solution, step S400 includes the following contents:
[0027] The data upload priority of all data collection nodes and the data acquisition priority of all business processing nodes in the system are calculated through the 5G edge computing platform, and the system data transmission priority matrix is constructed and the matrix elements are updated in real time. Each element in the matrix is the data transmission priority of sending data from each data collection node to each business processing node;
[0028] For any data collection node a and business processing node b, filter the data acquisition priority of all business processing nodes that obtain data from data collection node a and the data upload priority of all data collection nodes that transmit data to business processing node b, and calculate the data transmission priority between nodes at any time point according to the formula:
[0029]
[0030] Among them, P a,b is the data transmission priority between data collection node a and business processing node b, P a is the data upload priority of data collection node a, P b To calculate the data acquisition priority of business processing node b, sum(x) is a summation function that outputs the sum of all values in x, P A-b is the data upload priority set of all source data collection nodes that send data to business processing node b, P a-B To obtain the data acquisition priority set of all business processing nodes that collect data from data collection node a, t b The time interval from the current time point to the next service processing time of service processing node b;
[0031] Combined with the data transmission priority ratio between the system data collection end and the data usage end, the dependence and demand of each business node on the collected data are fully considered to ensure the rationality and interpretability of the subsequent physical link network slice resource allocation.
[0032] In the above technical solution, step S500 includes the following contents:
[0033] Real-time monitoring of all data packet information transmitted in the system's physical data transmission links, including data source data collection node information, data destination business processing node information, and data transmission priority data between nodes;
[0034] For data packets in any data transmission physical link, they are sorted from high to low according to the data transmission priority between nodes, and network link resources are allocated to each data packet in turn through network slicing, and the actual network link resource allocation strategy in each physical line is verified;
[0035] When allocating network link resources for data packets in the physical link for data transmission, data packets with higher priority for data transmission between nodes are given priority access to the 5G core network, and network link resources are allocated using network slicing technology for data transmission.
[0036] For data packets with lower data transmission priority between nodes, when network link resources can meet the transmission needs of all data packets, network slicing technology is used to allocate the remaining network link resources for data transmission; when network link resources cannot meet the transmission needs of all data packets, the data packet is cached and preprocessed through edge computing, and network link resources are allocated again when network link resources in the data transmission physical link are sufficient or the data transmission priority of the data packet is improved;
[0037] By personalizing the data packets with different data transmission priorities, while ensuring the continuity and balance of system services, low-priority data packets are cached and pre-processed through edge computing, reducing the load on the 5G core network and ensuring the efficiency of data transmission in the physical link. At the same time, each physical link data packet is monitored in real time to ensure that network link resources are allocated to each data packet in a timely manner, ensuring the timeliness of data transmission.
[0038] A data transmission storage system based on 5G communication technology using a data transmission storage method based on 5G communication technology in the above technical solution, the system comprising: a node monitoring module, an edge computing module, and a data transmission management module;
[0039] The node monitoring module monitors the data acquisition and transmission behavior of each data collection node and each business processing node in the system, and obtains the data collection information of all data collection nodes and the business processing information of the business processing nodes; the edge computing module calculates and analyzes the data upload priority of each data collection node and the data acquisition priority of the business processing node based on the data collection information of the data collection nodes and the business processing information of the business processing nodes through the 5G edge computing cloud platform, and then comprehensively calculates the data transmission priority between each data collection node and the business processing node in the system at any time point; the data transmission management module monitors the data transmission priority between the source data collection node and the destination business processing node of the data packet to be transmitted in the physical transmission link of the system in real time, and uses network slicing technology to allocate network link resources to the physical transmission links in each system.
[0040] In the above technical solution, the node monitoring module includes: a data acquisition node monitoring unit and a business processing node monitoring unit;
[0041] The data acquisition node monitoring unit is used to monitor the data acquisition behavior of each data acquisition node in the system and obtain data acquisition information of each data acquisition node; the business processing node monitoring unit is used to monitor the data acquisition and transmission behavior of each business processing node and obtain business processing information of each business processing node.
[0042] In the above technical solution, the edge computing module includes: a data upload priority analysis unit, a data acquisition priority analysis unit, and a data transmission priority calculation unit;
[0043] The data upload priority analysis unit calculates and analyzes the data upload priority of each data collection node based on the data collection information of each data collection node; the data acquisition priority analysis unit calculates and analyzes the data acquisition priority of each business processing node based on the business processing information of each business processing node; the data transmission priority calculation unit comprehensively calculates the data upload priority of each data collection node and the data acquisition priority of each business processing node to calculate the data transmission priority between nodes in the system.
[0044] In the above technical solution, the data transmission management module includes: a physical transmission link monitoring unit and a data transmission management unit;
[0045] The physical transmission link monitoring unit is used to monitor the data packet information in each physical transmission link in the system; the data transmission management unit uses network slicing technology to allocate network link resources to each data packet according to the data transmission priority between the data acquisition node where the data packet comes from and the destination service processing node.
[0046] Compared with the prior art, the present invention has the following beneficial effects:
[0047] The present invention conducts real-time monitoring and analysis on the data acquisition end and the data usage end in the data monitoring and transmission system, performs personalized calculation and analysis on the data upload priority and data acquisition priority of each node, comprehensively considers the data requirements of various services in the system, allocates data transmission priority to each physical link, and then optimizes the data transmission storage management strategy in the system, uses edge computing and 5G network slicing technology to ensure the efficiency and timeliness of system data transmission, while ensuring the continuity and balance of various services in the system, and realizes the automatic and flexible management of system data transmission and storage; wherein, when calculating and analyzing the data transmission priority of each node in the system, the data acquisition frequency is introduced for calculation, and when comprehensively considering the actual data processing, the high-frequency sampling data has higher accuracy than the low-frequency sampling data during interpolation fitting and other processing, thereby ensuring the scientificity and rationality of the system priority allocation; in addition, by comprehensively considering the data requirements of the data acquisition end and the data usage end, the priority of each data packet during data transmission is calculated, ensuring that the business requirements are fully considered during the system data transmission storage management, and simultaneously improving the system business continuity and balance and the flexibility of automatic data transmission management. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Figure 1 This is a flow chart of a data transmission and storage method based on 5G communication technology of the present invention;
[0049] Figure 2 This is an organizational structure diagram of a data transmission and storage system based on 5G communication technology in the present invention. DETAILED DESCRIPTION
[0050] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0051] Example: See Figure 1-Figure 2 , the present invention provides a technical solution,
[0052] like Figure 1 As shown, the present invention provides a data transmission and storage method based on 5G communication technology, and the method includes the following analysis steps:
[0053] Step S100: real-time monitoring of data collection information of all data collection nodes and business processing information of business processing nodes in the system;
[0054] Step S200: Analyze and calculate the data upload priority of each data collection node according to the data collection information of each data collection node;
[0055] Step S300: Analyze and calculate the data acquisition priority of each business processing node according to the business processing information of each business processing node;
[0056] Step S400: Combining the data upload priority of each data collection node and the data acquisition priority of each business processing node, analyzing the data transmission priority between each data collection node and each business processing node in the system at each time point;
[0057] Step S500: Real-time supervision of data transmission in the data transmission link in the system is performed according to the data transmission priority between each data collection node and each business processing node.
[0058] The step S100 includes the following contents:
[0059] Through the 5G edge computing cloud platform, the data collection and transmission behaviors of all data collection nodes and business processing nodes in the system are monitored in real time, the data collection information of all data collection nodes and the business processing information of business processing nodes are obtained, and data transmission weights are assigned to each data collection node and each business processing node;
[0060] In the specific implementation, taking the intelligent water management system as an example, the data acquisition nodes include various types of physical sensors in the water system, such as flow monitoring meters, water pressure detection sensors, etc., and the business processing nodes include nodes in the system for processing and analyzing water system data directly obtained by physical sensors, such as data analysis modules used for water data monitoring and early warning in each system supervision area.
[0061] The data acquisition node data acquisition information includes the data information type T acquired by the data acquisition node a , the size of the data packet collected in a single time S a , data collection time t, for any data collection node a, its data collection information is recorded as: [T a , S a , AT a (t1, t2, ..., t m )]; among them, AT a is the data collection time set of data collection node a, t1, t2, ..., t m is the data collection time of each data collection node a;
[0062] The service processing information of the service processing node includes the source data collection node of the service processing node, the number of data packets provided by each source data collection node for a single service processing, and the service processing time. For any service processing node b, its service processing information is recorded as: [(D1, N1), (D2, N2), ..., (D A , N A ), PTb (t1, t2, ..., t n )]; where D1, D2, ..., D A Identify the data collection nodes of each source, N1, N2, ..., N A The number of data packets provided by each source data collection node for a single business processing of business processing node b, PT b is the service processing time set of service processing node b, t1, t2, ..., t n is the service processing time of each service processing node b.
[0063] The step S200 includes the following contents:
[0064] For any data collection node a, obtain the data collection information of the node collected in real time through the 5G edge computing cloud platform, and calculate the data upload priority of the data collection node a according to the formula:
[0065] P a =k a ×Δt a ×S a +C a ;
[0066] Among them, P a is the data upload priority of data collection node a, k a is the data transmission weight of data acquisition node a, Δt a is the time interval between two consecutive data collections of data collection node a, S a is the size of a single data packet collected by data collection node a, C a Constants for data collection node priority evaluation;
[0067] In specific implementation, the data transmission weight of the data acquisition node is used to describe the importance of the collected data in the overall data business function. Considering that the higher the data acquisition frequency, the more data is acquired in the same time. When performing pre-processing operations such as interpolation and fitting on missing data, the data processing result will be more accurate. Therefore, the data acquisition time interval is introduced for calculation to ensure that the priority of low-frequency sampling data is higher under the same weight.
[0068] The step S300 includes the following contents:
[0069] For any business processing node b, obtain the business processing information of the node collected in real time through the 5G edge computing cloud platform, and calculate the data acquisition priority of the business processing node b according to the formula:
[0070]
[0071] Among them, P b The data acquisition priority of the business processing node b, k b is the data transmission weight of service processing node b, Δt b is the service processing time interval of service processing node b, i is the source data collection node number of service processing node b, A is the number of data packets provided by source data collection node i for a single service processing of service processing node b, P i is the data upload priority of source data collection node i, N i The number of data packets provided by source data collection node i, C b A constant for evaluating the priority of a business processing node;
[0072] In specific implementation, the data transmission weight of the business processing node refers to the importance of the processed business in the overall business function of the system. Considering that the differences in the amount and type of data used by different business nodes in realizing functions have a significant impact on the complexity of the business, the data upload priority of each source data collection node is introduced into the calculation to ensure that business processing nodes with higher business complexity have a higher priority when obtaining required data.
[0073] The step S400 includes the following contents:
[0074] The data upload priority of all data collection nodes and the data acquisition priority of all business processing nodes in the system are calculated through the 5G edge computing platform, and the system data transmission priority matrix is constructed and the matrix elements are updated in real time. Each element in the matrix is the data transmission priority of sending data from each data collection node to each business processing node;
[0075] For any data collection node a and business processing node b, filter the data acquisition priority of all business processing nodes that obtain data from data collection node a and the data upload priority of all data collection nodes that transmit data to business processing node b, and calculate the data transmission priority between nodes at any time point according to the formula:
[0076]
[0077] Among them, P a,b is the data transmission priority between data collection node a and business processing node b, P a is the data upload priority of data collection node a, P b To calculate the data acquisition priority of business processing node b, sum(x) is a summation function that outputs the sum of all values in x, P A-b is the data upload priority set of all source data collection nodes that send data to business processing node b, P a-BTo obtain the data acquisition priority set of all business processing nodes that collect data from data collection node a, t b The time interval from the current time point to the next service processing time of service processing node b;
[0078] During the specific implementation, it is considered that a single data collected by the system may be involved in multiple services, and a single service of the system may use multi-source data. Therefore, a normalized priority calculation is performed, and the data transmission priority is calculated based on the time interval between each time point and the next service operation to ensure the balance of different services when each data packet is transmitted in the same physical link, and to perform personalized analysis on each data packet to enhance the continuity of various services in the system.
[0079] The step S500 includes the following contents:
[0080] Real-time monitoring of all data packet information transmitted in the system's physical data transmission links, including data source data collection node information, data destination business processing node information, and data transmission priority data between nodes;
[0081] For data packets in any data transmission physical link, they are sorted from high to low according to the data transmission priority between nodes, and network link resources are allocated to each data packet in turn through network slicing, and the actual network link resource allocation strategy in each physical line is verified;
[0082] When allocating network link resources for data packets in the physical link for data transmission, data packets with higher priority for data transmission between nodes are given priority access to the 5G core network, and network link resources are allocated using network slicing technology for data transmission.
[0083] For data packets with lower data transmission priority between nodes, when network link resources can meet the transmission needs of all data packets, network slicing technology is used to allocate the remaining network link resources for data transmission; when network link resources cannot meet the transmission needs of all data packets, the data packet is cached and preprocessed through edge computing, and network link resources are allocated again when network link resources in the data transmission physical link are sufficient or the data transmission priority of the data packet is improved;
[0084] In specific implementation, high-priority data packets generally include the following characteristics: large data volume, high business complexity, short time interval between participating businesses, high importance of the data contained, and high importance of the businesses involved; therefore, the above technical solution is adopted to manage the transmission and storage of data in the physical link to ensure the overall business balance and continuity of the system and improve the flexibility and scientificity of automatic data transmission and storage management.
[0085] like Figure 2As shown, the present invention also provides a data transmission storage system based on 5G communication technology, the system comprising: a node monitoring module, an edge computing module, and a data transmission management module;
[0086] The node monitoring module monitors the data acquisition and transmission behavior of each data collection node and each business processing node in the system, and obtains the data collection information of all data collection nodes and the business processing information of the business processing nodes; the edge computing module calculates and analyzes the data upload priority of each data collection node and the data acquisition priority of the business processing node based on the data collection information of the data collection nodes and the business processing information of the business processing nodes through the 5G edge computing cloud platform, and then comprehensively calculates the data transmission priority between each data collection node and the business processing node in the system at any time point; the data transmission management module monitors the data transmission priority between the source data collection node and the destination business processing node of the data packet to be transmitted in the physical transmission link of the system in real time, and uses network slicing technology to allocate network link resources to the physical transmission links in each system.
[0087] The node monitoring module includes: a data collection node monitoring unit and a business processing node monitoring unit;
[0088] The data acquisition node monitoring unit is used to monitor the data acquisition behavior of each data acquisition node in the system and obtain data acquisition information of each data acquisition node; the business processing node monitoring unit is used to monitor the data acquisition and transmission behavior of each business processing node and obtain business processing information of each business processing node.
[0089] The edge computing module includes: a data upload priority analysis unit, a data acquisition priority analysis unit, and a data transmission priority calculation unit;
[0090] The data upload priority analysis unit calculates and analyzes the data upload priority of each data collection node based on the data collection information of each data collection node; the data acquisition priority analysis unit calculates and analyzes the data acquisition priority of each business processing node based on the business processing information of each business processing node; the data transmission priority calculation unit comprehensively calculates the data upload priority of each data collection node and the data acquisition priority of each business processing node to calculate the data transmission priority between nodes in the system.
[0091] The data transmission management module includes: a physical transmission link monitoring unit and a data transmission management unit;
[0092] The physical transmission link monitoring unit is used to monitor the data packet information in each physical transmission link in the system; the data transmission management unit uses network slicing technology to allocate network link resources to each data packet according to the data transmission priority between the data acquisition node where the data packet comes from and the destination service processing node.
[0093] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the equivalent elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.
Claims
1. A data transmission and storage method based on 5G communication technology, characterized in that , the method comprises the following analysis steps: Step S100: real-time monitoring of data collection information of all data collection nodes and business processing information of business processing nodes in the system; Step S200: Analyze and calculate the data upload priority of each data collection node according to the data collection information of each data collection node; For any data collection node a, obtain the data collection information of the node collected in real time through the 5G edge computing cloud platform, and calculate the data upload priority of the data collection node a according to the formula: P a =k a ×Δt a ×S a +C a ; Among them, P a is the data upload priority of data collection node a, k a is the data transmission weight of data acquisition node a, Δt a is the time interval between two consecutive data collections of data collection node a, S a is the size of a single data packet collected by data collection node a, C a Constants for data collection node priority evaluation; Step S300: Analyze and calculate the data acquisition priority of each business processing node according to the business processing information of each business processing node; For any business processing node b, obtain the business processing information of the node collected in real time through the 5G edge computing cloud platform, and calculate the data acquisition priority of the business processing node b according to the formula: Among them, P b The data acquisition priority of the business processing node b, k b is the data transmission weight of service processing node b, Δt b is the service processing time interval of service processing node b, i is the source data collection node number of service processing node b, A is the number of data packets provided by source data collection node i for a single service processing of service processing node b, P i is the data upload priority of source data collection node i, N i The number of data packets provided by source data collection node i, C b A constant for evaluating the priority of a business processing node; Step S400: Combining the data upload priority of each data collection node and the data acquisition priority of each business processing node, analyzing the data transmission priority between each data collection node and each business processing node in the system at each time point; The data upload priority of all data collection nodes and the data acquisition priority of all business processing nodes in the system are calculated through the 5G edge computing platform, and the system data transmission priority matrix is constructed and the matrix elements are updated in real time. Each element in the matrix is the data transmission priority of sending data from each data collection node to each business processing node; For any data collection node a and business processing node b, filter the data acquisition priority of all business processing nodes that obtain data from data collection node a and the data upload priority of all data collection nodes that transmit data to business processing node b, and calculate the data transmission priority between nodes at any time point according to the formula: Among them, P a,b is the data transmission priority between data collection node a and business processing node b, P a is the data upload priority of data collection node a, P b To calculate the data acquisition priority of business processing node b, sum(x) is a summation function that outputs the sum of all values in x, P A-b is the data upload priority set of all source data collection nodes that send data to business processing node b, P a-B To obtain the data acquisition priority set of all business processing nodes that collect data from data collection node a, t b The time interval from the current time point to the next service processing time of service processing node b; Step S500: Real-time supervision of data transmission in the data transmission link in the system is performed according to the data transmission priority between each data collection node and each business processing node.
2. According to a data transmission and storage method based on 5G communication technology according to claim 1, it is characterized in that: The step S100 includes the following contents: Through the 5G edge computing cloud platform, the data collection and transmission behaviors of all data collection nodes and business processing nodes in the system are monitored in real time, the data collection information of all data collection nodes and the business processing information of business processing nodes are obtained, and data transmission weights are assigned to each data collection node and each business processing node; The data acquisition node data acquisition information includes the data information type T acquired by the data acquisition node a , the size of the data packet collected in a single time S a , data collection time t, for any data collection node a, its data collection information is recorded as: [T a , S a , AT a (t1, t2, ..., t m )]; among them, AT a is the data collection time set of data collection node a, t1, t2, ..., t m is the data collection time of each data collection node a; The service processing information of the service processing node includes the source data collection node of the service processing node, the number of data packets provided by each source data collection node for a single service processing, and the service processing time. For any service processing node b, its service processing information is recorded as: [(D1, N1), (D2, N2), ..., (D A , N A ), PT b (t1, t2, ..., t n )]; where D1, D2, ..., D A Identify the data collection nodes of each source, N1, N2, ..., N A The number of data packets provided by each source data collection node for a single business processing of business processing node b, PT b is the service processing time set of service processing node b, t1, t2, ..., t n is the service processing time of each service processing node b.
3. According to claim 2, a data transmission and storage method based on 5G communication technology is characterized in that: The step S500 includes the following contents: Real-time monitoring of all data packet information transmitted in the system's physical data transmission links, including data source data collection node information, data destination business processing node information, and data transmission priority data between nodes; For data packets in any data transmission physical link, they are sorted from high to low according to the data transmission priority between nodes, and network link resources are allocated to each data packet in turn through network slicing, and the actual network link resource allocation strategy in each physical line is verified; When allocating network link resources for data packets in the physical link for data transmission, data packets with higher priority for data transmission between nodes are given priority access to the 5G core network, and network link resources are allocated using network slicing technology for data transmission. For data packets with lower data transmission priority between nodes, when network link resources can meet the transmission needs of all data packets, network slicing technology is used to allocate the remaining network link resources for data transmission. When network link resources cannot meet the transmission needs of all data packets, the data packet is cached and preprocessed through edge computing, and network link resources are allocated again when there are sufficient network link resources in the physical link for data transmission or the data transmission priority of the data packet is improved.
4. A data transmission and storage system based on 5G communication technology using a data transmission and storage method based on 5G communication technology as claimed in any one of claims 1 to 3, characterized in that: The system includes: a node monitoring module, an edge computing module, and a data transmission management module; The node monitoring module monitors the data acquisition and transmission behavior of each data collection node and each business processing node in the system, and obtains the data collection information of all data collection nodes and the business processing information of the business processing nodes; the edge computing module calculates and analyzes the data upload priority of each data collection node and the data acquisition priority of the business processing node based on the data collection information of the data collection nodes and the business processing information of the business processing nodes through the 5G edge computing cloud platform, and then comprehensively calculates the data transmission priority between each data collection node and the business processing node in the system at any time point; the data transmission management module monitors the data transmission priority between the source data collection node and the destination business processing node of the data packet to be transmitted in the physical transmission link of the system in real time, and uses network slicing technology to allocate network link resources to the physical transmission links in each system.
5. According to claim 4, a data transmission and storage system based on 5G communication technology is characterized in that: The node monitoring module includes: a data collection node monitoring unit and a business processing node monitoring unit; The data acquisition node monitoring unit is used to monitor the data acquisition behavior of each data acquisition node in the system and obtain data acquisition information of each data acquisition node; the business processing node monitoring unit is used to monitor the data acquisition and transmission behavior of each business processing node and obtain business processing information of each business processing node.
6. According to claim 4, a data transmission and storage system based on 5G communication technology is characterized in that: The edge computing module includes: a data upload priority analysis unit, a data acquisition priority analysis unit, and a data transmission priority calculation unit; The data upload priority analysis unit calculates and analyzes the data upload priority of each data collection node based on the data collection information of each data collection node; the data acquisition priority analysis unit calculates and analyzes the data acquisition priority of each business processing node based on the business processing information of each business processing node; the data transmission priority calculation unit comprehensively calculates the data upload priority of each data collection node and the data acquisition priority of each business processing node to calculate the data transmission priority between nodes in the system.
7. According to claim 4, a data transmission and storage system based on 5G communication technology is characterized in that: The data transmission management module includes: a physical transmission link monitoring unit and a data transmission management unit; The physical transmission link monitoring unit is used to monitor the data packet information in each physical transmission link in the system; the data transmission management unit uses network slicing technology to allocate network link resources to each data packet according to the data transmission priority between the data acquisition node where the data packet comes from and the destination service processing node.
Citation Information
Patent Citations
Uplink eMBB and uRLLC coexistence scheduling method and system based on random forest
CN118413896A
Data distribution method and system for edge computing node and storage medium
CN118802913A