Information communication management system of rail car

By establishing a subnet of shared frequency domain resources of wireless access network in the railcar information and communication management system, and using deep reinforcement learning to optimize resource allocation, the problem that existing systems are difficult to allocate frequency domain resources efficiently in real time and significantly improve the Resource utilization and allocation efficiency.

CN119485221AActive Publication Date: 2025-02-18JIANGSU FLYING SHUTTLE INTELLIGENT CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411648723.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-19
Publication Date
2025-02-18
Estimated Expiration
2044-11-19

AI Technical Summary

Technical Problem

The existing rail vehicle information and communication management system is difficult to allocate wireless access network frequency domain resources in real time and efficiently, and cannot meet the needs of rail vehicle networks under high-speed operation.

Method used

By establishing a subnet that shares frequency domain resources of the wireless access network, and combining deep reinforcement learning to predict the optimal resource allocation state, dynamic optimization allocation of frequency domain resources of the wireless access network is achieved.

Benefits of technology

It greatly improves the allocation efficiency of frequency domain resources of wireless access networks and ensures the quality and stability of rail vehicle information and communication services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119485221A_ABST
    Figure CN119485221A_ABST
Patent Text Reader

Abstract

The invention discloses an information communication management system of a rail car, which belongs to the technical field of data communication management, and comprises the following steps: a communication sub-network module correspondingly establishes a plurality of shared wireless access network frequency domain resource sub-networks according to different service types; the communication transmission rate module calculates the communication transmission rate of the user accessing the sub-network; the communication loss demand module defines signal transmission path loss and dynamic flow demand of the rail car; the allocation efficiency module obtains the frequency domain resource allocation efficiency of the wireless access network through frequency domain resource allocation analysis; the allocation optimization module constructs a frequency domain resource allocation optimization function; and the resource allocation module predicts the optimal resource allocation state of the sub-network at the next moment through deep reinforcement learning, and allocates the wireless access network frequency domain resources to each sub-network. According to the invention, the problem that the existing information communication management system of the rail car is difficult to efficiently allocate the frequency domain resources of the wireless access network in real time is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of communication systems, and in particular relates to an information communication management system for a rail vehicle. Background Art

[0002] The expansion of urban scale and population has made the problem of urban ground traffic congestion more prominent, seriously affecting people's travel efficiency and travel experience. In such an environment, rail transit has begun to be used in more and more cities. Rail transit can divert the pressure of urban ground transportation, effectively alleviate traffic congestion, and provide convenience for urban residents' daily travel.

[0003] Rail vehicles and the network terminals on board move quickly, have a variety of communication services, and have different business requirements. For example, rail vehicle automatic control communication services require low latency and high security, video surveillance services require large bandwidth, and passenger service communication services have great uncertainty. In the wireless communication environment of urban rail transit, the fast-moving rail vehicles and limited wireless signal coverage will cause the frequency domain resources of the wireless access network to change continuously with the operation of the rail vehicles, thereby affecting the information and communication service quality of the rail vehicles. The existing rail vehicle information and communication system's ability to allocate wireless access network frequency domain resources in real time is difficult to meet the network needs of rail vehicles under high-speed operation. Summary of the invention

[0004] In view of the above-mentioned deficiencies in the prior art, the present invention provides an information communication management system for a rail vehicle, which solves the problem that the existing information communication management system for rail vehicles is difficult to allocate frequency domain resources of a wireless access network in real time and efficiently.

[0005] In order to achieve the above-mentioned object of the invention, the technical solution adopted by the present invention is:

[0006] The present invention provides an information communication management system for a rail vehicle, comprising:

[0007] A communication sub-network module, used to establish several sub-networks that share frequency domain resources of a wireless access network;

[0008] A communication transmission rate module, used to calculate the communication transmission rate of the user accessing the sub-network according to the channel bandwidth allocated by the sub-network to the user accessing the sub-network and the signal-to-noise ratio of the user on the channel;

[0009] Communication loss requirement module, used to define the signal transmission path loss and dynamic flow demand of rail vehicles;

[0010] The allocation efficiency module is used to perform frequency domain resource allocation analysis according to the communication transmission rate of the user accessing the sub-network, the signal transmission path loss of the rail vehicle and the dynamic flow demand, so as to obtain the frequency domain resource allocation efficiency of the wireless access network;

[0011] An allocation optimization module, used to construct a frequency domain resource allocation optimization function according to the frequency domain resource allocation efficiency of the wireless access network;

[0012] The resource allocation module is used to predict the optimal resource allocation state of the sub-network at the next moment through deep reinforcement learning based on the frequency domain resource allocation optimization function, and complete the allocation of wireless access network frequency domain resources to each sub-network.

[0013] The beneficial effects of the present invention are as follows: the information communication management system of a rail vehicle provided by the present invention establishes a plurality of sub-networks for sharing the frequency domain resources of the wireless access network of the rail vehicle according to different service types through the communication sub-network module, thereby providing a basis for allocating the frequency domain resources of the wireless access network obtained when the train is traveling according to the service type; through the communication transmission rate module, the communication resources allocated to the user by the sub-network are realized, and the communication transmission rate of the user accessing the sub-network is calculated; through the communication loss requirement module, the signal transmission path loss on the rail vehicle and the dynamic flow demand per unit transmission time of each sub-network are defined, thereby providing a basis for determining the frequency domain resource allocation efficiency of the wireless access network of each sub-network; through the allocation efficiency module, the allocation efficiency of the frequency domain resources of the wireless access network on the rail vehicle is analyzed, thereby providing a basis for constructing a frequency domain resource allocation optimization function; through the resource allocation module, according to the frequency domain resource allocation optimization function, based on deep reinforcement learning, the optimal allocation of the frequency domain resources of the wireless access network that dynamically changes in the rail vehicle is realized, thereby greatly improving the efficiency of allocating the frequency domain resources of the wireless access network while ensuring the normal and stable operation of the business.

[0014] Other advantages of the present invention will be analyzed in more detail in subsequent embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0016] Figure 1 A block diagram of an information communication management system for a rail vehicle provided by the present invention. DETAILED DESCRIPTION

[0017] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. The components of the embodiments of the present invention generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of the claimed invention, but merely represents the selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present invention.

[0018] SLA (Service-Level Agreement) is a service level agreement that can clearly define the quality of service.

[0019] like Figure 1 As shown, in one embodiment of the present invention, the present invention provides an information communication management system for a rail vehicle, comprising:

[0020] The communication subnetwork module is used to establish several subnetworks that share the frequency domain resources of the wireless access network. The subnetwork builds multiple dedicated, virtualized, and mutually isolated logical networks on a common physical network to meet the differentiated needs of different services for network capabilities. The subnetwork can reduce the cost of building multiple private networks while providing highly flexible on-demand network services. In this embodiment, the types of subnetworks include low-latency transportation subnetworks, bandwidth-enhanced transportation subnetworks, and bandwidth-enhanced public subnetworks. The low-latency transportation subnetwork is an ultra-high reliability and low-latency communication subnetwork built based on rail transit frequency band resources, the bandwidth-enhanced transportation subnetwork is an enhanced mobile broadband communication subnetwork built based on rail transit frequency band resources, and the bandwidth-enhanced transportation public subnetwork is an enhanced mobile broadband communication subnetwork built based on public frequency band resources.

[0021] A communication transmission rate module, used to calculate the communication transmission rate of the user accessing the sub-network according to the channel bandwidth allocated by the sub-network to the user accessing the sub-network and the signal-to-noise ratio of the user on the channel;

[0022] The calculation expression of the communication transmission rate of the access user in the sub-network is as follows:

[0023] ,

[0024] ,

[0025] ,

[0026] in, Indicates the communication transmission rate of users accessing the sub-network. It represents the channel bandwidth allocated by the sub-network to the users accessing the sub-network, s represents the sub-network, and u represents the users accessing the sub-network. represents the logarithmic function with base 2, represents the signal-to-noise ratio of the user accessing the sub-network on the channel, ∈ represents the channel belonging to, Indicates the set of users accessing the subnet. Indicates any choice, represents the first sub-network, represents the second sub-network, represents the i-th sub-network, represents the nth subnetwork, Indicates the power allocated by the base station to users accessing the sub-network. represents the channel gain, Indicates the interference of other signals, represents the noise power spectral density, where n is the total number of sub-networks, i = 1, 2, …, n.

[0027] Communication loss requirement module, used to define the signal transmission path loss and dynamic flow demand of rail vehicles;

[0028] The calculation expressions of the signal transmission path loss and the dynamic flow demand are as follows:

[0029] ,

[0030] ,

[0031] Where SPL(d) represents the signal transmission path loss, represents the coupling loss, Indicates the distance between the terminal and the antenna. represents the wireless signal transmission loss coefficient, d represents the dynamic traffic demand set within the transmission time interval, Indicates the dynamic traffic demand of the first sub-network within the transmission time interval, Indicates the dynamic traffic demand of the second sub-network within the transmission time interval, represents the dynamic traffic demand of the ith sub-network within the transmission time interval, represents the dynamic traffic demand of the nth sub-network within the transmission time interval, and represents the set of data packets transmitted between all users accessing the ith sub-network and the base station within the transmission time interval. In this embodiment, the dynamic service traffic demand reflects the data packet transmission volume within the transmission time interval.

[0032] The allocation efficiency module is used to perform frequency domain resource allocation analysis according to the communication transmission rate of the user accessing the sub-network, the signal transmission path loss of the rail vehicle and the dynamic flow demand, so as to obtain the frequency domain resource allocation efficiency of the wireless access network;

[0033] The distribution efficiency module includes:

[0034] The SLA constraint submodule is used to constrain the data transmission rate, data transmission delay and channel bandwidth of each subnetwork within the communication transmission time interval to obtain SLA constraints;

[0035] The calculation expression of the SLA constraint is as follows:

[0036] ,

[0037] in, Indicates the data transmission rate threshold, The data transmission delay representing the communication transmission time interval, Indicates the data transmission delay threshold. Indicates the channel bandwidth threshold allocated to the subnetwork;

[0038] The SLA satisfaction rate submodule is used to calculate the SLA satisfaction rate based on the SLA constraints and the dynamic data packet transmission volume of the sub-network;

[0039] The calculation expression of the SLA satisfaction rate is as follows:

[0040] ,

[0041] in, Indicates the SLA satisfaction rate of the sub-network. Indicates the data packets transmitted by users accessing the sub-network within the communication transmission time interval. represents the SLA constraint satisfaction variable of the sub-network, It represents the set of data packets transmitted between all users accessing the sub-network and the base station within the transmission time interval;

[0042] In this embodiment, when the base station and the user accessing the sub-network transmit the data packet at a rate not less than the data transmission rate threshold within the communication transmission time interval, , the data transmission delay is not greater than the data transmission delay threshold If the transmission is successful and the occupied channel does not exceed the channel bandwidth threshold allocated to the subnetwork, the SLA constraint satisfaction variable is 1, otherwise it is 0.

[0043] The frequency domain allocation efficiency submodule is used to calculate the frequency domain resource allocation efficiency of the wireless access network based on the SLA satisfaction rate and the frequency domain resource utilization efficiency;

[0044] The calculation expression of the frequency domain resource allocation efficiency of the wireless access network is as follows:

[0045] ,

[0046] ,

[0047] ,

[0048] in, represents the frequency domain resource allocation efficiency of the wireless access network, Indicates the SLA satisfaction rate weight factor, Indicates the SLA satisfaction rate based on dynamic traffic demand and sub-network frequency domain resources. represents the frequency domain resource utilization efficiency weight factor, Indicates the frequency domain resource utilization efficiency based on dynamic traffic demand and sub-network frequency domain resources, represents the sum of the communication transmission rates of all users accessing all sub-networks, W represents the total frequency domain resources of the fixed bandwidth of the base station, Indicates the frequency domain resources allocated to the sub-network, represents the frequency domain resources allocated to the first sub-network, represents the frequency domain resources allocated to the i-th sub-network, Represents the frequency domain resources allocated to the nth sub-network.

[0049] An allocation optimization module, used to construct a frequency domain resource allocation optimization function according to the frequency domain resource allocation efficiency of the wireless access network;

[0050] The calculation expression of the frequency domain resource allocation optimization function is as follows:

[0051] ,

[0052] ,

[0053] ,

[0054] in, represents the maximum independent variable point set function, Indicates that so.

[0055] The resource allocation module is used to predict the optimal resource allocation state of the sub-network at the next moment through deep reinforcement learning based on the frequency domain resource allocation optimization function, and complete the allocation of wireless access network frequency domain resources to each sub-network.

[0056] The resource allocation module comprises:

[0057] The allocation state definition submodule is used to take the dynamic traffic demand of each subnetwork at each moment from the previous T moments to the current moment as the resource allocation state of the subnetwork at the current moment, and use the BiGRU network based on the resource allocation state of the subnetwork to predict the dynamic traffic demand of the subnetwork at the next moment as the resource allocation state of the subnetwork at the next moment;

[0058] The calculation expression of the resource allocation state of the sub-network at the next moment is as follows:

[0059] ,

[0060] ,

[0061] , ,

[0062] ,

[0063] in, Indicates the resource allocation state of the subnetwork at the next moment, represents the softmax activation function, represents the weight of the fully connected layer, represents the final hidden state at the current moment, b represents the bias of the fully connected layer, represents the forward hidden state at the current moment, represents the forward hidden state at the previous moment, represents the backward hidden state at the current moment, represents the backward hidden state at the next moment, Represents a splicing operation, represents the GRU unit, Indicates the resource allocation status of the subnetwork at the current moment. represents the dynamic traffic demand of the sub-network before time T, represents the dynamic traffic demand of the sub-network before time T-1, represents the dynamic traffic demand of the sub-network at the previous moment, Indicates the dynamic traffic demand of the subnetwork at the current moment;

[0064] In this embodiment, the dynamic traffic demand of the subnetwork reflects the data packet transmission volume within the transmission time interval, and the data packet transmission volume of the communication service itself is a kind of time series data, which can be predicted in time series. Since the service types of different subnetworks are different, and there is no obvious time correlation between the dynamic traffic demands of different service types, the time series prediction of the dynamic traffic demand can only be performed for each subnetwork separately. Since the rail vehicle moves at a fast speed, the available frequency domain resources of the wireless access network also change quickly, and the dynamic traffic demand corresponding to each subnetwork changes quickly, which is equivalent to a short-term fast time series prediction, with a short sequence length and high requirements for computational efficiency. Therefore, in this solution, the BiGRU network is used to predict the dynamic traffic demand at the next moment, so as to perform the optimal frequency domain resource allocation of the wireless access network according to the prediction results.

[0065] An action definition submodule is used to use the channel bandwidth allocated to each subnetwork as the resource allocation action of the subnetwork to obtain the resource allocation action space;

[0066] The calculation expression of the resource allocation action space is as follows:

[0067] ,

[0068] ,

[0069] Among them, A represents the resource allocation action space, Indicates the first resource allocation action of allocating channel bandwidth to the sub-network. represents the jth resource allocation action to allocate channel bandwidth to the sub-network, represents the pth resource allocation action to allocate channel bandwidth to the subnetwork, represents the channel bandwidth allocated to the first sub-network under the j-th resource allocation action, represents the channel bandwidth allocated to the nth subnetwork under the jth resource allocation action, where p is the total number of actions in the resource allocation action space;

[0070] The reward function definition submodule is used to construct a resource allocation reward function based on the frequency domain resource allocation optimization function;

[0071] The calculation expression of the resource allocation reward function is as follows:

[0072] ,

[0073] ,

[0074] ,

[0075] in, represents the resource allocation reward function, represents the sub-network SLA satisfaction rate reward function, Indicates that the SLA satisfies the variable weight, represents the frequency domain resource utilization reward function, represents the subnetwork priority coefficient, Indicates the minimum SLA satisfaction rate threshold. represents the frequency domain resource utilization weight, represents the frequency domain resource utilization efficiency, Indicates the minimum frequency domain resource utilization efficiency threshold;

[0076] In this embodiment, if the SLA satisfaction rate of all sub-networks is not lower than the minimum SLA satisfaction rate threshold, the SLA satisfaction variable weight is 1, otherwise it is 0; in this embodiment, the sub-network priority coefficient corresponding to the communication service related to the rail vehicle is greater than the sub-network priority coefficient corresponding to the communication service related to the non-rail vehicle, so as to give priority to the safe and stable operation of the rail vehicle. Based on the resource allocation reward function, it can not only ensure the stability of the communication service, but also provide a basis for evaluating the frequency domain resource utilization of the sub-network, thereby further improving the utilization of the frequency domain resources of the wireless access network.

[0077] The resource allocation submodule is used to predict the optimal resource allocation state of the subnetwork at the next moment based on the resource allocation action space and the resource allocation reward function through deep reinforcement learning, and complete the allocation of wireless access network frequency domain resources to each subnetwork.

[0078] The resource allocation submodule includes:

[0079] An execution network unit is used to obtain a probability distribution of resource allocation actions according to execution network parameters, a resource allocation state of the subnetwork at the next moment, and a resource action allocation space, and to obtain a target resource allocation action by sampling;

[0080] An evaluation network unit, used to evaluate the resource allocation state at each moment according to the evaluation network parameters, and obtain the resource allocation state value at each moment;

[0081] A state action evaluation unit, used to evaluate the resource allocation state of the sub-network at the current moment and the target resource allocation action at the current moment, and obtain a state action evaluation result;

[0082] The calculation expression of the state action evaluation result is as follows:

[0083] ,

[0084] in, Indicates the state action evaluation result, It represents the immediate reward obtained by executing the target resource allocation action at the current moment under the resource allocation state of the sub-network at the current moment. represents the state transfer value discount factor, It indicates the evaluation value of the resource allocation state of the sub-network at the current moment being transferred to the resource allocation state of the sub-network at the next moment through the target resource allocation action at the current moment. Indicates the resource allocation status value of the subnetwork at the current moment.

[0085] An execution network parameter updating unit, configured to update the execution network parameters based on the execution network parameter updating model according to the execution network parameters and evaluation network parameters at the current moment, the resource allocation state of the sub-network at the current moment, the target resource allocation action at the current moment, the resource allocation state of the sub-network at the next moment, and the state action evaluation result;

[0086] An evaluation network parameter updating unit, used to update the evaluation network parameters based on the evaluation network parameter updating model according to the evaluation network parameters and execution network parameters at the current moment, the resource allocation state of the sub-network at the current moment, the target resource allocation action at the current moment, the resource allocation state of the sub-network at the next moment, and the state action evaluation result;

[0087] The calculation expressions of the execution network parameter update model and the evaluation network parameter update model are as follows:

[0088] ,

[0089] ,

[0090] in, Indicates the execution network parameters, indicates assignment update, log indicates logarithmic operation, It represents the probability that the execution network selects the target resource allocation action at the current moment under the resource allocation state of the sub-network at the current moment. represents the logarithm of probability, represents the gradient of the logarithm of probability with respect to the execution network parameters, It represents the evaluation value of the evaluation network on the resource allocation state of the sub-network at the next moment. It represents the evaluation value of the evaluation network on the resource allocation status of the sub-network at the current moment. represents the evaluation network parameters, It represents the gradient of the evaluation network parameters regarding the evaluation value of the resource allocation state of the sub-network at the current moment.

[0091] The resource allocation optimization unit is used to obtain the optimal resource allocation state of the subnetwork at the next moment based on the resource allocation reward function, the target resource allocation action and the resource allocation state value at the next moment, based on the optimal resource allocation model, and complete the allocation of wireless access network frequency domain resources to each subnetwork.

[0092] The calculation expression of the optimal resource allocation model is as follows:

[0093] ,

[0094] in, It indicates the optimal value of executing the target resource allocation action at the current moment under the resource allocation state of the sub-network at the current moment to transfer to the resource allocation state of the sub-network at the next moment.

[0095] Based on the optimal resource allocation module, according to the maximum result of the resource allocation reward function, the resource allocation state of the sub-network at the next moment corresponding to the optimal value can be obtained, which is used as the optimal resource allocation state of the sub-network at the next moment, and the frequency domain resources of the wireless access network at that moment are allocated to each sub-network according to the optimal resource allocation state of the sub-network at the next moment, and the frequency domain resources of the wireless access network are allocated to each sub-network. The information communication management system of the rail vehicle provided by this solution can effectively improve the utilization rate and allocation efficiency of the frequency domain resources of the wireless access network obtained in real time during the movement of the rail vehicle.

[0096] The above description is only a specific implementation mode of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. An information communication management system for a rail vehicle, characterized in that: include: A communication sub-network module, used to establish several sub-networks that share frequency domain resources of a wireless access network; A communication transmission rate module, used to calculate the communication transmission rate of the user accessing the sub-network according to the channel bandwidth allocated by the sub-network to the user accessing the sub-network and the signal-to-noise ratio of the user on the channel; Communication loss requirement module, used to define the signal transmission path loss and dynamic flow demand of rail vehicles; The allocation efficiency module is used to perform frequency domain resource allocation analysis according to the communication transmission rate of the user accessing the sub-network, the signal transmission path loss of the rail vehicle and the dynamic flow demand, so as to obtain the frequency domain resource allocation efficiency of the wireless access network; An allocation optimization module, used to construct a frequency domain resource allocation optimization function according to the frequency domain resource allocation efficiency of the wireless access network; The resource allocation module is used to predict the optimal resource allocation state of the sub-network at the next moment through deep reinforcement learning based on the frequency domain resource allocation optimization function, and complete the allocation of wireless access network frequency domain resources to each sub-network.

2. The information communication management system for rail vehicles according to claim 1, characterized in that: The calculation expression of the communication transmission rate of the access user in the sub-network is as follows: , , , in, Indicates the communication transmission rate of users accessing the sub-network. It represents the channel bandwidth allocated by the sub-network to the users accessing the sub-network, s represents the sub-network, and u represents the users accessing the sub-network. represents the logarithmic function with base 2, represents the signal-to-noise ratio of the user accessing the sub-network on the channel, ∈ represents the channel belonging to, Indicates the set of users accessing the subnet. Indicates any choice, represents the first sub-network, represents the second sub-network, represents the i-th sub-network, represents the nth subnetwork, Indicates the power allocated by the base station to users accessing the sub-network. represents the channel gain, Indicates the interference of other signals, represents the noise power spectral density, where n is the total number of sub-networks, i = 1, 2, …, n.

3. The information communication management system for rail vehicles according to claim 2, characterized in that: The calculation expressions of the signal transmission path loss and the dynamic flow demand are as follows: , , Where SPL(d) represents the signal transmission path loss, represents the coupling loss, Indicates the distance between the terminal and the antenna. represents the wireless signal transmission loss coefficient, d represents the dynamic traffic demand set within the transmission time interval, Indicates the dynamic traffic demand of the first sub-network within the transmission time interval, Indicates the dynamic traffic demand of the second sub-network within the transmission time interval, represents the dynamic traffic demand of the ith sub-network within the transmission time interval, It represents the dynamic traffic demand of the nth sub-network within the transmission time interval, and it represents the set of data packets transmitted between all users accessing the ith sub-network and the base station within the transmission time interval.

4. The information communication management system for rail vehicles according to claim 3, characterized in that: The distribution efficiency module includes: The SLA constraint submodule is used to constrain the data transmission rate, data transmission delay and channel bandwidth of each subnetwork within the communication transmission time interval to obtain SLA constraints; The calculation expression of the SLA constraint is as follows: , in, Indicates the data transmission rate threshold, The data transmission delay representing the communication transmission time interval, Indicates the data transmission delay threshold. Indicates the channel bandwidth threshold allocated to the subnetwork; The SLA satisfaction rate submodule is used to calculate the SLA satisfaction rate based on the SLA constraints and the dynamic data packet transmission volume of the sub-network; The calculation expression of the SLA satisfaction rate is as follows: , in, Indicates the SLA satisfaction rate of the sub-network. Indicates the data packets transmitted by users accessing the sub-network within the communication transmission time interval. represents the SLA constraint satisfaction variable of the sub-network, It represents the set of data packets transmitted between all users accessing the sub-network and the base station within the transmission time interval; The frequency domain allocation efficiency submodule is used to calculate the frequency domain resource allocation efficiency of the wireless access network based on the SLA satisfaction rate and the frequency domain resource utilization efficiency; The calculation expression of the frequency domain resource allocation efficiency of the wireless access network is as follows: , , , in, represents the frequency domain resource allocation efficiency of the wireless access network, Indicates the SLA satisfaction rate weight factor, Indicates the SLA satisfaction rate based on dynamic traffic demand and sub-network frequency domain resources. represents the frequency domain resource utilization efficiency weight factor, Indicates the frequency domain resource utilization efficiency based on dynamic traffic demand and sub-network frequency domain resources, represents the sum of the communication transmission rates of all users accessing all sub-networks, W represents the total frequency domain resources of the fixed bandwidth of the base station, Indicates the frequency domain resources allocated to the sub-network, represents the frequency domain resources allocated to the first sub-network, represents the frequency domain resources allocated to the i-th sub-network, Represents the frequency domain resources allocated to the nth sub-network.

5. The information communication management system for rail vehicles according to claim 4, characterized in that: The calculation expression of the frequency domain resource allocation optimization function is as follows: , , , in, represents the maximum independent variable point set function, Indicates that so.

6. The information communication management system for rail vehicles according to claim 5, characterized in that: The resource allocation module comprises: The allocation state definition submodule is used to take the dynamic traffic demand of each subnetwork at each moment from the previous T moments to the current moment as the resource allocation state of the subnetwork at the current moment, and use the BiGRU network based on the resource allocation state of the subnetwork to predict the dynamic traffic demand of the subnetwork at the next moment as the resource allocation state of the subnetwork at the next moment; The calculation expression of the resource allocation state of the sub-network at the next moment is as follows: , , , , , in, Indicates the resource allocation state of the subnetwork at the next moment, represents the softmax activation function, represents the weight of the fully connected layer, represents the final hidden state at the current moment, b represents the bias of the fully connected layer, represents the forward hidden state at the current moment, represents the forward hidden state at the previous moment, represents the backward hidden state at the current moment, represents the backward hidden state at the next moment, Represents a splicing operation, represents the GRU unit, Indicates the resource allocation status of the subnetwork at the current moment. represents the dynamic traffic demand of the sub-network before time T, represents the dynamic traffic demand of the sub-network before time T-1, represents the dynamic traffic demand of the sub-network at the previous moment, Indicates the dynamic traffic demand of the subnetwork at the current moment; An action definition submodule is used to use the channel bandwidth allocated to each subnetwork as the resource allocation action of the subnetwork to obtain the resource allocation action space; The calculation expression of the resource allocation action space is as follows: , , Among them, A represents the resource allocation action space, Indicates the first resource allocation action of allocating channel bandwidth to the sub-network. represents the jth resource allocation action to allocate channel bandwidth to the sub-network, represents the pth resource allocation action to allocate channel bandwidth to the subnetwork, represents the channel bandwidth allocated to the first sub-network under the j-th resource allocation action, represents the channel bandwidth allocated to the nth subnetwork under the jth resource allocation action, where p is the total number of actions in the resource allocation action space; The reward function definition submodule is used to construct a resource allocation reward function based on the frequency domain resource allocation optimization function; The calculation expression of the resource allocation reward function is as follows: , , , in, represents the resource allocation reward function, represents the sub-network SLA satisfaction rate reward function, Indicates that the SLA satisfies the variable weights, represents the frequency domain resource utilization reward function, represents the subnetwork priority coefficient, Indicates the minimum SLA satisfaction rate threshold. represents the frequency domain resource utilization weight, represents the frequency domain resource utilization efficiency, Indicates the minimum frequency domain resource utilization efficiency threshold; The resource allocation submodule is used to predict the optimal resource allocation state of the subnetwork at the next moment based on the resource allocation action space and the resource allocation reward function through deep reinforcement learning, and complete the allocation of wireless access network frequency domain resources to each subnetwork.

7. The information communication management system for rail vehicles according to claim 6, characterized in that: The resource allocation submodule includes: An execution network unit is used to obtain a probability distribution of resource allocation actions according to execution network parameters, a resource allocation state of the subnetwork at the next moment, and a resource action allocation space, and to obtain a target resource allocation action by sampling; An evaluation network unit, used to evaluate the resource allocation state at each moment according to the evaluation network parameters, and obtain the resource allocation state value at each moment; A state action evaluation unit, used to evaluate the resource allocation state of the sub-network at the current moment and the target resource allocation action at the current moment, and obtain a state action evaluation result; An execution network parameter updating unit, configured to update the execution network parameters based on the execution network parameter updating model according to the execution network parameters and evaluation network parameters at the current moment, the resource allocation state of the sub-network at the current moment, the target resource allocation action at the current moment, the resource allocation state of the sub-network at the next moment, and the state action evaluation result; An evaluation network parameter updating unit, used to update the evaluation network parameters based on the evaluation network parameter updating model according to the evaluation network parameters and execution network parameters at the current moment, the resource allocation state of the sub-network at the current moment, the target resource allocation action at the current moment, the resource allocation state of the sub-network at the next moment, and the state action evaluation result; The resource allocation optimization unit is used to obtain the optimal resource allocation state of the subnetwork at the next moment based on the resource allocation reward function, the target resource allocation action and the resource allocation state value at the next moment, based on the optimal resource allocation model, and complete the allocation of wireless access network frequency domain resources to each subnetwork.

8. The information communication management system for rail vehicles according to claim 7, characterized in that: The calculation expression of the state action evaluation result is as follows: , in, Indicates the state action evaluation result, It represents the immediate reward obtained by executing the target resource allocation action at the current moment under the resource allocation state of the sub-network at the current moment. represents the state transfer value discount factor, It indicates the evaluation value of the resource allocation state of the sub-network at the current moment being transferred to the resource allocation state of the sub-network at the next moment through the target resource allocation action at the current moment. Indicates the resource allocation status value of the subnetwork at the current moment.

9. The information communication management system for rail vehicles according to claim 8, characterized in that: The calculation expressions of the execution network parameter update model and the evaluation network parameter update model are as follows: , , in, Indicates the execution network parameters, indicates assignment update, log indicates logarithmic operation, It represents the probability that the execution network selects the target resource allocation action at the current moment under the resource allocation state of the sub-network at the current moment. represents the logarithm of probability, represents the gradient of the logarithm of probability with respect to the execution network parameters, It represents the evaluation value of the evaluation network on the resource allocation state of the sub-network at the next moment. It represents the evaluation value of the evaluation network on the resource allocation status of the sub-network at the current moment. represents the evaluation network parameters, It represents the gradient of the evaluation network parameters regarding the evaluation value of the resource allocation state of the sub-network at the current moment.

10. The information communication management system for rail vehicles according to claim 9, characterized in that: The calculation expression of the optimal resource allocation model is as follows: , in, It indicates the optimal value of executing the target resource allocation action at the current moment under the resource allocation state of the sub-network at the current moment to transfer to the resource allocation state of the sub-network at the next moment.

Citation Information

Patent Citations

  • Internet of Vehicles spectrum resource allocation method and system based on user experience quality

    CN111510882A

  • Method for determining working efficiency of road side unit and related device

    CN115103331A

  • Mobile communication networking method and system for rail transit

    CN116321062A

  • High-speed internet access system and method suitable for low-orbit satellite

    CN119135245A