A multi-mode communication agile adaptation method and system

Abstract

The present invention discloses a multimode communication agile adaptation method and system, which relate to the field of autonomous driving technology, and include: obtaining driving scene information through a multimode communication node, and generating multimode communication network element information based on the driving scene information; obtaining travel information through a multimode communication vehicle node, and generating communication exchange content information based on the multimode communication network element information and the travel information; the multimode communication vehicle node determines a multimode communication terminal node set based on the communication exchange content information, and determines a service quality parameter set according to the multimode communication terminal node set; generates communication mode decision variables based on the service quality parameter set and the communication exchange content information, and optimizes the communication mode decision variables to obtain optimal service quality parameters; realizes communication between multimode communication nodes through the optimal service quality parameters; the present invention solves the problems of low communication efficiency and high communication delay in the existing multimode communication adaptation method.

Description

Technical Field

[0001] The present invention relates to the field of autonomous driving technology, and in particular to a multi-mode communication agile adaptation method and system. Background Art

[0002] With the development of vehicle networking communication technology, corresponding progress has been made in road safety and driving energy efficiency. In vehicle networking communication applications, the choice of communication mode directly affects the rate, delay, and reliability of data transmission, and thus affects the communication efficiency of the overall communication unit of the vehicle networking. The high dynamics and spatiotemporal complexity of the network topology caused by the high-speed movement of vehicles, the complex and fast-changing wireless propagation environment, the new scientific problems of low latency and high reliability communication under high node density and high communication frequency, are subject to various factors such as driving scenarios, driving intentions, and business needs. Different communication modes have their own advantages and limitations. Therefore, the on-board unit needs to quickly and adaptively select the corresponding communication mode or combination of communication modes according to the driving scenario, driving intention, and business needs.

[0003] At present, the existing multi-mode communication agile adaptation methods cannot deeply analyze the communication terminals and data quality requirements that need to be transmitted by communication data services based on the three major factors of driving scenarios, driving intentions, and business needs, and it is difficult to combine the various communication modes and corresponding communication capabilities of the communication initiator to build a multi-mode communication agile adaptation mechanism for the Internet of Vehicles. It can be seen that the existing multi-mode communication adaptation methods have the problems of low communication efficiency and high communication delay. Summary of the invention

[0004] The present invention provides a multi-mode communication agile adaptation method and system to solve the problems of low communication efficiency and high communication delay in the existing multi-mode communication adaptation method.

[0005] In order to achieve the above object, the present invention is implemented by the following technical solutions:

[0006] In a first aspect, the present invention provides a multimode communication agile adaptation method, the method comprising:

[0007] Determining a multimode communication node in a driving environment, wherein the multimode communication node includes: a multimode communication vehicle node and a multimode communication non-vehicle node;

[0008] Acquiring driving scene information through a multimode communication node, and generating multimode communication network element information based on the driving scene information;

[0009] Acquiring travel information through a multimode communication vehicle node, and generating communication exchange content information based on the multimode communication network element information and the travel information;

[0010] The multimode communication vehicle node determines a set of multimode communication terminal nodes based on the communication exchange content information, and determines a set of quality of service parameters according to the set of multimode communication terminal nodes;

[0011] Generate communication mode decision variables based on the service quality parameter set and the communication exchange content information, and optimize the communication mode decision variables to obtain optimal service quality parameters;

[0012] Communication between multi-mode communication nodes is achieved through optimal quality of service parameters.

[0013] Optionally, determining the multimode communication node in the driving environment includes:

[0014] Determine a multimode communication node in the driving environment, and then the multimode communication node determines all other multimode communication nodes related to the vehicle driving;

[0015] The multi-mode communication nodes are divided into multi-mode communication vehicle nodes and multi-mode communication non-vehicle nodes. The relative position information between the multi-mode communication nodes is determined by acquiring relevant position information with respect to the driving environment.

[0016] Optionally, the acquiring driving scene information through the multi-mode communication node includes:

[0017] Collect the traffic conditions, vehicle status and network status in the current driving environment through communication equipment, perception equipment or information fusion center, and integrate the traffic conditions, vehicle status and network status into driving scene information;

[0018] Generating multi-mode communication network element information based on the driving scenario information includes:

[0019] The multimode communication node determines all communication modes adapted to the multimode communication terminal node set, constructs a communication mode set from all communication modes adapted to the multimode communication node, and uses the communication mode set as multimode communication network element information.

[0020] Optionally, the obtaining travel information through a multi-mode communication vehicle node includes:

[0021] The multi-mode communication vehicle node collects the vehicle driving information at the current moment according to the vehicle communication equipment, the vehicle sensing equipment and the information fusion center, and uses the vehicle driving information as the travel information.

[0022] Optionally, the multimode communication vehicle node determines a set of multimode communication terminal nodes based on the communication exchange content information, including:

[0023] The multimode communication vehicle node determines a set of multimode communication terminal nodes that need to communicate with the multimode communication vehicle node based on the communication exchange content information, multimode communication network element information and driving scenario information. The multimode communication terminal node set includes all multimode communication nodes that need to communicate with the multimode communication vehicle node in the current driving environment.

[0024] Optionally, determining a set of quality of service parameters according to the set of multimode communication terminal nodes includes:

[0025] The delay requirements and reliability requirements when a multi-mode communication vehicle node communicates with a set of multi-mode communication terminal nodes are determined based on the communication exchange content information, and the delay requirements and reliability requirements are integrated into a set of service quality parameters.

[0026] Optionally, the generating a communication mode decision variable based on the service quality parameter set and the communication exchange content information includes:

[0027] The communication mode decision variables are generated according to the multi-mode communication network element information, the service quality parameter set and the communication exchange content information.

[0028] Optionally, optimizing the communication mode decision variable to obtain an optimal service quality parameter includes:

[0029] The communication mode decision variables are optimized through the corresponding optimization criteria, and the optimization criteria satisfy the following learning model:

[0030]

[0031] Among them, the performance criterion function Indicates the specific performance criteria designed according to requirements, such as meeting the transmission delay of all multi-mode communication nodes.

[0032] Optionally, the learning model construction process is as follows:

[0033] The Markov decision model in the multi-mode communication agile adaptation method for the Internet of Vehicles is constructed, including three key elements: state, action, and reward, which are defined as follows:

[0034] State: The state in the Markov decision model reflects the multi-mode communication node of the agent in the current period The set of supportable communication network elements with other multi-mode communication nodes, the multi-mode communication node at the current moment The state set is represented as :

[0035] ;

[0036] Action: In the constructed Markov decision model, the multi-mode communication node At the current moment, it is decided to use a certain communication mode for communication or not. A communication mode strategy of a communication node set is an action, and the action space is expressed as:

[0037] ;

[0038] in, Represents the multi-mode communication vehicle node at the current moment The network status, Represents the multi-mode communication vehicle node at the current moment In network status action space;

[0039] Reward: Based on the current State and Action, the reinforcement learning algorithm obtains rewards through evaluation , Indicates the multi-mode communication node at the current moment The reward value, Indicates the multi-mode communication node at the current moment The decision action, that is, the decision variable :

[0040] ;

[0041] Indicates the current decision action After that, multi-mode communication nodes According to the corresponding QoS, the rewards are obtained, and the performance criterion function Used to quantify the performance of specific decision actions in communication networks;

[0042] Multimode communication node The state transition probability , its specific definition is expressed as:

[0043] ;

[0044] State transition probability Indicates the multi-mode communication node at the current moment After deciding to adopt a certain communication mode, the state set at the next moment The probability distribution of , , Respectively represent the multi-mode communication nodes at the next moment Multimode communication nodes Available communication modes The support status of the multi-mode communication node at the next moment Multimode communication nodes In communication mode The size of the data to be sent in the lower buffer, the multi-mode communication node at the next moment Multimode communication nodes The bandwidth of available communication modes;

[0045] Multimode communication node The policy function , its specific definition is expressed as:

[0046] ;

[0047] Indicates the environment status is When the multi-mode communication node Select Action The mapping of Indicates the probability of selecting an action. It is used to determine the multi-mode communication node according to the state transition probability at the current moment. Multimode communication nodes Communication mode How to decide on the next step;

[0048] Multimode communication node State value function under the QoS constraint of communication service quality , its specific definition is expressed as:

[0049] ;

[0050] Represents a multimode communication node In Status The expected return under is used to measure the environmental state Agile Adaptation Strategy assessment. represents the reward decay coefficient, Indicates the environment status is Expected reward when

[0051] State-Action Value Function , its specific definition is expressed as:

[0052] ;

[0053] Estimated to be in state Take Action The expected return obtained after the training is to complete the exchange of content under the QoS constraint. transmission and maximize the cumulative rewards. Indicates the multi-mode communication node at the next moment decision-making action.

[0054] In a second aspect, an embodiment of the present application provides a vehicle multi-mode communication agile adaptation system, including a processor and a memory;

[0055] Memory, used to store computer programs;

[0056] The processor is used to implement any method step described in the first aspect when executing a program stored in the memory.

[0057] Beneficial effects:

[0058] The multimode communication agile adaptation method provided by the present invention obtains driving scene information through a multimode communication node, and generates multimode communication network element information based on the driving scene information; obtains travel information through a multimode communication vehicle node, and generates communication exchange content information based on the multimode communication network element information and the travel information; the multimode communication vehicle node determines a multimode communication terminal node set based on the communication exchange content information, and determines a service quality parameter set according to the multimode communication terminal node set; generates a communication mode decision variable based on the service quality parameter set and the communication exchange content information, and optimizes the communication mode decision variable to obtain an optimal service quality parameter; realizes communication between multimode communication nodes through the optimal service quality parameter; thereby, an agile adaptation mechanism for multimode communication equipment in a vehicle networking environment is specifically constructed based on driving scene-driving intention-business demand elements, and by matching the communication exchange content information, there is no need to overly rely on real-time collection and analysis of scene element information of specific multimode communication nodes, which is conducive to quickly generating service quality parameters and corresponding objective functions, so that it can meet the reasonable update of scene element information for frequently changing external scene information;

[0059] It is worth noting that this method is applicable to the Internet of Vehicles scenario based on vehicle business demand factors as input variables, effectively providing the prediction capability of communication modes based on short-term future decisions beyond traditional algorithms, while avoiding the long-term solution problem of deep learning algorithms on unstable business demand factors. Through agile analysis of driving scenarios, driving intentions, and business needs, the flexibility and real-time performance of the vehicle-mounted multi-mode gateway communication process are improved, so that it can better meet the ever-changing Internet of Vehicles needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Figure 1 A flowchart of a multi-mode communication agile adaptation method according to a preferred embodiment of the present invention;

[0061] Figure 2 A schematic diagram of a multi-mode communication agile adaptation method according to a preferred embodiment of the present invention;

[0062] Figure 3 Schematic diagram of traffic status and vehicle status according to a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0063] The technical solution of the present invention is described clearly and completely below. Obviously, the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0064] Unless otherwise defined, the technical terms or scientific terms used in the present invention shall have the usual meanings understood by persons with ordinary skills in the field to which the present invention belongs. The words "first", "second" and similar words used in the present invention do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, words such as "one" or "one" do not indicate quantity restrictions, but indicate the existence of at least one. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship also changes accordingly.

[0065] See also Figure 1-3 , an embodiment of the present application provides a multi-mode communication agile adaptation method, the method comprising:

[0066] Determining a multimode communication node in a driving environment, wherein the multimode communication node includes: a multimode communication vehicle node and a multimode communication non-vehicle node;

[0067] Acquiring driving scene information through a multimode communication node, and generating multimode communication network element information based on the driving scene information;

[0068] Acquiring travel information through a multimode communication vehicle node, and generating communication exchange content information based on the multimode communication network element information and the travel information;

[0069] The multimode communication vehicle node determines a set of multimode communication terminal nodes based on the communication exchange content information, and determines a set of quality of service parameters according to the set of multimode communication terminal nodes;

[0070] Generate communication mode decision variables based on the service quality parameter set and the communication exchange content information, and optimize the communication mode decision variables to obtain optimal service quality parameters;

[0071] Communication between multi-mode communication nodes is achieved through optimal quality of service parameters.

[0072] In the above embodiment, driving scene information is obtained through a multimode communication node, and multimode communication network element information is generated based on the driving scene information; travel information is obtained through a multimode communication vehicle node, and communication exchange content information is generated based on the multimode communication network element information and the travel information; the multimode communication vehicle node determines a set of multimode communication terminal nodes based on the communication exchange content information, and determines a set of service quality parameters based on the set of multimode communication terminal nodes; communication mode decision variables are generated based on the set of service quality parameters and the communication exchange content information, and the communication mode decision variables are optimized to obtain optimal service quality parameters; communication between multimode communication nodes is achieved through the optimal service quality parameters; thereby, an agile adaptation mechanism for multimode communication devices in a vehicle networking environment is specifically constructed based on driving scene-driving intention-business demand elements. By matching the communication exchange content information, there is no need to rely too much on real-time collection and analysis of scene element information of specific multimode communication nodes, which is conducive to quickly generating service quality parameters and corresponding objective functions, so that the scene element information can be reasonably updated for the frequently changing scene information in the outside world.

[0073] Taking a specific example to illustrate, the method specifically includes the following steps:

[0074] Step 1: Construct the communication network element generation module.

[0075] For example, the traffic conditions include: the number of lanes in the current driving scene, the number of multi-mode communication nodes, the vehicle location, the vehicle driving status, etc. Figure 3 As shown, the total number of lanes in the current driving scene is 3, and the set of multi-mode communication nodes that can be collected is , where multimode communication nodes 1 to 5 are vehicle nodes, and all multimode communication vehicle nodes are in a moving (driving) state, and multimode communication nodes 6 and 7 are non-vehicle nodes. Multimode communication vehicle nodes 1 and 2 are located in lane 2, multimode communication vehicle nodes 3 and 4 are located in lane 3, and multimode communication vehicle node 5 is located in lane 1. Multimode communication non-vehicle nodes 6 and 7 are located on both sides of the road (non-lane), and the driving state and lane state of the non-lane multimode communication node information are specified to be 0. The location information of multimode communication nodes 1, 2, 3, 4, 5, 6, and 7 , , .、 , , , , obtained in real time by GPS, lidar or camera, respectively: (39.8996, 116.4069), (39.8993,116.4068), (39.8998, 116.4069), (39.8995, 116.4069), (39.8998, 116.4069), (39.9000, 116.4071), (39.8996, 116.4063). Exemplarily, Table 1 lists a set of 5 vehicle driving states, represented by numbers 0 to 4. Among them, 0 indicates that the vehicle is stationary, 1 indicates that the vehicle is in a normal (constant speed) driving state, 2 indicates that the vehicle is in an accelerating driving state, 3 indicates that the vehicle is in a decelerating driving state, and 4 indicates that the vehicle is in a right turn (or right lane change) state. The detailed information of the communication network elements is shown in Table 1:

[0076] Table 1: Traffic status information table of multi-mode communication nodes at the current moment

[0077]

[0078] Network conditions include: multi-mode communication nodes Available communication modes with other nodes, the size of data to be sent in the buffer at the current moment, and the bandwidth.

[0079] For example, Table 2 lists the communication set consisting of four communication modes: , Indicates the communication protocol LTE, Indicates the communication protocol DSRC, Indicates the communication protocol Wi-Fi, Indicates the communication protocol PC5.

[0080] Taking multi-mode communication vehicle node 1 and multi-mode communication vehicle node 2 as an example, at the current moment, the communication protocols supported between multi-mode communication vehicle node 1 and multi-mode communication vehicle node 2 are LTE, DSRC, Wi-Fi, and PC5. The available communication modes between multi-mode communication vehicle node 1 and multi-mode communication vehicle node 2 are expressed as , , , Based on the communication protocols supported between the multi-mode communication vehicle node 1 and the multi-mode communication vehicle node 2, the network status also includes the available buffer and bandwidth at the current moment. For example, the communication protocol LTE supports a channel bandwidth of 20M. Since the LTE communication mode needs to be forwarded through the base station, the bandwidth used for transmission is = 20 / 2 = 10M; the communication protocol DSRC does not pass through the base station forwarding, and the supported bandwidth is = 10M; the communication protocol Wi-Fi does not pass through the base station forwarding, and the supported bandwidth is = 20M; Communication protocol PC5 does not pass through the base station forwarding, the supported bandwidth is = 40M;

[0081] The sizes of data to be sent in the buffers of the communication protocols LTE, DSRC, Wi-Fi and PC5 of the multi-mode communication vehicle node 1 are respectively =5Kbits, =10Kbits, =20Kbits, =45Kbits. Taking multi-mode communication vehicle nodes 1 and 5 as an example, the communication protocols supported between multi-mode communication vehicle node 1 and multi-mode communication vehicle node 5 at the current moment are DSRC, Wi-Fi and PC5, then the available communication modes between multi-mode communication vehicle node 1 and multi-mode communication vehicle node 2 are expressed as , the unavailable communication mode between multi-mode communication vehicle node 1 and multi-mode communication vehicle node 5 is expressed as The communication mode support between the multi-mode communication vehicle node 1 and other multi-mode communication nodes is shown in Table 2:

[0082] Table 2: Network status information table of multi-mode communication nodes at the current moment

[0083]

[0084] Step 2: Construct a communication exchange content generation module.

[0085] Taking multi-mode communication vehicle node 1 as an example, based on the information collected by the vehicle communication device or vehicle sensing device at the current moment and the travel information of the multi-mode communication vehicle node, the communication exchange content information of the multi-mode communication vehicle node at the current moment is generated. The communication exchange content constructed by multi-mode communication vehicle node 1 is {change lane to the right}, that is, .

[0086] Step 3: Construct a communication node set generation module.

[0087] Exemplarily, the multi-mode communication vehicle node 1 exchanges content information through the communication at the current moment Determine the set of multi-mode communication nodes , according to the current position of multimode communication vehicle node 1 and the characteristics of the exchange content, multimode communication vehicle node 1 communicates with nearby multimode communication vehicle nodes and multimode communication non-vehicle nodes, then , , , , , , indicating that at the current moment, multi-mode communication vehicle node 1 needs to send the communication exchange content information Sent to multi-mode communication vehicle nodes 2, 3, 4, 5 and multi-mode communication non-vehicle nodes 6, 7.

[0088] Step 4: Construct the communication service quality generation module.

[0089] Exemplarily, the multi-mode communication vehicle node 1 exchanges content information according to the communication And the determined communication node set information , the communication exchange content generated by the multi-mode communication vehicle node 1 at the current moment mainly focuses on the delay requirement of the communication process, so only the delay is used as the satisfaction target to generate the corresponding QoS:

[0090] For example, = 7ms, = 5ms, = 5ms, = 6ms, = 4ms, = 6ms, representing the multi-mode communication vehicle nodes at the current moment , , , , , The maximum acceptable transmission delay for decision communication;

[0091] Step 5: Build a communication mode agile adaptation module.

[0092] Exemplarily, the multi-mode communication vehicle node 1 constructs the state space information according to the contents of Table 1 and Table 2 in step 1. In the agile adaptation scenario, spatial information is specifically reflected as the delay in a certain communication mode. For example, the objective function Specifically, to meet the transmission delay QoS minimization, the cumulative delay of the data size to be sent in the buffer is The calculation formula (1) is as follows:

[0093] Formula (1)

[0094] in, Indicates the number of paths that a communication node passes through when transmitting information in different communication modes. When the communication mode is LTE or NR, that is, cellular communication = 2, other communication modes = 1. For example, for multi-mode communication vehicle node 1, there is only exchange content information Corresponding to the multi-mode communication node Data size = 5Kbits, the multi-mode communication vehicle node 1 selects different communication modes to communicate with other nodes as actions, the accumulated delays of different actions and the accumulated delays of the data size to be sent in the buffer of the multi-mode communication vehicle node 1 under different communication modes are based on formula (1), and the specific values ​​are shown in Table 3:

[0095] Table 3: Cache size, bandwidth and initialization delay of different communication modes of multi-mode communication node 1

[0096]

[0097] Construct reward functions based on agile adaptation of scenario requirements and constraints :

[0098] Formula (2)

[0099] In formula (2) Represents a multi-mode communication vehicle node Multimode communication nodes Complete communication services between After the delay, When it is greater than the delay constraint, the reward is negative infinity, and the communication mode maintains the previous state and no longer updates the subsequent state. When the delay is less than the delay constraint, the reward is the maximum delay sum in the current state Different action delay from the next state The difference.

[0100] Formula (3)

[0101] The objective of the model is the same as that shown in formula (3), which is to minimize the number of multi-mode communication vehicle nodes Final delay in completing the business , The size of the multi-mode communication vehicle node With other multi-mode communication nodes The maximum value of the delay to complete the service is determined by .

[0102] According to the description of the basic elements of the above model, the initialization state space is shown in state 0 of Table 4. The state values ​​of different communication modes of multi-mode communication vehicle node 1 are all 0. At this time, the multi-mode communication vehicle node is selected for communication. First, a random strategy is used to select the node. The adaptation strategy from state 1 to state 6 is shown in formula (4):

[0103] Formula (4)

[0104] Among them, the communication node set CnIndicates the number of multi-mode communication nodes that have not yet been agilely adapted, and does not include nodes that are not supported by the communication mode. Based on the state value function The state value of communication mode 1 (state 1) is calculated as shown in formula (5):

[0105] Formula (5)

[0106] Among them, the adaptation strategy is random selection, then there is only one strategy, taking multi-mode communication vehicle node 2 and multi-mode communication vehicle node 5 as an example, there are , Initial stage , set the discount factor According to steps 1 to 3, the nodes that need to communicate and the supported communication modes are determined. Therefore, the scenario of agile adaptation is known, and the constructed state transition probability matrix is In communication mode c= 1 as an example, any multimode communication node that selects communication mode 1 in state 1 will receive a reward. Similarly, the state values ​​of state 1 in communication mode 2, communication mode 3, and communication mode 4 can be calculated, which are -0.375, -0.125, and -0.125, respectively. The state is updated according to the calculation process shown in formula (5), as shown in Table 4:

[0107] Based on state 1, update state 2 of mode 1 and randomly remove a node that has completed communication, then we have formula (6):

[0108] Formula (6)

[0109] in, Updated in state 1 and applied to the calculation process of formula (5). According to the above process, states 3 to 6 are updated as shown in Table 4:

[0110] Table 4: State value corresponding to state space

[0111]

[0112] After calculation, the state value of multimode communication node 1 in all states is obtained, but the strategy is still consistent with the traditional adaptation scheme, and the best matching scheme is not obtained. In order to obtain the best agile adaptation scheme, the strategy can be easily calculated based on the state-action value function. value, using a greedy strategy to adopt each state The action with the largest value can get the optimal agile adaptation solution. Taking state 0 as an example, calculate the action in state 0 The value of , based on the greedy strategy, we first consider node 6 which has the smallest delay constraint and supports communication mode 1, and calculate its state-action value as shown in formula (7) to formula (10):

[0113] Formula (7)

[0114] Formula (8)

[0115] Formula (9)

[0116] Formula (10)

[0117] Select an action from the above state-action value The value of is the largest, so the updated agile adaptation strategy is At this time, mode 1 is updated to state 1, mode 2, mode 3 and mode 4 remain in state 0, and the action is in state 1 The corresponding maximum delay =1.5ms, and the total delay is 1ms. Based on state 1, select multimode communication node 3 and multimode communication node 4 with the same delay constraint according to the delay constraint, randomly select one of them, and calculate different state-action values, as shown in formulas (11) to (14):

[0118] Formula (11)

[0119] Formula (12)

[0120] Formula (13)

[0121] Formula (14)

[0122] At this time, the reward of mode 3 is the largest, so mode 3 is selected. At the same time, mode 3 enters state 1, mode 1 remains in state 1, and modes 2 and 4 remain in state 0. At this time, the total delay is 1.25ms, and the agile adaptation strategy is updated as follows: According to the above process, the state-action value is calculated in sequence, as shown in Table 5:

[0123] Table 5: State-Action Value Table

[0124]

[0125] When the state action values ​​in Table 5 are the same, they are randomly selected according to the communication mode supported by the node. Combining Table 5, we can get: The optimal agile adaptation strategy has a total delay of 1.5 ms. Compared with the random strategy, the maximum delay can be reduced by 3.5 ms. The detailed strategy is shown in Table 6:

[0126] Table 6: Best Agile Adaptation Strategy Table

[0127]

[0128] It can be seen from Table 6 that the decision communication mode of multimode communication vehicle node 1 and multimode communication vehicle node 2 is DSRC, the decision communication mode of multimode communication vehicle node 1 and multimode communication vehicle node 3 is Wi-Fi, the decision communication mode of multimode communication vehicle node 1 and multimode communication vehicle node 4 is PC5, the decision communication mode of multimode communication vehicle node 1 and multimode communication vehicle node 5 is PC5, the decision communication mode of multimode communication vehicle node 1 and multimode communication non-vehicle node 6 is LTE, and the decision communication mode of multimode communication vehicle node 1 and multimode communication non-vehicle node 7 is PC5.

[0129] The embodiment of the present application also provides a vehicle multi-mode communication agile adaptation system, including a processor and a memory;

[0130] Memory, used to store computer programs;

[0131] The processor is used to implement any method step in the multi-mode communication agile adaptation method when executing the program stored in the memory.

[0132] The preferred specific embodiments of the present invention are described in detail above. It should be understood that a person skilled in the art can make many modifications and changes based on the concept of the present invention without creative work. Therefore, any technical solution that can be obtained by a person skilled in the art through logical analysis, reasoning or limited experiments based on the concept of the present invention on the basis of the prior art should be within the scope of protection determined by the claims.

Claims

1. A multi-mode communication agile adaptation method, characterized in that: The method comprises: Determining a multimode communication node in a driving environment, wherein the multimode communication node includes: a multimode communication vehicle node and a multimode communication non-vehicle node; Acquiring driving scene information through a multimode communication node, and generating multimode communication network element information based on the driving scene information; Wherein, obtaining driving scene information through a multi-mode communication node includes: Collect the traffic conditions, vehicle status and network status in the current driving environment through communication equipment, perception equipment or information fusion center, and integrate the traffic conditions, vehicle status and network status into driving scene information; Generating multi-mode communication network element information based on the driving scenario information includes: The multimode communication node determines all communication modes adapted to other multimode communication terminal nodes, constructs a communication mode set from all communication modes adapted to the multimode communication node, and uses the communication mode set as multimode communication network element information; Acquiring travel information through a multimode communication vehicle node, and generating communication exchange content information based on the multimode communication network element information and the travel information; The multimode communication vehicle node determines a set of multimode communication terminal nodes based on the communication exchange content information, and determines a set of quality of service parameters according to the set of multimode communication terminal nodes; Generate communication mode decision variables based on the service quality parameter set and the communication exchange content information, and optimize the communication mode decision variables to obtain optimal service quality parameters; Communication between multi-mode communication nodes is achieved through optimal quality of service parameters.

2. The multi-mode communication agile adaptation method according to claim 1, characterized in that: The determining of the multi-mode communication nodes in the driving environment comprises: Determine all communication devices related to vehicle driving in the driving environment, and determine all communication devices as multi-mode communication nodes; By acquiring relevant position information of the multimode communication nodes and the driving environment, the multimode communication nodes are divided into multimode communication vehicle nodes and multimode communication non-vehicle nodes.

3. The multi-mode communication agile adaptation method according to claim 1, characterized in that: The obtaining of travel information through a multi-mode communication vehicle node includes: The multi-mode communication vehicle node collects the vehicle driving information at the current moment according to the vehicle communication equipment, the vehicle sensing equipment and the information fusion center, and uses the vehicle driving information as the travel information.

4. The multi-mode communication agile adaptation method according to claim 1, characterized in that: The multimode communication vehicle node determines a set of multimode communication terminal nodes based on the communication exchange content information, including: The multimode communication vehicle node determines a set of multimode communication terminal nodes that need to communicate with the multimode communication vehicle node based on the communication exchange content information, multimode communication network element information and driving scenario information. The multimode communication terminal node set includes all multimode communication nodes that need to communicate with the multimode communication vehicle node in the current driving environment.

5. The multi-mode communication agile adaptation method according to claim 1, characterized in that: The determining of a set of quality of service parameters according to the set of multimode communication terminal nodes comprises: The delay requirements and reliability requirements when a multi-mode communication vehicle node communicates with a set of multi-mode communication terminal nodes are determined based on the communication exchange content information, and the delay requirements and reliability requirements are integrated into a set of service quality parameters.

6. The multi-mode communication agile adaptation method according to claim 1, characterized in that: The generating of the communication mode decision variable based on the service quality parameter set and the communication exchange content information comprises: The communication mode decision variables are generated according to the multi-mode communication network element information, the service quality parameter set and the communication exchange content information.

7. The multi-mode communication agile adaptation method according to claim 1, characterized in that: The optimizing the communication mode decision variables to obtain the optimal service quality parameters includes: The communication mode decision variables are optimized through the corresponding optimization criteria, and the optimization criteria satisfy the following learning model: ； Among them, the performance criterion function It indicates the specific performance criteria designed according to the requirements, which meets the transmission delay of all multi-mode communication nodes. Represents a multimode communication node Multimode communication nodes The maximum acceptable transmission delay between Indicates the multi-mode communication node at the current moment Multimode communication nodes Whether the available communication modes are supported , , Indicates the multi-mode communication node at the current moment Multimode communication nodes Support available communication modes , Indicates the multi-mode communication node at the current moment Multimode communication nodes Unsupported available communication mode , Indicates the multi-mode communication node at the current moment In communication mode The size of the data to be sent in the lower buffer. Represents a multimode communication node Multimode communication nodes In communication mode The available bandwidth size under Represents a multimode communication node Multimode communication nodes Whether to select the communication mode As a means of exchanging content transmission, represents a communication set, Represents a set of multimode communication nodes.

8. The multi-mode communication agile adaptation method according to claim 7, characterized in that: The construction process of the learning model is as follows: The Markov decision model in the multi-mode communication agile adaptation method for the Internet of Vehicles is constructed, including three key elements: state, action, and reward, which are defined as follows: State: The state in the Markov decision model reflects the multi-mode communication node of the agent in the current period The set of supportable communication network elements with other multi-mode communication nodes, the multi-mode communication node at the current moment The state set is represented as : ； Action: In the constructed Markov decision model, the multi-mode communication node At the current moment, it is decided to use a certain communication mode for communication or not. A communication mode strategy of the communication node set is an action, and the action space is expressed as: ； in, Represents the multi-mode communication vehicle node at the current moment The network status, Represents the multi-mode communication vehicle node at the current moment In network status action space; Reward: Based on the current State and Action, the reinforcement learning algorithm obtains rewards through evaluation , Indicates the multi-mode communication node at the current moment The reward value, Indicates the multi-mode communication node at the current moment The decision action, that is, the decision variable : ； Indicates the current decision action After that, multi-mode communication node According to the corresponding QoS, the rewards are obtained, and the performance criterion function Used to quantify the performance of specific decision actions in communication networks; Multimode communication node The state transition probability , its specific definition is expressed as: ； State transition probability Indicates the multi-mode communication node at the current moment After deciding to adopt a certain communication mode, the state set at the next moment The probability distribution of , , Respectively represent the multi-mode communication nodes at the next moment Multimode communication nodes Available communication modes The support status of the multi-mode communication node at the next moment Multimode communication nodes In communication mode The size of the data to be sent in the lower buffer, the multi-mode communication node at the next moment Multimode communication nodes The bandwidth of available communication modes; Multimode communication node The policy function , its specific definition is expressed as: ； Indicates the environment status is When the multi-mode communication node Select Action The mapping of Represents the probability of selecting an action, which is used to determine the multi-mode communication node according to the state transition probability at the current moment Multimode communication nodes Communication mode How to decide on the next step; Multimode communication node State value function under the QoS constraint of communication service quality , its specific definition is expressed as: ； Represents a multimode communication node In Status The expected return under is used to measure the environmental state Agile Adaptation Strategy assessment, represents the reward decay coefficient, Indicates the environment status is Expected reward when State-Action Value Function , its specific definition is expressed as: ； Estimated to be in state Take Action The expected return obtained after the training is to complete the exchange of content under the QoS constraint. transmission, and maximize the cumulative rewards, Indicates the multi-mode communication node at the next moment decision-making action.

9. A multi-mode communication agile adaptation system, characterized in that: Including processor and memory; Memory, used to store computer programs; A processor, for implementing the method steps described in any one of claims 1 to 8 when executing a program stored in a memory.

Images