Link quality evaluation method, link switching method, device and storage medium
By obtaining network status and communication quality information, calculating expected returns and generating state behavior mapping tables, the problems of low efficiency and insufficient accuracy of link quality evaluation are solved, and efficient and accurate link quality evaluation and handover decisions are achieved.
Patent Information
- Application Number
- CN202111083757.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-13
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-09-13
AI Technical Summary
In the prior art, the link quality evaluation efficiency is low and the evaluation results are inaccurate, mainly because parameters reflecting the link quality can be obtained only when the link is actually used, resulting in low evaluation efficiency and one-sided results.
By obtaining network status information and communication quality information corresponding to the switching behavior, calculating the expected benefits of the switching behavior and network state, and generating a state behavior mapping table, which is used to find and determine the expected benefits of the switching behavior and network state in the application stage, thereby Conduct link quality assessment and handover decisions.
It improves the efficiency and accuracy of link quality evaluation, can quantitatively evaluate link quality based on learned expected returns, reduces the recalculation of expected returns, and improves the accuracy and efficiency of link quality evaluation.
Smart Images

Figure CN113784411B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to a link quality assessment method, a link switching method, a device and a storage medium. Background Art
[0002] A network link usually refers to a communication channel between two nodes in a network, hereinafter referred to as a link. In a communication system, there may be two or more links between two nodes, and the link quality of different links is different. Link quality is used to reflect the information transmission capability. For example, for a link with higher link quality, the transmission rate is high, the packet loss rate is low, and the delay is low. Therefore, when two nodes communicate, it is usually necessary to select a link with better link quality for information transmission.
[0003] However, some parameters that can reflect link quality can only be obtained when the link is actually used. In the process of link quality evaluation, the link quality information can only be obtained by actually using the link to be compared, which will lead to low efficiency of link quality evaluation. On the contrary, if the parameters that can only be obtained when the link is actually used are not considered, the evaluation results of link quality may be one-sided, resulting in inaccurate link quality evaluation results. Summary of the invention
[0004] In view of this, the present application provides a link quality assessment method, a link switching method, a device and a storage medium, so as to solve the problem of low efficiency of link quality assessment or inaccurate link quality assessment results in the prior art.
[0005] In a first aspect, an embodiment of the present application provides a link quality assessment method, including:
[0006] When the first link is in a connected state, acquiring network state information corresponding to a switching behavior, where the switching behavior is used to represent switching the first link to a second link;
[0007] Acquire first communication quality information of the first link, where the first communication quality information is used to characterize the communication quality when the first link is in a connected state;
[0008] According to the switching behavior, switching the first link to the second link;
[0009] Acquire second communication quality information of the second link, where the second communication quality information is used to characterize the communication quality when the second link is in a connected state;
[0010] An expected benefit corresponding to the switching behavior and the network status information is determined according to the first communication quality information and the second communication quality information.
[0011] Preferably, determining the expected benefit corresponding to the switching behavior and the network status information according to the first communication quality information and the second communication quality information includes:
[0012] Determining, according to the first communication quality information and the second communication quality information at the current moment, an immediate benefit corresponding to the switching behavior and the network state information at the current moment;
[0013] According to the expected benefit corresponding to the switching behavior and the network status information at the previous moment, the immediate benefit corresponding to the switching behavior and the network status information at the current moment and an iteration rule, the expected benefit corresponding to the switching behavior and the network status information at the current moment is determined.
[0014] Preferably, determining the instant benefit corresponding to the switching behavior and the network status information at the current moment according to the first communication quality information and the second communication quality information at the current moment includes:
[0015] The ratio of the second communication quality information to the first communication quality information at the current moment is reduced by 1 to obtain an immediate benefit corresponding to the switching behavior and the network status information at the current moment.
[0016] Preferably, determining the expected benefit corresponding to the switching behavior and the network state information at the current moment according to the expected benefit corresponding to the switching behavior and the network state information at the previous moment, the instant benefit corresponding to the switching behavior and the network state information at the current moment, and an iteration rule includes:
[0017] Define the current time as t, the previous time as t-1, according to the formula: Q t =Q t-1 +α[R t -Q t-1 ], determine the expected benefit Q corresponding to the switching behavior and the network status information at time t t , where Q t-1 is the expected benefit corresponding to the switching behavior and the network status information at time t-1, R t is the instantaneous benefit corresponding to the switching behavior and the network state information at time t, and α is the learning rate parameter.
[0018] Preferably, the acquiring the first communication quality information of the first link includes:
[0019] Collect the first communication quality parameter x of the first link in n dimensions _before =[a1,a2,…,a n ] T , n≥2;
[0020] The first communication quality parameter x _before =[a1,a2,…,a n ] T Each dimension in is normalized to obtain the first communication quality information x std_before =[a std_1 ,a std_2 ,…,a std_n ] T .
[0021] Preferably, the collecting of the first communication quality parameter x of the first link in n dimensions _before =[a1,a2,…,a n ] T ,include:
[0022] Collect the first communication quality parameter X of the first link N times _before =[x _before (1) ,x _before (2) ,…,x _before (N) ] T , where the first communication quality parameter x of n dimensions is collected each time _before =[a1,a2,…,a n ] T ;
[0023] The first communication quality parameter x _before =[a1,a2,…,a n ] T Each dimension in is normalized to obtain the first communication quality information x std_before =[a std_1 ,a std_2 ,…,a std_n ] T ,include:
[0024] The first communication quality parameter X of the N first links collected _before =[x _before (1) ,x _before (2) ,…,x _before (N) ] T Perform sliding average processing to obtain the sliding average value of the N first communication quality parameters
[0025] The sliding average of the N first communication quality parameters Each dimension parameter in is standardized to obtain the first communication quality information x std_before =[a std_1 ,a std_2 ,…,a std_n ] T .
[0026] Preferably, the acquiring the second communication quality information of the second link includes:
[0027] Collect the second communication quality parameter x of the second link in n dimensions _after =[b1,b2,…,b n ] T , n≥2;
[0028] The second communication quality parameter x _after =[b1,b2,…,b n ] T Each dimension in is normalized to obtain the first communication quality information x std_after =[b std_1 ,b std_2 ,…,b std_n ] T .
[0029] Preferably, the collecting of the second communication quality parameter x of the second link in n dimensions _after =[b1,b2,…,b n ] T ,include:
[0030] Collect the second communication quality parameter X of the second link M times _after =[x _after (1) ,x _after (2) ,…,x _after (M) ] T , where the first communication quality parameter x of n dimensions is collected each time _after =[b1,b2,…,b n ] T
[0031] The second communication quality parameter x _after =[b1,b2,…,b n ] T Each dimension in is normalized to obtain the second communication quality information x std_after =[b std_1 ,b std_2 ,…,b std_n ] T ,include:
[0032] The collected second communication quality parameter X of the M second links _after =[x _after (1) ,x _after (2) ,…,x _after (M) ] T Perform sliding average processing to obtain the sliding average value of the M second communication quality parameters
[0033] The sliding average value of the M second communication quality parameters Each dimension parameter in is standardized to obtain the second communication quality information x std_after =[b std_1 ,b std_2 ,…,b std_n ] T .
[0034] Preferably, after determining the expected benefit corresponding to the switching behavior and the network status information according to the first communication quality information and the second communication quality information, the method further includes:
[0035] Determine whether the link quality evaluation times corresponding to the switching behavior reaches a preset evaluation times threshold;
[0036] If the number of quality evaluations does not reach a preset evaluation number threshold, the second link is switched to the first link, and the link quality evaluation corresponding to the switching behavior is re-executed.
[0037] In a second aspect, an embodiment of the present application provides a link switching method, including:
[0038] Obtain current network status information corresponding to the target switching behavior;
[0039] Determine the expected benefit corresponding to the target switching behavior and the current network state information according to the mapping relationship between the switching behavior, the network state information and the expected benefit;
[0040] If the expected benefit is greater than or equal to a preset expected benefit threshold, the target switching behavior is executed.
[0041] In a third aspect, an embodiment of the present application provides an electronic device, including:
[0042] one or more processors;
[0043] one or more memories;
[0044] and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to execute the method described in any one of the first aspects above.
[0045] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the methods described in the first aspect above.
[0046] In an embodiment of the present application, the relative quality between links in a certain network state can be quantitatively evaluated based on the expected benefit of the real network after the learned link switching, and the link quality evaluation result is more accurate. In the application stage, the expected benefit corresponding to the switching behavior and the network state can be obtained based on a table lookup. Since this process does not need to switch to the corresponding link according to the switching behavior, there is no need to recalculate the expected benefit, so the link quality evaluation efficiency is high. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0048] Figure 1 A schematic diagram of an application scenario provided for an embodiment of the present application;
[0049] Figure 2 A schematic diagram of a link quality assessment method provided in an embodiment of the present application;
[0050] Figure 3 A schematic diagram of a link switching method flow provided in an embodiment of the present application;
[0051] Figure 4 A schematic diagram of another link quality assessment method provided in an embodiment of the present application;
[0052] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0053] In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.
[0054] It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0055] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.
[0056] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.
[0057] See also Figure 1 , is a schematic diagram of an application scenario provided by an embodiment of the present application. Figure 1 As shown, the application scenario includes a first node and a second node, and the first node and the second node can choose to communicate through a first link or a second link.
[0058] In a specific implementation, the first node and the second node can be interconnected through a wired or wireless communication network to transmit information. The communication network can be a local area network or a wide area network transferred through a relay device. When the communication network is a local area network, exemplarily, the communication network can be a short-range communication network such as a wifi hotspot network, a wifi P2P network, a Bluetooth network, a zigbee network or a near field communication (NFC) network. When the communication network is a wide area network, exemplarily, the communication network can be a third-generation wireless telephone technology (3G) network, a fourth-generation mobile communication technology (4G) network, a fifth-generation mobile communication technology (5G) network, a future-evolved public land mobile network (PLMN) or the Internet, etc.
[0059] The first node and the second node may be terminal devices or network devices. Among them, the terminal devices may include mobile phones, tablet computers, personal computers (PC), personal digital assistants (PDA), smart watches, netbooks, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, vehicle-mounted devices, robots, smart glasses, etc. Network devices may include servers, routers, switches, wireless access points, etc. The embodiments of the present application do not specifically limit the product forms of the first node and the second node.
[0060] It should be pointed out that Figure 1 This is only an exemplary description of the embodiment of the present application. For example, in an actual communication system, in addition to the first node and the second node, there may be other nodes such as a third node and a fourth node; in addition to the first link and the second link, there may be other links such as a third link and a fourth link between the first node and the second node. This embodiment of the present application does not specifically limit this.
[0061] It can be understood that in order to improve the communication quality between the first node and the second node, it is necessary to select a link with higher link quality between the first node and the second node for information transmission. For example, between the first link and the second link, if the link quality of the first link is higher, the first link is selected for information transmission; conversely, if the link quality of the second link is higher, the second link is selected for information transmission.
[0062] In order to select a link with higher link quality from all links, link quality evaluation is required. However, some parameters that can reflect link quality can only be obtained when the link is actually used. In the process of link quality evaluation, the link to be compared needs to be actually used to obtain link quality information, which will result in low efficiency of link quality evaluation. On the contrary, if the parameters that can only be obtained when the link is actually used are not considered, the evaluation result of link quality may be one-sided, resulting in inaccurate link quality evaluation result.
[0063] In response to the above problems, the embodiments of the present application provide a link quality assessment method, a link switching method, a device and a storage medium, so as to solve the problems of low efficiency of link quality assessment or inaccurate link quality assessment results in the prior art. The technical solution provided by the embodiments of the present application can be divided into two stages: a link quality assessment stage and an application stage. Specifically, in the link quality assessment stage, a state behavior mapping table is generated according to the local network status, and the state behavior mapping table includes a mapping relationship between the network status, the switching behavior and the expected benefit. In the application stage, according to the current network status, the expected benefit corresponding to the switching behavior is determined by searching the state behavior mapping table, so that subsequent processing and judgment are performed according to the expected benefit. The following is a detailed description.
[0064] See also Figure 2 , is a flow chart of a link quality assessment method provided in an embodiment of the present application. The method can be applied to Figure 1 The application scenario shown in Figure 1. Figure 2 As shown, it mainly includes the following steps.
[0065] Step S201: when a first link is in a connected state, network state information corresponding to a switching behavior is acquired, where the switching behavior is used to represent switching the first link to a second link.
[0066] In the embodiment of the present application, the switching behavior refers to the switching action between different links. It is understandable that different switching actions between links represent different switching behaviors. For example, switching the first link to the second link represents one switching behavior; switching the first link to the third link represents another switching behavior. For ease of explanation, in the embodiment of the present application, the switching behavior is explained by switching the first link to the second link.
[0067] The network status information involved in the embodiment of the present application is the network status information corresponding to the switching behavior. For example, if the switching behavior is the switching from the first link to the second link, the network status information corresponding to the switching behavior may be the network status information of the first link and / or the second link. Specifically, it may be the network parameters of the first link and / or the second link.
[0068] It should be noted that the network parameters corresponding to the network status information are network parameters that can be obtained without switching to the corresponding link, such as signal strength, network delay, packet loss rate, etc. The network parameters corresponding to the communication quality information hereinafter may include network parameters that can be obtained only by switching to the corresponding link, such as real-time rate, downlink and uplink rates, etc. Of course, the network parameters corresponding to the communication quality information may also include network parameters that can be obtained without switching to the corresponding link, and the embodiments of the present application do not impose specific restrictions on this.
[0069] In practical applications, the parameters used to describe the network may not be discrete values. In order to facilitate the quantization of the network status information, the network parameters used to reflect the network status information may be discretely quantified.
[0070] Taking the Wi-Fi signal strength (Received Signal Strength Indication, RSSI) as an example, the RSSI parameter can be discretized into values of 0-4 according to Table 1, and the size of this value can be used to indicate the quality of the parameter interval.
[0071] Table 1:
[0072] Wi-Fi RSSI range The corresponding discrete value (-∞,-88] 0 (-88,-77] 1 (-77,-66] 2 (-66,-55] 3 (-55,+∞) 4
[0073] Therefore, the network state can be represented as a vector of multiple discretized network parameters, and the network state information can be represented by formula one.
[0074] Formula 1:
[0075] S net =[s1,s2,…,s l ] T
[0076] Among them, S net represents specific network state information, s represents the discrete representation value of a certain network parameter, and l represents the number of network parameters. It can be seen that the more network parameters there are, the more network states there are, that is, the more network state information there is, and the larger the size of the state behavior mapping table generated. Therefore, the selection of network parameters requires certain feature engineering to determine.
[0077] Step S202: Acquire first communication quality information of the first link, where the first communication quality information is used to characterize the communication quality when the first link is in a connected state.
[0078] The communication quality information is used to calculate the expected benefit. Therefore, when designing the communication quality information for the expected benefit, multiple key network parameters that affect the network quality can be comprehensively considered, such as signal strength, packet loss rate, latency, downlink and uplink rates, etc.
[0079] In the embodiment of the present application, the network parameter corresponding to the first communication quality information (hereinafter referred to as the first communication quality parameter) can be described in the form of the following n-dimensional vector.
[0080] Formula 2:
[0081] x _before =[a1,a2,…,a n ] T
[0082] Among them, x_before represents the first communication quality parameter, a represents a network parameter used to reflect the communication quality, and n represents the dimension of the network parameter, that is, the number of network parameters. In a specific implementation, n≥2.
[0083] However, since the dimensions of various network parameters are different, the comprehensive evaluation of multiple network parameters requires the standardization of each dimension of network parameters.
[0084] Specifically, each dimension of the first communication quality parameter shown in Formula 2 is standardized to obtain the first communication quality information, as shown in Formula 3.
[0085] Formula 3:
[0086] x std_before =[a std_1 ,a std_2 ,…,a std_n ] T
[0087] Among them, x std_before represents the standardized first communication quality parameter, that is, the first communication quality information; a std_1 represents the standardized network parameter a1; a std_2 represents the standardized network parameter a2; and so on, which will not be repeated here.
[0088] In a possible implementation manner, the first communication quality parameter of the first link is sampled N times, and the results of the N times of sampling can be expressed by formula four.
[0089] Formula 4:
[0090] X _before =[x _before (1) ,x _before (2) ,…,x _before (N) ] T
[0091] Among them, x _before (1) Indicates the communication quality parameter of the first sampling; x _before (2) It represents the communication quality parameter of the second sampling; and so on, which will not be described here.
[0092] Then, a sliding average is performed on each sampling result of the first communication quality parameter, and the sliding average value of the N first communication quality parameters is calculated. Each dimension parameter in is normalized to obtain the first communication quality information, as shown in Formula 3. The embodiment of the present application does not specifically limit the form of normalization, for example, Min-maxNormalization may be used.
[0093] Step S203: according to the switching behavior, switch the first link to the second link.
[0094] After acquiring the communication quality information of the first link, the first link is switched to the second link to acquire the communication quality information of the second link.
[0095] Step S204: Acquire second communication quality information of the second link, where the second communication quality information is used to characterize the communication quality when the second link is in a connected state.
[0096] Since the second link is currently in the connection state, the communication quality information of the second link, that is, the second communication quality information, can be acquired.
[0097] In the embodiment of the present application, the network parameter corresponding to the second communication quality information (hereinafter referred to as the second communication quality parameter) can be described in the form of the following n-dimensional vector.
[0098] Formula 5:
[0099] x _after =[b1,b2,…,b n ] T
[0100] Among them, x _after represents the second communication quality parameter, b represents a network parameter used to reflect the communication quality, and n represents the dimension of the network parameter, that is, the number of network parameters. In a specific implementation, n≥2.
[0101] However, since the dimensions of various network parameters are different, the comprehensive evaluation of multiple network parameters requires the standardization of each dimension of network parameters.
[0102] Specifically, each dimension of the second communication quality parameter shown in Formula 5 is standardized to obtain the second communication quality information, as shown in Formula 6.
[0103] Formula 6:
[0104] x std_after =[b std_1 ,b std_2 ,…,b std_n ] T
[0105] Among them, x std_afterrepresents the standardized second communication quality parameter, that is, the second communication quality information; b std_1 represents the standardized network parameter b1; b std_2 represents the standardized network parameter b2; and so on, which will not be repeated here.
[0106] In a possible implementation manner, the second communication quality parameter of the second link is sampled M times, and the result of the M times of sampling can be expressed by Formula 7.
[0107] Formula 7:
[0108] X _after =[x _after (1) ,x _after (2) ,…,x _after (M) ] T
[0109] Among them, x _after (1) Indicates the communication quality parameter of the first sampling; x _after (2) It represents the communication quality parameter of the second sampling; and so on, which will not be described here.
[0110] Then, the sampling result of each second communication quality parameter is averaged to calculate the sliding average value of the M first communication quality parameters. Then, the standardized second communication quality information is calculated by combining the maximum value and the minimum value in the first communication quality information after the standardized processing. The calculation formula is shown in Formula 8.
[0111] Formula 8:
[0112]
[0113] Normalize indicates a certain normalization method, and cache_params indicates the maximum value and the minimum value in the first communication quality information after normalization.
[0114] Step S205: Determine an expected benefit corresponding to the switching behavior and the network status information according to the first communication quality information and the second communication quality information.
[0115] The expected benefit involved in the embodiment of the present application refers to the benefit that can be obtained in terms of communication quality after executing the switching behavior (switching from the first link to the second link).
[0116] It is understandable that after obtaining the expected benefit, the mapping relationship between the switching behavior, the network state information and the expected benefit can be determined. In a specific implementation, a corresponding state-behavior mapping table can be generated according to the mapping relationship.
[0117] See Table 2, which is a state behavior mapping table shown in an embodiment of the present application. Table 2 shows two switching behaviors, wherein the first switching behavior is used to represent the switching of the first link to the second link, and the second switching behavior is used to represent the switching of the first link to the third link.
[0118] The same switching behavior may correspond to a variety of different network status information. For example, in Table 2, the first switching behavior corresponds to the first network status information, the second network status information, and the third network status information; the second switching behavior corresponds to the fourth network status information and the fifth network status information. It can be understood that the more network parameters used to characterize the network status information, the more network status information each switching behavior corresponds to.
[0119] In the state-behavior mapping table, each switching behavior and each network state information corresponds to a specific expected benefit value. In the application stage, the expected benefit value corresponding to the target switching behavior and the current network state information can be determined by searching the state-behavior mapping table, and then determining whether to execute the target switching behavior.
[0120] Table 2:
[0121]
[0122] In a possible implementation, in order to further improve the accuracy of the expected return, the above method can be used to perform multiple iterative operations on the expected return. After multiple iterations, the expected return will converge to a relatively stable value.
[0123] Specifically, the above step S205 specifically includes:
[0124] According to the first communication quality information and the second communication quality information at the current moment, determine the immediate benefit corresponding to the switching behavior and the network status information at the current moment. Even if the benefit can be quantified by set rules and network parameters. For example, the ratio of the second communication quality information and the first communication quality information at the current moment is reduced by 1 to obtain the immediate benefit corresponding to the switching behavior and the network status information at the current moment.
[0125] In a possible implementation, the calculation formula for instant profit is shown in Formula 9.
[0126] Formula 9:
[0127]
[0128] Here, R represents immediate return.
[0129] After obtaining the instantaneous benefit at the current moment, the expected benefit corresponding to the switching behavior and the network status information at the previous moment, the instantaneous benefit at the current moment and the iteration rule can be used to determine the expected benefit corresponding to the switching behavior and the network status information at the current moment.
[0130] In a possible implementation, the calculation formula for expected return is shown in Formula 10.
[0131] Formula 10:
[0132] Q t =Q t-1 +α[R t -Q t-1 ]
[0133] The current time is defined as t, the previous time is defined as t-1, Q t represents the expected return, Q t-1 is the expected return at time t-1, R t is the instantaneous return at time t, and α is the learning rate parameter. It should be noted that the Q t and Q t-1 The corresponding network status information is the same.
[0134] Understandable, Figure 2 The process shown is the process of performing a link quality assessment. In the specific implementation, the number of link quality assessments can be set, that is, Figure 2 The number of executions of the process shown. After executing step S205, it can be determined whether the number of link quality evaluations corresponding to a certain switching behavior reaches a preset evaluation number threshold; if the number of quality evaluations does not reach the preset evaluation number threshold, the second link is switched to the first link, and the process returns to step S201, and the link quality evaluation corresponding to the switching behavior is re-executed until the preset link quality evaluation number is reached.
[0135] It is understandable that in the process of link quality evaluation using the above method, the network state may change, that is, the network state information obtained in step S201 may change. Therefore, after multiple iterations, all possible network states in the network environment may be traversed, and the state behavior mapping table shown in Table 2 may be obtained.
[0136] In an embodiment of the present application, the relative quality between links in a certain network state can be quantitatively evaluated based on the learned expected benefit of the real network after link switching, and the link quality evaluation result is more accurate.
[0137] After the behavior mapping table is obtained by the above method, in the application stage, the expected benefit corresponding to the switching behavior can be determined according to the current network state by searching the state behavior mapping table, so that subsequent processing and judgment can be performed according to the expected benefit.
[0138] See also Figure 3 , is a schematic diagram of a link switching method provided in an embodiment of the present application. Figure 3 As shown, it mainly includes the following steps.
[0139] Step S301: Acquire current network status information corresponding to the target switching behavior.
[0140] Among them, the target switching behavior can be understood as the switching behavior that the user expects to perform. For example, the target switching behavior is the first switching behavior shown in Table 2, that is, the user expects to switch the first link to the second link. The current network state information can be understood as the network state information corresponding to the target switching behavior in the current network environment. For example, the network state information corresponding to the first switching behavior in the current network environment is the second network state information.
[0141] Step S302: Determine the expected benefit corresponding to the target switching behavior and the current network status information according to the mapping relationship among the switching behavior, the network status information and the expected benefit.
[0142] Specifically, after obtaining the current network state information corresponding to the target switching behavior, the state behavior mapping table can be searched to determine the expected benefit corresponding to the target switching behavior and the current network state behavior. The state behavior mapping table can be preset in the device or can be used Figure 2 The example shown generates.
[0143] For example, the target switching behavior is the first switching behavior shown in Table 2, and the current network state information corresponding to the target switching behavior is the second network state information, then the expected benefit is the expected benefit value corresponding to the first switching behavior and the second network state information.
[0144] Step S303: If the expected benefit is greater than or equal to a preset expected benefit threshold, the target switching behavior is executed.
[0145] In a specific implementation, an expected benefit threshold may be preset. The embodiment of the present application does not specifically limit the size of the expected benefit threshold. After obtaining the expected benefit, the expected benefit may be compared with the expected benefit threshold. If the expected benefit is greater than or equal to the preset expected benefit threshold, the target switching behavior is executed. For example, in Table 2, if the expected benefit value corresponding to the first switching behavior and the second network status information is greater than or equal to the preset expected benefit threshold, the first switching behavior is executed, that is, the first link is switched to the second link.
[0146] In the embodiment of the present application, in the application stage, the expected benefit corresponding to the switching behavior and the network state can be obtained based on a table lookup. Since the process does not need to switch to the corresponding link according to the switching behavior, and does not need to recalculate the expected benefit, the link quality evaluation efficiency is high.
[0147] See also Figure 4 , is a flow chart of another link quality assessment method provided in an embodiment of the present application. The method can be applied to Figure 1 The application scenario shown in Figure 1. Figure 4 As shown, it mainly includes the following steps.
[0148] Step S401: when a first link is in a connected state, network state information corresponding to a switching behavior is acquired, where the switching behavior is used to represent switching the first link to a second link.
[0149] Step S402: collecting N first communication quality parameters of the first link, where the first communication quality parameters are n-dimensional data; performing sliding average and standardization processing on the N first communication quality parameters of the first link to obtain first communication quality information.
[0150] Step S403: according to the switching behavior, switch the first link to the second link.
[0151] Step S404: collecting the second communication quality parameters of the second link M times, where the second communication quality parameters are n-dimensional data; performing sliding average and standardization processing on the first communication quality parameters of the first link M times to obtain second communication quality information.
[0152] Step S405: determining the instantaneous benefit corresponding to the switching behavior and the network status information at the current moment according to the first communication quality information and the second communication quality information at the current moment.
[0153] Step S406: Determine the expected benefit corresponding to the switching behavior and the network status information at the current moment according to the expected benefit corresponding to the switching behavior and the network status information at the previous moment, the instant benefit corresponding to the switching behavior and the network status information at the current moment, and the iteration rule.
[0154] Step S407: Iteratively update the state-behavior mapping table according to the expected benefit.
[0155] Step S408: Determine whether the number of iterations reaches a preset iteration number threshold.
[0156] If the judgment result is no, proceed to step S409; if the judgment result is yes, proceed to step S410.
[0157] Step S409: switch the second link to the first link, and return to step S401.
[0158] Step S410: Switch the second link to the first link, change the network environment, reset the number of iterations, and return to step S401.
[0159] That is, after reaching the number of iterations, the network environment is changed and iteration is performed again to traverse all network environments. In a possible implementation, the switching behavior can also be changed and iteration is performed again to traverse all switching behaviors. Figure 2 For the sake of brevity, the description of the illustrated embodiment will not be repeated here.
[0160] In an embodiment of the present application, the relative quality between links in a certain network state can be quantitatively evaluated based on the learned expected benefit of the real network after link switching, and the link quality evaluation result is more accurate.
[0161] See also Figure 5 , is a schematic diagram of an electronic device structure provided in an embodiment of the present application, the electronic device 500 may include: a processor 501, a memory 502 and a communication unit 503. These components communicate through one or more buses. Those skilled in the art can understand that the structure of the server shown in the figure does not constitute a limitation of the present application. It can be a bus structure or a star structure, and can also include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0162] The communication unit 503 is used to establish a communication channel so that the storage device can communicate with other devices, receive user data sent by other devices or send user data to other devices.
[0163] The processor 501 is the control center of the storage device. It uses various interfaces and lines to connect various parts of the entire electronic device. It runs or executes software programs and / or modules stored in the memory 502, and calls data stored in the memory to perform various functions of the electronic device and / or process data. The processor can be composed of an integrated circuit (IC), for example, it can be composed of a single packaged IC, or it can be composed of multiple packaged ICs with the same or different functions. For example, the processor 501 can only include a central processing unit (CPU). In the embodiment of the present application, the CPU can be a single computing core or multiple computing cores.
[0164] The memory 502 is used to store the execution instructions of the processor 501. The memory 502 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0165] When the execution instructions in the memory 502 are executed by the processor 501 , the electronic device 500 is enabled to execute part or all of the steps in the above method embodiment.
[0166] In a specific implementation, the present application further provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment provided in the present application. The storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).
[0167] In a specific implementation, an embodiment of the present application further provides a computer program product, which includes executable instructions. When the executable instructions are executed on a computer, the computer executes some or all of the steps in the above method embodiment.
[0168] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.
[0169] Those skilled in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.
[0170] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0171] In several embodiments provided by the present invention, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program codes.
[0172] The above is only a specific embodiment of the present invention. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. The protection scope of the present invention shall be based on the protection scope of the claims.
Claims
1. A link quality assessment method, characterized in that: include: When the first link is in a connected state, acquiring network state information corresponding to a switching behavior, where the switching behavior is used to represent switching the first link to a second link; Acquire first communication quality information of the first link, where the first communication quality information is used to characterize the communication quality when the first link is in a connected state; According to the switching behavior, switching the first link to the second link; Acquire second communication quality information of the second link, where the second communication quality information is used to characterize the communication quality when the second link is in a connected state; Determining an expected benefit corresponding to the switching behavior and the network state information according to the first communication quality information and the second communication quality information; The determining, according to the first communication quality information and the second communication quality information, an expected benefit corresponding to the switching behavior and the network state information includes: Determining, according to the first communication quality information and the second communication quality information at the current moment, an immediate benefit corresponding to the switching behavior and the network state information at the current moment; According to the expected benefit corresponding to the switching behavior and the network status information at the previous moment, the immediate benefit corresponding to the switching behavior and the network status information at the current moment and an iteration rule, the expected benefit corresponding to the switching behavior and the network status information at the current moment is determined.
2. The method according to claim 1, characterized in that The determining, according to the first communication quality information and the second communication quality information at the current moment, an immediate benefit corresponding to the switching behavior and the network state information at the current moment includes: The ratio of the second communication quality information to the first communication quality information at the current moment is reduced by 1 to obtain an immediate benefit corresponding to the switching behavior and the network status information at the current moment.
3. The method according to claim 1, characterized in that The determining, according to the expected benefit corresponding to the switching behavior and the network status information at the previous moment, the instant benefit corresponding to the switching behavior and the network status information at the current moment, and an iteration rule, the expected benefit corresponding to the switching behavior and the network status information at the current moment includes: Define the current time as t, the previous time as t-1, according to the formula: Q t =Q t-1 +α[R t -Q t-1 ], determine the expected benefit Q corresponding to the switching behavior and the network status information at time t t , where Q t-1 is the expected benefit corresponding to the switching behavior and the network status information at time t-1, R t is the instantaneous benefit corresponding to the switching behavior and the network state information at time t, and α is the learning rate parameter.
4. The method according to claim 1, characterized in that: The acquiring first communication quality information of the first link includes: Collect the first communication quality parameter x of the first link in n dimensions _before =[a1,a2,…,a n ] T , n≥2; The first communication quality parameter x _before =[a1,a2,…,a n ] T Each dimension in is normalized to obtain the first communication quality information x std_before =[a std_1 ,a std_2 ,…,a std_n ] T .
5. The method according to claim 4, characterized in that The first communication quality parameter x of the first link of the acquisition n dimension _before =[a1,a2,…,a n ] T ,include: Collect the first communication quality parameter X of the first link N times _before =[x _before (1) ,x _before (2) ,…,x _before (N) ] T , where the first communication quality parameter x of n dimensions is collected each time _before =[a1,a2,…,a n ] T ; The first communication quality parameter x _before =[a1,a2,…,a n ] T Each dimension in is normalized to obtain the first communication quality information x std_before =[a std_1 ,a std_2 ,…,a std_n ] T ,include: The first communication quality parameter X of the N first links collected _before =[x _before (1) ,x _before (2) ,…,x _before (N) ] T Perform sliding average processing to obtain the sliding average value of the first communication quality parameter N times The sliding average of the N first communication quality parameters Each dimension parameter in is standardized to obtain the first communication quality information x std_before =[a std_1 ,a std_2 ,…,a std_n ] T .
6. The method according to claim 1, characterized in that The acquiring the second communication quality information of the second link includes: Collect the second communication quality parameter x of the second link in n dimensions _after =[b1,b2,…,b n ] T , n≥2; The second communication quality parameter x _after =[b1,b2,…,b n ] T Each dimension in is normalized to obtain the first communication quality information x std_after =[b std_1 ,b std_2 ,…,b std_n ] T .
7. The method according to claim 6, characterized in that The collecting n-dimensional second communication quality parameter x of the second link _after =[b1,b2,…,b n ] T ,include: Collect the second communication quality parameter X of the second link M times _after =[x _after (1) ,x _after (2) ,…,x _after (M) ] T , where the first communication quality parameter x of n dimensions is collected each time _after =[b1,b2,…,b n ] T The second communication quality parameter x _after =[b1,b2,…,h n ] T Each dimension in is normalized to obtain the second communication quality information x std_after =[b std_1 ,b std_2 ,…,b std_n ] T ,include: The collected second communication quality parameter X of the M second links _after =[x _after (1) ,x _after (2) ,…,x _after (M) ] T Perform sliding average processing to obtain the sliding average value of the second communication quality parameter M times The sliding average value of the M second communication quality parameters Each dimension parameter in is standardized to obtain the second communication quality information x std_after =[b std_1 ,b std_2 ,…,b std_n ] T .
8. The method according to claim 1, characterized in that After determining the expected benefit corresponding to the switching behavior and the network status information according to the first communication quality information and the second communication quality information, the method further includes: Determine whether the link quality evaluation times corresponding to the switching behavior reaches a preset evaluation times threshold; If the number of quality evaluations does not reach a preset evaluation number threshold, the second link is switched to the first link, and the link quality evaluation corresponding to the switching behavior is re-executed.
9. A link switching method, characterized in that: include: Obtain current network status information corresponding to the target switching behavior; Determine the expected benefit corresponding to the target switching behavior and the current network status information according to the mapping relationship among the switching behavior, the network status information and the expected benefit generated by the method according to any one of claims 1 to 8; If the expected benefit is greater than or equal to a preset expected benefit threshold, the target switching behavior is executed.
10. An electronic device, characterized in that: include: one or more processors; one or more memories; And one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to perform the method described in any one of claims 1 to 9.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 9.
