Terminal roaming guidance method and apparatus, and electronic device and storage medium
By evaluating and adjusting the roaming strategy of terminal devices, using terminals and network image libraries, the problem of network communication interruption during the movement of sticky terminal devices is solved, intelligent roaming and rapid cold start are achieved, and roaming efficiency and applicability are improved.
Patent Information
- Application Number
- PCT/CN2024/086124
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-04-03
- Publication Date
- 2024-12-05
AI Technical Summary
Sticky terminal devices cannot actively roam smartly during movement, resulting in interruption of network communication, and the existing technology cannot effectively solve this problem.
By obtaining the historical roaming data of the target terminal, evaluating its roaming strategy, adjusting policy parameters to meet the expected requirements, guiding terminal devices to roam intelligently in the AP network environment, and using the terminal image library and the network image library to achieve rapid cold start and adaptive roaming .
It improves the applicability and efficiency of terminal equipment when roaming, ensures the stability and quality of network connections, adapts to the differences between different terminal equipment, and optimizes the roaming experience.
Smart Images

Figure CN2024086124_05122024_PF_FP_ABST
Abstract
Description
Terminal roaming guidance method, device, electronic device and storage medium
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on May 31, 2023, with application number 202310636473.X and application name “A terminal roaming guidance method, device, electronic device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present application relates to the field of network communication technology, and in particular to a terminal roaming guidance method, device, electronic device, and storage medium. Background Art
[0004] In wireless communication networks, devices maintain network communication within the signal coverage of a wireless access point (AP). However, because the signal coverage of a single AP (also known as the AP's service area) is limited, devices often move from one AP's service area to another.
[0005] To prevent network communication interruptions when a terminal device switches between different APs, wireless roaming technology has been introduced. Wireless roaming allows a terminal device to associate with a new AP and disconnect from its original AP (the one it initially associated with) when it moves between the coverage areas of two APs. During this process, the terminal device maintains an uninterrupted network connection. This wireless roaming method must be initiated by the terminal device.
[0006] However, some devices with poor roaming proactivity (for example, low-end mobile phones and tablets) will stick to the AP they initially associated with. Even if the device moves far away from the originally associated AP or the signal becomes weak, they will not roam to an AP with a stronger signal. These devices are called sticky devices.
[0007] For these sticky devices, relying on active roaming is not feasible. Intelligent roaming offers a compelling solution to this problem. It guides roaming in a way the device understands, making it more intelligent than active roaming.
[0008] Summary of the Invention
[0009] Each exemplary embodiment of the present application provides a terminal roaming guidance method, device, electronic device, and storage medium.
[0010] In a first aspect, a terminal roaming guidance method is provided, comprising:
[0011] Obtaining historical roaming data of a target terminal under a first target roaming policy, and determining a roaming evaluation result of the target terminal based on the historical roaming data, wherein the first target roaming policy is a roaming policy assigned by a network profile library based on a wireless access point (AP) network environment when the target terminal enters the AP network environment;
[0012] If the roaming evaluation result does not meet the expected requirements, adjusting the policy parameters in the first target roaming policy until the expected requirements are met, thereby obtaining a second target roaming policy for the target terminal, wherein the expected requirements represent an optimal time for the target terminal to execute the optimal roaming policy; and
[0013] Based on the second target roaming policy, the target terminal is guided to roam to a target AP in the AP network environment, wherein the target AP is the target AP in the second target roaming policy.
[0014] In a possible embodiment, the AP network environment includes N APs, which are configured with a terminal portrait library, wherein the terminal portrait library includes one or more roaming policies of terminals in the N APs, where N is an integer greater than 0;
[0015] Before acquiring the historical roaming data of the target terminal under the first target roaming policy, the method further includes:
[0016] Determining the terminal type to which the target terminal belongs;
[0017] If a first terminal matching the terminal type is found in the terminal portrait library based on the terminal type to which the target terminal belongs, the roaming policy of the first AP currently associated with the first terminal among the N APs is used as the first target roaming policy of the target terminal.
[0018] In a possible embodiment, the AP network environment is configured with a terminal portrait library, including:
[0019] Determining whether there is a first network profile in the network profile library that meets a similarity requirement with the AP network profile of the AP network environment; and
[0020] When a first network portrait exists, the terminal portrait library corresponding to the first network portrait is reused in the AP network environment.
[0021] In a possible embodiment, the method further includes:
[0022] If, according to the terminal type to which the target terminal belongs, a first terminal matching the terminal type is not found in the terminal portrait library, determining an initial roaming policy of the target terminal according to the mutual scanning information of the N APs in the AP network environment and the roaming information of the target terminal, and using the initial roaming policy of the target terminal as a first target roaming policy of the target terminal;
[0023] The roaming information of the target terminal includes one or more of the following information: signal strength information, roaming time, channel utilization, number of uplink bytes, number of downlink bytes, packet loss rate, and physical rate.
[0024] In a possible embodiment, the terminal portrait includes one or more of the following information: the network communication capability of the terminal during roaming, the terminal name, the terminal identifier, the terminal type, and the roaming strategy adopted by the terminal when roaming in N APs.
[0025] In a possible embodiment, determining the terminal type to which the target terminal belongs includes one or more of the following methods:
[0026] Determining the terminal type to which the target terminal belongs by identifying a media access control address;
[0027] Determining the terminal type to which the target terminal belongs through a hypertext transfer protocol (http) initiated by the target terminal; and
[0028] The terminal type of the target terminal is determined according to the attribute information of the target terminal.
[0029] In a possible embodiment, the method further includes:
[0030] Obtain network information of N APs in the AP network environment, where N is an integer greater than 0;
[0031] Determining network environment characteristics of the AP network environment based on the network information of the N APs; and
[0032] Based on the network environment characteristics of the AP network environment, an AP network profile of the AP network environment is constructed and stored in a network profile library.
[0033] In a possible embodiment, determining the network environment characteristics of the AP network environment according to the network information of the N APs includes one or more of the following:
[0034] Determining network environment characteristics of the AP network environment based on coverage information in the network information of the N APs;
[0035] Determining network environment characteristics of the AP network environment based on distribution information in the network information of the N APs;
[0036] Determining network environment characteristics of the AP network environment based on jitter drop point areas in the network information of the N APs; and
[0037] According to the mutual scanning information in the network information of N APs, the network environment characteristics of the AP network environment are determined.
[0038] In a possible embodiment, the method further includes:
[0039] Obtaining mutual scanning information of M APs in a new AP network environment, where M is an integer greater than 0; and ranking the M APs by importance based on the mutual scanning information of the M APs;
[0040] Constructing a mutual scanning matrix of the new AP network environment according to the mutual scanning signal strength values of the M APs in the importance ranking;
[0041] generating a new AP network profile of the new AP network environment according to the mutual scanning matrix of the new AP network environment; and
[0042] If the new AP network portrait of the new AP network environment meets the similarity requirement with the AP network portrait of the AP network environment in the network portrait library, the terminal portrait library in the AP network environment is reused for the new AP network environment.
[0043] In a possible embodiment, the method further includes:
[0044] If the new AP network portrait of the new AP network environment does not meet the similarity requirement with the AP network portraits in the network portrait library, the new AP portrait is added to the network portrait library.
[0045] In a possible embodiment, ranking the M APs by importance based on the mutual scanning information of the M APs includes:
[0046] Based on the mutual scanning signal strength values of the M APs, importance is sorted, wherein the greater the mutual scanning signal strength value, the higher the importance; or
[0047] The M APs are sorted by importance based on their respective frequencies, wherein the higher the frequency, the higher the importance.
[0048] In a possible embodiment, obtaining historical roaming data of the target terminal under the first target roaming policy includes:
[0049] Acquire historical roaming data of the target terminal within a preset time period of the first target roaming policy; or,
[0050] Acquire a preset amount of historical roaming data of the target terminal under the first target roaming policy; or,
[0051] Acquire all historical roaming data of the target terminal under the first target roaming policy.
[0052] In a possible embodiment, the historical roaming data includes: one or more of the following: signal strength, uplink physical rate, downlink physical rate, uplink byte count, downlink byte count, and packet loss rate of the target terminal under the first target roaming policy;
[0053] The determining, according to the historical roaming data, a roaming evaluation result of the target terminal includes:
[0054] determining whether the communication performance of the target terminal meets set expected requirements based on historical roaming data before and after the target terminal executes the first target roaming policy; and
[0055] The expected requirement represents the suitability of the roaming behavior of the target terminal.
[0056] In a possible embodiment, whether the communication performance of the target terminal meets the set expected requirements includes:
[0057] There is a case where the historical roaming data does not meet a corresponding set threshold, and it is determined that the communication performance of the target terminal after roaming using the first target roaming policy does not meet a set expected requirement.
[0058] In a possible embodiment, adjusting the policy parameters in the first target roaming policy until the expected requirements are met includes:
[0059] After the target terminal performs the selected first roaming action in the current first roaming state, obtaining an expected reward and a second roaming state at a next moment;
[0060] determining, according to the Q function, a second roaming action to be performed by the target terminal in the second roaming state; and
[0061] updating the Q function according to the second roaming state, the second roaming action, and the expected reward until the updated Q function meets the expected requirement;
[0062] The Q function satisfies the following expression: Q(s,a)=Q(s,a)+α(r+γQ(s′,a′)-Q(s,a)); s is the first roaming state, a is the first roaming action, r is the expected reward, α is the set learning rate, γ is the set discount rate, s' is the second roaming state, and a' is the second roaming action.
[0063] In a second aspect, a terminal roaming guidance method is provided, including:
[0064] Obtain historical roaming data of a target terminal under a first target roaming policy, and determine a roaming evaluation result of the target terminal based on the historical roaming data; wherein, the first target roaming policy is a roaming policy assigned when the target terminal enters an AP network environment; if the roaming evaluation result does not meet expected requirements, adjust the policy parameters in the first target roaming policy until they meet the expected requirements, thereby obtaining a second target roaming policy for the target terminal; and according to the second target roaming policy, guide the target terminal to roam to a target AP in the AP network environment.
[0065] In one embodiment, the AP network environment includes N APs and a terminal profile library, the terminal profile library including at least one roaming policy of each terminal in the N APs, where N is an integer greater than 0; before obtaining historical roaming data of the target terminal under the first target roaming policy, the method further includes:
[0066] Identify the terminal type to which the target terminal belongs. If, based on the terminal type to which the target terminal belongs, a first terminal matching the terminal type is found in the terminal portrait library, the roaming policy of the first AP currently associated with the first terminal among the N APs is used as the first target roaming policy of the target terminal. If, based on the terminal type to which the target terminal belongs, a first terminal matching the terminal type is not found in the terminal portrait library, determine the initial roaming policy of the target terminal based on the mutual scanning information of the N APs in the AP network environment and the roaming information of the target terminal, and use the initial roaming policy of the target terminal as the first target roaming policy of the target terminal.
[0067] In the embodiment of the present application, based on the constructed terminal portrait library, the target terminal newly connected to the network can reuse the roaming strategy of the same type of terminal, thereby improving the speed of roaming.
[0068] In one embodiment, the method further includes:
[0069] Obtain network information of N APs in the AP network environment, where N is an integer greater than 0; determine network environment characteristics of the AP network environment based on the network information of the N APs; construct an AP network profile of the AP network environment based on the network environment characteristics of the AP network environment, and store it in a network profile library.
[0070] In an embodiment of the present application, various AP network environments can be summarized and distinguished by constructing the above-mentioned network portrait library. When a new AP network environment is subsequently constructed, the roaming strategy of a similar AP network environment can be reused based on the network portrait library. Therefore, the process of re-formulating the roaming strategy can be omitted, thereby optimizing the roaming experience.
[0071] In one embodiment, determining the network environment characteristics of the AP network environment based on the network information of the N APs includes:
[0072] Determine the network environment characteristics of the AP network environment based on the coverage information in the network information of the N APs; or determine the network environment characteristics of the AP network environment based on the distribution information in the network information of the N APs; or determine the network environment characteristics of the AP network environment based on the jitter drop point area in the network information of the N APs.
[0073] In the embodiment of the present application, network environment characteristics in the AP network environment can be extracted from multiple dimensions, so that the subsequently constructed network portrait library is more accurate.
[0074] In one embodiment, the method further comprises:
[0075] Obtain mutual scanning information of M APs in a new AP network environment, where M is an integer greater than 0; sort the M APs by importance based on the mutual scanning information of the M APs; construct a mutual scanning matrix of the new AP network environment based on the mutual scanning signal strength values of each of the M APs in the importance sorting; generate a new AP network portrait of the new AP network environment based on the mutual scanning matrix of the new AP network environment; if the new AP network portrait of the new AP network environment meets the similarity requirement with the AP network portrait of the AP network environment in the network portrait library, reuse the terminal portrait library in the AP network environment to the new AP network environment.
[0076] In an embodiment of the present application, when building an AP network environment, a fast cold start can be achieved based on the network portrait library.
[0077] In one embodiment, adjusting the policy parameters in the first target roaming policy until the expected requirements are met includes:
[0078] After executing a selected first roaming action in a first roaming state of the target terminal, an expected reward and a second roaming state at a next moment are obtained; determining a second roaming action to be executed by the target terminal in the second roaming state according to a Q function; updating the Q function according to the second roaming state, the second roaming action, and the expected reward until the updated Q function meets the expected requirement; wherein the Q function satisfies the following expression: Q(s,a)=Q(s,a)+α(r+γQ(s^',a^')-Q(s,a)); s is the first roaming state, a is the first roaming action, r is the expected reward, α is a set learning rate, γ is a set discount rate, s' is the second roaming state, and a' is the second roaming action.
[0079] In a third aspect, a terminal roaming guidance device is provided, including:
[0080] An evaluation module is configured to obtain historical roaming data of a target terminal under a first target roaming policy, and determine a roaming evaluation result of the target terminal based on the historical roaming data; wherein the first target roaming policy is a roaming policy assigned to the target terminal when the target terminal enters an AP network environment; an adjustment module is configured to adjust policy parameters in the first target roaming policy until the policy parameters meet the expected requirements if the roaming evaluation result does not meet the expected requirements, thereby obtaining a second target roaming policy for the target terminal; and a guidance module is configured to guide the target terminal to roam to a target AP in the AP network environment based on the second target roaming policy.
[0081] In one embodiment, the AP network environment includes N APs and a terminal portrait library, wherein the terminal portrait library includes at least one roaming policy of each terminal in the N APs, where N is an integer greater than 0; the apparatus further includes an allocation module; the allocation module is specifically configured to:
[0082] Identify the terminal type to which the target terminal belongs; if, based on the terminal type to which the target terminal belongs, a first terminal matching the terminal type is found in the terminal portrait library, then use the roaming policy of the first AP currently associated with the first terminal among the N APs as the first target roaming policy of the target terminal; if, based on the terminal type to which the target terminal belongs, a first terminal matching the terminal type is not found in the terminal portrait library, then determine the initial roaming policy of the target terminal based on the mutual scanning information of the N APs in the AP network environment and the roaming information of the target terminal, and use the initial roaming policy of the target terminal as the first target roaming policy of the target terminal.
[0083] In one embodiment, the device also includes a network image construction module; the network image construction module is used to obtain network information of N APs in the AP network environment, where N is an integer greater than 0; based on the network information of the N APs, the network environment characteristics of the AP network environment are determined; based on the network environment characteristics of the AP network environment, an AP network portrait of the AP network environment is constructed and stored in a network portrait library.
[0084] In one embodiment, the network image construction module is specifically configured to:
[0085] Determine the network environment characteristics of the AP network environment based on the coverage information in the network information of the N APs; or determine the network environment characteristics of the AP network environment based on the distribution information in the network information of the N APs; or determine the network environment characteristics of the AP network environment based on the jitter drop point area in the network information of the N APs.
[0086] In one embodiment, the network image construction module is also used to: obtain mutual scanning information of M APs in a new AP network environment, where M is an integer greater than 0; sort the M APs by importance based on the mutual scanning information of the M APs; construct a mutual scanning matrix of the new AP network environment based on the mutual scanning signal strength values of each of the M APs in the importance sorting; generate a new AP network portrait of the new AP network environment based on the mutual scanning matrix of the new AP network environment; if the new AP network portrait of the new AP network environment meets the similarity requirement with the AP network portrait of the AP network environment in the network portrait library, the terminal portrait library of the AP network environment is reused for the new AP network environment.
[0087] In a fourth aspect, an electronic device is provided, including:
[0088] A memory is used to store a computer program; a processor is used to implement the method steps described in the first aspect or the second aspect when executing the computer program stored in the memory.
[0089] In a fifth aspect, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method steps described in the first aspect or the second aspect are implemented.
[0090] In an embodiment of the present application, since historical roaming data of the target terminal under the first target roaming policy is obtained for analysis, and the first target roaming policy is the roaming policy assigned when the target terminal enters the AP network environment, it is determined whether the roaming of the target terminal using the first target roaming policy meets the expected requirements. If not, the policy parameters in the first target roaming policy are optimized before guiding the target terminal to roam. Therefore, compared with using a threshold method to guide the roaming of terminal devices, the differences between different terminal devices are taken into account, and the roaming policies adopted for different terminal devices can be adaptively adjusted during the roaming process to maximize the roaming benefits, thereby improving the applicability of the terminal device when roaming.
[0091] For each of the above-mentioned aspects from the third to the fifth aspect and the technical effects that may be achieved by each of the aspects, please refer to the above-mentioned description of the technical effects that can be achieved by various possible solutions in the first or second aspect, and no further details will be given here.
[0092] Other features and advantages of the present application will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present application. The purposes and other advantages of the present application can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0093] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, without paying any creative work, they can also obtain drawings of other embodiments based on these drawings.
[0094] The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute improper limitations on the present application.
[0095] FIG1 is a schematic diagram of an application scenario applicable to an embodiment of the present application.
[0096] FIG2 is a flowchart of a terminal roaming guidance method provided in an embodiment of the present application.
[0097] FIG3 is a schematic structural diagram of a terminal roaming guidance device provided in an embodiment of the present application.
[0098] FIG4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0099] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of the technical solutions of this application, but not all of them. Based on the embodiments described in this application document, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the technical solutions of this application.
[0100] The terms "first" and "second" in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any of its variations are intended to cover non-exclusive protection. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. "Multiple" in this application can mean at least two, for example, two, three or more, and the embodiments of this application are not limited thereto.
[0101] In addition, the term "and / or" in this document simply describes an association between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document, unless otherwise specified, generally indicates an "or" relationship between the related objects.
[0102] Currently, intelligent roaming is used to guide terminal devices to roam. This is primarily done by configuring a threshold on the AP side to trigger roaming. When the AP detects that a terminal device parameter (for example, signal-to-noise ratio or communication rate) falls below the threshold, it proactively sends a disassociation message to the terminal device, allowing it to associate with an AP with better signal strength and faster communication rate.
[0103] However, different types of terminal devices, and even different terminal devices of the same type, can have varying network communication capabilities. Therefore, during the triggering phase, the thresholds for triggering roaming vary for different types of terminal devices, and even for different terminal devices of the same type. If a threshold is set to guide terminal device roaming, setting the threshold is crucial. A fixed threshold is relatively simple to determine, but can result in poor roaming performance. A variable threshold is more complex to determine. Therefore, this threshold-based approach to guiding terminal device roaming is less applicable.
[0104] To facilitate understanding by those skilled in the art, the technical terms involved in each exemplary embodiment of the present application are first explained.
[0105] (1) Cold start means that a terminal can reuse the roaming policy of terminals of the same type, and a new AP network environment can reuse the roaming policy of terminals associated with similar network environments.
[0106] (2) SARSA (State Action Reward State Action) algorithm is an algorithm for learning Markov decision process strategies. It is usually used in the fields of machine learning and reinforcement learning. It updates the current action (or strategy) by updating the value function (such as Q function), and then generates new states and rewards through new actions (or strategies), and then updates the value function. It continues to iterate until both the value function and the strategy converge to meet the desired requirements.
[0107] (3) Greedy Algorithm: When solving a problem, it always makes the best choice at the moment. In other words, it does not consider the overall optimal solution, and the algorithm only obtains a local optimal solution in a certain sense.
[0108] (4) Received Signal Strength Indicator (RSSI): Generally used to indicate wireless signal strength, it refers to the signal strength of the wireless signal when it is received. RSSI is related to the transmit power of the wireless module, the design of the RF front end, and the gain of the antenna.
[0109] The following briefly introduces the application scenarios to which the technical solutions of the embodiments of the present application can be applied. It should be noted that the application scenarios described below are only used to illustrate the embodiments of the present application and are not limiting. In specific implementation, the technical solutions provided by the embodiments of the present application can be flexibly applied according to actual needs.
[0110] Figure 1 is a schematic diagram of an application scenario applicable to the implementation of this application. As shown, the scenario includes a target terminal 101 and an access point 102. Specifically, AP 102 includes three access points (AP1, AP2, and AP3). It should be noted that there is no limit to the number of APs involved in AP 102; Figure 1 only illustrates three APs.
[0111] AP 102 comprises three APs forming an AP network environment 103. When a target terminal 101 enters this AP network environment 103, AP 102 can assign a matching first target roaming policy to the target terminal 101. During the roaming process, if AP 102 determines that the roaming of the target terminal 101 based on the first target roaming policy does not meet the desired requirements, AP 102 can adjust the policy parameters of the first target roaming policy in real time until the desired requirements are met. AP 102 then guides the target terminal 101 to roam to a target AP (e.g., AP1 in FIG. 1 ) in the AP network environment 103 based on the adjusted second target roaming policy, so that AP1 can provide network services to the target terminal 101. Network services may include, for example, channels (resources), wireless fidelity (Wi-Fi) signals, and the like.
[0112] The target terminal 101 can be an electronic device such as a mobile phone, a smart wearable device, a tablet computer, a notebook, etc.; in addition, a related client can also be installed on the target terminal 101, and the client can be software, such as an application (English: Application, abbreviated: APP), a browser, short video software, etc., or a web page, a mini program, etc.
[0113] In an embodiment of the present application, a network portrait library can be pre-built. This network portrait library can be used to store AP network portraits for various AP network environments. When subsequently building a new AP network environment, similarity comparison can be performed based on this network portrait library to achieve a rapid cold start. Specifically, network information for N APs in the AP network environment (e.g., network information for AP1, AP2, and AP3 in FIG1 ) can be obtained. Based on the network information for these three APs (which may include one or more of each AP's coverage information, distribution information, jitter drop point area, and mutual scanning information), the network environment characteristics of the AP network environment (e.g., AP network environment 103 in FIG1 ) are determined. Based on the network environment characteristics of the AP network environment including these three APs, an AP network portrait for the AP network environment is constructed and stored in the network portrait library. That is, the network portrait library is determined based on the environmental characteristics of the various AP network portraits and includes network portraits for multiple AP network environments. The AP network portrait is used to characterize the network environment characteristics of the AP network environment.
[0114] In one embodiment, the following aspects may be considered to determine the network environment characteristics of the N APs.
[0115] Aspect 1: Based on the coverage information in the network information of N APs, the network environment characteristics of the AP network environment are determined. The coverage information may include the coverage range of each AP in the AP network environment. This coverage information can be used to identify points in the AP network environment (e.g., AP network environment 103 in Figure 1) where insufficient signal coverage exists, thereby preventing roaming performance from being affected by insufficient signal coverage during roaming.
[0116] Aspect 2: Determine the network environment characteristics of the AP network environment based on the distribution information in the network information of N APs. The distribution information is used to characterize the specific location of each AP in the AP network environment, which helps improve the accuracy of roaming during the subsequent roaming process.
[0117] Aspect 3: Based on the jitter dropout areas in the network information of N APs, the network environment characteristics of the AP are determined. The jitter dropout areas are used to identify areas in the AP network environment where signal jitter exists. These areas can be processed accordingly to prevent subsequent roaming performance issues caused by signal jitter.
[0118] Aspect 4: Determine the network environment characteristics of the AP network environment based on the mutual scanning information in the network information of N APs. The mutual scanning information is used to characterize each AP in the AP network environment. For example, AP identifiers and signal strengths (such as RSSI) can be used to distinguish APs in the AP network environment. The mutual scanning information is used to characterize the information about the peer AP (such as AP identifiers and received signal strength) that each AP can determine based on information received from the peer AP.
[0119] It should be noted that the construction of AP network portraits for various AP network environments can be achieved through one or more of the above aspects, and the specific combination is not limited. The above aspects 1 to 4 are only examples. During the actual roaming process, AP network portraits can also be constructed based on the characteristics of other aspects.
[0120] In one embodiment, when building a new AP network environment, a method for implementing a fast cold start based on a network portrait library may specifically include the following steps.
[0121] Obtain the mutual scanning information of M APs in the new AP network environment, where M is an integer greater than 0; sort the M APs by importance based on the mutual scanning information of the M APs; construct a mutual scanning matrix of the new AP network environment based on the mutual scanning signal strength values of the M APs in the importance sorting, for example, the number of rows of the mutual scanning matrix represents the number of APs in the network environment, the number of columns represents the number of APs scanned (receivable), the matrix elements can be the signal strengths of the received APs, and the magnitude of the signal strength can represent the perceived distance between the APs. Generally speaking, the closer the two APs are, the greater the signal strength value. ; Generate a new AP network portrait of the new AP network environment based on the mutual scanning matrix of the new AP network environment; if the new AP network portrait of the new AP network environment meets the similarity requirement with the AP network portrait of the AP network environment in the network portrait library (for example, the AP network environment 103 in Figure 1), the terminal portrait library of the AP network environment 103 is reused for the new AP network environment, thereby achieving a fast cold start; if the new AP network portrait of the new AP network environment does not meet the similarity requirement with all the AP network portraits in the AP network environment in the network portrait library, the new AP network portrait is added to the network portrait library.
[0122] In one embodiment, determining whether a new AP network profile of a new network environment meets a similarity requirement with an AP network profile of an AP network environment in a network profile library includes:
[0123] Determining the similarity between the mutual scanning matrix of the new AP network environment and the mutual scanning matrix of the first AP network environment in the network portrait library;
[0124] When the similarity meets the preset requirement, it is determined that the new AP network profile of the new network environment and the AP network profile of the AP network environment in the network profile library meet the similarity requirement.
[0125] In one embodiment, the similarity can be cosine similarity (the value range can be 0 to 1, and the larger the value, the more similar), Euclidean distance (the smaller the distance, the more similar), or jaccard similarity (the value range can be 0 to 1, and the larger the value, the more similar); accordingly, the similarity requirement can be that the similarity is less than a preset threshold set according to actual needs.
[0126] The similarity requirement may also be that a clustering algorithm can be used to find the cluster center closest to the mutual scanning matrix of the new AP network environment. When the nearest cluster center is found, the Euclidean distance between the cluster center and the mutual scanning matrix of the new network environment meets the preset requirements (for example, it may be less than 0.5), then the AP network portrait of the AP network environment in the network portrait library meets the similarity requirement.
[0127] In one embodiment, the importance of M APs is sorted based on the mutual scanning signal strength values of the M APs, and the AP with a larger mutual scanning signal strength value is more important; or the importance of the M APs can be sorted based on the frequency of the M APs, and the AP with a higher frequency is more important.
[0128] In one embodiment, generating a new AP network portrait of the new AP network environment based on the mutual scanning matrix of the new AP network environment can be: based on the mutual scanning matrix of the new AP network environment, using a feature training model to extract the network environment characteristics of the new AP network environment, and generating a new AP network portrait of the new AP network environment based on the network environment characteristics of the new AP network environment.
[0129] By constructing the above-mentioned network portrait library, various AP network environments can be summarized and distinguished. When a new AP network environment is subsequently constructed, the roaming strategy of a similar AP network environment can be reused based on the network portrait library, thereby omitting the process of re-formulating the roaming strategy, thereby improving the roaming efficiency of the terminal and optimizing the roaming experience.
[0130] In one embodiment of the present application, a terminal profile library can be configured for the constructed AP network environment (for example, a terminal profile library can be configured for AP 102 in Figure 1). This terminal profile library includes roaming policies for at least one type of terminal across N APs. For example, Class A terminals can include at least three roaming policies for AP1, AP2, and AP3, respectively. Similarly, Class B terminals can also include at least three roaming policies for AP1, AP2, and AP3, respectively. Class C terminals can also include at least three roaming policies for AP1, AP2, and AP3, respectively. Terminal types can be classified based on one or more combinations of hardware specifications, such as brand, category, and model.
[0131] In some embodiments, the roaming strategies of various types of terminals in N APs can be distinguished by terminal profiles. A terminal profile can carry the terminal's network communication capabilities (e.g., RSSI) during roaming, the terminal name, terminal identifier, terminal type, and the roaming strategies adopted by the terminal when roaming in N APs. This terminal profile library can assist the AP in roaming guidance of terminals. For example, when a target terminal comes online, if a matching terminal profile exists in the terminal profile library, roaming guidance can be performed on the target terminal based on the matching terminal profile.
[0132] It should be noted that the specific forms of the above-mentioned network portrait library and terminal portrait library are not limited in the embodiments of this application.
[0133] To further illustrate the technical solutions provided by the embodiments of the present application, this is described in detail below with reference to the accompanying drawings and specific implementation methods. Although the embodiments of the present application provide the method operation steps as shown in the following embodiments or drawings, more or fewer operation steps may be included in the method based on routine or no creative labor. In the steps where there is no necessary causal relationship logically, the execution order of these steps is not limited to the execution order provided by the embodiments of the present application. The method may be executed or executed in parallel in the order of the methods shown in the embodiments or drawings during the actual processing process or when the device is executed.
[0134] Figure 2 is a flow chart of a terminal roaming guidance method provided in an embodiment of the present application. This process can be executed by a terminal roaming guidance device, which can be implemented through software, hardware, or a combination of software and hardware. As shown in Figure 2, the process includes the following steps.
[0135] Step 201: Acquire historical roaming data of a target terminal under a first target roaming policy, and determine a roaming evaluation result of the target terminal according to the historical roaming data.
[0136] The first target roaming policy may be a roaming policy initially allocated when the target terminal (such as the target terminal 101 in FIG1 ) enters the AP network environment.
[0137] In one embodiment, the terminal type of the target terminal can be identified, and a first target roaming policy can be allocated to the target terminal based on the terminal type of the target terminal and the terminal portrait library configured above.
[0138] In one embodiment, the terminal type of the target terminal can be identified by identifying the Media Access Control (MAC) address; the terminal type of the target terminal can also be identified by a communication request initiated by the target terminal (for example, a hypertext transfer protocol (http) communication request, a communication request frame, etc.); the terminal type of the target terminal can also be identified by the attribute information of the target terminal (information used to characterize the physical attributes of the target terminal and / or the attributes of the terminal user; for example, user information, Internet behavior information, Internet device information, etc.). The embodiments of the present application are not limited here.
[0139] In one embodiment, a first target roaming policy is allocated to the target terminal based on the terminal type to which the target terminal belongs and the terminal portrait library configured above, which may mainly include the following two situations.
[0140] Case 1: If, based on the terminal type of the target terminal, a first terminal matching the terminal type is found in the terminal portrait library, the roaming policy of the first AP currently associated with the first terminal among the N APs is used as the first target roaming policy of the target terminal, allowing the newly connected target terminal to reuse the roaming policy of the same type of terminal (referred to as cold start), thereby improving the speed of roaming. Taking Figure 1 above as an example, if the terminal type of the target terminal matches a Class A terminal, the roaming policies of the Class A terminal in AP1, AP2, and AP3 can be obtained from the terminal portrait library. When it is determined that the first AP currently associated with the Class A terminal is AP1, the roaming policy of the Class A terminal in AP1 can be used as the first target roaming policy of the target terminal, thereby achieving a fast cold start.
[0141] Case 2: If, based on the terminal type to which the target terminal belongs, the first terminal that matches the terminal type is not found in the terminal portrait libraries associated with each of the N APs, the initial roaming strategy of the target terminal is determined based on the mutual scanning information of the N APs in the AP network environment and the roaming information of the target terminal (which may be the historical roaming data of the target terminal, such as the received signal strength before and after roaming, roaming time, channel utilization, number of uplink bytes, number of downlink bytes, packet loss rate, physical rate, etc.), and the initial roaming strategy of the target terminal is used as the first target roaming strategy of the target terminal.
[0142] In one embodiment, obtaining historical roaming data of the target terminal under the first target roaming policy may be obtaining historical roaming data of the target terminal within a set time period (for example, from 7 a.m. to 9 a.m. every day) under the first target roaming policy; or obtaining sufficient historical roaming data of the target terminal under the first target roaming policy (that is, satisfying a preset number); or obtaining all historical roaming data of the target terminal under the first target roaming policy, which is not limited in this embodiment of the present application.
[0143] In one embodiment, a roaming assessment result of the target terminal is determined based on the historical roaming data. Specifically, the roaming assessment result of the target terminal can be obtained by performing a roaming assessment based on at least one historical roaming data item, such as signal strength, uplink physical rate, downlink physical rate, uplink byte count, downlink byte count, and packet loss rate, of the target terminal under a first target roaming policy. The roaming assessment process determines the communication performance of the target terminal by comparing the historical roaming data before and after the target terminal implements the first target roaming policy. If the communication performance deteriorates after roaming, it indicates that the roaming assessment result of the target terminal does not meet the expected requirements. If the communication performance improves after roaming, it can be further determined whether a preset threshold is met. If the preset threshold is met, the target terminal meets the expected requirements. The uplink physical rate refers to the rate at which the target terminal sends data, and the downlink physical rate refers to the rate at which the target terminal receives data. The uplink byte count refers to the number of bytes sent by the target terminal per unit time, and the downlink byte count refers to the number of bytes received by the target terminal per unit time. For example, if the downlink physical rate decreases after roaming, it is determined that the communication performance after roaming has deteriorated.
[0144] Step 202: If the roaming evaluation result does not meet the expected requirements, the policy parameters in the first target roaming policy are adjusted until they meet the expected requirements, thereby obtaining a second target roaming policy for the target terminal.
[0145] In one embodiment, the roaming evaluation result may be a result obtained based on the above-mentioned one type of historical roaming data, or a result obtained based on the above-mentioned multiple types of historical roaming data, which is not limited in this embodiment of the present application.
[0146] In one embodiment, the expected requirement is used to represent the best time for the target terminal to execute the optimal roaming strategy.
[0147] For example, using the aforementioned signal strength as an example, if the signal strength is assessed to be lower than a set signal strength threshold, indicating that the target terminal does not meet the set desired requirements using the first target roaming policy, the policy parameters in the first target roaming policy are adjusted until the desired requirements are met, thereby obtaining a second target roaming policy for the target terminal. If the signal strength is not lower than the set signal strength threshold, indicating that the target terminal can meet the desired requirements using the first target roaming policy, the target terminal is guided to roam to a target AP in the AP network environment according to the first target roaming policy.
[0148] Taking the above-mentioned uplink physical rate and downlink physical rate as an example, if the uplink physical rate is evaluated to be lower than the rate threshold, and the downlink physical rate is also evaluated to be lower than the rate limit, it indicates that the target terminal does not meet the set expected requirements by adopting the first target roaming strategy, then the policy parameters in the first target roaming strategy are adjusted until they meet the expected requirements, and the second target roaming strategy of the target terminal is obtained. Otherwise, it indicates that the target terminal can meet the expected requirements by adopting the first target roaming strategy, and according to the first target roaming strategy, the target terminal is guided to roam to the target AP in the AP network environment.
[0149] Taking the above-mentioned signal strength, packet loss rate, uplink physical rate, and downlink physical rate as an example, they are compared with their respective set thresholds. If any one of them does not exceed the set threshold, it indicates that the target terminal does not meet the set expected requirements by adopting the first target roaming strategy. Then, the policy parameters in the first target roaming strategy are adjusted until the expected requirements are met, and the second target roaming strategy of the target terminal is obtained. Otherwise, it indicates that the target terminal can meet the expected requirements by adopting the first target roaming strategy. According to the first target roaming strategy, the target terminal is guided to roam to the target AP in the AP network environment.
[0150] Optionally, the policy parameters in the first target roaming policy are adjusted until the desired requirement is met, using a SARSA algorithm. Specifically, the following steps may be performed: based on the target terminal executing the selected first roaming action in the current first roaming state (which may be a state where the expected reward does not meet the desired requirement), an expected reward (which may be the aforementioned roaming evaluation result) and a second roaming state at the next moment are obtained; a second roaming action to be executed by the target terminal in the second roaming state is determined based on a Q function. For example, a second roaming action is selected and executed in the second roaming state using a greedy algorithm configured based on the Q function; and the Q function is updated based on the second roaming state, the second roaming action, and the expected reward until the updated Q function meets the desired requirement (e.g., when the Q function value is maximized). The desired requirement may be that the policy parameters (e.g., roaming actions, which may include but are not limited to roaming out of an old AP or roaming into a new AP) are optimal for the target terminal to roam to the target AP (e.g., optimal signal strength and physical rate), thereby maximizing the benefit of the target terminal when roaming to the target AP, i.e., maximizing the Q function value (benefit value). In the embodiment of the present application, the Q function represents the obtained benefits, that is, the benefit value of each state and each strategy adopted in this state, which can be stored in a table or matrix, for example.
[0151] Among them, the Q function satisfies the following expression:
[0152] Q(s,a)=Q(s,a)+α(r+γQ(s′,a′)-Q(s,a));
[0153] Among them, s is the first roaming state, a is the first roaming action, r is the expected reward, α is the set learning rate, γ is the set discount rate, s' is the second roaming state, and a' is the second roaming action.
[0154] It should be noted that, in addition to using the above-mentioned SARSA algorithm, other similar reinforcement learning algorithms may also be used to adjust the policy parameters of the roaming policy, and the embodiments of the present application do not limit this.
[0155] Step 203: According to the second target roaming policy, the target terminal is guided to roam to a target AP in the AP network environment.
[0156] Optionally, after guiding the target terminal to roam to the target AP in the AP network environment according to the second target roaming policy, the second target roaming policy can also be updated to the terminal portrait library, so that when the target terminal enters the AP network environment again in the future, it can be directly guided to roam according to the policy to achieve a fast cold start and improve the roaming experience.
[0157] In an embodiment of the present application, since historical roaming data of the target terminal under the first target roaming policy is obtained for analysis, and the first target roaming policy is the roaming policy assigned when the target terminal enters the AP network environment, it is determined whether the roaming of the target terminal using the first target roaming policy meets the expected requirements. If not, the policy parameters in the first target roaming policy are optimized before guiding the target terminal to roam. Therefore, compared with using a threshold method to guide the roaming of terminal devices, the differences between different terminal devices are taken into account, and the roaming policies adopted for different terminal devices can be adaptively adjusted during the roaming process to maximize the roaming benefits, thereby improving the applicability of the terminal device when roaming.
[0158] Based on the same technical concept, an embodiment of the present application also provides a terminal roaming guidance device, which can implement the above-mentioned terminal roaming guidance method process in the embodiment of the present application.
[0159] Figure 3 is a schematic diagram of the structure of a terminal roaming guidance device provided in an embodiment of the present application. As shown in Figure 3, the device includes: an evaluation module 301, an adjustment module 302, and a guidance module 303. Furthermore, the device may also include an allocation module 304 and a network image construction module 305.
[0160] The evaluation module 301 is configured to obtain historical roaming data of a target terminal under a first target roaming policy, and determine a roaming evaluation result of the target terminal according to the historical roaming data.
[0161] The adjustment module 302 is configured to adjust the policy parameters in the first target roaming policy until the policy parameters meet the expected requirements if the roaming evaluation result does not meet the expected requirements, thereby obtaining a second target roaming policy for the target terminal.
[0162] The guiding module 303 is configured to guide the target terminal to roam to a target AP in the AP network environment according to the second target roaming policy.
[0163] In one embodiment, the adjustment module 302 is specifically configured to:
[0164] After the target terminal performs the selected first roaming action in the current first roaming state, an expected reward (which may be the aforementioned roaming evaluation result) and a second roaming state at a next moment are obtained; a second roaming action to be performed by the target terminal in the second roaming state is determined according to a Q function; and the Q function is updated according to the second roaming state, the second roaming action, and the expected reward until the updated Q function meets the expected requirement. The Q function satisfies the following expression: Q(s,a)=Q(s,a)+α(r+γQ(s′,a′)-Q(s,a)); s is the first roaming state, a is the first roaming action, r is the expected reward, α is a set learning rate, γ is a set discount rate, s′ is the second roaming state, and a′ is the second roaming action.
[0165] In one embodiment, the AP network environment includes N APs and a terminal profile library, wherein the terminal profile library includes at least one roaming policy of each terminal in the N APs, where N is an integer greater than 0; the allocation module 304 is specifically configured to:
[0166] Identify the terminal type to which the target terminal belongs; if, based on the terminal type to which the target terminal belongs, a first terminal matching the terminal type is found in the terminal portrait library, then use the roaming policy of the first AP currently associated with the first terminal among the N APs as the first target roaming policy of the target terminal; if, based on the terminal type to which the target terminal belongs, a first terminal matching the terminal type is not found in the terminal portrait library, then determine the initial roaming policy of the target terminal based on the mutual scanning information of the N APs in the AP network environment and the roaming information of the target terminal, and use the initial roaming policy of the target terminal as the first target roaming policy of the target terminal.
[0167] In one embodiment, the network image construction module 305 is used to obtain network information of N APs in the AP network environment, where N is an integer greater than 0; determine the network environment characteristics of the AP network environment based on the network information of the N APs; and construct an AP network portrait of the AP network environment based on the network environment characteristics of the AP network environment, and store it in a network portrait library.
[0168] In one embodiment, the network image construction module 305 is specifically configured to:
[0169] Determine the network environment characteristics of the AP network environment based on the coverage information in the network information of the N APs; or determine the network environment characteristics of the AP network environment based on the distribution information in the network information of the N APs; or determine the network environment characteristics of the AP network environment based on the jitter drop point area in the network information of the N APs.
[0170] In one embodiment, the network image construction module 305 is also used to: obtain mutual scanning information of M APs in a new AP network environment, where M is an integer greater than 0; sort the M APs by importance based on the mutual scanning information of the M APs; construct a mutual scanning matrix of the new AP network environment based on the mutual scanning signal strength values of each of the M APs in the importance sorting; generate a new AP network portrait of the new AP network environment based on the mutual scanning matrix of the new AP network environment; if the new AP network portrait of the new AP network environment meets the similarity requirement with the AP network portrait of the AP network environment in the network portrait library, the terminal portrait library of the AP network environment is reused for the new AP network environment.
[0171] It should be noted here that the above-mentioned device provided in the embodiment of the present application can implement all the method steps in the above-mentioned method embodiment and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.
[0172] Based on the same technical concept, an electronic device is also provided in an embodiment of the present application, which can realize the functions of the aforementioned terminal roaming guidance device.
[0173] FIG4 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0174] At least one processor 401, and a memory 402 connected to at least one processor 401. In the embodiments of the present application, the specific connection medium between the processor 401 and the memory 402 is not limited. FIG4 takes the connection between the processor 401 and the memory 402 via the bus 400 as an example. The bus 400 is represented by a bold line in FIG4, and the connection between other components is only for schematic illustration and is not intended to be limiting. The bus 400 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, FIG4 only uses a bold line to represent it, but this does not mean that there is only one bus or one type of bus. Alternatively, the processor 401 can also be called a controller, and there is no limitation on the name.
[0175] In this embodiment of the present application, memory 402 stores instructions executable by at least one processor 401. At least one processor 401 can execute a terminal roaming guidance method discussed above by executing the instructions stored in memory 402. Processor 401 can implement the functions of each module in the apparatus shown in FIG3.
[0176] Among them, the processor 401 is the control center of the device, which can use various interfaces and lines to connect the various parts of the entire control device, and monitor the device as a whole by running or executing instructions stored in the memory 402 and calling data stored in the memory 402, the various functions of the device and processing data.
[0177] In one possible design, processor 401 may include one or more processing units. Processor 401 may integrate an application processor and a modem processor. The application processor primarily processes the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 401. In some embodiments, processor 401 and memory 402 may be implemented on the same chip. In some embodiments, they may also be implemented on separate chips.
[0178] Processor 401 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of this application. A general-purpose processor can be a microprocessor or any conventional processor. The steps of a terminal roaming guidance method disclosed in the embodiments of this application can be directly implemented as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor.
[0179] The memory 402 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 402 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (Random Access Memory, RAM), a static random access memory (Static Random Access Memory, SRAM), a programmable read-only memory (Programmable Read Only Memory, PROM), a read-only memory (Read Only Memory, ROM), an electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 402 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 402 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.
[0180] By designing and programming the processor 401, the code corresponding to the terminal roaming guidance method described in the aforementioned embodiment can be embedded in the chip, so that the chip can execute the terminal roaming guidance method of the embodiment shown in FIG2 during operation. How to design and program the processor 401 is well known to those skilled in the art and will not be described in detail here.
[0181] It should be noted here that the above-mentioned electronic device provided in the embodiment of the present application can implement all the method steps implemented in the above-mentioned method embodiment and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.
[0182] An embodiment of the present application further provides a computer-readable storage medium, which stores computer-executable instructions. The computer-executable instructions are used to enable a computer to execute a terminal roaming guidance method in the above embodiment.
[0183] An embodiment of the present application further provides a computer program product. When the computer program product is called by a computer, the computer is caused to execute a terminal roaming guidance method in the above embodiment.
[0184] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0185] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or box in the flow chart and / or block diagram, as well as the combination of the flow chart and / or box in the flow chart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more flow charts and / or one or more boxes in the block diagram.
[0186] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0187] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0188] Although the optional embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the optional embodiments and all changes and modifications that fall within the scope of the present application.
[0189] Obviously, those skilled in the art may make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. Thus, if these modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the present application also intends to include such modifications and variations.
Claims
1. A terminal roaming guidance method, comprising: Acquire historical roaming data of the target terminal under a first target roaming strategy, and determine a roaming evaluation result of the target terminal according to the historical roaming data, wherein the first target roaming strategy is a roaming strategy assigned by a network profile library based on a wireless access point AP network environment when the target terminal enters the AP network environment; If the roaming evaluation result does not meet the expected requirements, adjusting the policy parameters in the first target roaming policy until the expected requirements are met, to obtain a second target roaming policy for the target terminal, wherein the expected requirements represent the best time for the target terminal to execute the best roaming policy; and Based on the second target roaming policy, the target terminal is guided to roam to a target AP in the AP network environment, wherein the target AP is a target AP in the second target roaming policy.
2. The method of claim 1, wherein: The AP network environment includes N APs, which are configured with a terminal portrait library, wherein the terminal portrait library includes one or more roaming policies of terminals in the N APs, where N is an integer greater than 0; Before acquiring the historical roaming data of the target terminal under the first target roaming policy, the method further includes: Determining the terminal type to which the target terminal belongs; If a first terminal matching the terminal type is found in the terminal portrait library according to the terminal type to which the target terminal belongs, the roaming policy of the first AP currently associated with the first terminal among the N APs is used as the first target roaming policy of the target terminal.
3. The method of claim 2, wherein: The AP network environment is configured with a terminal portrait library, including: Determine whether there is a first network profile in the network profile library that meets a similarity requirement with an AP network profile of the AP network environment; and When the first network portrait exists, the terminal portrait library corresponding to the first network portrait is reused in the AP network environment.
4. The method of claim 2, wherein: The method further comprises: If, according to the terminal type to which the target terminal belongs, a first terminal matching the terminal type is not found in the terminal portrait library, determining an initial roaming policy of the target terminal according to the mutual scanning information of the N APs in the AP network environment and the roaming information of the target terminal, and using the initial roaming policy of the target terminal as a first target roaming policy of the target terminal; The roaming information of the target terminal includes one or more of the following information: signal strength information, roaming time, channel utilization, number of uplink bytes, number of downlink bytes, packet loss rate, and physical rate.
5. The method of claim 2, wherein: The terminal portrait includes one or more of the following information: the network communication capability of the terminal during roaming, the terminal name, the terminal identification, the terminal type, and the roaming strategy adopted by the terminal when roaming in N APs respectively.
6. The method of claim 2, wherein: The determining of the terminal type to which the target terminal belongs includes one or more of the following methods: Determining the terminal type to which the target terminal belongs by identifying a media access control address; Determine the terminal type to which the target terminal belongs through the hypertext transfer protocol (http) initiated by the target terminal; as well as The terminal type to which the target terminal belongs is determined according to the attribute information of the target terminal.
7. The method of claim 1, wherein: The method further comprises: Obtain network information of N APs in the AP network environment, where N is an integer greater than 0; Determining network environment characteristics of the AP network environment according to the network information of the N APs; and According to the network environment characteristics of the AP network environment, an AP network profile of the AP network environment is constructed and stored in a network profile library.
8. The method of claim 7, wherein: The determining, according to the network information of the N APs, the network environment characteristics of the AP network environment includes one or more of the following: Determining network environment characteristics of the AP network environment according to coverage information in the network information of the N APs; Determining network environment characteristics of the AP network environment according to distribution information in the network information of the N APs; Determine the network environment characteristics of the AP network environment according to the jitter drop point area in the network information of the N APs; as well as According to the mutual scanning information in the N AP network information, the network environment characteristics of the AP network environment are determined.
9. The method according to any one of claims 1 to 8, wherein: The method further comprises: Acquire mutual scanning information of M APs in a new AP network environment, where M is an integer greater than 0; and sort the M APs by importance according to the mutual scanning information of the M APs; Constructing a mutual scanning matrix of the new AP network environment according to the mutual scanning signal strength values of the M APs in the importance ranking; Generating a new AP network profile of the new AP network environment according to the mutual scanning matrix of the new AP network environment; and If the new AP network portrait of the new AP network environment meets the similarity requirement with the AP network portrait of the AP network environment in the network portrait library, the terminal portrait library in the AP network environment is reused for the new AP network environment.
10. The method of claim 11, wherein: The method further comprises: If the new AP network portrait of the new AP network environment does not meet the similarity requirement with the AP network portraits in the network portrait library, the new AP portrait is added to the network portrait library.
11. The method of claim 9, wherein: The step of ranking the M APs by importance according to the mutual scanning information of the M APs includes: Based on the mutual scanning signal strength values of the M APs, the importance is sorted, wherein the greater the mutual scanning signal strength value, the higher the importance; or The M APs are sorted by importance based on their respective frequencies, wherein the higher the frequency, the higher the importance.
12. The method of claim 1, wherein: The acquiring of historical roaming data of the target terminal under the first target roaming policy includes: Acquire historical roaming data of the target terminal within a preset time period of the first target roaming policy; or, Acquire a preset amount of historical roaming data of the target terminal under the first target roaming policy; or, Acquire all historical roaming data of the target terminal under the first target roaming policy.
13. The method of claim 1, wherein: The historical roaming data includes: one or more of the following: signal strength, uplink physical rate, downlink physical rate, uplink byte number, downlink byte number, and packet loss rate of the target terminal under the first target roaming strategy; The determining the roaming evaluation result of the target terminal according to the historical roaming data includes: Determining whether the communication performance of the target terminal meets the set expected requirements based on the historical roaming data before and after the target terminal executes the first target roaming policy; and The expected requirement represents the suitability of the roaming behavior of the target terminal.
14. The method of claim 13, wherein: Whether the communication performance of the target terminal meets the set expected requirements, including: There is a case where the historical roaming data does not meet a corresponding set threshold, and it is determined that the communication performance of the target terminal after roaming using the first target roaming strategy does not meet a set expected requirement.
15. The method according to any one of claims 1 to 14, wherein: The adjusting the policy parameters in the first target roaming policy until the expected requirements are met includes: After the target terminal performs the selected first roaming action in the current first roaming state, obtaining an expected reward and a second roaming state at the next moment; determining, according to the Q function, a second roaming action to be performed by the target terminal in the second roaming state; and updating the Q function according to the second roaming state, the second roaming action, and the expected reward until the updated Q function meets the expected requirement; The Q function satisfies the following expression: Q(s,a)=Q(s,a)+α(r+γQ(s′,a′)-Q(s,a)); s is the first roaming state, a is the first roaming action, r is the expected reward, α is the set learning rate, γ is the set discount rate, s' is the second roaming state, and a' is the second roaming action.
16. A terminal roaming guidance device, comprising: An evaluation module, configured to obtain historical roaming data of a target terminal under a first target roaming policy, and determine a roaming evaluation result of the target terminal according to the historical roaming data; wherein the first target roaming policy is a roaming policy assigned when the target terminal enters a wireless access point AP network environment; an adjusting module, configured to adjust the policy parameters in the first target roaming policy until the policy parameters meet the expected requirements if the roaming evaluation result does not meet the expected requirements, thereby obtaining a second target roaming policy for the target terminal; and A guiding module is used to guide the target terminal to roam to a target AP in the AP network environment according to the second target roaming policy.
17. An electronic device comprising: Memory, used to store computer programs; as well as A processor, configured to implement the method steps of any one of claims 1 to 15 when executing the computer program stored in the memory.
18. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method steps described in any one of claims 1 to 15 are implemented.
Citation Information
Patent Citations
Mechanisms to improve mobile device roaming in wireless networks
CN103999511A
Roaming method in wireless local area, wireless access point and server
CN106550348A
Terminal roaming method and device
CN114189924A
Terminal roaming control method and device and roaming strategy library generation method and device
CN115734301A
Methods and systems for steering of roaming
WO2023017036A1
