802.11ax Wireless LAN Access Method

Abstract

This application provides an 802.11ax wireless LAN access method, relating to the field of wireless communication technology. The method includes: determining a resource unit allocation method; sending uplink parameter information to a network device based on the resource unit allocation method; the uplink parameter information being used for wireless LAN access control. The 802.11ax wireless LAN access method provided in this application can reduce random contention during the acquisition of parameters required for wireless LAN access, achieving low-latency wireless LAN access.

Description

Technical Field

[0001] This application relates to the field of wireless communication technology, and in particular to an 802.11ax wireless local area network access method. Background Technology

[0002] With the rapid development of mobile internet and smart terminals, personalized user services and terminal density have exploded, making High-Density High-Bandwidth Wireless Local Area Networks (HDHB WLANs) the primary form of wireless communication. The 802.11ax wireless standard employs innovative technologies such as antenna arrays, Orthogonal Frequency Division Multiple Access (OFDMA), Multi-User Multiple-Input Multiple-Output (MU-MIMO), and beamforming, providing higher bandwidth and better network performance, thus alleviating some of the single-point traffic pressure in HDHB WLANs. However, current WLAN access methods still rely on Received Signal Strength Indication (RSSI) and random contention for resource acquisition, leading to long WLAN access times and extended connection durations. Summary of the Invention

[0003] This application provides an 802.11ax wireless LAN access method to overcome the shortcomings of the prior art and achieve low-time and low-latency wireless LAN access.

[0004] In a first aspect, this application provides an 802.11ax wireless local area network access method, applied to a terminal, comprising:

[0005] Determine the allocation method for resource units;

[0006] The uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

[0007] In one embodiment, sending uplink parameter information to the network device based on the allocation method of the resource units includes:

[0008] When the terminal is active, the resource unit is allocated by designated allocation, and the terminal sends uplink parameter information to the network device through the designated resource unit.

[0009] In one embodiment, sending uplink parameter information to the network device based on the allocation method of the resource units includes:

[0010] When the terminal is in an inactive state, the resource unit is allocated by uplink orthogonal frequency division multiple access (OFDMA) random access, and the terminal sends uplink parameter information to the network device through contention to obtain the resource unit.

[0011] In one embodiment, the uplink parameter information includes cache status report information and network location information;

[0012] Send uplink parameter information to network devices, including:

[0013] The cache status report information is placed in the frame header of the cache status report response frame, and the network location information is placed in the frame body of the cache status report response frame;

[0014] The uplink parameter information is sent to the network device through the cache status report response frame.

[0015] In one embodiment, determining the allocation method of resource units includes:

[0016] Obtain the uplink parameter request message sent by the network device;

[0017] The allocation method of resource units is determined based on the target field in the uplink parameter request message; the allocation method of resource units is determined based on the active status of the terminal.

[0018] Secondly, this application provides an 802.11ax wireless LAN access method, applied to network devices, including:

[0019] The receiver receives uplink parameter information sent by the terminal; the uplink parameter information is sent based on the resource unit allocation method.

[0020] Wireless LAN access control is based on the aforementioned uplink parameter information.

[0021] In one embodiment, the 802.11ax wireless LAN access method further includes:

[0022] The allocation method of resource units is determined based on the active status of the terminal;

[0023] Send an uplink parameter request message to the terminal; the uplink parameter request message is used to indicate the allocation method of resource units.

[0024] In one embodiment, determining the allocation method of resource units based on the active state of the terminal includes:

[0025] When the terminal is active, the allocation method for the resource unit is determined to be designated allocation; or,

[0026] When the terminal is in an inactive state, the allocation method of the resource unit is determined to be uplink orthogonal frequency division multiple access random access.

[0027] In one embodiment, wireless local area network access control based on the uplink parameter information includes:

[0028] Determine the target parameters based on the aforementioned uplink parameter information;

[0029] Input the target parameters into the target model to obtain the wireless local area network access strategy output by the target model;

[0030] Wireless LAN access control is performed based on the aforementioned wireless LAN access strategy.

[0031] The target model is determined based on the priority empirical replay algorithm with adjusted time difference error loss function and the Hubel loss function.

[0032] In one embodiment, the 802.11ax wireless LAN access method further includes:

[0033] The target model is obtained by training the initial model using the target parameters as samples and the corresponding wireless LAN access policies as labels.

[0034] Thirdly, embodiments of this application provide an 802.11ax wireless local area network access device, comprising:

[0035] The determination module is used to determine the allocation method of resource units;

[0036] The sending module is used to send uplink parameter information to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

[0037] Fourthly, embodiments of this application provide an 802.11ax wireless local area network access device, comprising:

[0038] A receiving module is used to receive uplink parameter information sent by the terminal; the uplink parameter information is sent based on the resource unit allocation method.

[0039] The control module is used to control wireless local area network access based on the uplink parameter information.

[0040] Fifthly, this application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the methods described in the first and second aspects.

[0041] In a sixth aspect, this application also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the methods described in the first and second aspects.

[0042] In a seventh aspect, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the methods described in the first and second aspects.

[0043] The 802.11ax wireless LAN access method provided in this application sends uplink parameter information by determining the resource unit allocation method. Based on the uplink parameter information, wireless LAN access control can be performed, thereby reducing random competition for the parameters required for wireless LAN access during the acquisition process, reducing parameter acquisition time, improving parameter acquisition accuracy, and realizing low-latency wireless LAN access. Attached Figure Description

[0044] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0045] Figure 1 This is one of the flowcharts illustrating the 802.11ax wireless LAN access method provided in this application;

[0046] Figure 2 This is the second flowchart illustrating the 802.11ax wireless LAN access method provided in this application;

[0047] Figure 3 This is one of the structural schematic diagrams of the 802.11ax wireless local area network access device provided in this application;

[0048] Figure 4 This is the second schematic diagram of the 802.11ax wireless LAN access device provided in this application;

[0049] Figure 5 This is a schematic diagram of the structure of the electronic device provided in this application. Detailed Implementation

[0050] The common methods for accessing a wireless local area network are as follows:

[0051] (1) Electronic devices obtain network standard information and one or more network slice information from the gateway device, enabling users to more flexibly select the desired WLAN network based on whether the WLAN network provides 5G Internet access and / or based on which 5G network capabilities the WLAN network provides.

[0052] (2) Obtain the wireless access points (APs) around the device to be connected, determine the identifier of each AP, which carries application information suitable for access, and send the identifier to the device to be connected. The application information carried by the identifier indicates the matching applications that can run after connecting to the wireless access point, reflecting the network quality of different wireless access points. This allows users to selectively connect to the appropriate access point after receiving its identifier, and then run the corresponding application, ensuring efficient and accurate data transmission and improving the user experience.

[0053] (3) The AP carries the display order identifier corresponding to the Service Set Identifier (SSID) name of the wireless service it provides and the description information corresponding to the SSID name in the broadcast beacon frame message or the probe response message in response to the wireless terminal. This allows the relevant wireless terminal to sort all the SSID names based on the display order identifier corresponding to the SSID names carried in all the received Beacon messages and / or Probe Response messages, and display the sorted SSID names and their corresponding description information. Ultimately, this makes it easier for relevant users to quickly select the appropriate SSID and access the network, thereby improving the access experience of the WLAN network.

[0054] However, all of the above methods have certain drawbacks:

[0055] Method (1) allows an electronic device gateway device to receive one or more first network capability information of a wireless local area network (WLAN). The first network capability information includes the network standard information of the first gateway device and / or one or more network slicing capability information of the first gateway device, enabling users to more flexibly select the desired WLAN network based on whether the WLAN network provides 5G Internet access and / or based on which 5G network capability the WLAN network provides. However, this solution is for 5G WLAN networks and is not applicable to other types of WLAN networks such as WiFi.

[0056] Method (2) sends network identifiers to access terminals to reflect the network quality of different wireless access points, thereby enabling users to selectively access the network as needed, improving the efficiency and accuracy of data transmission, and enhancing the user experience. Although this scheme considers differentiated application requirements, it does not consider the application of high-density, high-bandwidth wireless LANs for access, nor does it involve the 802.11ax protocol.

[0057] Method (3) sends SSID names to wireless terminals so they can select access points. This method sorts the determined SSID names based on their corresponding display order identifiers to select a suitable access point. While this method allows wireless terminals to select appropriate access points, the selection process relies on the display order provided by the network provider and cannot dynamically select access points based on WLAN network conditions. This can lead to issues such as load imbalance in dense WLAN environments.

[0058] Based on the analysis of the above methods, this application proposes an access optimization method for high-density, high-bandwidth 802.11ax wireless LANs. This method utilizes novel technologies introduced in the 802.11ax protocol, such as Trigger Frames and OFDMA, to collect WLAN network parameters, generate a global access policy, and achieve flexible configuration of access resources, thereby enabling WLAN load balancing and contention avoidance.

[0059] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0060] Figure 1 This is one of the flowcharts illustrating the 802.11ax wireless LAN access method provided in this application embodiment. (Refer to...) Figure 1 This application provides an 802.11ax wireless local area network access method, which is applied to terminals such as mobile phones, computers, and televisions, and may include:

[0061] Step 110: Determine the allocation method for resource units;

[0062] Step 120: Send uplink parameter information to network devices based on the resource unit allocation method; the uplink parameter information is used for wireless LAN access control.

[0063] An 802.11ax access point (AP) serves as the access point for a WLAN, providing uplink and downlink data transmission resources. An 802.11ax wireless terminal (STA) needs to access the wireless LAN and requests network resources for data transmission. The access controller (AC), as the central controller, controls terminal access and resource allocation within the WLAN. Before a wireless terminal initiates an access action, the AC can send a parameter collection command to the AP, requesting the collection of parameters such as the wireless terminal's access service type, access resource requirements, and AP load. This information is used by the AC to calculate access policies. Upon receiving the AC's request, the AP performs the parameter collection action.

[0064] In step 110, the terminal, such as a wireless terminal, can obtain relevant information broadcast by the network device AP and determine the allocation method of Resource Units (RUs) based on the AP broadcast information. The allocation method of Resource Units may include designated allocation, random allocation, contention allocation, etc.

[0065] In step 120, the terminal can send uplink parameter information to the network device based on the resource unit allocation method determined in step 110. The uplink parameter information can be used to generate a wireless LAN access policy, thereby enabling wireless LAN access control.

[0066] The 802.11ax wireless LAN access method provided in this application sends uplink parameter information by determining the resource unit allocation method. Based on the uplink parameter information, wireless LAN access control can be performed, thereby reducing random competition for the parameters required for wireless LAN access during the acquisition process, reducing parameter acquisition time, improving parameter acquisition accuracy, and realizing low-latency wireless LAN access.

[0067] In one embodiment, sending uplink parameter information to the network device based on the resource unit allocation method includes:

[0068] When the terminal is active, the resource unit allocation method is designated allocation, and the terminal sends uplink parameter information to the network device through the designated resource unit.

[0069] When a terminal is active, it has a high probability of accessing the network, and its resource units can be allocated by designated allocation. Designated allocation allows the terminal to send uplink parameter information to the network device through a specified resource unit without having to compete for channel resources.

[0070] The 802.11ax wireless LAN access method provided in this application sends uplink parameter information of the terminal by specifying the allocation method. It can collect parameter information of active terminals with a high probability of access, reduce resource waste caused by channel collision, and reduce parameter collection time.

[0071] In one embodiment, sending uplink parameter information to the network device based on the resource unit allocation method includes:

[0072] When the terminal is inactive, the resource unit allocation method is uplink orthogonal frequency division multiple access random access, and the terminal sends uplink parameter information to the network device through contention to obtain the resource unit.

[0073] For terminals that are inactive but currently have access requests, their resource units can be allocated using Uplink OFDMA Random Access (UORA). If an inactive terminal does not have a designated RU, it can compete for an RU using UORA and then send uplink parameter information to the network device through the acquired RU.

[0074] The 802.11ax wireless LAN access method provided in this application embodiment transmits terminal uplink parameter information through a contention-based allocation method. It can collect parameter information from inactive terminals. In this case, the contention scale is small, which can reduce the parameter collection time and achieve fast parameter uploading.

[0075] In one embodiment, the uplink parameter information includes cache status report information and network location information;

[0076] Send uplink parameter information to network devices, including:

[0077] Place the cache status report information in the frame header of the cache status report response frame, and place the network location information in the frame body of the cache status report response frame;

[0078] Uplink parameter information is sent to the network device by caching status report response frames.

[0079] Uplink parameter information can include STA buffer status report information and STA network location information. Buffer status report information is located in BSR response frame, and network location information is the signal range of which APs the STA is within, used to calculate the STA's access target.

[0080] The network location information of a STA can be obtained by broadcasting a beacon frame from the AP. The beacon frame contains the AP's Service Set Identifier (SSID) and Basic Service Set Identifier (BSSID). This information allows the STA to identify nearby networks and determine whether to connect.

[0081] After receiving a Buffer State Report Request (BSRP) trigger frame broadcast by the AP, the terminal can reply with a Buffer Status Report (BSR) response frame via OFDMA. This frame is either a Quality of Service (QoS) data frame or a QoS null frame, in which the buffer status report information is located in the QoS control field or BSR control subfield of the response frame header.

[0082] This application combines the reporting process of terminal network location information with the reporting process of cache status report information. Specifically, the STA's BSR information is still placed in the Frame Header of the BSR response frame, and the Beacon frame information received by the STA from different APs is placed in the Frame Body of the BSR response frame. The terminal can send uplink parameter information to the network device AP through the cache status report response frame. Both types of STA parameter information can reach the AP through a single uplink information transmission.

[0083] The AP will receive uplink parameter information from the STA, summarize it, and upload its own load information and the STA's parameter information to the network device AC.

[0084] The 802.11ax wireless LAN access method provided in this application combines the reporting process of cache status report information and network location information, which can save time consumption in the parameter acquisition stage. In addition, by using trigger frames, OFDMA and other technologies, high-precision acquisition of network parameters is also achieved, and finally low-latency wireless LAN access can be realized.

[0085] In one embodiment, determining the allocation method of resource units includes:

[0086] Obtain the uplink parameter request message sent by the network device;

[0087] The allocation method of resource units is determined based on the target field in the uplink parameter request message; the allocation method of resource units is determined based on the active status of the terminal.

[0088] The AP broadcasts a BSRP trigger frame requesting the STA to send uplink parameter information and enable uplink OFDMA. After receiving the uplink parameter request message from the network device AP (i.e., after receiving the BSRP trigger frame), the STA can specify the RU allocation method during OFDMA transmission based on the AID12 field in the target field of the BSRP trigger frame.

[0089] Specifically, when the terminal is active, the AP can collect parameters in several rounds using the RU (Remote Root) allocation method. The RU is assigned to the target STA via the AID12 field of the trigger frame. The value of the AID12 field represents the STA's AID, ranging from 1 to 2007. When the terminal is inactive, it can upload parameter information in several rounds using the UORA (User-Oriented Access) method. In this case, the value of the AID12 field can be 0 or 2045, indicating that the RU has not been assigned by the AP, and the STA can compete for the RU using the UORA method to upload parameters.

[0090] The 802.11ax wireless LAN access method provided in this application determines the value of a target field by the active state of the terminal, and determines the allocation method of resource units based on the value of the target field. This can speed up parameter acquisition and achieve low-latency wireless LAN access.

[0091] The 802.11ax wireless LAN access method provided in this application is described below from the perspective of the network device. The 802.11ax wireless LAN access method on the network device side described below can be referred to in correspondence with the 802.11ax wireless LAN access method on the terminal side described above.

[0092] Figure 2 This is the second flowchart illustrating the 802.11ax wireless LAN access method provided in this application embodiment. (Refer to...) Figure 2 This application provides an 802.11ax wireless local area network access method, which is applied to network devices and may include:

[0093] Step 210: Receive uplink parameter information sent by the receiving terminal; the uplink parameter information is sent based on the resource unit allocation method;

[0094] Step 220: Control wireless LAN access based on uplink parameter information.

[0095] In one embodiment, the 802.11ax wireless LAN access method further includes:

[0096] The allocation method of resource units is determined based on the active status of the terminal;

[0097] Send an uplink parameter request message to the terminal; the uplink parameter request message is used to indicate the allocation method of resource units.

[0098] In one embodiment, determining the allocation method of resource units based on the active state of the terminal includes:

[0099] When the terminal is active, the resource unit allocation method is determined to be designated allocation; or,

[0100] When the terminal is inactive, the resource unit allocation method is determined to be uplink orthogonal frequency division multiple access random access.

[0101] In one embodiment, the network performs wireless LAN access control based on uplink parameter information, including:

[0102] Determine the target parameters based on the uplink parameter information;

[0103] Input the target parameters into the target model to obtain the wireless LAN access strategy output by the target model;

[0104] Wireless LAN access control is based on wireless LAN access policies.

[0105] The target model is determined based on the priority empirical replay algorithm with adjusted time difference error (TD-error) loss function and the Huber loss function.

[0106] After obtaining the load information of the AP and the uplink parameter information of the STA, the network device AC can process them to obtain the target parameters, and then use these target parameters to calculate the high-density, high-bandwidth 802.11ax WLAN terminal access strategy.

[0107] Let n be the number of STAs with uplink and downlink data transmission requirements within the WLAN range, and m be the number of APs. The AC can first process network parameters such as AP load information and STA uplink parameter information, mainly processing them into three types of information:

[0108] (1) Network location information

[0109] After summarizing the network location information uploaded by the STA, the AC can obtain the relative positional relationship between the AP and STA in the WLAN. The AC can represent this positional relationship as a set, APrange. j The elements in the AP represent the AP j STAs within signal range.

[0110] (2) Access resource requirement information

[0111] After obtaining the STA's buffer status report information through the BSR response frame, the AC uses this information to calculate the uplink and downlink transmission rate requirements for the terminal's access services. The theoretical transmission rate calculation formula for 802.11ax is as follows:

[0112] Speed ​​= ms i *mb i *N subcarrier *N strea / (Symbol+GI)

[0113] Where Speed ​​is the theoretical transmission rate of 802.11ax; ms i The symbol bit length (mb) is the length of the symbol bit. i The bit rate is the symbol length; the bit rate and symbol length are determined by the modulation and coding scheme (MCS); N subcarrier N is the number of subcarriers; stream MIMO spatial stream number, allocated by AP; Symbol is a fixed value of 12.8us; GI is a fixed value for inter-frame gap, of 0.8us.

[0114] The subcarrier requirement N corresponding to the 802.11ax OFDMA transmission mechanism subcarrier for:

[0115]

[0116] Among them, bs i For STA I The buffer size; ΔT is the transmission opportunity (TXOP) duration.

[0117] Given STA I The buffer size is 1 / 250b. I MCS stands for mcs I The TXOP duration is ΔT. Assuming that all STAs' buffers will be transferred within ΔT, then the STAs... i The minimum required transmission rate is bs i / ΔT.

[0118] N subcarrierThe possible values ​​are 26, 52, 106, 242, 484, and 996, from which the RU specification corresponding to the STA transmission rate can be obtained. According to the 802.11ax RU classification method, let the need corresponding to a 26-tone RU be denoted as... i for Then 52-tone RU, 106-tone RU, and 242-tone RU correspond to respectively The maximum spectrum resources provided by 20MHz are The maximum spectrum resources provided by 40MHz are STA i The spectrum resource requirement is need i AP j The spectrum resources are supplied. j .

[0119] (3) Terminal access service types

[0120] The access category is used to manage different QoS requirements for terminal access services. This application, referencing the 802.11e standard, defines four access categories: Best Effort, Background, Video, and Voice, distinguished by the ACI field and corresponding to different priorities. The ACI value corresponding to the terminal's access service access category is identified by the ACI High field in the BSR response frame, and is uploaded to the AC and STA via the BSR response frame during the parameter acquisition phase. i The access service type is denoted as ACI. i .

[0121] After the above operations, the AC can determine the target parameters based on the network parameters. The target parameters include: terminal network location information APrange. j AP j Available spectrum resources supply j STA i The spectrum resources required for access i STA i Access service type ACI i .

[0122] AC can input target parameters into the target model, obtain the wireless LAN access policy output by the target model, and perform wireless LAN access control based on the wireless LAN access policy.

[0123] In high-density, high-bandwidth 802.11ax WLANs, access resources are limited. Therefore, the Access Control Unit (AC) can define the access value of different STAs to achieve reasonable allocation of access resources and meet the differentiated QoS requirements of terminals. The AC defines the access value of different STAs.i The access value is calculated as follows:

[0124]

[0125] Among them, v i For STA i The access value; α and β are weighted coefficients used to weigh the impact of cache size and waiting time on the access value, and can be flexibly varied according to different service scenarios; bs min This represents the minimum terminal cache size; bs max wt is the maximum value of the terminal buffer size. i wt is the waiting time for the terminal STA. min wt represents the minimum terminal waiting time. max This represents the maximum terminal wait time; ACI i The priority corresponding to ACI for STA service type.

[0126] To remove the influence of dimensions, in calculating v i At that time, it is possible to deal with bs i and wt i Perform Min-Max normalization.

[0127] At this point, the AC transforms the access optimization problem into a problem of maximizing access value under limited resource constraints. The resource providers are the APs in the WLAN. j Available resources are supply j STA i The required resources for access are needed. i The value is v i .

[0128] This optimization problem can be solved by constructing a DQN model. The state space, action space, and reward function of the DQN model are defined as follows:

[0129] State space: The resource allocation state of m APs, that is, the AP access resource supply at the current time t. j Occupied status.

[0130] Action space: The set of all possible actions that an agent can take based on the current state space. The action execution flow is as follows: Select a STA that is not connected to the WLAN, then select a target AP that the STA can connect to, and attempt to select the STA to connect to the target AP.

[0131] Reward function: Select STA i Access AP j If there is no violation of resource constraints, supply can be used. j Greater than neet i The action was executed successfully, and the reward r is STA. i value v i Otherwise, the reward r is The specific formula is as follows:

[0132] r t =R(s) t ,a t ,s t+1 )

[0133] Where, r t Let be the reward at time t; R be the value function; s t The current network state; a t The currently executing action; s t+1 This is the next transition state.

[0134] The target model can be obtained by optimizing the DQN model using the priority empirical replay algorithm with adjusted time difference error loss function and Hubel loss function.

[0135] After the DQN model is built, the Improved-DQN algorithm can be used to train the model. Compared with the traditional DQN, Improved-DQN mainly optimizes the experience replay mechanism and loss function calculation, which can improve the DQN model's performance and speed in solving WLAN access optimization problems.

[0136] The specific steps for constructing the target model are as follows:

[0137] (1) Initialize two neural networks, Q-Network(Q) and Target Q-Network(Q′). The two networks have the same structure but different parameters, θ and θ′, respectively. Before the algorithm is executed, a greedy algorithm ε-greedy strategy is first used to generate samples, producing (s t ,a t ,r t ,s t+1 The quadruple indicates the network state of HDHB WLAN. t Execute access selection action a t The reward r t and the next transition state s t+1 The quadruple (s) generated during the state transition process t ,a t ,r t,s t+1 The samples are stored in the experience replay pool as initial samples and used as input to the neural network when the algorithm is executed.

[0138] (2) Initialize the Experience Replay pool to store the Agent's experience in the environment. Improved-DQN optimizes the experience replay mechanism by employing a priority experience replay algorithm based on adjusting the time difference error loss function. Specifically, during the sampling process, samples with a time difference error δ less than the threshold η are uniformly sampled; when the time difference error is greater than the threshold η, the squared loss function is used to calculate the loss function. The sampling probability of the sample is:

[0139]

[0140] Where P(i) is the probability that sample numbered i in the experience replay pool is sampled; δ i σ represents the time difference error of sample i; σ is used to balance the weight of importance sampling and random sampling, when σ = 0 it is equivalent to using random sampling; η is the threshold, which can be defined by the user; max(|δ i | σ η) represents the sampling weight of sample number i in the experience replay pool; J represents the number of samples in the experience replay pool.

[0141] (3) At each time step t, the Agent follows the ε-greedy policy based on the current network state s. t Select action a t Execute action a t Afterwards, the agent observes the new state s returned by the environment. t+1 and reward r t .

[0142] The ε-greedy strategy involves randomly exploring unknown actions and states with a probability of ε, and then selecting the action with the highest reward at each time step with a probability of 1-ε.

[0143]

[0144] Among them, a max (s;θ) represents the action with the highest reward when the network state is s and the parameter of the Q-Network is θ; Q(s,a;θ) represents the Q-Network corresponding to action a when the network state is s.

[0145] (4) (s) t ,a t ,r t ,s t+1 This experience tuple is stored in the Experience Replay pool.

[0146] (5) Randomly select a certain number of experience tuples from the experience pool to train the Q-Network. For each experience tuple, calculate the maximum action in the current state and the Q-value y of the maximum action. t :

[0147]

[0148] Among them, y t Q is the Q-value of the maximum action in the current state; Q(s,a; θ) represents the Q-Network corresponding to state s and action a; Q ′ (s,a;θ ′ () indicates that the target-Q network corresponding to state s and action a is executed. The target Q-value y in Improved-DQN is... t It is calculated jointly by Q-Network and Target-Q-Network to address the problem of overestimation of Q-value.

[0149] (6) Update the parameters of the Q-Network using the backpropagation algorithm to reduce the error between the predicted Q-value and the actual reward in the current state. In each iteration, by minimizing the loss function, the network parameters θ can be updated, thereby updating the decision action. The updated Q-Network will be used to select the next action. Before calculating the loss function, the current time difference error δ is first calculated. t That is, the difference between Q-Network and Target-Q-Network:

[0150] δ t =y t -Q(s,a;θ)

[0151] This application replaces the Mean Square Error (MSE) loss function in the traditional DQN algorithm with Hubel loss. The adjusted loss function of the DQN neural network is as follows:

[0152]

[0153] Where L(θ) is the loss function of the adjusted DQN neural network; η is a parameter in the Huber loss function, representing the threshold.

[0154] When the TD-error is less than the threshold, it is considered a normal value, and the gradient gradually decreases. At this time, the loss function is similar to the mean square error (MSE) loss function, which can ensure that the model obtains the global optimum more accurately. When it is greater than the threshold, the gradient is always approximately η. At this time, the error function is similar to the mean absolute error (MAE) loss function, which can ensure that the model updates parameters quickly and still has good resistance to outliers.

[0155] (7) At regular time steps, copy the parameters of the Q-Network to the Target Q-Network, and let θ ′ =θ, this method of parameter update can improve the stability of the algorithm and make the algorithm more likely to converge.

[0156] (8) Repeat steps 3-7 until convergence or the specified number of training iterations is reached.

[0157] After training, the trained DQN network becomes the target model, which can generate high-density, high-bandwidth 802.11ax WLAN global access policies. The target parameters are input into the trained Improved-DQN model, and the model outputs the access policy.

[0158] The 802.11ax wireless LAN access method provided in this application can generate an optimized network access strategy by inputting target parameters into a target model obtained after adjustment based on the DQN model, thereby controlling wireless LAN access. This reduces the large traffic pressure caused by network access in high-density, high-bandwidth 802.11ax WLANs and solves the problem of unbalanced WLAN traffic load. In addition, the optimized network access strategy supports orderly access of high-density terminals and avoids too many terminals accessing a single AP, reducing transmission latency caused by channel contention during transmission and improving the overall throughput of the WLAN.

[0159] In one embodiment, the 802.11ax wireless LAN access method further includes:

[0160] The target model is obtained by training the initial model using the target parameters as samples and the corresponding wireless LAN access policies as labels.

[0161] The AC can obtain target parameters by processing the AP's load information and the STA's uplink parameter information. Then, it uses these target parameters as samples and the corresponding WLAN access policy as labels to train the initial model, resulting in the target model. The training of the model can be restricted according to actual needs, such as reaching a certain number of iterations or a certain accuracy rate; this application does not impose specific restrictions in this regard. The AC performs WLAN access control based on the WLAN access policy output by the target model.

[0162] The 802.11ax wireless LAN access method provided in this application obtains a prediction model by training an initial model. The accuracy of the model can be improved through continuous iteration, thereby ensuring the optimization of the wireless LAN access strategy and thus ensuring access control of the wireless LAN.

[0163] Based on the above embodiments, this application can simulate the proposed scheme using Python. The simulation environment is an indoor local area network scenario, where all devices support the IEEE 802.11ax network protocol. All downlink channels from base stations to users and interference channels to other users are modeled as independent and identically distributed Rayleigh fading models, and the channel gain is normalized. The Improved-DQN model consists of a fully connected neural network with one hidden layer containing 32 neurons, each with the ReLU (Rectified Linear Unit) activation function. Simulation parameters are shown in the table below:

[0164] frequency band 5GHz Spectrum bandwidth 40MHz Guard interval 3.2μs Modulation and Coding Strategy (MCS) 9 Excitation function ReLU Learning rate 0.0001 Experience pool size 2000

[0165] To better evaluate the performance of the algorithm in this application, we compare this solution with three other access methods:

[0166] 1) Access algorithm based on RSSI signal strength.

[0167] 2) Access strategy generation algorithm based on greedy algorithm.

[0168] 3) Access policy generation algorithm based on DQN.

[0169] Among them, 2) and 3) use the same AC configuration as the access policy generation algorithm based on Improved-DQN to calculate the access policy, and 1) the access algorithm based on RSSI signal strength does not use AC control.

[0170] In the simulation, we compared this application with three algorithms by changing parameters such as the number of terminals, node density, and cache space size, and evaluated the algorithm performance from the perspectives of average latency and hit rate.

[0171] With a constant number of access points (APs), the throughput differences among the four access methods are small at low terminal density. At higher terminal density, Improved-DQN outperforms the other three algorithms in throughput, and the throughput difference widens with increasing terminal density. When terminal density is high, the average throughput of RSSI-based access algorithms shows a decreasing trend, which is due to increased random channel contention.

[0172] When terminal density is low, RSSI-based access has the shortest access latency because it eliminates the time required for parameter acquisition and computation. However, as terminal density increases, the latency of RSSI-based access increases rapidly, with a faster growth rate than the other three access methods. In scenarios with high terminal density, Greedy calculates a shorter average access latency due to its lower algorithm complexity and shorter computation time. Improved-DQN outperforms DQN in terms of access latency.

[0173] The 802.11ax wireless LAN access device provided in this application is described below. The 802.11ax wireless LAN access device described below and the 802.11ax wireless LAN access method described above can be referred to in correspondence.

[0174] Figure 3 This is one of the structural schematic diagrams of the 802.11ax wireless local area network access device provided in the embodiments of this application. (Refer to...) Figure 3 The 802.11ax wireless local area network access device provided in this application embodiment may include:

[0175] Module 310 is used to determine the allocation method of resource units;

[0176] The sending module 320 is used to send uplink parameter information to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

[0177] The 802.11ax wireless LAN access device provided in this application embodiment sends uplink parameter information by determining the resource unit allocation method. Based on the uplink parameter information, wireless LAN access control can be performed, thereby reducing random competition for the parameters required for wireless LAN access during the acquisition process, reducing parameter acquisition time, improving parameter acquisition accuracy, and realizing low-latency wireless LAN access.

[0178] Figure 4 This is the second structural schematic diagram of the 802.11ax wireless local area network access device provided in the embodiments of this application. (Refer to...) Figure 4 The 802.11ax wireless local area network access device provided in this application embodiment may include:

[0179] The receiving module 410 is used to receive uplink parameter information sent by the terminal; the uplink parameter information is sent based on the resource unit allocation method.

[0180] Control module 420 is used to control wireless local area network access based on the uplink parameter information.

[0181] The 802.11ax wireless LAN access device provided in this application embodiment sends uplink parameter information by determining the resource unit allocation method. Based on the uplink parameter information, wireless LAN access control can be performed, thereby reducing random competition for the parameters required for wireless LAN access during the acquisition process, reducing parameter acquisition time, improving parameter acquisition accuracy, and realizing low-latency wireless LAN access.

[0182] Figure 5 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 5 As shown, the electronic device may include: a processor 510, a communications interface 520, a memory 530, and a communication bus 540, wherein the processor 510, the communications interface 520, and the memory 530 communicate with each other via the communication bus 540. The processor 510 can call logical instructions in the memory 530 to execute 802.11ax wireless LAN access methods, such as:

[0183] Determine the allocation method for resource units;

[0184] The uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

[0185] Furthermore, the logical instructions in the aforementioned memory 530 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0186] On the other hand, this application also provides a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the 802.11ax wireless LAN access method provided by the above methods, including, for example:

[0187] Determine the allocation method for resource units;

[0188] The uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

[0189] Furthermore, this application also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer is able to perform the steps of the 802.11ax wireless LAN access method provided by the above methods, such as including:

[0190] Determine the allocation method for resource units;

[0191] The uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

[0192] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0193] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0194] It should also be noted that the terms "first," "second," etc., used in the embodiments of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same class, and the number of objects is not limited. For example, the first object can be one or more.

[0195] In the embodiments of this application, the term "and / or" describes the relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following associated objects have an "or" relationship.

[0196] In this application's embodiments, "determine B based on A" means that factor A must be considered when determining B. It is not limited to "B can be determined based solely on A," but should also include: "determine B based on A and C," "determine B based on A, C, and E," "determine C based on A, and further determine B based on C," etc. Additionally, it can include using A as a condition for determining B, for example, "when A meets the first condition, determine B using the first method"; another example, "when A meets the second condition, determine B," etc.; another example, "when A meets the third condition, determine B based on the first parameter," etc. Of course, it can also be a condition where A is a factor in determining B, for example, "when A meets the first condition, determine C using the first method, and further determine B based on C," etc.

[0197] In the embodiments of this application, the term "multiple" refers to two or more, and other quantifiers are similar.

[0198] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for accessing an 802.11ax wireless local area network, characterized in that, Applied to terminals, including: Determine the allocation method for resource units; Uplink parameter information is sent to network devices based on the allocation method of the resource units; the uplink parameter information is used for wireless LAN access control. Based on the allocation method of the resource units, uplink parameter information is sent to the network device, including: When the terminal is in an active state, the resource unit is allocated by designated allocation, and the terminal sends uplink parameter information to the network device through the designated resource unit; Based on the allocation method of the resource units, uplink parameter information is sent to the network device, including: When the terminal is in an inactive state, the resource unit is allocated by uplink orthogonal frequency division multiple access (OFDMA) random access, and the terminal sends uplink parameter information to the network device through contention to obtain the resource unit.

2. The 802.11ax wireless LAN access method according to claim 1, characterized in that, The uplink parameter information includes cache status report information and network location information; Send uplink parameter information to network devices, including: The cache status report information is placed in the frame header of the cache status report response frame, and the network location information is placed in the frame body of the cache status report response frame; The uplink parameter information is sent to the network device through the cache status report response frame.

3. The 802.11ax wireless LAN access method according to claim 1, characterized in that, Determine the allocation method for resource units, including: Obtain the uplink parameter request message sent by the network device; The allocation method of resource units is determined based on the target field in the uplink parameter request message; the allocation method of resource units is determined based on the active status of the terminal.

4. A method for accessing an 802.11ax wireless local area network, characterized in that, Applied to network devices, including: The receiver receives uplink parameter information sent by the terminal; the uplink parameter information is sent based on the resource unit allocation method. Wireless LAN access control based on the aforementioned uplink parameter information; The method further includes: The allocation method of resource units is determined based on the active status of the terminal; Send an uplink parameter request message to the terminal; the uplink parameter request message is used to indicate the allocation method of resource units; Determining the allocation method of resource units based on the active status of the terminal includes: When the terminal is active, the allocation method for the resource unit is determined to be designated allocation; or, When the terminal is in an inactive state, the allocation method of the resource unit is determined to be uplink orthogonal frequency division multiple access random access.

5. The 802.11ax wireless LAN access method according to claim 4, characterized in that, Wireless LAN access control based on the aforementioned uplink parameter information includes: Determine the target parameters based on the aforementioned uplink parameter information; Input the target parameters into the target model to obtain the wireless local area network access strategy output by the target model; Wireless LAN access control is performed based on the aforementioned wireless LAN access strategy. The target model is determined based on the priority empirical replay algorithm with adjusted time difference error loss function and the Hubel loss function.

6. The 802.11ax wireless LAN access method according to claim 5, characterized in that, The method further includes: The target model is obtained by training the initial model using the target parameters as samples and the corresponding wireless LAN access policies as labels.

Images