Channel access method and device

By using a neural network model adapted to a dynamic network environment in Wi-Fi systems to make channel access decisions, communication conflicts and throughput reduction problems when multiple nodes share channels are solved, and more efficient channel utilization and network adaptability are achieved.

CN118945871APending Publication Date: 2024-11-12HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310533970.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-11
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Existing Wi-Fi systems are prone to communication conflicts when multiple nodes share channels, resulting in reduced throughput and increased latency. The random backoff mechanism has problems such as low capacity, large delay, poor fairness and insufficient anti-interference ability.

Method used

Adopt neural network models that are adapted to the dynamic network environment to predict or decide channel access, and optimize channel access decisions through state information sharing between devices and model parameter updates to reduce network overhead.

Benefits of technology

It effectively improves the decision-making accuracy of channel access and the adaptability of network environment, reduces network overhead and delay, and improves channel utilization efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945871A_ABST
    Figure CN118945871A_ABST
Patent Text Reader

Abstract

The invention provides a channel access method and device. The method comprises the steps that first equipment determines first state information; the first state information is input information of a first model, the first model is used for predicting decision information of a first device accessing a channel, and the first state information comprises occupation information of the channel and node information of a node occupying resources of the channel and exceeding a preset resource threshold value; the first device sends the first state information to a second device; receiving model parameters of the first model from the second device; the model parameters comprise offsets and / or weights corresponding to different variables in the first model; the first device updates the first model based on the model parameter to obtain an updated first model; and the first equipment inputs the first state information into an updated first model, and outputs decision information of an access channel of the first equipment. According to the method, the decision information of the access channel of the equipment can be obtained, and the updated first model can adapt to the network environment change.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of wireless communications, and in particular to a channel access method and device. Background Art

[0002] In a short-distance transmission network system (such as Wi-Fi), multiple nodes will use the same shared channel for communication. If two or more nodes send messages on the shared channel at the same time, a communication conflict will occur, and the message transmission will fail, resulting in a reduction in the throughput of the shared channel and an increase in the delay of node communication in the network, affecting the user experience. The existing Wi-Fi system uses a carrier sense multiple access with collision avoidance (CSMA / CA) access mechanism to share channels to avoid conflicts. In order to ensure the fairness of multiple nodes competing for channels at the same time, a random backoff mechanism is also introduced. Each node selects a random backoff number according to its corresponding contention window (CW). When the channel is idle in the detection time slot, the corresponding backoff number decreases. Only when the random backoff ends can the channel be accessed. This method of avoiding conflicts through random numbers has the disadvantages of low capacity, large delay, poor fairness, and no anti-interference ability.

[0003] The current technology proposes to use artificial intelligence (AI) to perform the intelligent distributed coordination function (IDCF) access process to complete channel access, and the channel access decision is determined by the neural network (NN). Since the neural network parameters are obtained through training of a large amount of environmental data, however, in a dynamic wireless environment, it is necessary to train the neural network model (NN Model) that adapts to environmental changes in real time, and it is necessary to frequently send the NN Model (or neural network parameters), which results in a large air interface overhead. Summary of the invention

[0004] The present application provides a channel access method, which can use a neural network model that adapts to a dynamic network environment to predict or decide on channel access, thereby reducing network overhead.

[0005] In the first aspect, a channel access method is provided. The method can be executed by a first device, or by a chip / chip system corresponding to the first device, and this is not limited. The method can specifically include: the first device determines first state information; the first state information is input information of a first model, the first model is used to predict the decision information of the first device accessing the channel, and the first state information includes the occupancy information of the channel and the node information of the node occupying the resources of the channel exceeding the preset resource threshold; the first device sends the first state information to the second device; the first device receives the model parameters of the first model from the second device; the model parameters include the bias and / or weight corresponding to different variables in the first model; the bias and / or weight corresponding to different variables are determined by the second device according to the first state information; the first device updates the first model based on the model parameters of the first model to obtain an updated first model; the first device inputs the first state information into the updated first model, and obtains the decision information of the first device accessing the channel based on the output of the updated first model.

[0006] In an embodiment of the present application, the first device may be but not limited to a station (STA), and the second device may be but not limited to an access point (AP. In addition, the first device may also be an access point (AP), and the second device may also be a station (STA). Here, the decision information of the first device accessing the channel may include but is not limited to: whether to access the channel, the probability value of accessing the channel, the contention window duration for accessing the channel, etc.

[0007] Through this method, not only can the decision information of the first device accessing the channel be effectively obtained, but also the first state information used by the second device to determine the model parameters of the first model includes the occupancy information of the channel and the node information occupying the channel resources greater than the preset resource threshold. Therefore, the first device updates the first model based on the model parameters from the second device, so that the updated first model can better adapt to the dynamic network environment, thereby avoiding the need for the second device to determine and send the model parameters of the first model in real time due to changes in the network environment, thereby reducing network overhead.

[0008] In one possible implementation, the occupancy information of the channel includes a first occupancy rate of the first device occupying the channel based on the target access type and a second occupancy rate of other devices occupying the channel based on the target access type, and the other device is at least one device occupying the channel other than the first device.

[0009] In the embodiment of the present application, the target access type may be, but is not limited to: an access type for voice data, an access type for video data, an access type for maximum capability transmission data, and an access type for background data.

[0010] Exemplarily, the first occupancy rate corresponding to the target access type of the first device occupying the channel may be a proportion of the total duration during which the first device occupies the channel for data transmission based on the target access type in a specified measurement duration.

[0011] In one possible implementation, the second occupancy rate can be determined in the following manner: the first device sends the first occupancy rate to the second device; the first device receives first information from the second device; the first information includes a total occupancy rate of the channel based on the target access type, and the total occupancy rate is obtained by the second device based on the first occupancy rate and the occupancy rate of the channel occupied by other devices based on the target access type; the first device subtracts the first occupancy rate of the first device from the total occupancy rate to obtain the second occupancy rate.

[0012] Through this implementation, the first device can effectively and accurately obtain the occupancy rate of the channel occupied by other devices based on the target access type.

[0013] In a possible implementation, before the first device sends the first occupancy to the second device, the method further includes: the first device receives second information from the second device, the second information including a channel occupancy threshold of the target access type; the first device determines that the first occupancy of the first device is greater than the channel occupancy threshold. That is, the first device sends the first occupancy to the second device only when it determines that the first occupancy is greater than the channel occupancy threshold. In this implementation, other devices can report their own occupancy of the target channel based on the target access type to the second device in a manner similar to that of the first device, while devices whose occupancy of the channel for the target access type is not greater than the channel occupancy threshold do not need to report to the second device.

[0014] Through this implementation, the efficiency of the second device in collecting node information statistics can be improved, and network transmission overhead can also be saved.

[0015] In a possible implementation manner, the method further includes: the first device receiving a first request message from the second device, where the first request message is used to request the first device to occupy a first occupancy rate of the channel based on the target access type.

[0016] Through this implementation, the second device can actively request the first device to obtain the occupancy rate of the channel occupied by one or more access types. Then, the first device can send the occupancy rate of the channel occupied by the one or more access types to the second device based on the request message of the first device. There is no need to report the occupancy rate of the channel occupied by all access types, thereby further reducing network transmission overhead.

[0017] In a possible implementation, the node information includes the number of the nodes, and the nodes specifically refer to devices whose resource occupancy rate of the channel based on the target access type is greater than a resource occupancy rate threshold of the channel based on the target access type.

[0018] In one possible implementation, the number of nodes can be obtained in the following manner: the first device receives the number of nodes from the second device, and the number of nodes is obtained by the second device based on the resource occupancy rate of the channel occupied by the first device based on the target access type, the resource occupancy rate of the channel occupied by other devices based on the access type, and the resource occupancy rate threshold of the channel.

[0019] Through this implementation, the quantity information of the devices occupying a large amount of the channel resources can be effectively obtained, so as to facilitate subsequent training to obtain the model parameters of the first model that can adapt to the dynamic network environment.

[0020] In a possible implementation, the first status information also includes one or more of the following: carrier sensing result information of the channel in a preset historical time period, the length of time between the current data transmission time of the first device and the last successful data transmission time of the first device, and the length of time between the current data transmission time of other devices and the last successful data transmission time of the other devices.

[0021] Through this implementation, the first state information can be effectively used to obtain the decision information for the first device to access the channel.

[0022] In a possible implementation, when the decision information for the first device to access the channel is the probability value of the first device successfully accessing the channel, the method further includes: the first device obtains the contention window duration for the first device to access the channel based on the probability value of the channel, and the first device can access the channel within the contention window duration.

[0023] Through this implementation, the duration of the contention window in which the first device occupies the channel based on the target access type can be effectively obtained. Compared with the probability value of the target access type occupying the target channel, the duration of the contention window has better characteristics and compatibility.

[0024] In the second aspect, a channel access method is provided. The method can be executed by a second device, or by a chip / chip system corresponding to the second device, without limitation. The method may specifically include: the second device receives first state information from a first device; the first state information is input information of a first model, the first model is used to predict the decision information of the first device accessing a channel, the first state information includes channel occupancy information and node information occupying the channel resources exceeding a preset resource threshold; the second device determines the model parameters of the first model according to the first state information; the model parameters include biases and / or weights corresponding to the variables in the first model; the second device sends the model parameters of the first model to the first device.

[0025] In the embodiment of the present application, the first device may be but not limited to a station (STA), and the second device may be but not limited to an access point (AP. In addition, the first device may also be an access point (AP), and the second device may also be a station (STA).

[0026] In an embodiment of the present application, the first status information also includes one or more of the following: carrier sensing result information of the channel in a preset historical time period, the length of time between the current data transmission time of the first device and the last successful data transmission time of the first device, and the length of time between the current data transmission time of other devices and the last successful data transmission time of other devices.

[0027] In the method of the present application, the second device receives first status information from the first device; the first status information is input information of the first model, and the first model is used to predict the decision information of the first device to access the channel, and the first status information includes the occupancy information of the channel and the node information of the node occupying the channel resources exceeding the preset resource threshold; then the second device determines the model parameters of the first model according to the first status information; and then sends the model parameters of the first model to the first device. After receiving the model parameters of the first model, the first device can use the model parameters to update the first model, and then can effectively obtain the decision information of the first device to access the channel through the updated first model, and the updated first model can better adapt to the dynamic network environment, thereby avoiding the need for the second device to train the first model in real time and send the model parameters of the first model due to changes in the network environment, thereby reducing network overhead.

[0028] In a possible implementation, the method also includes: the second device receives the occupancy rate of the channel occupied by at least one device based on the target access type, and the at least one device includes the first device; the second device determines the total occupancy rate of the channel occupied by the target access type based on the occupancy rate of the channel occupied by the at least one device based on the target access type; the second device sends first information to the first device, and the first information includes the total occupancy rate of the channel occupied by the target access type.

[0029] In the embodiment of the present application, the target access type may be, but is not limited to: an access type for voice data, an access type for video data, an access type for maximum capability transmission data, and an access type for background data.

[0030] Through the implementation method, the second device counts the total occupancy rate of the channel occupied by the target access type and sends it to the first device, so that the first device can use the total occupancy rate to effectively obtain the occupancy rate of the channel occupied by other devices based on the target access type.

[0031] In a possible implementation, the occupancy information of the channel includes a first occupancy rate of the first device occupying the channel based on the target access type and a second occupancy rate of other devices occupying the channel based on the target access type, where the other devices are at least one device occupying the channel other than the first device; the node information includes the number of nodes, and the node specifically refers to a device whose resource occupancy rate of occupying the channel based on the target access type is greater than a resource occupancy rate threshold of occupying the channel based on the target access type.

[0032] Through this implementation, the occupancy information of the channel includes the occupancy information of the first device occupying the channel and the occupancy information of other devices occupying the channel. Therefore, the second device obtains the model parameters of the first model based on the first status information containing the occupancy information of the channel and can better adapt to changes in the network environment.

[0033] In a possible implementation, the second device determines the model parameters of the first model according to the first state information, including: the second device uses a reinforcement learning method to train the model parameters of the first model based on the first state information and reward function information, and the reward function information is associated with the first occupancy rate of the first device. Through this implementation, the model parameters of the first model that can adapt to a dynamic network environment can be effectively obtained.

[0034] In the third aspect, an embodiment of the present application also provides a communication device, which can be used to execute the method of the first aspect. The communication device can be a first device (for example, a station STA), or can be a component of the first device (for example, a chip, or a chip system, or a circuit), or can be a device that can be used in combination with the first device.

[0035] In a possible implementation, the communication device may include a module or unit corresponding to the method / operation / step / action described in the first aspect, and the module or unit may be a hardware circuit, or software, or a combination of a hardware circuit and software. In a possible implementation, the communication device may include a processing module and a communication module. The processing module is used to call the communication module to perform the functions of receiving and / or sending.

[0036] In one possible implementation, the communication device may include a processing unit and a communication unit, which can perform the corresponding functions in the above method example. For details, please refer to the description of the method provided in the above first aspect or any possible implementation method, which will not be repeated here.

[0037] In a fourth aspect, an embodiment of the present application also provides a communication device, which can be used to execute the method of the second aspect. The communication device can be a second device (for example, an access point AP), or can be a component of the second device (for example, a chip, or a chip system, or a circuit), or can be a device that can be used in conjunction with the second device.

[0038] In a possible implementation, the communication device may include a module or unit corresponding to the method / operation / step / action described in the second aspect, and the module or unit may be a hardware circuit, or software, or a combination of a hardware circuit and software. In a possible implementation, the communication device may include a processing module and a communication module. The processing module is used to call the communication module to perform the functions of receiving and / or sending.

[0039] In one possible implementation, the communication device may include a processing unit and a communication unit, which can perform the corresponding functions in the above method example. For details, please refer to the description of the method provided in the above second aspect or any possible implementation method thereof, which will not be repeated here.

[0040] In a fifth aspect, the present application also provides a communication system, which includes a first device for executing the method provided in the first aspect and a second device for executing the method provided in the second aspect.

[0041] In a sixth aspect, an embodiment of the present application further provides a computer storage medium, which stores a software program. When the software program is read and executed by one or more processors, it can implement the method provided by the above-mentioned first aspect or any possible implementation method thereof, or implement the method provided by the above-mentioned second aspect or any possible implementation method thereof.

[0042] In the seventh aspect, an embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the method provided by the above-mentioned first aspect or any possible implementation method thereof to be executed, or enables the method provided by the above-mentioned second aspect or any possible implementation method thereof to be executed.

[0043] In an eighth aspect, an embodiment of the present application further provides a chip system, which includes a processor for supporting a first device to implement the functions involved in the above-mentioned first aspect; or for supporting a second device to implement the functions involved in the above-mentioned second aspect.

[0044] In a possible design, the chip system further includes a memory, and the memory is used to store necessary program instructions and data executed by the loading device. The chip system can be composed of a chip, or can include a chip and other discrete devices.

[0045] It should be noted that the technical effects that can be achieved by any possible implementation method in the third to eighth aspects mentioned above can correspond to the description of the technical effects that can be achieved by any possible implementation method in the first to second aspects or the first to second aspects mentioned above; they will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 is a schematic diagram of a Wi-Fi network architecture;

[0047] Figure 2 A schematic diagram of a communication system architecture to which the method of the embodiment of the present application is applicable;

[0048] Figure 3A A schematic diagram of a neural network structure;

[0049] Figure 3B A diagram of a neuron calculating output based on input;

[0050] Figure 4 A schematic diagram of a flow chart of a channel access method provided in an embodiment of the present application;

[0051] Figure 5 A specific flow chart of the first embodiment provided in the embodiments of the present application;

[0052] Figure 6A specific flow chart of the second embodiment provided in the embodiments of the present application;

[0053] Figure 7 A specific flow chart of the third embodiment provided in the embodiments of the present application;

[0054] Fig. 8A A schematic diagram of a CW conversion structure provided in an embodiment of the present application;

[0055] Figure 8B A schematic diagram of another CW conversion structure provided in an embodiment of the present application;

[0056] Fig. 9 A schematic diagram of the structure of a communication device provided in an embodiment of the present application;

[0057] Fig.10 A schematic diagram of the structure of another communication device provided in an embodiment of the present application;

[0058] Fig.11 A schematic diagram of the structure of a chip provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] In a short-distance transmission network system (for example, Wi-Fi), channels are shared, that is, multiple nodes in the wireless network will use the same shared channel to communicate. In this network, if two or more nodes send messages at the same time, a communication conflict will occur, and the node's message transmission will fail, resulting in a decrease in the channel's throughput and an increase in the latency of node communication in the network, greatly affecting the user experience. It can be seen that the node channel access decision has an important impact on communication and plays a decisive role in the user experience. In a distributed scenario, there is no central node to perform unified scheduling and coordination of all nodes in the network, and the nodes directly decide whether to access the shared channel.

[0060] New wireless technologies, new terminals, and new applications will make wireless networks more and more complex. In order to combat the high complexity trend of wireless networks, artificial intelligence (AI) has become a consensus in the industry as an effective tool for wireless network design and management.

[0061] In wireless networks, AI's advantages are reflected in four aspects: 1. Solving complex network problems without mathematical models; 2. Solving wireless network management problems with large search spaces; 3. Global optimization at the cross-layer and cross-node network level; 4. Actively optimizing wireless network parameters through AI's predictive capabilities. Wireless resource allocation is crucial to the performance of wireless networks, and includes channel access, channel allocation, rate configuration, and power configuration.

[0062] Traditional wireless network design and management are based on certain rules. Designers achieve certain design goals by designing algorithms or functions, expressed as f(·). Designers need to clearly give the operation rules of each step of f(·). For example, if y=f(x), designers need to give how each step is calculated from input x to output y. After the introduction of AI, f(·) is no longer based on rules, but is described by neural network structure and neural network parameters, expressed as f(θ,·), where θ represents neural network parameters. Designers no longer need to design algorithms or functions for each step, but can achieve certain design goals by designing neural network structures and training neural network parameters. Therefore, AI is increasingly used in wireless networks.

[0063] In view of the above, the prior art proposes an AI-based channel access method, see Figure 1 As shown, taking a Wi-Fi network as an example, there is at least one station STA in the network, and each station STA sends its status information s i Send to the central node ( Figure 2 The access point AP is used as an example. The AP trains the neural network and sends the trained neural network parameters (such as Figure 1 The NN shown in i ) is sent to the STA, and then the STA sends its status information s i Input the neural network and you can infer the decision result. Where i=1,2,3… STA status information may include: the carrier sensing result information of the channel in a preset historical time period, the time between the current data transmission time and the last successful data transmission time, and the time between the current data transmission time of other nodes and the last successful data transmission time, etc. The decision result may include whether to access the channel, the probability value of accessing the channel, the contention window length of the access channel, etc. According to the above, the neural network parameters are obtained through training of network environment data, and in a dynamic network environment, the AP needs to train the NN Model in real time to obtain the neural network parameters, and needs to send down the neural network parameters frequently, which will generate a large network overhead.

[0064] In response to the above-mentioned problems, the present application proposes a channel access method to obtain the policy information for the first device to access the channel on the basis of reducing network overhead, and the updated first model can adapt to changes in the network environment.

[0065] The technical solution provided in the embodiment of the present application can be applied to wireless local area network (WLAN) systems, such as Wi-Fi, etc. For example, the embodiment of the present application can also be applied to the Institute of Electrical and Electronics Engineers (IEEE) 802.11 system standards, such as 802.11a / b / g protocols, 802.11n protocols, 802.11ac protocols, 802.11ax protocols, 802.11be protocols or next-generation protocols, etc., which are not listed here one by one. Of course, the embodiment of the present application can also be applied to other types of communication systems, such as cellular systems (including but not limited to: long-term evolution (LTE) systems, fifth-generation (5G) communication systems, and new communication systems (such as 6G) emerging in future communication development, etc.), Internet of Things (IoT) systems, narrowband Internet of Things (NB-IoT) systems, other short-range communication systems (including but not limited to: Bluetooth, ultra-wideband (UWB)), etc.

[0066] In addition, the embodiments of the present application can be applied to scenarios in which a node transmits data to one or more nodes. For example, uplink / downlink transmission of a single user, uplink / downlink transmission of multiple users, and device-to-device (D2D) transmission. Among them, any of the above nodes can be a communication device in a wireless communication system, that is, the method provided in the embodiments of the present application can be implemented by a communication device in a wireless communication system. For example, the communication device can be at least one of an access point (AP) or a station (STA). The communication devices (such as AP and STA) in the embodiments of the present application have certain AI capabilities. For example, AP can train neural networks, and STA can use neural networks for reasoning and decision-making.

[0067] In the embodiment of the present application, the WLAN system can provide high-speed and low-latency transmission. With the continuous evolution of WLAN application scenarios, the WLAN system will be applied to more scenarios or industries, such as the Internet of Things industry, the Internet of Vehicles industry or the banking industry, corporate offices, stadiums and exhibition halls, concert halls, hotel rooms, dormitories, wards, classrooms, supermarkets, squares, streets, production workshops and warehouses, etc. Of course, the devices (such as access points or sites) supporting WLAN communication or perception can be sensor nodes in smart cities (such as smart water meters, smart electric meters, smart air detection nodes), smart devices in smart homes (such as smart cameras, projectors, display screens, televisions, speakers, refrigerators, washing machines, etc.), nodes in the Internet of Things, entertainment terminals (such as wearable devices such as AR and VR), smart devices in smart offices (such as printers, projectors, loudspeakers, speakers, etc.), Internet of Vehicles devices in the Internet of Vehicles, infrastructure in daily life scenarios (such as vending machines, self-service navigation desks in supermarkets, self-service cashier devices, self-service ordering machines, etc.), and equipment in large sports and music venues, etc. For example, the access point and the station can be devices used in the Internet of Vehicles, IoT nodes and sensors in the Internet of Things (IoT), smart cameras in smart homes, smart remote controls, smart water meters and electricity meters, and sensors in smart cities. The specific forms of STA and AP are not limited in the embodiments of the present application, and are only exemplary.

[0068] While the embodiments of the present application are described using a network deployed on IEEE 802.11 as an example, various aspects of the present application may also be extended to other networks that adopt various standards or protocols, such as high-performance wireless LAN (HIPERLAN) (a wireless standard similar to the IEEE 802.11 standard, mainly used in Europe) and wide area network (WAN), wireless local area network (WLAN), personal area network (PAN) or other networks currently known or developed later.

[0069] See also Figure 2 A wireless network architecture and device diagram applicable to the embodiments of the present application are shown. Figure 2As shown, in this network architecture, the equipment includes one wireless access point (AP) and three associated stations (STA), and each STA can communicate with the AP. The internal functional modules of AP and STA may include a central processing unit, a media access control (MAC), a transceiver, an antenna, and a neural network processing unit (NPU). The NPU includes a training module and an inference module. The trained neural network parameters will be fed back to the inference module. The NPU can act on various other modules of the network node, including the central processing unit, MAC, transceiver, and antenna. The NPU can act on the decision-making tasks of each module, such as interacting with the transceiver, deciding the switch of the transceiver for energy saving, such as interacting with the antenna, controlling the direction of the antenna, such as interacting with the MAC, controlling channel access, channel selection, and spatial multiplexing decisions, etc.

[0070] Above Figure 2 As an example only, compared to Figure 2 The devices and the number of devices in the embodiment of the present application may include more or less. In addition, the embodiment of the present application can also be applied to communication between APs, for example, each AP can communicate with each other through a distributed system (DS), and the embodiment of the present application can also be applied to communication between STAs.

[0071] In an embodiment of the present application, an access point may be an access point for a terminal device (such as a mobile phone) to enter a wired (or wireless) network, which is mainly deployed in homes, buildings, and parks, with a typical coverage radius of tens of meters to hundreds of meters. Of course, it can also be deployed outdoors. An access point is equivalent to a bridge connecting a wired network and a wireless network. Its main function is to connect various wireless network clients together and then connect the wireless network to the Ethernet. Specifically, an access point may be a terminal device (such as a mobile phone) or a network device (such as a router) with a Wi-Fi chip. An access point may be a device that supports the 802.11be standard. An access point may also be a device that supports a variety of wireless local area networks (WLAN) standards of the 802.11 family, such as 802.11ax, 802.11ac, 802.11ad, 802.11ay, 802.11n, 802.11g, 802.11b, 802.11a, and 802.11be next generation. The access point in this application may be a HE AP or an extremely high throughput (EHT) AP, or may be an access point applicable to a future generation of Wi-Fi standards.

[0072] The site can be a wireless communication chip, a wireless sensor or a wireless communication terminal, etc., and can also be called a user. For example, the site can be a mobile phone that supports Wi-Fi communication function, a tablet computer that supports Wi-Fi communication function, a set-top box that supports Wi-Fi communication function, a smart TV that supports Wi-Fi communication function, a smart wearable device that supports Wi-Fi communication function, a vehicle-mounted communication device that supports Wi-Fi communication function, and a computer that supports Wi-Fi communication function, etc. Optionally, the site can support the 802.11be standard. The site can also support multiple wireless local area networks (WLAN) standards of the 802.11 family, such as 802.11ax, 802.11ac, 802.11n, 802.11g, 802.11b, 802.11a, and 802.11be next generation.

[0073] The station in this application may be a HE STA or an extremely high throughput (EHT) STA, or may be a STA applicable to a future generation of Wi-Fi standards.

[0074] For example, access points and sites can be devices used in the Internet of Vehicles, IoT nodes and sensors in the Internet of Things (IoT), smart cameras and smart remote controls in smart homes, smart water and electricity meters, and sensors in smart cities.

[0075] The AP and STA involved in the embodiments of the present application may be AP and STA applicable to the IEEE 802.11 system standard. AP is a device deployed in a wireless communication network to provide wireless communication functions for its associated STA. The AP can be used as the hub of the communication system, and is usually a network-side product that supports the MAC and PHY of the 802.11 system standard. For example, it may be a base station, a router, a gateway, a repeater, a communication server, a switch or a bridge and other communication equipment, wherein the base station may include various forms of macro base stations, micro base stations, relay stations, etc. Here, for the convenience of description, the above-mentioned devices are collectively referred to as AP. STA is usually a terminal product that supports the media access control (MAC) and physical layer (PHY) of the 802.11 system standard, such as a mobile phone, a laptop computer, etc.

[0076] In order to better understand the embodiments of the present application, the names and technical features involved in the embodiments of the present application are explained below. It should be noted that these explanations are intended to make the embodiments of the present application easier to understand and should not be regarded as limiting the scope of protection claimed by the present application.

[0077] 1) Model, which refers to an AI model, also known as a neural network, is related to the task performed by the device. For example, the device can perform a channel access task, then the input information of the model can include carrier sensing results, channel access behavior and data packet transmission results, and the output information can include the expected reward for accessing or not accessing the channel. For another example, the device can perform a rate adaptation task, then the input information of the model can include received power, carrier sensing results, coding and modulation scheme (MCS) and data packet transmission results, and the output information can include the probability of using each MCS. For another example, the device can perform a channel aggregation task, then the input information of the model can include the carrier sensing results of each channel and the load of each channel, and the output information can include the expected reward for using different channel aggregation methods. For another example, the device can perform a channel state information (CSI) feedback task, then the input information of the model can include the channel matrix and the beamforming matrix, and the output information can include compressed channel information. For another example, the device can perform a traffic prediction task, then the input of the model can include historical traffic information, and the output information can include predicted traffic. The model can implement task-related functions, and the model can assist the device in making predictions or decisions.

[0078] Neural network (NN) is a machine learning technology that simulates the human brain neural network in order to achieve artificial intelligence-like. Neural network can include input layer, middle layer (also called hidden layer) and output layer. Taking the simplest neural network as an example, its internal structure and implementation are explained. Figure 3A , Figure 3A It is a schematic diagram of a fully connected neural network with 3 layers. Figure 3A As shown, the neural network includes three layers, namely the input layer, the hidden layer and the output layer, wherein the input layer has three neurons, the hidden layer has four neurons, the output layer has two neurons, and each layer of neurons is fully connected to the neurons in the next layer. Each connection between neurons corresponds to a weight, which can be updated through training. Each neuron in the hidden layer and the output layer can also correspond to a bias, which can be updated through training. Updating the neural network means updating these weights and biases. After determining the structure of the neural network, i.e., the number of neurons contained in each layer and how the output of the previous neuron is input to the subsequent neuron (i.e., the connection relationship between neurons), and adding the parameters of the neural network, i.e., weights and biases, all the information of the neural network can be determined.

[0079] Depend on Figure 3AIt can be seen that each neuron may have multiple input connections, and each neuron can calculate the output based on the input. Figure 3B A neuron calculates output based on input, such as Figure 3B As shown, a neuron contains 3 inputs, 1 output, and 2 calculation functions. The calculation formula of the output can be expressed as:

[0080] Output = activation function (input 1 * weight 1 + input 2 * weight 2 + input 3 * weight 3 + bias) Formula 1

[0081] The symbol “*” represents the mathematical operation “multiplication” or “times”, and the same applies to the symbols shown below.

[0082] In addition, each neuron may also have multiple output connections, and the output of one neuron can be used as the input of the next neuron. It should be understood that the input layer only has output connections, and each neuron in the input layer is the value of the input neural network, and the output value of each neuron is directly used as the input of all output connections. The output layer only has input connections, and the output is calculated using the calculation method of formula 1 above. Optionally, the output layer can have no activation function calculation, then the above formula 1 can be transformed into: Output = Input 1 * Weight 1 + Input 2 * Weight 2 + Input 3 * Weight 3 + Bias.

[0083] For example, a k-layer neural network can be expressed as:

[0084] y=f k (f k-1 (…(f1(w1*x+b1))) Formula 2

[0085] Among them, x represents the input of the neural network, y represents the output of the neural network, and w i represents the weight of the i-th layer of the neural network, b i represents the bias of the i-th layer of the neural network, f i Represents the activation function of the i-th layer of the neural network. i=1,2,…,k.

[0086] 2) State information, which may be input information of the model, such as the aforementioned carrier sensing results, channel access behavior, and data packet transmission results, etc. It is understandable that the state information may be preset or predefined by the protocol.

[0087] 3) In the embodiments of the present application, at least one can also be described as one or more, and multiple can be two, three, four or more, which is not limited in the present application. In the embodiments of the present application, " / " can indicate that the objects associated before and after are in an "or" relationship, for example, A / B can indicate A or B; "and / or" can be used to describe that there are three relationships between the associated objects, for example, A and / or B can indicate: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In order to facilitate the description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like can be used to distinguish between technical features with the same or similar functions. The words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not limit them to be necessarily different. In the embodiments of the present application, the words "exemplary" or "for example" are used to indicate examples, illustrations or descriptions, and any embodiment or design described as "exemplary" or "for example" should not be interpreted as being more preferred or more advantageous than other embodiments or design. The use of words such as “exemplary” or “for example” is intended to present the relevant concepts in a specific manner to facilitate understanding.

[0088] It should be noted that in this application, "indication" may include direct indication, indirect indication, explicit indication, and implicit indication. When describing that a certain indication information is used to indicate A, it can be understood that the indication information carries A, directly indicates A, or indirectly indicates A.

[0089] In this application, the information indicated by the indication information is referred to as the information to be indicated. In the specific implementation process, there are many ways to indicate the information to be indicated, such as but not limited to, the information to be indicated can be directly indicated, such as the information to be indicated itself or the index of the information to be indicated. The information to be indicated can also be indirectly indicated by indicating other information, wherein there is an association relationship between the other information and the information to be indicated. It is also possible to indicate only a part of the information to be indicated, while the other parts of the information to be indicated are known or agreed in advance. For example, the indication of specific information can also be achieved with the help of the arrangement order of each information agreed in advance (such as specified by the protocol), thereby reducing the indication overhead to a certain extent.

[0090] The information to be indicated can be sent as a whole, or divided into multiple sub-information and sent separately, and the sending period and / or sending time of these sub-information can be the same or different. The specific sending method is not limited in this application. Among them, the sending period and / or sending time of these sub-information can be pre-defined, for example, pre-defined according to the protocol, or configured by the transmitting device by sending configuration information to the receiving device. Among them, the configuration information can include, for example but not limited to, one or a combination of at least two of radio resource control signaling, media access control (MAC) layer signaling and physical layer signaling. Among them, radio resource control signaling, for example, radio resource control (RRC) signaling; MAC layer signaling, for example, includes MAC control element (CE); physical layer signaling, for example, includes downlink control information (DCI).

[0091] The technical solution of the present application is introduced below in conjunction with specific embodiments.

[0092] The present invention provides a channel access method which is applicable to but not limited to Figure 1 The system architecture shown in the figure is shown in the figure, and the method can be executed by the first device (or the second device) involved in the present application, or by the chip corresponding to the first device (or the second device) involved in the present application. The present application does not specifically limit the form of the first device (or the second device) involved. In addition, the first device in the embodiment of the present application can be but not limited to a station (STA), and the second device can be but not limited to an access point (AP). Reference Figure 4 As shown, the method may specifically include the following steps:

[0093] S401: The first device determines first state information; the first state information is input information of the first model, and the first state information includes occupancy information of the channel and node information of nodes that occupy resources of the channel exceeding a preset resource threshold.

[0094] The first model is used to predict the decision information of the first device accessing the channel. Exemplarily, the first model may be a neural network used by the first device to make a channel access decision.

[0095] In a possible implementation, the occupancy information of the channel may include a first occupancy rate of the first device occupying the channel based on the target access type and a second occupancy rate of other devices occupying the channel based on the target access type, and the other device is at least one device occupying the channel other than the first device.

[0096] In the above, the target access type may refer to the data service type that occupies the channel for transmission. Exemplarily, when a STA in an IEEE 802.11 network accesses an AP for transmission, in order to distinguish the priority of the service, four access types (AC) are defined, namely, the access type for voice, the access type for video, the access type for maximum capability, and the access type for background. Therefore, in an embodiment of the present application, the target access type may be, but is not limited to, one or more of the access type for voice data, the access type for video data, the access type for maximum capability transmission data (such as web browsing data), and the access type for background data (such as file type data).

[0097] In a possible implementation manner, the first device may calculate a first occupancy rate of the channel occupied by itself based on the target access type.

[0098] Exemplarily, the first occupancy rate of the channel occupied by the first device based on the target access type may refer to the proportion of the total duration during which the first device occupies the channel to transmit data using the target access type in a certain measurement duration.

[0099] In a possible implementation manner, the second occupancy rate may be determined by, but not limited to, the following method:

[0100] Step 1: The first device sends a first occupancy rate of the channel occupied by the first device based on the target access type to the second device. Correspondingly, the second device receives the first occupancy rate.

[0101] In this embodiment, in addition to receiving the first occupancy rate of the first device, the second device also receives the occupancy rate of the target access type of other devices connected to the second device, so that the second device can subsequently use the occupancy rates corresponding to these devices to calculate the total occupancy rate of the target access type occupying the channel and determine the node information.

[0102] That is, the second device receives an occupancy rate of the channel occupied by at least one device based on the target access type, and the at least one device includes the first device;

[0103] Step 2: The second device determines a total occupancy rate of the channel based on the target access type according to the occupancy rate of the channel occupied by the at least one device based on the target access type;

[0104] In the above, the total occupancy rate of the target access type in the channel may refer to the sum of the occupancy rate of the target access type of the second device in the channel and the occupancy rate of the target access type of all devices (i.e., all devices occupying the channel, including the first device) in the channel.

[0105] Exemplarily, the total occupancy rate of the channel occupied by the target access type may satisfy the following formula:

[0106] Load tol =channelload+load0;

[0107] Among them, Load tol It indicates the total occupancy rate of the channel occupied by the target access type. Channel load indicates the sum of the occupancy rates of the channel occupied by all devices (i.e., all devices occupying the channel, including the first device but excluding the second device) based on the target access type. Load0 indicates the occupancy rate of the channel occupied by the second device based on the target access type.

[0108] Step 3: The second device sends first information to the first device, wherein the first information includes a total occupancy rate of the channel based on the target access type. Correspondingly, the first device receives the first information.

[0109] Step 4: The first device subtracts the first occupancy rate of the first device from the total occupancy rate of the target access type on the channel to obtain the second occupancy rate (ie, the occupancy rate of the channel occupied by other devices based on the target access type).

[0110] In a possible implementation, before the first device sends the first occupancy rate to the second device, the method may also include: the first device receives second information from the second device, the second information including a channel occupancy rate threshold of the target access type; and the first device determines that the first occupancy rate of the first device is greater than the channel occupancy rate threshold.

[0111] In this embodiment, the first device can report its first occupancy rate of the target channel based on the target access type to the second device only when it determines that its first occupancy rate of the target channel based on the target access type is greater than the channel occupancy rate threshold; other devices can refer to the reporting method of the first device to report their own occupancy rate of the target channel based on the target access type to the second device, thereby not only facilitating the second device to count the number of devices greater than the channel occupancy rate threshold, but also reducing the network transmission overhead.

[0112] In a possible implementation, before the first device sends the first occupancy rate to the second device, the method further includes: the first device receives a first request message from the second device, the first request message being used to request the first device to occupy a first occupancy rate of the channel based on a target access type.

[0113] Through this implementation, the second device can actively request the first device to obtain the occupancy rate of one or more access types occupying the target channel. Then, the first device can send the occupancy rate of the one or more access types corresponding to itself to the second device based on the request message of the first device, without reporting the occupancy rate of all access types occupying the target channel.

[0114] In an embodiment of the present application, the node information in the first state information may include the number of nodes, and the node specifically refers to a device whose resource occupancy rate of the channel based on the target access type is greater than a resource occupancy rate threshold of the channel based on the target access type.

[0115] In a possible implementation, the number of nodes may be obtained by, but not limited to, the following method:

[0116] The first device receives the number of nodes from the second device, and the number of nodes can be obtained by the second device based on the resource occupancy rate of the channel occupied by the first device based on the target access type, the resource occupancy rate of the channel occupied by other devices based on the access type, and the resource occupancy rate threshold of the channel.

[0117] In an embodiment of the present application, the first status information of the first device may also include but is not limited to: carrier sensing result information of the channel in a preset historical time period, the length of time between the current data transmission time of the first device and the last successful data transmission time of the first device, and the length of time between the current data transmission time of other devices and the last successful data transmission time of the other devices.

[0118] S402: The first device sends the first status information to the second device. Correspondingly, the second device receives the first status information.

[0119] S403: The second device determines model parameters of the first model according to the first state information, where the model parameters include biases and / or weights corresponding to different variables in the first model.

[0120] Exemplarily, the biases and / or weights corresponding to different variables in the first model may refer to the biases and / or weights corresponding to different neurons in the neural network.

[0121] In a possible implementation, the second device determines the model parameters of the first model based on the first state information, which may include: the second device uses a reinforcement learning method to train the model parameters of the first model based on the first state information and reward function information, and the reward function information is associated with the first occupancy rate of the first device.

[0122] In the embodiment of the present application, the reward function information may be equivalent to the reward function used in the prior art for training a neural network. However, unlike the prior art, in the embodiment of the present application, the reward value used by the AP (i.e., the second device) when training the neural network model of the STA (i.e., the first device) is associated with the channel occupancy rate of the STA, so that the neural network model finally trained can better adapt to the dynamic business environment.

[0123] S404: The second device sends the model parameters of the first model to the first device.

[0124] Correspondingly, the first device receives the model parameters of the first model.

[0125] S405: The first device updates the first model based on the model parameters of the first model to obtain an updated first model.

[0126] Exemplarily, the first device may update previous model parameters of the first model based on the model parameters of the first model, thereby obtaining the updated first model.

[0127] S406: The first device inputs the first state information into the updated first model, and obtains decision information of the first device accessing the channel based on an output of the updated first model.

[0128] In an embodiment of the present application, the first device inputs the first state information into the updated first model, and outputs the decision information of the first device accessing the channel based on the updated first model. The decision information of the first device accessing the channel may include but is not limited to: whether to access the channel in the current time slot, the probability value of accessing the channel, the contention window duration of accessing the channel, and the backoff window size.

[0129] In a possible implementation, when the decision information for the first device to access the channel is the probability value of the first device successfully accessing the channel, the method may further include: the first device obtains the contention window duration for the first device to access the channel based on the probability value of the channel; and the first device accesses the channel within the contention window duration.

[0130] In summary, the present application proposes a channel access method, which includes: a first device determines first state information; the first state information is input information of a first model, the first model is used to predict decision information of the first device accessing a channel, and the first state information includes occupancy information of the channel and node information of nodes occupying resources of the channel exceeding a preset resource threshold; the first device sends the first state information to a second device; the first device receives model parameters of the first model from the second device; the model parameters include biases and / or weights corresponding to different variables in the first model; the biases and / or weights corresponding to different variables are determined by the second device according to the first state information; the first device updates the first model based on the model parameters of the first model to obtain an updated first model; the first device inputs the first state information into the updated first model, and obtains decision information of the first device accessing the channel based on the output of the updated first model. According to the foregoing, this method can effectively obtain the strategy information for the first device to access the channel, and the first state information used to determine the biases and / or weights corresponding to different variables in the first model includes the channel occupancy information and the node information occupying the channel resources greater than the preset resource threshold. Therefore, updating the first model based on the model parameters including the biases and / or weights corresponding to these different variables can enable the first model to better adapt to the dynamic network environment, thereby avoiding real-time updating of the first model due to changes in the network environment and reducing network overhead.

[0131] The channel access method proposed in the present application is further described in detail below through several specific embodiments.

[0132] Embodiment 1:

[0133] In this embodiment 1, the above Figure 4 How the first device in step S401 of the scheme determines the occupancy information of the channel in the first state information (i.e., the first occupancy rate of the first device occupying the channel based on the target access type and the second occupancy rate of other devices occupying the channel based on the target access type) and the node information (i.e., the number of nodes) of the nodes occupying the resources of the channel exceeding the preset resource threshold is described in detail. In this embodiment 1, the first device takes a station (STA) as an example, and the second device takes an AP as an example. One or more STAs can access the same AP, so the AP can be regarded as a central node, and a STA can be regarded as a node. Reference Figure 5 As shown, the method flow of this embodiment 1 is specifically as follows:

[0134] S501a: STA1 sends the channel occupancy rate of STA1 to the AP.

[0135] That is, STA1 sends the occupancy rate of the channel occupied by STA1 based on the target access type to the AP.

[0136] Exemplarily, the occupancy rate of the channel occupied by STA1 based on the target access type (the occupancy rate of the channel may be referred to as channel occupancy rate or channel load) may be the ratio of the duration for which STA1 transmits using the target access type to the total statistical duration.

[0137] S501b: STA2 sends the channel occupancy rate of STA2 to the AP.

[0138] Exemplarily, the channel occupancy rate of STA2 is the ratio of the transmission duration of STA2 to the total statistical duration.

[0139] In a specific implementation manner, when a STA in an IEEE 802.11 network accesses an AP for transmission, there may be several access categories (ACs), namely: Voice (equivalent to the above Figure 4 The access type of voice data in the scheme), video (Video) (which is equivalent to the above Figure 4 The access type of the video data in the scheme), the best effort (i.e., equivalent to the above Figure 4 The access type with the maximum capacity to transmit data in the scheme), background (Background) (which is equivalent to the above Figure 4 The access type of background data in the scheme can be simply expressed as: AC_VO, AC_VI, AC_BE, AC_BK. Therefore, when the STA can report its own channel occupancy (load) to the AP, it can send the channel occupancy corresponding to one or more access types (AC) of SAT to the AP (equivalent to the above Figure 4 In the scheme, the first device occupies the channel based on the target access type).

[0140] In the above, the STA1 (or STA2) sends its own channel load corresponding to AC_VO, channel load corresponding to AC_VI, channel load corresponding to AC_BE, and channel load corresponding to AC_BK to the AP respectively.

[0141] In another specific implementation manner, the AP may send a request message of a target access type (AC) to the accessed STA (i.e., equivalent to the above Figure 4In the scheme, the second device sends a first request message to the first device, and the request message is used to request the channel occupancy rate corresponding to the target access type (AC). Then, after receiving the request message of the target access type (AC), the STA reports the channel occupancy rate corresponding to the target access type to the AP.

[0142] Exemplarily, the AP sends a request message for the channel load of AC_VO to STA1 (or STA2), where the request message is used to request the channel load of AC_VO of STA1 (or STA2); then, based on the request message, STA1 (or STA2) sends the channel load corresponding to its own AC_VO to the AP.

[0143] In the first embodiment, the above-mentioned STA1 and STA2 are only used as examples of STAs connected to the AP. In practice, the STAs connected to the AP are not limited to the above-mentioned STA1 and STA2. And each STA connected to the AP can refer to the above-mentioned STA1 or STA2 to determine its own channel occupancy (i.e., the occupancy rate of the channel occupied by itself based on the target access type), and then report its own channel occupancy (i.e., the occupancy rate of the channel occupied by itself based on the target access type) to the AP respectively. The embodiment of the present application does not specifically limit the order in which each STA reports its own channel occupancy to the AP. That is, the order of executing the above-mentioned S501a and S501b is not limited.

[0144] In a possible implementation, the AP may also observe and count the packets sent by each STA (ie, the data packets or messages sent), and determine the channel occupancy rate corresponding to the STA according to the statistics of the packets sent by each STA.

[0145] Exemplarily, the AP may take the ratio of the statistical packet sending duration of STA1 to the total statistical duration as the channel occupancy rate of STA1.

[0146] Since the AP cannot fully detect the STA's transmission status, that is, the conflicting messages, when performing statistics, it is more accurate for the STA to report its own channel occupancy rate to the AP.

[0147] S502: The AP determines the number of active nodes and the total occupancy of the channel based on the channel occupancy reported by the STA.

[0148] In a specific implementation manner, the active node determined by the AP (equivalent to the above Figure 4The node in the scheme may refer to an STA whose channel occupancy corresponding to the target access type is greater than the preset threshold value of the channel of the target access type (i.e., the channel occupancy threshold TH of the target access type). Therefore, the AP may obtain the number of STAs whose channel occupancy is greater than the preset threshold value (i.e., the channel occupancy threshold TH) based on the channel occupancy corresponding to the target access type reported by all STAs.

[0149] In a specific implementation, the AP may determine the total occupancy of the channel corresponding to the access type (AC) based on the channel occupancy of the access type (AC) reported by the STA (ie, the total occupancy of the channel corresponding to the access type (AC) Figure 4 The scheme is based on the total occupancy rate of the channel occupied by the target access type) and the number of active nodes corresponding to the access type (AC).

[0150] For example, if STA1 and STA2 report (i.e., send) the channel load corresponding to the voice access type to the AP respectively, then the AP determines the number of active nodes corresponding to the voice access type and the total occupancy of the channel corresponding to the voice access type based on the channel load of the voice access type of STA1 and STA2. The specific determination method can be the above-mentioned implementation method, which will not be repeated here.

[0151] Exemplarily, the number of active nodes (ie, STAs) may satisfy the following formula:

[0152]

[0153] Among them, N a represents the number of active nodes, n represents the sequence number of the node, Indicates the total number of nodes, load n is the channel occupancy rate of node n corresponding to the target access type (such as AC_VO), TH is the channel occupancy rate threshold corresponding to the target access type (such as AC_VO), and the typical value of TH is 0.1.

[0154] The total occupancy rate of the target access type (such as AC_VO) occupying the channel can satisfy the following formula:

[0155] load tol =channelload+load0;

[0156] in,

[0157] Load tolIndicates the total occupancy rate of the channel occupied by the target access type (such as AC_VO). Channel load indicates the total occupancy rate of the channel occupied by all SATs (i.e., STA1 and STA2) based on the target access type (such as AC_VO). Load0 indicates the occupancy rate of the channel occupied by the AP itself based on the target access type (such as AC_VO). The symbol Indicates rounding down.

[0158] In the above, the channel occupancy rate of the AP itself based on the target access type (such as AC_VO) can be the ratio between the sum of the time when the AP uses the target access type (such as AC_VO) to send messages and the sum of the statistical time. Among them, the AP uses the target access type (such as AC_VO) to send messages that can include both successfully sent messages and sent erroneous messages.

[0159] In an embodiment of the present application, the total occupancy rate of the channel can be counted by the AP and sent to each STA, which can effectively reduce the power consumption caused by the STA frequently monitoring the carrier. At the same time, it can also avoid inaccurate statistical results caused by STA sleep. Therefore, the total occupancy rate of the channel counted by the AP in the embodiment of the present application is more accurate.

[0160] S503a: The AP sends the number of active nodes and the total occupancy of the channel to STA1.

[0161] S503b: The AP sends the number of active nodes and the total occupancy rate of the channel to STA2.

[0162] In a specific implementation, the AP sends the number of active nodes and the total occupancy rate of the channel occupied by the target access type to STA1 and STA2 by broadcasting. Correspondingly, STA1 and STA2 can receive the number of active nodes and the total occupancy rate of the channel occupied by the target access type.

[0163] S504a: STA1 calculates the channel occupancy of other STAs based on the total channel occupancy from the AP and its own channel occupancy.

[0164] Exemplarily, STA1 can calculate the occupancy rate of the channel occupied by other STAs based on the one or more access types according to the total occupancy rate of the channel occupied by one or more access types from the AP and its own occupancy rate of the channel based on the one or more access types.

[0165] S504b: STA2 calculates the channel occupancy of other STAs based on the total channel occupancy from the AP and its own channel occupancy.

[0166] Exemplarily, STA2 can calculate the occupancy rate of the channel occupied by other STAs based on the one or more access types according to the total occupancy rate of the channel occupied by one or more access types from the AP and its own occupancy rate of the channel based on the one or more access types.

[0167] Exemplarily, the STA with a sequence number of n (which can be expressed as STA_n, n=1, 2...) calculates that the occupancy rate of the channel occupied by other STAs based on the target access type (taking AC_VO as an example) can satisfy the following formula:

[0168] load -n =load tol -load n

[0169] Among them, load -n The occupancy rate of the channel occupied by other STAs based on AC_VO, load n The occupancy rate of the channel occupied by STA_n based on AC_VO.

[0170] For example, the occupancy rate of the channel occupied by AC_VO of STA1 is 30%, and the total occupancy rate of the channel occupied by AC_VO is 90% as calculated by the AP. Then, the occupancy rate of the channel occupied by AC_VO of other STAs is 60%.

[0171] In the above steps, STA1 and STA2 are only used as examples of STAs connected to the AP. In practice, the STAs connected to the AP are not limited to the above STA1 and STA2. Each STA connected to the AP can refer to the above STA1 or STA2 to obtain its own channel occupancy rate (i.e., the occupancy rate of the channel occupied by itself based on the target access type) and the channel occupancy rate of other STAs (i.e., the occupancy rate of the channel occupied by other STAs based on the target access type) and the number of active nodes (i.e., the number of devices occupying channel resources greater than the preset resource threshold), which will not be described in detail here.

[0172] After executing the above steps, the STA can add its own channel occupancy rate and the channel occupancy rate of other STAs and the number of active nodes to its own status information, and send the newly added status information to the AP. The AP trains based on the newly added status information to obtain the model parameters of the corresponding neural network model, and then sends the model parameters to the corresponding STA. The STA can use the model parameters from the AP to update its own neural network model, and thus can use the updated neural network model to infer the decision information of accessing the channel (such as the probability value of accessing the channel).

[0173] In this embodiment 1, each STA accessing the AP reports its own channel occupancy (i.e., the occupancy rate of each STA occupying the channel based on the target access type). The AP can use the channel occupancy rate reported by each STA to effectively obtain the total channel occupancy rate (i.e., the total occupancy rate of the channel occupied based on the target access type) and the number of active nodes, and then distribute the counted total channel occupancy rate (i.e., the occupancy rate of all devices occupying the channel based on the target access type) and the number of active nodes to each STA, so that each STA can obtain the channel occupancy rate of other STAs (i.e., the occupancy rate of other STAs occupying the channel based on the target access type) and the number of active nodes, so that each STA can add its own corresponding channel occupancy rate and the channel occupancy rate and the number of active nodes corresponding to other STAs to its own status information, so as to train the neural network model parameters that adapt to the dynamic network environment.

[0174] Embodiment 2:

[0175] Compared with the above-mentioned embodiment 1, the main difference of the embodiment 2 is that: when the STA determines that its own channel occupancy rate reaches the preset threshold value, it reports its own channel occupancy rate to the AP. Figure 6 As shown, the specific process of the second embodiment is as follows:

[0176] S601: preset threshold value of AP broadcast channel.

[0177] Exemplarily, the AP may carry a preset threshold value of the channel (i.e., the channel occupancy threshold TH corresponding to the target access type) in the broadcast message. For example, channel TH = 0.1. Correspondingly, after STA1 and STA2 accessing the AP receive the broadcast message, they may obtain the preset threshold value of the channel therein.

[0178] In a possible implementation, when a STA in an IEEE 802.11 network accesses an AP for transmission, there may be several access types (AC), namely: voice, video, best effort, and background, which can be simply expressed as: AC_VO, AC_VI, AC_BE, AC_BK. Therefore, the AP may carry preset threshold values ​​(or channel occupancy threshold TH) of channels corresponding to one or more access types (AC) in a broadcast message.

[0179] Exemplarily, the AP carries the load threshold of AC_VO in a broadcast message.

[0180] S602a: STA1 determines that its own channel occupancy is greater than a preset threshold value of the channel, and sends the channel occupancy of STA1 to the AP.

[0181] If STA1 determines that its own channel occupancy is not greater than the preset threshold value (or channel occupancy threshold TH) of the channel, then the channel occupancy of STA1 is not sent to the AP.

[0182] Specifically, STA1 receives the preset threshold value of the channel corresponding to one or more access types in the broadcast message of the AP (that is, equivalent to the above Figure 4 If the channel occupancy threshold corresponding to the target access type in the scheme is determined, STA1 can compare the channel occupancy corresponding to one or more access types of its own with the channel occupancy threshold (or threshold) of the corresponding access type; when STA1 determines that the channel occupancy of its own access type is greater than the channel occupancy threshold (or threshold) of the corresponding access type, it reports (sends) the channel occupancy of its own access type to the AP.

[0183] Exemplarily, the channel load thresholds corresponding to different access types carried in the broadcast message received by STA1 from AP are: threshold 1, threshold 2, threshold 3, and threshold 4; wherein threshold 1 is the channel load threshold corresponding to AC_VO, threshold 2 is the channel load threshold corresponding to AC_VI, threshold 3 is the channel load threshold corresponding to AC_BE, and threshold 4 is the channel load threshold corresponding to AC_BK. Further, if STA1 determines that its own channel load value of AC_VO is greater than threshold 1, and its own channel load value of AC_VI is greater than threshold 2, and the channel loads of other access types are less than the corresponding thresholds, then STA1 only reports its own channel load of AC_VO and channel load of AC_VI to AP.

[0184] S602b: STA2 determines that its own channel occupancy is greater than a preset threshold value of the channel, and sends the channel occupancy of STA2 to the AP.

[0185] If STA2 determines that its own channel occupancy is not greater than the preset threshold value (or channel occupancy threshold TH) of the channel, then the channel occupancy of STA2 is not sent to the AP.

[0186] In one implementation, when STA2 receives a preset threshold value of a channel corresponding to one or more access types in a broadcast message from an AP, it refers to the execution of STA1 in the above step S602a, which is not described in detail here.

[0187] S603: The AP determines the number of active nodes and the total occupancy of the channel based on the channel occupancy reported by the STA.

[0188] The AP may count the number of STAs that have reported the channel occupancy rate, and use the number of STAs after counting as the number of active nodes.

[0189] The AP determines the total occupancy of the channel based on the channel occupancy reported by the STA. The implementation method of the AP determining the total occupancy of the channel in the above step S502 may be referred to, and will not be described in detail here.

[0190] S604a: The AP sends the number of active nodes and the total occupancy rate of the channel to STA1.

[0191] The step S604a can be implemented by referring to the above-mentioned S503a, which will not be described in detail here.

[0192] S604b: The AP sends the number of active nodes and the total occupancy rate of the channel to STA2.

[0193] The step S604b can be implemented with reference to the above-mentioned S503b, and will not be described in detail here.

[0194] S605a: STA1 calculates the channel occupancy of other STAs based on the total channel occupancy from the AP and its own channel occupancy.

[0195] The step S605a can be implemented with reference to the above-mentioned S504a, and will not be described in detail here.

[0196] S605b: STA2 calculates the channel occupancy of other STAs based on the total channel occupancy from the AP and its own channel occupancy.

[0197] The step S605b can be implemented with reference to the above-mentioned S504b, and will not be described in detail here.

[0198] Similar to the above embodiment, STA1 and STA2 in the above steps are only examples of STAs connected to the AP. In practice, the STAs connected to the AP are not limited to the above STA1 and STA2, and each STA connected to the AP can refer to the above STA1 or STA2 to obtain its own channel occupancy and the channel occupancy of other STAs and the number of active nodes, which will not be described in detail here.

[0199] After executing the above steps, the STA can add its own channel occupancy rate (i.e., its own occupancy rate of the channel based on the target access type) and the channel occupancy rate of other STAs (i.e., the occupancy rate of other STAs occupying the access type based on the target access type) and the number of active nodes to its own status information, and send the newly added status information to the AP. The AP performs training based on the newly added status information to obtain the model parameters of the corresponding neural network model, and then sends the model parameters to the corresponding STA. The STA can use the model parameters from the AP to update its own neural network model, so that the updated neural network model can be used to infer the decision information of the access channel (such as the probability value of accessing the channel).

[0200] Compared with the above-mentioned embodiment 1, in the embodiment 2, the STA can report its own channel occupancy rate (i.e., the occupancy rate of the channel based on the target access type) to the AP on demand, i.e., the preset threshold value of the AP broadcast channel (i.e., the channel occupancy threshold corresponding to the target access type). After each STA connected to the AP receives the preset threshold value, it can compare its own channel occupancy rate with the preset threshold value. If it is greater than, it reports its own channel occupancy rate to the AP. If it is not greater than, it does not need to report its own channel occupancy rate to the AP. Therefore, compared with the reporting method of the embodiment 1, the method of the embodiment 2 can effectively save air interface overhead.

[0201] Embodiment three:

[0202] In this embodiment 3, the above Figure 4 The process of determining the model parameters of the first model according to the first state information of the first device in step S403 of the solution is described in detail. In this embodiment 3, the first device is a station (STA) as an example, and the second device is an AP as an example. One or more STAs can access the same AP, so the AP can be regarded as a central node, and a STA can be regarded as a node. Figure 7 As shown, the method flow of the third embodiment is as follows:

[0203] S701a: STA1 sends the training data of STA1 to the AP.

[0204] For example, the training data of STA1 (equivalent to the above Figure 4 The first state information in the scheme includes but is not limited to: the channel occupancy rate of STA1 (which is equivalent to the above Figure 4 The occupancy rate of the channel occupied by the first device in the scheme based on the target access type can be expressed as load1), the channel occupancy rate of other STAs (which is equivalent to the above Figure 4The occupancy rate of the channel occupied by other devices in the scheme based on the target access type can be expressed as load -1 ), the time between the time when STA1 currently sends data and the time when it successfully sent data last time (which can be expressed as d1), the time between the time when other STAs currently send data and the time when they successfully sent data last time (which can be expressed as d -1 ), the number of active nodes (equivalent to the above Figure 4 The number of devices of the target access type occupying channel resources greater than the preset resource threshold can be expressed as N), the carrier sensing results of the channel in a historical time period preset by STA1, the channel access behavior and data packet transmission results of STA1, etc.

[0205] S701b: STA2 sends STA2's training data to the AP.

[0206] For example, the training data of STA2 (equivalent to the above Figure 4 The first state information in the scheme includes but is not limited to: the channel occupancy rate of STA2 (equivalent to the above Figure 4 The occupancy rate of the channel occupied by the first device in the scheme based on the target access type can be expressed as load1), the channel occupancy rate of other STAs (which is equivalent to the above Figure 4 The occupancy rate of the channel occupied by other devices in the scheme based on the target access type can be expressed as load -1 ), the time between the time when STA2 currently sends data and the time when it successfully sent data last time (which can be expressed as d1), the time between the time when other STAs currently send data and the time when they successfully sent data last time (which can be expressed as d -1 ), the number of active nodes (equivalent to the above Figure 4 The number of devices of the target access type occupying channel resources greater than the preset resource threshold can be expressed as N), the carrier sensing results of STA2 in the channel in a preset historical time period, the channel access behavior and data packet transmission results of STA2, etc.

[0207] In the third embodiment, the above STA1 and STA2 are only used as examples of STAs connected to the AP. In practice, the STAs connected to the AP are not limited to the above STA1 and STA2. And each STA connected to the AP can refer to the above STA1 or STA2 to report training data to the AP. The embodiment of the present application does not specifically limit the order in which each STA reports training data to the AP. That is, the order of executing the above S701a and S701b is not limited.

[0208] S702: The AP calculates the reward function corresponding to each STA based on the training data reported by each STA, and uses reinforcement learning for training to obtain the corresponding neural network model parameters.

[0209] The method of AP training neural network parameters is similar to the prior art. Compared with the prior art, the difference in training neural network parameters in the embodiment of the present application lies in the calculation of reward.

[0210] In the embodiment of the present application, the AP may calculate the reward values ​​corresponding to different STAs to satisfy the following formula:

[0211]

[0212] load n Indicates the channel occupancy rate of STA with sequence number n (equivalent to the above Figure 4 The first occupancy rate of the first device in the scheme), d n Indicates the time from when the STA with sequence number n needs to send data to the time when it last successfully sent data. n is a positive integer, the symbol "*" is a multiplication sign, and w is a normalization coefficient, so that load n *d n / w is not greater than 1.

[0213] That is, the AP loads the training data reported by each STA connected to the AP. n and d n , calculate the load corresponding to each STA respectively n *d n Value; for load n *d n The STA with the largest value and which successfully sent data last time determines that its reward value is equal to 1; n *d n The value is not the largest, but the STA that successfully sent data last time determines that its reward value is equal to load n *d n ; For the STA that sends conflicting data, determine its reward value equal to -1.

[0214] Exemplarily, the AP calculates the load1*d1 value based on load1 and d1 in the training data reported by STA1; and calculates the load2*d2 value based on load2 and d2 in the training data reported by STA2. If the load1*d1 value of STA1 is the maximum and STA1 successfully sent data last time, then the AP determines that the reward value corresponding to STA1 is 1; if STA2 successfully sent data last time, then the AP determines that the reward value corresponding to STA2 is load2*d2 / w.

[0215] The above-mentioned STA1 and STA2 are merely examples of STAs connected to the AP. In practice, the STAs connected to the AP are not limited to the above-mentioned STA1 and STA2.

[0216] In the embodiment of the present application, since the channel occupancy (load) information is added to the reward calculation, a STA with a small channel occupancy (load) will not receive a large reward even if it successfully sends data, thereby being able to adapt to dynamic changes in the business.

[0217] S703a: AP sends the neural network model parameters corresponding to STA1 to STA1.

[0218] S703b: AP sends the neural network model parameters corresponding to STA2 to STA2.

[0219] Among them, the neural network model parameters may include the weight and bias of each neuron.

[0220] S704a: STA1 performs reasoning based on the neural network model parameters to obtain a channel access strategy.

[0221] S704b: STA2 performs inference based on the neural network model parameters to obtain a channel access strategy.

[0222] STA1 (or STA2) infers the channel access strategy based on the corresponding neural network model parameters (equivalent to the above Figure 4 The process of obtaining the policy information of the first device based on the first model output in the solution can refer to the prior art and will not be described in detail here.

[0223] The channel access strategy of STA1 (or STA2) may include but is not limited to: whether to access the channel in the current time slot, the probability of accessing the channel, the contention window, and the backoff window size.

[0224] Similar to the above-mentioned embodiments 1 and 2, STA1 and STA2 in the above steps are only examples of STAs connected to the AP. In practice, the STAs connected to the AP are not limited to the above-mentioned STA1 and STA2, and each STA connected to the AP can obtain the channel access strategy by referring to the above-mentioned STA1 or STA2, which will not be described in detail here.

[0225] In this third embodiment, when the AP trains the neural network model of the STA, compared with the prior art, for the calculation of the reward, the reward will be associated with the channel occupancy rate of the STA (i.e., the channel occupancy information of the newly added STA), so that the neural network model finally trained can better adapt to the dynamic changes in the network environment.

[0226] Embodiment 4:

[0227] In the fourth embodiment, the direct decision strategy is one of the commonly used methods in reinforcement learning.

[0228] (Markov decision process, MDP) category, strategy is a distribution function, that is, probability. However, compared with the decision contention window (CW) duration, the characteristics and compatibility of directly using probability decision are poor. Therefore, this embodiment proposes a method for converting the probability output by the neural network into the CW duration. In addition, in order to support CW conversion of different access types (AC), different access types (AC) will adopt different CW conversion methods. Fig. 8A and Figure 8B A schematic diagram of the structures of two CW conversion methods provided in the embodiments of the present application.

[0229] like Fig. 8A As shown, each AC corresponds to a neural network NN, and the input of each NN is the measurement information of the corresponding AC (the measurement information can be equivalent to the above Figure 4 The first state information in the scheme), the output of each NN is the probability of accessing the channel, and the access channel probability output by each NN is converted by a corresponding CW conversion method to obtain the corresponding CW duration. That is, AC_VO corresponds to CW1, AC_VI corresponds to CW2, AC_BE corresponds to CW3, and AC_BK corresponds to CW4.

[0230] In the embodiment of the present application, there will be CWs of these four access types for one STA, and the final output is the CW duration of one of the ACs.

[0231] In a possible implementation, the CW duration of the STA is the longest of the CW durations of the four access types. For example, the CW durations corresponding to the four access types of STA1 (i.e., AC_VO, AC_VI, AC_BE, AC_BK) are respectively expressed as: CW1, CW2, CW3, CW4; among them, the value of CW2 is the largest, so the output decision contention window duration of the STA1 is CW2.

[0232] like Figure 8B As shown, all ACs correspond to the same neural network NN, and the input of the NN is the measurement information of all ACs (the measurement information can be equivalent to the above Figure 4 The state information in the scheme) outputs the probability of access channels corresponding to all ACs, and the probabilities of access channels corresponding to all ACs are converted by the same CW conversion method to obtain CWs corresponding to all ACs.

[0233] In the embodiment of the present application, there will be CWs of these four access types for one STA, and the final output is the CW duration of one of the ACs.

[0234] In a possible implementation, the CW duration of the STA is the longest of the CW durations of the four access types. For example, the CW durations corresponding to the four access types of STA1 (i.e., AC_VO, AC_VI, AC_BE, AC_BK) are respectively expressed as: CW1, CW2, CW3, CW4; among them, the value of CW2 is the largest, so the output decision contention window duration of the STA1 is CW2.

[0235] In the embodiment of the present application, the above conversion method can satisfy the following formula:

[0236]

[0237] Wherein, p represents the probability of channel access output by the neural network (NN). X represents the bias item corresponding to the access type (AC). For example, the bias values ​​corresponding to AC_VO, AC_VI, AC_BE, and AC_BK may be: 2, 1, -10, and -20.

[0238] Through this fourth embodiment, the probability of channel access output by neural network inference can be effectively converted into the contention window (CW) duration of the channel access; compared with the probability of channel access, the characteristics and compatibility of the CW duration will be better.

[0239] In the embodiments provided by the present application, the methods provided by the embodiments of the present application are introduced from the perspective of interaction between various devices. In order to implement the functions in the methods provided by the embodiments of the present application, the first device or the second device may include a hardware structure and / or a software module to implement the functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a function in the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0240] The division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional module in each embodiment of the present application may be integrated into a processor, or may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated modules may be implemented in the form of hardware or in the form of software functional modules.

[0241] Same as above idea, Fig. 9 As shown, the embodiment of the present application also provides a communication device 900 for implementing the functions of the AUSF network element in the above method. For example, the communication device 900 can be a software module or a chip system. In the embodiment of the present application, the chip system can be composed of a chip, or it can include a chip and other discrete devices. The communication device 900 may include: a communication unit 901 and a processing unit 902.

[0242] In the embodiment of the present application, the communication unit 901 may also be referred to as a transceiver unit, and may include a sending unit and / or a receiving unit, which are respectively used to execute the steps of sending and receiving by the first device or the second device in the above method embodiment. The processing unit 902 may be used to read instructions and / or data in the storage module so that the communication device 900 implements the above method embodiment.

[0243] Optionally, the communication device 900 may further include a storage unit 903, which is equivalent to a storage module and can be used to store instructions and / or data.

[0244] The following, combined Figures 9 and 10 The communication device provided in the embodiment of the present application is described in detail. It should be understood that the description of the device embodiment corresponds to the description of the method embodiment, so the contents not described in detail can be referred to the method embodiment above, and will not be repeated here for the sake of brevity.

[0245] The communication unit 901 may also be referred to as a transceiver, a transceiver, a transceiver device, etc. The processing unit may also be referred to as a processor, a processing board, a processing module, a processing device, etc. Optionally, the device used to implement the receiving function in the communication unit 901 may be regarded as a receiving unit, and the device used to implement the sending function in the communication unit 901 may be regarded as a sending unit, that is, the communication unit 901 includes a receiving unit and a sending unit. The communication unit may also be sometimes referred to as a transceiver, a transceiver, or a transceiver circuit, etc. The receiving unit may also be sometimes referred to as a receiver, a receiver, or a receiving circuit, etc. The sending unit may also be sometimes referred to as a transmitter, a transmitter, or a transmitting circuit, etc.

[0246] When the communication device 900 executes the above embodiment Figure 4 In the process shown, the functions of the first device are as follows: the processing unit 902 is used to determine the first state information; the first state information is the input information of the first model, the first model is used to predict the decision information of the first device accessing the channel, and the first state information includes the occupancy information of the channel and the node information of the node occupying the resources of the channel exceeding the preset resource threshold; the communication unit 901 sends the first state information to the second device; the communication unit 901 is also used to receive the model parameters of the first model from the second device; the model parameters include the biases and / or weights corresponding to different variables in the first model; the biases and / or weights corresponding to different variables are determined by the second device according to the first state information; the processing unit 902 is used to update the first model based on the model parameters of the first model to obtain an updated first model; and is also used to input the first state information into the updated first model, and obtain the decision information of the first device accessing the channel based on the output of the updated first model.

[0247] In one possible implementation, the occupancy information of the channel includes a first occupancy rate of the channel occupied by the first device based on the target access type and a second occupancy rate of the channel occupied by other devices based on the target access type, and the other device is at least one device occupying the channel other than the first device.

[0248] In one possible implementation, the second occupancy rate may be determined in the following manner: sending the first occupancy rate to the second device through the communication unit 901; and receiving first information from the second device; the first information includes the total occupancy rate of the target access type occupying the channel, and the total occupancy rate is obtained by the second device based on the first occupancy rate and the occupancy rate of the channel occupied by other devices based on the target access type; and obtaining the second occupancy rate by subtracting the first occupancy rate of the first device from the total occupancy rate through the processing unit 902.

[0249] In a possible implementation, the communication unit 901 may also be used to: receive second information from the second device before sending the first occupancy rate to the second device, the second information including a channel occupancy rate threshold of the target access type; and determine through the processing unit 902 that the first occupancy rate of the first device is greater than the channel occupancy rate threshold.

[0250] In a possible implementation, the communication unit 901 may also be used to: receive a first request message from the second device, where the first request message is used to request the first device to occupy a first occupancy rate of the channel based on a target access type.

[0251] In a possible implementation, the node information includes the number of the nodes, and the nodes specifically refer to devices whose resource occupancy rate of the channel based on the target access type is greater than a resource occupancy rate threshold of the channel based on the target access type.

[0252] In one possible implementation, the number of nodes can be obtained in the following manner: the number of nodes is received from the second device through the communication unit 901, and the number of nodes is obtained by the second device based on the resource occupancy rate of the channel occupied by the first device based on the target access type and the resource occupancy rate of the channel occupied by other devices based on the access type, as well as the resource occupancy rate threshold of the channel.

[0253] In a possible implementation manner, the target access type is one or more of the following: an access type for voice data, an access type for video data, an access type for maximum capability transmission data, and an access type for background data.

[0254] In a possible implementation, the first status information also includes one or more of the following: carrier sensing result information of the channel in a preset historical time period, the length of time between the current data transmission time of the first device and the last successful data transmission time of the first device, and the length of time between the current data transmission time of other devices and the last successful data transmission time of the other devices.

[0255] In a possible implementation, when the decision information for accessing the channel is a probability value of the first device successfully accessing the channel, the processing unit 902 may also be used to: obtain a contention window duration for the first device to access the channel based on the probability value of the channel, and the first device accesses the channel within the contention window duration.

[0256] In a possible implementation manner, the first device is a station, and the second device is an access point.

[0257] When the communication device 900 executes the above embodiment Figure 4 The function of the second device in the process shown is: the communication unit 901 is used to receive first state information from the first device; the first state information is input information of the first model, the first model is used to predict the decision information of the first device accessing the channel, and the first state information includes the occupancy information of the channel and the node information of the nodes occupying the resources of the channel exceeding the preset resource threshold; the processing unit 902 is used to determine the model parameters of the first model according to the first state information; the model parameters include the bias and / or weight corresponding to each variable in the first model; the communication unit 901 can also be used to send the model parameters of the first model to the first device.

[0258] In a possible implementation, the communication unit 901 may also be used to: receive the occupancy rate of the channel occupied by at least one device based on the target access type, the at least one device including the first device; the processing unit 902 may also be used to determine the total occupancy rate of the channel occupied based on the target access type according to the occupancy rate of the channel occupied by the at least one device based on the target access type; the communication unit 901 may also be used to send first information to the first device, the first information including the total occupancy rate of the channel occupied based on the target access type.

[0259] In a possible implementation, the channel occupancy information includes a first occupancy rate of the channel occupied by the first device based on the target access type and a second occupancy rate of the channel occupied by other devices based on the target access type, where the other devices are at least one device occupying the channel other than the first device; the node information includes the number of nodes, and the node specifically refers to a device whose resource occupancy rate of the channel based on the target access type is greater than a resource occupancy rate threshold of the channel based on the target access type.

[0260] In one possible implementation, when determining the model parameters of the first model based on the first state information, the processing unit 902 can be specifically used to: based on the first state information and reward function information, use a reinforcement learning method to train to obtain the model parameters of the first model, and the reward function information is associated with the first occupancy rate of the first device.

[0261] In a possible implementation manner, the target access type is one or more of the following: an access type for voice data, an access type for video data, an access type for maximum capability transmission data, and an access type for background data.

[0262] In a possible implementation, the first status information also includes one or more of the following: carrier sensing result information of the channel in a preset historical time period, the length of time between the current data transmission time of the first device and the last successful data transmission time of the first device, and the length of time between the current data transmission time of other devices and the last successful data transmission time of the other devices.

[0263] In a possible implementation manner, the first device is a station, and the second device is an access point.

[0264] like Fig.10 The communication device 1000 provided in an embodiment of the present application is shown. Fig.10 The communication device shown can be Fig. 9 The communication device 1000 can be applied to the flowchart shown above to perform the functions of the first device or the second device in the above method embodiment. For ease of description, Fig.10 Only the main components of the communication device are shown.

[0265] like Fig.10 As shown, the communication device 1000 includes a communication interface 1001 and a processor 1002. The communication interface 1001 and the processor 1002 are coupled to each other. It can be understood that the communication interface 1001 can be a transceiver or an input-output interface, or an interface circuit such as a transceiver circuit. Optionally, the communication device 1000 can also include a memory 1003 for storing instructions executed by the processor 1002 or storing input data required by the processor 1002 to run the instructions or storing data generated after the processor 1002 runs the instructions.

[0266] When the communication device 1000 is used to implement Figure 4 When the method is shown, the processor 1002 is used to implement the functions of the processing unit 902, and the communication interface 1001 is used to implement the functions of the communication unit 901.

[0267] The specific connection medium between the communication interface 1001, the processor 1002 and the memory 1003 is not limited in the embodiment of the present application. Fig.10 In the embodiment, the memory 1003, the processor 1002 and the communication interface 1001 are connected via a communication bus 1004. Fig.10The communication bus 1004 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.10 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0268] When the communication device is a chip, Fig.11 A simplified schematic diagram of a chip device structure is shown, where the chip 1100 includes an interface circuit 1101 and one or more processors 1102. Optionally, the chip 1100 may also include a bus.

[0269] in:

[0270] The processor 1102 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above communication method can be completed by an integrated logic circuit of hardware in the processor 1102 or an instruction in the form of software. The above processor 1102 can be a general-purpose processor, a digital communicator (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The disclosed methods and steps in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0271] The interface circuit 1101 can be used to send or receive data, instructions or information. The processor 1102 can use the data, instructions or other information received by the interface circuit 1101 to process, and can send the processing completion information through the interface circuit 1101.

[0272] Optionally, the chip further includes a memory 1103, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory 1103 may also include a non-volatile random access memory (NVRAM).

[0273] Optionally, the memory stores executable software modules or data structures, and the processor can perform corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in the operating system).

[0274] Optionally, the chip can be used in the first device or the second device involved in the embodiment of the present application. Optionally, the interface circuit 1101 can be used to output the execution result of the processor 1102. The channel access method provided by one or more embodiments of the present application can refer to the aforementioned embodiments, which will not be repeated here.

[0275] It should be noted that the corresponding functions of the interface circuit 1101 and the processor 1102 can be implemented through hardware design, software design, or a combination of hardware and software, and there is no limitation here.

[0276] An embodiment of the present application also provides a computer-readable storage medium on which computer instructions for implementing the method executed by the first device or the second device in the above method embodiment are stored.

[0277] For example, when the computer program is executed by a computer, the computer can implement the method performed by the first device or the second device in the above method embodiment.

[0278] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed by a computer, enables the computer to implement the method performed by the first device or the second device in the above method embodiment.

[0279] The present application also provides a chip device, including a processor, configured to call a computer program or computer instruction stored in the memory, so that the processor executes the above Figure 4-Figure 7 as well as Figure 8A-8B The channel access method of the embodiment shown.

[0280] In a possible implementation, the input of the chip device corresponds to the above Figure 4 In the receiving operation of the embodiment shown, the output of the chip device corresponds to the above Figure 4-Figure 7 as well as Figure 8A-8B The sending operation in the embodiment shown.

[0281] Optionally, the processor is coupled to the memory via an interface.

[0282] Optionally, the chip device further comprises a memory, in which computer programs or computer instructions are stored.

[0283] The processor mentioned in any of the above may be a general-purpose central processing unit, a microprocessor, an application-specific integrated circuit (ASIC), or one or more processors for controlling the above Figure 4-Figure 7 as well as Figure 8A-8B An integrated circuit for executing a program of a channel access method of the embodiment shown. The memory mentioned in any of the above places can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM), etc.

[0284] It should be noted that, for the sake of convenience and brevity of description, the explanation of the relevant contents and beneficial effects in any of the communication devices provided above can refer to the corresponding channel access method embodiments provided above, and will not be repeated here.

[0285] In the present application, the communication devices may also include a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system layer. Among them, the hardware layer may include hardware such as a central processing unit (CPU), a memory management unit (MMU), and a memory (also called main memory). The operating system of the operating system layer may be any one or more computer operating systems that implement business processing through processes, such as Linux operating system, Unix operating system, Android operating system, iOS operating system, or Windows operating system. The application layer may include applications such as browsers, address books, word processing software, and instant messaging software.

[0286] The division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional module in each embodiment of the present application may be integrated into a processor, or may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated modules may be implemented in the form of hardware or in the form of software functional modules.

[0287] Through the description of the above implementation mode, it can be clearly understood by those skilled in the art that the embodiments of the present application can be implemented by hardware, firmware, or a combination thereof. When software is used for implementation, the above functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein the communication media include any medium that facilitates the transmission of a computer program from one place to another. The storage medium can be any available medium that a computer can access. Taking this as an example but not limited to: a computer-readable medium can include RAM, ROM, electrically erasable programmable read only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer. In addition. Any connection can be appropriately a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, wireless, and microwave are included in the fixation of the medium. As used in the embodiments of the present application, disk and disc include compact disc (CD), laser disc, optical disc, digital video disc (DVD), floppy disk, and Blu-ray disc, where disks usually copy data magnetically and discs use lasers to copy data optically. The above combinations should also be included in the scope of protection of computer-readable media.

[0288] In short, the above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present application shall be included in the protection scope of the present application.

Claims

1. A channel access method, characterized in that: include: The first device determines first status information; The first state information is input information of a first model, the first model is used to predict decision information of the first device accessing a channel, and the first state information includes occupancy information of the channel and node information of nodes whose resources occupying the channel exceed a preset resource threshold; The first device sends the first status information to the second device; The first device receives model parameters of the first model from the second device; the model parameters include biases and / or weights corresponding to different variables in the first model respectively; The biases and / or weights respectively corresponding to the different variables are determined by the second device according to the first state information; The first device updates the first model based on the model parameters of the first model to obtain an updated first model; The first device inputs the first state information into the updated first model, and obtains decision information of the first device accessing the channel based on an output of the updated first model.

2. The method according to claim 1, characterized in that: The occupancy information of the channel includes a first occupancy rate of the first device occupying the channel based on the target access type and a second occupancy rate of other devices occupying the channel based on the target access type, and the other device is at least one device occupying the channel except the first device.

3. The method according to claim 2, characterized in that The second occupancy rate is determined by: The first device sends the first occupancy rate to the second device; The first device receives first information from the second device; the first information includes a total occupancy rate of the channel occupied by the target access type, and the total occupancy rate is obtained by the second device according to the first occupancy rate and the occupancy rate of the channel occupied by other devices based on the target access type; The first device subtracts the first occupancy of the first device from the total occupancy to obtain the second occupancy.

4. The method according to claim 3, characterized in that Before the first device sends the first occupancy rate to the second device, the method further includes: The first device receives second information from the second device, where the second information includes a channel occupancy threshold of the target access type; and the first device determines that the first occupancy of the first device is greater than the channel occupancy threshold.

5. The method according to claim 3 or 4, characterized in that: The method further comprises: The first device receives a first request message from the second device, where the first request message is used to request the first device to occupy a first occupancy rate of the channel based on a target access type.

6. The method according to claim 1, characterized in that The node information includes the number of the nodes, and the nodes specifically refer to devices whose resource occupancy rate of the channel based on the target access type is greater than a resource occupancy rate threshold of the channel based on the target access type.

7. The method according to claim 6, characterized in that The number of nodes is obtained by: The first device receives the number of nodes from the second device, and the number of nodes is obtained by the second device based on the resource occupancy rate of the channel occupied by the first device based on the target access type, the resource occupancy rate of the channel occupied by other devices based on the access type, and the resource occupancy rate threshold of the channel.

8. The method according to any one of claims 2 to 7, characterized in that: The target access type is one or more of the following: Access type for voice data, access type for video data, access type for data with maximum transmission capability, and access type for background data.

9. The method according to any one of claims 1 to 8, characterized in that: The first status information also includes one or more of the following: The carrier sensing result information of the channel in a preset historical time period, the length of time between the current data transmission time of the first device and the last successful data transmission time of the first device, and the length of time between the current data transmission time of other devices and the last successful data transmission time of the other devices.

10. The method according to any one of claims 1 to 8, characterized in that: When the decision information for the first device to access the channel is a probability value of the first device successfully accessing the channel, the method further includes: The first device obtains a contention window duration for the first device to access the channel based on the probability value of the channel, and the first device accesses the channel within the contention window duration.

11. The method according to any one of claims 1 to 10, characterized in that The first device is a station, and the second device is an access point.

12. A channel access method, characterized in that: include: The second device receives the first status information from the first device; The first state information is input information of a first model, the first model is used to predict decision information of the first device accessing a channel, and the first state information includes occupancy information of the channel and node information of nodes whose resources occupying the channel exceed a preset resource threshold; The second device determines model parameters of the first model according to the first state information; the model parameters include biases and / or weights corresponding to different variables in the first model respectively; The second device sends the model parameters of the first model to the first device.

13. The method according to claim 12, characterized in that The method further comprises: The second device receives an occupancy rate of the channel occupied by at least one device based on a target access type, wherein the at least one device includes the first device; The second device determines, according to the occupancy rate of the channel occupied by the at least one device based on the target access type, a total occupancy rate of the channel occupied based on the target access type; The second device sends first information to the first device, where the first information includes a total occupancy rate of the channel based on the target access type.

14. The method according to claim 12, characterized in that The occupancy information of the channel includes a first occupancy rate of the first device occupying the channel based on the target access type and a second occupancy rate of other devices occupying the channel based on the target access type, wherein the other device is at least one device occupying the channel except the first device; The node information includes the number of the nodes, and the nodes specifically refer to devices whose resource occupancy rate of the channel based on the target access type is greater than a resource occupancy rate threshold of the channel based on the target access type.

15. The method according to claim 14, characterized in that The second device determines, according to the first state information, a model parameter of the first model, including: The second device uses a reinforcement learning method to train model parameters of the first model based on the first state information and reward function information, and the reward function information is associated with the first occupancy rate of the first device.

16. The method according to any one of claims 13 to 15, characterized in that The target access type is one or more of the following: Access type for voice data, access type for video data, access type for data with maximum transmission capability, and access type for background data.

17. The method according to any one of claims 12 to 16, characterized in that: The first status information also includes one or more of the following: The carrier sensing result information of the channel in a preset historical time period, the length of time between the current data transmission time of the first device and the last successful data transmission time of the first device, and the length of time between the current data transmission time of other devices and the last successful data transmission time of the other devices.

18. The method according to any one of claims 12 to 17, characterized in that The first device is a station, and the second device is an access point.

19. A communication device, characterized in that: The method comprises a unit for executing the method according to any one of claims 1 to 11, or comprises a unit for executing the method according to any one of claims 12 to 18.

20. A communication device, characterized in that: include: Processor and memory; The memory is used to store computer programs or instructions; The processor is used to execute the computer program or instructions in the memory, so that the device performs the method according to any one of claims 1 to 11, or the device performs the method according to any one of claims 12 to 18.

21. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which, when called by an electronic device, enable the electronic device to execute the method as claimed in any one of claims 1 to 11 or enable the electronic device to execute the method as claimed in any one of claims 12 to 18.

22. A computer program product, characterized in that The method comprises computer-executable instructions, which, when executed on a computer, cause the computer to execute the method according to any one of claims 1 to 11 or cause the computer to execute the method according to any one of claims 12 to 18.

23. A communication system, characterized in that: The invention comprises an apparatus for executing the method according to any one of claims 1 to 11 and an apparatus for executing the method according to any one of claims 12 to 18.