Generalized perception model under limited spectral resources and distributed Q learning access method

Abstract

The invention discloses a generalized perception model under limited spectral resources and a distributed Q learning access method. According to the model, a channel perception mechanism based on a zero-added latin square matrix is proposed by considering limitation of spectrum resources and dynamism of network environment and aiming at the problem of multiple time-slot channel perception sequenceoptimization. The method includes the following steps that firstly, a game model is constructed, and participants are all cognitive users in a network; based on the generalized perception model, eachuser randomly selects a channel perception sequence strategy from the corresponding zero-added latin square matrix and conducts perception; each active user calculates a current state return value and conducts Q-value update and probability update for the next time slot on the basis of the current state return value; the cognitive users conduct time-slot perception circularly until channel perception sequence strategies of all the cognitive users are converged. By adopting the model and the method, multiple time-slot channel perception sequence conflict is effectively reduced under the limited spectral resources, and handling capacity of the system cognitive users is improved.

Description

technical field [0001] The invention belongs to the technical field of wireless communication, and proposes a generalized channel perception model and a distributed Q learning algorithm under the condition of limited spectrum resources. Background technique [0002] The sharp increase in spectrum demand and the inefficient use of certain frequency bands have given rise to Opportunistic Spectrum Access (OSA). Opportunistic spectrum access requires reconfigurable networked devices, known as Cognitive Radio (CR) devices, that can change behavior in response to their corresponding environmental stimuli (Ref. J.Mitola III and G.Q.Maguire Jr.,“ Cognitive Radio: Making Software Radiomore Personal,” IEEE Pers. Communications, vol.6, no.4, pp.13–18, Aug.1999). These cognitive devices or cognitive users (Secondary User, SU) need to use spectrum detection to ensure that the frequency band is not occupied when the primary user (Primary User, PU) is active, so as to avoid causing interf...

AI Technical Summary

Problems solved by technology

[0004] However, most of the studies mentioned above ignore the problems of limited spectrum resources (the number of cognitive users is greater than the number of channels) and the dynamic changes of the network environment. In actual communication scenarios, system resources are not always sufficient, and users do not It is not always active, and the channel occupancy in the cognitive network is also time-varying

Images