Resource allocation method and device based on polarization information processing

Abstract

The application discloses a resource allocation method and device based on polarization information processing. The method comprises the following steps: obtaining prior information of H2H user equipment and time-delay sensitive machine equipment in a human-machine-object mixed access heterogeneous network based on pre-allocated resource blocks, transmission power and polarization state information; defining a state set, an action selection set and a reward function for time-delay tolerant machine equipment based on the prior information; exploring the maximum reward value of the time-delay tolerant machine equipment by using a greedy strategy based on the state set, the action selection set and the reward function; and allocating resources for the time-delay tolerant machine equipment based on the maximum reward value, wherein the resources comprise resource blocks, power and polarization state. The application solves the technical problem of unreasonable resource allocation in the prior art.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of communication, in particular to a resource allocation method and device based on polarization information processing. BACKGROUND

[0002] Cellular network is considered as one of the important technologies for serving human-machine-object hybrid access communication services. As a technology with globalized, perfect and unified standards and large-scale commercialization, cellular network can effectively provide high coverage probability and communication quality, meet the long-distance object-to-object data communication demand, and has the ability to provide efficient and reliable information transmission bearing for both humans and objects. On the one hand, cellular network can provide safe and reliable communication links and high data transmission rates for human-type communication (HTC); on the other hand, under the active promotion of operators, the network architecture and protocol of cellular Internet of Things technology have gradually developed, becoming one of the important communication technologies supporting MTC. Therefore, cellular network can provide communication services for both HTC devices and MTC devices containing various types of machines and objects, forming a heterogeneous network for human-machine-object hybrid access.

[0003] Although the heterogeneous network for human-machine-object hybrid access has irreplaceable advantages for improving spectrum efficiency, due to the intensive deployment of a large number of heterogeneous HTC and MTC devices and frequency reuse, the interference environment of the network becomes particularly complex: there are both same type of device interference due to same frequency deployment and interference between different types of devices due to shared spectrum. How to solve the spectrum efficiency performance damage caused by these interferences and realize the interference-free coexistence between HTC and MTC devices in the heterogeneous network while meeting the diversified communication needs of HTC devices and MTC devices is an important problem that needs in-depth research.

[0004] Radio Resource Management (RRM) is one of the effective methods to solve the interference between HTC and MTC. RRM is to allocate wireless resources (including time domain, frequency domain, spatial domain, power domain, code domain, etc.) to users reasonably, provide wireless access and data transmission for users while ensuring the Quality of Service (QoS) needs of users, and the goal is to improve the efficiency of wireless spectrum utilization. The traditional wireless resources that can be managed and controlled include time domain resources (such as time slots, subframes, etc.), frequency domain resources (such as spectrum, subcarriers), spatial domain resources (such as antennas, beams), power domain resources (such as transmission power), code domain resources (such as channel source coding), etc. The resources in different domains can be combined to form resource blocks allocated to users. Under the condition that the total network resource quantity is limited, RRM needs to allocate time slots, carriers and beam resource blocks of different sizes to users, and maximize the network performance under the premise of meeting the QoS of users.

[0005] However, in the prior art, the utilization of time and frequency domain resources can only improve the spectrum utilization rate by 3%-10%; since the spatial spectrum opportunity exists in the same frequency and different beam directions, the utilization of the spatial spectrum opportunity makes the improvement of the spectrum utilization rate relatively high, but is only 45.15%. The reduction of available spectrum opportunities and the increasing demand of the heterogeneous network for human-machine-thing hybrid access for spectrum utilization rate become a prominent contradiction. The utilization of the above domain spectrum opportunities is far from enough for the demand of wireless spectrum.

[0006] At present, no effective solution has been proposed for the above problems. SUMMARY

[0007] Embodiments of the present application provide a resource allocation method and device based on polarization information processing, to at least solve the technical problem of unreasonable resource allocation in the prior art.

[0008] According to an aspect of embodiments of the present application, a resource allocation method based on polarization information processing is provided, comprising: obtaining prior information of H2H user equipment and time-sensitive machine equipment in a heterogeneous network for human-machine-thing hybrid access based on pre-allocated resource blocks, transmission power and polarization state information; defining a state set, an action selection set and a reward function for a time-tolerant machine equipment based on the prior information; exploring a maximum reward value of the time-tolerant machine equipment by using a greedy strategy based on the state set, the action selection set and the reward function; and allocating resources for the time-tolerant machine equipment based on the maximum reward value, wherein the resources include resource blocks, power and polarization state.

[0009] According to another aspect of embodiments of the present application, a resource allocation device based on polarization information processing is also provided, comprising: an initialization module configured to obtain prior information of H2H user equipment and time-sensitive machine equipment in a heterogeneous network for human-machine-thing hybrid access based on pre-allocated resource blocks, transmission power and polarization state information; a definition module configured to define a state set, an action selection set and a reward function for a time-tolerant machine equipment based on the prior information; an exploration module configured to explore a maximum reward value of the time-tolerant machine equipment by using a greedy strategy based on the state set, the action selection set and the reward function; and an allocation module configured to allocate resources for the time-tolerant machine equipment based on the maximum reward value, wherein the resources include resource blocks, power and polarization state.

[0010] According to another aspect of the embodiments of the present application, a human-machine hybrid access heterogeneous network is also provided, comprising a machine user equipment, a H2H user equipment, a machine equipment gateway and a base station, the machine user equipment comprises a time delay tolerant machine equipment and a time delay sensitive machine equipment, wherein the machine equipment gateway comprises the resource allocation device based on polarization information processing as described above.

[0011] In the embodiments of the present application, the prior information is obtained based on the pre-allocated resource block, the transmission power and the polarization state information, the state set, the action selection set and the reward function are defined for the time delay tolerant machine equipment based on the prior information, the maximum reward value of the time delay tolerant machine equipment is explored by using the greedy strategy based on the state set, the action selection set and the reward function, and the resource is allocated for the time delay tolerant machine equipment based on the maximum reward value, thereby solving the technical problem of unreasonable resource allocation in the prior art. BRIEF DESCRIPTION OF DRAWINGS

[0012] The drawings described herein are used to provide further understanding of the present application, and form a part of the present application. The illustrative embodiments of the present application and their descriptions serve to explain the present application, and do not constitute improper limitations on the present application. In the drawings:

[0013] Figure 1 is a flow chart of a resource allocation method based on polarization information processing according to an embodiment of the present application;

[0014] Figure 2 is a flow chart of another resource allocation method based on polarization information processing according to an embodiment of the present application;

[0015] Figure 3 is a flow chart of a resource allocation sub-method according to an embodiment of the present application;

[0016] Figure 4 is a structural schematic diagram of a human-machine hybrid access heterogeneous network according to an embodiment of the present application;

[0017] Figure 5 is a structural schematic diagram of a resource allocation device based on polarization information processing according to an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to enable persons skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative labor should fall within the scope of protection of the present application.

[0019] It is to be understood that the terminology "first", "second" and the like used in the specification and the claims of the application as well as the preceding description of the drawings is merely used to distinguish similar objects and does not necessarily indicate a specific order or sequence of steps. It is to be understood that data used in connection with the described embodiments is to be taken in a generic and descriptive sense and not necessarily in a limiting sense. Furthermore, the terms "comprising", "including", "containing", and "having" and any variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, system, product, or device that comprises, includes, contains, or has an item or step does not include only that item or step, but can also include additional items or steps not expressly listed or inherent to such process, method, system, product, or device.

[0020] Embodiment 1

[0021] In a heterogeneous network for human-machine-object hybrid access, polarization information as a signal intrinsic attribute is an important resource that can be utilized. At present, polarization information has shown great application potential in optical fiber and radar communication. In the field of wireless communication, with the development of next-generation wireless communication systems, base stations and terminals with orthogonal dual-polarized antennas are becoming more and more popular due to the influence of antenna space, size and other factors. By using the orthogonal polarization branch configured at the receiving end, complete polarization information such as signal amplitude ratio and phase difference can be obtained without increasing the complexity of additional hardware through virtual polarization eigenvector signal processing methods. The ideal short-distance coverage and high signal-to-noise ratio communication environment of the heterogeneous network itself makes the polarization information less affected by the channel depolarization effect, providing an excellent opportunity for the application of polarization information. Similar to the time domain, frequency domain, spatial domain, power domain and other information of the signal, polarization information is also a basic information of the signal, independent of other domain information, and can be independently utilized or combined.

[0022] According to an embodiment of the application, a resource allocation method based on polarization information processing is provided, as shown in Figure 1 The method comprises the following steps:

[0023] In step S102, based on the pre-allocated resource block, the transmission power and the polarization state information, the prior information of the H2H user equipment and the time-delay-sensitive machine equipment in the heterogeneous network for human-machine-object hybrid access is obtained.

[0024] The existing polarization information processing-based resource allocation methods are all proposed for human-type communication, i.e., polarization states and other wireless communication resources are allocated to human-type communication devices, and there is no research on allocating polarization states to machine-type communication devices in a human-machine-object hybrid access heterogeneous network to improve the communication system efficiency. Therefore, in the prior art, how to solve the spectrum efficiency performance damage caused by complex interference in a human-machine-object coexistence network, realize the interference-free coexistence between HTC and MTC devices in a heterogeneous network, and meet the diversified communication needs of HTC devices and MTC devices, there is no related research based on polarization information processing.

[0025] In the embodiments of the present application, in a human-machine-object hybrid access heterogeneous network, in addition to traditional human-to-human communication services, M2M service types are divided into critical services and tolerant services, wherein M2M devices exist in a cluster form and establish a communication link with a local machine device gateway, H2H users and critical M2M users in the network are pre-allocated OFDM frequency subbands (i.e., resource blocks), and the remaining tolerant M2M users multiplex the same spectrum resources, and the tolerant M2M devices are configured with dual-polarized antennas and have the ability to adjust the transmission polarization state.

[0026] In step S104, based on the prior information, a state set, an action selection set and a reward function are defined for the delay-tolerant machine device.

[0027] First, the constraint conditions and optimization objectives of optimizing the devices in the human-machine-object hybrid access heterogeneous network are determined. The constraint conditions and optimization objectives can include: modeling the optimization objective of the quality of service requirement of the delay-tolerant machine device in the heterogeneous network as maximizing the throughput of the delay-tolerant machine device; modeling the constraint condition of the quality of service requirement of the H2H user device in the heterogeneous network as the SINR value of the H2H user being greater than a preset SINR threshold; and modeling the constraint condition of the quality of service requirement of the delay-sensitive machine device in the heterogeneous network as the reliability of the delay-sensitive machine device being greater than a preset reliability threshold.

[0028] Then, based on the determined constraint conditions and optimization objectives, a state set, an action selection set and a reward function of the delay-tolerant machine device in the device are defined. The action selection set is determined based on a resource block selection set, a transmission power selection set and a transmission polarization state selection set, and at the same time, each delay-tolerant machine can only multiplex one resource block in the resource block selection set and select one transmission power value in the transmission power selection set, and has a polarization state on the selected resource block.

[0029] Step S106, based on the state set, action selection set and reward function, the maximum reward value of the delay-tolerant machine device is explored by using a greedy policy.

[0030] In the exploration phase, the delay-tolerant machine device randomly selects a resource block, a polarization state and a transmission power value in the action selection set, and obtains a reward value based on the selected resource block, polarization state and transmission power value.

[0031] In the utilization phase, the delay-tolerant machine device determines a current policy based on the state set, action selection set and reward function. For example, based on the resource block and transmission power of the H2H user equipment, the SINR on the uplink communication link of the H2H user equipment is determined; based on the resource block and transmission power of the delay-sensitive machine device, the SINR on the uplink communication link of the delay-sensitive machine device is determined; based on the interference from the cellular user and the inter-cluster interference, the SINR on the uplink communication link of the delay-tolerant machine device is determined, wherein the inter-cluster interference is the interference generated when machine devices from different clusters share the same resource block; based on the SINR on the uplink communication link of the H2H user equipment, the SINR on the uplink communication link of the delay-sensitive machine device, and the SINR on the uplink communication link of the delay-tolerant machine device, the current policy for allocating resource blocks, power and polarization states for the delay-tolerant machine device is determined.

[0032] In some example embodiments, the SINR on the uplink communication link of the delay-tolerant machine device can be obtained by: obtaining a dual-polarized channel between the delay-tolerant machine device and a machine device gateway, wherein both the delay-tolerant machine device and the machine device gateway are configured with dual-polarized antennas, and the dual-polarized channel is formed between the dual-polarized antennas; based on the dual-polarized channel, the interference from the cellular user and the inter-cluster interference, the SINR on the uplink communication link of the delay-tolerant machine device is determined.

[0033] Then, based on the current policy, the optimal resource block, polarization state and transmission power value are selected in the action selection set, and finally, based on the selected optimal resource block, polarization state and transmission power value, a reward value is obtained, and the above steps are iterated until the maximum reward value is obtained.

[0034] Step S108, based on the maximum reward value, resources are allocated for the delay-tolerant machine device, wherein the resources include resource blocks, power and polarization states.

[0035] allocating a polarization state of a signal transmitted to a machine device gateway for the delay-tolerant machine, wherein the allocated polarization state is characterized by an amplitude ratio descriptor and a phase difference descriptor. In addition to allocating the polarization state, a resource block and a power are also allocated.

[0036] In the existing polarization information processing technology, the main research focuses on how to use polarization diversity, multiplexing and interference cancellation to improve the spectral efficiency of wireless communication systems. However, the depth and breadth of research and development of polarization information resources are far from matching their importance.

[0037] In this embodiment, a resource allocation method based on polarization information processing is proposed for resource allocation in a heterogeneous network for human-machine-object hybrid access. Through distributed deployment, the transmission polarization state, resource block and transmission power are adaptively allocated, so that the delay-tolerant machine device can continuously optimize its transmission polarization state, resource block and power allocation strategy in the process of interacting with the network environment, maximize its throughput, and also guarantee the QoS requirements of cellular users. The method proposed in this application fully utilizes the polarization resources of the wireless network, and through polarization information processing, not only can the delay-tolerant machine device learn the optimal resource scheme in a self-organizing manner, but also has little impact on the performance of high-QoS demand users in the heterogeneous network for human-machine-object hybrid access.

[0038] Embodiment 2

[0039] According to an embodiment of the present application, a resource allocation method based on polarization information processing in a heterogeneous network for human-machine-object hybrid access is provided. The method can be applied in a heterogeneous network, which includes a base station, a machine type network gateway, an H2H user device, a delay-sensitive machine device (also referred to as a critical machine device) and a delay-tolerant machine device. The uplink channel is divided into resource blocks in the time domain and the frequency domain, and each resource block has a bandwidth of 180 KHz.

[0040] Figure 2 A resource allocation method based on polarization information processing in a heterogeneous network for human-machine-object hybrid access according to an embodiment of the present application is shown in FIG. 1, which includes the following steps: Figure 2 As shown in FIG. 1, the method includes the following steps:

[0041] Step S202, constructing a system model.

[0042] The H2H user device and the critical (delay-sensitive) machine user device (CMTCD) directly communicate with the base station, which is referred to as a cellular user (CUE). For the delay-tolerant machine device, the local uplink communication between the machine type network gateway (MTCG). The delay-tolerant machine user device and the machine type network gateway are both configured with dual-polarized antennas.

[0043] The available resource blocks in the system are denoted as K = {1, 2, …, K}, and the cellular users are denoted as N = H ∪ S, where H = {1, 2, …, H} represents the H2H user equipments, and S = {1, 2, …, S} represents the delay-sensitive machine equipments, and the number of machine equipment clusters in the system is denoted as L = {1, 2, …, L}, respectively represent the polarization state of the machine equipment gateway and the tth delay-tolerant machine equipment in the cluster l.

[0044] The polarization state of the signal sent by the tth delay-tolerant machine equipment to the machine equipment gateway The polarization state of the signal sent by the tth delay-tolerant machine equipment to the machine equipment gateway

[0045]

[0046] wherein, and are the amplitude ratio descriptor and the phase difference descriptor of respectively, and j represents an imaginary unit. Similarly, the polarization state received by the machine equipment gateway can be represented as In this application, the polarization state of the signal sent by the delay-tolerant machine equipment will be determined by the execution result of the proposed resource allocation system and method based on polarization information processing, and the polarization state received by the machine equipment gateway is set to a fixed value according to the actual antenna polarization state and remains unchanged in the resource allocation process.

[0047] Due to the influence of channel fading, the energy of a certain polarization component of the transmitted signal will be transferred to another orthogonal component, so that a deflection occurs at the receiving end, and this phenomenon is called channel depolarization effect. The channel containing the depolarization effect can be modeled as the following dual-polarized Rayleigh fading channel:

[0048] H = gh p

[0049] wherein the scalar g obeys complex Gaussian fading, which is used to represent Rayleigh fading, and the vector h p represents the channel depolarization effect containing polarization correlation and power imbalance. The polarization correlation matrix of h p is

[0050]

[0051] wherein (·)' represents complex conjugate, (·) H represents conjugate transpose, χ is the inverse of channel cross-polarization identification (XPD), t p and r pdenote the transmit and receive correlation coefficients, respectively, t p and r p are usually small and are assumed to be zero, p p and q p are the cross-channel correlation coefficients, which are usually equal according to ray tracing measurements. p and q p are the cross-channel correlation coefficients, which are usually equal according to ray tracing measurements.

[0052] h p may be characterized as

[0053]

[0054] where |·| denotes the absolute value, β k , k = 1, 2, 3, 4 are random phases uniformly distributed in [0, 2π).

[0055] In this application, the channel between the tth delay-tolerant machine device in the same cluster and the machine device gateway on resource block k is denoted as The channel between the tth machine device in the lth cluster and the base station on the kth resource block is denoted as where and characterize independent Rayleigh channel fading; the channel between the hth H2H user or the sth delay-sensitive machine device user and the rth machine device in cluster l is denoted as and and represent the channel gains of the H2H user h and the delay-sensitive machine user device s to the base station on resource block k, respectively.

[0056] Step S204, optimize the system model.

[0057] The hth H2H user device and the sth delay-sensitive machine device user on the kth resource block are assumed to have and be the transmit power of the H2H user and the delay-sensitive machine device user, respectively, the received SINR at the base station can be represented by the following formula, respectively:

[0058]

[0059]

[0060] where l denotes the lth cluster, denotes the channel gain of the H2H user h to the base station on resource block k, denotes the transmit power of the H2H user h on resource block k, and t denotes the tth delay-tolerant machine device, denotes the tth time-delay tolerant machine device in the lth cluster denotes the kth resource

[0061] denotes the transmit power on the block, L denotes the total number of clusters, σ 2 denotes the additive white Gaussian noise power, denotes the transmit power on the kth resource block by the time-delay sensitive machine user device s, denotes the channel gain on the kth resource block from the time-delay sensitive machine user device s to the base station, denotes the channel on the kth resource block from the tth machine device in the lth cluster to the base station, denotes the polarization state of the signal transmitted by the tth time-delay tolerant machine device to the machine device gateway.

[0062] When the kth resource block is allocated to a time-delay tolerant machine device communication link, the SINR is denoted as:

[0063]

[0064] wherein is denoted as or Therefore, the first term in the denominator of the above formula denotes the interference from cellular users, and the second term denotes the inter-cluster interference, i.e., the interference generated when machine devices from different clusters share the same resource block, denotes the channel on the kth resource block between the tth time-delay tolerant machine device and the machine device gateway, denotes the polarization state of the signal received by the machine device gateway on the kth resource block.

[0065] To meet the different QoS requirements of different communication mode devices, such as the high data rate required by the H2H communication mode and the high reliability required by the time-delay sensitive machine device, the objective of the present application is to maximize the throughput of the time-delay tolerant machine device while keeping the SINR value of the H2H user higher than the specified SINR threshold and ensuring the high reliability of each time-delay sensitive machine device. The spectrum, polarization state and power allocation problem is denoted as follows:

[0066]

[0067]

[0068]

[0069]

[0070]

[0071]

[0072]

[0073]

[0074] where k denotes the kth resource block, is a binary variable, which is equal to 1 if the user equipment t in cluster l is allocated the resource block k, otherwise 0, denotes the signal-to-interference-and-noise ratio (SINR) of the kth resource block allocated to a certain delay-tolerant machine type communication link, s denotes the sth delay-sensitive machine equipment, x h×k is a binary variable, which is equal to 1 if the user equipment h is allocated the resource block k, otherwise 0, denotes the signal-to-interference-and-noise ratio (SINR) of the kth resource block received by the base station from the hth H2H user equipment, denotes the signal-to-interference-and-noise ratio (SINR) of the kth resource block received by the base station from the sth delay-sensitive machine equipment user, denotes the sth delay-tolerant machine equipment in cluster l transmit power on the kth resource block, and denote the minimum SINR values required by the H2H user and the delay-sensitive machine equipment user, respectively, for establishing a reliable link; p0 represents the maximum tolerable outage probability;

[0075]

[0076] to ensure that the machine equipments in the same cluster do not share the resource blocks;

[0077]

[0078] to ensure that at most one resource block is allocated to the communication link between each M2M pair; to ensure that the resource blocks occupied by the cellular users are unique;

[0079]

[0080] in the range of and specify the range of the transmit power selected by the machine equipments in the cluster, denotes the transmit power value currently selected by the delay-tolerant machine equipment.

[0081] Step S206, resource allocation is performed.

[0082] The method for performing resource allocation, as shown in Figure 3 includes the following steps:

[0083] Step S2062, the resource allocation system is initialized.

[0084] Based on the pre-allocated spectrum sub-band, transmit power and polarization state information, the channel conditions of the spectrum sub-band occupied by H2H users and delay-sensitive machine device users and the SINR or outage probability are obtained.

[0085] Step S2064, define the action selection set, state set, reward and punishment function and strategy of the delay-tolerant machine device.

[0086] Action: The action set of the delay-tolerant machine device is the polarization state, transmit power and resource block. At the same time, each machine device can only multiplex one resource block and select one transmit power value, and has a polarization state on the resource block. Therefore, the action of machine device m at time t can be represented as:

[0087]

[0088] Where a m,k ={α m,1 ,α m,2 ,…,α m,K}, Respectively represent the resource block selection set, transmit power selection set and transmit polarization state selection set. Wherein, Indicates the amplitude ratio descriptor of , j represents the imaginary unit, Indicates the phase difference descriptor.

[0089] State: The state set of each delay-tolerant machine device is defined by the result of its interaction with the network environment at time t on resource block k, and is defined as:

[0090]

[0091] Where is the interference indication binary variable measured by the cellular user at time t on resource block k, and the value 1 represents that the mth machine device can guarantee the minimum QoS requirement of the cellular user when multiplexing resource block k with the cellular user, and 0 indicates that the QoS requirement of the cellular user cannot be guaranteed.

[0092] Reward and punishment function: In order to make each machine device adaptively select the transmit power value and resource block that can guarantee the overall performance of the system while maximizing its own throughput, the reward and punishment function is defined as follows:

[0093]

[0094] Strategy: The strategy refers to the scheme that the delay-tolerant machine device in the cluster determines the next action selection according to its current state. The Bellman equation is used as the optimal strategy equation:

[0095]

[0096] wherein R(s, a) represents the expected reward or penalty value obtained by the machine device according to the current state and action selection, 0≤γ≤1 is a discount factor, and the value determines the importance of the current reward or penalty value in the iteration process, and the smaller the value, the more the current reward or penalty value is valued, P s,s′ is the probability of the current device transferring from the state s to s', wherein v(s) represents a state value function.

[0097] The state / action value maintained by each delay-tolerant machine device is defined as Q(s, a), which represents the reward or penalty value obtained by each device according to the learned strategy of the device in the state s and the action a, and is represented as follows:

[0098]

[0099] The Q value update strategy is defined as follows:

[0100]

[0101] For each delay-tolerant machine device, the device will only update the Q value when the reward or penalty value obtained by the next state / action selection is greater than the current value, otherwise the current Q value is kept unchanged.

[0102] In step S2066, the maximum Q value is explored based on the greedy strategy.

[0103] In the exploration phase, the delay-tolerant machine device randomly selects the resource block, polarization state and transmission power value regardless of the influence of the generated interference on the cellular users. In this phase, the machine device selects the action to obtain the reward or penalty value and updates the state without considering the strategy, which helps the machine device to quickly understand the advantage action selection and disadvantage action selection, and prevents the condition of being in a local optimal value in the utilization phase. The utilization phase refers to selecting the optimal action informed by the current strategy to obtain the reward or penalty value. Although this phase always moves towards the goal of maximizing the Q value of the device. In this form, the iteration is cycled until each Q value converges, and the resource block selection, polarization state and power allocation scheme of each machine device gateway MTCG are output, and the performance of the cellular users under the resource allocation scheme is recorded.

[0104] Since the delay-tolerant machine device and the gateway are configured with dual-polarized antennas, they have the physical device premise of spatial domain resources, therefore, in addition to optimizing the allocation of polarization states, in some embodiments, the spatial domain resources can also be mined and utilized based on multi-antenna technology through beamforming and other methods, and the resource blocks, beamforming and transmission power are jointly allocated to achieve the purpose of improving network performance.

[0105] The application provides a resource allocation method based on polarization information processing in a human-machine-object hybrid access heterogeneous network, and provides a novel wireless resource management method in the human-machine-object hybrid access heterogeneous network.

[0106] In addition, the application provides an independent self-organizing resource allocation scheme, selects a resource block, a polarization state and a suitable transmission power with optimal channel conditions in the human-machine-object hybrid access heterogeneous network, thereby improving the performance of a time delay tolerant machine device, and ensuring the QoS requirements of H2H services and time delay sensitive M2M services associated with a base station by respectively meeting the signal to interference and noise ratio (SINR) threshold and the outage probability.

[0107] It should be noted that, for the foregoing method embodiments, in order to simply describe, the foregoing method embodiments are all described as a series of action combinations, but those skilled in the art should know that the application is not limited to the action sequence described, because according to the application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the actions and modules involved are not necessarily necessary for the application.

[0108] From the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be realized by means of software and a necessary general hardware platform, and of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the application can be embodied in the form of a software product, which is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk), and includes a plurality of instructions for causing a terminal device (which can be a mobile phone, a computer, a server, or a network device) to execute the methods described in the various embodiments of the application.

[0109] Embodiment 3

[0110] According to the embodiments of the application, a human-machine-object hybrid access heterogeneous network is also provided, as shown in the figure, the human-machine-object hybrid access heterogeneous network comprises a machine user device, an H2H user device 46, a machine device gateway 44 and a base station 42, the machine user device comprises a time delay tolerant machine device 49 and a time delay sensitive machine device 48. Figure 4

[0111] ​In this embodiment, a plurality of wireless connection machine user equipments, H2H user equipments 46 in a single cell, wherein the uplink channel is divided into resource blocks in time domain and frequency domain, and each resource block has a bandwidth of 180KHz. H2H user equipments 46 and time delay sensitive machine devices (CMTCD) 48 directly communicate with the base station, which is called cellular user (CUE). For time delay tolerant machine devices 49, and local uplink communication between machine device gateway 44 (MTCG). Both the tolerant machine device 49 and the machine device gateway 44 are configured with dual-polarized antennas.

[0112] Among them, the machine device gateway 44 includes a polarization information processing based resource allocation device, which will be described below, and will not be repeated here.

[0113] The polarization information processing based resource allocation device provided in the heterogeneous network for human-machine-object mixed access provided by the embodiment of the application, for the complex interference problem in the human-machine-object coexistence communication scene, innovatively introduces polarization resources, optimizes the transmission polarization state of the time delay tolerant machine device, and increases a new resource dimension on the basis of traditional time, frequency, space and other wireless resources, so that the performance of the communication system is further improved.

[0114] Specifically, the time delay tolerant machine device continuously optimizes its spectrum selection, polarization state and power allocation strategy in the process of interacting with the network environment, maximizes its throughput while also guaranteeing the QoS demand of the cellular user.

[0115] Embodiment 4

[0116] According to the embodiment of the application, a polarization information processing based resource allocation device is also provided, as shown in Figure 5 The device includes an initialization module 52, a definition module 54, an exploration module 56 and an allocation module 58.

[0117] The initialization module 52 is configured to obtain prior information of H2H user equipments and time delay sensitive machine devices in the heterogeneous network for human-machine-object mixed access based on pre-allocated resource blocks, transmission power and polarization state information.

[0118] The definition module 54 is configured to define a state set, an action selection set and a reward function for the time delay tolerant machine device based on the prior information.

[0119] The exploration module 56 is configured to explore the maximum reward value of the time delay tolerant machine device by using a greedy strategy based on the state set, the action selection set and the reward function.

[0120] The allocation module 58 is configured to allocate resources for the delay-tolerant machine device based on the maximum reward value, wherein the resources include resource blocks, power and polarization states.

[0121] The resource allocation device based on polarization information processing provided by the embodiment firstly establishes a heterogeneous network system model facing human-machine hybrid access, including H2H user equipment, delay-sensitive machine user equipment and delay-tolerant machine equipment. Secondly, an resource allocation optimization model is established, under the premise of meeting the different QoS requirements of different communication mode equipment, the throughput of the delay-tolerant machine equipment is maximized while keeping the SINR value of the H2H user higher than the specified SINR threshold and ensuring the high reliability of each delay-sensitive machine equipment. Finally, a resource allocation method based on polarization information processing is proposed, which adopts a distributed decision scheme, so that each delay-tolerant machine equipment autonomously selects resource blocks, polarization states and transmission power values, and solves the resource allocation optimization problem.

[0122] Optionally, specific examples in the embodiment can refer to examples described in Embodiment 1 and Embodiment 2 described above, and the embodiment will not be repeated here.

[0123] The scheme provided by the embodiment has the following beneficial effects:

[0124] 1) Polarization information processing advantage: In the same scenario, there is no prior art that studies polarization information processing. Compared with the existing resource allocation method, the application introduces polarization information processing to improve the efficiency of the wireless communication system.

[0125] 2) Resource allocation method advantage: Based on the traditional optimization theory to solve the resource allocation problem, the application selects the multi-agent cooperation and distributed execution mode in the implementation of the resource allocation method, which greatly reduces the business load of the base station, and can update the resource allocation strategy of each agent in each iteration, greatly improving the training convergence speed and also achieving better performance.

[0126] The above embodiment numbers of the application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0127] The integrated units in the above embodiments, if realized in the form of software function units and sold or used as independent products, can be stored in the above computer-readable storage medium. Based on such understanding, the technical solutions of the application essentially or the parts that make contributions to the prior art or the whole or part of the technical solutions can be embodied in the form of software products, and the computer software product is stored in the storage medium, including a plurality of instructions to make one or more computer devices (which can be personal computers, servers or network devices, etc.) execute all or part of the steps of the methods described in the embodiments of the application.

[0128] In the above-described embodiments of the present application, the description of each embodiment is focused on a certain aspect, and the part not described in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0129] In several embodiments provided in the present application, it should be understood that the disclosed client can be implemented by other manners. Among them, the above-described device embodiments are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed each other can be indirect coupling or communication connection through some interfaces, units or modules, and can be electrical or other forms.

[0130] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the present embodiment.

[0131] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0132] The above is only the preferred embodiment of the present application, and it should be pointed out that for ordinary skilled in the art, without departing from the principles of the present application, a number of improvements and refinements can be made, and these improvements and refinements should be considered as the protection scope of the present application.

Claims

1. A resource allocation method based on polarization information processing, characterized by, The method comprises: obtaining prior information of H2H user equipment and time-sensitive machine equipment in a hybrid human-machine access heterogeneous network based on pre-allocated resource blocks, transmission power and polarization state information; defining a state set, an action selection set and a reward function for a time-tolerant machine equipment based on the prior information; exploring a maximum reward value of the time-tolerant machine equipment by using a greedy strategy based on the state set, the action selection set and the reward function; allocating resources for the time-tolerant machine equipment based on the maximum reward value, wherein the resources include resource blocks, power and polarization state; wherein exploring the maximum reward value of the time-tolerant machine equipment by using a greedy strategy based on the state set, the action selection set and the reward function comprises: in the exploration phase, the time-tolerant machine equipment randomly selects resource blocks, polarization states and transmission power values in the action selection set, and obtains a reward value based on the selected resource blocks, polarization states and transmission power values; in the utilization phase, the time-tolerant machine equipment determines a current strategy based on the state set, the action selection set and the reward function, and selects the optimal resource blocks, polarization states and transmission power values in the action selection set based on the current strategy, and then obtains a reward value based on the selected optimal resource blocks, polarization states and transmission power values, until the maximum reward value is obtained; wherein the current strategy is determined by: determining the SINR on the uplink communication link of the H2H user equipment based on the resource blocks and transmission power of the H2H user equipment; determining the SINR on the uplink communication link of the time-sensitive machine equipment based on the resource blocks and transmission power of the time-sensitive machine equipment; determining the SINR on the uplink communication link of the time-tolerant machine equipment based on the interference from cellular users and inter-cluster interference, wherein the inter-cluster interference is the interference generated when machine equipment from different clusters share the same resource block; determining the current strategy for allocating resource blocks, power and polarization state for the time-tolerant machine equipment based on the SINR on the uplink communication link of the H2H user equipment, the SINR on the uplink communication link of the time-sensitive machine equipment, and the SINR on the uplink communication link of the time-tolerant machine equipment.

2. The method of claim 1, wherein, wherein the action selection set is determined based on a resource block selection set, a transmission power selection set and a transmission polarization state selection set, and each time-tolerant machine can only multiplex one resource block in the resource block selection set and select one transmission power value in the transmission power selection set at the same time, and has a polarization state on the selected resource block.

3. The method of claim 1, wherein, allocating resources for the time-tolerant machine equipment includes allocating a polarization state of a signal transmitted to a machine equipment gateway for the time-tolerant machine, wherein the allocated polarization state is characterized by an amplitude ratio descriptor and a phase difference descriptor.

4. The method of claim 1, wherein, defining a state set, an action selection set and a reward function for the time-tolerant machine equipment comprises: determining a constraint condition and an optimization target of an equipment in a heterogeneous network of human-machine-object hybrid access optimization; defining a state set, an action selection set and a reward function of the delay-tolerant machine equipment in the equipment based on the determined constraint condition and optimization target.

5. The method of claim 4, wherein, determining a constraint condition and an optimization target of an equipment in a heterogeneous network of human-machine-object hybrid access optimization, comprising: modeling an optimization target of a quality of service requirement of the delay-tolerant machine equipment in the heterogeneous network as maximizing a throughput of the delay-tolerant machine equipment; modeling the constraint condition of the quality of service requirement of the H2H user equipment in the heterogeneous network as an SINR value of the H2H user being greater than a preset SINR threshold value; modeling the constraint condition of the quality of service requirement of the delay-sensitive machine equipment in the heterogeneous network as a reliability of the delay-sensitive machine equipment being greater than a preset reliability threshold value.

6. The method of claim 1, wherein, determining an SINR on an uplink communication link of the delay-tolerant machine equipment based on interference from a cellular user and inter-cluster interference, comprising: obtaining a dual-polarized channel between the delay-tolerant machine equipment and a machine equipment gateway, wherein both the delay-tolerant machine equipment and the machine equipment gateway are configured with dual-polarized antennas, and the dual-polarized channel is formed between the dual-polarized antennas; determining an SINR on an uplink communication link of the delay-tolerant machine equipment based on the dual-polarized channel, the interference from the cellular user and the inter-cluster interference.

7. A polarization information processing-based resource allocation apparatus characterized by comprising: comprising: an initialization module configured to obtain prior information of H2H user equipment and delay-sensitive machine equipment in a heterogeneous network of human-machine-object hybrid access based on pre-allocated resource blocks, transmission power and polarization state information; a definition module configured to define a state set, an action selection set and a reward function for a delay-tolerant machine equipment based on the prior information; an exploration module configured to explore a maximum reward value of the delay-tolerant machine equipment based on the state set, the action selection set and the reward function using a greedy strategy; an allocation module configured to allocate resources for the delay-tolerant machine equipment based on the maximum reward value, wherein the resources include resource blocks, power and polarization state; wherein the exploration module is further configured to: in an exploration phase, the delay-tolerant machine equipment randomly selects resource blocks, polarization states and transmission power values in the action selection set, and obtains a reward value based on the selected resource blocks, polarization states and transmission power values; in a utilization phase, the delay-tolerant machine equipment determines a current strategy based on the state set, the action selection set and the reward function, and selects optimal resource blocks, polarization states and transmission power values in the action selection set based on the current strategy, and then obtains a reward value based on the selected optimal resource blocks, polarization states and transmission power values, until the maximum reward value is obtained; wherein the current policy is determined by: determining a SINR on an uplink communication link of the H2H user equipment based on resource blocks and transmit power of the H2H user equipment; determining a SINR on an uplink communication link of the latency-sensitive machine equipment based on resource blocks and transmit power of the latency-sensitive machine equipment; determining a SINR on an uplink communication link of the latency-tolerant machine equipment based on interference from cellular users and inter-cluster interference, wherein the inter-cluster interference is interference from different clusters of machine equipment sharing the same resource blocks; and determining the current policy for allocating resource blocks, power, and polarization states for the latency-tolerant machine equipment based on the SINR on the uplink communication link of the H2H user equipment, the SINR on the uplink communication link of the latency-sensitive machine equipment, and the SINR on the uplink communication link of the latency-tolerant machine equipment.

8. A heterogeneous network of human-machine hybrid access, comprising machine user equipment, H2H user equipment, machine device gateway and base station, the machine user equipment comprising time tolerant machine device and time sensitive machine device, characterized in that, The machine equipment gateway includes the apparatus of claim 7.

Images