A method for dynamically allocating time and / or frequency communication resources between a plurality of satellites in a non-terrestrial communication network, and a non-terrestrial communication network for implementing such a method.

Abstract

Method for dynamically allocating time and / or frequency communication resources between a plurality of satellites in a non-terrestrial communication network, and non-terrestrial communication network for implementing such a method. The present invention relates to a method for dynamically allocating time and / or frequency communication resources between a plurality of satellites (S1, S2, S3) in a non-terrestrial communication network (10), the method comprising the following iterative steps, implemented by each of the satellites (S1, S2, S3) over a predefined time slot horizon: - reception of data relating to user equipment contained in the geographical sub-zones (z1-1,...,z1-n1; z2-1,...,z2-n2 ; z3-1,…,z3-n3) of a geographical area (Z1, Z2, Z3) covered by said satellite; - transmission of said received data to at least one other satellite; - determination of a time and / or frequency communication resource allocation action for each satellite (S1, S2, S3), for said time slot horizon; - application of the time and / or frequency communication resource allocation action determined for said satellite (S1, S2, S3), for said time slot horizon. Figure for the abbreviation: Figure 1.

Description

Title of the invention: A method for dynamically allocating time and / or frequency communication resources between a plurality of satellites in a non-terrestrial communication network, and a non-terrestrial communication network for implementing such a method.

[0001] The present invention relates to a method for dynamically allocating time and / or frequency communication resources between a plurality of satellites in a non-terrestrial communication network. Preferably, the non-terrestrial communication network is a wireless network, for example, an LTE (Long Term Evolution) or 4G, 5G, or 6G cellular network, or a DVB-S / DVB-S2 / DVB-S2X network, or an ad-hoc network, without this being limiting within the scope of the present invention.

[0002] The present invention also relates to an associated non-terrestrial communication network, configured to implement the resource allocation method.

[0003] In the prior art, non-terrestrial communication networks comprising several satellites are known. Such satellites may, for example, be geostationary, multi-orbital, or low Earth orbit (LEO) satellites belonging to the same satellite constellation. Furthermore, each satellite can operate in a so-called "transparent" mode, in which the satellite acts as a repeater (and the base station is located on the ground segment), or a "regenerative" mode, with, for example, the protocol layers of a base station on the satellite (giving it a regenerative capacity function and allowing it to process data packets). Alternative implementations with intermediate operating modes involving a split (e.g., a protocol split) of the protocol layers between the satellite and the ground segment are also possible.

[0004] Each satellite covers a predefined geographic area (typically a geographic area on the Earth's surface), each geographic area covered by a satellite being subdivided into smaller geographic sub-areas (called "spots" or "beams"). The geographic areas covered by all the satellites together exhibit areas of overlap and areas of exclusive coverage. Such a configuration is schematically illustrated in [Fig. 1], where three satellites SI, S2, S3 are shown, each geographic area covered by a satellite SI, S2, S3 being referenced Z1, Z2, Z3; the geographic sub-areas being referenced z1-1,...,z1-n1; z2-1,...,z2-n2; z3-1,...,z3-n3; where n1, n2, respectively n3, designates the number of geographical sub-zones in the geographical zone Z1, Z2, respectively Z3. The overlap zones between satellites SI, S2, S3 and the exclusive coverage zones are clearly visible on this [Fig.1].

[0005] Each of the geographical sub-areas of a given geographical area contains a given number of user equipment, each user equipment typically being a radio node intended to establish communication with one of the satellites.

[0006] A problem that arises is then to carry out the allocation of time and / or frequency communication resources between the satellites in the non-terrestrial communication network. By "time and / or frequency communication resources" we mean for example resource blocks ("Resource Blocks" or RBs) for an OFDM, DFT-s-OFDM or other multiplexing techniques such as CDMA, FDMA / TDMA multiplexing, symbols, slots, subframes or radio frames, beam hopping sequences, transmission powers (which may be different between the different satellites and between the different geographical sub-areas covered by the same satellite, and which may vary over time), or even subcarriers or frequency bands, channels or associated frequency sub-bands.

[0007] Formally, a beam repointing sequence for a given satellite corresponds to the allocation, for each individual time slot within a given time horizon, of a set of geographic sub-areas assigned to that satellite during that time slot. However, the problem of optimizing a beam repointing sequence is inherently difficult even in a single-satellite context. Indeed, if two adjacent geographic sub-areas are allocated to the same satellite on the same carrier frequency or on neighboring carrier frequencies, co-channel or inter-channel interference is likely to occur, drastically degrading system performance.This problem is even more difficult in a multi-satellite context, as it is necessary to establish collaboration between the satellites in order to reduce the probabilities of collisions, in other words the probability of assigning the same geographical sub-area on the same or neighboring frequencies to two or more satellites, which would then generate a high level of interference.

[0008] More generally, the choice of each of the three aforementioned categories of temporal and / or frequency communication resources has an impact on the choice of the others. Indeed, if two adjacent geographical sub-zones are allocated during the same time slot, it is then desirable to reduce the transmission power in these geographical sub-zones, or to allocate frequencies different carriers to these two geographical sub-areas, in order to minimize the level of interference received.

[0009] The optimization of the allocation of these time and / or frequency communication resources aims to optimize the performance of the non-terrestrial network by adapting to the propagation conditions between satellites and user equipment within each geographical sub-area, as well as to the position of the user equipment and its traffic requirements. However, the resulting optimization problem is a combinatorial problem that is very difficult to solve using conventional optimization approaches.

[0010] To address the aforementioned problem of optimizing the allocation of time and / or frequency communication resources, known solutions consist of centralized or distributed approaches. In centralized approaches, the various satellites of the non-terrestrial communication network communicate their information to a central point (typically a ground-based communication gateway). This communication gateway calculates the resource allocation and transmits the decided allocation to the satellites. In contrast, in distributed approaches, the satellites themselves make decisions regarding their own resource allocation, with or without collaboration with the other satellites in the network.However, a major drawback of centralized solutions is the latency introduced by the transmission of information from each satellite to the central point, followed by the communication of this allocation to the satellites. This latency results in reduced system responsiveness to changing conditions, for example, in the event of significant mobility of user equipment within geographic sub-areas, or in the event of highly variable traffic demand from this user equipment. Furthermore, a major drawback of distributed solutions is that each satellite makes a local decision regarding its resource allocation and does not have access to the decisions of other satellites, which can lead to, for example, collisions in the beam repointing sequences chosen by the satellites.Thus, a convergence phase is required with several successive decision-making steps until a good configuration is reached (without, however, guaranteeing that there will be no collisions even once convergence is achieved).

[0011] As an example of a distributed approach solution, patent document CN 117856858 A describes a method for dynamically allocating time and / or frequency communication resources among a plurality of satellites in a non-terrestrial communication network. In this method, each satellite is an agent that makes a decision regarding its own resource allocation, without being able to know the decision made simultaneously by the other agents (i.e., by the other satellites). Each satellite has access to the observations of the others. satellites are used for decision-making. Thus, each satellite has access to a global observation of the environment for its decision-making. However, decision-making remains local, and therefore the resulting allocation of temporal and / or frequency communication resources is subject to interference. Each satellite is equipped with a computer system including a centrally trained neural network. The centralized training of the satellites' neural networks, combined with the use of a global state during resource allocation, aims to minimize the number of problematic situations and accelerate the convergence phase, without, however, overcoming all the limitations of distributed approaches.Indeed, a drawback of the dynamic resource allocation process described in this patent document lies in the fact that decision-making is carried out independently by each satellite, which can lead to allocations subject to significant interference.

[0012] The present invention aims to provide a method for the dynamic allocation of time-domain and / or frequency-domain communication resources among a plurality of satellites in a non-terrestrial communication network. This method solves the problem of resource allocation optimization with moderate computing power and maximized network performance, while overcoming the drawbacks of conventional centralized and distributed approaches. The present invention also aims to provide such a method for allocating all kinds of time-domain and / or frequency-domain communication resources. Furthermore, the present invention aims to provide such a method for solving the problem of communications required for decision-making.

[0013] To this end, the invention relates to a method for the dynamic allocation of temporal and / or frequency communication resources between a plurality of satellites in a non-terrestrial communication network, each satellite covering a predefined geographical area, each geographical area covered by a satellite being subdivided into smaller geographical sub-areas, each of said geographical sub-areas containing a given number of user devices, each user device being intended to establish communication with a satellite, the geographical areas covered by the plurality of satellites having overlapping areas and areas of exclusive coverage, each satellite being equipped with a computer system comprising a deep neural network trained by reinforcement learning,Each deep neural network receives as input the set of states of the different satellites of the non-terrestrial communication network at a current time, and is configured to provide as output an action allocating temporal and / or frequency communication resources for each of said satellites, the deep neural networks being, identical across all satellites in the non-terrestrial communication network, the process includes the following iterative steps, implemented by each satellite over a predefined time slot horizon:

[0014] - receiving data relating to user equipment contained in the sub- geographical areas of the geographical area covered by said satellite;

[0015] - sending said received data to at least one other satellite among the plurality of satellites of the non-terrestrial communication network;

[0016] - determination of an action for allocating communication resources temporal and / or frequency for each satellite of the plurality of satellites of the non-terrestrial communication network, for said time slot horizon;

[0017] - application of the temporal communication resource allocation action and / or frequency determined for said satellite, for said time slot horizon.

[0018] Thanks to the fact that each satellite has a deep neural network trained by reinforcement learning and implements all the steps of the process over a time slot horizon, each satellite is able to determine its own allocation action for time and / or frequency communication resources, as well as the actions of the other satellites, without the determined allocation actions causing collisions because the deep neural networks are identical across all satellites. Such an approach thus overcomes the drawbacks of conventional centralized and distributed approaches and can be described as semi-distributed. Consequently, such a semi-distributed approach makes it possible to solve the resource allocation optimization problem with moderate computing power and maximized network performance.

[0019] According to other advantageous aspects of the invention, the method comprises one or more of the following features, taken individually or in all technically possible combinations:

[0020] - each of the user devices is a radio node;

[0021] - during the data reception stage, the data relating to the equipment users contained in the geographical sub-areas of the geographical area covered by said satellite include data relating to a position of user equipment in each geographical sub-area and / or data relating to a communication need on the part of each user equipment and / or data relating to a loss by coupling in the downlink and / or uplink of each user equipment;

[0022] - during the data reception stage, the data relating to the equipment users contained in the geographical sub-areas of the geographical area covered by said satellite also include data relating to a signal-to-interference and noise ratio in the downlink and / or uplink of each user device, and / or data relating to the amount of energy remaining in said satellite;

[0023] - during the step of sending the received data, when the data relating to user equipment contained in the geographical sub-areas of the geographical area covered by said satellite includes data relating to a position of the user equipment in each geographical sub-area, said position data is sent in the form of a cumulative distribution function or in the form of a probability density function;

[0024] - when the data relating to user equipment contained in the sub- geographical areas of the geographical area covered by said satellite include data relating to a position of user equipment in each geographical sub-area, the step of sending said data is carried out by encoding, for each of the geographical sub-areas, the coordinates of each user equipment contained in said geographical sub-area on a predefined number of bits; or by subdividing each geographical sub-area into a set of geographical sub-regions and then sending, for each geographical sub-region of a given geographical sub-area, the number of user equipment contained in said geographical sub-region;

[0025] - the step of sending the received data consists of sending, for each sub-area geographical area of ​​the geographical area covered by the satellite, of at least one distribution function or at least one histogram of this data over a predefined number of points and over a predefined interval;

[0026] - when the data relating to user equipment contained in the sub- geographical areas of the geographical area covered by said satellite include data relating to downlink and / or uplink coupling loss of each user equipment, the step of sending said data is carried out by encoding, for each of the geographical sub-areas, the downlink and / or uplink coupling loss of each user equipment contained in said geographical sub-area on a predefined number of bits; or by sampling the downlink and / or uplink coupling loss values ​​of the user equipment contained in each geographical sub-area between a minimum coupling loss value and a maximum coupling loss value on said predefined number of points and then sending, for each geographical sub-area, said sampled values;

[0027] - during the step of sending the received data, said data is sent to all other satellites of the plurality of satellites of the non-terrestrial communication network in a general broadcast mode;

[0028] - during the step of sending the received data, said data is sent to a only other satellite of the plurality of satellites of the non-terrestrial communication network in an individual broadcast mode;

[0029] - said only one other satellite is a satellite that has not already received data relating to user equipment from another satellite, and the step of sending the received data includes a sub-step of aggregating said received data with data from another satellite and relating to user equipment covered by one or more other satellite(s);

[0030] - each deep neural network is configured as a neural network with ramifications of actions;

[0031] - each branch of the action branching neural network indicates, for a time slots of the horizon and for a given geographical sub-zone, a satellite allocated to user equipment in said geographical sub-zone as well as a transmission power to be used and / or a signal carrier frequency;

[0032] - the step of determining an action for allocating communication resources temporal and / or frequency for each satellite of the plurality of satellites of the non-terrestrial communication network further includes a sub-step of application, by the computer system, of a binary vector mask on all or part of the branches of the neural network with action ramifications;

[0033] - the computer system of each satellite further comprises a second network of deep neurons trained by reinforcement learning, the second deep neural network being configured as an encoder, the first action branching neural network being arranged at the output of said second neural network;

[0034] - said second deep neural network exhibits an equivariance property by permutation on its inputs;

[0035] - each deep neural network is further configured according to conditions distinct meteorological and / or atmospheric conditions, and / or based on distinct communication traffic profiles;

[0036] - the step of sending the received data is carried out according to a protocol of communication in accordance with the 4G / 5G standard, the data being sent in messages respecting an X2 / Xn and / or E-UTRAN / NG-RAN and / or Sl / NG and / or F1-AP / F1-C and / or FAPI / nFAPI communication interface of said 4G / 5G standard.

[0037] The invention also relates to a non-terrestrial communication network comprising a plurality of satellites, each satellite covering a geographical area predefined, each geographical area covered by a satellite being subdivided into smaller geographical sub-areas, each of said geographical sub-areas containing a predefined number of user devices, each user device being intended to establish communication with a satellite, the geographical areas covered by the plurality of satellites exhibiting overlapping areas and areas of exclusive coverage, each satellite being equipped with a computer system comprising a deep neural network trained by reinforcement learning, each deep neural network receiving as inputs all the states of the different satellites of the non-terrestrial communication network at a current time, and being configured to provide as output an action of allocating temporal and / or frequency communication resources for each of said satellites,The deep neural networks are identical across all satellites of the non-terrestrial communication network, in which each satellite is configured to implement the steps of the process as previously described.

[0038] According to another advantageous aspect of the invention, the computer system of each satellite has on the one hand a capacity to calculate a cumulative distribution function and / or a probability density function, and on the other hand a capacity to estimate loss by coupling and / or signal / interference ratio plus noise per user equipment and / or per beam or geographical sub-area.

[0039] The term "encoder" refers to a neural network configured to encode a set of input data into another set of features related to that input data and considered essential. The role of the encoder is to provide a certain representation of the data such that this representation is suitable for a predefined purpose.

[0040] The invention will become clearer upon reading the following description, given solely by way of non-limiting example, and made with reference to the drawings in which:

[0041] - Fig. 1 is a schematic view of a non-terrestrial communication network according to an example of an embodiment of the invention, the non-terrestrial communication network comprising several satellites;

[0042] - [Fig. 2] is a flowchart of a dynamic resource allocation process temporal and / or frequency communication, implemented by each satellite of the [Fig.1];

[0043] - [Fig. 3] is a view analogous to that of [Fig. 1], illustrating a first stage of the process of [Fig.2];

[0044] - [Fig.4] is a view analogous to that of [Fig.1], illustrating a second step of the process of [Fig.2];

[0045] - [Fig. 5] is a view analogous to that of [Fig. 1], illustrating a third stage of the process of [Fig.2];

[0046] - [Fig. 6] is a sequence diagram representing a process of communication implemented within the framework of the process according to the invention, the communication being carried out between three satellites and two entities, according to a first example of a communication protocol;

[0047] - [Fig.7] is a sequence diagram representing a process of communication implemented within the framework of the process according to the invention, communication being carried out between three satellites and two entities, according to a second example of a communication protocol; and

[0048] - [Fig.8] is a sequence diagram representing a process of communication implemented within the framework of the process according to the invention, the communication being carried out between two satellites and two entities, according to a third example of a communication protocol.

[0049] A non-terrestrial communication network 10 according to an embodiment of the invention is schematically illustrated in [Fig. 1]. The non-terrestrial communication network 10 is typically a wireless network, for example, an LTE (Long Term Evolution) or 4G, 5G, or 6G cellular network, or a DVB-S / DVB-S2 / DVB-S2X network, or an ad-hoc network, although this is not a limitation within the scope of the present invention. In the particular embodiment illustrated in [Fig. 1], the non-terrestrial communication network 10 is a multi-user network. In an alternative not shown, the non-terrestrial communication network 10 is a single-user network.

[0050] The non-terrestrial communication network 10 comprises several satellites SI, S2, S3, for example, three satellites SI, S2, S3 in the particular embodiment illustrated in [Fig. 1]. The non-terrestrial communication network 10 also comprises several user devices, not shown in [Fig. 1] for clarity. Each user device is intended to establish communication with one of the satellites SI, S2, S3 and is typically a radio node, although this last point is not limiting within the scope of the present invention. Alternatively, each user device could, for example, be a smartphone, a hands-free communication device, a connected object, or a terminal mounted on an aircraft or boat.The SI, S2, and S3 satellites of the non-terrestrial communication network 10 are, for example, geostationary, multi-orbital, or low Earth orbit (LEO) satellites belonging to the same satellite constellation. Furthermore, each SI, S2, or S3 satellite operates in either a "transparent" mode, in which it acts as a repeater (with an individual base station located on the ground segment), or a "regenerative" mode. with, for example, the protocol layers of the base station on the satellite (giving it a regenerative capacity function and allowing it to process data packets). According to a particular embodiment of the invention, at least one of the SI, S2, S3 satellites of the non-terrestrial communication network 10 is configured to operate in a master-slave communication mode with at least one third satellite, the latter not belonging to the constellation of SI, S2, S3 satellites configured in accordance with the present invention (which third satellite is not shown in [Fig. 1] for reasons of clarity).In other potential alternatives, the satellite configured as a master implements, for example, the upper layers of a base station (e.g., L2 / L3 or L3), and the CU (Central Unit) is located on the ground, and the satellite configured as a slave implements, for example, the lower layers of a base station (e.g., L1 or L1 / L2), where the distributed unit DU (Distributed Unit), or possibly the radio unit RU (Radio Unit), is located on the slave satellite in question.

[0051] Each SI, S2, S3 satellite, for example, is composed of a protocol stack called an eNB (for "enhanced Node B" in English, in the case of a base station conforming to the LTE communication standard) or a protocol stack called a gNB (for "next generation Node B" in English, in the case of a base station conforming to the 5G communication standard), or even a portion of a protocol stack resulting from a division of the protocol stack between lower and upper protocol layers. The base station can be distributed between one or more SI, S2, S3 satellites, or between an SI, S2, S3 satellite and the ground network.

[0052] Each satellite SI, S2, S3 covers a predefined geographic area Z1, Z2, Z3 (typically a geographic area on the Earth's surface), each geographic area covered by a satellite being subdivided into smaller geographic sub-areas z1-1,...,z1-n1; z2-1,...,z2-n2; z3-1,...,z3-n3; where n1, n2, and n3 respectively denote the number of geographic sub-areas in the geographic area Z1, Z2, and Z3 respectively. As can be seen in [Fig. 1], the geographic areas Z1, Z2, and Z3 covered by all the satellites SI, S2, and S3 exhibit areas of overlap and areas of exclusive coverage. Each of the geographic sub-areas z1-1,...,z1-n1; z2-1,...,z2-n2; z3-l,...,z3-n3 contains a given number of user devices (this number of user devices may differ from one geographical sub-zone to another).Each of the SI, S2, and S3 satellites is configured either to communicate with all other SI, S2, and S3 satellites in network 10 using a general broadcast mode (also called "broadcast" in English); or with only one other SI, S2, or S3 satellite in network 10 using an individual broadcast mode (also called "unicast" in English). In this... In the last scenario, each of the satellites SI, S2, S3 is, for example, equipped with a directional antenna.

[0053] Each satellite SI, S2, S3 is equipped with a computer system, which is not shown in [Fig. 1] for clarity. The computer system of each satellite SI, S2, S3 includes a deep neural network (not visible in [Fig. 1]) that is pre-trained using reinforcement learning. The deep neural networks are identical across all satellites SI, S2, S3 of the non-terrestrial communication network 10. "Deep neural network reinforcement learning" refers to a subfield of machine learning that involves performing reinforcement learning on a deep neural network architecture ("deep reinforcement learning"). Reinforcement learning makes it possible to approach an optimal policy within the framework of Markovian decision processes.

[0054] Each deep neural network receives as input the set of states of the different satellites SI, S2, S3 of the non-terrestrial communication network 10 at a given time, and is configured to provide as output an action allocating temporal and / or frequency-domain communication resources for each of the satellites SI, S2, S3. According to a particular embodiment, each deep neural network is configured as an action-branching neural network, as will be detailed later. Preferably, according to this particular embodiment, the computer system of each satellite SI, S2, S3 is configured to apply a binary vector mask to all or part of the branches of the action-branching neural network that is stored in this computer system.The binary vector mask is chosen such that a zero probability is assigned to an output of the deep neural network when this output corresponds to a predetermined invalid action. The use of such a binary vector mask ensures minimal protection (against the risk of interference) between adjacent geographical sub-areas z1-1,...,zl-n1; z2-1,...,z2-n2; z3-1,...,z3-n3, as well as guaranteeing compliance with desired constraints, for example a maximum transmission power and / or a minimum separation between two geographical sub-areas served on the same carrier frequency.

[0055] According to a preferred embodiment of the invention, the computer system of each satellite SI, S2, S3 further comprises a second deep neural network (not visible in [Fig. 1]) which is pre-trained by reinforcement learning. Each second deep neural network of a satellite SI, S2, S3 is configured as an encoder and is arranged as input to the first deep branching neural network (described previously) which is stored in The computer system of this satellite SI, S2, S3. Preferably, each second deep neural network exhibits a permutation equivariance property on its inputs. A "permutation equivariance property" is understood to mean that for any permutation of the inputs of the second neural network, the output of that second neural network undergoes the same permutation. Such a permutation equivariance property advantageously accelerates the training of deep neural networks and improves the generalizability of the dynamic allocation method according to the invention. Even more preferably, and without limiting the scope of the present invention, each second deep neural network is an encoder-only transformer network (also called an "Encoder Only Transformer"), without positional coding.By "transformer neural network without positional coding" we mean any neural network developed according to a self-attentive model that can take an arbitrary number of links, possesses the property of equivariance under permutation and is equipped with an attention mechanism.

[0056] Each of the first and second neural networks is a deep neural network trained by reinforcement learning which comprises an ordered succession of layers of neurons, each of which takes its inputs from the outputs of the previous layer.

[0057] More precisely, each layer comprises neurons taking their inputs from the outputs of the neurons of the previous layer, or from the input variables for the first layer.

[0058] Alternatively, more complex neural network structures can be envisaged with a layer that can be linked to a layer further away than the immediately preceding layer.

[0059] Each neuron is also associated with an operation, that is to say a type of processing, to be carried out by said neuron within the corresponding processing layer.

[0060] The first neural network is typically an encoder, preferably an encoder-only type transformer neural network (also called "Encoder Only Transformer" in English).

[0061] Preferably, each first and / or second deep neural network is configured according to distinct weather and / or atmospheric conditions (such as, for example, "good," "degraded," and "very degraded"), and / or according to distinct communication traffic profiles (such as, for example, "morning," "afternoon," and "night"). This makes it possible to reduce the variability range of the neural networks, resulting in "specialized" neural networks with better performance in each regime considered. Indeed, it is known that The larger the range of variability in the inputs of a neural network, the more challenging the learning and generalization processes become. It is also known that the communication needs of user equipment vary and depend particularly on the time of day. Therefore, by configuring each first and / or second deep neural network in this way, training the neural networks is advantageously facilitated, and the generalization capability of the dynamic allocation method according to the invention is improved.

[0062] Regarding the training of deep neural networks, this can, for example, be carried out offline, either on data from simulations or on databases collected via already deployed satellite constellations. Each neural network is typically trained using a deep reinforcement learning algorithm such as, for example, the "soft actor critic" algorithm.

[0063] The training process is as follows. The algorithm decides on an allocation of time and / or frequency communication resources for the duration of an allocation horizon. Performance metrics are measured at the end of this horizon (for example, a metric indicating the total number of user devices whose communication needs have been correctly met, or a percentage of satisfaction for each user device). Based on this reward, the training algorithm improves the neural network until convergence is reached.

[0064] Time and / or frequency communication resources may, for example, correspond to beam repointing sequences, and / or to transmission powers (which may be different between the different SI, S2, S3 satellites and between the different geographical sub-zones zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3 covered by the same SI, S2, S3 satellite, and which may vary over time), and / or to carrier frequencies (allocated by SI, S2, S3 satellite and / or by geographical sub-zone zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3).

[0065] The dynamic allocation process for time and / or frequency communication resources between the satellites SI, S2, and S3 in the non-terrestrial communication network 10, implemented by each of the satellites SI, S2, and S3, will henceforth be explained with reference to [Fig. 2], which presents a flowchart of its steps, as well as with reference to Figures 3 to 5. For the remainder of this document, it is assumed that time is divided into time slots of the same predefined duration, and that the allocation of time and / or frequency communication resources is carried out over a predefined horizon of kl time slots. The choice of the factor kl results from a compromise: a small value of kl allows for greater responsiveness of the system to different conditions in terms of the position of the satellites SI, S2, and S3, user equipment, etc. but also generates a greater recurrence in the need for information exchange between the SI, S2, S3 satellites.

[0066] The method comprises an iterative phase 20 executed by each of the satellites SI, S2, S3, for each horizon of kl time slots. For clarity, only the steps performed by satellite SI will be detailed hereafter, bearing in mind that the other satellites S2, S3 implement the same steps in a similar and simultaneous manner.

[0067] During an initial step 22 (illustrated in [Fig. 3]) of the iterative phase 20, the satellite SI receives data relating to user equipment contained in the geographical sub-areas zl-l,...,zl-nl of the geographical area ZI that it covers. According to a particular embodiment of the invention, such data includes at least data relating to the position of user equipment in each geographical sub-area zl-l,...,zl-nl and / or data relating to a communication requirement on the part of each user equipment and / or data relating to a downlink and / or uplink coupling loss of each user equipment.Preferably, according to this same particular embodiment, such data further includes downlink and / or uplink signal-to-interference plus noise ratio data for each user device, and / or data on the amount of power remaining at the SL satellite. Knowledge by the SI satellite of the user device positions is important because a given user device will not experience the same level of interference from an adjacent geographic sub-area depending on its position within its own geographic sub-area. Communication requirements are crucial for planning beam repointing sequences (it will be necessary to serve a geographic sub-area more frequently if the user devices have high communication needs).Knowledge of coupling loss and / or the signal-to-noise ratio is also important to determine the level of interference a user device can tolerate, and thus optimize transmission power and beam repointing sequences. When user device data includes information about each device's communication requirements, this information may include Scheduling Requests or Buffer Status Reports. The SI satellite's knowledge of its remaining power is also important, as it determines the number of geographic sub-areas (zl-l, ..., zl-nl) it can effectively serve.

[0068] At the end of this initial step 22, the SI satellite is able to determine the number of user devices contained in each geographical sub-zone zl-l,...,zl-nl of the ZI zone which it covers.

[0069] In a subsequent step 24 (illustrated in [Fig. 4]) of the iterative phase 20, satellite SI sends the data received during the preceding step 22 to at least one other satellite S2, S3. In the embodiment illustrated in [Fig. 4], satellite SI sends the data received during the preceding step 22 to each of the other satellites S2, S3, in a general broadcast mode. In an alternative (not shown), satellite SI sends the data received during the preceding step 22 to one of the other satellites, for example satellite S2, in an individual broadcast mode.Satellite S2 sends to satellite S3 the aggregation composed of the data received from satellite SI and its own data collected during the previous step 22, and satellite S3 sends to satellite SI the aggregation composed of the data received from satellite S2 (minus the data relating to satellite SI) and its own data collected during the previous step 22. Finally, also during this step 24, satellite SI sends to satellite S2 the data collected by satellite S3 during the previous step 22. Such a communication protocol thus makes it possible to advantageously reduce the number of inter-satellite communications required (to a number of 2N1-2 communications, where NI is the number of satellites in the network 10, in this case three satellites in the particular embodiment example of figures 1 to 5), and therefore the associated latency time.

[0070] During this step 24, when the data relating to user equipment contained in the geographical sub-areas zl-l,...,zl-nl include data relating to the position of user equipment in each geographical sub-area zl-l,...,zl-nl, the position data is preferably sent by the SI satellite in the form of a cumulative distribution function or in the form of a probability density function. More specifically, according to this use case, step 24 of sending the position data is carried out by encoding, for each of the geographical sub-areas zl-l,...,zl-nl, the coordinates of each user equipment contained in the geographical sub-area zl-l,...,zl-nl in question on a predefined number of bits; or by subdividing each geographical sub-area zl-l,...,zl-nl into a set of geographic sub-regions (not shown in the figures for clarity) and then sending, for each geographic sub-region of a given geographic sub-zone zl-l,...,zl-nl, the number of user devices contained in that geographic sub-region. Advantageously, the SI satellite calculates the number of bits required for each of the two aforementioned data transmission procedures (encoding or subdivision). Then, based on the number of bits calculated, it selects the procedure that requires the fewest bits. This calculation can be repeated at each new iteration of phase 20, thus allowing dynamic switching between the two procedures to continuously minimize the amount of signaling required. Indeed, the amount of signaling to be exchanged between the SI, S2, and S3 satellites is potentially high (especially when numerous user devices are present in the geographical sub-areas), which justifies minimizing the amount of data transmitted. It should be noted that an additional bit can be added during transmission to indicate to the receiving satellite which transmission procedure was used.Such a cumulative distribution function or probability density function allows us to indicate statistical information concerning the behavior of users within the geographical sub-areas zl-l,...,zl-nl. .

[0071] During this same step 24, the data are preferably sent by the SI satellite, for each geographical sub-area zl-l,...,zl-nl of the geographical area Zl, in the form of at least one distribution function or at least one histogram of this data over a predefined number of points and a predefined interval, particularly when the data include data relating to a communication requirement on the part of each user device and / or data relating to a loss due to downlink and / or uplink coupling of each user device. More specifically, when the data relating to the user devices contained in the geographical sub-areas zl-l,...The zl-nl sub-areas include data relating to downlink and / or uplink coupling loss for each user device. Step 24, the transmission of coupling loss data, is performed by encoding, for each of the zl-l,...,zl-nl geographic sub-areas, the downlink and / or uplink coupling loss of each user device within that sub-area using a predefined number of bits; or by sampling the downlink and / or uplink coupling loss values ​​of the user devices within each zl-l,...,zl-nl geographic sub-area between a minimum and maximum coupling loss value at a predefined number of points, and then sending the sampled values ​​for each zl-l,...,zl-nl geographic sub-area. Sampling can be performed regularly or irregularly.Advantageously, the S1 satellite calculates the number of bits required for each of the two aforementioned data transmission procedures (encoding or sampling), and then, based on the number of bits calculated, selects the procedure that requires the fewest bits. This calculation can be repeated at each new iteration of phase 20, thus allowing dynamic switching between the two procedures for continuous searching. to minimize the amount of signaling required. Note that an additional bit may be added during transmission to indicate to the receiving satellite which transmission procedure was used.

[0072] According to a preferred embodiment of the invention, this step 24 of sending the received data is carried out according to a communication protocol conforming to the 4G / 5G standard, the data being sent in messages respecting an X2 / Xn communication interface and / or and / or E-UTRAN / NG-RAN and / or Sl / NG and / or F1-AP / F1-C (for the 3GPP 4G / 5G standard) and / or FAPI / nFAPI (for the non-3GPP 4G / 5G standard). In the case of the 4G or 5G standard, each deep neural network can be trained in one or more entity(ies) called CMNF / LMF / e-SMLC (from the English "Coverage Management Network Function" for CMNF and "Location Management Function" for LMF in 5G, and "enhanced Serving Mobile Location Center" for e-SMLC in 4G), which knows the constellations and is able to determine the positions of the satellites at different times.Thus, this entity (or entities) CMNF / LMF / e-SMLC perform(s) a plurality of training exercises, corresponding to all possible configurations regarding the ground coverage of the different satellites. When the transmission step 24 is carried out according to a communication protocol conforming to the 4G / 5G standard, with the data being sent in messages respecting an X2 / Xn communication interface of the 4G / 5G standard, the satellites SI, S2, S3 exchange information concerning their respective geographical sub-zones zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3, via Xn / X2 messages. For example, the SI, S2, and S3 satellites send a request to an entity called AMF / MME (Access and Mobility Management Function in 5G, or Mobility Management Entity in LTE) to obtain the weights of the trained neural network. The AMF / MME then sends a request to the CMNF / LMF / e-SMLC entity regarding these weights.This assumes that the CMNF / LMF / e-SMLC entity is able to determine the position of the satellites at each instant, and therefore can determine the appropriate weights. When the data transmitted by the SI, S2, S3 satellites is in the form of a cumulative distribution function (CDF or "Cumulative Distributed Function") or in the form of a probability density function (PDF or "Probability Density Function"), such a transmitted function is, for example, defined on a predefined number of points (not everything is transmitted, the CMNF / LMF / e-SMLC entity being configured to interpolate the missing points in order to recover the exact curve).The computer system of each satellite SI, S2, S3 has on the one hand a capacity to calculate a cumulative distribution function and / or a probability density function, and on the other hand a capacity to estimate loss by coupling and / or signal / interference ratio plus noise per user equipment and / or by. beam or geographical sub-zone zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3. In addition, the predefined number of points can be indicated in the request sent by the SI, S2, S3 satellites to the AMF / MME entity. Xn / X2 messages between two satellites can be REQUEST type messages (for example, containing requests or inquiries about information such as the number of user equipment and / or a cumulative distribution function as a function of coupling loss, and / or a cumulative distribution function as a function of a signal / interference plus noise ratio, and / or a cumulative distribution function as a function of a Buffer Status Report (BSR), and / or a cumulative distribution function as a function of a Scheduling Request (SR), and / or a probability density function per beam or geographic sub-area,downlink and / or uplink, for the Sx satellite) or RESPONSE type messages (for example, containing values ​​for parameters such as the number of user devices and / or a cumulative distribution function as a function of coupling loss, and / or a cumulative distribution function as a function of a signal-to-interference plus-noise ratio, and / or a cumulative distribution function as a function of a BSR buffer state ratio, and / or a cumulative distribution function as a function of an SR scheduling request, and / or a probability density function per beam or geographic sub-area, downlink and / or uplink, for the Sx satellite).

[0073] In a first potential alternative illustrated in [Fig. 6], the NG-RAN / E-UTRAN NG / S1 interface, referenced II, can carry / assist in the transfer between the SI, S2, and S3 satellites on the one hand and the AMF / MME entity on the other hand of a neural model 30 (which corresponds to the concatenation of the first and second deep neural networks) trained on the ground on one of the entities external or internal to the core network. In this example, the AMF / MME entity queries the CMNF / LMF / e-SMLC entity in a REQUEST type message 32 for an information request such as, for example, the transfer of a neural model 30 trained on the ground on one of the entities external or internal to the core network, and receives a response in a RESPONSE type message 34 with the corresponding values ​​for the neural model 30 trained on the ground on one of the entities external or internal to the core network.Potentially, following the reception of a REQUEST 44 type message (for example containing requests or queries on information) e.g. between satellites SI and S2 and / or SI and S3, satellites S2 and S3 respond with a RESPONSE 45 message (for example containing the values ​​for parameters) to satellite SI and satellite SI applies the configuration calculated using the neural model 30.

[0074] In a second potential alternative illustrated in [Fig.7], the NG-RAN / E-UTRAN NG / S1 interface, referenced II, can carry / assist in the transfer between the SI, S2, S3 satellites on the one hand and the AMF / MME entity on the other hand information such as, for example, a satellite GNSS position / satellite ephemeris / satellite coverage / satellite energy constraint calculated on one of the entities external or internal to the core network. In this example, the AMF / MME entity queries the CMNF / LMF / e-SMLC entity in a REQUEST type message 36 for a request for information of the type, for example, a satellite GNSS position / satellite ephemeris / satellite coverage / satellite energy constraint and receives a response in a RESPONSE type message 38 with the corresponding values ​​for a satellite GNSS position / satellite ephemeris / satellite coverage / satellite energy constraint of the SI, S2 satellites.Potentially, following the reception of a REQUEST 46 type message (for example, containing queries or inquiries about information such as the number of user devices and / or a cumulative distribution function as a function of coupling loss, and / or a cumulative distribution function as a function of a signal-to-interference plus-noise ratio, and / or a cumulative distribution function as a function of a Buffer Status Report (BSR), and / or a cumulative distribution function as a function of a Scheduling Request (SR), and / or a probability density function per beam or geographic sub-area, downlink and / or uplink), e.g.between satellites SI and S2, SI and S3, satellites S2 and S3 respond with a RESPONSE 47 message (for example containing values ​​for parameters such as the number of user equipment and / or a cumulative distribution function as a function of a coupling loss, and / or a cumulative distribution function as a function of a signal / interference plus noise ratio, and / or a cumulative distribution function as a function of a BSR buffer state ratio, and / or a cumulative distribution function as a function of an SR scheduling request, and / or a probability density function per beam or geographic sub-area, downlink and / or uplink) to satellite SI and satellite SI applies the configuration calculated using neural model 30.

[0075] In a third potential alternative illustrated in [Fig. 8], instead of a REQUEST / RESPONSE type message, one of the satellites, for example satellite SI (which in this example implements a master function), can directly configure (via an interface of type e.g. Xn / X2, Fl-AP, Fl-C, FAPI, nFAPI, or similar) a third satellite S4 (which in this example implements a slave function) for beam repointing of the third satellite S4 and / or the distributed unit DU or the unit The third-party satellite S4 radio RU receives the necessary resource allocation / power per beam. Following receipt of configuration message 40, the third-party satellite S4 applies the configuration sent by the SI satellite and responds with a configuration confirmation message 42.

[0076] Generally, once one of the satellites SI, S2, S3 applies the neural model 30, that satellite SI, S2, S3 can determine the configuration for all the other satellites SI, S2, S3 of the non-terrestrial communication network 10 in uplink and downlink and with respect to, for example, the power applied per beam, the frequency band, the resource allocation per beam for each satellite SI, S2, S3. Depending on the result, the satellite SI, S2, S3 configures the beam repointing procedure as well as the resource allocation strategy according to the neural model 30 trained by the CMNF / LMF / e-SMLC entity.

[0077] At the end of this step 24, the satellite SI has a perception (common to the other satellites S2, S3) of the environment relating to all the satellites SI, S2, S3 of the non-terrestrial communication network 10. In other words, at the end of step 24, the satellite SI (as well as each of the other satellites S2, S3) knows the respective states of all the satellites SI, S2, S3.

[0078] In a subsequent step 26 of the iterative phase 20, the computer system of satellite SI determines, for each of the satellites SI, S2, S3, an action for allocating temporal and / or frequency-domain communication resources for that satellite SI, S2, S3, for the current horizon of kl time slots. It is assumed that the computer system of satellite SI has an encoded version of its perceived state, so that each satellite SI, S2, S3 has an absolutely identical state space. During this step 26, satellite SI provides, as input to the neural network stored in its computer system, the aggregation of the states of all the satellites SI, S2, S3, more precisely, an encoded version of these states where applicable.The neural network then outputs an action for allocating time and / or frequency communication resources to satellite SI, as well as to each of the other satellites S2, S3, for the current horizon of kl time slots. Preferably, when the neural network is a branching action neural network, each branch of the branching action neural network indicates, for one of the kl time slots of the horizon and for a given geographic sub-zone zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3, a satellite SI, S2, S3 assigned to the user equipment in that geographic sub-zone zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3, as well as a transmission power to be used and / or a signal carrier frequency. This ensures that a given geographical sub-zone zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3 is allocated to a single satellite SI, S2, S3.Such an architecture through "action branching". (in English) consists of dividing the choice of a very large-dimensional combinatorial action into smaller-dimensional sub-actions. Various possibilities can be considered for dividing the overall action into sub-actions. According to a particular embodiment of the invention, kl.N2 branches are formed for the neural network, where N2 is the total number of geographic sub-areas zl-1,...,zl-nl; z2-1,...,z2-n2; z3-1,...,z3-n3. Thus, the dimension of the action space of each branch is N3.N4 (where N3 is the number of discrete values ​​that the emission power of each geographic sub-area can take and N4 is the number of different carrier frequencies), which advantageously reduces the dimension of the total action space. Furthermore, this procedure allows for the natural management of collisions since, by design of the architecture, a given geographical sub-zone zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3 is associated with a single satellite SI, S2, S3. .

[0079] Preferably, this determination step 26 includes a substep 262 in which the computer system applies a binary vector mask to all or part of the branches of the action-branching neural network. To this end, the determination step 26 also includes an intermediate substep 261 for vectorizing the outputs of the neural network. Applying a binary vector mask means prohibiting certain actions on a given branch of the action-branching neural network. Thus, the binary vector mask on the i-th branch corresponds to the invalid actions for the choice relating to the i-th time and / or frequency communication resource, and depends on the actions decided for the (il)th branches. For example, assuming that we wish to apply a maximum transmission power constraint to each time slot and for each satellite S1, S2, S3.If the decisions taken on the first (il)th branches lead to a satellite SI, S2, S3 saturating this constraint, then it is possible to apply a binary vector mask to the following branches in order to no longer assign geographical sub-zones zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3 to this satellite SI, S2, S3 to ensure compliance with the constraint.

[0080] In a subsequent step 28 (illustrated in [Fig. 5]) of the iterative phase 20, the satellite SI applies the time and / or frequency communication resource allocation action that it has just determined for itself in the preceding step 26, for the current horizon of kl time slots. At the end of step 28, step 22 is repeated for a new horizon of kl time slots.

[0081] It is therefore conceivable that the dynamic allocation method of temporal and / or frequency communication resources according to the invention presents a number of advantages.

[0082] It effectively solves the resource allocation optimization problem with moderate computing power and maximized network performance, while mitigating the drawbacks of conventional centralized and distributed approaches. Each satellite is able to determine its own allocation action for time and / or frequency communication resources, as well as the actions of other satellites, without the determined allocation actions causing collisions because the deep neural networks are identical across all satellites. Such an approach thus overcomes the drawbacks of conventional centralized and distributed approaches and can be described as semi-distributed.The method according to the invention also makes it possible to allocate all kinds of time and / or frequency communication resources, as well as to solve the problem of communications required for decision-making. Furthermore, it facilitates signal transmission between satellites, thereby minimizing the amount of data transmitted.

[0083] In other alternatives, SI, S2, S3 are satellites that operate in regenerative mode and / or satellites that operate in transparent mode. X2(LTE) / Xn(5G) messages or other evolution between satellites (or SANs for "Satellite Access Nodes") may be similar to TS 36.423 / TS 38.423 messages such as X2 / Xn "SETUP REQUEST" followed by X2 / Xn "SETUP RESPONSE", xNB "CONFIGURATION UPDATE" / xNB "CONFIGURATION UPDATE ACKNOWLEDGE / FAILURE", "MOBILITY CHANGE REQUEST" followed by "MOBILITY CHANGE ACKNOWLEDGE / FAILURE", "HANDOVER REQUEST" followed by "HANDOVER ACKNOWLEDGE / FAILURE / HANDOVER SUCCESS" or similar, "EARLY STATUS TRANSFER" or "UE Context Information IE". Messages between satellites (or SANs for "Satellite Access Nodes" in English) and MME / AMF (i.e., eNB-MME or gNB-AMF interfaces) can be protocols or similar messages such as S1-C / S1-AP (TS 36.413, for LTE), N2 / NGAP (TS 38.413 for 5G), such as Sl / NG “SETUP REQUEST” followed by Sl / NG “SETUP RESPONSE”, MME / AMF “CONFIGURATION UPDATE” followed by MME / AMF “CONFIGURATION UPDATE ACKNOWLEDGE”, ENB / RAN “CONFIGURATION UPDATE” followed by ENB / RAN “CONFIGURATION UPDATE ACKNOWLEDGE”, “(INITIAL) CONTEXT SETUP REQUEST” followed by “(INITIAL) CONTEXT SETUP RESPONSE”, “Connection Setup”, “Context Management” (of type “Setup / Modification / Release”), “Mobility Information”, Downlink / Uplink eNB / RAN / MME / AMF “Status / Configuration Transfer”.

[0084] In another alternative, once the cumulative distribution function CDF and the probability density function PDF are calculated, the transmission takes place over N points in a compressed manner to reduce the data rate required for transmission (i.e., the CMNF / LMF / e-SMLC entity and / or other satellites SI, S2, S3 could interpolate the N values ​​to recover the exact curve). To facilitate this task, the number of points N that the satellite will use to make the response "RESPONSE" (e.g., from satellite Sy to satellite Sx) can also be added to the "REQUEST" message (e.g., from satellite Sx to satellite Sy).

[0085] This description is applicable for satellite-only access networks or satellite and terrestrial access networks or for a satellite and terrestrial mesh in FDD and / or TDD transmission mode, for downlink or uplink access / resource allocation procedures or both, for NGSO & GSO multi-orbit solutions: U AV & HAPS, VLEO, LEO, MEO, GEO, etc.

[0086] Although the present invention has been described with reference to a non-terrestrial communication network 10 comprising three satellites SI, S2, S3, it is understood that it applies in the same way to any non-terrestrial communication network comprising a number of satellites greater than or equal to two, and different from three.

Claims

1. Demands A method for dynamically allocating time and / or frequency communication resources between a plurality of satellites (SI, S2, S3) in a non-terrestrial communication network (10), each satellite (SI, S2, S3) covering a predefined geographical area (Z1, Z2, Z3), each geographical area (Z1, Z2, Z3) covered by a satellite (SI, S2, S3) being subdivided into smaller geographical sub-areas (z1-1,...,z1-n1; z2-1,...,z2-n2; z3-1,...,z3-n3), each of said geographical sub-areas (z1-1,...,z1-n1; z2-1,...,z2-n2; z3-1,...,z3-n3), each of said geographical sub-areas (z1-1,...,z1-n1; z2-1,...,z2-n2; z3-1,...,z3-n3) containing a given number of user devices, each user device being intended to establish communication with a satellite (SI, S2, S3), the geographical areas (Z1, Z2, Z3) covered by the plurality of satellites (SI, S2, S3) exhibiting overlapping zones and exclusive coverage zones, each satellite (SI, S2,S3) being equipped with a computer system comprising a deep neural network trained by reinforcement learning, each deep neural network receiving as inputs the set of states of the different satellites (SI, S2, S3) of the non-terrestrial communication network (10) at a current time, and being configured to provide as output an action of allocating temporal and / or frequency communication resources for each of said satellites (SI, S2, S3), the deep neural networks being identical in all the satellites (SI, S2, S3) of the non-terrestrial communication network (10), the process comprising the following iterative steps, implemented by each of the satellites (SI, S2, S3) over a predefined time slot horizon:, - reception (22) of data relating to user equipment contained in the geographical sub-areas (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3) of the geographical area (Zl, Z2, Z3) covered by said satellite (SI, S2, S3); - sending (24) said received data to at least one other satellite (SI, S2, S3) among the plurality of satellites (SI, S2, S3) of the non-terrestrial communication network (10); - determination (26) of an action for allocating temporal and / or frequency communication resources for each satellite (SI, S2, S3) of the plurality of satellites (SI, S2, S3) of the non-terrestrial communication network (10), for said time slot horizon; - application (28) of the time and / or frequency communication resource allocation action determined for said satellite (SI, S2, S3), for said time slot horizon.

2. A method for dynamically allocating time and / or frequency communication resources according to claim 1, wherein each of the user equipment is a radio node.

3. A method for dynamically allocating time and / or frequency communication resources according to claim 1 or 2, wherein during the data reception step (22), the data relating to user equipment contained in the geographical sub-areas (zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3) of the geographical area (Zl, Z2, Z3) covered by said satellite (SI, S2, S3) include data relating to a position of the user equipment in each geographical sub-area (zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3) and / or data relating to a communication requirement on the part of each user equipment and / or data relating to a loss by downlink and / or uplink coupling of each user equipment.

4. A method for dynamically allocating time and / or frequency communication resources according to claim 3, wherein during the data reception step (22), the data relating to user equipment contained in the geographical sub-areas (zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3) of the geographical area (Zl, Z2, Z3) covered by said satellite (SI, S2, S3) further include data relating to a signal-to-interference and noise ratio in the downlink and / or uplink of each user equipment, and / or data relating to the amount of energy remaining in said satellite (SI, S2, S3).

5. A method for dynamically allocating time and / or frequency communication resources according to claim 3 or 4, wherein, during step (24) of sending received data, when the data relating to user equipment contained in the geographical sub-areas (zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3) of the geographical area (Zl, Z2, Z3) covered by said satellite (SI, S2, S3) include data relating to a position of user equipment in each geographical sub-zone (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3), said position data is sent in the form of a cumulative distribution function or in the form of a probability density function.

6. A method for dynamically allocating time and / or frequency communication resources according to any one of claims 3 to 5, wherein, during the step (24) of sending the received data, when the data relating to the user equipment contained in the geographical sub-areas (zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3) of the geographical area (Zl, Z2, Z3) covered by said satellite (SI, S2, S3) includes data relating to a position of the user equipment in each geographical sub-area (zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3), the step (24) of sending said data is carried out by encoding, for each of the geographical sub-areas (zl-l,...,zl-nl; z2-l,...,z2-n2 ; z3-l,...,z3-n3), the coordinates of each user device contained in said geographical sub-zone (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3) on a predefined number of bits; or by subdividing each geographic sub-area (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3) into a set of geographic sub-regions and then sending, for each geographic sub-region of a given geographic sub-area (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3), the number of user devices contained in said geographic sub-region.

7. A method for dynamically allocating time and / or frequency communication resources according to any one of claims 1 to 4, wherein the step (24) of sending the received data consists of sending, for each geographical sub-area (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3) of the geographical area (Zl, Z2, Z3) covered by the satellite (SI, S2, S3), at least one distribution function or at least one histogram of this data over a predefined number of points and over a predefined interval.

8. A method for dynamically allocating time and / or frequency communication resources according to claim 7 when it depends on claim 3, wherein, when the data relating to user equipment contained in the sub-areas geographical (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3) of the geographical area (Zl, Z2, Z3) covered by said satellite (SI, S2, S3) include data relating to a downlink and / or uplink coupling loss of each user equipment, step (24) of sending said data is carried out by encoding, for each of the geographical sub-areas (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3), the downlink and / or uplink coupling loss of each user equipment contained in said geographical sub-area (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3) on a predefined number of bits; or by sampling the loss values ​​by downlink and / or uplink coupling of user equipment contained in each geographical sub-zone (zl-l,...,zl-nl; z2-l,...,z2-n2; z3-l,...,z3-n3) between a minimum loss per coupling value and a maximum loss per coupling value on said predefined number of points and then sending, for each geographical sub-zone (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3), said sampled values.

9. Method for dynamically allocating time and / or frequency communication resources according to any one of claims 1 to 8, wherein, during the step (24) of sending the received data, said data is sent to all other satellites (SI, S2, S3) of the plurality of satellites (SI, S2, S3) of the non-terrestrial communication network (10) in a general broadcast mode.

10. A method for dynamically allocating time and / or frequency communication resources according to any one of claims 1 to 8, wherein, during the step (24) of sending the received data, said data is sent to only one other satellite of the plurality of satellites (SI, S2, S3) of the non-terrestrial communication network (10) in an individual broadcast mode.

11. A method for dynamically allocating time and / or frequency communication resources according to claim 10, wherein said only one other satellite is a satellite that has not already received data relating to user equipment from another satellite, and wherein the step (24) of sending the received data includes a substep of aggregating said received data to data from another satellite relating to user equipment covered by one or more other satellite(s).

12. A method for dynamically allocating temporal and / or frequency communication resources according to any one of claims 1 to 11, wherein each deep neural network is configured as an action branching neural network.

13. A method for dynamically allocating temporal and / or frequency communication resources according to claim 12, wherein each branch of the action branching neural network indicates, for one of the time slots of the horizon and for a given geographical sub-zone (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3), a satellite (SI, S2, S3) allocated to the user equipment of said geographical sub-zone (zl-l,...,zl-nl ; z2-l,...,z2-n2 ; z3-l,...,z3-n3) as well as a transmission power to be used and / or a signal carrier frequency.

14. Method for dynamic allocation of time and / or frequency communication resources according to claim 12 or 13, wherein the step (26) of determining an action for allocating time and / or frequency communication resources for each satellite (SI, S2, S3) of the plurality of satellites (SI, S2, S3) of the non-terrestrial communication network (10) further comprises a substep (262) of applying, by the computer system (16), a binary vector mask on all or part of the branches of the action branching neural network.

15. A method for dynamically allocating time and / or frequency communication resources according to any one of claims 12 to 14, wherein the computer system of each satellite (SI, S2, S3) further comprises a second deep neural network trained by reinforcement learning, the second deep neural network being configured as an encoder, the first action branching neural network being arranged as the output of said second neural network.

16. Method for dynamically allocating temporal and / or frequency communication resources according to claim 15, wherein said second deep neural network exhibits a permutation equivariance property on its inputs.

17. A method for dynamically allocating temporal and / or frequency communication resources according to any one of claims 1 to 16, wherein each deep neural network is further configured according to distinct meteorological and / or atmospheric conditions, and / or according to distinct communication traffic profiles.

18. A method for dynamically allocating time and / or frequency communication resources according to any one of claims 1 to 17, wherein the step (24) of sending the received data is carried out according to a communication protocol conforming to the 4G / 5G standard, the data being sent in messages respecting an X2 / Xn and / or E-UTRAN / NG-RAN and / or Sl / NG and / or F1-AP / F1-C and / or FAPI / nFAPI communication interface of said 4G / 5G standard.

19. A non-terrestrial communication network (10) comprising a plurality of satellites (SI, S2, S3), each satellite (SI, S2, S3) covering a predefined geographical area (Z1, Z2, Z3), each geographical area (Z1, Z2, Z3) covered by a satellite (SI, S2, S3) being subdivided into smaller geographical sub-areas (z1-1,...,z1-n1; z2-1,...,z2-n2; z3-1,...,z3-n3), each of said geographical sub-areas (z1-1,...,z1-n1; z2-1,...,z2-n2; z3-1,...,z3-n3) containing a predefined number of user devices, each user device being intended to establish communication with a satellite (SI, S2, S3), the geographical areas (Z1, Z2, Z3) covered by the plurality of satellites (SI, S2, S3) exhibiting overlapping areas and areas of exclusive coverage, each satellite (SI, S2, S3) being equipped with a computer system comprising a deep neural network trained by reinforcement learning,Each deep neural network receives as input the set of states of the different satellites (SI, S2, S3) of the non-terrestrial communication network (10) at a current time, and is configured to provide as output an action allocating temporal and / or frequency communication resources for each of said satellites (SI, S2, S3), the deep neural networks being identical in the set of satellites (SI, S2, S3) of the non-terrestrial communication network (10), in which each of the satellites (SI, S2, S3) is, configured to implement the steps of the process according to any one of claims 1 to 18.

20. Non-terrestrial communication network (10) according to claim 19, wherein the computer system of each satellite (SI, S2, S3) has on the one hand a capacity to calculate a cumulative distribution function and / or a probability density function, and on the other hand a capacity to estimate loss by coupling and / or signal / interference plus noise ratio per user equipment and / or per beam or geographical sub-area.

Images