Non-terrestrial communication method and apparatus

Abstract

The present application discloses a non-terrestrial communication method and apparatus. The method comprises: receiving at least one first request, wherein the first request is used for requesting a network device to execute a corresponding first action; and on the basis of priority information of each first action, inputting the at least one first action into a first model in a descending order of priorities, and determining whether the network device executes the first action. Thus, different satellite networks can be connected to each other by means of inter-satellite links to form a heterogeneous NTN network, and by using a deep reinforcement learning technique, efficient routing and scheduling can be performed over the inter-satellite links, and interconnectivity among GEO, MEO, and LEO satellites can be realized, such that services can collaboratively work, maximizing resource utilization while ensuring high efficiency and real-time performance of the services, thereby effectively improving resource utilization and improving communication efficiency of a system.

Description

Non-terrestrial communication method and apparatus TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of communication, and particularly relates to a non-terrestrial communication method and apparatus. BACKGROUND

[0002] Non-terrestrial (also known as non-terrestrial) network (Non-terrestrial Network, NTN) is an important technology introduced by the 5th generation mobile communication system (5th generation mobile communication system, 5G) to provide wireless resources through satellites (or unmanned aerial vehicles) instead of ground base stations.

[0003] However, in the current satellite network, the satellites in each orbit are not interconnected and cannot work cooperatively.

[0004] SUMMARY

[0005] Embodiments of the present disclosure provide a non-terrestrial communication method and apparatus.

[0006] A first aspect of the present disclosure provides a non-terrestrial communication method, the method comprising:

[0007] receiving at least one first request, the first request being used to request the network device to perform a corresponding first action;

[0008] inputting the at least one first action into a first model according to a priority from high to low based on priority information of each first action, and determining whether the network device performs the first action.

[0009] A second aspect of the present disclosure provides a network device, the network device comprising:

[0010] a transceiver configured to receive at least one first request, the first request being used to request the network device to perform a corresponding first action;

[0011] a processing module configured to input the at least one first action into a first model according to a priority from high to low based on priority information of each first action, and determine whether the network device performs the first action.

[0012] The scheme provided in the embodiments of the present disclosure can realize the interconnection of different satellite networks through inter-satellite links to form a heterogeneous NTN network, and can realize efficient routing and scheduling on the inter-satellite link by using deep reinforcement learning technology, can realize the interconnection of high, low and medium orbits, and can realize the cooperative work of various services, and can maximize the utilization of resources and meet the efficient real-time performance of services, thereby effectively improving the utilization of resources and improving the communication efficiency of the system. BRIEF DESCRIPTION OF DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the background art, the drawings needed to be used in the embodiments of the present disclosure or the background art will be described below.

[0014] FIG. 1A is a schematic diagram of the architecture of a communication system provided by an embodiment of the present disclosure;

[0015] FIG. 2A is a schematic diagram of the interaction of a non-terrestrial communication method provided by an embodiment of the present disclosure;

[0016] FIG. 2B is a schematic diagram of the architecture of an NTN network provided by an embodiment of the present disclosure;

[0017] FIG. 2C is a schematic diagram of a model structure provided by an embodiment of the present disclosure;

[0018] FIGS. 3A-3C are schematic diagrams of the flow of a non-terrestrial communication method provided by an embodiment of the present disclosure;

[0019] FIG. 4A is a schematic diagram of the overall architecture of a non-terrestrial communication method provided by an embodiment of the present disclosure;

[0020] FIG. 4B is a schematic diagram of a satellite provided by an embodiment of the present disclosure;

[0021] FIG. 4C is a schematic diagram of the flow of a non-terrestrial communication method provided by an embodiment of the present disclosure;

[0022] FIG. 5A is a schematic diagram of the structure of a network device provided by an embodiment of the present disclosure;

[0023] FIG. 6A is a schematic diagram of the structure of a communication device provided by an embodiment of the present disclosure;

[0024] FIG. 6B is a schematic diagram of the structure of a chip provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] The embodiments of the present disclosure provide a non-terrestrial communication method and device.

[0026] In a first aspect, the embodiments of the present disclosure provide a non-terrestrial communication method, the method comprising:

[0027] receiving at least one first request, the first request being used to request the network device to perform a corresponding first action;

[0028] inputting the at least one first action into a first model in order of priority from high to low based on priority information of each first action, and determining whether the network device performs the first action.

[0029] In the above embodiments, different satellite networks can be connected to each other through inter-satellite links to form a heterogeneous NTN network, and deep reinforcement learning technology can be used to enable efficient routing and scheduling on the inter-satellite links, intercommunication between high, low and medium orbits, and collaborative work of various services, taking into account the maximization of resource utilization and efficient real-time service, effectively improving resource utilization and improving system communication efficiency.

[0030] In combination with some embodiments of the first aspect, in some embodiments, the method further comprises:

[0031] inputting an output result of the first model after inputting the at least one first action into the first model into a second network, and updating the priority order of the first action based on an output result of the second network

[0032] wherein the updated priority of the first action that obtains a positive reward is increased; and the updated priority of the first action that obtains a negative reward is decreased.

[0033] In combination with some embodiments of the first aspect, in some embodiments, the second network is a deep Q network (DQN).

[0034] In combination with some embodiments of the first aspect, in some embodiments, the method further comprises:

[0035] obtaining environmental state information of the network device currently in;

[0036] The first model is used to determine whether the network device performs the first action in the current state.

[0037] In combination with some embodiments of the first aspect, in some embodiments, the first action is to send first information corresponding to the first request to a next-hop device.

[0038] In combination with some embodiments of the first aspect, in some embodiments, the first information comprises at least one of the following: communication sensing measurement information; positioning information; navigation information; weather information; service demand information; and resource information.

[0039] In some embodiments combined with the first aspect, in some embodiments, the network device comprises at least one of: a low earth orbit (LEO) satellite; a medium earth orbit (MEO) satellite; a highly elliptical orbit (HEO) satellite.

[0040] In some embodiments combined with the first aspect, in some embodiments, the first model is a deep neural network (DNN) model.

[0041] In some embodiments combined with the first aspect, in some embodiments, the first request is sent by another network device or a terminal.

[0042] In a second aspect, the embodiments of the present disclosure provide a network device, comprising a transceiver module and a processing module; wherein the network device is configured to perform the method in the first aspect and the optional implementation manners of the first aspect.

[0043] In a third aspect, the embodiments of the present disclosure provide a network device, comprising: one or more processors; wherein the network device is configured to perform the method in the first aspect and the optional implementation manners of the first aspect.

[0044] In a fourth aspect, the embodiments of the present disclosure provide a communication system, comprising: a terminal and a network device; wherein the network device is configured to perform the method in the first aspect and the optional implementation manners of the first aspect.

[0045] In a fifth aspect, the embodiments of the present disclosure provide a storage medium, which stores instructions, when the instructions are executed on a communication device, causing the communication device to perform the method in the first aspect and the optional implementation manners of the first aspect.

[0046] In a sixth aspect, the embodiments of the present disclosure provide a program product, which, when executed by a communication device, causes the communication device to perform the method in the first aspect and the optional implementation manners of the first aspect.

[0047] In a seventh aspect, the embodiments of the present disclosure provide a computer program, which, when executed on a computer, causes the computer to perform the method in the first aspect and the optional implementation manners of the first aspect.

[0048] In an eighth aspect, the embodiments of the present disclosure provide a chip or chip system. The chip or chip system comprises processing circuitry configured to perform the method in the first aspect and the optional implementation manners of the first aspect.

[0049] It can be understood that the terminal, the network device, the core network device, the communication system, the storage medium, the program product, the computer program, the chip or the chip system are all used to perform the method provided by the embodiments of the present disclosure. Therefore, the beneficial effects that can be achieved thereby can refer to the beneficial effects in the corresponding method, which will not be described here again.

[0050] This disclosure provides a non-terrestrial communication method and apparatus. In some embodiments, the terms "non-terrestrial communication method" and "information processing method" or "communication method" can be used interchangeably; the terms "non-terrestrial communication apparatus" and "information processing apparatus" or "communication apparatus" can be used interchangeably; and the terms "information processing system" or "communication system" can be used interchangeably.

[0051] This disclosure is not exhaustive, but merely illustrative of some embodiments, and is not intended to limit the scope of protection of this disclosure. Unless otherwise specified, each step in a particular embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a particular embodiment can also be implemented as an independent embodiment, and the order of the steps in a particular embodiment can be arbitrarily interchanged. Furthermore, the optional implementation methods in a particular embodiment can be arbitrarily combined; moreover, the embodiments can be arbitrarily combined, for example, some or all steps of different embodiments can be arbitrarily combined, and a particular embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.

[0052] In each of the disclosed embodiments, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of the embodiments are consistent and can be referenced by each other. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0053] The terminology used in the embodiments of this disclosure is for the purpose of describing particular embodiments only and is not intended to limit the scope of this disclosure.

[0054] In this embodiment of the disclosure, unless otherwise stated, elements expressed in the singular form, such as "a," "an," "the," "the," "the," "the," "the," "the," "this," etc., can mean "one and only one," or "one or more," "at least one," etc. For example, when using articles such as "a," "an," "the," etc. in translation, the noun following the article can be understood as either a singular expression or a plural expression.

[0055] In the embodiments disclosed herein, "multiple" refers to two or more.

[0056] In some embodiments, the terms “at least one of”, “one or more”, “a plurality of”, “multiple”, etc., may be used interchangeably.

[0057] In some embodiments, "at least one of A, B", "A and / or B", "in one case A, in another case B", "responsive to case A, responsive to case B" and the like, can be interpreted to include both cases, A and B, in some embodiments, A (A is performed regardless of B), in some embodiments, B (B is performed regardless of A), in some embodiments, selected from the group consisting of A and B (the selection between A and B is an option), in some embodiments, A and B (both A and B are performed).

[0058] In some embodiments, "A or B" and the like, can be interpreted to include both cases, A and B, in some embodiments, A (A is performed regardless of B), in some embodiments, B (B is performed regardless of A), in some embodiments, selected from the group consisting of A and B (the selection between A and B is an option). When there are more branches, similar descriptions can be made.

[0059] In some embodiments, the prefix words "first", "second", and the like, are used only to distinguish different description objects, and do not constitute a limitation on the position, order, priority, quantity, or content of the description objects. The description of the description objects should refer to the description in the claims or embodiments, and should not be limited by the prefix words. For example, the description object is "field", and the ordinal words before "field" in "first field" and "second field" do not limit the position or order between "fields", and "first" and "second" do not limit whether the "fields" modified by them are in the same message or not, nor do they limit the order of "first field" and "second field". For another example, the description object is "level", and the ordinal words before "level" in "first level" and "second level" do not limit the priority between "levels". For another example, the quantity of the description object is not limited by the ordinal words, and can be one or more. For example, "first device", where the quantity of "device" can be one or more. In addition, the objects modified by different prefix words can be the same or different, for example, the description object is "device", and "first device" and "second device" can be the same device or different devices, and their types can be the same or different; for another example, the description object is "information", and "first information" and "second information" can be the same information or different information, and their contents can be the same or different.

[0060] In some embodiments, "including A", "containing A", "for indicating A", "carrying A", can be interpreted as directly carrying A, or indirectly indicating A.

[0061] In some embodiments, the terms "in response to", "in response to determining", "in the case of", "when", "when", "if", "if" and the like can be replaced with each other.

[0062] In some embodiments, the terms "greater than", "greater than or equal to", "not less than", "more than", "more than or equal to", "not less than", "higher than", "higher than or equal to", "not lower than", "above", and the like can be replaced with each other, and the terms "less than", "less than or equal to", "not greater than", "fewer than", "fewer than or equal to", "not more than", "lower than", "lower than or equal to", "not higher than", "below", and the like can be replaced with each other.

[0063] In some embodiments, the apparatuses and devices can be interpreted as physical or virtual, and their names are not limited to the names described in the embodiments, and in some cases can also be understood as "equipment", "device", "circuit", "network element", "node", "function", "unit", "section", "system", "network", "chip", "chip system", "entity", "subject", and the like.

[0064] In some embodiments, "network" can be interpreted as an apparatus included in the network, such as an access network device, a core network device, and the like.

[0065] In some embodiments, an “access network device (AN device)” can also be referred to as a “radio access network device (RAN device),” a “base station (BS),” a “radio base station,” a “fixed station,” and in some embodiments can also be understood as a “node,” an “access point,” a “transmission point (TP),” a “reception point (RP),” a “transmission / reception point (TRP),” a “panel,” an “antenna panel,” an “antenna array,” a “cell,” a “macro cell,” a “small cell,” a “femto cell,” a “pico cell,” a “sector,” a “cell group,” a “serving cell,” a “carrier,” a “component carrier,” a “bandwidth part (BWP),” and the like.

[0066] In some embodiments, a "terminal" or "terminal device" can be referred to as a "user equipment (UE)", "user terminal", "mobile station (MS)", "mobile terminal (MT)", subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, etc.

[0067] In some embodiments, an access network device, a core network device, or a network device can be replaced with a terminal. For example, the embodiments of the present disclosure can also be applied to a structure in which communication between an access network device, a core network device, or a network device and a terminal is replaced with communication between a plurality of terminals (e.g., device-to-device (D2D), vehicle-to-everything (V2X), etc.). In this case, the terminal can also be configured to have all or part of the functions of the access network device. In addition, the terms "uplink", "downlink", etc. can also be replaced with terms corresponding to the inter-terminal communication (e.g., "side"). For example, an uplink channel, a downlink channel, etc. can be replaced with a side channel, and an uplink, a downlink, etc. can be replaced with a side link.

[0068] In some embodiments, a terminal can be replaced with an access network device, a core network device, or a network device. In this case, the access network device, the core network device, or the network device can also be configured to have all or part of the functions of the terminal.

[0069] In some embodiments, the data, information, etc. can be obtained in compliance with the laws and regulations of the country where the location is situated.

[0070] In some embodiments, the data, information, etc. can be obtained after obtaining the consent of the user.

[0071] In addition, each element, each row, or each column in the table of the embodiments of the present disclosure can be implemented as an independent embodiment, and any combination of any element, any row, or any column can also be implemented as an independent embodiment.

[0072] FIG. 1A is a schematic diagram of an architecture of a communication system according to an embodiment of the present disclosure.

[0073] As shown in FIG. 1A, the communication system 100 includes a network device 101 and a terminal 102.

[0074] In some embodiments, the network device 101 is, for example, a node or device that accesses a terminal to a wireless network, and the network device can include at least one of a satellite or a drone in a non-terrestrial communication network, an evolved NodeB (eNB) in a 5G communication system, a next generation eNB (ng-eNB), a next generation NodeB (gNB), a next generation RAN node (NG-RAN node), a node B (NB), a home node B (HNB), a home evolved node B (HeNB), a wireless backhaul device, a radio network controller (RNC), a base station controller (BSC), a base transceiver station (BTS), a base band unit (BBU), a mobile switching center, a base station in a 6G communication system, an Open RAN, a Cloud RAN, a base station in other communication systems, an access node in a Wi-Fi system, but is not limited thereto.

[0075] In some embodiments, the technical solutions of the present disclosure can be applied to an Open RAN architecture, at this time, the interfaces between the access network devices or within the access network devices involved in the embodiments of the present disclosure can become internal interfaces of the Open RAN, and the processes and information interactions between these internal interfaces can be realized through software or programs.

[0076] In some embodiments, the network device can be composed of a central unit (CU) and a distributed unit (DU), where the CU can also be referred to as a control unit. The CU-DU structure can split the protocol layers of the access network device, with some of the protocol layers being controlled by the CU and the rest of the protocol layers or all of the protocol layers being distributed in the DU and controlled by the CU, but is not limited thereto.

[0077] In some embodiments, the terminal 102 includes at least one of a mobile phone, a wearable device, an Internet of Things device, a communication-capable automobile, a smart automobile, a tablet computer (Pad), a wireless transceiver-equipped computer, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal device in industrial control, a wireless terminal device in self-driving, a wireless terminal device in remote medical surgery, a wireless terminal device in a smart grid, a wireless terminal device in transportation safety, a wireless terminal device in a smart city, a wireless terminal device in a smart home, a RedCap terminal, and the like, but is not limited thereto.

[0078] It can be understood that the communication system described in the embodiments of the present disclosure is for more clearly illustrating the technical solutions of the embodiments of the present disclosure, and does not constitute a limitation on the technical solutions proposed in the embodiments of the present disclosure. Those skilled in the art can know that, as the system architecture evolves and new business scenarios appear, the technical solutions proposed in the embodiments of the present disclosure are also applicable to similar technical problems.

[0079] The following embodiments of the present disclosure can be applied to the communication system 100 shown in FIG. 1A or part of the subject, but are not limited thereto. The subjects shown in FIG. 1A are exemplary, and the communication system can include all or part of the subjects in FIG. 1A, or other subjects other than those in FIG. 1A. The number and form of each subject is arbitrary, each subject can be physical or virtual, the connection relationship between each subject is exemplary, each subject can not be connected or can be connected, the connection can be in any manner, can be direct connection or indirect connection, can be wired connection or wireless connection.

[0080] Embodiments of the present disclosure can be applied to a Non-terrestrial Network (NTN), Long Term Evolution (LTE), LTE-Advanced (LTE-A), LTE-Beyond (LTE-B), SUPER 3G, IMT-Advanced, 4th generation mobile communication system (4G), 5th generation mobile communication system (5G), 5G new radio (NR), Future Radio Access (FRA), New-Radio Access Technology (RAT), New Radio (NR), New radio access (NX), Future generation radio access (FX), Global System for Mobile communications (GSM (registered trademark)), CDMA2000, Ultra Mobile Broadband (UMB), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20, Ultra-WideBand (UWB), Bluetooth (Bluetooth (registered trademark)), Public Land Mobile Network (PLMN) network, Device-to-Device (D2D) system, Machine to Machine (M2M) system, Internet of Things (IoT) system, Vehicle-to-Everything (V2X), system using other communication methods, next-generation system expanded based thereon, and the like. Further, a plurality of systems can be applied in combination (for example, combination of LTE or LTE-A and 5G, and the like).

[0081] In some embodiments, a non-terrestrial network (NTN) is an important technology introduced by the 5th generation mobile communication system (5G) to provide wireless resources through satellites (or unmanned aircraft systems (UAS) platforms) instead of ground base stations, as shown in FIG. 1A. Among them, the link between the satellite and the terminal is called the service link, and the link between the satellite and the gateway is called the feeder link.

[0082] In some embodiments, there are two typical architectures for NTN, namely the transparent payload mode and the regenerative payload mode. In the transparent payload mode, the satellite acts as a radio frequency repeater and only forwards the signal without any processing. In the regenerative payload mode, the satellite processes the data like a gNB.

[0083] However, in the current satellite network, satellites in different orbits are not interconnected, and high, medium and low orbit satellites work independently and cannot work cooperatively.

[0084] The non-terrestrial communication method and device provided by the present disclosure will be described in detail below in conjunction with the accompanying drawings.

[0085] FIG. 2A is an interaction diagram of a non-terrestrial communication method according to an embodiment of the present disclosure. As shown in FIG. 2A, the present embodiment relates to a non-terrestrial communication method, and the method comprises:

[0086] In step S2101, the network device 101 receives at least one first request.

[0087] In some embodiments, the network device 101 can receive at least one first request sent by another network device.

[0088] In some embodiments, the network device 101 can receive at least one first request sent by a terminal.

[0089] In some embodiments, the network device 101 can receive at least one first request sent by another device and a terminal.

[0090] In some embodiments, the first request is used to request the network device 101 to perform a first action.

[0091] In some embodiments, the first request sent by different devices can be used to request the network device 101 to perform different actions, and the same device can also send multiple first requests to the network device 101.

[0092] In some embodiments, the network device 101 can be a Low Earth Orbit (LEO) satellite, a Medium Orbit Earth (MEO) satellite, a Geostationary Orbit (GEO) satellite, a Highly Elliptical Orbit (HEO) satellite, etc.

[0093] In some embodiments, the other network device that sends the first request to the network device 101 can also be at least one of the following: a Low Earth Orbit (LEO) satellite, a Medium Orbit Earth (MEO) satellite, a Geostationary Orbit (GEO) satellite, a Highly Elliptical Orbit (HEO) satellite.

[0094] In various embodiments of the present application, as shown in FIG. 2B, satellites in different orbits (LEO, MEO, GEO, HEO, etc.) can communicate with each other to form a heterogeneous NTN network.

[0095] In some embodiments, the first action refers to sending first information corresponding to the first request to a next-hop device.

[0096] In some embodiments, the first action can be to schedule and forward the first information.

[0097] In some embodiments, the first information can include at least one of the following: communication awareness measurement information; positioning information; navigation information; weather information; service demand information; resource information.

[0098] In some embodiments, the next-hop device can be another network device or a terminal, etc.

[0099] In some embodiments, the first information can be measured by the network device 101 itself, or can be obtained by the network device 101 from other devices (such as other network devices or terminals, etc.).

[0100] In some embodiments, the name of the first request is not limited, and it can be, for example, an “awareness request”, a “service request”, a “resource request”, a “positioning information request”, a “navigation information request”, a “weather information request”, etc.

[0101] In step S2102, the network device 101 acquires environment state information.

[0102] In some embodiments, the network device 101 can acquire environment state information of the current environment.

[0103] In some embodiments, the network device 101 can determine whether to perform the first action in the current state based on the environment state information of the current environment.

[0104] As an example, the environment state information can include current service state, resource state, network state, real-time performance of each service, urgency, and the like.

[0105] In step S2103, the network device 101 inputs the at least one first action into the first model.

[0106] In some embodiments, the network device 101 can input the at least one first action requested to be performed by the at least one first request into the first model.

[0107] In some embodiments, the network device 101 can input the at least one first action into the first model in order of priority from high to low.

[0108] In some embodiments, the output result of the first model is whether to perform the input first action.

[0109] In some embodiments, the first model is used to determine whether to perform the input first action in the current environment state of the network device 101.

[0110] In some embodiments, the output result of the first model is whether to perform the input first action in the current environment state of the network device 101.

[0111] In some embodiments, the first action with high priority is preferentially input into the first model for decision (whether to perform in the current state).

[0112] In some embodiments, the network device 101 can first acquire priority information of the at least one first action.

[0113] In some embodiments, the network device 101 can acquire the priority information of the at least one first action (sort the at least one first action according to priority) in the process of training the first model.

[0114] In some embodiments, the first model is a deep neural network (DNN) model.

[0115] In some embodiments, the structure of the first model described above can be as shown in FIG. 2C.

[0116] wherein the leftmost represents the input layer, which is the feature matrix input to the first model (as an example, the input feature matrix is a column vector of length 75, which is used to represent the first action); the middle is one or more hidden layers included in the first model (as an example, the hidden layer includes 6 layers, each of which includes 128-256-256-128-64-32 nodes (or neurons)); and the rightmost is the output layer, which is the output result of the first model (represented by a two-dimensional vector, for example, it can also be represented by YES / NO).

[0117] As an example, the initial 128 nodes ensure that 75 data can be processed in the input layer. The middle nodes are set to fully interpret the information. The last 32 nodes are used for the output layer. The output layer is set to two nodes, indicating whether the current state and action are consistent to be scheduled, forwarded.

[0118] As an example, the feature matrix as the input layer of the first model described above, which includes a matrix (or vector) used to represent the first action. Assigning 1 to different positions of the column vector can represent different first actions, and a column vector of length n can be used to represent n first actions. For example, a column vector of length 5 can represent five different first actions, and assigning 1 to different positions of the vector can represent different first actions. For example, [0, 0, 1, 0, 0] represents action value No. 2, for example, the meaning of No. 2 action is “schedule, forward perception information”. Other vectors can represent “schedule, forward navigation information”, “schedule, forward weather information”, etc. Further, the feature matrix representing the first action is spliced with the feature matrix of the 70 digital information to obtain a column vector of length 75 as the input layer of the first model.

[0119] In some embodiments, the first model described above can be trained based on a training data set.

[0120] As an example, for the establishment of the training data set, since the first model uses deep learning, it is necessary to construct the training data set. The first model trained by reinforcement learning can be used as a controller for traffic forwarding, as close as possible to the actual use of the data set. The data to be collected includes the feature state matrix, and the first action performed is decided by various traffic scheduling and forwarding situations. Further, for each action in the training data set, NO means that the action should not be scheduled and forwarded in the current state, and YES means that the action should be scheduled and forwarded in the current state. In order to ensure the comprehensiveness of the training data set, a large number of tests and evaluations (for example, about one million tests and evaluations) are performed on the first model obtained under each training mode.

[0121] In some embodiments, the first model described above further includes a reward function.

[0122] As an example, in order to ensure the performance of various traffics in different aspects at the same time, the reward function can be divided into three parts, and the reward value is set by considering scheduling and forwarding efficiency, real-time accuracy and user satisfaction respectively.

[0123] Step S2104, the network device 101 determines whether to perform the first action.

[0124] In some embodiments, the network device 101 determines whether to perform the input first action based on the output result of the first model described above.

[0125] In some embodiments, the network device 101 determines whether to perform the input first action in the current environment state based on the output result of the first model described above.

[0126] In some embodiments, the network device 101 determines to perform the first action, and the network device 101 can also send the first information corresponding to the first action to the next hop device.

[0127] Step S2105, the network device 101 updates the priority information of the first action.

[0128] In some embodiments, the network device 101 can input the output result corresponding to at least one first action input into the first model into the second network, and update the priority order of the first action based on the output result of the second network.

[0129] In some embodiments, the first action that obtains a positive reward increases in priority after updating (the order may rise).

[0130] In some embodiments, the first action that obtains a negative reward decreases in priority after updating (the order may fall).

[0131] In some embodiments, the output result corresponding to the first action inputting the first model is a value representing affirmation (e.g., "Yes" or "YES"), and the priority of the first action is increased after being updated.

[0132] In some embodiments, the output result corresponding to the first action inputting the first model is a value representing negation (e.g., "No" or "NO"), and the priority of the first action is decreased after being updated.

[0133] In some embodiments, the priority of the first action is increased or decreased, but the position of the first action in the sequence of the plurality of actions does not necessarily change and still needs to be compared with the q values of other actions.

[0134] In some embodiments, the second network described above can be a deep Q network (DQN).

[0135] In some embodiments, the network device 101 can update the priority sequence of the first action based on a deep Q network (DQN). The q value of the DQN is the priority information of the first action. The output matrix of the DQN can be regarded as a sequence of action advantages, and the action with a higher sequence is a better action.

[0136] As an example, the DQN is used in the updating process of the first model. In the whole process, the q value of the DQN is calculated as follows:

[0137] wherein Q(s t ,a t ) represents the q value of the first action a t at the current time t in the state s t , R(s t ,a t ) represents the reward function value of the first action a t in the state s t , and Q(s t+1 ,a t+1 ) represents the q value of the first action a t+1 in the state s t+1 at the next time t+1.

[0138] As can be seen from the above formula, the q value of the action corresponding to the positive reward is increased, and the q value of the action corresponding to the negative reward is decreased. The main principle is to make the q value corresponding to the optimal action better than other positions. It can be determined that the greater the q value output by the trained model, the better the action. Therefore, the output matrix of the DQN should be regarded as a sequence of action advantages, rather than only a maximum q value corresponding to an action.

[0139] In some embodiments, if the network device 101 decides to perform an action, the action can be removed from the ordered action stack, otherwise, the action still participates in the ordering of actions.

[0140] In some embodiments, the terms “eNB”, “gNB”, “base station”, “NG-RAN node” and the like can be replaced with each other.

[0141] In some embodiments, the terms “MME”, “CN”, “AMF”, “SMF” and the like can be replaced with each other.

[0142] In some embodiments, the terms “SGW”, “UPF” and the like can be replaced with each other.

[0143] In some embodiments, the determination or judgment can be made by a value represented by 1 bit (0 or 1), or by a true or false value (Boolean value) represented by true or false, or by comparison of numerical values (for example, comparison with a predetermined value), but is not limited thereto.

[0144] In some embodiments, the terms “bearer”, “Protocol Data Unit (PDU) session”, “Evolved Radio Access Bearer (E-RAB)”, “EPS bearer”, “QoS flow” and the like can be replaced with each other.

[0145] In some embodiments, the terms “Next Generation Application Proposal (NGAP)”, “S1 Application Proposal (S1AP)” and the like can be replaced with each other.

[0146] In some embodiments, the terms “Xn Application Proposal (XnAP)”, “X2 Application Proposal (X2AP)” and the like can be replaced with each other.

[0147] In some embodiments, the terms “carrier”, “band”, “frequency” and the like can be replaced with each other.

[0148] In some embodiments, the names of information and the like are not limited to the names described in the embodiments, and terms such as "information", "message", "signal", "signaling", "report", "configuration", "indication", "instruction", "command", "channel", "parameter", "field", "symbol", "symbol", "codebook", "codeword", "codepoint", "bit", "data", "program", "chip", and the like can be replaced with each other.

[0149] In some embodiments, the names of information and the like are not limited to the names described in the embodiments, and terms such as "information", "message", "signal", "signaling", "report", "configuration", "indication", "instruction", "command", "channel", "parameter", "field", "symbol", "symbol", "codebook", "codeword", "codepoint", "bit", "data", "program", "chip", and the like can be replaced with each other.

[0150] In some embodiments, terms such as "physical downlink shared channel (PDSCH)", "DL data", and the like can be replaced with each other, and terms such as "physical uplink shared channel (PUSCH)", "UL data", and the like can be replaced with each other.

[0151] In some embodiments, the terms "radio", "wireless", "radio access network (RAN)", "access network (AN)", "RAN-based", and the like can be replaced with each other.

[0152] In some embodiments, the terms "resource block (RB)", "physical resource block (PRB)", "sub-carrier group (SCG)", "resource element group (REG)", "PRB pair", "RB pair", "resource element (RE)", "sub-carrier", and the like can be replaced with each other.

[0153] In some embodiments, the terms "acquire", "obtain", "get", "receive", "transmit", "bidirectional transmission", "send and / or receive", and the like can be replaced with each other, which can be interpreted as receiving from other subjects, acquiring from protocols, obtaining from higher layers, obtaining by self-processing, implementing autonomously, and the like.

[0154] In some embodiments, the terms "send", "transmit", "report", "issue", "transmit", "bidirectional transmission", "send and / or receive", and the like can be replaced with each other.

[0155] In some embodiments, the terms "certain", "preset", "pre-set", "set", "indicated", "a certain", "any", "first", and the like can be replaced with each other, and "certain A", "preset A", "pre-set A", "set A", "indicated A", "a certain A", "any A", "first A" can be interpreted as A specified in advance in protocols and the like, can be interpreted as A obtained by setting, configuring, or indicating, and the like, can be interpreted as certain A, a certain A, any A, or first A, and the like, but are not limited thereto.

[0156] The communication method related to the embodiments of the present disclosure can include at least one of steps S2101-S2105. For example, step 2101 can be implemented as an independent embodiment, steps 2101+2103 can be implemented as an independent embodiment, step 2103 can be implemented as an independent embodiment, step 2104 can be implemented as an independent embodiment, steps 2103+2104 can be implemented as an independent embodiment, steps 2101+2103+2104 can be implemented as an independent embodiment, step 2102 can be implemented as an independent embodiment, steps 2102+2103+2104 can be implemented as an independent embodiment, steps 2101+2102+2103+2104 can be implemented as an independent embodiment, step 2105 can be implemented as an independent embodiment, steps 2101+2103+2104+2105 can be implemented as an independent embodiment, steps 2101+2102+2103+2104+2105 can be implemented as an independent embodiment, and the like, but are not limited thereto.

[0157] In some embodiments, steps S2101 and S2102 can be exchanged in order or performed simultaneously.

[0158] In some embodiments, steps S2102 and S2105 are optional, and one or more of these steps can be omitted or replaced in different embodiments.

[0159] In some embodiments, other optional implementations described before or after the description of FIG. 2A can be referred to.

[0160] FIG. 3A is a flow diagram of a non-terrestrial communication method according to an embodiment of the present disclosure. As shown in FIG. 3A, the embodiments of the present disclosure relate to a non-terrestrial communication method, and the method is performed by the network device 101, and the method includes:

[0161] Step S3101, receiving at least one first request.

[0162] Optional implementations of step S3101 can be referred to optional implementations of step S2101 of FIG. 2A and other associated parts in the embodiments related to FIG. 2A, which will not be described herein.

[0163] Step S3102, obtaining environment state information.

[0164] Optional implementations of step S3102 can be referred to optional implementations of step S2102 of FIG. 2A and other associated parts in the embodiments related to FIG. 2A, which will not be described herein.

[0165] Step S3103, inputting at least one first action into a first model.

[0166] The optional implementation of step S3103 can refer to the optional implementation of step S2103 in FIG. 2A and other associated parts in the embodiments related to FIG. 2A, which will not be repeated here.

[0167] In step S3104, it is determined whether to perform the first action.

[0168] The optional implementation of step S3104 can refer to the optional implementation of step S2104 in FIG. 2A and other associated parts in the embodiments related to FIG. 2A, which will not be repeated here.

[0169] In step S3105, the priority ranking of the first action is updated.

[0170] The optional implementation of step S3105 can refer to the optional implementation of step S2105 in FIG. 2A and other associated parts in the embodiments related to FIG. 2A, which will not be repeated here.

[0171] The communication method related to the embodiments of the present disclosure can include at least one of steps S3101-S3105. For example, step 3101 can be implemented as an independent embodiment, steps 3101+3103 can be implemented as an independent embodiment, step 3103 can be implemented as an independent embodiment, step 3104 can be implemented as an independent embodiment, steps 3103+3104 can be implemented as an independent embodiment, steps 3101+3103+3104 can be implemented as an independent embodiment, step 3102 can be implemented as an independent embodiment, steps 3102+3103+3104 can be implemented as an independent embodiment, steps 3101+3102+3103+3104 can be implemented as an independent embodiment, step 3105 can be implemented as an independent embodiment, steps 3101+3103+3104+3105 can be implemented as an independent embodiment, steps 3101+3102+3103+3104+3105 can be implemented as an independent embodiment, and the like, but are not limited thereto.

[0172] In some embodiments, the order of steps S3101 and S3102 can be exchanged or performed simultaneously.

[0173] In some embodiments, steps S3102 and S3105 are optional, and one or more of these steps can be omitted or replaced in different embodiments.

[0174] FIG. 3B is a flow diagram of a non-terrestrial communication method according to an embodiment of the present disclosure. As shown in FIG. 3B, the embodiments of the present disclosure relate to a non-terrestrial communication method, the method is performed by the access network device 101, and the method includes the following steps:

[0175] Step S3201, receiving at least one first request.

[0176] Optional implementation of step S3201 can refer to step S2101 in FIG. 2A, optional implementation of step S3101 in FIG. 3A, and other associated parts in the embodiments related to FIG. 2A and FIG. 3A, which are not described here again.

[0177] Step S3202, inputting at least one first action into a first model.

[0178] Optional implementation of step S3202 can refer to step S2102 in FIG. 2A, optional implementation of step S3102 in FIG. 3A, and other associated parts in the embodiments related to FIG. 2A and FIG. 3A, which are not described here again.

[0179] Step S3203, determining whether to perform the first action.

[0180] Optional implementation of step S3203 can refer to step S2103 in FIG. 2A, optional implementation of step S3103 in FIG. 3A, and other associated parts in the embodiments related to FIG. 2A and FIG. 3A, which are not described here again.

[0181] Step S3204, updating priority ranking of the first action.

[0182] Optional implementation of step S3204 can refer to step S2104 in FIG. 2A, optional implementation of step S3104 in FIG. 3A, and other associated parts in the embodiments related to FIG. 2A and FIG. 3A, which are not described here again.

[0183] The communication method related to the embodiments of the present disclosure can include at least one of steps S3201-S3204. For example, step 3201 can be implemented as an independent embodiment, step 3202 can be implemented as an independent embodiment, step 3203 can be implemented as an independent embodiment, steps 3201+3202 can be implemented as an independent embodiment, steps 3202+3203 can be implemented as an independent embodiment, steps 3201+3202+3203 can be implemented as an independent embodiment, steps 3201+3202+3203+3204 can be implemented as an independent embodiment, and the like, but not limited thereto.

[0184] FIG. 3C is a flow diagram of a non-terrestrial communication method according to an embodiment of the present disclosure. As shown in FIG. 3C, the embodiment of the present disclosure relates to a non-terrestrial communication method, the method is performed by the access network device 101, and the method includes:

[0185] Step S3301, receiving at least one first request.

[0186] The optional implementation of step S3301 can refer to the optional implementation of step S2101 in FIG. 2A, step S3101 in FIG. 3A, step S3201 in FIG. 3B, and other associated parts in the embodiments related to FIG. 2A, FIG. 3A and FIG. 3B, which are not described here again.

[0187] In step S3302, at least one first action is input into the first model.

[0188] The optional implementation of step S3302 can refer to the optional implementation of step S2102 in FIG. 2A, step S3102 in FIG. 3A, step S3202 in FIG. 3B, and other associated parts in the embodiments related to FIG. 2A, FIG. 3A and FIG. 3B, which are not described here again.

[0189] In step S3303, it is determined whether to perform the first action.

[0190] The optional implementation of step S3303 can refer to the optional implementation of step S2103 in FIG. 2A, step S3103 in FIG. 3A, step S3203 in FIG. 3B, and other associated parts in the embodiments related to FIG. 2A, FIG. 3A and FIG. 3B, which are not described here again.

[0191] The communication method related to the embodiments of the present disclosure can include at least one of steps S3301-S3303. For example, step 3301 can be implemented as an independent embodiment, step 3302 can be implemented as an independent embodiment, step 3303 can be implemented as an independent embodiment, steps 3302+3303 can be implemented as an independent embodiment, steps 3301+3302+3303 can be implemented as an independent embodiment, and the like, but are not limited thereto.

[0192] The following is an exemplary introduction to the method described in the above embodiments.

[0193] In some embodiments, referring to FIG. 2B, as shown in FIG. 2B, in the embodiments of the present disclosure, each satellite network is connected to each other through an inter-satellite link (ISL), and a deep reinforcement learning technology is used in the inter-satellite link to perform efficient routing and scheduling. High, ground, and medium orbit interconnections can be performed to form a heterogeneous NTN network, so that each service can work cooperatively to improve resource utilization and real-time performance of the service.

[0194] In some embodiments, as shown in FIG. 4A, a deep reinforcement learning technology can be used in the inter-satellite link, and according to the feedback of the environment and the decision, the embodiments of the present disclosure propose a method of using DNN+DQN to perform a large amount of training, so that the service request and resource scheduling of each inter-satellite link can be efficiently routed and scheduled.

[0195] As an example, as shown in FIG. 4A, when performing positioning and navigation, not only the MEO navigation satellite can be relied on, but also other low-orbit satellites can be used for communication and perception measurement to perceive the existence of surrounding objects such as other aircrafts, spacecrafts, ships, cloud thickness, etc., to perform safer navigation. Each satellite has its business demand information and resource information that can be provided. This can be used as the input and output of each satellite, that is, the information scheduling and forwarding of inter-satellite links, as shown in FIG. 4B.

[0196] In some embodiments, the planning decision of routing scheduling can be made using the q-value table sorting of reinforcement learning. For example, the decision of whether to schedule and forward share navigation information or to forward share perception information can be made using the q-value table sorting of reinforcement learning.

[0197] In some embodiments, as shown in FIG. 4C, in the action sorting part in FIG. 4C, the darker the color, the greater the q-value corresponding to the action. The action stack is used to store the sorted actions and output the action values step by step in order. The pending action is temporarily considered as the priority action, and therefore needs to be finally decided. The action judgment network (i.e., the first model in the foregoing embodiments of the present application) judges whether the input state and action are feasible and outputs a Boolean value. True indicates that the current operation is to be scheduled and forwarded.

[0198] In some embodiments, the action judgment network (i.e., the first model in the foregoing embodiments of the present application) control is used to determine whether to perform a specific operation (i.e., whether the current state is to be scheduled and forwarded), as shown in FIG. 4C. The presence of the action judgment network (i.e., the first model in the foregoing embodiments of the present application) is equivalent to a doorman who decides the final action execution.

[0199] Therefore, the input of the DNN is the feature matrix and the action to be performed.

[0200] As an example, if the feature matrix has 70 numerical information planes, but the action information has only one number, this makes the network easy to ignore the action information.

[0201] The present embodiment proposes a new encoding method to represent the action value. A column vector with a length of 5 can represent five different actions, and assigning a value of 1 at different positions can represent different actions. For example, [0, 0, 1, 0, 0] represents action value No. 2, which means “schedule and forward perception information”. Other vectors can represent “schedule and forward navigation information”, “schedule and forward weather information”, etc. The column vector with a length of 5 is spliced with the 70 numerical information planes to obtain a column vector with a length of 75 as the input layer of the DNN.

[0202] In some embodiments, as shown in FIG. 2C, the intermediate layer node distribution is set to 128-256-256-128-64-32. The initial 128 nodes ensure that 75 data can be processed in the input layer. The middle nodes are set to fully interpret the information. The last 32 nodes are used for the output layer. The output layer is set to two nodes, indicating whether the current state and action are consistent, whether scheduling and forwarding should be performed.

[0203] In some embodiments, the action decision network (i.e., the first model in the foregoing embodiments of the present application) can also be provided with a reward function. In order to ensure the performance of each service in different aspects at the same time, the reward function can be divided into three parts, and the scheduling and forwarding efficiency, real-time accuracy and user satisfaction are considered to set the reward.

[0204] In some embodiments, the action decision network (i.e., the first model in the foregoing embodiments of the present application) uses deep learning, so it is necessary to construct a training data set. For the establishment of the training data set, the training data set is closest to the actual use, and the model trained by reinforcement learning is used as a controller for service forwarding. The data to be collected includes the feature state matrix, and the action is decided by the scheduling and forwarding of various services. When the model is trained, No means that the action should not be scheduled and forwarded in the current state, and Yes means that the action should be scheduled and forwarded in the current state. In order to ensure the comprehensiveness of the training data set, the model obtained under each training mode is tested and evaluated about one million times.

[0205] In some embodiments, DQN (i.e., the second network in the foregoing embodiments of the present application) is used in the reinforcement learning network update process. In the whole process, the q value of DQN is calculated as follows:

[0206] As can be seen from the above equation, the q value corresponding to the action that obtains a positive reward will increase, and the q value corresponding to the action that obtains a negative reward will decrease. The main principle is to make the q value corresponding to the optimal action better than other positions. It can be determined that the greater the q value output by the trained model, the better the action. Therefore, the output matrix should be regarded as an order of action advantages, rather than just a q value corresponding to an action.

[0207] The embodiments of the present application can view the network output of DQN from a new angle and make innovative processing, and give the specific process of the filling action selection method.

[0208] The embodiments of the present disclosure further provide a device for implementing any of the above methods, for example, a device comprising units or modules for implementing the steps performed by the terminal in any of the above methods. For another example, another device is further provided, comprising units or modules for implementing the steps performed by the network equipment (such as an access network device, a core network function node, a core network device, etc.) in any of the above methods.

[0209] It should be understood that the division of each unit or module in the above device is only a logical function division, and all or part of the units or modules can be integrated into one physical entity or physically separated in actual implementation. In addition, the units or modules in the device can be implemented in the form of processor invoking software: for example, the device comprises a processor connected with a memory, the memory stores instructions, and the processor invokes the instructions stored in the memory to implement any of the above methods or to implement the functions of each unit or module of the device, wherein the processor is a general processor such as a central processing unit (CPU) or a microprocessor, and the memory is a memory in the device or a memory outside the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuit, and the functions of part or all of the units or modules can be implemented by the design of the hardware circuit, and the hardware circuit can be understood as one or more processors; for example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC), and the functions of part or all of the units or modules are implemented by the design of the logical relationship between the elements in the circuit; for another example, in another implementation, the hardware circuit is a programmable logic device (PLD), and taking a field programmable gate array (FPGA) as an example, it can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured by a configuration file, so as to implement the functions of part or all of the units or modules. All units or modules of the above device can be implemented in the form of processor invoking software, or all units or modules can be implemented in the form of hardware circuit, or part of the units or modules are implemented in the form of processor invoking software, and the remaining part is implemented in the form of hardware circuit.

[0210] In the embodiments of the present disclosure, the processor is a circuit with signal processing capability. In one implementation, the processor can be a circuit with instruction reading and running capability, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), a digital signal processor (DSP), or the like. In another implementation, the processor can implement certain functions through a logical relationship of hardware circuits, and the logical relationship of the hardware circuits is fixed or can be reconfigured. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In the reconfigurable hardware circuit, the processor loads a configuration document to implement the configuration of the hardware circuit. It can be understood that the processor loads instructions to implement the functions of the above part or all units or modules. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), and the like.

[0211] FIG. 5A is a structural schematic diagram of a network device according to an embodiment of the present disclosure. As shown in FIG. 5A, the network device 5100 can include at least one of a transceiver module 5101, a processing module 5102, and the like. In some embodiments, the transceiver module is configured to receive at least one first request, the first request being used to request the network device to perform a corresponding first action; and the processing module is configured to input the at least one first action into a first model according to a priority from high to low based on priority information of each first action, and determine whether the network device performs the first action.

[0212] Optionally, the processing module is further configured to:

[0213] input an output result of inputting the at least one first action into the first model into a second network, and update the priority order of the first action based on an output result of the second network;

[0214] wherein the updated priority of the first action obtaining the positive reward is increased, and the updated priority of the first action obtaining the negative reward is decreased.

[0215] Optionally, the second network is a deep Q network (DQN).

[0216] Optionally, the processing module is further configured to:

[0217] obtain environment state information of the network device;

[0218] The first model is configured to determine whether the network device executes the first action in the current state.

[0219] Optionally, the first action is sending first information corresponding to the first request to a next-hop device.

[0220] Optionally, the first information includes at least one of the following: communication sensing measurement information; positioning information; navigation information; weather information; service demand information; and resource information.

[0221] Optionally, the network device includes at least one of the following: a low earth orbit (LEO) satellite; a medium earth orbit (MEO) satellite; and a highly elliptical orbit (HEO) satellite.

[0222] Optionally, the first model is a deep neural network (DNN) model.

[0223] Optionally, the first request is sent by another network device or a terminal.

[0224] Optionally, the transceiver is configured to perform at least one of the communication steps (for example, step S2101, but not limited thereto) performed by the network device 101 in any of the above methods, and details are not repeated here.

[0225] Optionally, the processing module is configured to perform at least one of the other steps (for example, steps S2102, S2103, S2104, and S2105, but not limited thereto) performed by the network device 101 in any of the above methods, and details are not repeated here.

[0226] FIG. 6A is a structural schematic diagram of a communication device 6100 according to the embodiments of the present disclosure. The communication device 6100 can be a network device (for example, an access network device, a core network device, etc.), a terminal (for example, a user equipment, etc.), a chip, a chip system, or a processor supporting the implementation of the network device in any of the above methods, or a chip, a chip system, or a processor supporting the implementation of the terminal in any of the above methods. The communication device 6100 can be used to implement the methods described in the above method embodiments, and details can be referred to the descriptions in the above method embodiments.

[0227] As shown in FIG. 6A, the communication device 6100 includes one or more processors 6101. The processor 6101 can be a general processor or a special-purpose processor, etc., for example, a baseband processor or a central processor. The baseband processor can be used to process communication protocols and communication data, the central processor can be used to control a communication apparatus (e.g., a base station, a baseband chip, a terminal device, a terminal device chip, a DU or a CU, etc.), execute programs, and process data of the programs. The communication device 6100 is configured to perform any of the above methods.

[0228] In some embodiments, the communication device 6100 further includes one or more memories 6102 configured to store instructions. Optionally, all or part of the memory 6102 can also be outside the communication device 6100.

[0229] In some embodiments, the communication device 6100 further includes one or more transceivers 6103. When the communication device 6100 includes one or more transceivers 6103, the transceiver 6103 performs at least one of the communication steps such as transmitting and / or receiving in the above methods, and the processor 6101 performs at least one of the other steps.

[0230] In some embodiments, the transceiver can include a receiver and / or a transmitter, which can be separate or integrated together. Optionally, the terms transceiver, transceiving unit, transceiver, transceiving circuit, etc. can be replaced with each other, the terms transmitter, transmitting unit, transmitter, transmitting circuit, etc. can be replaced with each other, and the terms receiver, receiving unit, receiver, receiving circuit, etc. can be replaced with each other.

[0231] In some embodiments, the communication device 6100 can include one or more interface circuits 6104. Optionally, the interface circuit 6104 is connected with the memory 6102, and the interface circuit 6104 can be used to receive signals from the memory 6102 or other devices, and can be used to send signals to the memory 6102 or other devices. For example, the interface circuit 6104 can read instructions stored in the memory 6102 and send the instructions to the processor 6101.

[0232] The communication device 6100 described in the above embodiments can be a network device or a terminal, but the scope of the communication device 6100 described in the present disclosure is not limited thereto, and the structure of the communication device 6100 can not be limited by FIG. 6A. The communication device can be a standalone device or can be part of a larger device. For example, the communication device can be: (1) a standalone integrated circuit (IC), or a chip, or a chip system or subsystem; (2) a set of one or more ICs, which can optionally also include storage components for storing data, programs; (3) an ASIC, such as a modem; (4) a module that can be embedded in other devices; (5) a receiver, a terminal device, a smart terminal device, a cellular phone, a wireless device, a handset, a mobile unit, a vehicle-mounted device, a network device, a cloud device, an artificial intelligence device, and the like; (6) other devices, and the like.

[0233] FIG. 6B is a structural diagram of a chip 6200 according to an embodiment of the present disclosure. For the case where the communication device 6100 is a chip or a chip system, the structural diagram of the chip 6200 shown in FIG. 6B can be referred to, but is not limited thereto.

[0234] The chip 6200 includes one or more processors 6201, and the chip 6200 is configured to execute any of the above methods.

[0235] In some embodiments, the chip 6200 further includes one or more interface circuits 6202. Optionally, the interface circuit 6202 is connected to the memory 6203, and the interface circuit 6202 can be configured to receive signals from the memory 6203 or other devices, and the interface circuit 6202 can be configured to send signals to the memory 6203 or other devices. For example, the interface circuit 6202 can read instructions stored in the memory 6203 and send the instructions to the processor 6201.

[0236] In some embodiments, the interface circuit 6202 performs at least one of the communication steps (such as steps S2101, S2102, S2103, but not limited thereto) in the above methods, and the processor 6201 performs at least one of the other steps.

[0237] In some embodiments, the terms interface circuit, interface, transceiver pin, and transceiver can be replaced with each other.

[0238] In some embodiments, the chip 6200 further includes one or more memories 6203 for storing instructions. Optionally, all or part of the memory 6203 can be outside the chip 6200.

[0239] The disclosure further provides a storage medium having stored instructions which, when executed on the communication device 6100, cause the communication device 6100 to perform any of the above methods. Optionally, the storage medium is an electronic storage medium. Optionally, the storage medium is a computer-readable storage medium, but is not limited thereto, and can also be a storage medium readable by other apparatuses. Optionally, the storage medium can be a non-transitory storage medium, but is not limited thereto, and can also be a transitory storage medium.

[0240] The disclosure further provides a program product which, when executed by the communication device 6100, causes the communication device 6100 to perform any of the above methods. Optionally, the program product is a computer program product.

[0241] The disclosure further provides a computer program which, when executed on a computer, causes the computer to perform any of the above methods.

[0242] In the above embodiments, all or some of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or some of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer programs. When the computer programs are loaded on a computer and executed, all or some of the processes or functions described in the embodiments of the disclosure are generated. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer programs can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer programs can be transferred from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) manner. The computer readable storage medium can be any available medium accessible by a computer or a data storage device such as a server, data center, etc. integrated with one or more available media sets. The available media can be a magnetic medium (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a high-density digital video disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD)), etc.

[0243] Those skilled in the art can clearly understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software manner depends on specific application and design constraints of the technical solutions. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present disclosure.

[0244] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.

[0245] The above is only a specific implementation of the present disclosure, but the protection scope of the present disclosure is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the present disclosure, which should be covered within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

1. A non-terrestrial communication method, characterized in that, The method is performed by a network device, and the method includes: Receive at least one first request, the first request being used to request the network device to perform a corresponding first action; Based on the priority information of each first action, at least one first action is input into the first model in descending order of priority to determine whether the network device executes the first action.

2. The method according to claim 1, characterized in that, The method further includes: The output of at least one of the first actions is input into the first model and then input into the second network. The priority ranking of the first actions is updated based on the output of the second network. Specifically, the priority of the first action that receives a positive reward increases after the update; the priority of the first action that receives a negative reward decreases after the update.

3. The method according to claim 2, characterized in that, The second network is a deep Q network (DQN).

4. The method according to any one of claims 1-3, characterized in that, The method further includes: Obtain the current environmental status information of the network device; The first model is used to determine whether the network device performs the first action in its current state.

5. The method according to any one of claims 1-4, characterized in that, The first action is to send the first information corresponding to the first request to the next hop device.

6. The method according to claim 5, characterized in that, The first information includes at least one of the following: Communication sensing measurement information; Location information; Navigation information; Weather information; Business requirements information; Resource information.

7. The method according to any one of claims 1-6, characterized in that, The network device includes at least one of the following: Low Earth Orbit (LEO) satellites; Medium Earth Orbit (MEO) satellites; Highly elliptical orbit (HEO) satellite.

8. The method according to any one of claims 1-7, characterized in that, The first model is a deep neural network (DNN) model.

9. The method according to any one of claims 1-8, characterized in that, The first request was sent by another network device or terminal.

10. A network device, characterized in that, The network device includes: The transceiver module is configured to receive at least one first request, wherein the first request is configured to request the network device to perform a corresponding first action; The processing module is configured to input at least one of the first actions into the first model in descending order of priority based on the priority information of each of the first actions, and determine whether the network device executes the first action.

11. A network device, characterized in that, The network device includes: One or more processors; The network device is used to perform the non-terrestrial communication method according to any one of claims 1-9.

12. A storage medium storing instructions, characterized in that, When the instruction is executed on the communication device, it causes the communication device to perform the non-terrestrial communication method as described in any one of claims 1-9.

Images