Control method and device

Abstract

The invention provides a control method and a related device. The method includes: generating at least one control message in a natural language form using a language model (LM), where each control message indicates a respective operation to be performed, each of the one or more control messages also indicates information related to performing the respective operation indicated by the one or more control messages; at least one piece of semantic information of the at least one control message is obtained, and each control message in the at least one control message corresponds to one piece of corresponding semantic information; forming at least one information payload comprising the at least one piece of semantic information; the at least one information payload is transmitted. By means of the control method and the related device, open vocabularies can be supported in control, particularly, more complex and more precise control over wireless equipment can be supported, more efficient and more flexible communication can be achieved, forward and backward compatibility can be supported, and a cross-modal function can be adapted.

Description

Cross-references to related applications

[0001] This application claims priority to U.S. Provisional Application No. 63 / 582,294, filed September 13, 2023. The disclosure of the aforementioned patent application is incorporated herein by reference in its entirety. Technical Field

[0002] This invention relates to the field of wireless communication technology, and in particular to a control method, apparatus, device, system, and storage medium. Background Technology

[0003] Communication can be divided into three levels: bit communication, semantic communication, and validity communication. For the past 60 years, wireless communication has primarily focused on the lowest level, bit communication—the so-called "technical problem"—ensuring the absolute accuracy of bits transmitted from the sender to the receiver. Validity communication, at the highest level, aims to achieve the ultimate goal of communication—the so-called "validity problem"—ensuring that the semantic meaning conveyed to the receiver elicits the desired behavior at the receiver.

[0004] The purpose of describing this background information is to disclose information that the applicant believes may be relevant to the present invention. It does not necessarily imply an admission, nor should any of the foregoing information be construed as constituting prior art in contrast to the present invention. Summary of the Invention

[0005] In a first aspect, embodiments of the present invention provide a control method, the method comprising:

[0006] At least one control message in natural language form is generated using a language model (LM), wherein each control message in the at least one control message indicates a corresponding operation to be performed, and each of the one or more control messages further indicates information related to performing the corresponding operation indicated by the one or more control messages, wherein the at least one control message includes the one or more control messages;

[0007] Obtain at least one semantic information from the at least one control message, wherein each control message in the at least one control message corresponds to a corresponding semantic information from the at least one semantic information;

[0008] Form at least one information payload, wherein the at least one information payload includes at least one piece of semantic information of the at least one control message;

[0009] Send the at least one information payload.

[0010] The central device generates at least one control message in natural language form and forms at least one information payload including semantic information of the at least one control message to control the user equipment. The at least one control message indicates a corresponding operation to be performed, and one or more control messages in the at least one control message also indicate information related to performing the corresponding operation. This allows for support of open vocabularies in control, particularly supporting more complex and precise control of wireless devices, enabling more efficient and flexible communication, supporting forward and backward compatibility, and accommodating cross-modal functions.

[0011] In one possible implementation of the first aspect, the LM can be a language learning model (LLM).

[0012] In one possible implementation of the first aspect, some or all of the control messages in the one or more control messages are conditional control messages or cyclic control messages. Since some or all of the control messages generated by the central device can be conditional control messages or cyclic control messages, introducing control messages in natural language forms that support conditionality and cyclicity into the system helps improve the efficiency and flexibility of the communication system.

[0013] In one possible implementation of the first aspect, each piece of information related to performing the corresponding operation is based on the result of another operation indicated by the one or more control messages. Since the control message may include information related to performing the operation, based on the result of another operation indicated by the control message, the control message can instruct the user equipment to perform the operation and the basis or conditions for performing that operation through a single control message. Compared to the traditional process (i.e., the user equipment needs to report the operation result to the central device, and then the central device instructs the user equipment to perform the next operation based on the operation result), this simplifies the communication process for control and allows for more complex and precise control of wireless devices.

[0014] In one possible implementation of the first aspect, the one or more control messages include a first control message, wherein the first control message is a conditional control message, the first control message indicating a first operation to be performed and information related to performing the first operation, the information related to performing the first operation including a first condition for performing the first operation, the first condition being based on the result of a second operation.

[0015] In one possible implementation of the first aspect, the one or more control messages include a second control message, wherein the second control message is a loop control message, the second control message indicating a third operation to be performed and information related to performing the third operation, the information related to performing the third operation including a second condition for a loop for performing the third operation, the second condition being based on the result of a fourth operation.

[0016] By including conditional control messages or cyclic control messages (where one operation is performed based on the result of another operation), more complex and dynamic control scenarios (where operations are performed based on the results of other operations) can be achieved, thereby improving the performance and energy efficiency of communication systems.

[0017] In one possible implementation of the first aspect, the at least one control message includes a plurality of control messages to be executed sequentially. By transmitting a series of control messages including a plurality of control messages sequentially, communication overhead can be reduced, thereby enabling more efficient use of the wireless channel and reducing latency when transmitting control messages from the central device to the user equipment.

[0018] In one possible implementation of the first aspect, the method further includes: obtaining registration information of a functional modality, wherein the registration information of the functional modality includes a description of the functional modality, the description being in natural language form.

[0019] In one possible implementation of the first aspect, the registration information of the functional modality further includes at least one description related to the result of the functional modality, wherein the at least one description related to the result of the functional modality is in natural language form, and each of the at least one description related to the result of the functional modality includes: a conditional description describing a condition based on the result of the functional modality; or a loop description describing a loop with a condition based on the result of the functional modality.

[0020] In one possible implementation of the first aspect, the registration information of the functional modality further includes a parameter list of the functional modality.

[0021] In one possible implementation of the first aspect, the method further includes: registering the functional modality with the LM.

[0022] Because the registration information for functional modalities includes descriptions in natural language or descriptions related to the results of the functional modality and / or a list of parameters for the functional modality, the system can adapt to cross-modal functions and support forward and backward compatibility. Descriptions related to the results of a functional modality can be used as conditions for executing another functional modality, or as conditions for loops used to execute another functional modality. In other words, the state of the result of a functional modality can be used as the basis for executing another functional modality. Furthermore, when new functional modalities are added, they can be registered along with their corresponding natural language descriptions without changing the system architecture or communication protocol, which improves the system's versatility and makes it more flexible.

[0023] In one possible implementation of the first aspect, the method further includes: recording the registration information of the functional modality. After obtaining the registration information, it can be stored locally for later use, thereby facilitating subsequent maintenance.

[0024] In one possible implementation of the first aspect, the method further includes: recording the user equipment identifier (ID) of the user equipment that has registered the functional mode or the group user equipment ID of the user equipment group that has registered the functional mode. The central device can record the user equipment ID of the user equipment or the group user equipment ID of the user equipment group, as well as the registration information, for further use, so as to more directly invoke the corresponding functional modes of different user equipment without additional communication or negotiation, thereby helping to optimize the utilization of transmission resources.

[0025] In one possible implementation of the first aspect, the method further includes: obtaining a first semantic information via an embedder based on the description of the functional modality.

[0026] In one possible implementation of the first aspect, the method further includes: obtaining at least one piece of second semantic information corresponding to each of the at least one description, based on the at least one description associated with the result of the functional modality, via an embedder.

[0027] Embedders can translate, embed, or lexicalize descriptions in natural language form into semantic information, thereby giving the semantic information a more structured and machine-readable format, and typically resulting in a smaller size compared to the natural language description. After acquiring the semantic information of the functional modality, the central device can store this semantic information locally for future use, thus eliminating the need to translate the description every time it is used. This facilitates subsequent use, reduces the processing overhead of description translation, and lowers communication latency.

[0028] In one possible implementation of the first aspect, the method further includes: storing the first semantic information and the at least one piece of second semantic information. After obtaining the first and second semantic information, this information can be stored locally for future use, thus eliminating the need to translate the description or the description related to the result of the functional modality every time it is used, thereby facilitating subsequent use, reducing the processing overhead of description translation, and reducing communication latency.

[0029] In one possible implementation of the first aspect, before forming the at least one information payload, the method further includes: determining the correlation between the semantic information of each control message in the at least one control message and multiple semantic information of a plurality of registered functional modalities, wherein the multiple semantic information of the plurality of functional modalities includes multiple first semantic information, each first semantic information corresponding to a corresponding functional modality in the plurality of functional modalities and obtained from the description of the corresponding functional modality in the plurality of functional modalities; the multiple semantic information of the plurality of functional modalities also includes at least one second semantic information, each second semantic information being obtained from a description related to the result of one of the functional modalities in the plurality of functional modalities.

[0030] In one possible implementation of the first aspect, the method further includes:

[0031] The correlation between the semantic information of the third control message and each of the plurality of semantic information is determined to be less than a threshold, wherein the at least one control message includes the third control message;

[0032] The third control message is rejected.

[0033] The central device determines whether a control message is registered by comparing the semantic information of each control message with multiple semantic information entries from multiple registered functional modalities. If the correlation between the semantic information of a control message and the semantic information of the registered functional modalities is below a threshold, the control message is determined to be unregistered, and the central device rejects it. The central device can avoid encoding or transmitting unregistered control messages and can multicast or unicast the control message only to user equipment that has registered the corresponding functional modality, thus saving power consumption for both the central device and user equipment, and conserving transmission resources.

[0034] In one possible implementation of the first aspect, obtaining the at least one piece of semantic information of the at least one control message includes:

[0035] For each of the at least one control message:

[0036] Extract the portion of each control message that does not contain any parameters;

[0037] According to the aforementioned part, a semantic piece of information for each control message is obtained through the embedder.

[0038] The generated control message may include a list of parameters (values). The central device can divide the control message into two parts: the first part includes the parameter list (if any), and the second part includes the rest of the control message. The central device only translates the second part into semantic information. Since the second part, translated into semantic information, does not include parameters (values) that may change, the semantic information of the control message can be highly correlated with the semantic information of the corresponding functional modality. This helps the central device determine whether the control message is a registered message, helps the user equipment determine the corresponding functional modality, reduces computational complexity, and helps standardize the length of the semantic information.

[0039] In one possible implementation of the first aspect, forming the at least one information payload includes:

[0040] For each of the at least one control message:

[0041] A first information payload is formed, wherein the first information payload includes the start position information of the second transmission opportunity and the length information of the semantic information of each control message;

[0042] A second information payload is formed, wherein the second information payload includes the semantic information of each control message, and the second transmission opportunity is used to transmit the second information payload.

[0043] The central device can generate a first information payload and a second information payload to transmit control messages, which helps to utilize wireless resources more efficiently and provides greater flexibility in error correction and retransmission. Since the first information payload includes the start position information of the second transmission opportunity and the length information of the semantic information, the receiving device can synchronize and correctly receive the second information payload.

[0044] In one possible implementation of the first aspect, the at least one control message includes at least one fourth control message, each fourth control message further includes a parameter list, and the first information payload of each of the at least one fourth control message further includes the parameter list.

[0045] In one possible implementation of the first aspect, the method further includes:

[0046] The second information payload is encoded using a first encoding method, wherein,

[0047] The first information payload also includes information from the first encoding method.

[0048] By including a first encoding method for encoding a second information payload in the first information payload, the user equipment can immediately identify the appropriate encoding scheme required for decoding the subsequent second information payload.

[0049] In one possible implementation of the first aspect, the method further includes: encoding the first information payload using a second encoding method.

[0050] In one possible implementation of the first aspect, the first encoding method includes a first modulation and coding scheme (MCS), and the second encoding method includes a second MCS.

[0051] In one possible implementation of the first aspect, the method further includes:

[0052] From the multiple semantic information of the registered multiple functional modalities, determine at least two semantic information related to the at least one semantic information of the at least one control message, wherein the at least two semantic information includes one or more first semantic information and one or more second semantic information;

[0053] Determine at least one user equipment ID or at least one group of user equipment IDs associated with the at least two semantic pieces of information, wherein,

[0054] The first information payload further includes the at least one user equipment ID, or the at least one group of user equipment IDs; or the first information payload further includes information indicating the at least one user equipment ID, or information indicating the at least one group of user equipment IDs.

[0055] The central device can determine the specific functional mode targeted by the control message and the corresponding user equipment (UE) or group of UE to which the control message should be sent. This ensures that the control message is delivered to the intended recipient, thereby improving the efficiency and accuracy of the communication system. Furthermore, since the first information payload includes a UE ID or group of UE IDs, or information indicating either a UE ID or group of UE IDs, the receiving UE can determine whether it is the correct recipient based on the first information payload, further improving the efficiency and accuracy of the communication system. When the receiving UE is not the intended recipient, the UE can stop decoding the second information payload, thus saving energy.

[0056] In one possible implementation of the first aspect, the method further includes: the transmission of the information payload comprising:

[0057] The first information payload is transmitted during the first transmission opportunity.

[0058] The second information payload is transmitted during the second transmission opportunity.

[0059] The central device can transmit the first information payload and the second information payload during the first and second transmission opportunities, respectively. Therefore, the central device can allocate radio resources more efficiently by assigning different transmission opportunities to each payload, thereby helping to prevent congestion and ensure smooth information transmission.

[0060] In one possible implementation of the first aspect, registering the functional modality with the LM comprises: registering the functional modality with the at least one LM by providing the registration information of the functional modality to the at least one LM, wherein the at least one LM includes the LM.

[0061] In one possible implementation of the first aspect, the method further includes: sending configuration information of at least one embedder.

[0062] In one possible implementation of the first aspect, the configuration information of the at least one embedder is sent via a broadcast message, a multicast message, or a unicast message.

[0063] One or more Learning Models (LMs) can exist, and each LM can include one or more embedders. Functional modalities can be registered to at least one of the LMs. Different LMs or embedders can be compatible with different types of communication systems or used for different application scenarios. Deploying multiple LMs on a central device can enhance the flexibility and customizability of the system. When different embedders are built based on different domains, specializing the vocabulary can significantly reduce the size and cost of the embedders, while also improving the accuracy of relevance calculations.

[0064] In one possible implementation of the first aspect, the configuration information of the at least one embedder includes the architecture and parameters of each of the at least one embedder.

[0065] The configuration information of an embedder may include the architecture and parameters of each embedder, and may also include the embedder ID of each embedder, so as to configure each embedder to the user device.

[0066] In one possible implementation of the first aspect, the configuration information of the at least one embedder includes the embedder ID of each of the at least one embedder.

[0067] The configuration information of an embedder can include the architecture and parameters of each embedder, and can also include the embedder ID of each embedder, so as to facilitate the configuration of each embedder to the user device.

[0068] In one possible implementation of the first aspect, the information payload is sent via multicast or unicast messages.

[0069] In one possible implementation of the first aspect, there are multiple LMs, wherein each of the multiple LMs has at least one embedder.

[0070] In one possible implementation of the first aspect, at least one functional mode is registered in one or more of the plurality of LMs, but not in one or more other LMs besides the one or more LMs.

[0071] In one possible implementation of the first aspect, the first LM of the plurality of LMs has a first embedder, and the second LM of the plurality of LMs does not have the first embedder.

[0072] In one possible implementation of the first aspect, the LM has a first embedder and a second embedder different from the first embedder.

[0073] Multiple LMs and / or embedders can exist. Different LMs and / or embedders can be developed by different companies and used for different specific purposes. This can reduce the size and cost of the LM, improve the effectiveness of the generated control messages, improve the resource utilization of the central device, and improve overall efficiency.

[0074] In one possible implementation of the first aspect, the method further includes: registering the LM.

[0075] In one possible implementation of the first aspect, the method further includes: registering at least one embedder of the LM.

[0076] Registration of LMs or their embedders enables the system to recognize and utilize LMs and their embedders, thereby achieving efficient natural language processing and improving system performance.

[0077] In one possible implementation of the first aspect, the order in which the corresponding control messages among the plurality of control messages are executed is indicated by the order of the corresponding control messages among the plurality of control messages. By indicating the execution order through the order of the plurality of control messages, the user equipment can perform the required operation in a predictable and expected manner.

[0078] Secondly, embodiments of the present invention provide a control method, the method comprising:

[0079] Obtain at least one information payload, wherein the at least one information payload includes at least one semantic information of at least one control message, and each control message in the at least one control message corresponds to a corresponding semantic information in the at least one semantic information;

[0080] From multiple semantic information of multiple functional modalities, at least one target semantic information corresponding to the at least one semantic information of the at least one control message is determined, wherein each target semantic information indicates a corresponding functional modality to be executed; one or more target semantic information of the at least one target semantic information also indicates information related to the execution of the corresponding functional modality, wherein the multiple functional modalities include the corresponding functional modality to be executed;

[0081] The corresponding functional mode is executed based on each of the at least one target semantic information.

[0082] User equipment (UE) can acquire an information payload including semantic information of at least one control message, wherein the at least one control message indicates a corresponding operation to be performed, and one or more control messages in the at least one control message also indicate information related to performing the corresponding operation. UE can determine at least one piece of target semantic information based on the at least one control message and can execute the corresponding functional mode. Therefore, open vocabularies can be supported in control, especially supporting more complex and precise control of wireless devices, enabling more efficient and flexible communication, supporting forward and backward compatibility, and adapting to cross-modal functions.

[0083] In one possible implementation of the second aspect, the at least one control message includes one or more control messages, each of which is a conditional control message or a cyclic control message. Since some or all of the control messages in the at least one control message generated by the central device can be conditional or cyclic control messages, introducing control messages in a natural language format that supports conditionality and cyclicity into the system helps improve the efficiency and flexibility of the communication system.

[0084] In one possible implementation of the second aspect, each piece of information related to the execution of the corresponding functional mode is based on the result of another functional mode indicated by the one or more control messages. Since the control messages can include information related to the execution of an operation based on the result of another operation indicated by the control message, the communication process can be simplified, and more complex and precise control of the wireless device can be achieved.

[0085] In one possible implementation of the second aspect, the one or more target semantic information includes first target semantic information indicating a first functional modality to be performed and information related to performing the first functional modality, wherein the information related to performing the first functional modality includes a first condition for performing the first functional modality, the first condition being based on the result of a second functional modality, and the plurality of functional modalities including the first functional modality and the second functional modality.

[0086] In one possible implementation of the second aspect, the one or more target semantic information pieces include second target semantic information indicating a third functional modality to be performed and information related to performing the third functional modality, wherein the information related to performing the third functional modality includes a second condition for a loop for performing the third functional modality, the second condition being based on the result of a fourth functional modality, and the plurality of functional modalities including the third functional modality and the fourth functional modality.

[0087] Since one or more target semantic information can include target semantic information indicating the functional modality to be performed and information related to the performance of the functional modality, wherein the information related to the performance of the functional modality includes conditions based on the result of another operation indicated by the control message, the communication process for control can be simplified and more complex and precise control of wireless devices can be achieved.

[0088] In one possible implementation of the second aspect, the multiple semantic information of the plurality of functional modalities includes multiple first semantic information corresponding to the plurality of functional modalities, each of the multiple first semantic information being obtained from a description of the corresponding functional modality in the plurality of functional modalities, wherein the description is in natural language form; the multiple semantic information of the plurality of functional modalities also includes at least one second semantic information, each of the second semantic information being obtained from a description related to the result of the functional modality in the plurality of functional modalities, wherein the description related to the result of the functional modality is in natural language form. Since at least one target semantic information is determined from the multiple semantic information and the multiple semantic information may include multiple first semantic information obtained from the description of the corresponding functional modality, and each of the one or more second semantic information is obtained from a description related to the result of the functional modality in the plurality of functional modalities, the determined target semantic information can be a combination of a first semantic information and a second semantic information, thereby supporting complex and precise control of the wireless device.

[0089] In one possible implementation of the second aspect, the one or more target semantic information pieces respectively include first target semantic information indicating the corresponding function to be performed and second target semantic information indicating information related to performing the corresponding function mode. Since each of the one or more target semantic information pieces can indicate the corresponding function to be performed, as well as information related to performing the corresponding function mode, complex and precise control of the wireless device can be supported.

[0090] In one possible implementation of the second aspect, before obtaining the at least one information payload, the method further includes: encapsulating each of the plurality of functional modalities into a calling function to obtain a plurality of calling functions, wherein each of the plurality of calling functions includes a description of the corresponding functional modality, the description being in natural language form; one or more of the plurality of calling functions further include at least one of the following: a parameter list of the corresponding functional modality or at least one description related to the result of the corresponding functional modality, wherein the at least one description related to the result of the functional modality is in natural language form and includes: a conditional description describing conditions based on the result of the corresponding functional modality; and / or a loop description describing a loop with conditions based on the result of the corresponding functional modality.

[0091] In one possible implementation of the second aspect, the calling function includes an application programming interface (API) calling function.

[0092] Because each functional modality can be encapsulated as a function call (such as an API call function), the functional modality can be executed by calling that function. Function calls can be implemented in various programming languages. By encapsulating each functional modality as a function call, it facilitates easier integration and use with different programming languages ​​and promotes interoperability between different systems or components that may be developed using different technologies.

[0093] In one possible implementation of the second aspect, before acquiring the at least one information payload, the method further includes: sending registration information for each of the plurality of functional modalities, wherein the registration information for each functional modality includes the description of each functional modality.

[0094] In one possible implementation of the second aspect, the registration information for each of one or more of the plurality of functional modalities further includes at least one of the following: a parameter list for each of the one or more functional modalities or at least one description related to the result of each of the one or more functional modalities, wherein the at least one description related to the result of each of the one or more functional modalities is in natural language form and includes: a conditional description describing conditions based on the result of each of the one or more functional modalities; and / or a loop description describing a loop with conditions based on the result of each of the one or more functional modalities.

[0095] Because the registration information for functional modalities includes descriptions in natural language or at least one of the following: a parameter list or at least one description related to the results of the functional modality, the system can adapt to cross-modal functions and support more complex control of wireless devices, as well as forward and backward compatibility. Furthermore, when new functional modalities are added, they can be registered along with their corresponding natural language descriptions without changing the system architecture or communication protocol, which improves the system's versatility and makes it more flexible.

[0096] In one possible implementation of the second aspect, the method further includes: decoding the at least one information payload.

[0097] In one possible implementation of the second aspect, each information payload in the at least one information payload includes:

[0098] The first information payload is acquired during the first transmission opportunity of the corresponding control message, and includes the start position information of the second transmission opportunity of the corresponding control message and the length information of the semantic information of the corresponding control message.

[0099] The second information payload is acquired during the second transmission opportunity of the corresponding control message and includes the semantic information of the corresponding control message.

[0100] In one possible implementation of the second aspect, decoding each of the at least one information payload includes:

[0101] The first information payload is decoded to obtain the starting position information of the second transmission opportunity and the length information of the semantic information of the corresponding control message;

[0102] The second information payload is decoded to obtain the semantic information of the corresponding control message.

[0103] User equipment can acquire the first information payload and the second information payload during the first transmission opportunity and the second transmission opportunity, respectively. Therefore, by allocating different transmission opportunities for each payload, radio resources can be allocated more efficiently, and the process of acquiring and decoding the information payload ensures reliable retrieval of the semantic information of the control message.

[0104] In one possible implementation of the second aspect, the at least one control message includes a plurality of control messages to be executed sequentially. By transmitting a series of control messages including multiple control messages sequentially, communication overhead can be reduced, thereby enabling more efficient use of the wireless channel and reducing latency when transmitting control messages from the central device to the user equipment.

[0105] In one possible implementation of the second aspect, the method further includes: when the decoding of the information payload including a semantic information of a second control message among the plurality of control messages fails, or when the execution of a functional mode indicated by a target semantic information of the second control message among the plurality of control messages fails, the information payload including a semantic information of a first control message among the plurality of control messages is not decoded, wherein, in the order stated, the second control message precedes the first control message. If the decoding of the information payload including a semantic information of a control message fails, or when the execution of a functional mode indicated by a target semantic information of a control message fails, subsequent control messages are not decoded. Thus, the system can avoid unnecessary processing and reduce the risk of errors. This can improve overall system performance and reliability, ensuring that the user equipment follows the expected operating sequence and that the user equipment only executes instructions that it can correctly understand and execute.

[0106] In one possible implementation of the second aspect, the first information payload of each of the at least one information payload further includes: a parameter list of the corresponding control message.

[0107] In one possible implementation of the second aspect, the first information payload further includes information about a first encoding method, and the second information payload is decoded using the first encoding method. By including the first encoding method for encoding the second information payload in the first information payload, the user equipment can immediately identify a suitable encoding scheme required for decoding the subsequent second information payload.

[0108] In one possible implementation of the second aspect, a second encoding method is used to decode the first information payload.

[0109] In one possible implementation of the second aspect, the first encoding method includes a first modulation and coding scheme (MCS), and the second encoding method includes a second MCS.

[0110] In one possible implementation of the second aspect, the first information payload further includes: information indicating a user equipment ID or information indicating a group of user equipment IDs.

[0111] In one possible implementation of the second aspect, the method further includes: in response to determining that the user equipment ID or the group user equipment ID does not match the user equipment ID or group user equipment ID of the user equipment, not decoding the second information payload.

[0112] Since the first information payload includes information indicating the user equipment ID or information indicating the group user equipment ID, the user equipment can determine whether it is the correct receiver based on the first information payload, thereby improving the efficiency and accuracy of the communication system.

[0113] In one possible implementation of the second aspect, the method further includes: obtaining configuration information for at least one embedder. Using the configuration information of the at least one embedder, the at least one embedder can be configured to the user device, which can then use the at least one embedder to translate the description of the functional modality into semantic information.

[0114] In one possible implementation of the second aspect, the at least one semantic information of the at least one control message is obtained through a first embedder among the at least one embedder, and the multiple semantic information of the multiple functional modalities is obtained through the first embedder. Since the user equipment can compare the semantic information of the control message with candidate semantic information obtained using the same embedder, the accuracy and reliability of the comparison results are improved.

[0115] In one possible implementation of the second aspect, the configuration information of the at least one embedder includes the embedder ID of each of the at least one embedder. By including the embedder ID of each of the at least one embedder in the configuration, it is easier to track and manage specific embedders that are in use or that need to be updated or maintained.

[0116] In one possible implementation of the second aspect, the multiple semantic information pieces of the multiple functional modalities are stored after acquisition. The user equipment can store the acquired semantic information of the multiple functional modalities, enabling the user equipment to quickly access and utilize this semantic information when needed.

[0117] In one possible implementation of the second aspect, the multiple semantic information items of the plurality of functional modalities are acquired by the first embedder before each determination of the at least one target semantic information item corresponding to the at least one semantic information item of the at least one control message. The user equipment can acquire the semantic information of the plurality of functional modalities whenever needed, thereby reducing the storage requirements of the user equipment.

[0118] In one possible implementation of the second aspect, the order in which the plurality of control messages are executed is indicated by the order of the respective control messages within the plurality of control messages. By indicating the execution order through the order of the plurality of control messages, the user equipment can perform the required operation in a predictable and expected manner.

[0119] Thirdly, embodiments of the present invention provide a first apparatus comprising modules for performing the control method according to the first aspect or any possible implementation thereof.

[0120] Fourthly, embodiments of the present invention provide a second apparatus comprising modules for performing the control method according to the second aspect or any possible implementation thereof.

[0121] Fifthly, embodiments of the present invention provide a third apparatus, including a processing circuit for performing the control method according to the first aspect or any possible implementation thereof.

[0122] In a sixth aspect, embodiments of the present invention provide a fourth apparatus, including a processing circuit for performing the control method according to the second aspect or any possible implementation thereof.

[0123] In a seventh aspect, embodiments of the present invention provide a communication system including a first device according to a third aspect or a third device according to a fifth aspect, and a second device according to a fourth aspect or a fourth device according to a sixth aspect.

[0124] Eighthly, embodiments of the present invention provide a computer-readable medium storing computer-executable instructions, which, when executed by a processor, cause the processor to perform the control method according to the first aspect or any possible implementation thereof, or according to the second aspect or any possible implementation thereof.

[0125] In a ninth aspect, embodiments of the present invention provide a computer program product including computer execution instructions, which, when executed by a processor, cause the processor to perform the control method according to the first aspect or any possible implementation thereof, or according to the second aspect or any possible implementation thereof.

[0126] This invention provides a control method and related apparatus. The method involves generating at least one control message in natural language form using a programming model (LM), wherein each control message indicates a corresponding operation to be performed, and each of the one or more control messages further indicates information related to performing the corresponding operation indicated by the one or more control messages, the at least one control message comprising the one or more control messages; acquiring at least one piece of semantic information from the at least one control message, wherein each control message corresponds to a corresponding piece of semantic information in the at least one piece of semantic information; forming at least one information payload, wherein the at least one information payload comprises the at least one piece of semantic information from the at least one control message; and transmitting the at least one information payload. This allows for support of open vocabularies in control, particularly supporting more complex and precise control of wireless devices, enabling more efficient and flexible communication, supporting forward and backward compatibility, and adapting to cross-modal functions. Attached Figure Description

[0127] The following figures illustrate exemplary embodiments of the present invention by way of example, in which:

[0128] Figure 1 This is a simplified schematic diagram of a communication system according to one or more embodiments of the present invention.

[0129] Figure 2 This is a schematic diagram of an exemplary communication system according to one or more embodiments of the present invention.

[0130] Figure 3 This is a schematic diagram of the basic component structure of a communication system according to one or more embodiments of the present invention.

[0131] Figure 4 This is a block diagram of a device in a communication system according to one or more embodiments of the present invention.

[0132] Figure 5 This is a schematic diagram of a communication system.

[0133] Figure 6 This is a communication diagram between the central equipment and the first user equipment.

[0134] Figure 7This is a schematic diagram of an LLM model according to one or more embodiments of the present invention.

[0135] Figure 8 A schematic flowchart of a control method according to one or more exemplary embodiments of the present invention is shown.

[0136] Figure 9 A schematic flowchart of a control method according to one or more exemplary embodiments of the present invention is shown.

[0137] Figure 10 A schematic flowchart of a registration process according to one or more embodiments of the present invention is shown.

[0138] Figure 11 This is a schematic diagram of a central device according to one or more embodiments of the present invention.

[0139] Figure 12 This is a schematic diagram of the configuration of an embedder according to one or more embodiments of the present invention.

[0140] Figure 13 This is a schematic diagram of a functional mode according to one or more embodiments of the present invention.

[0141] Figure 14 This is a schematic diagram of a functional mode according to one or more embodiments of the present invention.

[0142] Figure 15 This is a schematic diagram illustrating an example of obtaining semantic vectors according to one or more embodiments of the present invention.

[0143] Figure 16 This is a schematic diagram illustrating an example of a user equipment notifying a central device of registration information for a functional mode according to one or more embodiments of the present invention.

[0144] Figure 17 This is a schematic diagram illustrating an example of a central device registration function mode according to one or more embodiments of the present invention.

[0145] Figure 18 This is a schematic diagram illustrating an example of a central device recording a second user device according to one or more embodiments of the present invention.

[0146] Figure 19 This is a schematic diagram illustrating an example of generating control messages according to one or more embodiments of the present invention.

[0147] Figure 20 This is a schematic diagram illustrating an example of a correlation comparison process according to one or more embodiments of the present invention.

[0148] Figure 21This is a schematic diagram illustrating an example of a central device encoding and transmitting open-voc control messages in two transmission opportunities according to one or more embodiments of the present invention.

[0149] Figure 22 This is a schematic diagram illustrating an example of a user equipment decoding and receiving open-voc control messages in two transmission opportunities according to one or more embodiments of the present invention.

[0150] Figure 23 This is a schematic diagram illustrating an example of a user equipment execution process according to one or more embodiments of the present invention.

[0151] Figure 24 This is a schematic diagram of another functional mode according to one or more embodiments of the present invention.

[0152] Figure 25 This is a schematic diagram illustrating an example of obtaining semantic vectors according to one or more embodiments of the present invention.

[0153] Figure 26 This is a schematic diagram illustrating another example of a user equipment notifying a central device of registration information for a functional mode according to one or more embodiments of the present invention.

[0154] Figure 27 This is a schematic diagram of another example of a central device registration function modality according to one or more embodiments of the present invention.

[0155] Figure 28 This is a schematic diagram illustrating an example of a user equipment execution process according to one or more embodiments of the present invention.

[0156] Figure 29 A schematic diagram of the structure of a first device according to one or more exemplary embodiments of the present invention is shown.

[0157] Figure 30 A schematic diagram of the structure of a second device according to one or more exemplary embodiments of the present invention is shown. Detailed Implementation

[0158] To more clearly describe the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings required for describing the embodiments or the prior art are briefly introduced below.

[0159] In the following description, reference is made to the accompanying drawings, which form part of this invention, and which illustrate by way of description specific aspects of embodiments of the invention or aspects in which embodiments of the invention may be used. It should be understood that embodiments of the invention can be used in other aspects and include structural or logical variations not depicted in the drawings. Therefore, the following detailed description should not be construed in a limiting sense, and the scope of the invention is defined by the appended claims.

[0160] To more clearly describe the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings required for describing the embodiments or the prior art are briefly introduced below.

[0161] Communication can be divided into three levels: bit communication, semantic communication, and validity communication. For the past 60 years, wireless communication has primarily focused on the lowest level, bit communication—the so-called "technical problem"—ensuring the absolute accuracy of bits transmitted from the sender to the receiver. Validity communication, at the highest level, aims to achieve the ultimate goal of communication—the so-called "validity problem"—ensuring that the semantic meaning conveyed to the receiver elicits the desired behavior at the receiver.

[0162] Wireless communication systems rely heavily on pre-negotiated (standardized) control message content and format, which can lead to forward and / or backward compatibility issues between different communication systems.

[0163] For illustrative purposes, specific exemplary embodiments are explained in detail below with reference to the accompanying drawings.

[0164] The embodiments described herein illustrate information sufficient for practice and explain methods for practicing this subject matter. Upon reading the following description with reference to the accompanying drawings, those skilled in the art will understand the concepts of the claimed subject matter and recognize that the application of these concepts is not specifically mentioned herein. It should be understood that these concepts and applications are within the scope of this invention and the appended claims.

[0165] Furthermore, it should be understood that any module, component, or device disclosing executable instructions herein may include or otherwise access one or more non-transitory computer / processor-readable storage media for storing information, such as computer / processor-readable instructions, data structures, program modules, and / or other data. A non-exhaustive list of examples of non-transitory computer / processor-readable storage media includes: magnetic tape cassettes, magnetic tape, disk storage, or other magnetic storage devices; compact disc read-only memory (CD-ROM), digital video disc or digital multifunction disc (i.e., DVD), Blu-ray disc™, or other optical storage devices; volatile and non-volatile, removable and non-removable media, random-access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory, or other storage technologies implemented in any method or technology. Any such non-transitory computer / processor storage medium may be part of, or accessed by, a device / apparatus. Computer / processor-readable / executable instructions used to implement the methods, applications, or modules described herein may be stored by such non-transitory computer / processor-readable storage media or otherwise preserved.

[0166] Furthermore, in this invention, when used in conjunction with the terms "comprising" or "including" in the claims and / or specification, the words "a" or "an" may refer to "one," but also have the same meaning as "one or more," "at least one," and "one or more," unless explicitly stated otherwise. Similarly, the word "another" may refer to at least a second or more, unless explicitly stated otherwise.

[0167] The terms “coupled to,” “coupled,” or “connected” as used herein may have several different meanings depending on the context in which they are used. For example, as used herein, the terms “coupled to,” “coupled,” or “connected” may indicate that two elements or devices are directly connected to each other, or are mechanically connected to each other via one or more intermediate elements or devices, depending on the specific context. The term “and / or” as used herein, when associated with a list of multiple items, means to include any one or more of the items that make up the list.

[0168] This invention provides a two-stage control message passing system method and apparatus for a wireless system. The wireless system includes a central device (also called a core device, such as a base station, core network, etc.) and at least one user equipment (such as a UE or other device). The following example illustrates a scenario where the central device transmits partial control messages to the user equipment. It should be noted that the scenario where the user equipment transmits partial control messages to the central device can be included in this invention in the same manner.

[0169] Figure 1 This is a simplified schematic diagram of a communication system according to one or more embodiments of the present invention.

[0170] refer to Figure 1 A simplified schematic diagram of a communication system is provided as an illustrative, not limiting, example. Communication system 100 (which may be...) Figure 1 The wireless system 100 includes a radio access network 120. The radio access network 120 can be a next-generation (e.g., sixth-generation, 6G or later) radio access network, or a traditional (e.g., 5G, 4G, 3G or 2G) radio access network. One or more communication electronic devices (EDs) 110a, 110b, 110c, 110d, 110e, 110f, 110g, 110h, 110i, 110j (commonly referred to as 110) can interconnect with each other or connect to one or more network nodes (170a, 170b, commonly referred to as 170) within the radio access network 120. A core network 130 can be part of the communication system 100 and can depend on or be independent of the radio access technology used in the communication system 100. Furthermore, the communication system 100 includes a public switched telephone network (PSTN) 140, the Internet 150, and other networks 160.

[0171] Uplink messages / data transmitted between the central device (e.g., network node 170) and the sensing device (e.g., ED 180) can be carried in higher-level signaling such as RRC signaling or MAC layer signaling. Alternatively, these messages / data can be carried in physical layer signaling (e.g., UCI). Alternatively, these messages / data can be carried in a combination of higher-level signaling and physical signaling. It should be noted that "message" in this invention can be replaced with "information," which can be carried in a single message or more than one single message. Downlink messages / data transmitted between the central device and ED 110 can be carried in higher-level signaling such as RRC signaling or MAC layer signaling. Alternatively, these messages / data can be carried in physical layer signaling (e.g., UCI). Alternatively, these messages / data can be carried in a combination of higher-level signaling and physical signaling. It should be noted that "message" in this invention can be replaced with "information," which can be carried in a single message or more than one single message.

[0172] A custom network energy-saving implementation method could be considered, in which operators manually perform energy saving based on heuristics, traffic load management and balancing.

[0173] Figure 2 This is a schematic diagram of an exemplary communication system according to one or more embodiments of the present invention.

[0174] Figure 2 An exemplary communication system 100 is illustrated. Generally, the communication system 100 enables multiple wireless or wired components to transmit data and other content. The purpose of the communication system 100 may be to provide content such as voice, data, video, and / or text via broadcast, multicast, and unicast. The communication system 100 can operate by sharing resources such as carrier spectrum bandwidth among its constituent components. The communication system 100 may include terrestrial communication systems and / or non-terrestrial communication systems. The communication system 100 can provide a wide range of communication services and applications (e.g., earth monitoring, remote sensing, passive sensing and positioning, navigation and tracking, autonomous delivery and mobility, etc.). The communication system 100 can provide high availability and robustness through the joint operation of terrestrial and non-terrestrial communication systems. For example, integrating a non-terrestrial communication system (or components thereof) into a terrestrial communication system can create a heterogeneous network that can be considered as comprising multiple layers. Compared to traditional communication networks, heterogeneous networks can achieve better overall performance through efficient multi-link joint operation, more flexible function sharing, and faster physical layer link switching between terrestrial and non-terrestrial networks.

[0175] Terrestrial communication systems and non-terrestrial communication systems can be considered subsystems of a communication system. Figure 2In the example shown, communication system 100 includes electronic devices (EDs) 110a, 110b, 110c, and 110d (commonly referred to as ED110), radio access networks (RANs) 120a and 120b, a non-terrestrial communication network 120c, a core network 130, a public switched telephone network (PSTN) 140, the Internet 150, and other networks 160. RANs 120a and 120b include corresponding base stations (BSs) 170a and 170b, which are commonly referred to as terrestrial transmit and receive points (T-TRPs) 170a and 170b. The non-terrestrial communication network 120c includes an access node 172, which is commonly referred to as a non-terrestrial transmit and receive point (NT-TRP) 172. Based on the similarity of the reference numerals in the attached figures, it can be inferred that the non-terrestrial communication network 120c can be considered a radio access network, and its operation is similar to that of RAN 120a and 120b. The non-terrestrial communication network 120c may include at least one non-terrestrial network (NTN) device and at least one corresponding terrestrial network device, wherein the at least one NTN device acts as a transport layer device, and the at least one corresponding terrestrial network device acts as a radio access network node, which communicates with the ED through the NTN device.

[0176] Alternatively or additionally, any ED 110 can be used to connect, access, or communicate with any T-TRP 170a, 170b, NT-TRP 172, Internet 150, core network 130, PSTN 140, other network 160, or any combination thereof. In some examples, ED 110a can perform uplink and / or downlink transmissions with T-TRP 170a via terrestrial air interface 190a. In some examples, ED 110a, 110b, 110c, and 110d can also communicate directly with each other via one or more sidelink air interfaces 190b. In some examples, ED 110d can perform uplink and / or downlink transmissions with NT-TRP 172 via non-terrestrial air interface 190c.

[0177] Air interfaces 190a and 190b can use similar communication technologies, such as any suitable wireless access technology. For example, communication system 100 can implement one or more channel access methods in air interfaces 190a and 190b, such as code division multiple access (CDMA), space division multiple access (SDMA), time division multiple access (TDMA), frequency division multiple access (FDMA), orthogonal FDMA (OFDMA), or single-carrier FDMA (SC-FDMA), also known as discrete Fourier transform spread OFDMA (DFT-s-OFDMA). Air interfaces 190a and 190b can utilize other higher-dimensional signal spaces, which may involve combinations of orthogonal and / or non-orthogonal dimensions.

[0178] The non-terrestrial air interface 190c enables communication between the ED 110d and one or more NT-TRP 172s via a wireless link or simply via a link. In some examples, the link is a dedicated connection for unicast transmission, a connection for broadcast transmission, or a connection between a group of ED 110s and one or more NT-TRP 172s for multicast transmission.

[0179] RANs 120a and 120b communicate with core network 130 to provide various services, such as voice, data, and other services, to EDs 110a, 110b, and 110c. RANs 120a and 120b and / or core network 130 may communicate directly or indirectly with one or more other RANs (not shown), which may or may not be directly served by core network 130, and may or may not use the same radio access technology as RANs 120a, RAN 120b, or both. Core network 130 may also serve as a gateway access between (i) RANs 120a and 120b or EDs 110a, 110b, and 110c, or both, and (ii) other networks (e.g., PSTN 140, Internet 150, and other networks 160). Additionally, some or all of the EDs in EDs 110a, 110b, and 110c may include the ability to communicate with different wireless networks via different radio links using different radio technologies and / or protocols. ED 110a, 110b, and 110c can communicate with a service provider or exchange (not shown) via a wired communication channel and with the Internet 150, but not wirelessly (or also wirelessly). PSTN 140 may include a circuit-switched telephone network for providing plain old telephone service (POTS). The Internet 150 may include a network of computers and / or subnets (intranets) and incorporate protocols such as Internet Protocol (IP), Transmission Control Protocol (TCP), and User Datagram Protocol (UDP). ED 110a, 110b, and 110c may be multimode devices capable of operating under various wireless access technologies and may include multiple transceivers supporting such operation.

[0180] Figure 3 This is a schematic diagram of the basic component structure of a communication system according to one or more exemplary embodiments of the present invention.

[0181] Figure 3Another example of an ED 110 and base stations 170a, 170b, and / or 170c is shown. The ED 110 is used to connect people, objects, machines, etc. The ED 110 can be widely used in various scenarios, such as cellular communication, device-to-device (D2D), vehicle-to-everything (V2X), peer-to-peer (P2P), machine-to-machine (M2M), machine-type communications (MTC), Internet of Things (IoT), virtual reality (VR), augmented reality (AR), mixed reality (MR), metaverse, digital twins, industrial control, autonomous driving, telemedicine, smart grids, smart furniture, smart offices, smart wearables, smart transportation, smart cities, drones, robots, remote sensing, passive sensing, positioning, navigation and tracking, autonomous delivery, and mobility, etc.

[0182] Each ED 110 represents any suitable end-user equipment for wireless operation and may include (or be referred to as): user equipment / device (UE), wireless transmit / receive unit (WTRU), mobile station, fixed or mobile subscriber unit, cellular phone, station (STA), machine-type communication (MTC) device, personal digital assistant (PDA), smartphone, laptop, computer, tablet, wireless sensor, consumer electronics, smartbook, vehicle, automobile, truck, bus, train, or IoT device, wearable device (such as watch, glasses, head-mounted device, etc.), industrial equipment, or means of the above devices or constituting the above devices (e.g., communication module, modem, or chip), etc. Future generations of ED 110 may be referred to using other terms. Base stations 170a and 170b are T-TRPs, referred to below as T-TRP 170. Alternatively... Figure 3As shown, NT-TRP is referred to as NT-TRP 172 below. Each ED 110 connected to T-TRP 170 and / or NT-TRP 172 can be dynamically or semi-statically turned on (i.e., established, activated, or enabled), turned off (i.e., released, deactivated, or disabled), and / or configured in response to one or more of connectivity availability and connectivity necessity.

[0183] ED 110 includes a transmitter 201 and a receiver 203 coupled to one or more antennas 204. Only one antenna 204 is shown in the figure to avoid congestion. One, some, or all of the antennas 204 may also be panels. The transmitter 201 and receiver 203 may be integrated as a transceiver, etc. The transceiver is used to modulate data or other content for transmission through at least one antenna 204 or a network interface controller (NIC). The transceiver is also used to demodulate data or other content received through at least one antenna 204. Each transceiver includes any suitable structure for generating signals for wireless or wired transmission and / or for processing signals received wirelessly or wiredly. Each antenna 204 includes any suitable structure for transmitting and / or receiving wireless or wired signals.

[0184] ED 110 includes at least one memory 208. Memory 208 stores instructions and data used, generated, or collected by ED 110. For example, memory 208 may store software instructions or modules executed by one or more processing units (e.g., processor 210) for implementing some or all of the functions and / or embodiments described herein. Each memory 208 includes any suitable one or more volatile and / or non-volatile storage and retrieval devices. Any suitable type of memory can be used, such as random access memory (RAM), read-only memory (ROM), hard disk, optical disk, subscriber identity module (SIM) card, memory stick, secure digital (SD) memory card, on-processor cache, etc.

[0185] ED 110 may also include one or more input / output devices (not shown) or interfaces (e.g., Figure 1(Wired interface of Internet 150 in the network). Input / output devices or interfaces support interaction with users or other devices in the network. Each input / output device or interface includes any suitable structure for providing or receiving information from the user and / or for network interface communication. For example, suitable structures include speakers, microphones, keypads, keyboards, displays, touchscreens, etc.

[0186] ED 110 includes a processor 210 for performing operations including: operations related to preparing uplink transmissions to NT-TRP 172 and / or T-TRP 170; operations related to processing downlink transmissions received from NT-TRP 172 and / or T-TRP 170; and operations related to processing sidelink transmissions to and from another ED 110. Processing operations related to preparing uplink transmissions may include operations such as encoding, modulation, transmit beamforming, and generating symbols for transmission. Processing operations related to processing downlink transmissions may include operations such as receive beamforming, demodulation, and decoding of received symbols. According to an embodiment, the downlink transmissions may be received by receiver 203 (possibly using receive beamforming), and processor 210 may extract signaling from the downlink transmissions (e.g., by detecting and / or decoding signaling). Examples of signaling may be reference signals transmitted by NT-TRP 172 and / or T-TRP 170. In some embodiments, processor 210 performs transmit beamforming and / or receive beamforming based on beam direction indication (e.g., beam angle information (BAI)) received from T-TRP 170. In some embodiments, processor 210 may perform operations related to network access (e.g., initial access) and / or downlink synchronization, such as operations related to detecting synchronization sequences, decoding, and acquiring system information. In some embodiments, processor 210 may perform channel estimation using reference signals received from NT-TRP 172 and / or T-TRP 170.

[0187] Although not shown, processor 210 may be part of transmitter 201 and / or receiver 203. Although not shown, memory 208 may be part of processor 210.

[0188] The processor 210, the processing components of the transmitter 201, and the processing components of the receiver 203 may each be implemented by the same or different one or more processors for executing instructions stored in memory (e.g., memory 208). Alternatively, some or all of the processing components of the processor 210, the transmitter 201, and the receiver 203 may be implemented using hardware accelerators such as a programmable field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), a graphics processing unit (GPU), or an artificial intelligence (AI) accelerator.

[0189] In some implementations, the T-TRP 170 may have other names, such as base station, basetransceiver station (BTS), wireless base station, network node, network device, network-side device, transmit / receive node, NodeB, evolved NodeB (eNodeB or eNB), home eNodeB, next-generation NodeB (gNB), transmission point (TP), site controller, access point (AP), wireless router, relay station, ground node, ground network device, ground base station, baseband unit (BBU), remote radio unit (RRU), active antenna unit (AAU), remote radio head (RRH), central unit (CU), distributed unit (DU), positioning node, etc. The T-TRP 170 can be a macro BS, pico BS, relay node, host node, or a combination thereof. T-TRP 170 may refer to the aforementioned equipment or to a component within the aforementioned equipment (e.g., a communication module, modem, or chip).

[0190] In some embodiments, the various parts of T-TRP 170 may be distributed. For example, some modules in T-TRP 170 may be located remotely from the device housing the antenna 256 of T-TRP 170 and may be coupled to the device housing the antenna 256 via a communication link (not shown) sometimes referred to as a fronthaul (such as a common public radio interface (CPRI)). Therefore, in some embodiments, the term "T-TRP 170" may also refer to network-side modules that perform processing operations such as determining the location of ED 110, resource allocation (scheduling), message generation, and encoding / decoding, which are not necessarily part of the device housing the antenna 256 of T-TRP 170. These modules may also be coupled to other T-TRPs. In some embodiments, T-TRP 170 may actually be multiple T-TRPs operating together to serve ED 110 through cooperative multicast and other methods.

[0191] T-TRP 170 includes at least one transmitter 252 and at least one receiver 254 coupled to one or more antennas 256. Only one antenna 256 is shown in the figure to avoid congestion. One, some, or all of the antennas 256 may also be panels. The transmitter 252 and receiver 254 may be integrated as a transceiver. T-TRP 170 also includes a processor 260 for performing operations related to: preparing downlink transmissions to be transmitted to ED 110, processing uplink transmissions received from ED 110, preparing backhaul transmissions to be transmitted to NT-TRP 172, and processing transmissions received from NT-TRP 172 via backhaul. Processing operations related to preparing downlink or backhaul transmissions may include operations such as encoding, modulation, precoding (e.g., multiple-input multiple-output (MIMO) precoding), transmit beamforming, and generating symbols for transmission. Processing operations related to transmissions received in the uplink or via backhaul may include receiving beamforming, demodulating received symbols, and decoding received symbols. Processor 260 may also perform operations related to network access (e.g., initial access) and / or downlink synchronization, such as generating the contents of a synchronization signal block (SSB) and generating system information. In some embodiments, processor 260 also generates a beam direction indication, such as a BAI, which can be scheduled for transmission by scheduler 253. Processor 260 may perform other network-side processing operations described herein, such as determining the location of ED 110 and determining the deployment location of NT-TRP 172. In some embodiments, processor 260 may generate signaling to configure one or more parameters of ED 110 and / or one or more parameters of NT-TRP 172. Any signaling generated by processor 260 is transmitted by transmitter 252. It should be noted that the term "signaling" as used herein may also be referred to as control signaling. Signaling can be transmitted in physical layer control channels (e.g., physical downlink control channel (PDCCH)). In this case, the signaling can be called dynamic signaling. Signaling transmitted in the downlink physical layer control channel can be called downlink control information (DCI). Signaling transmitted in the uplink physical layer control channel can be called uplink control information (UCI). Signaling transmitted in the sidelink physical layer control channel can be called sidelink control information (SCI).Signaling can be included in higher-layer (e.g., above the physical layer) data packets transmitted in physical layer data channels (e.g., physical downlink shared channel, PDSCH). In this case, the signaling can be called higher-layer signaling, static signaling, or semi-static signaling. Higher-layer signaling can also refer to radio resource control (RRC) protocol signaling or media access control-control element (MAC-CE) signaling.

[0192] Scheduler 253 may be coupled to processor 260. Scheduler 253 may be included within T-TRP 170 or may operate separately from T-TRP 170. Scheduler 253 may schedule uplink, downlink, lateral link, and / or backlink transmissions, including issuing scheduling authorizations and / or configuring schedule-free (e.g., "configured authorization") resources. T-TRP 170 also includes memory 258 for storing information and data. Memory 258 stores instructions and data used, generated, or collected by T-TRP 170. For example, memory 258 may store software instructions or modules executed by processor 260 for implementing some or all of the functions and / or embodiments described herein.

[0193] Although not shown, processor 260 may be part of transmitter 252 and / or receiver 254. Furthermore, although not shown, processor 260 may implement scheduler 253. Although not shown, memory 258 may be part of processor 260.

[0194] The processing components of processor 260, scheduler 253, transmitter 252, and receiver 254 may each be implemented by the same or different one or more processors for executing instructions stored in memory (e.g., memory 258). Alternatively, some or all of the processing components of processor 260, scheduler 253, transmitter 252, and receiver 254 may be implemented using dedicated circuitry such as a programmable FPGA, hardware accelerator (e.g., GPU or AI accelerator), or ASIC.

[0195] Although the NT-TRP 172 is shown as an example of a drone only, it can be implemented in any suitable non-terrestrial form, such as satellites and high-altitude platforms including international mobile communication base stations and unmanned aerial vehicles. Furthermore, in some implementations, the NT-TRP 172 may have other names, such as a non-terrestrial node, a non-terrestrial network device, or a non-terrestrial base station. The NT-TRP 172 includes a transmitter 272 and a receiver 274 coupled to one or more antennas 280. Only one antenna 280 is shown in the figure to avoid congestion. One, some, or all of the antennas may also be panels. The transmitter 272 and receiver 274 may be integrated as a transceiver. The NT-TRP 172 also includes a processor 276 for performing operations related to: preparing downlink transmissions to be sent to ED 110, processing uplink transmissions received from ED 110, preparing backhaul transmissions to be sent to T-TRP 170, and processing transmissions received from T-TRP 170 via backhaul. Processing operations related to preparing downlink or backhaul transmissions may include operations such as encoding, modulation, precoding (e.g., MIMO precoding), transmit beamforming, and generating symbols for transmission. Processing operations related to processing transmissions received in the uplink or via backhaul may include operations such as receive beamforming, demodulating received symbols, and decoding received symbols. In some embodiments, processor 276 performs transmit beamforming and / or receive beamforming based on beam direction information (e.g., BAI) received from T-TRP 170. In some embodiments, processor 276 may generate signaling to configure one or more parameters of ED 110. In some embodiments, NT-TRP 172 implements physical layer processing but does not implement higher-level functions such as medium access control (MAC) or radio link control (RLC) layer functions. Since this is only an example, in general, NT-TRP 172 may implement higher-level functions in addition to physical layer processing.

[0196] The NT-TRP 172 also includes a memory 278 for storing information and data. Although not shown, a processor 276 may form part of the transmitter 272 and / or the receiver 274. Although not shown, the memory 278 may form part of the processor 276.

[0197] The processing components of processor 276, transmitter 272, and receiver 274 can each be implemented by the same or different one or more processors for executing instructions stored in memory (e.g., memory 278). Alternatively, some or all of the processing components of processor 276, transmitter 272, and receiver 274 can be implemented using dedicated circuitry such as a programmable FPGA, hardware accelerator (e.g., GPU or AI accelerator), or ASIC. In some embodiments, NT-TRP 172 can actually be multiple NT-TRPs operating together to serve ED110 via cooperative multicast or similar methods.

[0198] T-TRP 170, NT-TRP 172 and / or ED 110 may include other components, but these components have been omitted for clarity.

[0199] One or more steps of the methods in the embodiments provided herein can be derived from... Figure 4 The corresponding unit or module is executed. Figure 4 This is a block diagram of a device in a communication system according to one or more exemplary embodiments of the present invention. Figure 4 Units or modules in devices or apparatuses such as ED110, T-TRP 170, or NT-TRP 172 are illustrated. For example, signals may be transmitted by a transmitting unit or transmitting module. Signals may be received by a receiving unit or receiving module. Signals may be processed by a processing unit or processing module. Other steps may be performed by an artificial intelligence (AI) module or a machine learning (ML) module. The corresponding units or modules may be implemented using hardware, one or more components or devices executing software, or a combination thereof. For example, one or more units or modules may be circuits such as integrated circuits. Examples of integrated circuits include programmable FPGAs, GPUs, or ASICs. For example, one or more of these units or modules may be logical functions, such as logical functions executed by circuits, by a portion of an integrated circuit, or by software instructions executed by a processor. It should be understood that if these modules are implemented using software executed by a processor, etc., then these modules may be retrieved by the processor, wholly or partially, individually or collectively, for processing, or in one or more instances as needed, and these modules themselves may include instructions for further deployment and instantiation.

[0200] Further details regarding ED 110, T-TRP 170, and NT-TRP 172 are known to those skilled in the art. Therefore, these details are omitted herein.

[0201] For decades, bit-based communication has been a focus of industry, primarily due to its efficiency—optimizing the transmission of more bits at the lowest wireless cost. This has led to extensive research into channel coding and source coding theories to guide the design of forward error correction (FEC) coding schemes, modulation schemes, and lossy or lossless compression schemes in engineering. However, this emphasis has overshadowed another crucial aspect of communication: transmission effectiveness (the sender triggering the receiver's expected behavior).

[0202] For a receiver to perform an operation as the sender expects, the receiver and sender need to pre-negotiate protocols to map the expected operation (observation or execution) into bits. In the modern wireless industry, these pre-negotiated protocols form an important part of the wireless standards that each device follows. For example, in a wireless system, a new expected operation mapped to a few bits of a control message (or information within a message) cannot be used until it is standardized and hardware compatible with that standard is deployed.

[0203] The control message passing system (i.e., the system for control messages that uses pre-negotiated protocols) in current communication systems such as 4G and 5G systems is a closed vocabulary system, accessible only to transmission-related control messages, downlink control information (DCI), and uplink control information (UCI). A large part of the 5G wireless standard is specifically designed for the content and format of DCI and UCI. On the receiving side, pre-negotiated functions (operations and their parameters) are carefully mapped to certain bits of control messages with specific formats. When a new transmission technology emerges (e.g., from 4G to 5G), some new related control messages require years of standardization meetings and implementations before they can be added to DCI and UCI, or defined as new DCI and UCI formats. Similarly, when an older transmission technology is phased out, older control messages also require years of meetings and implementations before they can be removed from DCI and UCI. With the accelerated evolution of future transmission technologies, the need for updates to DCI and UCI will also increase, and the current closed-vocabulary controlled messaging system will become an obstacle to achieving flexible replacement.

[0204] Since 5G, Ultra Reliable Low Latency Communication (URLLC) has been considered one of the key application characteristics of wireless systems. Recent AI technologies are accelerating the development of autonomous vehicles and robots, increasing the demand for low latency and high reliability communication. However, these applications cannot utilize the most reliable and fastest wireless channels because the control messages in these applications are not open to wireless technologies (such as 5G), can only be processed as data, and can only be transmitted through data channels.

[0205] Each anticipated operation is specifically defined and mapped to a number of bits in a control message. This definition and mapping requires thorough pre-negotiation and is written into the radio standard, then implemented in all user equipment (UE) and network nodes (e.g., base stations). Intended operations include specific observation or execution function modes. For example, a control message requesting the receiver to measure the current "received signal power" (e.g., reference signal received power (RSRP)) is a specific "observation" function mode (it does not change the receiver's state); while another control message requesting the receiver to configure its "carrier frequency" is a specific "execution" function mode (it changes the receiver's state). Understandably, the communication protocol associates one control message with one function mode and another control message with another function mode. Control messages are cross-modal.

[0206] Modern cellular wireless systems such as 5G include a central device (e.g., BTS, gNodeB, eNodeB) and at least one user equipment (e.g., UE, user, terminal, IoT device, etc.). In 5G, the central device is responsible for managing and maintaining the overall communication quality of all user equipment associated with it. See [link to documentation]. Figure 5 and Figure 6 . Figure 5 This is a schematic diagram of a communication system. Figure 6 This is a communication diagram between the central equipment and the first user equipment.

[0207] The central equipment primarily performs management and maintenance tasks through the control plane of the wireless system. The control plane includes physical layer control channels (e.g., downlink PDCCH and uplink PUCCH) and a portion of physical layer data channels (e.g., downlink PDSCH and uplink PUCCH), as well as several carefully standardized control messages. Typically, most control messages are robustly encoded (using lower coding rates and modulation schemes), without HARQ (to achieve shorter latency), and transmitted via the physical control channels. The content, format, location, and length of the standardized control messages are clearly defined and specified to ensure strict adherence by all devices. Typically, standardized control messages are short enough to form a small block to fit the DCI. Optionally, if the standardized control messages are long enough, they can also be transmitted via the physical data channels.

[0208] Certain bits in the standardized control message indicate the required functional mode, which is an observation (measurement) operation and / or an execution (configuration or setup) operation. The standard document explicitly specifies (through offline pre-negotiation) which bits are associated with which functional mode, and both the central equipment and user equipment are aligned with this standard document.

[0209] Certain bits in the standardized control message represent parameter values ​​for the functional mode. The standard document explicitly specifies (through offline pre-negotiation) which bits and how many bits are associated with which parameters of the functional mode, and both the central equipment and user equipment are aligned with this standard document.

[0210] Adding a new functional modality means updating certain bits in the standardized control message, which can take years to reach consensus within the standardization body and be implemented by all new devices. For example, because the number of bits allocated to a parameter value is fixed, the quantization of that value cannot be updated until a change in the number of bits is agreed upon within the standardization body and implemented by all new devices.

[0211] The central equipment generates standardized control messages by precisely padding bits according to a pre-negotiated standard. The central equipment then encodes the control messages using some pre-negotiated modulation and coding scheme (MCS) and transmits them to the user equipment on transmission opportunities within the physical radio allocation (control channel or data channel).

[0212] The user equipment receives control messages from the transport opportunity and decodes them according to the pre-negotiated MCS. The user equipment can then execute functional modes using parameter values ​​based on the decoded bits in the control message.

[0213] Natural language is one of the few carriers that supports both open vocabularies and forward and backward compatibility, while also enabling cross-modal functionality. To date, all theories, rules, laws, devices, knowledge, gadgets, and even wireless standards have been developed and stored in natural language. However, directly embedding sentences in natural language (e.g., word-for-word embedding via the American Standard Code for Information Interchange (ASIC)) is highly sensitive to word order and sentence format. For example, "set the carrier frequency to 3.5 GHz" is considered different from "the carrier frequency should be set to 3.5 GHz," even though they are semantically similar. Or, "What is the current received signal power?" and "The received signal power is very high" constitute a semantically similar question and answer pair. For decades, no machine has been able to understand flexible and open natural language sentences, and no heuristic method has been able to map and compare natural language sentences within a general semantic domain.

[0214] Large-language-models (LLMs) enable machines to "understand" sentences in natural language form. While the primary goal of an LLM is extraction or prediction (generation) within sentences, each LLM may contain components capable of embedding sentences in natural language form into a semantic domain. Typically, these embedding components are implemented using deep neural networks based on Transformers and trained through contrastive learning with a large number of training samples. Modern wireless systems suffer from at least one of the following problems. First, the content and format of control messages in wireless communication standards are pre-negotiated (standardized), forming a closed vocabulary within a semantic context used only for transmission. Control messages are responsible for managing and maintaining the entire wireless communication system, given the most reliable and fastest physical channel. However, this resource or capability is not open to other applications, especially ultra-reliable low-latency communication (URLLC) applications, including autonomous vehicles or robots. For example, control messages such as "emergency braking" in an autonomous vehicle can only be transmitted as data over a physical data channel. Second, pre-negotiated (standardized) control messages in wireless communication standards have issues with forward and backward compatibility. Some "obsolete" control messages still occupy some resource space in the physical channel, while some new control messages (for new technologies) cannot be added until a new standard is released (e.g., several years later). This diminishes the ability of wireless systems to benefit from state-of-the-art transmission technologies.

[0215] In the disclosure of this invention, a method, apparatus and system for open vocabulary control messages are provided to support conditional ("if, then") and loop ("when...", "when..., execute", "execute...until", "execute for...").

[0216] Unlike standardized DCI (i.e., in 4G and 5G), this paper introduces control messages in natural language forms that support conditionality and loops. From a computer programming theory perspective, a program only needs four types of instructions to be encoded: read state, change state, conditional statements, and loops. Strictly speaking, loop instructions are not necessary, but they do help improve program efficiency.

[0217] The first potential advantage is efficiency. Open-vocabulary control messages are associated with functional modalities supported by the user equipment. These modalities can be observation (reading the current state of the user equipment), execution (changing the current state of the user equipment), or both. For example, to implement conditional judgment, the central device can trigger at least two control messages: a first message for observation (referred to as the observation message in this invention) and a second message for execution (referred to as the execution message in this invention). In response to the observation message received from the central device, the user equipment can report its current state at least once. In this case, with open-vocabulary control messages supporting conditional judgment, the two control messages can be conditionally combined and sent to the user equipment. The central device only needs to send them once. As another example, to implement a loop with open-vocabulary control messages, the central device needs to continuously send multiple execution control messages and one observation message, and then repeat the process. However, with open-vocabulary control messages supporting loops, the central device only needs to send one control message indicating the loop.

[0218] The second potential advantage is the ability to program user devices via a series of control messages in natural language. In one implementation, DCI and open-vocabulary control messages in 5G are independent and have no order relation. Programs are order-sensitive, or rather, the order of program instructions (carrying critical (basic) information) is crucial. The order of a series of control messages begins to matter when control messages support free conditional statements and loops.

[0219] LLM's Embedding Model

[0220] The central equipment primarily schedules and manages user equipment through the control plane of the wireless system. The control plane includes multiple physical layer channels and multiple control messages. Unlike 5G, this invention includes some open-vocabulary control messages in natural language form to achieve forward and backward compatibility in wireless communication.

[0221] These control messages are called open-vocabulary control messages in natural language form. The main reasons for using natural language instead of artificial language (such as 5G standards) include at least one of the following:

[0222] Natural language is the de facto best semantic "standard" for almost everything. Discussions, development, writing, and standardization of wireless systems (such as 4G and 5G) are all conducted in natural languages ​​(such as English).

[0223] Inference based on a powerful LLM model can generate a series or a subset of open-vocabulary control messages in natural language form. If modern wireless systems can leverage the ever-expanding LLM model, they can support control messages in natural language form.

[0224] It is generally accepted that a "man-in-the-loop" mechanism should be maintained during both the training and inference phases of an LLM model. During training, the "man-in-the-loop" mechanism helps to regulate the behavior of the LLM model, ensuring it conforms to safety and ethical guidelines; during inference, it facilitates backtracking and accumulating real-world samples for human review. Both phases require the system to support control messages in natural language.

[0225] In this invention, the central device should use an LLM to generate a series of control messages in natural language. The construction of the LLM depends on the specific implementation. Enterprises or operators can gain efficiency advantages through their own LLM models. Enterprises can also continuously improve their LLM models through human-in-the-loop reinforcement learning, thereby updating the LLM generation model.

[0226] A typical LLM model may include several components: an encoder that translates, embeds, or lexicallyizes sentences in natural language form into semantic embeddings; a generator or predictor that generates a series of semantic embeddings; and a decoder that translates the generated semantic embeddings back into sentences or messages in natural language form. In some LLM models, the generator and decoder are tightly coupled together.

[0227] There is a degree of randomness in LLM models. For example, two semantic embeddings in the same input sentence in natural language form are not exactly the same. However, these two semantic embeddings are highly correlated because their inner product is high.

[0228] Semantic embeddings have many names, such as semantic vectors, semantic lexical units, and lexical units. In some LLM models, semantic embeddings exist in tensor form, while in others they exist in matrix form. Typically, longer sentences in natural language form produce longer semantic embeddings. To adapt semantic embeddings to the wireless physical layer, an embedder is proposed:

[0229] Regularize semantic embeddings into vectors (semantic vectors); for example, simply vectorize them using tensors or matrices;

[0230] A finite number of fixed lengths are predefined, and then the semantic vectors are regularized to one of these fixed lengths. Generally, longer sentences will be regularized into longer semantic vectors;

[0231] In the following discussion, semantic vectors of one of these predefined lengths will be referred to as "semantic vectors";

[0232] The encoder component of the LLM and the above regularization are referred to as "embedders".

[0233] Embedded models are components of LLM models; see [link / reference]. Figure 7 The figure is a schematic diagram of an LLM model. In fact, compared to generators and decoders that typically contain billions of neurons, the embedding model is the smallest, simplest, and least energy-intensive component in an LLM model.

[0234] Figure 7 A typical LLM model is illustrated. A sentence in natural language form is input into the LLM model. This sentence is first embedded into semantic embeddings via a deep neural network (e.g., the transform-based deep neural network-1 in the figure). These semantic embeddings are then fed into a generator or predictor, which generates a series of semantic embeddings following the input semantic embeddings. This series of semantic embeddings is then translated into a sentence in natural language form by a decoder. Optionally, the generator and decoder can be combined using a deep neural network (e.g., another transform-based deep neural network-2 in the figure).

[0235] A functional mode is an operation performed by a user equipment. Operations include observation and / or execution. When a user equipment performs an observation operation, it measures certain states or conditions. When a user equipment performs an execution operation, it changes certain states or conditions. A functional mode can be an observation operation, an execution observation, or both.

[0236] Figure 8 A schematic flowchart of a control method according to one or more exemplary embodiments of the present invention is shown. The method can be implemented by a first device. Optionally, the first device can be a central device or other device with similar functions (e.g., the first device can be a chip), without limitation. Figure 8 As shown, the method may include the following steps.

[0237] S810: Generate at least one control message in natural language form using a language model (LM), wherein each control message in the at least one control message indicates a corresponding operation to be performed, and each of the one or more control messages also indicates information related to performing the corresponding operation indicated by the one or more control messages, wherein the at least one control message includes one or more control messages.

[0238] In this embodiment, the central device uses a language model to generate at least one control message in natural language form. Each control message in the at least one control message indicates a corresponding operation to be performed, and some or all of the control messages also indicate information related to performing the corresponding operation indicated by one or more control messages. In one possible implementation, the LM can be an LLM.

[0239] In one possible implementation, some or all of the control messages in one or more control messages can be conditional control messages or cyclic control messages. That is, some or all of the control messages in at least one control message generated by the central device can be conditional control messages or cyclic control messages, used to indicate the operation to be performed and information related to performing that operation.

[0240] Conditional control messages are a specific type of control message that includes conditions, such as those represented by an "if, then" structure. This message specifies that an operation should be performed only if certain conditions are met. Loop control messages are a type of control message that includes instructions for performing repeated operations, such as those represented by loop structures like "when...", "when..., execute", "execute...until", or "execute for...". This message indicates the number of times an operation should be performed, or under what conditions the operation should be repeated.

[0241] Since some or all of the control messages generated by the central device can be conditional control messages or cyclic control messages, introducing control messages in natural language forms that support conditionality and cyclicity into the system helps improve the efficiency and flexibility of the communication system.

[0242] In one possible implementation, each piece of information related to performing a corresponding operation can be based on the result of another operation indicated by one or more control messages. That is, the information related to performing a corresponding operation can depend on the result or output of another operation indicated by the control message. In one possible implementation, the corresponding operation can be an observation (measurement) operation and / or an execution (configuration or setting) operation, and the other operation indicated by the control message can be an observation (measurement) operation. For example, the control message could be "If readState#2 is in a lower range, then SetState#1 (value #1)". In this case, the information related to performing the operation "SetState#1 (value #1)" is based on the result of the operation "readState#2". Because the control message can include information related to the execution of an operation based on the result of another operation indicated by the control message, the operation to be performed and the conditions for (repeated) performing the operation can be indicated by a single control message, thereby simplifying the communication process for control and enabling more complex and precise control of the wireless device.

[0243] In one possible implementation, one or more control messages may include a first control message, which is a conditional control message. The first control message indicates a first operation to be performed and information related to performing the first operation. The information related to performing the first operation includes a first condition for performing the first operation, which is based on the result of a second operation. The first conditional control message generated by the central device indicates that the execution of a specific operation depends on the satisfaction of a specific condition. This condition can be based on various factors, such as input values, system states, or external events. For example, the control message could be "If readState#2 is in a lower range, then SetState#1 (value #1)". In this case, the control message indicates the first operation "SetState#1 (value #1)" to be performed when the result of the second operation "readState#2" is in a lower range.

[0244] In one possible implementation, one or more control messages may include a second control message, which is a loop control message. The second control message indicates a third operation to be performed and information related to performing the third operation. The information related to performing the third operation includes a second condition for the loop used to perform the third operation, based on the result of the fourth operation. The loop control message generated by the central device indicates that a specific operation should be repeated until a specific condition is met or a defined number of iterations is reached. This specific condition can be based on various factors, such as input values, system states, or external events. For example, the loop control message could be "Set state 3 to value #2 when the checked state 1 is in a higher range." In this case, the control message indicates a loop for performing the third operation "Set state 3 to value #2" under the second condition that "the checked state 1 is in a higher range." That is, the third operation "Set state 3 to value #2" is repeated when the result of the fourth operation, "the checked state 1," is in a higher range. The second condition is based on the result of the fourth operation, "the checked state 1."

[0245] By including conditional control messages or cyclic control messages (where an operation is performed based on the result of another operation), more complex and dynamic control scenarios (where operations are performed based on the results of other operations) can be achieved, thereby improving the performance and energy efficiency of communication systems.

[0246] S820: Obtain at least one semantic information of at least one control message, wherein each control message in the at least one control message corresponds to a corresponding semantic information in the at least one semantic information.

[0247] In this embodiment, the central device obtains the semantic information of the control message based on the control message. Semantic information in this invention also refers to semantic vectors, semantic embeddings, semantic lexical units, etc. Semantic information can be the meaning or semantic numerical representation of words, phrases, sentences, or documents.

[0248] In one possible implementation, the central device can acquire a first semantic information through an embedder based on the description of the functional modality. In another possible implementation, the central device can acquire at least one piece of second semantic information corresponding to at least one description, respectively, through an embedder, based on at least one description related to the result of the functional modality.

[0249] The embedder can translate, embed, or lexicalize the description in natural language form, or the description related to the outcome of the functional modality, into semantic information, thereby giving the semantic information a more structured and machine-readable format, and typically smaller in size compared to the description in natural language form. When the functional modality includes a description of the functional modality and at least one description related to the outcome of the functional modality, the central device can acquire the semantic information corresponding to the description of the functional modality and the semantic information corresponding to each of the at least one description related to the outcome of the functional modality, respectively.

[0250] In one possible implementation, the central device can also store first semantic information and at least one piece of second semantic information. After acquiring the first and second semantic information, the central device can store them locally for future use. Therefore, it is not necessary to translate the description or the description related to the result of the functional modality every time it is used, which facilitates subsequent use, reduces the processing overhead of description translation, and reduces communication latency.

[0251] In one possible implementation, for each control message in at least one control message, the central device can obtain a portion of each control message that does not contain any parameters, and based on that portion, obtain a semantic piece of information for each control message through an embedder.

[0252] The generated control message may include a list of parameters (values). The central device can divide the control message into two parts: the first part includes the parameter list (if any), and the second part includes the rest of the control message. The central device only translates the second part into semantic information. Since the second part, translated into semantic information, does not include parameters (values) that may change, the semantic information of the control message can be highly correlated with the semantic information of the corresponding functional modality. This helps the central device determine whether the control message is a registered message, helps the user equipment determine the corresponding functional modality, reduces computational complexity, and helps standardize the length of the semantic information.

[0253] In one possible implementation, the central device can determine the correlation between the semantic information of each control message in at least one control message and multiple semantic information of multiple registered functional modalities. The multiple semantic information of the multiple functional modalities includes multiple first semantic information, each first semantic information corresponding to a corresponding functional modality among the multiple functional modalities, and obtained from the description of the corresponding functional modality among the multiple functional modalities. The multiple semantic information of the multiple functional modalities also includes at least one second semantic information, each second semantic information obtained from a description related to the result of one of the multiple functional modalities. The registered multiple semantic information of the multiple functional modalities can be stored in the central device or translated from the description of the functional modality or the description related to the result of the functional modality during use. Since at least one control message indicates a corresponding operation to be performed and may also indicate information related to performing the corresponding operation, the multiple semantic information of the multiple functional modalities used for comparison with the semantic information of the control message may include the first semantic information obtained from the description of the functional modality, and may also include the second semantic information obtained from the description related to the result of the functional modality.

[0254] In one possible implementation, the central device can determine that the correlation between the semantic information of the third control message and each of the multiple semantic messages is below a threshold, wherein at least one control message includes the third control message, and the central device can reject the third control message.

[0255] The central device determines whether a control message is registered by comparing the semantic information of each control message with multiple semantic information entries from multiple registered functional modalities. If the correlation between the semantic information of a control message and the semantic information of the registered functional modalities is below a threshold, the control message is determined to be unregistered, and the central device rejects it. The central device can avoid encoding and transmitting unregistered control messages. It can multicast or unicast the control message only to user equipment that has registered the corresponding functional modality, thus saving power consumption for both the central device and user equipment, and conserving transmission resources.

[0256] S830: Form at least one information payload, wherein the at least one information payload includes at least one semantic piece of information from at least one control message.

[0257] In this embodiment, in order to transmit control messages, the central device forms an information payload that includes semantic information of the control messages. The semantic information has a more structured and machine-readable format and is typically smaller in size than the control messages, thereby making communication more efficient and saving transmission resources.

[0258] In one possible implementation, for each control message in at least one control message, the central device may form a first information payload, wherein the first information payload includes start position information of a second transmission opportunity and length information of semantic information of each control message; the central device may form a second information payload, wherein the second information payload includes semantic information of each control message, and the second transmission opportunity is used to transmit the second information payload.

[0259] The central device can generate a first information payload and a second information payload to transmit control messages, which helps to utilize wireless resources more efficiently and provides greater flexibility in error correction and retransmission. Since the first information payload includes the start position information of the second transmission opportunity and the length information of the semantic information, the receiving device can synchronize with and correctly receive the second information payload based on the first information payload.

[0260] The central device allocates a segment of radio resources for control messages. The first portion of the radio resources is reserved for standardizing control messages. The second portion of the radio resources is allocated to open vocabulary control messages, which include at least a first open vocabulary control message.

[0261] By reserving a segment of wireless resources for control messages and allocating separate portions for standardized and open-vocabulary messages, the central device can ensure that these messages are transmitted efficiently without interference from other data transmissions.

[0262] In one possible implementation, at least one control message includes at least one fourth control message, each fourth control message further including a parameter list, and the first information payload of each of the at least one fourth control message also includes the parameter list. If the control message also includes a parameter list, then the parameter list is included in the first information payload to be transmitted.

[0263] In one possible implementation, the central device may further encode the second information payload using a first encoding method, wherein the first information payload also includes information about the first encoding method. The encoding method used by the second information payload may be explicitly or implicitly indicated by the first information payload. By including the first encoding method for encoding the second information payload in the first information payload, the user equipment can immediately identify the appropriate encoding scheme required for decoding the subsequent second information payload.

[0264] In one possible implementation, the central device may use a second encoding method to encode the first information payload. The second encoding method may be the same as or different from the first encoding method, and no restriction is placed here.

[0265] In one possible implementation, the first coding method includes a first modulation and coding scheme (MCS), and the second coding method includes a second MCS. Both the first and second coding methods can be MCS. In another possible implementation, the first and second coding methods can be other coding methods suitable for wireless transmission, such as pulse amplitude modulation (PAM), frequency shift keying (FSK), phase shift keying (PSK), quadrature amplitude modulation (QAM), etc.

[0266] In one possible implementation, the central device can determine at least two semantic information related to at least one semantic information of at least one control message from multiple semantic information of multiple registered functional modalities, wherein the at least two semantic information includes one or more first semantic information and one or more second semantic information; it can determine at least one user equipment ID or at least one group of user equipment IDs associated with the at least two semantic information, wherein the first information payload further includes at least one user equipment ID or at least one group of user equipment IDs; or the first information payload further includes information indicating at least one user equipment ID or information indicating at least one group of user equipment IDs.

[0267] The central device can store a mapping between each registered functional modality and its corresponding information indicating at least one user equipment ID or at least one group of user equipment IDs. In one possible implementation, the central device can store a mapping between each registered functional modality and its user equipment ID or group of user equipment IDs. The central device can calculate the relevance between the semantic information of the control message and the semantic information of each of the at least one registered functional modality, and then determine the semantic information most relevant to the semantic information of the control message. When the most relevant semantic information is determined, the central device can retrieve the corresponding information indicating at least one user equipment ID or information indicating at least one group of user equipment IDs, or either the user equipment ID or the group of user equipment IDs, from its database or associated records. When the control message indicates an operation to be performed and information related to performing the operation indicated by the control message, the semantic information of the control message can be related to the semantic information obtained from the description of the functional modality and the semantic information obtained from the description related to the result of the functional modality.

[0268] The central device can determine the specific functional mode targeted by the control message and the corresponding user equipment (UE) or group of UE to which the control message should be sent. This ensures that the control message is delivered to the intended recipient, thereby improving the efficiency and accuracy of the communication system. Furthermore, since the first information payload includes a UE ID or group of UE IDs, or information indicating either a UE ID or group of UE IDs, the receiving UE can determine whether it is the correct recipient based on the first information payload, further improving the efficiency and accuracy of the communication system. When the receiving UE is not the intended recipient, the UE can stop decoding the second information payload, thus saving energy.

[0269] S840: Send at least one information payload.

[0270] In this embodiment, the central device sends the information payload after forming it.

[0271] In one possible implementation, the central device can transmit a first information payload during a first transmission opportunity and a second information payload during a second transmission opportunity. The central device can transmit the information payload through two parts, comprising the first and second information payloads. The central device can transmit the first and second information payloads separately during the first and second transmission opportunities. Therefore, the central device can allocate radio resources more efficiently by assigning different transmission opportunities to each payload, thereby helping to prevent congestion and ensure smooth information transmission.

[0272] The first and second transmission opportunities do not indicate the order in which the first and second information payloads arrive at the user equipment. In other words, from a radio resource perspective, it is not mandatory for a transmission opportunity to arrive at the user equipment before the second opportunity. Encoding and transmitting the first and second information payloads during different transmission opportunities helps to utilize radio resources more efficiently and provides greater flexibility in error correction and retransmission.

[0273] In one possible implementation, the information payload is sent via multicast or unicast messages.

[0274] In one possible implementation, at least one control message may include multiple control messages to be executed sequentially. By transmitting a series of control messages, including multiple control messages, sequentially, communication overhead can be reduced, thereby enabling more efficient use of the wireless channel and reducing latency when transmitting control messages from the central device to the user equipment. The user equipment can be programmed through a series of control messages in natural language form.

[0275] In one possible implementation, the order in which corresponding control messages are executed among multiple control messages can be indicated by the order of the corresponding control messages within the multiple control messages. By indicating the execution order through the order of multiple control messages, the user equipment can perform the required operations in a predictable and expected manner.

[0276] The central device can use the LM to generate a series or a sequence of control messages to program the user equipment. The order of these control messages is crucial, as it specifies the particular instructions and conditions the user equipment must follow. If the user equipment encounters difficulties decoding, understanding, or executing a previous control message, there is no need to attempt to process the subsequent one.

[0277] The central device generates at least one control message in natural language form and forms at least one information payload including semantic information of the at least one control message to control the user equipment. The at least one control message indicates a corresponding operation to be performed, and one or more control messages in the at least one control message also indicate information related to performing the corresponding operation. This allows for support of open vocabularies in control, particularly supporting more complex and precise control of wireless devices, enabling more efficient and flexible communication, supporting forward and backward compatibility, and adapting to cross-modal functions. By supporting control messages with information related to performing the corresponding operation, multiple control messages (where each control message only indicates an observation operation or an execution operation) can be conditionally combined and sent to the user equipment, thereby improving the system's communication efficiency.

[0278] Figure 9 A schematic flowchart of a control method according to one or more exemplary embodiments of the present invention is shown. This method can be implemented by a second device. Optionally, the second device can be a user equipment or other device with similar functionality (e.g., the second device can be a chip), and there is no limitation herein. Figure 9 As shown, the method may include the following steps.

[0279] S910: Obtain at least one information payload, wherein the at least one information payload includes at least one semantic information of at least one control message, and each control message in the at least one control message corresponds to a corresponding semantic information in the at least one semantic information.

[0280] In this embodiment, the user equipment acquires an information payload, which includes semantic information of a control message. The control message is in natural language form and is used to instruct the receiver to perform a specific operation. The semantic information of the control message can be the meaning of the control message or a numerical representation of its semantics. The control message is generated by the central device and is in natural language form.

[0281] In one possible implementation, at least one control message may include one or more control messages, each of which is a conditional control message or a cyclic control message. Since some or all of the control messages in the at least one control message generated by the central device can be conditional or cyclic control messages, introducing control messages in a natural language format that supports conditionality and cyclicity into the system helps improve the efficiency and flexibility of the communication system.

[0282] In one possible implementation, each piece of information related to the execution of a corresponding functional mode is based on the result of another functional mode indicated by one or more control messages. Since the control messages can include information related to the execution of an operation based on the result of another operation indicated by the control message, the communication process can be simplified, and more complex and precise control of the wireless device can be achieved.

[0283] In one possible implementation, one or more target semantic information includes first target semantic information indicating a first functional modality to be executed and information related to the execution of the first functional modality, wherein the information related to the execution of the first functional modality includes a first condition for the execution of the first functional modality, the first condition being based on the result of a second functional modality, and the multiple functional modalities include the first functional modality and the second functional modality.

[0284] In one possible implementation, one or more target semantic information pieces include second target semantic information indicating the third functional modality to be executed and information related to the execution of the third functional modality, wherein the information related to the execution of the third functional modality includes a second condition for a loop for executing the third functional modality, the second condition being based on the result of a fourth functional modality, and the multiple functional modalities include the third functional modality and the fourth functional modality.

[0285] Since one or more target semantic information can include target semantic information indicating the functional modality to be performed and information related to the performance of the functional modality, wherein the information related to the performance of the functional modality includes conditions based on the result of another operation indicated by the control message, the communication process for control can be simplified and more complex and precise control of wireless devices can be achieved.

[0286] In one possible implementation, after acquiring at least one information payload, the user equipment can decode the at least one information payload. By decoding the information payload, the user equipment can obtain the semantic information and other information of the control message.

[0287] In one possible implementation, each information payload in at least one information payload may include: a first information payload, acquired during a first transmission opportunity corresponding to a control message, and including start position information of a second transmission opportunity corresponding to the control message and length information of semantic information of the corresponding control message; and a second information payload, acquired during a second transmission opportunity corresponding to the control message, and including semantic information of the corresponding control message. The user equipment may acquire the first information payload during the first transmission opportunity and decode it to obtain the start position information of the second transmission opportunity and the length information of the semantic information of the control message. The user equipment may acquire the second information payload during the second transmission opportunity based on the start position information of the second transmission opportunity and the length information of the semantic information of the control message, wherein the second information payload includes the semantic information of the control message. After acquiring the second information payload, the user equipment may decode it to obtain the semantic information of the control message. The user equipment may acquire the first information payload and the second information payload during the first transmission opportunity and the second transmission opportunity, respectively. Therefore, by allocating different transmission opportunities to each payload, radio resources can be allocated more efficiently, and the process of acquiring and decoding information payloads ensures reliable retrieval of semantic information from control messages.

[0288] The first and second transmission opportunities do not indicate the order in which the first and second information payloads arrive at the user equipment. In other words, from a radio resource perspective, it is not mandatory for a transmission opportunity to arrive at the user equipment before the second opportunity. Encoding and transmitting the first and second information payloads during different transmission opportunities helps to utilize radio resources more efficiently and provides greater flexibility in error correction and retransmission.

[0289] The first information payload includes the start position information of the second transmission opportunity and the length information of the semantic information of the control message. Therefore, the receiving device can synchronize and correctly receive the second information payload according to the first information payload.

[0290] In one possible implementation, the user equipment can decode the first information payload to obtain the start position information of the second transmission opportunity and the length information of the semantic information of the corresponding control message. Using these, the user equipment can obtain the second information payload and decode it to obtain the semantic information.

[0291] In one possible implementation, the first information payload of each of the one or more information payloads in at least one information payload further includes: a parameter list corresponding to the control message.

[0292] In one possible implementation, the first information payload may further include information about a first encoding method, which is used to decode the second information payload. In another possible implementation, a second encoding method may be used to decode the first information payload. By including a first encoding method for encoding the second information payload in the first information payload, the user equipment can immediately identify a suitable encoding scheme required for decoding the subsequent second information payload.

[0293] In one possible implementation, the first encoding method may include a first modulation and coding scheme (MCS), and the second encoding method may include a second MCS.

[0294] In one possible implementation, the first and second encoding methods can be other encoding methods that can be used for wireless transmission, such as pulse amplitude modulation (PAM), frequency shift keying (FSK), phase shift keying (PSK), quadrature amplitude modulation (QAM), etc.

[0295] In one possible implementation, the first information payload further includes: information indicating the user equipment ID or information indicating the group user equipment ID.

[0296] In one possible implementation, in response to determining that the User Equipment ID (UE) or Group UE ID does not match the UE's UE ID or Group UE ID, the UE may not decode the second information payload. When the UE identifier is indicated in the first information payload, if the UE finds that the decoded UE ID or Group UE ID does not match its own, the UE may not decode the second information payload, thereby saving the UE's energy consumption and processing resources. Since the first information payload includes information indicating the UE ID or Group UE ID, the UE can determine whether it is the correct receiver based on the first information payload, thus improving the efficiency and accuracy of the communication system.

[0297] S920: From multiple semantic information of multiple functional modalities, determine at least one target semantic information corresponding to at least one semantic information of at least one control message, wherein each target semantic information in the at least one target semantic information indicates the corresponding functional modality to be executed; one or more target semantic information in the at least one target semantic information also indicates information related to the execution of the corresponding functional modality, wherein the multiple functional modalities include the corresponding functional modality to be executed.

[0298] In this embodiment, the user equipment (UE) determines at least one target semantic information by comparing the semantic information of one or more control messages obtained from the central device with all its candidate semantic information. Each candidate semantic information corresponds to a corresponding functional modality in at least one functional modality of the UE. The candidate semantic information is obtained based on a description of the corresponding functional modality or a description related to the result of a functional modality, the description of which is in natural language form. The candidate semantic information can be stored in the UE or retrieved each time the UE needs it. The description of the corresponding functional modality is in natural language form.

[0299] In one possible implementation, the multiple semantic information of multiple functional modalities may include multiple first semantic information corresponding to the multiple functional modalities, each of the multiple first semantic information being obtained from the description of the corresponding functional modality in the multiple functional modalities, wherein the description is in natural language form; the multiple semantic information of multiple functional modalities also includes at least one second semantic information, each of the second semantic information being obtained from the description related to the result of the functional modality in the multiple functional modalities, wherein the description related to the result of the functional modality is in natural language form.

[0300] Candidate semantic information used for comparison with semantic information included in the information payload can be obtained based on the description of the corresponding functional modality or the description related to the result of a functional modality, both in natural language form. The user equipment can calculate the relevance or similarity between the semantic information obtained from the central equipment and all its candidate semantics. Based on the relevance calculation, the target semantic information is identified as the most relevant to the semantic information.

[0301] In one possible implementation, one or more pieces of target semantic information may include first target semantic information indicating the corresponding function to be performed and second target semantic information indicating information related to the modality of performing the corresponding function.

[0302] In one possible implementation, multiple semantic information items from multiple functional modalities can be acquired and then stored. The user equipment can store the acquired semantic information from multiple functional modalities, enabling the user equipment to quickly access and utilize this semantic information when needed.

[0303] In one possible implementation, multiple semantic information items for multiple functional modalities can be acquired by a first embedder before determining at least one target semantic information item corresponding to at least one semantic information item for at least one control message. The user equipment can acquire the semantic information for multiple functional modalities whenever needed, thereby reducing the storage requirements of the user equipment.

[0304] In one possible implementation, at least one piece of semantic information for at least one control message is obtained through a first embedder in at least one embedder, and multiple pieces of semantic information for multiple functional modalities are obtained through the first embedder. One or more registered embedders may exist in the system. Target semantic information can be determined from candidate semantic information obtained by the same embedder used to obtain the semantic information included in the information payload. For example, the central device may notify the user equipment of the embedder ID of the first embedder used to obtain the semantic information included in the information payload. Since the user equipment can compare the semantic information of the control message with the candidate semantic information obtained using the same embedder, the accuracy and reliability of the comparison results are improved.

[0305] S930: Execute the corresponding functional mode based on each target semantic information in at least one target semantic information.

[0306] In this embodiment, after determining at least one piece of target semantic information, the user equipment executes a functional mode corresponding to the target semantic information.

[0307] In one possible implementation, at least one control message may include multiple control messages to be executed sequentially. By transmitting a series of control messages including multiple control messages sequentially, communication overhead can be reduced, thereby enabling more efficient use of the wireless channel and reducing latency when transmitting control messages from the central device to the user equipment.

[0308] In one possible implementation, the user equipment (UE) may: not decode the information payload containing a semantic information of a first control message among multiple control messages when decoding of the information payload including a semantic information of a second control message in a plurality of control messages fails, or when the execution of a functional mode indicated by a target semantic information of the second control message in a plurality of control messages fails, wherein the second control message precedes the first control message in this order. The central device may utilize the LM to generate a series or a sequence of control messages to program the UE. The order of these control messages is crucial because it specifies the particular instructions and conditions that the UE must follow. When the UE fails to decode a second control message preceding the first control message, or when the UE fails to execute the functional mode indicated by the semantic information of the second control message, the UE need not attempt to process subsequent first control messages.

[0309] If the information payload containing semantic information of a control message fails to be decoded, or if the execution of a functional mode corresponding to a target semantic information indication of a control message fails, subsequent control messages will not be decoded. This allows the system to avoid unnecessary processing and reduce the risk of errors. This improves overall system performance and reliability, ensuring that user equipment follows the expected sequence of operations and only executes instructions that it can correctly understand and execute.

[0310] In one possible implementation, the order of execution of multiple control messages can be indicated by the order of the corresponding control messages within the multiple control messages. By indicating the execution order through the order of multiple control messages, the user equipment can perform the required operations in a predictable and expected manner.

[0311] User equipment (UE) can acquire an information payload including semantic information of at least one control message, wherein the at least one control message indicates a corresponding operation to be performed, and one or more control messages in the at least one control message also indicate information related to performing the corresponding operation. UE can determine at least one piece of target semantic information based on the at least one control message and can execute the corresponding functional mode. Therefore, open vocabularies can be supported in control, especially supporting more complex and precise control of wireless devices, enabling more efficient and flexible communication, supporting forward and backward compatibility, and adapting to cross-modal functions.

[0312] Figure 10 A schematic flowchart illustrating a registration process according to one or more embodiments of the present invention is shown. Figure 10 As shown, the method may include the following steps.

[0313] S1010: The user equipment sends registration information for each of the multiple functional modes, wherein the registration information for each functional mode includes a description of each functional mode.

[0314] In this embodiment, the user equipment sends registration information of functional modalities to the central equipment. The registration information includes a description of the functional modality, which is in natural language form. The registration information for each functional modality can be sent individually, together (e.g., in a single packet), or a subset of functional modalities can be sent together; this invention does not limit the scope of the invention.

[0315] In one possible implementation, the registration information for each of one or more functional modalities among a plurality of functional modalities further includes at least one of the following: a parameter list for each of the one or more functional modalities or at least one description related to the result of each of the one or more functional modalities, wherein the at least one description related to the result of each of the one or more functional modalities is in natural language form and includes: a conditional description describing conditions based on the result of each of the one or more functional modalities; and / or a loop description describing a loop with conditions based on the result of each of the one or more functional modalities.

[0316] Real-world user equipment includes multiple states as well as multiple observation and execution functions. A functional modality includes at least one observation function for reading at least one state or at least one execution function for changing at least one state.

[0317] A functional mode is an operation performed by a user equipment. Operations include observation and / or execution. When a user equipment performs an observation operation, it measures certain states or conditions. When a user equipment performs an execution operation, it changes certain states or conditions. A functional mode can be an observation operation, an execution observation, or both.

[0318] Because the registration information for functional modalities includes descriptions in natural language or at least one of the following: a parameter list or at least one description related to the results of the functional modality, the system can adapt to cross-modal functions and support more complex control of wireless devices, as well as forward and backward compatibility. Furthermore, when new functional modalities are added, they can be registered along with their corresponding natural language descriptions without changing the system architecture or communication protocol, which improves the system's versatility and makes it more flexible.

[0319] In one possible implementation, the user equipment may encapsulate each of a plurality of functional modalities into a calling function to obtain a plurality of calling functions, wherein each of the plurality of calling functions includes a description of the corresponding functional modality in natural language form. One or more of the plurality of calling functions further include at least one of the following: a parameter list of the corresponding functional modality or at least one description relating to the result of the corresponding functional modality, wherein the at least one description relating to the result of the functional modality is in natural language form and includes: a conditional description describing a condition based on the result of the corresponding functional modality; and / or a loop description describing a loop with a condition based on the result of the corresponding functional modality. The calling function is used to interact with the corresponding function by sending a request and processing the data returned by the corresponding function.

[0320] When a functional modality is associated with an unconditional execution or observation operation, the function call for the functional modality may include a description of the functional modality, or a list of its parameters. The description of the functional modality is in natural language form.

[0321] When a functional modality is associated with an observation operation and at least one condition based on the result of the observation operation, the calling function of the functional modality may include a description of the functional modality and at least one description associated with the result of the functional modality, or may also include a parameter list of the functional modality. Both the description of the functional modality and the at least one description associated with the result of the functional modality are in natural language form. The at least one description associated with the result of the functional modality includes: a conditional description describing a condition based on the result of the functional modality; and / or a loop description describing a loop with a condition based on the result of the functional modality. The calling function of the functional modality may include more than one description associated with the result of the functional modality; that is, the functional modality may include more than one conditional description or loop description, or both.

[0322] In one possible implementation, the calling function may include an application programming interface (API) calling function. An API is a set of rules, protocols, and tools that enable different software applications to communicate and interact with each other. An API defines the methods and data formats that applications can use to exchange information and request services from each other.

[0323] Since each functional modality can be encapsulated as a function call (such as an API call function), the API can be invoked to execute the functional modality. Each functional modality can have a corresponding API corresponding to its description. When a functional modality also has a description related to the result of the functional modality (which can be a conditional description or a loop description), there will be an API corresponding to the description related to the result of the functional modality, which can be a conditional API or a loop API. Function calls can be implemented in various programming languages. By encapsulating each of the multiple functional modalities as a function call, it is easier to integrate and use with different programming languages ​​and promotes interoperability between different systems or components that may be developed using different technologies.

[0324] In one possible implementation, the user equipment can use other technologies to implement the functionality for interacting with the functional modality. For example, the system can directly call the functional modality using the syntax of a suitable programming language; this approach may be suitable for smaller applications or when the functional modality is tightly coupled to the rest of the application's logic. As another example, if the functional modality is provided as a library or software development kit (SDK), the system can directly integrate and use the library functions in the application code. Yet another example is that in a distributed system, the functional modality can be implemented as a standalone service accessible over a network. The system can interact with the functional modality using standard communication protocols such as Representational State Transfer (REST), gRPC, or message queues. Accordingly, the central device can obtain registration information for each functional modality, where the registration information for each functional modality includes a description of the corresponding functional modality.

[0325] S1020: The central device registers multiple functional modes with the LM.

[0326] In this embodiment, the central device can register multiple functional modes with the LM. When the registration information for multiple functional modes is sent separately, the central device can register each functional mode with the LM after receiving the corresponding registration information, or it can register all functional modes with the LM after receiving the registration information for all functional modes; this invention does not limit this. In one possible implementation, the LM can be an LLM.

[0327] In one possible implementation, the central device can record registration information for functional modes. After obtaining the registration information, the central device can store it locally for later use, thereby facilitating subsequent maintenance.

[0328] In one possible implementation, when the functional modality includes a description in natural language form and also includes at least one description related to the outcome of the functional modality, the central device or user device can translate the description of the functional modality and the at least one description related to the outcome of the functional modality into semantic information, respectively, through an embedder.

[0329] In one possible implementation, the central device may also record the user equipment identifier (ID) of the user equipment with registered functional modes or the group user equipment ID of the user equipment group with registered functional modes. The central device can associate the information indicating the user equipment ID or the group user equipment ID of the user equipment group with the corresponding functional mode and can record this association, wherein registration information of the functional mode is received from the user equipment. That is, the central device can record the user equipment ID of the user equipment or the group user equipment ID of the user equipment group, as well as a description and parameter list (if any) of the functional modes possessed by the user equipment or user equipment group. The central device can record the user equipment ID of the user equipment or the group user equipment ID of the user equipment group and the registration information for further use, so as to more directly invoke the corresponding functional modes of different user equipment without additional communication or negotiation, thereby helping to optimize the utilization of transmission resources.

[0330] In one possible implementation, the system may have one or more LMs. The central device can register a functional mode with at least one LM by providing registration information of the functional mode to at least one LM. That is, when the system has multiple LMs, the central device can register a functional mode with one of the multiple LMs, or it can register a functional mode with multiple LMs, which can be determined according to actual needs. For example, these LMs may be used for different purposes or communication technologies, and the functional mode to be registered may be used in some of these communication technologies. In this case, the central device may register the functional mode with only one or more suitable LMs.

[0331] In one possible implementation, the central device can send configuration information for at least one embedder. The LM can register its embedder with the system, which may include the central device and user devices. The central device can send the embedder's configuration information to the user device to register the embedder. When an embedder is introduced or updated, the central device can send configuration information to the user device, including the embedder's architecture and parameters (neuron values), etc. In one possible implementation, the configuration information for at least one embedder is sent via broadcast, multicast, or unicast messages.

[0332] Accordingly, the user equipment can obtain configuration information for at least one embedder. After obtaining the configuration information, the user equipment can register or update at least one embedder.

[0333] In one possible implementation, multiple embedders can be registered in the system (e.g., including a first embedder and a second embedder). These multiple embedders can be included in the same LM or in different LMs.

[0334] For example, when a second embedder exists and is introduced or updated, the central device can transmit the configuration of the second embedder to all user devices. In some cases, the first LM model may have a first embedder and a second embedder; in other cases, the first LM model has a first embedder and the second LM model has a second embedder.

[0335] In one possible implementation, the configuration information of at least one embedder may be sent via broadcast messages, multicast messages, or unicast messages.

[0336] One or more Learning Models (LMs) can exist, and each LM can include one or more embedders. Functional modalities can be registered to at least one of the LMs. Different LMs or embedders can be compatible with different types of communication systems or used for different application scenarios. Deploying multiple LMs on a central device can enhance the flexibility and customizability of the system. When different embedders are built based on different domains, specializing the vocabulary can significantly reduce the size and cost of the embedders, while also improving the accuracy of relevance calculations.

[0337] In one possible implementation, the configuration information of at least one embedder may include the architecture and parameters of each of the at least one embedder. In another possible implementation, the configuration information of at least one embedder may include the embedder ID of each of the at least one embedder.

[0338] The configuration information of an embedder may include the architecture and parameters of each embedder, and may also include the embedder ID of each embedder, so as to configure each embedder to the user device.

[0339] In one possible implementation, the user equipment can obtain configuration information for at least one embedder. Using this configuration information, the user equipment can configure the at least one embedder to translate the description of the functional modality into semantic information.

[0340] In one possible implementation, the central device and the user device can acquire the semantic information of the functional modality using the same embedder, based on the description of the functional modality included in the registration information. Due to the inherent randomness or variability of the embedder, the semantic information of the functional modality acquired by the central device and the user device may not be exactly the same. However, despite this variability, a strong semantic correlation still exists between the semantic information acquired by the central device and the semantic information acquired by the user device. Randomness in the embedding process may introduce slight variations in the output semantic information, even if the input description remains unchanged. These variations can be attributed to factors such as the specific initialization of the embedder parameters or the randomness of certain neural network operations.

[0341] Several scenarios can arise when a system has at least two embedders. In one possible implementation, there are multiple LMs, where each LM has at least one embedder. That is, the system can have multiple LMs, and each LM can have one or more embedders. In another possible implementation, at least one LM in the system has multiple embedders.

[0342] In one possible implementation, at least one functional modality may be registered in one or more LMs among a plurality of LMs, but not in one or more other LMs besides the one or more LMs among the plurality of LMs.

[0343] In one possible implementation, a first LM of a plurality of LMs has a first embedder, and a second LM of a plurality of LMs does not have a first embedder. In another possible implementation, the LM has a first embedder and a second embedder different from the first embedder.

[0344] Multiple LMs and / or embedders can exist. Different LMs and / or embedders can be developed by different companies and used for different specific purposes. This can reduce the size and cost of the LM, improve the effectiveness of the generated control messages, improve the resource utilization of the central device, and improve overall efficiency.

[0345] In one possible implementation, the central device may register the LM. In another possible implementation, the central device may register at least one embedder of the LM. Registration of the LM or its embedder enables the system to recognize and utilize the LM and its embedder, thereby achieving efficient natural language processing and improving system performance.

[0346] For ease of understanding, exemplary scenarios of the control method of the present invention are described below. It should be noted that these examples are for illustration only and should not be construed as limiting the technical solutions of the present invention.

[0347] Figure 7A typical LLM model is illustrated. A sentence in natural language form is input into the LLM model. This sentence is first embedded into semantic embeddings via a deep neural network (e.g., the transform-based deep neural network-1 in the figure). These semantic embeddings are then fed into a generator or predictor, which generates a series of semantic embeddings following the input semantic embeddings. This series of semantic embeddings is then translated into a sentence in natural language form by a decoder. Optionally, the generator and decoder can be combined using a deep neural network (e.g., another transform-based deep neural network-2 in the figure).

[0348] like Figure 11 As shown in Scenario 1, the first LLM model can register its first embedder with the system, where the central device and at least one first user device register the first embedder. When the first embedder is introduced or updated, the central device will configure the first embedder (including architecture and parameters (neuron values)) to all user devices via broadcast, multicast, and unicast.

[0349] When a second embedder exists and is introduced or updated, the central device can transmit the second embedder to all user devices. In some cases, the first LLM model can have both a first and a second embedder; in others, the first LLM model has a first embedder and the second LLM model has a second embedder. For example, the first embedder may be in English and the second embedder may be in Chinese, or the first embedder may be generic and the second embedder may be specific to IoT (smaller and faster).

[0350] Because LLMs can be implemented independently, a central device can have more than one LLM model, such as... Figure 11 Scenario 2 is shown in the example. For instance, the first LLM model is built by company A for green energy equipment management; the second LLM model is built by company B for smart city traffic sensors. Detailed information for each LLM model can be found in the description above.

[0351] When configuring an embedder, if there is more than one embedder, the central device can notify all user devices of the embedder identifier, see below. Figure 12 .

[0352] Register functional modalities to the system

[0353] A functional mode is an operation performed by a user equipment. Operations include observation and / or execution. When a user equipment performs an observation operation, it measures certain states or conditions. When a user equipment performs an execution operation, it changes certain states or conditions. A functional mode can be an observation operation, an execution observation, or both. Figure 13Examples of two states are given, namely state #1 and state #2. To access a state (state #1 and state #2), a function is required. Assume a function can only access one state at a time. This function can either change the state (an execution function, such as "SetState#1(value)") or read the state (an observation function, such as "Result = ReadState#1(void)", "IsState#1HigherThan(value)", or "IsState#1InRangeBetween(value1, value2)"), or both read and change the state (an execution and observation function).

[0354] At least one first functional modality is enabled, equipped, or implemented on at least one first user device. To enable the central device to use the first functional modality enabled on the first user device, the system registers the first functional modality into the system if it is new or updated to the system.

[0355] On the first user device, the first functional modality can be encapsulated as at least one first application programming interface (API) call function, see [link to relevant documentation]. Figure 14 The first API call function can be in various programming languages, such as C, Java, Python, C++, assembly, etc. The first API call function can have a first parameter list. The first API call function can have a first description, which uses natural language to describe the first functional modality. It should be noted that a functional modality can be implemented through a series of API functions, but it is best to implement one functional modality through a single API function. Figure 14 The functional modalities shown include the API, parameter list, and description in natural language.

[0356] Optionally, such as Figure 15 As shown, the first user device can translate the first description into a first semantic vector (or a batch of first semantic vectors of different lengths) using a first embedding device and then store it. Alternatively, the first user device can translate the first description into a second semantic vector (or a batch of second semantic vectors of different lengths) using a second embedding device and then store it. Alternatively, the first user device can translate the first description into a first semantic vector using the first embedding device without storing it. Due to the inherent randomness of the first embedding device, the first semantic vectors generated by the first embedding device may not be completely identical, but they will be very similar in the semantic domain.

[0357] like Figure 16As shown, the first user equipment can notify the central device of the first functional mode by transmitting a first description and a first parameter list to the central device. The first user equipment transmits the first description of the first functional mode to the central device so that the central device can register the first functional mode into the system.

[0358] After receiving the first description and the first parameter list, the central device can register the first functional modality to the first LLM model by providing the first description and the first parameter list. Optionally, if a second LLM model exists, the central device can register the first functional modality to the second LLM model by providing the first description and the first parameter list.

[0359] Optionally, such as Figure 17 As shown, the central device can translate the first description into a third semantic vector (or a third batch of semantic vectors of different lengths) using a first embedder and then store it. Preferably, the central device can associate the first user equipment identifier with the first functional modality. Alternatively, if a second embedder exists, the central device can translate the first description into a fourth semantic vector (or a fourth batch of semantic vectors of different lengths) using the second embedder and then store it. Alternatively, the central device can translate the first description into a third semantic vector using the first embedder without storing it. Due to the randomness of the first embedder, the third semantic vector generated by the first embedder may not be exactly the same, but they are very close in the semantic domain.

[0360] like Figure 18 As shown, if the second user equipment has the same first functional mode, the second user equipment can provide the central device with a first description and a first parameter list. The central device can add the second user equipment identifier to the first functional mode. That is, if the first functional mode has been registered, the central device can record the second user equipment that supports the first functional mode.

[0361] If the second user equipment has a second functional modality (new or updated), the second user equipment can provide the central device with a second description and a second parameter list. The central device can use the second functional modality to record the second user equipment identifier. Conversely, the central device can notify the first LLM model provider of the second functional modality by providing the second description and the second parameter list to the first LLM model provider. Optionally, if there is more than one LLM model provider, the central device can notify the second LLM model provider of the second functional modality by providing the second description and the second parameter list to the second LLM model provider.

[0362] Although the first user device and the central device translate the same first description using the same first embedder, the first semantic vector and the third semantic vector may not be exactly the same due to the randomness inherent in the first embedder. However, the first semantic vector and the third semantic vector have a strong semantic correlation.

[0363] If the central device consistently generates at least two consecutive open-vocabulary control messages for the user equipment, it indicates that two functional modalities can be combined into one functional modality. The central device and the user equipment can negotiate to generate a third functional modality with a third functional API. The third API function sequentially calls the two functional APIs. As runtime increases, new functional modalities are created that encapsulate multiple older functional modalities in a certain order, thereby improving efficiency.

[0364] like Figure 19 As shown, the central device generates at least one first open-vocabulary control message using a first LLM model. The first control message in natural language form may include a list of parameters (values) and is specific to a first functional modality on a first user device.

[0365] The central device divides the first open vocabulary (Open-Voc) control message into two parts: the first part includes a parameter list (if any), and the second part includes the rest of the first open vocabulary control message.

[0366] The central device can select a first length and translate the second part of the first open vocabulary control message into a fifth semantic vector through a first embedder.

[0367] The central device can translate the description of the first functional modality into a third semantic vector through the first embedder.

[0368] Although the fifth semantic vector and the third semantic vector may not be exactly the same due to the randomness of the first embedding model, the fifth semantic vector and the third semantic vector indicate a strong semantic correlation.

[0369] Optionally, such as Figure 20 As shown, the central device can compare the correlation between the fifth semantic vector and the third semantic vector with a first threshold. If the correlation between the fifth semantic vector and the semantic vector of each registered functional modality is lower than the first threshold, the central device can determine that the first control message is an unregistered message; otherwise, the central device can determine that the first control message is a registered message. The central device can reject unregistered messages.

[0370] One of its advantages is that the central equipment can multicast or unicast the information payload to user equipment that has registered the relevant functional modes, thereby saving power consumption of user equipment.

[0371] like Figure 21 As shown, the central device can encode and transmit the parameter list of the first open vocabulary control message during the first transmission opportunity, and encode and transmit the fifth semantic vector during the second transmission opportunity.

[0372] In other words, the central device can encode and transmit open-voc control messages in two transmission opportunities.

[0373] The central device allocates a segment of radio resources for control messages. The first portion of the radio resources is reserved for standardizing control messages. The second portion of the radio resources is allocated to open vocabulary control messages, which include at least a first open vocabulary control message.

[0374] The central device can form a first information payload, which includes a parameter list of a first open vocabulary control message, the start position of a second transmission opportunity, a first length of a fifth semantic vector, a first MCS encoding the fifth semantic vector, and (optionally) a first user equipment identifier. The central device encodes the first information payload using a second MCS. The central device allocates a first transmission opportunity in a second portion of the radio resources to transmit the first information payload.

[0375] The central device can form a second information payload including a fifth semantic vector. The central device encodes the second information payload using a first MCS. The central device allocates a second transmission opportunity with a starting position and a first length in the second part of the radio resources to transmit the second information payload.

[0376] like Figure 22 As shown, the first user equipment receives a first transmission opportunity (i.e., receives certain information about the first transmission opportunity). The first user equipment uses a second MCS to decode the first information payload. Optionally, if the user equipment identifier is transmitted in the first information payload, and the first user equipment finds that the decoded user equipment identifier does not match, the first user equipment may stop decoding the second information payload.

[0377] like Figure 23 As shown, the first user equipment decodes the parameter list of the first open vocabulary control message, the starting position of the second transmission opportunity, the first length of the fifth semantic vector, and the first MCS. Based on this information, the first user equipment receives the second transmission opportunity and uses the first MCS to decode the fifth semantic vector.

[0378] The first user equipment calculates the relevance between the fifth semantic and all its candidate semantics (including at least the first semantic vector). The first user equipment can select the first semantic as the most relevant semantic to the fifth semantic. Then, the first user equipment can use the parameters decoded by the first user equipment in the first transmission opportunity to invoke the first API call function. Finally, the first user equipment executes the first functional mode with the correct parameters.

[0379] In the top-level architecture, the central device sends a first control message in natural language to the first user device that performs the first functional mode.

[0380] In addition to the examples above, the following are some further descriptions of the present invention.

[0381] Registration Conditions Functional Modal

[0382] like Figure 24 As shown, the first user equipment can have a third functional mode. The first functional mode is associated with performing an operation, which is setting the state #1 of the first user equipment to "value #1". The third functional mode is associated with observing an operation, which is reading the state #2 of the first user equipment.

[0383] Typically, conditional control messages are expressed in natural language as: "SetState#1(value#1) if readState#2 is in a low range". Generally, the operation is performed conditionally on the result of the observation operation. To support conditional judgments, a conditional description is added to the observation modality in addition to the API name, parameter list, and description. In the following example: "SetState#1(value#1) if readState#2 is in a low range", the first conditional description could be in natural language form "if the checked state #2 is in a low range", and its corresponding API would be "readState#2()<=low-range-upbound". Similarly, the second conditional description could be in natural language form "if the checked state #2 is in a high range", and its corresponding API would be "readState#2()>=high-range-low-bound".

[0384] When a first user equipment registers an observation function mode (e.g., a third function mode), the first user needs to send not only the third description of the third function mode to the central equipment, but also the first (and second) condition descriptions. For example... Figure 25As shown, the first user equipment can translate the third description into a sixth semantic vector (or a batch of sixth semantic vectors of different lengths) using the first embedder and then store it. The first user equipment can translate the first conditional description of the third functional modality into a seventh semantic vector (or a batch of seventh semantic vectors of different lengths) using the first embedder and then store it. The first user equipment can translate the second conditional description of the third functional modality into an eighth semantic vector (or a batch of seventh semantic vectors of different lengths) using the first embedder and then store it.

[0385] like Figure 26 As shown, the first user equipment sends a third parameter list, a third description (in natural language), a first condition description (in natural language), and a second condition description (in natural language) to the central equipment.

[0386] like Figure 27 As shown, after receiving the third description and the third parameter list, the central device can register the third functional modality to the first LLM model by providing the third description, the first conditional description, the second conditional description, and the third parameter list. Optionally, if a second LLM model exists, the central device can register the third functional modality to the second LLM model by providing the third description, the first conditional description, the second conditional description, and the third parameter list.

[0387] Optionally, the central device can translate the third description into a ninth semantic vector (or a ninth batch of semantic vectors of different lengths) using the first embedding device and then store it. The central device can translate the first conditional description into a tenth semantic vector (or a tenth batch of semantic vectors of different lengths) using the first embedding device and then store it. The central device can translate the second conditional description into an eleventh semantic vector (or a ninth batch of semantic vectors of different lengths) using the first embedding device and then store it.

[0388] Translate one or more conditionally open vocabulary control messages

[0389] The central device uses a first LLM model to generate at least one first conditional open vocabulary control message. The first conditional control message, in natural language form, may include a list of parameters (values) for a first functional modality (operation) on the first user device, and conditional on the result of a third functional modality on the first device. For example, the first conditional open vocabulary control message is "If the checked state #2 is in a lower range, then configure state #1 to the value 1". Typically, "if...then" can be used as a prompt for the language generator to generate conditional control messages.

[0390] and Figure 19 Similar to the first open vocabulary control message in the first conditional open vocabulary control message, the central device can divide the first conditional open vocabulary control message into two parts and translate the second part into the fifth semantic vector.

[0391] Encoding and transmitting one or more conditionally open vocabulary control messages

[0392] The central device can encode and transmit a first conditionally open vocabulary control message to the first user, which is related to... Figure 20 The first open vocabulary in the text is very similar to the control message.

[0393] Understanding Open Vocabulary Control Messages

[0394] The first user equipment receives and processes the received first conditional open vocabulary control message, which, together with... Figure 21 The first open vocabulary in the text is very similar to the control message.

[0395] and Figure 22 Unlike the processing of the first open vocabulary control message, the first user device can calculate the correlation between the fifth semantic and all its candidate semantics, where all candidate semantics include at least the first semantic vector, the sixth semantic vector, and the seventh semantic vector. The first user device can select the first semantic vector and the seventh semantic vector as the semantic vectors most relevant to the fifth semantic. Subsequently, the first user device can use the result of the first conditional API of the third functional modality as a condition to call the first API call function using the parameters decoded by the first user device in the first transmission opportunity, such as... Figure 28 As shown.

[0396] Register loop function mode

[0397] Similar to the conditional function mode, the observation function mode can be the condition of a loop of multiple execution function modes.

[0398] Just as conditional descriptions are supported in the observation function modality, the first user equipment can add cyclic descriptions in the form of natural language. For example, "when the checked state #2 is in a lower range" and "when the checked state #2 is in a higher range".

[0399] from Figures 24 to 28 All conditional descriptions can be replaced with loop descriptions. The first LLM model of the central device can generate the first loop open vocabulary control message through the prompt "When..., execute...".

[0400] Programming user equipment through a series of open-vocabulary control messages

[0401] After the first user equipment and the central equipment support the first open vocabulary control message, the first conditional open vocabulary control message and the first cyclic open vocabulary control message, the central equipment can use the first LLM model to generate a series or a sequence of open vocabulary control messages to program the first user equipment.

[0402] Because the order of instructions in a program is important, the order of a series of open-vocabulary control messages is also important. For example, the central device can generate the following sequence:

[0403] Message 1: If the checked state 2 is in a lower range, then configure state #1 to value #1;

[0404] Message 2: When the checked state 1 is in a higher range, set state 3 to value #2;

[0405] Message 1 should be executed before message 2. This means that the first user equipment cannot execute message 2 until message 1 is completed. Alternatively, if the first user equipment cannot decode, understand, or execute message 1, then it does not need to decode message #2.

[0406] It should be noted that for V2X scenarios, DCI can be replaced with SCI, and DCI field packets can be replaced with SCI field packets.

[0407] It should be noted that in this invention, "controlling message" and "control signaling" have the same meaning and can be used interchangeably.

[0408] It should be noted that in this invention, "message" can mean "information" or carry "information". In some aspects of this invention, a computer program comprising instructions is provided. When the instructions are executed by a processor, the processor can implement the method of this invention.

[0409] The following describes embodiments of products related to wireless communication methods.

[0410] Figure 29 A schematic diagram of a first device according to one or more exemplary embodiments of the present invention is shown. This first device can be applied to the aforementioned central device, or a chip installed in or applied to the central device, or any other device, module, circuit, or unit capable of implementing the steps of the central device in the above method embodiments. Figure 29 As shown, the first device 2900 may include:

[0411] Processing module 2901 is used for:

[0412] At least one control message in natural language form is generated using a language model (LM), wherein each control message in the at least one control message indicates a corresponding operation to be performed, and each of the one or more control messages also indicates information related to performing the corresponding operation indicated by the one or more control messages, and the at least one control message includes one or more control messages;

[0413] Obtain at least one semantic information from at least one control message, wherein each control message in the at least one control message corresponds to one corresponding semantic information from the at least one semantic information;

[0414] Form at least one information payload, wherein the at least one information payload includes at least one piece of semantic information of at least one control message;

[0415] The transmitting module 2902 is used to transmit at least one information payload.

[0416] In one possible implementation, the LM can be an LLM.

[0417] In one possible implementation, some or all of the control messages in one or more control messages are conditional control messages or loop control messages.

[0418] In one possible implementation, each piece of information related to performing the corresponding operation is based on the result of another operation indicated by one or more control messages.

[0419] In one possible implementation, one or more control messages include a first control message, wherein the first control message is a conditional control message, the first control message indicating a first operation to be performed and information related to performing the first operation, the information related to performing the first operation including a first condition for performing the first operation, the first condition being based on the result of a second operation.

[0420] In one possible implementation, one or more control messages include a second control message, wherein the second control message is a loop control message, the second control message indicating a third operation to be performed and information related to performing the third operation, the information related to performing the third operation including a second condition for the loop used to perform the third operation, the second condition being based on the result of the fourth operation.

[0421] In one possible implementation, at least one control message includes multiple control messages to be executed sequentially.

[0422] In one possible implementation, the first device further includes an acquisition module 2903 for: acquiring registration information of a functional modality, wherein the registration information of the functional modality includes a description of the functional modality in natural language form.

[0423] In one possible implementation, the registration information for the functional modality further includes at least one description related to the result of the functional modality, wherein the at least one description related to the result of the functional modality is in natural language form, and each of the at least one description related to the result of the functional modality includes: a conditional description describing a condition based on the result of the functional modality; or a loop description describing a loop with a condition based on the result of the functional modality.

[0424] In one possible implementation, the registration information for the functional modality also includes a list of parameters for the functional modality.

[0425] In one possible implementation, the processing module 2901 is further configured to:

[0426] Register the functional modality with the LM.

[0427] In one possible implementation, the processing module 2901 is further configured to:

[0428] Record the registration information of the functional modality.

[0429] In one possible implementation, the processing module 2901 is further configured to:

[0430] Record the user equipment identifier (ID) of the user equipment with registered functional modes or the group user equipment ID of the user equipment group with registered functional modes.

[0431] In one possible implementation, the processing module 2901 is further configured to:

[0432] Based on the description of the functional modality, a first semantic information is obtained through the embedder.

[0433] In one possible implementation, the processing module 2901 is further configured to:

[0434] Based on at least one description related to the result of the functional modality, at least one piece of second semantic information corresponding to each of the at least one description is obtained by the embedder.

[0435] In one possible implementation, the processing module 2901 is further configured to:

[0436] Store the first semantic information and at least one piece of second semantic information.

[0437] In one possible implementation, the processing module 2901 is further configured to:

[0438] Determine the correlation between the semantic information of each control message in at least one control message and multiple semantic information of multiple registered functional modalities, wherein the multiple semantic information of multiple functional modalities includes multiple first semantic information, each first semantic information corresponding to a corresponding functional modality in the multiple functional modalities and obtained from the description of the corresponding functional modality in the multiple functional modalities; the multiple semantic information of multiple functional modalities also includes at least one second semantic information, each second semantic information being obtained from a description related to the result of one functional modality in the multiple functional modalities.

[0439] In one possible implementation, the processing module 2901 is further configured to:

[0440] The correlation between the semantic information of the third control message and each of the multiple semantic information is determined to be less than a threshold, wherein at least one control message includes the third control message;

[0441] Reject third-party control messages.

[0442] In one possible implementation, processing module 2901 is used for:

[0443] For each control message in at least one control message:

[0444] Extract the portion of each control message that does not contain any parameters;

[0445] Based on this section, a semantic piece of information for each control message is obtained through the embedder.

[0446] In one possible implementation, processing module 2901 is used for:

[0447] For each control message in at least one control message:

[0448] A first information payload is formed, wherein the first information payload includes the starting position information of the second transmission opportunity and the length information of the semantic information of each control message;

[0449] A second information payload is formed, wherein the second information payload includes semantic information of each control message, and a second transmission opportunity is used to transmit the second information payload.

[0450] In one possible implementation, at least one control message includes at least one fourth control message, each fourth control message further includes a parameter list, and the first information payload of each fourth control message in the at least one fourth control message also includes the parameter list.

[0451] In one possible implementation, the processing module 2901 is further configured to:

[0452] The second information payload is encoded using the first encoding method, wherein,

[0453] The first information payload also includes information about the first encoding method.

[0454] In one possible implementation, the processing module 2901 is further configured to:

[0455] The first information payload is encoded using a second encoding method.

[0456] In one possible implementation, the first encoding method includes a first modulation and coding scheme (MCS), and the second encoding method includes a second MCS.

[0457] In one possible implementation, the processing module 2901 is further configured to:

[0458] From multiple semantic information of multiple registered functional modalities, determine at least two semantic information related to at least one semantic information of at least one control message, wherein the at least two semantic information includes one or more first semantic information and one or more second semantic information;

[0459] Determine at least one user equipment ID or at least one group of user equipment IDs associated with at least two semantic pieces of information, wherein,

[0460] The first information payload also includes at least one user equipment ID, or at least one group of user equipment IDs; or the first information payload also includes information indicating at least one user equipment ID, or information indicating at least one group of user equipment IDs.

[0461] In one possible implementation, the sending module 2902 is used for:

[0462] During the first transmission opportunity, the first information payload is transmitted;

[0463] During the second transmission opportunity, a second information payload is sent.

[0464] In one possible implementation, the processing module 2901 is further configured to:

[0465] A functional modality is registered to at least one LM by providing registration information of the functional modality to at least one LM, wherein the at least one LM includes the LM.

[0466] In one possible implementation, the sending module 2902 is further configured to:

[0467] Send configuration information for at least one embedder.

[0468] In one possible implementation, the configuration information of at least one embedder is sent via broadcast, multicast, or unicast messages.

[0469] In one possible implementation, the configuration information of at least one embedder includes the architecture and parameters of each of the at least one embedder.

[0470] In one possible implementation, the configuration information of at least one embedder includes the embedder ID of each of the at least one embedder.

[0471] In one possible implementation, the information payload is sent via multicast or unicast messages.

[0472] In one possible implementation, there are multiple LMs, each of which includes the LM, wherein each of the multiple LMs has at least one embedder.

[0473] In one possible implementation, at least one functional mode is registered in one or more LMs among a plurality of LMs, but not in one or more other LMs besides the one or more LMs among the plurality of LMs.

[0474] In one possible implementation, the first LM of the plurality of LMs has a first embedder, and the second LM of the plurality of LMs does not have a first embedder.

[0475] In one possible implementation, the LM has a first embedder and a second embedder that is different from the first embedder.

[0476] In one possible implementation, the processing module 2901 is further configured to:

[0477] Register this LM.

[0478] In one possible implementation, the processing module 2901 is further configured to:

[0479] Register at least one embedder of the LM.

[0480] In one possible implementation, the order in which the corresponding control messages among the multiple control messages are executed is indicated by the order in which the corresponding control messages are executed among the multiple control messages.

[0481] Figure 30 A schematic diagram of a second device according to one or more exemplary embodiments of the present invention is shown. This second device can be applied to the aforementioned user equipment, or a chip installed in or applied to a central device, or any other device, module, circuit, or unit capable of implementing the steps of the user equipment in the above method embodiments. Figure 30 As shown, the second device 3000 may include:

[0482] The acquisition module 3001 is used to acquire at least one information payload, wherein the at least one information payload includes at least one semantic information of at least one control message, and each control message in the at least one control message corresponds to one corresponding semantic information in the at least one semantic information.

[0483] Processing module 3002 is used for:

[0484] From multiple semantic information of multiple functional modalities, determine at least one target semantic information that corresponds to at least one semantic information of at least one control message, wherein each target semantic information in the at least one target semantic information indicates the corresponding functional modality to be executed; one or more target semantic information in the at least one target semantic information also indicates information related to the execution of the corresponding functional modality, wherein the multiple functional modalities include the corresponding functional modality to be executed;

[0485] Execute the corresponding functional modality based on each of the at least one target semantic information.

[0486] In one possible implementation, at least one control message includes one or more control messages, each of which is a conditional control message or a loop control message.

[0487] In one possible implementation, each piece of information related to the execution of the corresponding functional mode is based on the result of another functional mode indicated by one or more control messages.

[0488] In one possible implementation, one or more target semantic information includes first target semantic information indicating a first functional modality to be executed and information related to the execution of the first functional modality, wherein the information related to the execution of the first functional modality includes a first condition for the execution of the first functional modality, the first condition being based on the result of a second functional modality, and the multiple functional modalities include the first functional modality and the second functional modality.

[0489] In one possible implementation, one or more target semantic information pieces include second target semantic information indicating the third functional modality to be executed and information related to the execution of the third functional modality, wherein the information related to the execution of the third functional modality includes a second condition for a loop for executing the third functional modality, the second condition being based on the result of a fourth functional modality, and the multiple functional modalities include the third functional modality and the fourth functional modality.

[0490] In one possible implementation, the multiple semantic information of multiple functional modalities includes multiple first semantic information corresponding to multiple functional modalities, each of the multiple first semantic information being obtained from the description of the corresponding functional modality in the multiple functional modalities, wherein the description is in natural language form; the multiple semantic information of multiple functional modalities also includes at least one second semantic information, each of the second semantic information being obtained from the description related to the result of the functional modality in the multiple functional modalities, wherein the description related to the result of the functional modality is in natural language form.

[0491] In one possible implementation, one or more pieces of target semantic information include first target semantic information indicating the corresponding function to be performed and second target semantic information indicating information related to the modality of performing the corresponding function.

[0492] In one possible implementation, the processing module 3002 is further configured to:

[0493] Each of a plurality of functional modalities is encapsulated as a calling function to obtain a plurality of calling functions, wherein each of the plurality of calling functions includes a description of the corresponding functional modality, the description being in natural language form; one or more of the plurality of calling functions respectively further include at least one of the following: a parameter list of the corresponding functional modality or at least one description related to the result of the corresponding functional modality, wherein the at least one description related to the result of the functional modality is in natural language form and includes: a conditional description describing a condition based on the result of the corresponding functional modality; or a loop description describing a loop with a condition based on the result of the corresponding functional modality.

[0494] In one possible implementation, the calling function includes an application programming interface (API) calling function.

[0495] In one possible implementation, the second device further includes a sending module 3003, configured to: send registration information for each of the plurality of functional modes, wherein the registration information for each functional mode includes a description of each functional mode.

[0496] In one possible implementation, the registration information for each of one or more functional modalities among a plurality of functional modalities further includes at least one of the following: a parameter list for each of the one or more functional modalities or at least one description related to the result of each of the one or more functional modalities, wherein the at least one description related to the result of each of the one or more functional modalities is in natural language form and includes: a conditional description describing conditions based on the result of each of the one or more functional modalities; or a loop description describing a loop with conditions based on the result of each of the one or more functional modalities.

[0497] In one possible implementation, the processing module 3002 is also used to decode at least one information payload.

[0498] In one possible implementation, each information payload in at least one information payload includes:

[0499] The first information payload is acquired during the first transmission opportunity of the corresponding control message, and includes the start position information of the second transmission opportunity of the corresponding control message and the length information of the semantic information of the corresponding control message.

[0500] The second information payload is acquired during the second transmission opportunity of the corresponding control message and includes the semantic information of the corresponding control message.

[0501] In one possible implementation, the processing module 3002 is further configured to:

[0502] The first information payload is decoded to obtain the starting position information of the second transmission opportunity and the length information of the semantic information of the corresponding control message;

[0503] The second information payload is decoded to obtain the semantic information of the corresponding control message.

[0504] In one possible implementation, at least one control message includes multiple control messages to be executed sequentially.

[0505] In one possible implementation, the processing module 3002 is further configured to:

[0506] When the information payload containing a semantic information of a second control message among multiple control messages fails to be decoded, or when the execution of a functional mode indicating a target semantic information of a second control message among multiple control messages fails, the information payload containing a semantic information of a first control message among multiple control messages is not decoded, wherein the second control message precedes the first control message in this order.

[0507] In one possible implementation, the first information payload of each of the one or more information payloads in at least one information payload further includes: a parameter list corresponding to the control message.

[0508] In one possible implementation, the first information payload also includes information from the first encoding method, and the second information payload is decoded using the first encoding method.

[0509] In one possible implementation, a second encoding method is used to decode the first information payload.

[0510] In one possible implementation, the first encoding method includes a first modulation and coding scheme (MCS), and the second encoding method includes a second MCS.

[0511] In one possible implementation, the first information payload further includes: information indicating the user equipment ID or information indicating the group user equipment ID.

[0512] In one possible implementation, the processing module 3002 is further configured to:

[0513] In response to the determination that the user equipment ID or group user equipment ID does not match the user equipment ID or group user equipment ID of the user equipment, the second information payload is not decoded.

[0514] In one possible implementation, the acquisition module 3001 is also used for:

[0515] Obtain configuration information for at least one embedder.

[0516] In one possible implementation, at least one semantic piece of information for at least one control message is obtained through a first embedder in at least one embedder, and multiple semantic pieces of information for multiple functional modalities are obtained through the first embedder.

[0517] In one possible implementation, the configuration information of at least one embedder includes the embedder ID of each of the at least one embedder.

[0518] In one possible implementation, multiple semantic pieces of information from multiple functional modalities are acquired and then stored.

[0519] In one possible implementation, multiple semantic information of multiple functional modalities is obtained by a first embedder before each determination of at least one target semantic information corresponding to at least one semantic information of at least one control message.

[0520] In one possible implementation, the order in which multiple control messages are executed is indicated by the order in which the corresponding control messages are executed within the multiple control messages.

[0521] This invention provides a third apparatus, including processing circuitry for performing any of the above-described communication methods executed by a central device. It should be understood that the third apparatus is capable of performing the steps executed by the central device in the above method embodiments, which will not be elaborated further here.

[0522] This invention provides a fourth apparatus, including processing circuitry for performing any of the above-described communication methods executed by a user equipment. It should be understood that the fourth apparatus is capable of performing the steps executed by the user equipment in the above method embodiments, and will not be described again here.

[0523] This invention provides a communication system, including at least one first device and / or at least one third device, as well as at least one second device and / or at least one fourth device.

[0524] This invention provides a communication system including at least one first processing circuit and at least one second processing circuit. The first processing circuit is used to execute the steps performed by a central device in any of the above-described communication methods, and the second processing circuit is used to execute the steps performed by a user device in any of the above-described communication methods.

[0525] Embodiments of the present invention provide a computer-readable medium storing computer-executable instructions that, when executed by a processor, cause the processor to perform steps in any of the above-described communication methods that are performed by a central device or by a user device.

[0526] This invention provides a computer program product including computer execution instructions, which, when executed by a processor, cause the processor to perform the steps in any of the above-described communication methods performed by a central device or by a user device.

[0527] Although embodiments of the present invention describe methods and processes by means of steps performed in a certain order, one or more steps in the methods and processes may be omitted or modified as appropriate. Where appropriate, one or more steps may be performed in an order other than that described.

[0528] In some aspects of the invention, a non-transitory computer-readable medium is provided that stores instructions which, when executed by a processor, enable the processor to implement the method of the invention.

[0529] In some aspects of the present invention, an apparatus / chipset system is provided, including components for implementing the method implemented by the sensing device of the present invention.

[0530] In some aspects of the invention, an apparatus / chipset system is provided, including components for implementing the methods implemented by the central device of the invention.

[0531] In some aspects of the invention, an apparatus / chipset system is provided, including components for implementing the methods implemented by the GPT device of the present invention.

[0532] In some aspects of the invention, a system is provided comprising at least two of the means of the sensing device of the invention, the means of the central device of the invention, and the means of the GPT device of the invention.

[0533] In some aspects of the invention, an apparatus / chipset system is provided, including at least one processor that executes instructions stored in a computer-readable medium to implement the method implemented by the sensing device of the invention.

[0534] In some aspects of the invention, an apparatus / chipset system is provided, including at least one processor that executes instructions stored in a computer-readable medium to implement a method implemented by the central device of the invention.

[0535] In some aspects of the invention, an apparatus / chipset system is provided, including at least one processor that executes instructions stored in a computer-readable medium to implement the methods implemented by the GPT device of the present invention.

[0536] This invention includes various embodiments, not only method embodiments but also other embodiments, such as apparatus embodiments and embodiments related to non-transitory computer-readable storage media. Embodiments may be incorporated individually or in combination with the features disclosed herein.

[0537] Although the present invention has referenced illustrative embodiments, it is not intended to be interpreted in a limiting sense. Those skilled in the art will understand, upon referring to this description, various modifications and combinations of the illustrative embodiments, as well as other embodiments of the invention.

[0538] Additionally or alternatively, features disclosed herein in the context of any particular embodiment may be implemented in other embodiments. For example, method embodiments may be implemented in apparatus, system, and / or computer program product embodiments. Furthermore, although embodiments are described primarily in the context of methods and apparatus, other implementations are contemplated as instructions stored in a non-transitory computer-readable medium, etc. Such a medium may store programs or instructions to perform any of the methods consistent with the present invention.

Claims

1. A control method, characterized in that, include: At least one control message in natural language form is generated using a language model (LM), wherein each control message in the at least one control message indicates a corresponding operation to be performed, and each of the one or more control messages further indicates information related to performing the corresponding operation indicated by the one or more control messages, wherein the at least one control message includes the one or more control messages; Obtain at least one semantic information from the at least one control message, wherein each control message in the at least one control message corresponds to a corresponding semantic information from the at least one semantic information; Form at least one information payload, wherein the at least one information payload includes at least one piece of semantic information of the at least one control message; Send the at least one information payload.

2. The method according to claim 1, characterized in that, Some or all of the control messages in the one or more control messages are conditional control messages or loop control messages.

3. The method according to claim 2, characterized in that, Each piece of information related to the execution of the corresponding operation is based on the result of another operation indicated by the one or more control messages.

4. The method according to claim 3, characterized in that, The one or more control messages include a first control message, wherein the first control message is a conditional control message, the first control message indicating a first operation to be performed and information related to performing the first operation, the information related to performing the first operation including a first condition for performing the first operation, the first condition being based on the result of a second operation.

5. The method according to claim 3 or 4, characterized in that, The one or more control messages include a second control message, wherein the second control message is a loop control message, the second control message indicating a third operation to be performed and information related to performing the third operation, the information related to performing the third operation including a second condition for a loop for performing the third operation, the second condition being based on the result of a fourth operation.

6. The method according to any one of claims 1 to 5, characterized in that, The at least one control message includes a plurality of control messages to be executed sequentially.

7. The method according to any one of claims 1 to 6, characterized in that, Also includes: Obtain registration information for a functional modality, wherein the registration information for the functional modality includes a description of the functional modality, the description being in natural language form.

8. The method according to claim 7, characterized in that, The registration information of the functional modality further includes at least one description related to the result of the functional modality, wherein the at least one description related to the result of the functional modality is in natural language form, and each of the at least one description related to the result of the functional modality includes: a conditional description describing a condition based on the result of the functional modality; or a loop description describing a loop with a condition based on the result of the functional modality.

9. The method according to claim 7 or 8, characterized in that, The registration information of the functional modality also includes a parameter list of the functional modality.

10. The method according to any one of claims 7 to 9, characterized in that, Also includes: Register the functional mode with the LM.

11. The method according to claim 10, characterized in that, Also includes: Record the registration information of the functional modality.

12. The method according to claim 11, characterized in that, Also includes: Record the user equipment identifier ID of the user equipment that has registered the functional mode or the group user equipment ID of the user equipment group that has registered the functional mode.

13. The method according to any one of claims 7 to 12, characterized in that, Also includes: Based on the description of the functional modality, a first semantic information is obtained through the embedder.

14. The method according to any one of claims 8 to 12, characterized in that, Also includes: Based on the at least one description associated with the result of the functional modality, at least one piece of second semantic information corresponding to the at least one description is obtained by the embedder.

15. The method according to claim 14, characterized in that, Also includes: Store the first semantic information and the at least one piece of second semantic information.

16. The method according to any one of claims 13 to 15, characterized in that, Prior to forming the at least one information payload, the method further includes: The correlation between the semantic information of each control message in the at least one control message and multiple semantic information of a plurality of registered functional modalities is determined, wherein the multiple semantic information of the plurality of functional modalities includes multiple first semantic information, each first semantic information corresponding to a corresponding functional modality in the plurality of functional modalities and obtained from the description of the corresponding functional modality in the plurality of functional modalities; the multiple semantic information of the plurality of functional modalities also includes at least one second semantic information, each second semantic information being obtained from a description related to the result of one functional modality in the plurality of functional modalities.

17. The method according to claim 11, characterized in that, Also includes: The correlation between the semantic information of the third control message and each of the plurality of semantic information is determined to be less than a threshold, wherein the at least one control message includes the third control message; The third control message is rejected.

18. The method according to any one of claims 1 to 17, characterized in that, The acquisition of the at least one semantic information of the at least one control message includes: For each of the at least one control message: Extract the portion of each control message that does not contain any parameters; According to the aforementioned part, a semantic piece of information for each control message is obtained through the embedder.

19. The method according to claim 18, characterized in that, The formation of the at least one information payload includes: For each of the at least one control message: A first information payload is formed, wherein the first information payload includes the start position information of the second transmission opportunity and the length information of the semantic information of each control message; A second information payload is formed, wherein the second information payload includes the semantic information of each control message, and the second transmission opportunity is used to transmit the second information payload.

20. The method according to claim 19, characterized in that, The at least one control message includes at least one fourth control message, each fourth control message further includes a parameter list, and the first information payload of each of the at least one fourth control message further includes the parameter list.

21. The method according to claim 19 or 20, characterized in that, Also includes: The second information payload is encoded using a first encoding method, wherein, The first information payload also includes information from the first encoding method.

22. The method according to any one of claims 19 to 21, characterized in that, Also includes: The first information payload is encoded using a second encoding method.

23. The method according to claim 22, characterized in that, The first encoding method includes a first modulation and coding scheme (MCS), and the second encoding method includes a second MCS.

24. The method according to claim 16, characterized in that, Also includes: From the multiple semantic information of the registered multiple functional modalities, determine at least two semantic information related to the at least one semantic information of the at least one control message, wherein the at least two semantic information includes one or more first semantic information and one or more second semantic information; Determine at least one user equipment ID or at least one group of user equipment IDs associated with the at least two semantic pieces of information, wherein, The first information payload further includes the at least one user equipment ID, or the at least one group of user equipment IDs; or the first information payload further includes information indicating the at least one user equipment ID, or information indicating the at least one group of user equipment IDs.

25. The method according to any one of claims 19 to 24, characterized in that, The payload for transmitting the information includes: The first information payload is transmitted during the first transmission opportunity. The second information payload is transmitted during the second transmission opportunity.

26. The method according to claim 9, characterized in that, Registering the functional modality with the LM includes: The functional modality is registered to at least one LM by providing the registration information of the functional modality to the at least one LM, wherein the at least one LM includes the LM.

27. The method according to any one of claims 13 to 26, characterized in that, Also includes: Send configuration information for at least one embedder.

28. The method according to claim 27, characterized in that, The configuration information of the at least one embedder is sent via broadcast message, multicast message, or unicast message.

29. The method according to claim 27 or 28, characterized in that, The configuration information of the at least one embedder includes the architecture and parameters of each of the at least one embedder.

30. The method according to any one of claims 27 to 29, characterized in that, The configuration information of the at least one embedder includes the embedder ID of each of the at least one embedder.

31. The method according to any one of claims 1 to 30, characterized in that, The information payload is sent via multicast or unicast messages.

32. The method according to any one of claims 1 to 31, characterized in that, There are multiple LMs, the multiple LMs including the LM, wherein each of the multiple LMs has at least one embedder.

33. The method according to claim 32, characterized in that, At least one functional mode is registered in one or more of the plurality of LMs, but not in one or more other LMs other than the one or more LMs.

34. The method according to claim 32, characterized in that, The first LM of the plurality of LMs has a first embedder, and the second LM of the plurality of LMs does not have the first embedder.

35. The method according to any one of claims 1 to 34, characterized in that, The LM has a first embedder and a second embedder that is different from the first embedder.

36. The method according to any one of claims 1 to 35, characterized in that, Also includes: Register the LM.

37. The method according to claim 36, characterized in that, Also includes: Register at least one embedder of the LM.

38. The method according to claim 6, characterized in that, The order in which the corresponding control messages among the plurality of control messages are executed is indicated by the order of the corresponding control messages among the plurality of control messages.

39. A control method, characterized in that, include: Obtain at least one information payload, wherein the at least one information payload includes at least one semantic information of at least one control message, and each control message in the at least one control message corresponds to a corresponding semantic information in the at least one semantic information; From multiple semantic information of multiple functional modalities, at least one target semantic information corresponding to the at least one semantic information of the at least one control message is determined, wherein each target semantic information indicates a corresponding functional modality to be executed; one or more target semantic information of the at least one target semantic information also indicates information related to the execution of the corresponding functional modality, wherein the multiple functional modalities include the corresponding functional modality to be executed; The corresponding functional mode is executed based on each of the at least one target semantic information.

40. The method according to claim 39, characterized in that, The at least one control message includes one or more control messages, each of which is a conditional control message or a loop control message.

41. The method according to claim 40, characterized in that, Each piece of information associated with the execution of the corresponding functional mode is based on the result of another functional mode indicated by the one or more control messages.

42. The method according to claim 41, characterized in that, The one or more target semantic information includes first target semantic information indicating a first functional modality to be executed and information related to executing the first functional modality, wherein the information related to executing the first functional modality includes a first condition for executing the first functional modality, the first condition being based on the result of a second functional modality, and the multiple functional modalities include the first functional modality and the second functional modality.

43. The method according to claim 41 or 42, characterized in that, The one or more target semantic information includes second target semantic information indicating the third functional modality to be executed and information related to the execution of the third functional modality, wherein the information related to the execution of the third functional modality includes a second condition for a loop for executing the third functional modality, the second condition being based on the result of a fourth functional modality, and the plurality of functional modalities including the third functional modality and the fourth functional modality.

44. The method according to any one of claims 41 to 43, characterized in that, The multiple semantic information of the multiple functional modalities includes multiple first semantic information corresponding to the multiple functional modalities, each of the multiple first semantic information being obtained from the description of the corresponding functional modality in the multiple functional modalities, wherein the description is in natural language form; the multiple semantic information of the multiple functional modalities also includes at least one second semantic information, each of the second semantic information being obtained from the description related to the result of the functional modality in the multiple functional modalities, wherein the description related to the result of the functional modality is in natural language form.

45. The method according to claim 44, characterized in that, The one or more target semantic information items respectively include first target semantic information indicating the corresponding function to be performed and second target semantic information indicating information related to the modality of performing the corresponding function.

46. ​​The method according to any one of claims 39 to 45, characterized in that, Before acquiring the at least one information payload, the method further includes: Each of the plurality of functional modalities is encapsulated as a calling function to obtain a plurality of calling functions, wherein each of the plurality of calling functions includes a description of the corresponding functional modality, the description being in natural language form; one or more of the plurality of calling functions further include at least one of the following: a parameter list of the corresponding functional modality or at least one description related to the result of the corresponding functional modality, wherein the at least one description related to the result of the functional modality is in natural language form and includes: a conditional description describing a condition based on the result of the corresponding functional modality; or a loop description describing a loop with a condition based on the result of the corresponding functional modality.

47. The method according to claim 46, characterized in that, The calling functions include application programming interface (API) calling functions.

48. The method according to claim 46 or 47, characterized in that, Before acquiring the at least one information payload, the method further includes: Send registration information for each of the plurality of functional modalities, wherein the registration information for each functional modality includes the description of each functional modality.

49. The method according to claim 48, characterized in that, The registration information for each of one or more functional modalities in the plurality of functional modalities further includes at least one of the following: a parameter list for each of the one or more functional modalities or at least one description related to the result of each of the one or more functional modalities, wherein the at least one description related to the result of each of the one or more functional modalities is in natural language form and includes: a conditional description describing conditions based on the result of each of the one or more functional modalities; or a loop description describing a loop with conditions based on the result of each of the one or more functional modalities.

50. The method according to any one of claims 39 to 49, characterized in that, It also includes decoding the at least one information payload.

51. The method according to claim 50, characterized in that, Each of the at least one information payload includes: The first information payload is acquired during the first transmission opportunity of the corresponding control message, and includes the start position information of the second transmission opportunity of the corresponding control message and the length information of the semantic information of the corresponding control message. The second information payload is acquired during the second transmission opportunity of the corresponding control message and includes the semantic information of the corresponding control message.

52. The method according to claim 51, characterized in that, Decoding each information payload in the at least one information payload includes: The first information payload is decoded to obtain the starting position information of the second transmission opportunity and the length information of the semantic information of the corresponding control message; The second information payload is decoded to obtain the semantic information of the corresponding control message.

53. The method according to any one of claims 50 to 52, characterized in that, The at least one control message includes a plurality of control messages to be executed sequentially.

54. The method according to claim 53, characterized in that, Also includes: When the information payload containing a semantic information of the second control message among the plurality of control messages fails to be decoded, or when the functional mode indicated by a target semantic information of the second control message among the plurality of control messages fails to be executed, the information payload containing a semantic information of the first control message among the plurality of control messages is not decoded, wherein, in the order stated, the second control message precedes the first control message.

55. The method according to claim 51, characterized in that, The first information payload of each of the at least one information payload further includes: the parameter list of the corresponding control message.

56. The method according to any one of claims 51 to 55, characterized in that, The first information payload also includes information about the first encoding method, and the second information payload is decoded using the first encoding method.

57. The method according to claim 56, characterized in that, The first information payload is decoded using a second encoding method.

58. The method according to claim 57, characterized in that, The first encoding method includes a first modulation and coding scheme (MCS), and the second encoding method includes a second MCS.

59. The method according to any one of claims 51 to 57, characterized in that, The first information payload also includes: information indicating the user equipment ID or information indicating the group user equipment ID.

60. The method according to claim 59, characterized in that, Also includes: In response to determining that the user equipment ID or the group user equipment ID does not match the user equipment ID or group user equipment ID of the user equipment, the second information payload is not decoded.

61. The method according to any one of claims 51 to 60, characterized in that, Also includes: Obtain configuration information for at least one embedder.

62. The method according to claim 61, characterized in that, The at least one semantic information of the at least one control message is obtained through a first embedder in the at least one embedder, and the multiple semantic information of the multiple functional modalities is obtained through the first embedder.

63. The method according to claim 62, characterized in that, The configuration information of the at least one embedder includes the embedder ID of each of the at least one embedder.

64. The method according to any one of claims 61 to 63, characterized in that, The multiple semantic information of the multiple functional modalities are stored after acquisition.

65. The method according to any one of claims 61 to 63, characterized in that, The multiple semantic information of the multiple functional modalities is obtained by the first embedder before each determination of the at least one target semantic information corresponding to the at least one semantic information of the at least one control message.

66. The method according to claim 53, characterized in that, The order in which the plurality of control messages are executed is indicated by the order in which the corresponding control messages are executed within the plurality of control messages.

67. A first device, characterized in that, include: Processing module, used for: At least one control message in natural language form is generated using a language model (LM), wherein each control message in the at least one control message indicates a corresponding operation to be performed, and each of the one or more control messages further indicates information related to performing the corresponding operation indicated by the one or more control messages, wherein the at least one control message includes the one or more control messages; Obtain at least one semantic information from the at least one control message, wherein each control message in the at least one control message corresponds to a corresponding semantic information from the at least one semantic information; Form at least one information payload, wherein the at least one information payload includes at least one piece of semantic information of the at least one control message; A sending module is used to send the at least one information payload.

68. The apparatus according to claim 67, characterized in that, Some or all of the control messages in the one or more control messages are conditional control messages or loop control messages.

69. The apparatus according to claim 68, characterized in that, Each piece of information related to the execution of the corresponding operation is based on the result of another operation indicated by the one or more control messages.

70. The apparatus according to claim 69, characterized in that, The one or more control messages include a first control message, wherein the first control message is a conditional control message, the first control message indicating a first operation to be performed and information related to performing the first operation, the information related to performing the first operation including a first condition for performing the first operation, the first condition being based on the result of a second operation.

71. The apparatus according to claim 69 or 70, characterized in that, The one or more control messages include a second control message, wherein the second control message is a loop control message, the second control message indicating a third operation to be performed and information related to performing the third operation, the information related to performing the third operation including a second condition for a loop for performing the third operation, the second condition being based on the result of a fourth operation.

72. The apparatus according to any one of 67 to 71, characterized in that, The at least one control message includes a plurality of control messages to be executed sequentially.

73. The apparatus according to any one of claims 67 to 72, characterized in that, The first device further includes an acquisition module, configured to: acquire registration information of a functional modality, wherein the registration information of the functional modality includes a description of the functional modality, the description being in natural language form.

74. The apparatus according to claim 73, characterized in that, The registration information of the functional modality further includes at least one description related to the result of the functional modality, wherein the at least one description related to the result of the functional modality is in natural language form, and each of the at least one description related to the result of the functional modality includes: a conditional description describing a condition based on the result of the functional modality; or a loop description describing a loop with a condition based on the result of the functional modality.

75. The apparatus according to claim 73 or 74, characterized in that, The registration information of the functional modality also includes a parameter list of the functional modality.

76. The apparatus according to any one of claims 73 to 75, characterized in that, The processing module is also used for: Register the functional mode with the LM.

77. The apparatus according to claim 76, characterized in that, The processing module is also used for: Record the registration information of the functional modality.

78. The apparatus according to claim 77, characterized in that, The processing module is also used for: Record the user equipment identifier (ID) of the user equipment that has registered the functional mode or the group user equipment ID of the user equipment group that has registered the functional mode.

79. The apparatus according to any one of claims 73 to 78, characterized in that, The processing module is also used for: Based on the description of the functional modality, a first semantic information is obtained through the embedder.

80. The apparatus according to any one of claims 74 to 78, characterized in that, The processing module is also used for: Based on the at least one description associated with the result of the functional modality, at least one piece of second semantic information corresponding to the at least one description is obtained by the embedder.

81. The apparatus according to claim 80, characterized in that, The processing module is also used for: Store the first semantic information and the at least one piece of second semantic information.

82. The apparatus according to any one of claims 79 to 81, characterized in that, The processing module is also used for: The correlation between the semantic information of each control message in the at least one control message and multiple semantic information of a plurality of registered functional modalities is determined, wherein the multiple semantic information of the plurality of functional modalities includes multiple first semantic information, each first semantic information corresponding to a corresponding functional modality in the plurality of functional modalities and obtained from the description of the corresponding functional modality in the plurality of functional modalities; the multiple semantic information of the plurality of functional modalities also includes at least one second semantic information, each second semantic information being obtained from a description related to the result of one functional modality in the plurality of functional modalities.

83. The apparatus according to claim 77, characterized in that, The processing module is also used for: The correlation between the semantic information of the third control message and each of the plurality of semantic information is determined to be less than a threshold, wherein the at least one control message includes the third control message; The third control message is rejected.

84. The apparatus according to any one of claims 67 to 83, characterized in that, The processing module is used for: For each of the at least one control message: Extract the portion of each control message that does not contain any parameters; According to the aforementioned part, a semantic piece of information for each control message is obtained through the embedder.

85. The apparatus according to claim 84, characterized in that, The processing module is used for: For each of the at least one control message: A first information payload is formed, wherein the first information payload includes the start position information of the second transmission opportunity and the length information of the semantic information of each control message; A second information payload is formed, wherein the second information payload includes the semantic information of each control message, and the second transmission opportunity is used to transmit the second information payload.

86. The apparatus according to claim 85, characterized in that, The at least one control message includes at least one fourth control message, each fourth control message further includes a parameter list, and the first information payload of each of the at least one fourth control message further includes the parameter list.

87. The apparatus according to claim 85 or 86, characterized in that, The processing module is also used for: The second information payload is encoded using a first encoding method, wherein, The first information payload also includes information from the first encoding method.

88. The apparatus according to any one of claims 85 to 87, characterized in that, The processing module is also used for: The first information payload is encoded using a second encoding method.

89. The apparatus according to claim 88, characterized in that, The first encoding method includes a first modulation and coding scheme (MCS), and the second encoding method includes a second MCS.

90. The apparatus according to claim 82, characterized in that, The processing module is also used for: From the multiple semantic information of the registered multiple functional modalities, determine at least two semantic information related to the at least one semantic information of the at least one control message, wherein the at least two semantic information includes one or more first semantic information and one or more second semantic information; Determine at least one user equipment ID or at least one group of user equipment IDs associated with the at least two semantic pieces of information, wherein, The first information payload further includes the at least one user equipment ID, or the at least one group of user equipment IDs; or the first information payload further includes information indicating the at least one user equipment ID, or information indicating the at least one group of user equipment IDs.

91. The apparatus according to any one of claims 85 to 90, characterized in that, The sending module is used for: The first information payload is transmitted during the first transmission opportunity. The second information payload is transmitted during the second transmission opportunity.

92. The apparatus according to claim 75, characterized in that, The processing module is also used for: The functional modality is registered to at least one LM by providing the registration information of the functional modality to the at least one LM, wherein the at least one LM includes the LM.

93. The apparatus according to any one of claims 79 to 92, characterized in that, The sending module is also used for: Send configuration information for at least one embedder.

94. The apparatus according to claim 93, characterized in that, The configuration information of the at least one embedder is sent via broadcast message, multicast message, or unicast message.

95. The apparatus according to claim 93 or 94, characterized in that, The configuration information of the at least one embedder includes the architecture and parameters of each of the at least one embedder.

96. The apparatus according to any one of claims 93 to 95, characterized in that, The configuration information of the at least one embedder includes the embedder ID of each of the at least one embedder.

97. The apparatus according to any one of claims 67 to 96, characterized in that, The information payload is sent via multicast or unicast messages.

98. The apparatus according to any one of claims 67 to 97, characterized in that, There are multiple LMs, the multiple LMs including the LM, wherein each of the multiple LMs has at least one embedder.

99. The apparatus according to claim 98, characterized in that, At least one functional mode is registered in one or more of the plurality of LMs, but not in one or more other LMs other than the one or more LMs.

100. The apparatus according to claim 98, characterized in that, The first LM of the plurality of LMs has a first embedder, and the second LM of the plurality of LMs does not have the first embedder.

101. The apparatus according to any one of claims 67 to 100, characterized in that, The LM has a first embedder and a second embedder that is different from the first embedder.

102. The apparatus according to any one of claims 67 to 101, characterized in that, The processing module is also used for: Register the LM.

103. The apparatus according to claim 102, characterized in that, The processing module is also used for: Register at least one embedder of the LM.

104. The apparatus according to claim 72, characterized in that, The order in which the corresponding control messages among the plurality of control messages are executed is indicated by the order of the corresponding control messages among the plurality of control messages.

105. A second device, characterized in that, include: An acquisition module is configured to acquire at least one information payload, wherein the at least one information payload includes at least one semantic information of at least one control message, and each control message in the at least one control message corresponds to a corresponding semantic information in the at least one semantic information; Processing module, used for: From multiple semantic information of multiple functional modalities, at least one target semantic information corresponding to the at least one semantic information of the at least one control message is determined, wherein each target semantic information indicates a corresponding functional modality to be executed; one or more target semantic information of the at least one target semantic information also indicates information related to the execution of the corresponding functional modality, wherein the multiple functional modalities include the corresponding functional modality to be executed; The corresponding functional mode is executed based on each of the at least one target semantic information.

106. The apparatus according to claim 105, characterized in that, The at least one control message includes one or more control messages, each of which is a conditional control message or a loop control message.

107. The apparatus according to claim 106, characterized in that, Each piece of information associated with the execution of the corresponding functional mode is based on the result of another functional mode indicated by the one or more control messages.

108. The apparatus according to claim 107, characterized in that, The one or more target semantic information includes first target semantic information indicating a first functional modality to be executed and information related to executing the first functional modality, wherein the information related to executing the first functional modality includes a first condition for executing the first functional modality, the first condition being based on the result of a second functional modality, and the multiple functional modalities include the first functional modality and the second functional modality.

109. The apparatus according to claim 107 or 108, characterized in that, The one or more target semantic information includes second target semantic information indicating the third functional modality to be executed and information related to the execution of the third functional modality, wherein the information related to the execution of the third functional modality includes a second condition for a loop for executing the third functional modality, the second condition being based on the result of a fourth functional modality, and the plurality of functional modalities including the third functional modality and the fourth functional modality.

110. The apparatus according to any one of claims 107 to 109, characterized in that, The multiple semantic information of the multiple functional modalities includes multiple first semantic information corresponding to the multiple functional modalities, each of the multiple first semantic information being obtained from the description of the corresponding functional modality in the multiple functional modalities, wherein the description is in natural language form; the multiple semantic information of the multiple functional modalities also includes at least one second semantic information, each of the second semantic information being obtained from the description related to the result of the functional modality in the multiple functional modalities, wherein the description related to the result of the functional modality is in natural language form.

111. The apparatus according to claim 110, characterized in that, The one or more target semantic information items respectively include first target semantic information indicating the corresponding function to be performed and second target semantic information indicating information related to the modality of performing the corresponding function.

112. The apparatus according to any one of claims 105 to 111, characterized in that, The processing module is also used for: Each of the plurality of functional modalities is encapsulated as a calling function to obtain a plurality of calling functions, wherein each of the plurality of calling functions includes a description of the corresponding functional modality, the description being in natural language form; one or more of the plurality of calling functions further include at least one of the following: a parameter list of the corresponding functional modality or at least one description related to the result of the corresponding functional modality, wherein the at least one description related to the result of the functional modality is in natural language form and includes: a conditional description describing a condition based on the result of the corresponding functional modality; or a loop description describing a loop with a condition based on the result of the corresponding functional modality.

113. The apparatus according to claim 112, characterized in that, The calling functions include application programming interface (API) calling functions.

114. The apparatus according to claim 112 or 113, characterized in that, The second device further includes a sending module, which is further configured to: send registration information for each of the plurality of functional modes, wherein the registration information for each functional mode includes the description of each functional mode.

115. The apparatus according to claim 114, characterized in that, The registration information for each of one or more functional modalities in the plurality of functional modalities further includes at least one of the following: a parameter list for each of the one or more functional modalities or at least one description related to the result of each of the one or more functional modalities, wherein the at least one description related to the result of each of the one or more functional modalities is in natural language form and includes: a conditional description describing conditions based on the result of each of the one or more functional modalities; or a loop description describing a loop with conditions based on the result of each of the one or more functional modalities.

116. The apparatus according to any one of claims 105 to 115, characterized in that, The processing module is also used to decode the at least one information payload.

117. The apparatus according to claim 116, characterized in that, Each of the at least one information payload includes: The first information payload is acquired during the first transmission opportunity of the corresponding control message, and includes the start position information of the second transmission opportunity of the corresponding control message and the length information of the semantic information of the corresponding control message. The second information payload is acquired during the second transmission opportunity of the corresponding control message and includes the semantic information of the corresponding control message.

118. The apparatus according to claim 117, characterized in that, The processing module is also used for: The first information payload is decoded to obtain the starting position information of the second transmission opportunity and the length information of the semantic information of the corresponding control message; The second information payload is decoded to obtain the semantic information of the corresponding control message.

119. The apparatus according to any one of claims 116 to 118, characterized in that, The at least one control message includes a plurality of control messages to be executed sequentially.

120. The apparatus according to claim 119, characterized in that, The processing module is also used for: When the information payload containing a semantic information of the second control message among the plurality of control messages fails to be decoded, or when the functional mode indicated by a target semantic information of the second control message among the plurality of control messages fails to be executed, the information payload containing a semantic information of the first control message among the plurality of control messages is not decoded, wherein, in the order stated, the second control message precedes the first control message.

121. The apparatus according to claim 117, characterized in that, The first information payload of each of the at least one information payload further includes: the parameter list of the corresponding control message.

122. The apparatus according to any one of claims 117 to 121, characterized in that, The first information payload also includes information about the first encoding method, and the second information payload is decoded using the first encoding method.

123. The apparatus according to claim 122, characterized in that, The first information payload is decoded using a second encoding method.

124. The apparatus according to claim 123, characterized in that, The first encoding method includes a first modulation and coding scheme (MCS), and the second encoding method includes a second MCS.

125. The apparatus according to any one of claims 117 to 123, characterized in that, The first information payload also includes: information indicating the user equipment ID or information indicating the group user equipment ID.

126. The apparatus according to claim 125, characterized in that, The processing module is also used for: In response to determining that the user equipment ID or the group user equipment ID does not match the user equipment ID or group user equipment ID of the user equipment, the second information payload is not decoded.

127. The apparatus according to any one of claims 117 to 126, characterized in that, The acquisition module is also used for: Obtain configuration information for at least one embedder.

128. The apparatus according to claim 127, characterized in that, The at least one semantic information of the at least one control message is obtained through a first embedder in the at least one embedder, and the multiple semantic information of the multiple functional modalities is obtained through the first embedder.

129. The apparatus according to claim 128, characterized in that, The configuration information of the at least one embedder includes the embedder ID of each of the at least one embedder.

130. The apparatus according to any one of claims 127 to 129, characterized in that, The multiple semantic information of the multiple functional modalities are stored after acquisition.

131. The apparatus according to any one of claims 127 to 129, characterized in that, The multiple semantic information of the multiple functional modalities are stored after acquisition.

132. The method according to any one of claims 127 to 129, characterized in that, The multiple semantic information of the multiple functional modalities is obtained by the first embedder before each determination of the at least one target semantic information corresponding to the at least one semantic information of the at least one control message.

133. The apparatus according to claim 119, characterized in that, The order in which the plurality of control messages are executed is indicated by the order in which the corresponding control messages are executed within the plurality of control messages.

134. A third device, characterized in that, It includes a processing circuit for performing the control method according to any one of claims 1 to 38.

135. A fourth device, characterized in that, It includes processing circuitry for performing the control method according to any one of claims 39 to 66.

136. A communication system, characterized in that, It includes a first device according to any one of claims 67 to 104 or a third device according to claim 134, and a second device according to any one of claims 105 to 133 or a fourth device according to claim 135.

137. A computer-readable medium storing computer-executable instructions, characterized in that, When executed by a processor, the computer execution instructions cause the processor to perform the control method according to any one of claims 1 to 38 or claims 39 to 66.

138. A computer program product comprising computer-executable instructions, characterized in that, When executed by a processor, the computer execution instructions cause the processor to perform the control method according to any one of claims 1 to 38 or claims 39 to 66.

Images