Information transmission method, information processing method, information transmission device, information processing device and related equipment

Abstract

The invention discloses an information transmission method, an information processing method, an information transmission device, an information processing device and related equipment, and belongs to the technical field of communication. The information processing method comprises the steps that first equipment receives first sensing information from second equipment, the first sensing information is information acquired based on a first sensing function, and the second equipment transmits the first sensing information to the second equipment; the second equipment has the first sensing function, and the first equipment is provided with a first AI unit; the first equipment inputs first input information into the first AI unit to obtain a reasoning result output by the first AI unit, and the first input information comprises the first sensing information.

Description

Technical Field

[0001] This application belongs to the field of communication technologies, and particularly relates to an information transmission method, an information processing method, a device, and related equipment. Background Art

[0002] In a communication network, the method of Artificial Intelligence (AI) is introduced to improve network communication performance.

[0003] In related technologies, the AI unit uses the measured value of a communication measurement quantity as input to perform inference.

[0004] However, using only the measured value of the communication measurement quantity as the input of the AI unit results in poor accuracy and generalization ability of the inference result of the AI unit. Summary of the Invention

[0005] Embodiments of this application provide an information transmission method, an information processing method, a device, and related equipment, which can use perception information as additional input information for the AI unit, improving the accuracy and generalization ability of the inference result of the AI unit.

[0006] In a first aspect, an information processing method is provided. The method includes:

[0007] A first device receives first perception information from a second device. The first perception information is information obtained based on a first perception function, the second device has the first perception function, and the first device has a first AI unit;

[0008] The first device inputs first input information into the first AI unit to obtain an inference result output by the first AI unit. The first input information includes the first perception information.

[0009] In a second aspect, an information transmission method is provided. The method includes:

[0010] A second device obtains first perception information based on a first perception function;

[0011] The second device sends the first perception information to the first device, where the input information of the first AI unit includes the first perception information, and the first AI unit is the AI unit of the first device.

[0012] In a third aspect, an information processing device for a first device is provided. The device includes:

[0013] A first receiving module, configured to receive first sensing information from a second device, where the first sensing information is information obtained based on a first sensing function, the second device has the first sensing function, and the first device has a first AI unit;

[0014] A processing module, configured to input first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first sensing information.

[0015] In a fourth aspect, there is provided an information transmission device for a second device, and the device includes:

[0016] An acquisition module, configured to acquire first sensing information based on a first sensing function;

[0017] A seventh sending module, configured to send the first sensing information to a first device, where the input information of the first AI unit includes the first sensing information, and the first AI unit is an AI unit of the first device.

[0018] In a fifth aspect, there is provided a communication device, and the communication device includes a processor and a memory. The memory stores a program or instructions that can run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0019] In a sixth aspect, there is provided a communication device, including a processor and a communication interface:

[0020] Wherein, when the communication device is used as the first device, the communication interface is configured to receive first sensing information from a second device, where the first sensing information is information obtained based on a first sensing function, the second device has the first sensing function, and the first device has a first AI unit; the processor is configured to input first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first sensing information; or,

[0021] When the communication device is used as the second device, the processor is configured to acquire first sensing information based on a first sensing function; the communication interface is configured to send the first sensing information to a first device, where the input information of the first AI unit includes the first sensing information, and the first AI unit is an AI unit of the first device.

[0022] In a seventh aspect, there is provided a readable storage medium, and the readable storage medium stores a program or instructions, and when the program or instructions are executed by a processor, the steps of the method described in the first aspect are implemented, or the steps of the method described in the second aspect are implemented.

[0023] In an eighth aspect, a wireless communication system is provided, including: a first device and a second device. The first device can be used to perform the steps of the method described in the first aspect, and the second device can be used to perform the steps of the method described in the second aspect.

[0024] In a ninth aspect, a chip is provided. The chip includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the method described in the first aspect or the second aspect.

[0025] In a tenth aspect, a computer program / program product is provided. The computer program / program product is stored in a storage medium, and the program / program product is executed by at least one processor to implement the steps of the method described in the first aspect or the second aspect.

[0026] In an embodiment of the present application, the first device receives first sensing information from the second device. Among them, the first sensing information is information obtained based on a first sensing function, the second device has the first sensing function, and the first device has a first AI unit; the first device inputs first input information into the first AI unit to obtain an inference result output by the first AI unit. Among them, the first input information includes the first sensing information. When the first device uses the first AI unit for inference, it receives the first sensing information obtained by the second device based on the first sensing function. In this way, by using the first sensing information obtained by the second device based on the first sensing function as additional input information for the first AI unit, the first AI unit can use the sensing information as auxiliary information in the inference process, which can improve the accuracy and generalization ability of the inference result of the first AI unit. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is a schematic structural diagram of a wireless communication system to which the embodiment of the present application can be applied;

[0028] Figure 2 is a schematic diagram of a neural network;

[0029] Figure 3 is a schematic diagram of a neuron;

[0030] Figure 4 is a comparison diagram of the CSI mean square error (Normalized Mean Square Error, NMSE) between the AI-based CSI prediction scheme and the non-AI-based CSI prediction scheme;

[0031] Figure 5 is a flowchart of an information processing method provided by the embodiment of the present application;

[0032] Figure 6 It is a flowchart of an information transmission method provided by an embodiment of the present application;

[0033] Figure 7 It is a schematic structural diagram of an information processing device provided by an embodiment of the present application;

[0034] Figure 8 It is a schematic structural diagram of an information transmission device provided by an embodiment of the present application;

[0035] Figure 9 It is a schematic structural diagram of a communication device provided by an embodiment of the present application;

[0036] Figure 10 It is a schematic structural diagram of a terminal provided by an embodiment of the present application;

[0037] Figure 11 It is a schematic structural diagram of a network - side device provided by an embodiment of the present application;

[0038] Figure 12 It is a schematic structural diagram of another network - side device provided by an embodiment of the present application. Detailed implementation manners

[0039] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope protected by the present application.

[0040] The terms "first", "second", etc. in the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are usually of the same category, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "or" in the present application means at least one of the connected objects. For example, "A or B" covers three scenarios, namely, Scenario 1: including A and not including B; Scenario 2: including B and not including A; Scenario 3: including both A and B. The character " / " generally indicates an "or" relationship between the associated objects before and after.

[0041] The term "indication" in this application can be either a direct indication (or an explicit indication) or an indirect indication (or an implicit indication). Among them, a direct indication can be understood as that the sender clearly tells the receiver specific information, operations to be performed, or request results, etc. in the sent indication; an indirect indication can be understood as that the receiver determines the corresponding information according to the indication sent by the sender, or makes a judgment and determines the operations to be performed or request results, etc. according to the judgment result.

[0042] It should be noted that the technology described in the embodiments of this application is not limited to the Long Term Evolution (LTE) / LTE-Advanced (LTE-A) system, and can also be used in other wireless communication systems, such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Orthogonal Frequency Division Multiple Access (OFDMA), Single-carrier Frequency-Division Multiple Access (SC-FDMA), or other systems. The terms "system" and "network" in the embodiments of this application are often used interchangeably, and the described technology can be used not only in the systems and radio technologies mentioned above, but also in other systems and radio technologies. The following description describes the New Radio (NR) system for example purposes, and uses NR terms in most of the following descriptions, but these technologies can also be applied to systems other than the NR system, such as the 6th Generation (6G) communication system. th Generation, 6G) communication system.

[0043] Figure 1The block diagram of a wireless communication system to which embodiments of the present application can be applied is shown. The wireless communication system includes a terminal 11 and a network-side device 12. Among them, the terminal 11 can be a mobile phone, a tablet personal computer, a laptop computer, a notebook computer, a personal digital assistant (PDA), a handheld computer, a netbook, an ultra-mobile personal computer (UMPC), a mobile internet device (MID), an augmented reality (AR), a virtual reality (VR) device, a robot, a wearable device, a flight vehicle, a vehicle user equipment (VUE), a shipborne device, a pedestrian user equipment (PUE), a smart home (home devices with wireless communication functions, such as refrigerators, TVs, washing machines or furniture, etc.), a game console, a personal computer (PC), a teller machine or a self-service machine, etc. Wearable devices include: smart watches, smart bracelets, smart earphones, smart glasses, smart jewelry (smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart ankle chains, etc.), smart wristbands, smart clothing, etc. Among them, the vehicle user equipment can also be referred to as a vehicle terminal, a vehicle controller, a vehicle module, a vehicle component, a vehicle chip or a vehicle unit, etc. It should be noted that the specific type of the terminal 11 is not limited in the embodiments of the present application. The network-side device 12 can include an access network device or a core network device. Among them, the access network device can also be referred to as a radio access network (RAN) device, a radio access network function or a radio access network unit. The access network device can include a base station, a wireless local area network (WLAN) access point (AP) or a wireless fidelity (WiFi) node, etc.Among them, the base station can be referred to as Node B (NB), Evolved Node B (eNB), the next generation Node B (gNB), New Radio Node B (NR Node B), access point, Relay Base Station (RBS), Serving Base Station (SBS), Base Transceiver Station (BTS), radio base station, radio transceiver, Basic Service Set (BSS), Extended Service Set (ESS), home Node B (HNB), home evolved Node B, Transmission Reception Point (TRP), or some other suitable term in the art. As long as the same technical effect is achieved, the base station is not limited to specific technical terms. It should be noted that in the embodiments of this application, only the base station in the NR system is taken as an example for introduction, and the specific type of the base station is not limited.

[0044] The core network device may include but is not limited to at least one of the following: core network node, core network function, Location Management Function (LMF), Mobility Management Entity (MME), Access and Mobility Management Function (AMF), Session Management Function (SMF), User Plane Function (UPF), Policy Control Function (PCF), Policy and Charging Rules Function (PCRF), Edge Application Server Discovery Function (EASDF), Unified Data Management (UDM), Unified Data Repository (UDR), Home Subscriber Server (HSS), Centralized network configuration (CNC), Network Repository Function (NRF), Network Exposure Function (NEF), Local NEF (L-NEF), Binding Support Function (BSF), Application Function (AF), Network Data Analytics Function (NWDAF), etc. It should be noted that in the embodiments of this application, only the core network devices in the NR system are taken as examples for introduction, and the specific types of core network devices are not limited. It should be noted that in the embodiments of this application, only the core network devices in the NR system are taken as examples for introduction, and the specific types of core network devices are not limited.

[0045] Artificial intelligence has currently been widely applied in various fields. There are multiple implementation methods for the AI unit, such as neural networks, decision trees, support vector machines, Bayesian classifiers, etc. In this application, a neural network is taken as an example for illustration, but the specific type of the AI unit is not limited.

[0046] Such asFigure 2 As shown, the neural network includes an input layer, a hidden layer, and an output layer, which can predict possible output results (Y) based on the input information (X1 to X n ) obtained by the input layer. The neural network consists of a large number of neurons. As Figure 3 shown, the parameters of a neuron include: input parameters a1 to a K , weights w, bias b, and activation function σ(z), and the output value a is obtained from these parameters. Among them, common activation functions include the sigmoid function, hyperbolic tangent (tanh) function, rectified linear unit (ReLU, also known as the rectified linear unit) function, etc., and z in the above function σ(z) can be calculated by the following formula:

[0047] z = a1w1 + … + a k w k + a K w K + b

[0048] where K represents the total number of input parameters.

[0049] The parameters of the neural network are optimized by an optimization algorithm. The optimization algorithm is a class of algorithms that can help us minimize or maximize the objective function (sometimes also called the loss function). The objective function is often a mathematical combination of AI unit parameters and data. For example, given data X and its corresponding label Y, we construct a neural network f(.). After having the neural network model, the predicted output f(x) can be obtained according to the input x, and the difference between the predicted value and the true value (f(x) - Y) can be calculated, which is the loss function. Our goal is to find the appropriate W and b to minimize the value of the above loss function. The smaller the loss value, the closer our AI unit is to the real situation.

[0050] Currently, common optimization algorithms are basically based on the backpropagation algorithm. The basic idea of the backpropagation algorithm is that the learning process consists of two processes: the forward propagation of signals and the backpropagation of errors. During forward propagation, the input samples are fed into the input layer and processed layer by layer through each hidden layer, and then transmitted to the output layer. If the actual output of the output layer does not match the expected output, it enters the stage of error backpropagation. Error backpropagation is to transmit the output error layer by layer through the hidden layer to the input layer in a certain form, and allocate the error to all units of each layer, so as to obtain the error signals of each layer of units. This error signal is used as the basis for correcting the weights of each unit. This process of adjusting the weights of each layer during signal forward propagation and error backpropagation is carried out cyclically. The process of continuously adjusting the weights is also the learning and training process of the network. This process continues until the error of the network output is reduced to an acceptable level, or until a pre-set number of learning times is reached.

[0051] Generally speaking, according to the different types of problems to be solved, the selected AI algorithms and the adopted AI units are also different. In the related technology, the main method to improve the 5G network performance with the help of AI is to enhance or replace the existing algorithms or processing modules through neural network-based algorithms and AI units. In specific scenarios, neural network-based algorithms and AI units can achieve better performance than deterministic algorithms. Commonly used neural networks include deep neural networks, convolutional neural networks, and recurrent neural networks, etc. With the help of existing AI tools, the construction, training, and verification of neural networks can be realized.

[0052] In summary, replacing non-AI processing modules in the communication system with AI or machine learning (ML) methods can effectively improve the system performance. For example, taking the prediction of channel state information (CSI) as an example, the historical CSI can be input into the AI unit, and the AI unit is used to analyze the time-domain change characteristics of the channel, and the future CSI is inferred based on this. The system performance corresponding to this scheme is as Figure 4 shown, based on Figure 4 it can be determined that the CSI prediction based on AI will have a very large performance gain compared with the scheme without prediction. At the same time, the different future moments for prediction will result in different prediction accuracies that can be achieved.

[0053] However, although the above gains can be obtained with AI-based CSI prediction, there are still some disadvantages, the most important of which is the poor generalization ability of the AI-based solution. When the inference environment is quite different from the training environment, the performance of the AI unit will become very poor, that is, there will be a mismatch. For example, the CSI prediction AI unit trained with the channel of a terminal moving at a speed of 30 km / h will perform very poorly when used to predict the CSI of a terminal moving at a speed of 60 km / h. Therefore, it is necessary to monitor the actual inference performance of CSI prediction and trigger a series of adjustment measures according to the monitoring results.

[0054] In the embodiments of the present application, perception information can be used to assist the AI unit in inference to improve the generalization ability of the AI unit and the accuracy of the inference result. For example, for the CSI prediction AI unit trained with the channel of a terminal moving at a speed of 30 km / h, when used to predict the CSI of a terminal moving at a speed of 60 km / h, perception information such as the terminal moving at a speed of 60 km / h can be input into the AI unit to assist the AI in inference, thus improving the accuracy of the prediction result of the CSI prediction AI unit trained with the channel of a terminal moving at a speed of 30 km / h for the CSI of a terminal moving at a speed of 60 km / h. In addition, based on the perception information to assist the AI unit in inference, it is also expected to reduce the training data volume of the AI unit.

[0055] It should be noted that the AI unit in the embodiments of the present application can be used in the above CSI prediction scenarios, and can also be used in other scenarios, such as AI-based CSI compression feedback, beam prediction, positioning enhancement, intelligent network selection, load balancing, energy saving, etc., which are not enumerated here.

[0056] To facilitate the understanding of the information processing method and information transmission method provided in the embodiments of the present application, the following terms in the embodiments of the present application are first explained:

[0057] 1) AI unit: The AI unit in the embodiments of the present application can also be referred to as an AI model, an AI structure, etc. Or the AI unit can also be a processing unit capable of implementing AI-related algorithms, formulas, processing flows, capabilities, etc. Or the AI unit can be a processing method, algorithm, function, module, or unit for a specific data set. Or the AI unit can be a processing method, algorithm, function, module, or unit running on AI-related hardware such as a Graphic Processing Unit (GPU), a Natural Processing Unit (NPU), a Tensor Processing Unit (TPU), or an Application-Specific Integrated Circuit (ASIC). The present application does not make specific limitations thereto. Optionally, the specific data set includes the input and / or output of the AI unit.

[0058] The identifier of the AI unit, such as an AI model identifier, an AI structure identifier, an AI algorithm identifier, a functionality ID, a physical identifier, a logical identifier, a global identifier, a local identifier, or the identifier of a specific data set associated with the AI unit, or the identifier of a specific scenario, environment, channel feature, or device related to the AI, or the identifier of a function, feature, ability, or module related to the AI, etc.

[0059] 2) First device: It can be a device that uses the AI unit for inference. For example, the first device can include a terminal or a network-side device.

[0060] 3) Second device: It can be a device with a sensing function and capable of obtaining sensing information based on this sensing function. This sensing information can be used as one of the input information of the AI unit to assist the AI unit in inference. For example, the first device can include a terminal or a network-side device, where the network-side device can include at least one of an access network device and a core network device.

[0061] Among them, the combination of the above first device and second device can include any one of the combinations shown in Table 1 below:

[0062] Table 1

[0063]

[0064] It should be noted that in the embodiments of the present application, for the convenience of description, usually the first device is a terminal and the second device is a network-side device as an example for illustration, which does not constitute a specific limitation here.

[0065] Optionally, the first device and the second device may be physically co-located. For example, the first device may perform inference based on the first AI unit, and the first device determines the first sensing information required for input to the first AI unit through sensing measurements.

[0066] It is worth noting that in the case where the first device and the second device are physically co-located, the interaction between the first device and the second device may be omitted.

[0067] Of course, the first device and the second device may also be independently deployed. For the sake of convenience of description, in the embodiments of the present application, the case where the first device and the second device are independently deployed is taken as an example for illustration.

[0068] 4) Wireless sensing results: The wireless sensing results in the embodiments of the present application may include at least one of the following:

[0069] Measurement values of first-level measurement quantities (received signals / raw channel information), where the first-level measurement quantities include at least one of the following: received signals / channel response complex results, amplitude / phase, I-channel / Q-channel and their operation results (the operations include addition, subtraction, multiplication, division, matrix addition, subtraction, multiplication, matrix transpose, trigonometric relation operations, square root operations, and power operations, etc., as well as threshold detection results, maximum / minimum value extraction results, etc. of the above operation results; the above operations also include Fast Fourier Transform (FFT) / Inverse Fast Fourier Transform (IFFT), Discrete Fourier Transform (DFT) / Inverse Discrete Fourier Transform (IDFT), 2D-FFT, 3D-FFT, matched filtering, autocorrelation operations, wavelet transforms, and digital filtering, etc., as well as threshold detection results, maximum / minimum value extraction results, etc. of the above operation results);

[0070] Measurement values of second-level measurement quantities (basic measurement quantities), where the second-level measurement quantities include at least one of the following: time delay, Doppler, angle, intensity, and their multi-dimensional combined representations;

[0071] Measurement values of third-level measurement quantities (basic attributes / statuses), where the third-level measurement quantities include at least one of the following: distance, speed, orientation, spatial position, acceleration;

[0072] Measurement values of fourth-level measurement quantities (advanced attributes / statuses), where the fourth-level measurement quantities include at least one of the following: whether a target exists, trajectory, action, expression, vital signs, quantity, imaging result, weather, air quality, shape, material, composition.

[0073] 5) Wireless statistical characteristics: The wireless statistical characteristics in the embodiments of this application include occlusion probability, user status, user behavior, handover failure rate, etc.

[0074] I) The occlusion probability refers to the probability that the serving beam is occluded;

[0075] II) The user status includes at least one of the following:

[0076] Registration status: Registration Management (RM) deregistration or RM registration (RMDEREGISTERED or RM REGISTERED);

[0077] Connection Management (CM) status: CM idle, CM connected;

[0078] Radio Resource Control (RRC) connection management status: RRC idle, RRC connected, RRC inactive;

[0079] III) The user behavior includes at least one of the following:

[0080] RRC-idle model behavior, including at least one of the following: Public Land Mobile Network (PLMN) selection, neighbor cell measurement, cell selection, cell reselection, Tracking Area (TA) update, paging monitoring, obtaining system information;

[0081] RRC-Inactive mode behavior, including at least one of the following: neighbor cell measurement, cell reselection, cell selection, RAN notification area (RNA) update, RAN paging monitoring, obtaining system information;

[0082] RRC-Connected mode behavior, including at least one of the following: serving cell channel quality measurement and reporting, neighbor cell measurement and measurement report reporting, Physical Downlink Control Channel (PDCCH) monitoring, monitoring the control channel related to the shared data channel (perceiving whether there is a relevant scheduling), obtaining system information.

[0083] Among them, the differences between the above RRC-idle, RRC-Inactive, and RRC-Connected are shown in Table 2 below:

[0084] Table 2

[0085] Between the UE and the base station Between the base station and the core network RRC-connected Connection Connection RRC-idle Release Release RRC-inactive Release Connection

[0086] IV) LiDAR-related measurement quantities, including at least one of the following:

[0087] LiDAR point cloud data, where each point in the LiDAR point cloud data includes: X / Y / Z position information, and additional information;

[0088] The angle and distance of the target obtained from the LiDAR point cloud data;

[0089] The visual features of the target identified from the LiDAR point cloud data, such as: people, vehicles, etc.;

[0090] The number of targets identified from the LiDAR point cloud data;

[0091] The additional information in the said LiDAR point cloud data includes at least one of the following:

[0092] Intensity: The echo intensity of the laser pulse that generates the LiDAR point;

[0093] Number of echoes: The number of echoes is the total number of echoes of a given pulse;

[0094] Point classification: Each post-processed LiDAR point can have a classification that defines the type of object reflecting the LiDAR pulse, and the LiDAR points can be divided into many categories, such as: ground, bare surface, top of the tree canopy, and water area, etc.;

[0095] Red, green, blue (RGB): The RGB band can be used as an attribute of the LiDAR data, and this attribute usually comes from the image collected during the LiDAR measurement;

[0096] Global Positioning System (GPS) time: The GPS timestamp when the laser point is emitted;

[0097] Scanning angle:

[0098] Scanning direction: The traveling direction of the laser scanning mirror, with value 1 representing the positive scanning direction and value 0 representing the negative scanning direction.

[0099] V) Vision-related measurement quantities, including at least one of the following:

[0100] Visual image;

[0101] The luminosity of the image pixel;

[0102] The RGB value of the image pixel;

[0103] Visual features of the target recognized from the image, such as: people, vehicles, etc.;

[0104] The angle and distance of the target recognized from the image (especially for binocular vision);

[0105] The number of targets recognized from the image.

[0106] VI) Radar-related measurement quantities, including at least one of the following:

[0107] Radar point cloud, each point in the point cloud includes: at least one of distance / speed / azimuth angle / pitch angle, or at least one of X / Y / Z / speed;

[0108] The distance, speed, and angle of the recognized target;

[0109] Radar imaging;

[0110] The number of targets.

[0111] VII) Inertial measurement unit-related measurement quantities, including at least one of the following:

[0112] Acceleration: at least one of the three directions of X / Y / Z;

[0113] Speed: at least one of the three directions of X / Y / Z;

[0114] Angular velocity: at least one of the three axes of X / Y / Z.

[0115] It should be noted that, in addition to the information types listed above, the first perception information in the embodiments of the present application may also include other types of perception information, such as including at least one of the following: whether the target exists, trajectory, action, expression, vital signs, quantity, imaging result, weather, air quality, shape, material, composition, hydrology, satellite image, terrain, etc.

[0116] Next, in conjunction with the accompanying drawings, through some embodiments and their application scenarios, the information processing method, information transmission method, information processing device, information transmission device, and related equipment provided by the embodiments of the present application will be described in detail.

[0117] Please refer to Figure 5 , an information processing method provided by an embodiment of the present application, the execution subject of which may be a first device, such as Figure 5 shown, the information processing method may include the following steps:

[0118] Step 501, the first device receives first perception information from the second device, where the first perception information is information obtained based on the first perception function, the second device has the first perception function, and the first device has a first AI unit.

[0119] In some embodiments, the above-mentioned first sensing information may include at least one of the following:

[0120] Wireless sensing results, wireless statistical characteristic information, geographical location information, measured values of lidar-related measurement quantities, measured values of vision-related measurement quantities, measured values of radar-related measurement quantities, measured values of inertial measurement unit-related measurement quantities.

[0121] Among them, the meanings of the contents of the above-mentioned first sensing information can refer to the explanations of the foregoing related terms, which will not be elaborated here.

[0122] Step 502: The first device inputs the first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first sensing information.

[0123] In some embodiments, the above-mentioned first sensing information represents sensing information used as one of the input information of the first AI unit, which is used to assist the first AI unit in reasoning and can improve the generalization ability of the first AI unit and the accuracy of the inference result.

[0124] It should be noted that in addition to including the first sensing information, the above-mentioned first input information may further include measured values of conventional communication measurement quantities, and the measured values of the communication measurement quantities have the same meaning as the input information used to input the AI unit in the related art, which will not be elaborated here.

[0125] For example: In AI-based CSI prediction, in addition to using historical CSI as input according to traditional communication settings, Doppler information, radar point cloud information, image information of the transmission environment, weather information, etc. sensed can also be used as auxiliary information to assist the AI unit in reasoning about the CSI prediction result.

[0126] For another example: In AI-based positioning, in addition to using channel measurement information according to traditional communication settings, distance information, radar point cloud information, terminal image information, environmental image information, etc. sensed can also be used as auxiliary information to assist the AI unit in reasoning about the positioning result.

[0127] In an embodiment of the present application, a first device receives first sensing information from a second device, where the first sensing information is information obtained based on a first sensing function, the second device has the first sensing function, and the first device has a first AI unit; the first device inputs first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first sensing information. When the first device uses the first AI unit for inference, it receives the first sensing information obtained by the second device based on the first sensing function. In this way, by using the first sensing information obtained by the second device based on the first sensing function as additional input information for the first AI unit, the first AI unit can use the sensing information as auxiliary information in the inference process, which can improve the accuracy and generalization ability of the inference result of the first AI unit.

[0128] In some embodiments, the above first AI unit and the first sensing information may be correlated with each other. For example, the first sensing information is input information dedicated to the first AI unit. At this time, the first device may activate the first AI unit according to the first sensing information.

[0129] For example, by pre-obtaining the correlation between the first sensing information and the first AI unit, or indicating the identification information of the first AI unit in the first sensing information, so that the first device activates the first AI unit based on the received first sensing information. In this way, it is possible to determine to activate the AI unit associated with the obtained sensing information based on the sensing information obtained by the first device, which not only simplifies the process of activating the AI unit but also avoids the problem of mismatch between the activated AI unit and the obtained sensing information.

[0130] Of course, in addition to being used as auxiliary information for the first AI unit to perform inference, the above first sensing information may have other uses, which are not specifically limited here.

[0131] It should be noted that in some embodiments, the above first AI unit may input various types of sensing information. At this time, the first device and the second device may interact to determine the first sensing information input into the first AI unit, so that the second device provides the first sensing information to the first device.

[0132] As an alternative embodiment, the method further includes:

[0133] The first device sends first information to the second device, where the first information is used to register the first AI unit with the second device;

[0134] Among them, the first information includes relevant information of at least one candidate perception information, and the candidate perception information is input information optional for the first AI unit; and the at least one candidate perception information includes the first perception information.

[0135] It should be noted that the candidate perception information is all the perception information that may be input to the first AI unit, while the first perception information represents the perception information actually used for input to the first AI unit, which may specifically be at least part of the candidate perception information. In other words, there are multiple perception information that can be used as input choices for the first AI unit. At this time, the first device and the second device can interact so that the first device receives the first perception information matching the first AI unit from the second device.

[0136] Optionally, the relevant information of the at least one candidate perception information includes at least one of the following:

[0137] 1) The information type of the at least one candidate perception information;

[0138] The information type of the above at least one candidate perception information can be used to indicate that the first AI unit can input one type of perception information or a combination of multiple types of perception information among camera information, radar information, environment reconstruction information, and meteorological information.

[0139] 2) The accuracy or processing level of the at least one candidate perception information;

[0140] In some embodiments, the accuracy or processing level of the candidate perception information can be divided into at least two levels. At this time, the accuracy or processing level of the first perception information can be indicated to obtain the first perception information matching the accuracy or processing level.

[0141] 3) The combined information of the at least one candidate perception information;

[0142] In some embodiments, there can be a combination of multiple types of perception information as candidate perception information. At this time, it is also necessary to further indicate which types of perception information can be combined or which types of perception information cannot be combined (for example, the combination of {camera information, environment reconstruction information} can be used as the first perception information, the combination of {camera information, radar information, meteorological information} can be used as the first perception information, and the combination of {environment reconstruction information, meteorological information} is prohibited from being used as the first perception information, etc.);

[0143] 4) The position information of the at least one candidate perception information in the input dimension of the first AI unit;

[0144] In some embodiments, the input information of the first AI unit can be one-dimensional or N-dimensional, where N is an integer greater than 1. At this time, it is necessary to indicate the position of the candidate perception information in the input information.

[0145] For example: Suppose the input information of the first AI unit is an array with a length of K. At this time, it is necessary to indicate the positions in this array where the candidate perception information is placed. For example, the candidate perception information is located at the first L element positions of the array.

[0146] Another example: Suppose the input information of the first AI unit is a two-dimensional matrix. At this time, it is necessary to indicate the positions in this matrix where the candidate perception information is placed. For example, it is located at the Nth to Mth elements of the second row of the matrix.

[0147] 5) The priority of the at least one candidate perception information.

[0148] In some embodiments, by indicating the priority of the at least one candidate perception information, it is possible to preferentially obtain and input the perception information with a higher priority level to the first AI unit.

[0149] In this embodiment, when the first device registers the first AI unit with the second device, it informs the second device of the perception information that can be input to the first AI unit, and the second device can then select some or all of it as the first perception information.

[0150] It is worth noting that, assuming the first device is a terminal and the second device is a network-side device, the application scenarios of this embodiment include: the case where the terminal has a first AI unit but has not registered with the network side or the network side does not have a first AI unit. For example, the first AI unit is trained by the terminal and its server itself, or fine-tuned based on a certain initial AI unit, or sent to the terminal by a third party. At this time, the terminal needs to register the first AI unit with the network side.

[0151] As another alternative embodiment, the method further includes:

[0152] The first device receives first configuration information from the second device, and the first configuration information is used to configure the first AI unit.

[0153] For example: If the first device is a terminal and the second device is a network-side device, the network-side device can configure the first AI unit for the terminal.

[0154] In this embodiment, the second device configures the first AI unit for the first device. At this time, the second device itself knows the perception information that can be input to the first AI unit, and thus sends the first perception information to the first device accordingly.

[0155] As another alternative implementation, the method further includes:

[0156] The first device sends a first request to the second device, where the first request is used to request activation of the first AI unit or request sending of the first perception information.

[0157] Optionally, the above first request may be an activation request. In this case, the activation request may indicate relevant information of the first perception information that the first AI unit needs to use. Alternatively, the second device may determine relevant information of the first perception information that the first AI unit needs to use according to locally stored registration information, configuration information, etc. or based on protocol agreements.

[0158] It should be noted that in the embodiments of the present application, activating the AI unit means that the first device uses the activated AI unit for inference. Correspondingly, deactivating the AI unit means that the first device stops using the deactivated AI unit for inference.

[0159] Optionally, the above first request may be a perception information sending request. In this case, the first device may request the second device to send the first perception information.

[0160] For example: The first request includes relevant information of the first perception information, such as the information type of the first perception information, the accuracy of the first perception information, the processing level of the first perception information, the dimension of the first perception information, the sending period or sending condition of the first perception information, the number of times (or amount) of sending the first perception information, the bearer channel of the first perception information, such as PDCCH, PUCCH, PDSCH, PUSCH, data plane channel, etc., and the bearer resources of the first perception information, including time domain resources (such as time slots, symbols), frequency domain resources (such as frequency domain resource blocks), spatial domain resources (such as antenna ports), etc., at least one of them.

[0161] In this implementation, the above first request may be used as trigger information for the second device to send the first perception information. That is, for example: If the first device is a terminal and the second device is a network-side device, then the network-side device sends the first perception information according to the content requested in the first request or according to other agreements (such as the protocol predefines that there is only one sending method for the first perception information) after receiving the first request.

[0162] As another alternative implementation, the method further includes:

[0163] The first device receives a first command from the second device, where the first command is used to activate the first AI unit;

[0164] The first device activates the first AI unit according to the first command.

[0165] Optionally, the second device may reply to the first command based on the first request received from the first device. At this time, the first device actively requests to activate the first AI unit, or requests the first perception information required by the first AI unit.

[0166] Of course, the above first command may also be actively sent by the second device. For example, the network side actively initiates a command to activate the first AI unit on the terminal side, which is not specifically limited here.

[0167] Optionally, the second configuration information may be carried in the first command, and the second configuration information is used to configure the first perception information;

[0168] The first device receives the first perception information from the second device, including:

[0169] The first device receives the first perception information from the second device according to the second configuration information.

[0170] For example: the second configuration information includes at least one of the following:

[0171] The information type of the first perception information;

[0172] The sending period of the first perception information;

[0173] The sending condition of the first perception information;

[0174] The accuracy of the first perception information;

[0175] The processing level of the first perception information;

[0176] The dimension of the first perception information;

[0177] The number of times the first perception information is sent;

[0178] The bearer channel of the first perception information;

[0179] The bearer resources of the first perception information (such as time domain, frequency domain, and space domain resources).

[0180] In this embodiment, the first AI unit of the first device may perform an explicit activation indication based on the first command from the second device.

[0181] Optionally, after the first device receives the first command from the second device, the method further includes:

[0182] The first device sends first confirmation information to the second device. The first confirmation information is a confirmation feedback message for the first command, and the first confirmation information is also used to request the sending of the first perception information.

[0183] Among them, the first confirmation information may be activation confirmation information.

[0184] For example: when the first device receives a first command to activate the first AI unit, it can determine the first perception information required by the activated first AI unit, and reuse the activation confirmation information to request the first perception information from the second device. At this time, the first device does not need to send a first request to the second device.

[0185] Similar to the above first request, the first confirmation information may also indicate relevant information of the first perception information, such as the information type of the first perception information, the accuracy of the first perception information, the processing level of the first perception information, the dimension of the first perception information, the sending period or sending condition of the first perception information, the number of times (or amount) of sending the first perception information, the resources of the first perception information (such as the bearer channel, time domain resources, frequency domain resources, spatial domain resources), etc.

[0186] In this embodiment, the activation confirmation information can be used to request the first perception information.

[0187] It should be noted that at least two of the above embodiments can be combined. For example: assuming that the first device is a terminal and the second device is a network-side device, the terminal can blindly detect the first perception information on the requested channel or resource within a predefined time T after sending an activation request for requesting to activate the first AI unit. If the first perception information can be correctly detected, the first AI unit is activated; if the first perception information cannot be correctly detected, the first AI unit is not activated. This predefined time T needs to be defined by the protocol or is also included in the previous activation request or activation confirmation information.

[0188] In some embodiments, after the first device activates the first AI unit, it may adjust the AI unit. For example: based on monitoring the inference result of the AI unit, when it is determined that the gain value of the inference result obtained by the AI unit based on the first perception information is less than a specified threshold or less than the gain value of the non-AI solution, the AI unit may be adjusted.

[0189] As an alternative embodiment, after the first device receives the first perception information from the second device, the method further includes:

[0190] The first device receives a second command from the second device, and the second command is used to indicate deactivating the first AI unit;

[0191] The first device deactivates the first AI unit according to the second command.

[0192] Optionally, the above second command may be a deactivation command, and the second device may instruct the first device to deactivate the first AI unit based on monitoring the inference result of the first AI unit or according to service requirements, etc.

[0193] In this embodiment, the first device may deactivate the first AI unit based on the second command of the second device.

[0194] As another alternative embodiment, after the first device receives the first perception information from the second device, the method further includes:

[0195] The first device sends a second request to the second device, where the second request is used to request at least one of the following:

[0196] Stop sending the first perception information;

[0197] Turn off the first perception function;

[0198] Deactivate the first AI unit.

[0199] In some embodiments, the above second request may be a deactivation request. At this time, the deactivation request may explicitly or implicitly instruct the second device to stop sending the first perception information and turn off the first perception function for at least one of them.

[0200] For example: An implicit indication method is as follows: When the deactivation request indicates deactivating the first AI unit, the second device may determine, based on this indication information, to stop sending the perception information dedicated to the first AI unit to the first device and turn off the perception function for measuring the perception information dedicated to the first AI unit.

[0201] Another example: An explicit indication method is as follows: The deactivation request carries first request information and second request information. The first request information is used to request to stop sending the first perception information, and the second request information is used to request to turn off the perception function for measuring the perception information dedicated to the first AI unit.

[0202] In this way, the first device can actively request the second device to deactivate the first AI unit, stop sending the first perception information, and turn off the first perception function for at least one of them.

[0203] In still some embodiments, the above second request may be a reply message to the second command. For example: The network side sends a deactivation command to the terminal, and the terminal replies a deactivation confirmation message based on this deactivation command. At this time, the deactivation confirmation message may explicitly or implicitly indicate at least one of the following: stop sending the first perception information, turn off the first perception function, deactivate the first AI unit.

[0204] In this embodiment, when the first device deactivates the first AI unit, it may also explicitly or implicitly instruct the second device to stop sending the first sensing information, or to turn off the first sensing function.

[0205] It is worth noting that after the first device deactivates the first AI unit, the first device may execute the function corresponding to the first AI unit using a non-AI solution, or use other AI units to execute the function corresponding to the first AI unit, or stop executing the function corresponding to the first AI unit.

[0206] In some embodiments, after the first device activates the first AI unit, it may adjust the input information of the AI unit. For example, based on monitoring the inference result of the first AI unit, when it is determined that the gain value of the inference result obtained by the first AI unit based on the first sensing information is less than a specified threshold or less than the gain value of the non-AI solution, the input information of the first AI unit may be adjusted.

[0207] As an alternative embodiment, after the first device receives the first sensing information from the second device, the method further includes:

[0208] The first device sends a third request to the second device, where the third request is used to request at least one of the following:

[0209] Send second sensing information to the first device;

[0210] Stop sending the first sensing information to the first device;

[0211] Turn off the first sensing function;

[0212] Wherein, the input information of the first AI unit is adjusted from the first sensing information to the second sensing information.

[0213] Optionally, the above third request may explicitly or implicitly instruct the second device to stop sending the first sensing information to the first device, or to turn off the first sensing function.

[0214] For example: An explicit indication method is: carrying in the third request the request information to stop sending the first sensing information to the first device and to turn off the first sensing function.

[0215] Another example: An implicit indication method is: If the first sensing information is the sensing information dedicated to the first AI unit, at this time, by sending a third request to the second device for instructing to send second sensing information to the first device, it can implicitly instruct the second device to stop sending the first sensing information to the first device and to turn off the first sensing function.

[0216] Optionally, the third request includes at least one of the following:

[0217] The information type of the second sensing information;

[0218] The sending period of the second sensing information;

[0219] The sending condition of the second sensing information;

[0220] The accuracy of the second sensing information;

[0221] The processing level of the second sensing information;

[0222] The dimension of the second sensing information;

[0223] The number of times the second sensing information is sent;

[0224] The bearer channel of the second sensing information;

[0225] The bearer resource of the second sensing information.

[0226] In this embodiment, by indicating the relevant information of the second sensing information in the third request, the first device can know how to receive the second sensing information or how to use the second sensing information.

[0227] In some embodiments, the method further includes:

[0228] The first device sends first capability information to the second device, where the first capability information is used to describe the relevant information of the sensing information supported by the first device for input to the AI unit;

[0229] The first device receives a second AI unit from the second device, where the sensing information for input to the second AI unit matches the first capability information.

[0230] For example: Assume that the first device is a terminal and the second device is a network-side device. Initially, the network-side configures a set of default AI units for the terminal, but the terminal may not be able to use these AI units. For example, the terminal does not support the sensing information required by the AI units. In this case, the network pushes the AI units that the terminal can use to the terminal.

[0231] Optionally, the first capability information is used to indicate at least one of the following for the sensing information supported by the first device for input to the AI unit:

[0232] The information type of the sensing information, the accuracy range of the sensing information, the processing level of the sensing information, the dimension of the sensing information, the size of the sensing information, the number of sensing information that the terminal can cache, the priority of the sensing information.

[0233] In this embodiment, the first device reports its capabilities, enabling the second device to determine to send a second AI unit supported by its capabilities to the first device based on the relevant information for inputting the perception information of the AI unit supported by the first device.

[0234] Please refer to Figure 6 , an information transmission method provided by an embodiment of this application, whose execution subject can be the second device, such as Figure 6 shown, this information transmission method may include the following steps:

[0235] Step 601, the second device obtains first perception information based on a first perception function.

[0236] Step 602, the second device sends the first perception information to the first device, where the input information of the first AI unit includes the first perception information, and the first AI unit is the AI unit possessed by the first device.

[0237] It should be noted that the above first perception information, first perception function, and first AI unit have the same meanings and functions as those in the first device side method embodiment, and will not be elaborated here.

[0238] The embodiment of this application corresponds to the first device side method embodiment. Among them, the first device side method embodiment is used to use the first perception information provided by the second device as the input information of the first AI unit to assist the inference of the first AI unit, while the second device side method embodiment is used to provide the first perception information to the first device.

[0239] In some embodiments, the first perception information includes at least one of the following:

[0240] Wireless perception results, wireless statistical characteristic information, geographical location information, measured values of lidar related measurement quantities, measured values of vision related measurement quantities, measured values of radar related measurement quantities, measured values of inertial measurement unit related measurement quantities.

[0241] In some embodiments, the method further includes:

[0242] The second device receives first information from the first device, where the first information is used to register the first AI unit with the second device;

[0243] where the first information includes relevant information of at least one candidate perception information, the candidate perception information is the optional input information of the first AI unit; and the at least one candidate perception information includes the first perception information.

[0244] Optionally, the related information of the at least one candidate perception information includes at least one of the following:

[0245] The information type of the at least one candidate perception information;

[0246] The accuracy or processing level of the at least one candidate perception information;

[0247] The combined information of the at least one candidate perception information;

[0248] The position information of the at least one candidate perception information on the input dimension of the first AI unit;

[0249] The priority of the at least one candidate perception information.

[0250] In some embodiments, the method further includes:

[0251] The second device sends first configuration information to the first device, and the first configuration information is used to configure the first AI unit.

[0252] In some embodiments, the method further includes:

[0253] The second device receives a first request from the first device, and the first request is used to request activation of the first AI unit or request sending of the first perception information.

[0254] In some embodiments, the method further includes:

[0255] The second device sends a first command to the first device, where the first command is used to activate the first AI unit.

[0256] In some embodiments, the first command carries second configuration information, and the second configuration information is used to configure the first perception information.

[0257] Optionally, the second configuration information includes at least one of the following:

[0258] The information type of the first perception information;

[0259] The sending period of the first perception information;

[0260] The sending condition of the first perception information;

[0261] The accuracy of the first perception information;

[0262] The processing level of the first perception information;

[0263] The dimension of the first perception information;

[0264] The number of times the first sensing information is sent;

[0265] The bearer channel of the first sensing information;

[0266] The bearer resource of the first sensing information.

[0267] In some embodiments, after the second device sends a first command to the first device, the method further includes:

[0268] The second device receives first confirmation information from the first device, where the first confirmation information is confirmation information for the first command, and the first confirmation information is further used to request sending the first sensing information.

[0269] In some embodiments, after the second device sends first sensing information to the first device, the method further includes:

[0270] The second device sends a second command to the first device, where the second command is used to indicate deactivating the first AI unit.

[0271] In some embodiments, after the second device sends first sensing information to the first device, the method further includes:

[0272] The second device receives a second request from the first device, where the second request is used to request at least one of the following:

[0273] Stop sending the first sensing information;

[0274] Turn off the first sensing function;

[0275] Deactivate the first AI unit.

[0276] In some embodiments, after the second device sends first sensing information to the first device, the method further includes:

[0277] The second device receives a third request from the first device, where the third request is used to request at least one of the following:

[0278] Send second sensing information to the first device;

[0279] Stop sending the first sensing information to the first device;

[0280] Turn off the first sensing function;

[0281] Wherein, the input information of the first AI unit is adjusted from the first sensing information to the second sensing information.

[0282] Optionally, the third request includes at least one of the following:

[0283] The information type of the second sensing information;

[0284] The sending period of the second sensing information;

[0285] The sending condition of the second sensing information;

[0286] The accuracy of the second sensing information;

[0287] The processing level of the second sensing information;

[0288] The dimension of the second sensing information;

[0289] The number of times the second sensing information is sent;

[0290] The bearer channel of the second sensing information;

[0291] The bearer resource of the second sensing information.

[0292] In some embodiments, the first sensing information is associated with the first AI unit, or the first sensing information includes the identification information of the first AI unit.

[0293] This embodiment can be combined with the above embodiments. For example: Assume that the first device is a terminal and the second device is a network-side device. By associating the first sensing information with the first AI unit, or the first sensing information includes the identification information of the first AI unit, the following interaction processes between the terminal and the network-side device can be simplified:

[0294] 1) The terminal can activate the first AI unit based on the received first sensing information. At this time, the network side does not need to send the first command to the terminal;

[0295] 2) When the first request is used to request the activation of the first AI unit, the network side can trigger the sending of the first sensing information accordingly. At this time, the first request may not carry the sending request information of the first sensing information;

[0296] 3) The network side can trigger the stop of sending the first sensing information or the closing of the first sensing function based on the second request of the first AI unit. That is, the second request at this time may not carry the stop sending request information of the first sensing information and the closing request information of the first sensing function;

[0297] 4) The network side can implicitly indicate the stop of sending the first sensing information or the closing of the first sensing function based on the relevant information of the second sensing information carried in the third request. That is, the third request at this time may not carry the stop sending request information of the first sensing information and the closing request information of the first sensing function.

[0298] In some embodiments, the method further includes:

[0299] The second device receives first capability information from the first device, where the first capability information is used to describe information related to the perception information supported by the first device for inputting to the AI unit;

[0300] The second device configures a second AI unit for the first device according to the first capability information, where the perception information for inputting to the second AI unit matches the first capability information.

[0301] Optionally, the first capability information is used to indicate at least one of the following for the perception information supported by the first device for inputting to the AI unit:

[0302] The type of information of the perception information, the accuracy range of the perception information, the processing level of the perception information, the dimension of the perception information, the size of the perception information, the number of perception information that the terminal can cache, the priority of the perception information.

[0303] In the embodiments of the present application, the steps executed by the second device correspond to the steps executed by the first device in the method embodiments on the first device side, and the two cooperate with each other to jointly control the activation or deactivation of the AI unit on the first device, the start or stop of the perception function, and the sending or stopping of the perception information, so that the first device can use the perception information to assist the AI unit in reasoning.

[0304] For the information processing method provided in the embodiments of the present application, the execution subject may be an information processing device. In the embodiments of the present application, taking the information processing device executing the information processing method as an example, the information processing device provided in the embodiments of the present application is described.

[0305] Referring to Figure 7 , the embodiments of the present application further provide an information processing device, which is applied to the first device. As Figure 7 shown, the information processing device 700 includes:

[0306] A first receiving module 701, configured to receive first perception information from a second device, where the first perception information is information obtained based on a first perception function, the second device has the first perception function, and the first device has a first AI unit;

[0307] A processing module 702, configured to input first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first perception information.

[0308] Optionally, the first perception information includes at least one of the following:

[0309] Wireless sensing results, wireless statistical characteristic information, geographical location information, measured values of lidar-related measurement quantities, measured values of vision-related measurement quantities, measured values of radar-related measurement quantities, measured values of inertial measurement unit-related measurement quantities.

[0310] Optionally, the information processing device 700 further includes:

[0311] A first sending module, configured to send first information to the second device, where the first information is used to register the first AI unit with the second device;

[0312] Wherein, the first information includes information related to at least one candidate sensing information, and the candidate sensing information is input information optional for the first AI unit; and the at least one candidate sensing information includes the first sensing information.

[0313] Optionally, the information related to the at least one candidate sensing information includes at least one of the following:

[0314] The information type of the at least one candidate sensing information;

[0315] The accuracy or processing level of the at least one candidate sensing information;

[0316] The combined information of the at least one candidate sensing information;

[0317] The position information of the at least one candidate sensing information in the input dimension of the first AI unit;

[0318] The priority of the at least one candidate sensing information.

[0319] Optionally, the information processing device 700 further includes:

[0320] A second receiving module, configured to receive first configuration information from the second device, where the first configuration information is used to configure the first AI unit.

[0321] Optionally, the information processing device 700 further includes:

[0322] A second sending module, configured to send a first request to the second device, where the first request is used to request activation of the first AI unit or request to send the first sensing information.

[0323] Optionally, the information processing device 700 further includes:

[0324] A third receiving module, configured to receive a first command from the second device, where the first command is used to activate the first AI unit;

[0325] An activation module, configured to activate the first AI unit according to the first command.

[0326] Optionally, the first command carries second configuration information for configuring the first perception information.

[0327] A first receiving module 701, specifically configured to:

[0328] Receive the first perception information from a second device according to the second configuration information.

[0329] Optionally, the second configuration information includes at least one of the following:

[0330] The type of the first perception information;

[0331] The sending period of the first perception information;

[0332] The sending condition of the first perception information;

[0333] The accuracy of the first perception information;

[0334] The processing level of the first perception information;

[0335] The dimension of the first perception information;

[0336] The number of times the first perception information is sent;

[0337] The bearer channel of the first perception information;

[0338] The bearer resource of the first perception information.

[0339] Optionally, the information processing device 700 further includes:

[0340] A third sending module, configured to send a first confirmation information to the second device, where the first confirmation information is a confirmation feedback information of the first command, and the first confirmation information is further used to request to send the first perception information.

[0341] Optionally, the information processing device 700 further includes:

[0342] A fourth receiving module, configured to receive a second command from the second device, where the second command is used to instruct to deactivate the first AI unit;

[0343] A deactivation module, configured to deactivate the first AI unit according to the second command.

[0344] Optionally, the first perception information is associated with the first AI unit, or the first perception information includes the identification information of the first AI unit, and the method further includes:

[0345] The first device activates the first AI unit according to the first sensing information.

[0346] Optionally, the information processing device 700 further includes:

[0347] A fourth sending module, configured to send a second request to the second device, where the second request is used to request at least one of the following:

[0348] Stop sending the first sensing information;

[0349] Turn off the first sensing function;

[0350] Deactivate the first AI unit.

[0351] Optionally, the information processing device 700 further includes:

[0352] A fifth sending module, configured to send a third request to the second device, where the third request is used to request at least one of the following:

[0353] Send second sensing information to the first device;

[0354] Stop sending the first sensing information to the first device;

[0355] Turn off the first sensing function;

[0356] Wherein, the input information of the first AI unit is adjusted from the first sensing information to the second sensing information.

[0357] Optionally, the third request includes at least one of the following:

[0358] The information type of the second sensing information;

[0359] The sending period of the second sensing information;

[0360] The sending condition of the second sensing information;

[0361] The accuracy of the second sensing information;

[0362] The processing level of the second sensing information;

[0363] The dimension of the second sensing information;

[0364] The sending times of the second sensing information;

[0365] The bearer channel of the second sensing information;

[0366] The bearer resource of the second sensing information.

[0367] Optionally, the information processing apparatus 700 further includes:

[0368] A sixth sending module, configured to send first capability information to the second device, where the first capability information is used to describe information related to the perception information supported by the first device for inputting to the AI unit;

[0369] A fifth receiving module, configured to receive a second AI unit from the second device, where the perception information for inputting to the second AI unit matches the first capability information.

[0370] Optionally, the first capability information is used to indicate at least one of the following for the perception information supported by the first device for inputting to the AI unit:

[0371] The information type of the perception information, the accuracy range of the perception information, the processing level of the perception information, the dimension of the perception information, the size of the perception information, the number of perception information that the terminal can cache, the priority of the perception information.

[0372] The information processing apparatus 700 provided in the embodiments of the present application can implement each process in the method embodiments on the first device side and achieve the same technical effects. To avoid repetition, details are not described here again.

[0373] For the information transmission method provided in the embodiments of the present application, the execution subject may be an information transmission apparatus. In the embodiments of the present application, taking the information transmission apparatus executing the information transmission method as an example, the information transmission apparatus provided in the embodiments of the present application is described.

[0374] Refer to Figure 8 , the embodiments of the present application further provide an information transmission apparatus, which is applied to a second device. As Figure 8 shown, the information transmission apparatus 800 includes:

[0375] An obtaining module 801, configured to obtain first perception information based on a first perception function;

[0376] A seventh sending module 802, configured to send the first perception information to the first device, where the input information of the first AI unit includes the first perception information, and the first AI unit is an AI unit of the first device.

[0377] Optionally, the information transmission apparatus 800 further includes:

[0378] A sixth receiving module, configured to receive first information from the first device, where the first information is used to register the first AI unit with the second device;

[0379] Among them, the first information includes relevant information of at least one candidate perception information, and the candidate perception information is input information optional for the first AI unit; and the at least one candidate perception information includes the first perception information.

[0380] Optionally, the information transmission device 800 further includes:

[0381] An eighth sending module, configured to send first configuration information to a first device, where the first configuration information is used to configure the first AI unit.

[0382] Optionally, the information transmission device 800 further includes:

[0383] A seventh receiving module, configured to receive a first request from the first device, where the first request is used to request to activate the first AI unit or request to send the first perception information.

[0384] Optionally, the information transmission device 800 further includes:

[0385] A ninth sending module, configured to send a first command to the first device, where the first command is used to activate the first AI unit.

[0386] Optionally, the information transmission device 800 further includes:

[0387] An eighth receiving module, configured to receive first confirmation information from the first device, where the first confirmation information is confirmation information of the first command, and the first confirmation information is further used to request to send the first perception information.

[0388] Optionally, the information transmission device 800 further includes:

[0389] A tenth sending module, configured to send a second command to the first device, where the second command is used to instruct to deactivate the first AI unit.

[0390] Optionally, the information transmission device 800 further includes:

[0391] A ninth receiving module, configured to receive a second request from the first device, where the second request is used to request at least one of the following:

[0392] Stop sending the first perception information;

[0393] Close the first perception function;

[0394] Deactivate the first AI unit.

[0395] Optionally, the information transmission device 800 further includes:

[0396] The tenth receiving module is configured to receive a third request from the first device, where the third request is used to request at least one of the following:

[0397] Sending second sensing information to the first device;

[0398] Stopping sending the first sensing information to the first device;

[0399] Closing the first sensing function;

[0400] Wherein, the input information of the first AI unit is adjusted from the first sensing information to the second sensing information.

[0401] Optionally, the information transmission device 800 further includes:

[0402] The eleventh receiving module is configured to receive first capability information from the first device, where the first capability information is used to describe relevant information supported by the first device for the sensing information input to the AI unit;

[0403] The configuration module is configured to configure a second AI unit for the first device according to the first capability information, where the sensing information input to the second AI unit matches the first capability information.

[0404] The information transmission device 800 provided in the embodiments of the present application can implement each process in the method embodiments on the second device side and achieve the same technical effects. To avoid repetition, details are not described here again.

[0405] The information processing device or information transmission device in the embodiments of the present application may be an electronic device, such as an electronic device with an operating system, or a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal or a network-side device. Exemplarily, the terminal may include, but is not limited to, the types of the terminal 11 listed above, and the network-side device includes, but is not limited to, the types of the access network device or core network device listed above, etc. The embodiments of the present application do not make specific limitations.

[0406] Optionally, as Figure 9 shown, the embodiments of the present application further provide a communication device 900, including a processor 901 and a memory 902. A program or instruction that can run on the processor 901 is stored on the memory 902. For example: when the communication device 900 is used as the first device, when the program or instruction is executed by the processor 901, each step in the method embodiments on the first device side is implemented, and the same technical effects can be achieved; when the communication device 900 is used as the second device, when the program or instruction is executed by the processor 901, each step in the method embodiments on the second device side is implemented, and the same technical effects can be achieved. To avoid repetition, details are not described here again.

[0407] An embodiment of the present application further provides a communication device, including a processor and a communication interface.

[0408] When the communication device is the first device, the communication interface is used to receive first sensing information from the second device, where the first sensing information is information obtained based on a first sensing function, the second device has the first sensing function, and the first device has a first AI unit; the processor is used to input first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first sensing information.

[0409] When the communication device is the second device, the processor is used to obtain first sensing information based on the first sensing function; the communication interface is used to send the first sensing information to the first device, where the input information of the first AI unit includes the first sensing information, and the first AI unit is the AI unit of the first device.

[0410] This embodiment of the communication device corresponds to the foregoing embodiments of the information processing method on the first device side and the information transmission method on the second device side. Each implementation process and implementation manner of the above method embodiments can be applied to this embodiment of the communication device and can achieve the same technical effect.

[0411] In some embodiments, Figure 10 It is a schematic diagram of the hardware structure of a terminal for implementing an embodiment of the present application.

[0412] The terminal 1000 includes, but is not limited to, at least some components such as a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.

[0413] Those skilled in the art can understand that the terminal 1000 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 1010 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 10 The terminal structure shown does not limit the terminal. The terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0414] It should be understood that in the embodiments of the present application, the input unit 1004 may include a Graphics Processing Unit (GPU) 10041 and a microphone 10042. The graphics processor 10041 processes the image data of static pictures or videos obtained by an image capturing device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of, for example, a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes at least one of a touch panel 10071 and other input devices 10072. The touch panel 10071 is also referred to as a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. The other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, which will not be elaborated here.

[0415] In the embodiments of the present application, after receiving downlink data from a network-side device, the radio frequency unit 1001 may transmit it to the processor 1010 for processing; in addition, the radio frequency unit 1001 may send uplink data to the network-side device. Generally, the radio frequency unit 1001 includes, but is not limited to, an antenna, an amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, etc.

[0416] The memory 1009 can be used to store software programs or instructions and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area may store an operating system, application programs or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1009 may include a volatile memory or a non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 1009 in the embodiments of the present application includes, but is not limited to, these and any other suitable types of memories.

[0417] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above modem processor may not be integrated into the processor 1010 either.

[0418] In one implementation, the terminal 1000 serves as the first device.

[0419] The radio frequency unit 1001 is used to receive first sensing information from a second device, where the first sensing information is information obtained based on a first sensing function, the second device has the first sensing function, and the first device has a first AI unit;

[0420] A processor 1010, configured to input first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first perception information.

[0421] Optionally, the first perception information includes at least one of the following:

[0422] Wireless perception result, wireless statistical characteristic information, geographical location information, measured values of lidar-related measurement quantities, measured values of vision-related measurement quantities, measured values of radar-related measurement quantities, measured values of inertial measurement unit-related measurement quantities.

[0423] Optionally, the radio frequency unit 1001 is further configured to send first information to the second device, where the first information is used to register the first AI unit with the second device;

[0424] where the first information includes information related to at least one candidate perception information, and the candidate perception information is optional input information for the first AI unit; and the at least one candidate perception information includes the first perception information.

[0425] Optionally, the information related to the at least one candidate perception information includes at least one of the following:

[0426] The information type of the at least one candidate perception information;

[0427] The accuracy or processing level of the at least one candidate perception information;

[0428] The combined information of the at least one candidate perception information;

[0429] The position information of the at least one candidate perception information in the input dimension of the first AI unit;

[0430] The priority of the at least one candidate perception information.

[0431] Optionally, the radio frequency unit 1001 is further configured to receive first configuration information from the second device, where the first configuration information is used to configure the first AI unit.

[0432] Optionally, the radio frequency unit 1001 is further configured to send a first request to the second device, where the first request is used to request activation of the first AI unit or request to send the first perception information.

[0433] Optionally, the radio frequency unit 1001 is further configured to receive a first command from the second device, where the first command is used to activate the first AI unit;

[0434] The processor 1010 is further configured to activate the first AI unit according to the first command.

[0435] Optionally, the first command carries second configuration information for configuring the first sensing information.

[0436] The receiving of the first sensing information from the second device performed by the radio frequency unit 1001 includes:

[0437] Receiving the first sensing information from the second device according to the second configuration information.

[0438] Optionally, the second configuration information includes at least one of the following:

[0439] The information type of the first sensing information;

[0440] The sending period of the first sensing information;

[0441] The sending condition of the first sensing information;

[0442] The accuracy of the first sensing information;

[0443] The processing level of the first sensing information;

[0444] The dimension of the first sensing information;

[0445] The number of times the first sensing information is sent;

[0446] The bearer channel of the first sensing information;

[0447] The bearer resource of the first sensing information.

[0448] Optionally, after the radio frequency unit 1001 executes the receiving of the first command from the second device, it is further configured to send first confirmation information to the second device, where the first confirmation information is the confirmation feedback information of the first command, and the first confirmation information is further used to request the sending of the first sensing information.

[0449] Optionally, after the radio frequency unit 1001 executes the receiving of the first sensing information from the second device, it is further configured to receive a second command from the second device, where the second command is used to instruct to deactivate the first AI unit.

[0450] The processor 1010 is further configured to deactivate the first AI unit according to the second command.

[0451] Optionally, the first sensing information is associated with the first AI unit, or the first sensing information includes the identification information of the first AI unit. The processor 1010 is further configured to activate the first AI unit according to the first sensing information.

[0452] Optionally, after receiving the first sensing information from the second device, the radio frequency unit 1001 is further configured to send a second request to the second device, where the second request is used to request at least one of the following:

[0453] Stop sending the first sensing information;

[0454] Turn off the first sensing function;

[0455] Deactivate the first AI unit.

[0456] Optionally, after receiving the first sensing information from the second device, the radio frequency unit 1001 is further configured to send a third request to the second device, where the third request is used to request at least one of the following:

[0457] Send second sensing information to the first device;

[0458] Stop sending the first sensing information to the first device;

[0459] Turn off the first sensing function;

[0460] Wherein, the input information of the first AI unit is adjusted from the first sensing information to the second sensing information.

[0461] Optionally, the third request includes at least one of the following:

[0462] The type of information of the second sensing information;

[0463] The sending period of the second sensing information;

[0464] The sending condition of the second sensing information;

[0465] The accuracy of the second sensing information;

[0466] The processing level of the second sensing information;

[0467] The dimension of the second sensing information;

[0468] The number of times of sending the second sensing information;

[0469] The bearer channel of the second sensing information;

[0470] The bearer resource of the second sensing information.

[0471] Optionally, the radio frequency unit 1001 is further configured to:

[0472] Send first capability information to the second device, where the first capability information is used to describe relevant information supported by the first device for inputting perception information of the AI unit;

[0473] Receive a second AI unit from the second device, where the perception information for inputting the second AI unit matches the first capability information.

[0474] Optionally, the first capability information is used to indicate at least one of the following for the perception information supported by the first device for inputting the AI unit:

[0475] The information type of the perception information, the accuracy range of the perception information, the processing level of the perception information, the dimension of the perception information, the size of the perception information, the number of perception information that the terminal can cache, the priority of the perception information.

[0476] It can be understood that the implementation processes of the implementation manners mentioned in this embodiment can refer to the relevant descriptions of the method embodiment on the first device side, and achieve the same or corresponding technical effects. To avoid repetition, they will not be elaborated here.

[0477] In another implementation manner, the above terminal 1000 serves as the second device.

[0478] The processor 1010 is configured to obtain first perception information based on the first perception function;

[0479] The radio frequency unit 1001 is configured to send the first perception information to the first device, where the input information of the first AI unit includes the first perception information, and the first AI unit is the AI unit of the first device.

[0480] Optionally, the first perception information includes at least one of the following:

[0481] Wireless perception results, wireless statistical characteristic information, geographical location information, measured values of lidar-related measurement quantities, measured values of vision-related measurement quantities, measured values of radar-related measurement quantities, measured values of inertial measurement unit-related measurement quantities.

[0482] Optionally, the radio frequency unit 1001 is further configured to receive first information from the first device, where the first information is used to register the first AI unit with the second device;

[0483] Wherein, the first information includes relevant information of at least one candidate perception information, the candidate perception information is the optional input information of the first AI unit; and the at least one candidate perception information includes the first perception information.

[0484] Optionally, the radio frequency unit 1001 is further configured to send first configuration information to the first device, where the first configuration information is used to configure the first AI unit.

[0485] Optionally, the radio frequency unit 1001 is further configured to receive a first request from the first device, where the first request is used to request activation of the first AI unit or request transmission of the first sensing information.

[0486] Optionally, the radio frequency unit 1001 is further configured to send a first command to the first device, where the first command is used to activate the first AI unit.

[0487] Optionally, the first command carries second configuration information, where the second configuration information is used to configure the first sensing information.

[0488] Optionally, after the radio frequency unit 1001 executes the sending of the first command to the first device, it is further configured to receive a first confirmation information from the first device, where the first confirmation information is a confirmation information of the first command, and the first confirmation information is further used to request transmission of the first sensing information.

[0489] Optionally, after the radio frequency unit 1001 executes the sending of the first sensing information to the first device, it is further configured to send a second command to the first device, where the second command is used to instruct deactivation of the first AI unit.

[0490] Optionally, after the radio frequency unit 1001 executes the sending of the first sensing information to the first device, it is further configured to receive a second request from the first device, where the second request is used to request at least one of the following:

[0491] Stop sending the first sensing information;

[0492] Turn off the first sensing function;

[0493] Deactivate the first AI unit.

[0494] Optionally, after the radio frequency unit 1001 executes the sending of the first sensing information to the first device, it is further configured to receive a third request from the first device, where the third request is used to request at least one of the following:

[0495] Send second sensing information to the first device;

[0496] Stop sending the first sensing information to the first device;

[0497] Turn off the first sensing function;

[0498] Among them, the input information of the first AI unit is adjusted from the first perception information to the second perception information.

[0499] Optionally, the first perception information is associated with the first AI unit, or the first perception information includes the identification information of the first AI unit.

[0500] Optionally, the radio frequency unit 1001 is further configured to receive first capability information from the first device, where the first capability information is used to describe relevant information supported by the first device for the perception information input to the AI unit.

[0501] The processor 1010 is further configured to configure a second AI unit for the first device through the radio frequency unit 1001 according to the first capability information, where the perception information input to the second AI unit matches the first capability information.

[0502] It can be understood that the implementation processes of the implementation manners mentioned in this embodiment can refer to the relevant descriptions of the foregoing method embodiments on the second device side, and achieve the same or corresponding technical effects. To avoid repetition, they will not be elaborated here.

[0503] This application embodiment further provides a network-side device, including a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement the steps of the foregoing method embodiments on the first device side or the second device side. This network-side device embodiment corresponds to the foregoing method embodiments on the first device side or the second device side. Each implementation process and implementation manner of the foregoing method embodiments can be applied to this network-side device embodiment, and the same technical effects can be achieved.

[0504] In one implementation manner, as Figure 11 shown, the network-side device 1100 includes: an antenna 1101, a radio frequency device 1102, a baseband device 1103, a processor 1104, and a memory 1105. The antenna 1101 is connected to the radio frequency device 1102. In the uplink direction, the radio frequency device 1102 receives information through the antenna 1101 and sends the received information to the baseband device 1103 for processing. In the downlink direction, the baseband device 1103 processes the information to be sent and sends it to the radio frequency device 1102. After processing the received information, the radio frequency device 1102 sends it out through the antenna 1101.

[0505] The method executed by the network-side device in the foregoing embodiments can be implemented in the baseband device 1103, and the baseband device 1103 includes a baseband processor.

[0506] The baseband device 1103 may include, for example, at least one baseband board, and a plurality of chips are arranged on the baseband board, such as Figure 11As shown, one of the chips, for example, is a baseband processor, which is connected to the memory 1105 through a bus interface to call the program in the memory 1105 and execute the network device operations shown in the above method embodiments.

[0507] The network-side device may further include a network interface 1106, which is, for example, a Common Public Radio Interface (CPRI).

[0508] Specifically, the network-side device 1100 in the embodiments of the present application further includes: instructions or programs stored on the memory 1105 and executable on the processor 1104. The processor 1104 calls the instructions or programs in the memory 1105 to execute Figure 7 and Figure 8 the methods executed by at least one of the modules shown in, and achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0509] In another implementation, the embodiments of the present application further provide a network-side device. As Figure 12 shown, the network-side device 1200 includes: a processor 1201, a network interface 1202, and a memory 1203. Among them, the network interface 1202 is, for example, a Common Public Radio Interface (CPRI).

[0510] Specifically, the network-side device 1200 in the embodiments of the present application further includes: instructions or programs stored on the memory 1203 and executable on the processor 1201. The processor 1201 calls the instructions or programs in the memory 1203 to execute the methods executed by the modules shown in 8, and achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0511] The embodiments of the present application further provide a readable storage medium, on which programs or instructions are stored. When the programs or instructions are executed by a processor, they implement each process of the foregoing information processing method or information transmission method embodiments, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0512] Among them, the processor is the processor in the terminal described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory ROM, random access memory RAM, magnetic disks, or optical discs, etc. In some examples, the readable storage medium may be a non-transitory readable storage medium.

[0513] Another embodiment of the present application further provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is configured to run programs or instructions to implement each process of the foregoing information processing method or information transmission method embodiment, and can achieve the same technical effects. To avoid repetition, details are not described herein again.

[0514] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip.

[0515] Another embodiment of the present application further provides a computer program / program product, which is stored in a storage medium. The computer program / program product is executed by at least one processor to implement each process of the foregoing information processing method or information transmission method embodiment, and can achieve the same technical effects. To avoid repetition, details are not described herein again.

[0516] The embodiments of the present application further provide a communication system, including: a first device and a second device. The first device can be used to execute the steps of the foregoing information processing method embodiment, and the second device can be used to execute the steps of the foregoing information transmission method embodiment.

[0517] It should be noted that in this document, the terms "including", "comprising" or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or device including a series of elements not only includes those elements but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted or combined. Additionally, the features described with reference to certain examples may be combined in other examples.

[0518] Through the description of the above embodiments, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of a computer software product plus a necessary general hardware platform, and of course, can also be implemented by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes several instructions for causing a terminal or a network-side device to execute the methods described in various embodiments of the present application.

[0519] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms of embodiments without departing from the purpose of the present application and the scope protected by the claims. These embodiments are all within the protection scope of the present application.

Claims

1. An information processing method, characterized in that, Including: The first device receives first sensing information from the second device, where the first sensing information is information obtained based on a first sensing function, the second device has the first sensing function, and the first device has a first AI unit; The first device inputs first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first sensing information.

2. The method according to claim 1, wherein The first sensing information includes at least one of the following: Wireless sensing result, wireless statistical characteristic information, geographical location information, measurement values of lidar-related measurement quantities, measurement values of vision-related measurement quantities, measurement values of radar-related measurement quantities, measurement values of inertial measurement unit-related measurement quantities.

3. The method according to claim 1 or 2, characterized in that, The method further includes: The first device sends first information to the second device, where the first information is used to register the first AI unit with the second device; Wherein, the first information includes information related to at least one candidate sensing information, the candidate sensing information is input information optional for the first AI unit; and the at least one candidate sensing information includes the first sensing information.

4. The method according to claim 3, characterized in that, The information related to the at least one candidate sensing information includes at least one of the following: The information type of the at least one candidate sensing information; The accuracy or processing level of the at least one candidate sensing information; The combined information of the at least one candidate sensing information; The position information of the at least one candidate sensing information in the input dimension of the first AI unit; The priority of the at least one candidate sensing information.

5. The method according to claim 1 or 2, characterized in that, The method further includes: The first device receives first configuration information from the second device, and the first configuration information is used to configure the first AI unit.

6. The method according to any one of claims 1 to 5, characterized in that The method further includes: The first device sends a first request to the second device, and the first request is used to request activation of the first AI unit or request sending of the first sensing information.

7. The method according to any one of claims 1 to 6, characterized in that The method further includes: The first device receives a first command from the second device, where the first command is used to activate the first AI unit; The first device activates the first AI unit according to the first command.

8. The method according to claim 7, wherein The first command carries second configuration information, and the second configuration information is used to configure the first sensing information; The first device receiving first sensing information from the second device includes: The first device receives the first sensing information from the second device according to the second configuration information.

9. The method according to claim 8, wherein The second configuration information includes at least one of the following: The information type of the first sensing information; The sending period of the first sensing information; The sending condition of the first sensing information; The accuracy of the first sensing information; The processing level of the first sensing information; The dimension of the first sensing information; The sending times of the first sensing information; The carrier channel of the first sensing information; The carrier resource of the first sensing information.

10. The method according to claim 7, characterized in that After the first device receives the first command from the second device, the method further includes: The first device sends a first confirmation message to the second device, where the first confirmation message is a confirmation feedback message for the first command, and the first confirmation message is further used to request the sending of the first sensing information.

11. The method according to any one of claims 1 to 10, characterized in that After the first device receives the first sensing information from the second device, the method further includes: The first device receives a second command from the second device, where the second command is used to instruct to deactivate the first AI unit; The first device deactivates the first AI unit according to the second command.

12. The method according to claim 1 or 2, characterized in that, The first sensing information is associated with the first AI unit, or the first sensing information includes the identification information of the first AI unit, and the method further includes: The first device activates the first AI unit according to the first sensing information.

13. The method according to any one of claims 1 to 12, characterized in that, After the first device receives the first sensing information from the second device, the method further includes: The first device sends a second request to the second device, where the second request is used to request at least one of the following: Stop sending the first sensing information; Turn off the first sensing function; Deactivate the first AI unit.

14. The method according to any one of claims 1 to 12, characterized in that, After the first device receives the first sensing information from the second device, the method further includes: The first device sends a third request to the second device, where the third request is used to request at least one of the following: Send second sensing information to the first device; Stop sending the first sensing information to the first device; Turn off the first sensing function; Wherein, the input information of the first AI unit is adjusted from the first sensing information to the second sensing information.

15. The method according to claim 14, characterized in that, The third request includes at least one of the following: The information type of the second sensing information; The sending period of the second sensing information; The sending condition of the second sensing information; The accuracy of the second sensing information; The processing level of the second sensing information; The dimension of the second sensing information; The number of times the second sensing information is sent; The carrier channel of the second sensing information; The carrier resource of the second sensing information.

16. The method according to any one of claims 1 to 15, characterized in that The method further includes: The first device sends first capability information to the second device, where the first capability information is used to describe the relevant information of the sensing information supported by the first device for input to the AI unit; The first device receives a second AI unit from the second device, where the sensing information for input to the second AI unit matches the first capability information.

17. The method according to claim 16, wherein The first capability information is used to indicate at least one of the following for the sensing information supported by the first device for input to the AI unit: The information type of the sensing information, the accuracy range of the sensing information, the processing level of the sensing information, the dimension of the sensing information, the size of the sensing information, the number of sensing information that the terminal can cache, the priority of the sensing information.

18. An information transmission method, characterized in that, Including: The second device acquires first sensing information based on the first sensing function; The second device sends the first sensing information to the first device, where the input information of the first AI unit includes the first sensing information, and the first AI unit is the AI unit possessed by the first device.

19. The method according to claim 18, wherein The first sensing information includes at least one of the following: Wireless sensing results, wireless statistical characteristic information, geographical location information, measured values of lidar-related measurement quantities, measured values of vision-related measurement quantities, measured values of radar-related measurement quantities, measured values of inertial measurement unit-related measurement quantities.

20. The method according to claim 18 or 19, characterized in that, The method further includes: The second device receives first information from the first device, where the first information is used to register the first AI unit with the second device; Wherein, the first information includes relevant information of at least one candidate sensing information, and the candidate sensing information is the input information optional for the first AI unit; and the at least one candidate sensing information includes the first sensing information.

21. The method according to claim 18 or 19, characterized in that, The method further includes: The second device sends first configuration information to the first device, and the first configuration information is used to configure the first AI unit.

22. The method according to any one of claims 18 to 21, characterized in that, The method further includes: The second device receives a first request from the first device, and the first request is used to request to activate the first AI unit or request to send the first sensing information.

23. The method according to any one of claims 1 to 22, characterized in that, The method further includes: The second device sends a first command to the first device, where the first command is used to activate the first AI unit.

24. The method according to claim 23, wherein The first command carries second configuration information, and the second configuration information is used to configure the first sensing information.

25. The method according to claim 23, wherein After the second device sends the first command to the first device, the method further includes: The second device receives first confirmation information from the first device, the first confirmation information is the confirmation information of the first command, and the first confirmation information is further used to request to send the first sensing information.

26. The method according to any one of claims 18 to 25, characterized in that, After the second device sends the first sensing information to the first device, the method further includes: The second device sends a second command to the first device, and the second command is used to instruct to deactivate the first AI unit.

27. The method according to any one of claims 18 to 26, characterized in that, After the second device sends the first sensing information to the first device, the method further includes: The second device receives a second request from the first device, where the second request is used to request at least one of the following: Stop sending the first sensing information; Turn off the first sensing function; Deactivate the first AI unit.

28. The method according to any one of claims 18 to 26, characterized in that, After the second device sends the first sensing information to the first device, the method further includes: The second device receives a third request from the first device, where the third request is used to request at least one of the following: Send second sensing information to the first device; Stop sending the first sensing information to the first device; Turn off the first sensing function; Wherein, the input information of the first AI unit is adjusted from the first sensing information to the second sensing information.

29. The method according to any one of claims 18 to 28, characterized in that, The first sensing information is associated with the first AI unit, or the first sensing information contains the identification information of the first AI unit.

30. The method according to any one of claims 18 to 29, characterized in that, The method further includes: The second device receives first capability information from the first device, where the first capability information is used to describe the relevant information of the sensing information supported by the first device for input to the AI unit; The second device configures a second AI unit for the first device according to the first capability information, where the perception information input to the second AI unit matches the first capability information.

31. An information processing apparatus, characterized in that, For the first device, the apparatus includes: A first receiving module, configured to receive first perception information from a second device, where the first perception information is information obtained based on a first perception function, the second device has the first perception function, and the first device has a first AI unit; A processing module, configured to input first input information into the first AI unit to obtain an inference result output by the first AI unit, where the first input information includes the first perception information.

32. The device according to claim 31, characterized in that, The apparatus further includes: A first sending module, configured to send first information to the second device, where the first information is used to register the first AI unit with the second device; Wherein, the first information includes relevant information of at least one candidate perception information, the candidate perception information is optional input information of the first AI unit; and the at least one candidate perception information includes the first perception information.

33. The device according to claim 31, characterized in that, The apparatus further includes: A second receiving module, configured to receive first configuration information from the second device, the first configuration information being used to configure the first AI unit.

34. The device according to any one of claims 31 to 33, characterized in that, The apparatus further includes: A second sending module, configured to send a first request to the second device, the first request being used to request activation of the first AI unit or request sending of the first perception information.

35. The device according to any one of claims 31 to 34, characterized in that, The apparatus further includes: A third receiving module, configured to receive a first command from the second device, where the first command is used to activate the first AI unit; An activation module, configured to activate the first AI unit according to the first command.

36. The device according to claim 35, characterized in that, The apparatus further includes: A third sending module, configured to send first confirmation information to the second device, the first confirmation information being a confirmation feedback message of the first command, and the first confirmation information is further used to request sending of the first perception information.

37. The device according to any one of claims 31 to 36, characterized in that The apparatus further includes: A fourth receiving module, configured to receive a second command from the second device, the second command being used to instruct deactivation of the first AI unit; A deactivation module, configured to deactivate the first AI unit according to the second command.

38. The device according to any one of claims 31 to 37, characterized in that, The apparatus further includes: A fourth sending module, configured to send a second request to the second device, where the second request is used to request at least one of the following: Stop sending the first perception information; Turn off the first perception function; Deactivate the first AI unit.

39. The device according to any one of claims 31 to 37, characterized in that The apparatus further includes: A fifth sending module, configured to send a third request to the second device, where the third request is used to request at least one of the following: Send second perception information to the first device; Stop sending the first perception information to the first device; Turn off the first perception function; Wherein, the input information of the first AI unit is adjusted from the first perception information to the second perception information.

40. The device according to any one of claims 31 to 39, characterized in that, The apparatus further includes: A sixth sending module, configured to send first capability information to the second device, where the first capability information is used to describe relevant information supported by the first device for inputting perception information of an AI unit; A fifth receiving module, configured to receive a second AI unit from the second device, where the perception information for inputting the second AI unit matches the first capability information.

41. An information transmission device, characterized in that, For a second device, the apparatus includes: An obtaining module, configured to obtain first perception information based on a first perception function; A seventh sending module, configured to send the first perception information to the first device, where the input information of a first AI unit includes the first perception information, and the first AI unit is an AI unit possessed by the first device.

42. The device according to claim 41, wherein, The apparatus further includes: A sixth receiving module, configured to receive first information from the first device, where the first information is used to register the first AI unit with the second device; Wherein, the first information includes relevant information of at least one candidate perception information, the candidate perception information is optional input information of the first AI unit; and the at least one candidate perception information includes the first perception information.

43. The device according to claim 41, characterized in that, The apparatus further includes: An eighth sending module, configured to send first configuration information to the first device, where the first configuration information is used to configure the first AI unit.

44. The device according to any one of claims 41 to 43, characterized in that, The apparatus further includes: A seventh receiving module, configured to receive a first request from the first device, where the first request is used to request activation of the first AI unit or request sending of the first perception information.

45. The device according to any one of claims 41 to 44, characterized in that, The apparatus further includes: A ninth sending module, configured to send a first command to the first device, where the first command is used to activate the first AI unit.

46. The device according to claim 45, characterized in that, The apparatus further includes: An eighth receiving module, configured to receive first confirmation information from the first device, the first confirmation information is confirmation information of the first command, and the first confirmation information is further used to request sending of the first perception information.

47. The device according to any one of claims 41 to 46, characterized in that, The apparatus further includes: A tenth sending module, configured to send a second command to the first device, where the second command is used to instruct deactivation of the first AI unit.

48. The device according to any one of claims 41 to 47, characterized in that, The apparatus further includes: A ninth receiving module, configured to receive a second request from the first device, where the second request is used to request at least one of the following: Stop sending the first perception information; Turn off the first perception function; Deactivate the first AI unit.

49. The device according to any one of claims 41 to 47, characterized in that The apparatus further includes: A tenth receiving module, configured to receive a third request from the first device, where the third request is used to request at least one of the following: Send second perception information to the first device; Stop sending the first perception information to the first device; Turn off the first perception function; Wherein, the input information of the first AI unit is adjusted from the first perception information to the second perception information.

50. The device according to any one of claims 41 to 49, characterized in that, The apparatus further includes: An eleventh receiving module, configured to receive first capability information from the first device, where the first capability information is used to describe relevant information supported by the first device for inputting perception information of an AI unit; A configuration module, configured to configure a second AI unit for the first device according to the first capability information, wherein the perception information input for the second AI unit matches the first capability information.

51. A communication device, characterized in that, It includes a processor and a memory. The memory stores programs or instructions that can run on the processor. When the programs or instructions are executed by the processor, the steps of the information transmission method according to any one of claims 1 to 17 are implemented, or the steps of the information processing method according to any one of claims 18 to 30 are implemented.

52. A readable storage medium, characterized in that, Programs or instructions are stored on the readable storage medium. When the programs or instructions are executed by the processor, the steps of the information transmission method according to any one of claims 1 to 17 are implemented, or the steps of the information processing method according to any one of claims 18 to 30 are implemented.

Images