Training data collection method and apparatus, communication device, and readable storage medium

Abstract

The present application provides a training data collection method and apparatus, a communication device, and a readable storage medium, and belongs to the technical field of communications. The training data collection method is applied to a first device, and the method comprises: sending data request information; and executing at least one of the following: acquiring sample data, and acquiring an artificial intelligence (AI) model or a machine learning (ML) model, the sample data being obtained on the basis of first label data and first training data, and the artificial intelligence (AI) model or machine learning (ML) model being obtained by training based on the sample data.

Description

Training data collection method, device, communication device and readable storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese Patent Application No. 202311283043.0 filed in China on September 28, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application relates to the field of communication technology, and in particular to a training data collection method, apparatus, communication device, and readable storage medium. Background Art

[0004] Traditional Next Generation Radio Access Network (NG-RAN) positioning methods in the 17th / 18th releases (R17 / R18) of the fifth generation mobile communication technology (5G) often rely on line-of-sight (LOS) environments. Positioning accuracy drops sharply in non-line-of-sight (NLOS) environments. R18 has begun researching the introduction of artificial intelligence (AI) / machine learning (ML) models into positioning to improve positioning accuracy.

[0005] Introducing AI / ML models in NG-RAN positioning can effectively address issues such as reduced positioning accuracy in NLOS channel environments. However, the first thing to consider when introducing AI / ML models in positioning technology is model training. The data used for model training needs to be collected over the air interface, but the positioning-related protocols in related technologies do not include a design for collecting training sample data for AI / ML models.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide a training data collection method, apparatus, communication device, and readable storage medium to address the problem of interactive design of the collection process of training sample data without an AI / ML model in NG-RAN positioning in the related art.

[0008] In order to solve the above technical problems, the embodiments of the present application provide the following technical solutions:

[0009] In a first aspect, an embodiment of the present application provides a training data collection method, applied to a first device, the method comprising:

[0010] Send data request information;

[0011] And do at least one of the following:

[0012] Get sample data;

[0013] Obtain artificial intelligence (AI) models or machine learning (ML) models;

[0014] The sample data is obtained based on the first label data and the first training data; the artificial intelligence AI model or the machine learning ML model is trained based on the sample data.

[0015] In a second aspect, an embodiment of the present application provides a training data collection method, applied to a second device, the method comprising:

[0016] Generate sample data;

[0017] The sample data is obtained based on the acquired first label data and first training data;

[0018] The sample data is used to train an artificial intelligence (AI) model or a machine learning (ML) model.

[0019] In a third aspect, an embodiment of the present application provides a training data collection method, applied to a third device, the method comprising:

[0020] receiving data request information;

[0021] According to the data request information, type information of the first training data and / or first label data are sent.

[0022] In a fourth aspect, an embodiment of the present application provides a training data collection apparatus, applied to a first device, the apparatus comprising:

[0023] A first sending module, configured to send data request information;

[0024] and a first processing module, wherein the first processing module is configured to perform at least one of the following:

[0025] Get sample data;

[0026] Obtain artificial intelligence (AI) models or machine learning (ML) models;

[0027] The sample data is obtained based on the first label data and the first training data; the artificial intelligence AI model or the machine learning ML model is trained based on the sample data.

[0028] In a fifth aspect, an embodiment of the present application provides a training data collection device, applied to a second device, the device comprising:

[0029] A first generating module, used to generate sample data;

[0030] The sample data is obtained based on the acquired first label data and first training data;

[0031] The sample data is used to train an artificial intelligence (AI) model or a machine learning (ML) model.

[0032] In a sixth aspect, an embodiment of the present application provides a training data collection apparatus, applied to a third device, the apparatus comprising:

[0033] A first receiving module, configured to receive data request information;

[0034] The second sending module is configured to send type information of the first training data and / or first label data according to the data request information.

[0035] In the seventh aspect, an embodiment of the present application provides a communication device, comprising: a processor, a memory, and a program stored on the memory and runnable on the processor, wherein the program, when executed by the processor, implements the steps of the training data collection method as described in any one of the first aspects, or, when executed by the processor, implements the steps of the training data collection method as described in any one of the second aspects, or, when executed by the processor, implements the steps of the training data collection method as described in any one of the third aspects.

[0036] In an eighth aspect, an embodiment of the present application provides a readable storage medium having a program stored thereon, and when the program is executed by a processor, the program implements the steps of the training data collection method as described in any one of the first aspect, or implements the steps of the training data collection method as described in any one of the second aspect, or implements the steps of the training data collection method as described in any one of the third aspect.

[0037] The beneficial effects of this application are:

[0038] The training data collection method provided by the present application solution sends data request information through the first device, and executes at least one of obtaining sample data and obtaining an artificial intelligence AI model or a machine learning ML model, which can realize the interaction of the collection process of training sample data of the AI / ML model in NG-RAN positioning. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] FIG1 is a schematic diagram showing the auxiliary positioning provided by the present application;

[0040] FIG2 is a schematic diagram showing direct positioning provided by the present application;

[0041] FIG3 is a flowchart of a training data collection method applied to a first device according to an embodiment of the present application;

[0042] FIG4 is a flowchart of a training data collection method applied to a second device according to an embodiment of the present application;

[0043] FIG5 shows one of the schematic diagrams for obtaining sample data provided in an embodiment of the present application;

[0044] FIG6 shows a second schematic diagram of obtaining sample data provided in an embodiment of the present application;

[0045] FIG7 is a flowchart of a training data collection method applied to a third device according to an embodiment of the present application;

[0046] FIG8 shows one of the flowcharts for obtaining a first true label as a TOA according to an embodiment of the present application;

[0047] FIG9 shows a second flowchart of obtaining a first true label as a TOA according to an embodiment of the present application;

[0048] FIG10 is an overall flow chart of the training data collection method provided in an embodiment of the present application;

[0049] FIG11 is a schematic diagram showing the structure of a training data collection apparatus applied to a first device according to an embodiment of the present application;

[0050] FIG12 is a schematic structural diagram of a training data collection apparatus applied to a second device according to an embodiment of the present application;

[0051] FIG13 is a schematic structural diagram of a training data collection apparatus applied to a third device according to an embodiment of the present application;

[0052] FIG14 is a schematic diagram showing the structure of a communication device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] In order to make the technical problems, technical solutions and advantages to be solved by the present application clearer, the following will be described in detail with reference to the accompanying drawings and specific embodiments. In the following description, specific details such as specific configurations and components are provided only to help fully understand the embodiments of the present application. Therefore, it should be clear to those skilled in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. In addition, for clarity and brevity, the description of known functions and structures has been omitted.

[0054] It should be understood that references throughout this specification to "one embodiment" or "an embodiment" mean that a particular feature, structure, or characteristic associated with the embodiment is included in at least one embodiment of the present application. Therefore, the appearances of "in one embodiment" or "in an embodiment" throughout this specification do not necessarily refer to the same embodiment. Furthermore, these particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0055] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the following processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0056] In the embodiments provided herein, it should be understood that "B corresponding to A" means that B is associated with A and B can be determined based on A. However, it should also be understood that determining B based on A does not mean determining B based solely on A; B can also be determined based on A and / or other information.

[0057] In the embodiments of this application, the term "and / or" describes the association relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0058] Before describing the specific embodiments of the present application, the following description is first given:

[0059] At the 3GPP RAN#94 plenary meeting, a new research project, "Study on Artificial Intelligence (AI) / Machine Learning (ML) for NR Air Interface," was introduced, with positioning accuracy enhancement selected as one of the research use cases. Improving positioning accuracy based on AI / ML models requires model training, using labeled data with real-world data.

[0060] Positioning technologies based on AI / ML models are divided into two categories: assisted positioning and direct positioning. As shown in Figure 1, assisted positioning involves inputting channel information into the AI / ML model, which then outputs intermediate positioning variables and uses traditional positioning methods to calculate the user equipment (UE) location information. Direct positioning, as shown in Figure 2, involves inputting channel information into the AI / ML model, which then directly outputs UE location information.

[0061] AIML model training requires training samples of {training data, true labels}. Each training data point must correspond to a true label. For direct positioning, the true label is the UE's location information (coordinates); for assisted positioning, the true label is the intermediate variables required for positioning, such as Reference Signal Time Difference (RSTD), Time of Arrival (TOA), and Loss of System (LOS) / Non-Loss of System (NLOS).

[0062] To solve the problem of interactive design of the collection process of training sample data without AI / ML models in NG-RAN positioning in the related art, the embodiments of the present application provide a training data collection method, apparatus, communication device and readable storage medium.

[0063] As shown in FIG3 , an embodiment of the present application provides a training data collection method, which is applied to a first device. The method includes:

[0064] Step 301: Send data request information;

[0065] And do at least one of the following:

[0066] Get sample data;

[0067] Obtain artificial intelligence (AI) models or machine learning (ML) models;

[0068] The sample data is obtained based on the first label data and the first training data; the artificial intelligence AI model or the machine learning ML model is trained based on the sample data.

[0069] In this step, "the first device obtains sample data" may include at least one of the following:

[0070] receiving sample data sent by the second device;

[0071] Receive sample data sent by other data collection entities;

[0072] The first device generates sample data, specifically, generates (obtains) the sample data from first label data and first training data.

[0073] "Obtaining an artificial intelligence (AI) model or a machine learning (ML) model" can include at least one of the following understandings:

[0074] The first device obtains sample data and performs model training based on the sample data to obtain an AI model ML model.

[0075] The first device receives sample data sent by other devices (such as sample data sent by the second device or other data collection entity), and the first device performs model training based on the sample data to obtain an AI model or ML model.

[0076] The first device obtains sample data and receives sample data sent by other devices. The first device performs model training based on the sample data to obtain an AI model or an ML model.

[0077] The first device receives an AI model or ML model trained by another device, where the trained AI model or ML model is trained by the other device using sample data acquired by the other device itself;

[0078] The first device receives an AI model or ML model trained by other devices, wherein the trained AI model or ML model is obtained by training with sample data sent from a device other than the other device.

[0079] The first device receives an AI model or an ML model trained by another device, wherein the trained AI model or ML model is trained by sample data obtained by the other device itself and sent by a device other than the other device.

[0080] The data collection entity includes at least one of the following:

[0081] First device;

[0082] Network-side equipment (including at least one of the following: LMF and next-generation Node B (gNB));

[0083] Third-Party Data Collection Entities.

[0084] In this step, the data request information is sent to the third device, wherein the third device is a positioning service module, which can be used to schedule any device in the first device and the second device, collect sample data, and configure and activate the transmission of the target reference signal. The third device includes: Location Management Function (LMF).

[0085] The first device includes at least one of the following:

[0086] Terminal UE; base station gNB.

[0087] The second device includes at least one of the following:

[0088] Terminal (UE); base station (gNB); Positioning Reference Unit (PRU); Road Side Unit (RSU).

[0089] It can be understood that the second device is a known terminal device or a terminal device that can obtain a position through a positioning method, and can also be a device that provides sample data to the first device.

[0090] Optionally, the data request information includes at least one of the following:

[0091] The type of the first true label;

[0092] The required amount of sample data, where the required amount of sample data can be understood as the amount of sample data required to train the AI / ML model;

[0093] location-related information of the first device;

[0094] Type information of the first training data;

[0095] The generalization requirement of the sample data refers to the richness of the sample data. The richer the scenarios between the entities providing the sample data, the better the generalization of the sample data. The generalization requirement of the sample data can be reflected by the number of target devices and / or the number of types of target devices. The target device is a device that transmits a target reference signal. A larger number of target devices and / or a larger number of types of target devices may improve the generalization of the sample data. Specifically, the generalization requirement of the sample data may include at least one of the following: an upper limit and / or a lower limit of the number of target devices, and an upper limit and / or a lower limit of the number of types of target devices;

[0096] The accuracy requirement of the sample data, where the accuracy requirement of the sample data can also be understood as the quality requirement of the true label in the first training data, can be reflected by at least one of the following: the type of the second device and / or the target device (the target device is the device that transmits the target reference signal), and confidence-related information. It should be noted that the accuracy of the sample data provided by a fixed-position device is relatively high, such as a fixed-position PRU. The confidence-related information includes, for example, the confidence of the device position;

[0097] The requirement information for the configuration of the target reference signal for obtaining the first training data is used, and the requirement information for the configuration of the target reference signal is used to determine the configuration of the target reference signal. The target reference signal is used to obtain the first training data. It should be noted that the target reference signal is a reference signal used for positioning measurements between target entities. Taking into account the type of equipment transmitting the target reference signal, the target reference signal includes at least one of the following: downlink positioning reference signal (DownLink Positioning Reference Signal, DL-PRS), uplink channel sounding reference signal (UpLink Sounding Reference Signal, UL-SRS) and sidelink positioning reference signal (SideLink Positioning Reference Signal, SL-PRS).

[0098] Optionally, the type of the first real label includes at least one of the following:

[0099] Position information, which may be pre-calibrated position information or position information obtained using a pre-set positioning method, and is used for direct positioning;

[0100] The first arrival time TOA value is the propagation time of the signal between the source and the receiver. In AI-assisted positioning, the TOA tag (first TOA value) is the signal transmission time under the LOS path. It can be obtained by the location information of the target reference signal device. The first TOA value is used to assist positioning;

[0101] The LOS / NLOS indicator indicates whether there is a line of sight between the entities sending and receiving the target reference signal. This can be determined by the relationship between the actual propagation time of the target reference signal and the TOA tag. The LOS / NLOS indicator is used to assist in positioning.

[0102] Optionally, the location-related information of the first device includes at least one of the following:

[0103] location information of the first device;

[0104] First timestamp information related to the location information of the first device, wherein the first timestamp information is used for subsequent matching of first label data and first training data to obtain sample data;

[0105] Credibility information related to the location of the first device.

[0106] Optionally, the type information of the first training data includes at least one of the following:

[0107] The type of the first measurement quantity in the first training data, such as a channel impulse response (CIR) or a power delay profile (PDP);

[0108] The dimension (size) of the first measurement quantity in the first training data, wherein when the second device collects sample data for the first device, the first device needs to specify the dimension (size) of the first measurement quantity. The first measurement quantity may be in matrix form, and the dimension of the first measurement quantity represents the size of the matrix. For example, the matrix of the first measurement quantity is 256*2, where 256 represents the number of time domain sampling points of the channel estimation contained in the first measurement quantity.

[0109] The first device may have corresponding requirements for the configuration of the target reference signal based on the needs of the AI / ML model (because different target reference signal configurations may result in different sample data, resulting in different AI / ML models at the training location). Optionally, the target reference signal configuration requirement information (also referred to as information related to the target reference signal configuration) includes at least one of the following:

[0110] a bandwidth for transmitting the target reference signal;

[0111] The time-frequency density information of the target reference signal, wherein the time-frequency density information of the target reference signal includes the number of symbols occupied by the target reference signal in the time domain or the comb structure (comb) in the frequency domain.

[0112] Optionally, the first training data is obtained by measuring according to the data request information and the target reference signal, and the first training data includes at least one of the following:

[0113] A first measurement quantity, wherein the first measurement quantity is obtained based on channel estimation or channel estimation transformation;

[0114] Second timestamp information related to the first measurement quantity;

[0115] Device identification information of a first target device used to send a target reference signal, where the device identification information may include a device ID or identity information. The device identification information is used to subsequently match the first tag data with the first training data to obtain sample data. The first target device is a device used to send a target reference signal and may include at least one of the following: a gNB, a UE, a PRU, or an RSU;

[0116] In an optional embodiment, the method further includes:

[0117] If the first condition is met, data termination information is sent, where the data termination information is used to instruct the third device to perform a preset operation, where the preset operation includes at least one of the following:

[0118] Stop sending the first tag data;

[0119] A device for transmitting a target reference signal is instructed to stop transmitting the target reference signal.

[0120] The first condition includes at least one of the following:

[0121] The sample data meets the required quantity of sample data.

[0122] The first device stops collecting sample data due to other reasons;

[0123] As shown in FIG4 , an embodiment of the present application further provides a training data collection method, which is applied to a second device. The method includes:

[0124] Step 401: Generate sample data;

[0125] The sample data is obtained based on the acquired first label data and first training data;

[0126] The sample data is used to train an artificial intelligence (AI) model or a machine learning (ML) model.

[0127] In this embodiment, the first label data and the first training data are matched to obtain sample data.

[0128] Before generating the sample data, the method further includes:

[0129] In an optional embodiment, configuration information for generating sample data is obtained, where the configuration information for generating sample data includes:

[0130] Type information of the first training data;

[0131] The type information of the first training data includes at least one of the following:

[0132] a type of a first measurement quantity in the first training data;

[0133] The dimension of the first measurement quantity in the first training data.

[0134] In an optional embodiment, after the second device generates the sample data, the method further includes:

[0135] The sample data is sent.

[0136] It should be noted that, in this optional embodiment, the second device sends the sample data to the first device and / or other data collection entities.

[0137] The first device includes at least one of the following:

[0138] Terminal UE; base station gNB.

[0139] The second device includes at least one of the following:

[0140] Terminal UE; base station gNB; PRU; RSU.

[0141] It should be noted that, when the first device is a terminal UE and the second device is also a terminal UE, or when the first device is a base station gNB and the second device is also a base station gNB, it can be understood that all embodiments of the training data collection method applied to the first device side provided in the embodiments of the present application can also be executed by the second device, and all embodiments of the training data collection method applied to the second device side can also be executed by the first device, that is, any terminal UE or any base station gNB can be used as the first device, and can also be used as the second device to execute the training data collection method on the corresponding side, and can achieve the same or similar technical effects. In the case where the second device is a PRU or RSU, the first device is a terminal UE or a base station gNB, then all embodiments of the training data collection method applied to the first device side can only be implemented by the terminal UE or the base station gNB, and all embodiments of the training data collection method applied to the second device side can only be implemented by the PRU or RSU, that is, the PRU or RSU cannot implement all embodiments of the training data collection method applied to the first device side, but the terminal UE or base station gNB can implement all embodiments of the training data collection method applied to the first device and the second device.

[0142] The first tag data is response information of the data request information, that is, the first tag data is obtained by the third device according to the data request information sent by the first device.

[0143] Optionally, the first tag data includes at least one of the following:

[0144] First ground-truth label;

[0145] Device identification information of a second target device used to transmit a target reference signal, where the device identification information includes a device ID and / or device identity information. The device identification information is used to subsequently match the first label data with the first training data to obtain sample data. The second target device is a device used to transmit a target reference signal and may include at least one of the following: a gNB, a UE, a PRU, or an RSU.

[0146] The third timestamp information related to the first real label is used for subsequent matching of the first label data and the first training data to obtain sample data.

[0147] The first training data is obtained by measuring according to the data request information and the target reference signal.

[0148] Optionally, the first training data includes at least one of the following:

[0149] a first measurement quantity, where the first measurement quantity is obtained based on channel estimation or channel estimation transformation;

[0150] Second timestamp information related to the first measurement quantity;

[0151] Device identification information of a first target device used to send a target reference signal;

[0152] Second time of arrival TOA value.

[0153] In an optional embodiment, the process of obtaining the first training data includes:

[0154] A target reference signal is received, where the target reference signal is a reference signal sent by a first target device and used to obtain first training data, and the target reference signal is measured according to type information of the first training data to obtain the first training data.

[0155] The first measurement quantity includes at least one of the following:

[0156] Channel estimation value H;

[0157] Time information of channel estimation;

[0158] Power information of channel estimation;

[0159] Phase information for channel estimation.

[0160] In an optional embodiment, the first training data includes a second TOA value;

[0161] The second TOA value is obtained by at least one of the following methods:

[0162] Measured based on a target reference signal, i.e., obtained through non-AI / ML model methods;

[0163] The second TOA value is obtained using a trained target model and a first measurement amount, wherein the target model includes an AI model and / or an ML model, and the first measurement amount is obtained by measuring the target reference signal according to the type information of the first training data, that is, the second TOA value is obtained by the AI / ML model.

[0164] In an optional embodiment, when the data request information includes the type of the first real label, and the type of the first real label is a line-of-sight LOS indication or a non-line-of-sight NLOS indication (LOS / NLOS indicator), the device receiving the target reference signal (i.e., the second device in this embodiment) obtains the LOS indication or the NLOS indication based on the first TOA value and the second TOA value; wherein the first TOA value is obtained based on the location information of the second device and the location information of the first target device used to send the target reference signal. Specifically, the second device obtains the LOS / NLOS indicator label based on the relationship between the first TOA value and the second TOA value, merges the LOS / NLOS indicator label with other information in the first label data, and obtains the first label data {LOS / NLOS indicator, device identification information, third timestamp information} required by the second device.

[0165] It should be noted that, in this embodiment, the data request information is sent by the first device to the third device, and the third device configures the second device to perform the operation of this optional embodiment.

[0166] In an optional embodiment, generating sample data includes:

[0167] According to the device identification information of the first target device in the first training data and the device identification information of the second target device in the first label data, and / or the second timestamp information in the first training data and the third timestamp information in the first label data, the first label data and the first training data are matched to obtain the sample data, that is, according to the device identification information and / or timestamp information in the first training data and the first label data, the first training data and the first label data are paired to obtain sample data {first measurement quantity, first true label}, and the obtained sample data is the data for training the AI / ML model.

[0168] In this optional embodiment, the following implementation methods are provided, namely, matching the first label data with the first training data based on the device identification information of the first target device in the first training data and the device identification information of the second target device in the first label data, and / or the second timestamp information in the first training data and the third timestamp information in the first label data to obtain the sample data, including at least one of the following:

[0169] Embodiment 1: When the positions of the device sending the target reference signal and the device receiving the target reference signal are both fixed, the first label data and the first training data are matched according to the device identification information of the first target device and the device identification information of the second target device to obtain the sample data;

[0170] Specifically, when the device identification information of the first target device is consistent with the device identification information of the second target device, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data.

[0171] In this embodiment, the entities sending and receiving the target reference signal are fixed. The second device matches the device identification information of the first target device with the device identification information of the second target device. If the device identification information is the same, the sample data {first measurement quantity, first true label} is obtained.

[0172] Implementation method 2: When the position of at least one of the device sending the target reference signal and the device receiving the target reference signal is not fixed, receive the updated first label data sent by the third device according to the position information of the third target device corresponding to the second timestamp information, and match the updated first label data with the first training data according to the device identification information of the second target device and the device identification information of the first target device in the updated first label data, and / or, according to the third timestamp information and the second timestamp information in the updated first label data, to obtain the sample data; wherein the position information of the third target device corresponding to the second timestamp information is sent by the third target device to the third device, or the position information of the third target device corresponding to the second timestamp information is determined by the third device according to the second timestamp information and a pre-set positioning method, and the third target device is a device with a non-fixed position among the device sending the target reference signal and the device receiving the target reference signal;

[0173] Specifically, when the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device, and when the third timestamp information in the updated first label data is consistent with the second timestamp information, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data.

[0174] Exemplarily, if the position of the third target device is not fixed, the third target device needs to report the position information of the third target device at the moment of sending and / or receiving the target reference signal (i.e., the second timestamp information), and then receive the updated first label data {first true label, device identification information, third timestamp information} sent by the third device according to the position information of the third target device corresponding to the second timestamp information. The second device then matches the device identification information of the second target device in the updated first label data with the device identification information of the first target device, and matches the third timestamp information in the updated first label data with the second timestamp information. If both matches are successful, the sample data {first measurement quantity, first true label} is obtained.

[0175] The specific method is as follows:

[0176] Method 1: When the third target device is a UE, the second device obtains the first training data {first measurement quantity, device identification information, second timestamp information Tb}, and the third target device updates the reported location information corresponding to the second timestamp information Tb. The third device obtains the updated first label data {first true label, set identification information, third timestamp information Tb} based on the updated location information corresponding to the second timestamp information Tb and provides feedback. The second device matches the device identification information of the second target device in the updated first label data with the device identification information of the first target device, and matches the third timestamp information in the updated first label data with the second timestamp information. If both are successful, the sample data {first measurement quantity, first true label} is obtained.

[0177] Method 2: When the second device is a gNB or RSU, the process is shown in Figure 5. The second device takes the gNB as an example. Other third target devices (including UE and / or PRU, UE is taken as an example in Figure 5) send a target reference signal UL-PRS (sent at time Tb) to the third target device, and simultaneously report the corresponding updated location information or obtain the location information (x2, y2) and timestamp information Tb by the third device through a positioning method. The third device obtains first label data {first true label (TOA2), device identification information (UE ID), second timestamp information Tb} based on (x2, y2) and the location information of the second device, and feeds it back to the second device. The second device obtains first training data based on the target reference signal. The second device matches the device identification information in the above-mentioned first label data with the device identification information in the first training data, and matches the timestamp information in the first label data with the timestamp information in the first training data. If both matches are successful, sample data {first measurement quantity, first true label} is obtained.

[0178] Implementation method three: When the position of at least one of the device sending the target reference signal and the device receiving the target reference signal is not fixed, the first label data and the first training data are matched based on at least one of the device identification information of the second target device, the second timestamp information, the device identification information of the first target device and the third timestamp information to obtain the sample data.

[0179] Specifically, the third implementation method includes at least one of the following methods:

[0180] Method 1: When the device identification information of the second target device is consistent with the device identification information of the first target device, and the time indicated by the second timestamp information is later than the time indicated by the third timestamp information, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data;

[0181] Specifically, the second device pairs the first training data {first measurement quantity B1, device identification information, second timestamp information Tb} with the first label data {first true label A1, device identification information, third timestamp information Ta}. If the device identification information is the same and Tb≥Ta, the sample data {first measurement quantity B1, first true label A1} is obtained.

[0182] Method 2: Determine the changed position information of the third target device, send the changed position information to the third device, receive updated first label data sent by the third device based on the changed position information, and if the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and the time indicated by the second timestamp information in the first training data is later than or equal to the time indicated by the third timestamp information in the updated first label data, match the first true label in the first label data and the first measurement in the first training data to obtain the sample data;

[0183] Specifically, when the third target device is a UE, the changed location information may be the location information that has been reported in the data request and obtained after being updated. When the third target device is a UE or a PRU, if no data request is initiated, the changed location information may be the re-reported location information. The third device sends the updated first label data {first true label A2, device identification information, third timestamp information Ta'} based on the changed location information. The second device pairs the first training data {first measurement quantity B1, device identification information, second timestamp information Tb} with the updated first label data {first true label A2, device identification information, third timestamp information Ta'}. If the device identification information is the same and Tb≥Ta', the sample data {first measurement quantity B1, first true label A2} is obtained.

[0184] Method three: determining the changed position information of the third target device, sending the changed position information to the third device, and receiving the updated first label data sent by the third device according to the changed position information, where the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and the time indicated by the third timestamp information in the updated first label data is later than or equal to the time indicated by the second timestamp information in the first training data, and the time indicated by the second timestamp information in the first training data is later than or equal to the time indicated by the third timestamp information in the first label data, matching the first true label in the first label data and the first measurement quantity in the first training data to obtain the sample data;

[0185] Specifically, the first label data {first true label A1, device identification information, third timestamp information Ta} sent by the third device is received, the changed position information of the third target device is determined, and the updated first label data {first true label A2, device identification information, third timestamp information Ta'} sent by the third device according to the changed position information is received. The second device pairs the first training data {first measurement quantity B1, device identification information, second timestamp information Tb}, the updated first label data {first true label A2, device identification information, third timestamp information Ta'} and the first label data {first true label A1, device identification information, third timestamp information Ta}. If the device identification information is the same and Ta<=Tb<=Ta', the first measurement quantity B1 is paired with the first true label A1 to obtain the sample data {first measurement quantity B1, first true label A1}.

[0186] Method 4: Determine the changed position information of the third target device, send the changed position information to the third device, receive the updated first label data sent by the third device according to the changed position information, and when the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and the time indicated by the third timestamp information in the updated first label data is earlier than the time indicated by the second timestamp information in the first training data, match the first true label in the updated first label data and the first measurement quantity in the first training data to obtain the sample data.

[0187] Specifically, the first label data {first true label A1, device identification information, third timestamp information Ta} sent by the third device is received, the changed position information of the third target device is determined, and the updated first label data {first true label A2, device identification information, third timestamp information Ta'} sent by the third device according to the changed position information is received. The second device pairs the first training data {first measurement quantity B1, device identification information, second timestamp information Tb}, the updated first label data {first true label A2, device identification information, third timestamp information Ta'} and the first label data {first true label A1, device identification information, third timestamp information Ta}. If the device identification information is the same and Tb>Ta', the first measurement quantity B1 is paired with the first true label A2 to obtain the sample data {first measurement quantity B1, first true label A2}.

[0188] The timestamp relationship in the above-mentioned method 3 and method 4 is shown in Figure 6. When the third target device is a UE and the second device is a gNB, the third target device UE reports location information (x1, y1) and third timestamp information Ta. The third device obtains the first label data {first true label TOA1, device identification information, third timestamp information Ta} based on the location information (x1, y1) and the location information of the second device. The third device sends the first label data to the second device. The third target device sends a target reference signal to the second device to obtain first training data {first measurement quantity, device identification information (UE ID), second timestamp information Tb}. The third target device UE reports updated location information (x2, y2) and third timestamp information Ta'. The third device obtains the first label data {first true label TOA2, device identification information, third timestamp information Ta'} based on the location information (x2, y2) and the location information of the second device, and sends the first label data to the second device.

[0189] It should also be noted that, when the second device is a gNB, the device that sends the target reference signal to the second device (gNB) includes at least one of the following:

[0190] UE;PRU.

[0191] When the second device is a UE or a PRU, the device sending the target reference signal to the second device includes at least one of the following:

[0192] UE; PRU; gNB; RSU.

[0193] In an optional embodiment, the method further includes:

[0194] The sample data is sent to a data collection entity.

[0195] As shown in FIG7 , an embodiment of the present application further provides a training data collection method, which is applied to a third device. The method includes:

[0196] Step 701: Receive data request information.

[0197] In this step, the third device receives the data request information sent by the first device.

[0198] Step 702: Send type information of first training data and / or first label data according to the data request information.

[0199] In this step, the third device sends the type information of the first training data and / or the first label data to the first device and / or the second device. When the third device sends the type information of the first training data and the first label data, the type information of the first training data is sent first, and then the first label data is sent.

[0200] The data request information includes at least one of the following:

[0201] The type of the first true label;

[0202] The required quantity of sample data;

[0203] location-related information of the first device;

[0204] Type information of the first training data;

[0205] Generalization requirements of sample data;

[0206] Accuracy requirements for sample data;

[0207] The target reference signal configuration requirement information is used to obtain the first training data, wherein the target reference signal configuration requirement information is used to determine the configuration of the target reference signal, and the target reference signal is used to obtain the first training data.

[0208] The first tag data includes at least one of the following:

[0209] First ground-truth label;

[0210] Device identification information of the second target device used to send the target reference signal

[0211] Third timestamp information related to the first true label.

[0212] In an optional embodiment, after receiving the data request information, the method further includes:

[0213] According to the data request information, a second device is determined, and the transmission of the target reference signal is configured and activated; wherein the second device is a device for generating sample data, and the sample data is used to train an artificial intelligence AI model or a machine learning ML model.

[0214] In an optional embodiment, when the data request information includes the type of the first real label, and the type of the first real label is location information, the first real label in the first label data is obtained by at least one of the following methods:

[0215] receiving location information sent by the second device, wherein the location information of the second device is reported in real time, or is to be re-reported after the location information of the second device is updated;

[0216] Location information obtained by a preset positioning method, wherein the preset positioning method is not limited in this embodiment and needs to be re-acquired after the location information of the second device is updated;

[0217] The location information of the second device is acquired in advance, wherein the location information of the second device (when the second device is a PRU) is known to the third device.

[0218] The first true label (the type of the first true label is location information) includes at least one of the following:

[0219] Location information;

[0220] fourth timestamp information associated with the location information;

[0221] Confidence information associated with the location information.

[0222] In an optional embodiment, when the data request information includes the type of the first real label, and the type of the first real label is a first arrival time TOA value (represented by TOA_1), the first real label in the first label data is obtained based on the location information of the second device and the location information of the first target device; wherein, the first target device is a device that sends a target reference signal.

[0223] The following describes the overall process of obtaining the first real label as TOA, taking the second device as a gNB as an example with reference to FIG8 :

[0224] 1. The first device (e.g., gNB) sends a data request message to the third device (LMF). The data request message includes at least one of the following:

[0225] First true tag type (TOA);

[0226] The required amount of sample data;

[0227] Generalization requirements of sample data;

[0228] Configuration information of the target reference signal.

[0229] 2. TRP configuration information interaction: After receiving the data request information, the LMF determines the available second device according to the data request information, configures and activates the transmission of UL-SRS;

[0230] If the second device is a UE, the location information, timestamp information related to the location information, and confidence information are reported to the LMF as needed, or the LMF obtains the location information of the UE through a positioning method;

[0231] If the second device is a PRU, proceed directly to the next step.

[0232] 3-7. Positioning capability interaction: The second device starts UL-SRS transmission according to the UL-SRS resource configuration; the third device sends positioning request information to the first device; the first device determines the transmission resources of UL-SRS; the first device configures UE SRS for the second device; the first device sends a positioning request information response to the third device; the third device sends a positioning activation request information to the first device; the first device activates the transmission of UE SRS; the first device sends a positioning activation response to the third device.

[0233] 8. After receiving the UL-SRS sent by the second device, the gNB obtains first training data {first measurement value, second timestamp information Tb, and device identifier information of the second device} through measurement.

[0234] 9. The second device reports its location information {location coordinates, timestamp Ta} or the location information of the second device (PRU) known to the LMF. The LMF calculates the time-of-arrival (TOA) tag between the second device and the first device (gNB) based on the location information of the second device. The TOA tag is the signal transmission time under the LOS path, that is, TOA = d / c, where d is the straight-line distance between the second device and the gNB, and c is the speed of light.

[0235] 10. Feedback the first tag data {first true tag (TOA), device identification information of the second device, and third timestamp Ta} to the gNB.

[0236] 11. The gNB matches the first training data and the first label data to obtain sample data {first measurement value, TOA}.

[0237] 12. When the sample data collected by the first device meets the required quantity, the first device sends a data termination request message to the third device.

[0238] 13. After receiving the data termination request message from the gNB, the LMF sends a deactivation message to the gNB or releases all UL-SRS resources.

[0239] 9, taking the second device as a UE as an example, the overall process of obtaining the first real label as TOA is described:

[0240] 1. The first device (taking UE as an example) sends data request information to the third device (LMF), where the data request information includes at least one of the following:

[0241] the type of the second device;

[0242] location information of the first device, where the location information may be obtained using a New Radio Access Technology (NR-RAT) method or a non-NR-RAT method;

[0243] A timestamp Ta corresponding to the location of the first device;

[0244] confidence information corresponding to the location of the first device;

[0245] First tag type (TOA);

[0246] a lower limit (threshold) on the number of second devices;

[0247] The quantity of sample data required;

[0248] The bandwidth of the transmission target reference signal;

[0249] The configuration information of the target reference signal includes at least one of the following: a comb of the target reference signal; a transmission bandwidth of the target reference signal; configuration information of the target reference signal;

[0250] The type of sample data;

[0251] The size of the sample data (referring to the dimension of the first measurement quantity).

[0252] 2. TRP configuration information interaction: After receiving the data request information, the third device determines the available second device based on the request information, configures and activates the transmission of DL-PRS;

[0253] If the second device is a UE, the location information, timestamp information related to the location information, and confidence information are reported to the LMF as needed, or the LMF obtains the location information of the UE through a positioning method;

[0254] If the second device is a PRU, proceed directly to the next step.

[0255] 3-10. Positioning capability interaction; the third device sends a target reference signal transmission request to the first device; the second device reports location information to the third device; the first device determines the DL-PRS transmission resource; the first device transmits DL-PRS to the second device; the first device sends a target reference signal transmission response to the third device; the first device sends a first auxiliary information request to the third device; the first device receives the first auxiliary information sent by the third device.

[0256] 11. After receiving the DL-PRS, the first device and / or the second device obtains the first training data {first measurement value, second timestamp information Tb, device identification information} through measurement.

[0257] 12. Based on the location information of the first and / or second devices, the LMF calculates the time of arrival (TOA) between the first and / or second devices and the third device. The TOA is the signal propagation time along the LOS path (whether or not the LOS path is included), i.e., TOA = d / c, where d is the straight-line distance between the first and / or second devices and the gNB, and c is the speed of light. The LMF feeds the first tag data (first true TOA, device identification information, and third timestamp Ta) back to the first and / or second devices.

[0258] 13. The first device and / or the second device matches the first training data and the first label data to obtain sample data {first measurement quantity, first true label}.

[0259] 14. The second device transmits the sample data to the first device or other data collection entity.

[0260] 15. The first device sends data termination request information to the second device.

[0261] 16. The second device receives the data termination request information and sends a target reference signal transmission request to the first device, where the target reference signal transmission request includes at least one of the following:

[0262] PRS Configuration Request Type("config" or "off")

[0263] PRS TRP Item: TRP ID and / or Requested DL PRS Transmission Characteristics.

[0264] The first device stops reference signal transmission according to the target reference signal transmission request.

[0265] In an optional embodiment, when the data request information includes the type of the first real label, and the type of the first real label is a line-of-sight LOS indication or a non-line-of-sight NLOS indication (LOS / NLOS indicator), the device receiving the target reference signal (i.e., the second device in this embodiment) obtains the LOS indication or the NLOS indication based on the first TOA value and the second TOA value; wherein the first TOA value is obtained based on the location information of the second device and the location information of the first target device used to send the target reference signal. Specifically, the second device obtains the LOS / NLOS indicator label based on the relationship between the first TOA value and the second TOA value, merges the LOS / NLOS indicator label with other information in the first label data, and obtains the first label data {LOS / NLOS indicator, device identification information, third timestamp information} required by the second device.

[0266] The following uses the gNB as an example to describe the process when the first real tag type is LOS / NLOS:

[0267] The first device (gNB) sends data request information to the third device (LMF), where the data request information includes at least one of the following:

[0268] First true label type (LOS / NLOS indicator);

[0269] Second, the number of devices required;

[0270] The required quantity of sample data;

[0271] Information related to target reference signal configuration.

[0272] After receiving the data request information, the LMF determines an available second device according to the data request information, and configures and activates the transmission of the UL-SRS;

[0273] Among them, if the second device is a UE, it reports location information, timestamp information related to the location information, and confidence information to the LMF as needed, or the LMF obtains the location information of the UE through positioning methods;

[0274] If the second device is a PRU, directly proceed to the next step.

[0275] The second device starts the transmission of UL-SRS according to the resource configuration of UL-SRS;

[0276] After the first device receives the UL-SRS sent by the second device, it measures and obtains the first training data {first measurement quantity, second timestamp information Tb, device identification information, TOA information (TOA_1)};

[0277] Among them, TOA_1 can be obtained through an AI / ML model; and / or,

[0278] TOA_1 can be obtained through non-AI / ML methods.

[0279] The LMF calculates the TOA between the second device and the first device according to the location information {location coordinates, timestamp Ta} reported by the second device or the location information of the second device (PRU) known to the LMF. The TOA label is the signal transmission time under the LOS path, that is, TOA = d / c, where d is the straight-line distance between the fourth device and the gNB, and c is the speed of light. And it feeds back the first label data {first true label (TOA_2), fourth device ID or identity information, timestamp Ta} to the first device.

[0280] The second device pairs according to the timestamp information and / or device identification information in the first training data set {first measurement quantity, second timestamp information Tb, device ID or identity identification information, TOA information (TOA_1)} and the first label data {first true label (TOA_2), device identification information, third timestamp information Ta}. If the pairing is successful, sample data is obtained, and then:

[0281] The LOS / NLOS indicator is obtained by comparing TOA_1 and TOA_2, including but not limited to the following method: if TOA_1 - TOA_2 < TH (threshold), it is determined as LOS, otherwise it is determined as NLOS. The TH value depends on the implementation.

[0282] The first device obtains the updated first label data {LOS / NLOS indicator, device identification information, third timestamp information Ta} according to the first label data and the above LOS / NLOS determination result.

[0283] In an optional embodiment, the method further includes:

[0284] Sending updated first label data to the second device based on the location information of the third target device corresponding to the second timestamp information in the first training data; wherein the location information of the third target device corresponding to the second timestamp information is sent by the third target device to the third device, or the location information of the third target device corresponding to the second timestamp information is determined by the third device based on the second timestamp information and a preset positioning method; the first training data is obtained by measuring based on a target reference signal; and the third target device is a device with a non-fixed location between the device sending the target reference signal and the device receiving the target reference signal;

[0285] In an optional embodiment, the method further includes:

[0286] Receive the change location information sent by the third target device

[0287] Sending updated first tag data according to the changed position information;

[0288] The third target device is a device whose location is not fixed, among the device that sends the target reference signal and the device that receives the target reference signal.

[0289] The overall process of the training data collection method provided in the embodiment of the present application is described in detail below with reference to FIG10 :

[0290] The first device sends data request response information to the third device;

[0291] The third device determines the second device according to the data request response information and configures target reference signal transmission;

[0292] The third device sends configuration information (measurement information) of the target reference signal to the first device and / or the second device;

[0293] The first device and / or the second device performs measurement based on the target reference signal to obtain first training data;

[0294] The third device sends response information of the data request information to the first device and / or the second device, wherein the response information includes the first tag data;

[0295] The first device and / or the second device performs data annotation (data matching) based on the first training data and the first label data to obtain sample data.

[0296] The sample data of the second device is sent to the first device. After the sample data collected by the first device meets the requirements, the data termination request information is sent to the third device. The third device feeds back the response information of the data termination request information and stops the transmission of the target reference signal.

[0297] The embodiments of the present application utilize the signaling and processes in the air interface of the related technology to implement the labeling of AI / ML-assisted positioning model training data, with small computational complexity and low complexity. It clarifies the process of collecting AI / ML model training data and provides a feasible solution for introducing AI / ML into air interface positioning.

[0298] As shown in FIG11 , an embodiment of the present application further provides a training data collection apparatus, which is applied to a first device and includes:

[0299] A first sending module 1101 is configured to send data request information;

[0300] and a first processing module 1102, configured to perform at least one of the following:

[0301] Get sample data;

[0302] Obtain artificial intelligence (AI) models or machine learning (ML) models;

[0303] The sample data is obtained based on the first label data and the first training data; the artificial intelligence AI model or the machine learning ML model is trained based on the sample data.

[0304] Optionally, the data request information includes at least one of the following:

[0305] The type of the first true label;

[0306] The required quantity of sample data;

[0307] location-related information of the first device;

[0308] Type information of the first training data;

[0309] Generalization requirements of sample data;

[0310] Accuracy requirements for sample data;

[0311] The target reference signal configuration requirement information is used to obtain the first training data, wherein the target reference signal configuration requirement information is used to determine the configuration of the target reference signal, and the target reference signal is used to obtain the first training data.

[0312] Optionally, the type of the first real label includes at least one of the following:

[0313] Location information;

[0314] First arrival time TOA value;

[0315] Line-of-sight (LOS) indication or non-line-of-sight (NLOS) indication.

[0316] Optionally, the location-related information of the first device includes at least one of the following:

[0317] location information of the first device;

[0318] first timestamp information related to the location information of the first device;

[0319] Credibility information related to the location of the first device.

[0320] Optionally, the type information of the first training data includes at least one of the following:

[0321] a type of a first measurement quantity in the first training data;

[0322] The dimension of the first measurement quantity in the first training data.

[0323] Optionally, the first training data includes at least one of the following:

[0324] a first measurement quantity;

[0325] Second timestamp information related to the first measurement quantity;

[0326] Device identification information of a first target device used to send a target reference signal;

[0327] Second TOA value.

[0328] It should be noted that the training data collection device applied to the first device provided in the embodiment of the present application is a device capable of executing the above-mentioned training data collection method applied to the first device. All embodiments of the above-mentioned training data collection method applied to the first device are applicable to the device and can achieve the same or similar technical effects.

[0329] As shown in FIG12 , an embodiment of the present application further provides a training data collection device, which is applied to a second device. The device includes:

[0330] The first generating module 1201 is used to generate sample data;

[0331] The sample data is obtained based on the acquired first label data and first training data;

[0332] The sample data is used to train an artificial intelligence (AI) model or a machine learning (ML) model.

[0333] Optionally, the first training data includes at least one of the following:

[0334] a first measurement quantity;

[0335] Second timestamp information related to the first measurement quantity;

[0336] Device identification information of a first target device used to send a target reference signal;

[0337] Second time of arrival TOA value.

[0338] Optionally, the device further comprises:

[0339] A first signal receiving module is configured to receive a target reference signal, where the target reference signal is a reference signal sent by a first target device and used to obtain first training data;

[0340] The first measurement module is configured to measure the target reference signal according to type information of the first training data to obtain the first training data.

[0341] Optionally, the first measurement quantity includes at least one of the following:

[0342] Channel estimation value;

[0343] Time information of channel estimation;

[0344] Power information of channel estimation;

[0345] Phase information for channel estimation.

[0346] Optionally, the first training data includes a second TOA value;

[0347] The second TOA value is obtained by at least one of the following methods:

[0348] Measured based on the target reference signal;

[0349] obtained using a trained target model and a first measurement quantity, wherein the target model includes an AI model and / or an ML model, and the first measurement quantity is obtained by measuring the target reference signal according to type information of the first training data;

[0350] Optionally, the device further comprises:

[0351] a second processing module, configured to, when the data request information includes the type of the first real label, and the type of the first real label is a line-of-sight (LOS) indication or a non-line-of-sight (NLOS) indication, obtain the LOS indication or the NLOS indication according to the first TOA value and the second TOA value;

[0352] The first TOA value is obtained according to the location information of the second device and the location information of the first target device used to send the target reference signal.

[0353] Optionally, the first generating module 1201 includes:

[0354] A first processing unit is used to match the first label data and the first training data based on the device identification information of the first target device in the first training data and the device identification information of the second target device in the first label data, and / or the second timestamp information in the first training data and the third timestamp information in the first label data to obtain the sample data.

[0355] Optionally, the first processing unit is specifically configured to perform at least one of the following:

[0356] When the positions of the device sending the target reference signal and the device receiving the target reference signal are both fixed, matching the first label data with the first training data according to the device identification information of the first target device and the device identification information of the second target device to obtain the sample data;

[0357] In a case where the position of at least one of the device sending the target reference signal and the device receiving the target reference signal is not fixed, receiving the updated first label data sent by the third device based on the position information of the third target device corresponding to the second timestamp information, and matching the updated first label data with the first training data based on the device identification information of the second target device and the device identification information of the first target device in the updated first label data, and / or based on the third timestamp information and the second timestamp information in the updated first label data to obtain the sample data; wherein the position information of the third target device corresponding to the second timestamp information is sent by the third target device to the third device, or the position information of the third target device corresponding to the second timestamp information is determined by the third device based on the second timestamp information and a pre-set positioning method, and the third target device is the device with a non-fixed position among the device sending the target reference signal and the device receiving the target reference signal;

[0358] When the position of at least one of the device sending the target reference signal and the device receiving the target reference signal is not fixed, the first label data and the first training data are matched based on at least one of the device identification information of the second target device, the second timestamp information, the device identification information of the first target device and the third timestamp information to obtain the sample data.

[0359] Optionally, the first processing unit is specifically configured to:

[0360] When the device identification information of the first target device is consistent with the device identification information of the second target device, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data.

[0361] Optionally, the first processing unit is specifically configured to:

[0362] When the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device, and / or when the third timestamp information in the updated first label data is consistent with the second timestamp information, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data.

[0363] Optionally, the first processing unit is specifically configured to perform at least one of the following:

[0364] When the device identification information of the second target device is consistent with the device identification information of the first target device, and the time indicated by the second timestamp information is later than the time indicated by the third timestamp, matching the first true label in the first label data and the first measurement in the first training data to obtain the sample data;

[0365] determining changed position information of a third target device, sending the changed position information to the third device, receiving updated first label data sent by the third device based on the changed position information, and matching a first true label in the first label data with a first measurement in the first training data when the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and when a time indicated by the second timestamp information in the first training data is later than or equal to a time indicated by the third timestamp information in the updated first label data, to obtain the sample data;

[0366] determining changed position information of a third target device, sending the changed position information to the third device, and receiving updated first label data sent by the third device based on the changed position information, where the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and where the time indicated by the third timestamp information in the updated first label data is later than or equal to the time indicated by the second timestamp information in the first training data, and the time indicated by the second timestamp information in the first training data is later than or equal to the time indicated by the third timestamp information in the first label data, matching the first true label in the first label data and the first measurement quantity in the first training data to obtain the sample data;

[0367] Determine the changed position information of the third target device, send the changed position information to the third device, receive the updated first label data sent by the third device according to the changed position information, and when the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and when the time indicated by the third timestamp information in the updated first label data is earlier than the time indicated by the second timestamp information in the first training data, match the first true label in the updated first label data and the first measurement quantity in the first training data to obtain the sample data.

[0368] It should be noted that the training data collection device applied to the second device provided in the embodiment of the present application is a device capable of executing the above-mentioned training data collection method applied to the second device. All embodiments of the above-mentioned training data collection method applied to the first device are applicable to the device and can achieve the same or similar technical effects.

[0369] As shown in FIG13 , an embodiment of the present application further provides a training data collection device, which is applied to a third device. The device includes:

[0370] A first receiving module 1301 is configured to receive data request information;

[0371] The second sending module 1302 is configured to send type information of the first training data and / or first label data according to the data request information.

[0372] Optionally, the data request information includes at least one of the following:

[0373] The type of the first true label;

[0374] The required quantity of sample data;

[0375] location-related information of the first device;

[0376] Type information of the first training data;

[0377] Generalization requirements of sample data;

[0378] Accuracy requirements for sample data;

[0379] The target reference signal configuration requirement information is used to obtain the first training data, wherein the target reference signal configuration requirement information is used to determine the configuration of the target reference signal, and the target reference signal is used to obtain the first training data.

[0380] Optionally, the first tag data includes at least one of the following:

[0381] First ground-truth label;

[0382] Device identification information of the second target device used to send the target reference signal

[0383] Third timestamp information related to the first true label.

[0384] Optionally, the device further comprises:

[0385] a determination module, configured to determine a second device according to the data request information;

[0386] Among them, the second device is a device for generating sample data, and the sample data is used to train an artificial intelligence AI model or a machine learning ML model.

[0387] Optionally, when the data request information includes the type of the first true label, and the type of the first true label is location information, the first true label in the first label data is obtained by at least one of the following methods:

[0388] receiving location information sent by a second device;

[0389] Location information obtained through a pre-set positioning method;

[0390] The location information of the second device is acquired in advance.

[0391] Optionally, the first true label includes at least one of the following:

[0392] Location information;

[0393] fourth timestamp information associated with the location information;

[0394] Confidence information associated with the location information.

[0395] Optionally, when the data request information includes the type of the first real label, and the type of the first real label is the first arrival time TOA value, the first real label in the first label data is obtained based on the location information of the second device and the location information of the first target device; wherein, the first target device is a device that sends a target reference signal.

[0396] Optionally, the device further comprises:

[0397] a first information sending module, configured to send updated first label data to a second device based on location information of a third target device corresponding to second timestamp information in the first training data; wherein the location information of the third target device corresponding to the second timestamp information is sent by the third target device to the third device, or the location information of the third target device corresponding to the second timestamp information is determined by the third device based on the second timestamp information and a preset positioning method; the first training data is obtained by measuring based on a target reference signal; and the third target device is a device with a non-fixed location, one of the device sending the target reference signal and the device receiving the target reference signal;

[0398] Optionally, the device further comprises:

[0399] The first information receiving module is used to receive the change position information sent by the third target device

[0400] A second information sending module, configured to send updated first tag data according to the changed position information;

[0401] The third target device is a device whose location is not fixed, among the device that sends the target reference signal and the device that receives the target reference signal.

[0402] It should be noted that the training data collection device applied to the third device provided in the embodiment of the present application is a device capable of executing the above-mentioned training data collection method applied to the third device. All embodiments of the above-mentioned training data collection method applied to the third device are applicable to the device and can achieve the same or similar technical effects.

[0403] As shown in Figure 14, an embodiment of the present application also provides a communication device, which is a first device, including: a processor 1401; and a memory 1403 connected to the processor 1401 through a bus interface 1402, the memory 1403 is used to store programs and data used by the processor 1401 when performing operations, and the processor 1401 calls and executes the programs and data stored in the memory 1403.

[0404] The transceiver 1404 is connected to the bus interface 1402 and is configured to receive and send data under the control of the processor 1401. Specifically, the processor 1401 is configured to read the program in the memory 1403, and the transceiver 1404 executes:

[0405] Send data request information;

[0406] And, the processor 1401 executes: obtaining sample data; and / or, the transceiver 1404 executes: obtaining an artificial intelligence AI model or a machine learning ML model;

[0407] The sample data is obtained based on the first label data and the first training data; the artificial intelligence AI model or the machine learning ML model is trained based on the sample data.

[0408] Optionally, the data request information includes at least one of the following:

[0409] The type of the first true label;

[0410] The required quantity of sample data;

[0411] location-related information of the first device;

[0412] Type information of the first training data;

[0413] Generalization requirements of sample data;

[0414] Accuracy requirements for sample data;

[0415] The target reference signal configuration requirement information is used to obtain the first training data, wherein the target reference signal configuration requirement information is used to determine the configuration of the target reference signal, and the target reference signal is used to obtain the first training data.

[0416] Optionally, the type of the first real label includes at least one of the following:

[0417] Location information;

[0418] First arrival time TOA value;

[0419] Line-of-sight (LOS) indication or non-line-of-sight (NLOS) indication.

[0420] Optionally, the location-related information of the first device includes at least one of the following:

[0421] location information of the first device;

[0422] first timestamp information related to the location information of the first device;

[0423] Credibility information related to the location of the first device.

[0424] Optionally, the type information of the first training data includes at least one of the following:

[0425] a type of a first measurement quantity in the first training data;

[0426] The dimension of the first measurement quantity in the first training data.

[0427] Optionally, the first training data includes at least one of the following:

[0428] a first measurement quantity;

[0429] Second timestamp information related to the first measurement quantity;

[0430] Device identification information of a first target device used to send a target reference signal;

[0431] Second TOA value.

[0432] In FIG14 , the bus architecture may include any number of interconnected buses and bridges, specifically linking together various circuits of one or more processors represented by processor 1401 and memory represented by memory 1403. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 1404 may be a plurality of components, i.e., including a transmitter and a receiver, providing a unit for communicating with various other devices over a transmission medium. The processor 1401 is responsible for managing the bus architecture and general processing, and the memory 1403 may store data used by the processor 1401 when performing operations.

[0433] An embodiment of the present application also provides a communication device, which is a second device and includes: a processor; and a memory connected to the processor through a bus interface, the memory being used to store programs and data used by the processor when performing operations, and the processor calling and executing the programs and data stored in the memory.

[0434] The transceiver is connected to the bus interface and is used to receive and send data under the control of the processor. Specifically, the processor is used to read the program in the memory.

[0435] The structure of the second device is basically the same as that of the communication device shown in FIG14 , and will not be described in detail here.

[0436] The processor performs:

[0437] Generate sample data;

[0438] The sample data is obtained based on the acquired first label data and first training data;

[0439] The sample data is used to train an artificial intelligence (AI) model or a machine learning (ML) model.

[0440] Optionally, the processor is further configured to:

[0441] Obtain configuration information for generating sample data, where the configuration information for generating sample data includes:

[0442] Type information of the first training data;

[0443] The type information of the first training data includes at least one of the following:

[0444] a type of a first measurement quantity in the first training data;

[0445] The dimension of the first measurement quantity in the first training data.

[0446] Optionally, the transceiver is used to:

[0447] The sample data is sent.

[0448] Optionally, the first tag data includes at least one of the following:

[0449] First ground-truth label;

[0450] Device identification information of the second target device used to send the target reference signal

[0451] Third timestamp information related to the first true label.

[0452] Optionally, the first training data includes at least one of the following:

[0453] a first measurement quantity;

[0454] Second timestamp information related to the first measurement quantity;

[0455] Device identification information of a first target device used to send a target reference signal;

[0456] Second time of arrival TOA value.

[0457] Optionally, the transceiver is further configured to:

[0458] receiving a target reference signal, where the target reference signal is a reference signal sent by a first target device and used to obtain first training data;

[0459] The processor is further configured to:

[0460] The target reference signal is measured according to the type information of the first training data to obtain the first training data.

[0461] Optionally, the first measurement quantity includes at least one of the following:

[0462] Channel estimation value;

[0463] Time information of channel estimation;

[0464] Power information of channel estimation;

[0465] Phase information for channel estimation.

[0466] Optionally, the first training data includes a second TOA value;

[0467] The second TOA value is obtained by at least one of the following methods:

[0468] Measured based on the target reference signal;

[0469] obtained using a trained target model and a first measurement quantity, wherein the target model includes an AI model and / or an ML model, and the first measurement quantity is obtained by measuring the target reference signal according to type information of the first training data;

[0470] Optionally, the processor is further configured to:

[0471] When the data request information includes the type of the first real label, and the type of the first real label is a line-of-sight (LOS) indication or a non-line-of-sight (NLOS) indication, obtaining the LOS indication or the NLOS indication according to the first TOA value and the second TOA value;

[0472] The first TOA value is obtained according to the location information of the second device and the location information of the first target device used to send the target reference signal.

[0473] Optionally, the processor is specifically configured to:

[0474] According to the device identification information of the first target device in the first training data and the device identification information of the second target device in the first label data, and / or, the second timestamp information in the first training data and the third timestamp information in the first label data, the first label data and the first training data are matched to obtain the sample data.

[0475] Optionally, the processor is specifically configured to perform at least one of the following:

[0476] When the positions of the device sending the target reference signal and the device receiving the target reference signal are both fixed, matching the first label data with the first training data according to the device identification information of the first target device and the device identification information of the second target device to obtain the sample data;

[0477] In a case where the position of at least one of the device sending the target reference signal and the device receiving the target reference signal is not fixed, receiving the updated first label data sent by the third device based on the position information of the third target device corresponding to the second timestamp information, and matching the updated first label data with the first training data based on the device identification information of the second target device and the device identification information of the first target device in the updated first label data, and / or based on the third timestamp information and the second timestamp information in the updated first label data to obtain the sample data; wherein the position information of the third target device corresponding to the second timestamp information is sent by the third target device to the third device, or the position information of the third target device corresponding to the second timestamp information is determined by the third device based on the second timestamp information and a pre-set positioning method, and the third target device is the device with a non-fixed position among the device sending the target reference signal and the device receiving the target reference signal;

[0478] When the position of at least one of the device sending the target reference signal and the device receiving the target reference signal is not fixed, the first label data and the first training data are matched based on at least one of the device identification information of the second target device, the second timestamp information, the device identification information of the first target device and the third timestamp information to obtain the sample data.

[0479] Optionally, the processor is specifically configured to:

[0480] When the device identification information of the first target device is consistent with the device identification information of the second target device, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data.

[0481] Optionally, the processor is specifically configured to:

[0482] When the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device, and / or when the third timestamp information in the updated first label data is consistent with the second timestamp information, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data.

[0483] Optionally, the processor is specifically configured to perform at least one of the following:

[0484] When the device identification information of the second target device is consistent with the device identification information of the first target device, and the time indicated by the second timestamp information is later than the time indicated by the third timestamp, matching the first true label in the first label data and the first measurement in the first training data to obtain the sample data;

[0485] determining changed position information of a third target device, sending the changed position information to the third device, receiving updated first label data sent by the third device based on the changed position information, and matching a first true label in the first label data with a first measurement in the first training data when the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and when a time indicated by the second timestamp information in the first training data is later than or equal to a time indicated by the third timestamp information in the updated first label data, to obtain the sample data;

[0486] determining changed position information of a third target device, sending the changed position information to the third device, and receiving updated first label data sent by the third device based on the changed position information, where the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and where the time indicated by the third timestamp information in the updated first label data is later than or equal to the time indicated by the second timestamp information in the first training data, and the time indicated by the second timestamp information in the first training data is later than or equal to the time indicated by the third timestamp information in the first label data, matching the first true label in the first label data and the first measurement quantity in the first training data to obtain the sample data;

[0487] Determine the changed position information of the third target device, send the changed position information to the third device, receive the updated first label data sent by the third device according to the changed position information, and when the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and when the time indicated by the third timestamp information in the updated first label data is earlier than the time indicated by the second timestamp information in the first training data, match the first true label in the updated first label data and the first measurement quantity in the first training data to obtain the sample data.

[0488] An embodiment of the present application also provides a communication device, which is a third device and includes: a processor; and a memory connected to the processor through a bus interface, the memory being used to store programs and data used by the processor when performing operations, and the processor calling and executing the programs and data stored in the memory.

[0489] The transceiver is connected to the bus interface and is used to receive and send data under the control of the processor. Specifically, the processor is used to read the program in the memory.

[0490] Among them, the structure of the third device is basically the same as the structure of the communication device shown in Figure 14, and will not be repeated here.

[0491] The transceiver performs at least one of the following:

[0492] receiving data request information;

[0493] According to the data request information, type information of the first training data and / or first label data are sent.

[0494] Optionally, the data request information includes at least one of the following:

[0495] The type of the first true label;

[0496] The required quantity of sample data;

[0497] location-related information of the first device;

[0498] Type information of the first training data;

[0499] Generalization requirements of sample data;

[0500] Accuracy requirements for sample data;

[0501] The target reference signal configuration requirement information is used to obtain the first training data, wherein the target reference signal configuration requirement information is used to determine the configuration of the target reference signal, and the target reference signal is used to obtain the first training data.

[0502] Optionally, the first tag data includes at least one of the following:

[0503] First ground-truth label;

[0504] Device identification information of the second target device used to send the target reference signal

[0505] Third timestamp information related to the first true label.

[0506] Optionally, the processor is further configured to:

[0507] determining a second device according to the data request information;

[0508] Among them, the second device is a device for generating sample data, and the sample data is used to train an artificial intelligence AI model or a machine learning ML model.

[0509] Optionally, when the data request information includes the type of the first true label, and the type of the first true label is location information, the first true label in the first label data is obtained by at least one of the following methods:

[0510] receiving location information sent by a second device;

[0511] Location information obtained through a pre-set positioning method;

[0512] The location information of the second device is acquired in advance.

[0513] Optionally, the first true label includes at least one of the following:

[0514] Location information;

[0515] fourth timestamp information associated with the location information;

[0516] Confidence information associated with the location information.

[0517] Optionally, when the data request information includes the type of the first real label, and the type of the first real label is the first arrival time TOA value, the first real label in the first label data is obtained based on the location information of the second device and the location information of the first target device; wherein, the first target device is a device that sends a target reference signal.

[0518] Optionally, the transceiver is further configured to:

[0519] Sending updated first label data to the second device based on the location information of the third target device corresponding to the second timestamp information in the first training data; wherein the location information of the third target device corresponding to the second timestamp information is sent by the third target device to the third device, or the location information of the third target device corresponding to the second timestamp information is determined by the third device based on the second timestamp information and a preset positioning method; the first training data is obtained by measuring based on a target reference signal; and the third target device is a device with a non-fixed location between the device sending the target reference signal and the device receiving the target reference signal;

[0520] Optionally, the transceiver is further configured to:

[0521] Receive the change location information sent by the third target device

[0522] Sending updated first tag data according to the changed position information;

[0523] The third target device is a device whose location is not fixed, among the device that sends the target reference signal and the device that receives the target reference signal.

[0524] In addition, a specific embodiment of the present application also provides a readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the steps of the training data collection method applied to the first device as described in any one of the above are implemented, or the steps of the training data collection method applied to the second device as described in any one of the above are implemented, or the steps of the training data collection method applied to the third device as described in any one of the above are implemented.

[0525] In the several embodiments provided in this application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection of some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0526] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may be physically included separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0527] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute part of the steps of the resource selection method described in each embodiment of the present application, or to execute part of the steps of the information sending method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program code.

[0528] The above is an optional implementation of the present application. It should be pointed out that for ordinary personnel in this technical field, several improvements and modifications can be made without departing from the principles described in the present application. These improvements and modifications are also within the scope of protection of the present application.

Claims

1. A training data collection method, applied to a first device, the method comprising: Send data request information; And do at least one of the following: Get sample data; Obtain artificial intelligence AI model or machine learning ML model; The sample data is obtained according to the first label data and the first training data; the artificial intelligence AI model or the machine learning ML model is trained based on the sample data.

2. The method according to claim 1, wherein: The data request information includes at least one of the following: The type of the first true label; The required quantity of sample data; location-related information of the first device; Type information of first training data; Generalization requirements of sample data; Accuracy requirements for sample data; The requirement information for obtaining configuration of a target reference signal for the first training data is used to determine the configuration of a target reference signal used to obtain the first training data.

3. The method according to claim 2, wherein: The type of the first real label includes at least one of the following: Location information; First arrival time TOA value; Line-of-sight (LOS) indication or non-line-of-sight (NLOS) indication.

4. The method according to claim 2, wherein: The location-related information of the first device includes at least one of the following: location information of the first device; first timestamp information related to the location information of the first device; Confidence information related to the location of the first device.

5. The method according to claim 2, wherein: The type information of the first training data includes at least one of the following: a type of a first measurement quantity in the first training data; The dimension of the first measurement quantity in the first training data.

6. The method according to claim 1, wherein: The first training data includes at least one of the following: A first measurement quantity; second timestamp information related to the first measurement; Device identification information of a first target device used to send a target reference signal; The second TOA value.

7. A training data collection method, applied to a second device, the method comprising: Generate sample data; The sample data is obtained according to the acquired first label data and first training data; The sample data is used to train an artificial intelligence (AI) model or a machine learning (ML) model.

8. The method according to claim 7, wherein: Before generating the sample data, the method further includes: Acquire configuration information for generating sample data, where the configuration information for generating sample data includes: Type information of the first training data; The type information of the first training data includes at least one of the following: a type of a first measurement quantity in the first training data; The dimension of the first measurement quantity in the first training data.

9. The method according to claim 7, wherein: The method further includes: sending the sample data.

10. The method according to claim 7, wherein: The first tag data includes at least one of the following: First true label; Device identification information of the second target device used to send the target reference signal The third timestamp information related to the first real label.

11. The method according to claim 7, wherein: The first training data includes at least one of the following: A first measurement quantity; second timestamp information related to the first measurement; Device identification information of a first target device used to send a target reference signal; Second time of arrival TOA value.

12. The method according to claim 7, wherein: The method further comprises: receiving a target reference signal, where the target reference signal is a reference signal sent by a first target device and used to obtain first training data; The target reference signal is measured according to the type information of the first training data to obtain the first training data.

13. The method according to claim 11, wherein: The first measurement includes at least one of the following: channel estimation value; Time information of channel estimation; Power information of channel estimation; Phase information for channel estimation.

14. The method according to claim 7, wherein: The first training data includes a second TOA value; The second TOA value is obtained by at least one of the following methods: Measured based on a target reference signal; It is obtained by using a trained target model and a first measurement quantity, wherein the target model includes an AI model and / or an ML model, and the first measurement quantity is obtained by measuring the target reference signal according to type information of first training data.

15. The method according to claim 7, wherein: The method further comprises: When the data request information includes the type of the first real label, and the type of the first real label is a line-of-sight (LOS) indication or a non-line-of-sight (NLOS) indication, obtaining the LOS indication or the NLOS indication according to the first TOA value and the second TOA value; The first TOA value is based on the location information of the second device and the target reference The location information of the first target device of the signal is obtained.

16. The method according to claim 7, wherein: Generate sample data, including: According to the device identification information of the first target device in the first training data and the device identification information of the second target device in the first label data, and / or, the second timestamp information in the first training data and the third timestamp information in the first label data, the first label data and the first training data are matched to obtain the sample data.

17. The method according to claim 16, wherein: According to the device identification information of the first target device in the first training data and the device identification information of the second target device in the first label data, and / or, the second timestamp information in the first training data and the third timestamp information in the first label data, the first label data and the first training data are matched to obtain the sample data, including at least one of the following: In a case where the positions of a device sending a target reference signal and a device receiving the target reference signal are both fixed, matching the first label data with the first training data according to the device identification information of the first target device and the device identification information of the second target device to obtain the sample data; In a case where the position of at least one of the device sending the target reference signal and the device receiving the target reference signal is not fixed, receiving the updated first label data sent by the third device according to the position information of the third target device corresponding to the second timestamp information, matching the updated first label data with the first training data according to the device identification information of the second target device and the device identification information of the first target device in the updated first label data, and / or, according to the third timestamp information in the updated first label data and the second timestamp information, to obtain the sample data; wherein the position information of the third target device corresponding to the second timestamp information is sent by the third target device to the third device, or the position information of the third target device corresponding to the second timestamp information is determined by the third device according to the second timestamp information and a preset positioning method, and the third target device is a device with a non-fixed position among the device sending the target reference signal and the device receiving the target reference signal; In a case where the location of at least one of the device sending the target reference signal and the device receiving the target reference signal is not fixed, according to the device identification information of the second target device, the second timestamp information, the device identification information of the first target device, and the third timestamp information At least one item of the information is used to match the first label data and the first training data to obtain the sample data.

18. The method according to claim 17, wherein: According to the device identification information of the first target device and the device identification information of the second target device, matching the first label data with the first training data to obtain the sample data includes: When the device identification information of the first target device is consistent with the device identification information of the second target device, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data.

19. The method according to claim 17, wherein: According to the device identification information of the second target device in the updated first label data and the device identification information of the first target device, and / or according to the third timestamp information and the second timestamp information in the updated first label data, matching the first label data and the first training data to obtain the sample data includes: When the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device, and when the third timestamp information in the updated first label data is consistent with the second timestamp information, the first true label in the first label data and the first measurement quantity in the first training data are matched to obtain the sample data.

20. The method according to claim 17, wherein: According to the device identification information of the second target device, the second timestamp information, the device identification information of the first target device, and at least one of the third timestamp information, the first label data and the first training data are matched to obtain the sample data, including at least one of the following: When the device identification information of the second target device is consistent with the device identification information of the first target device, and the time indicated by the second timestamp information is later than the time indicated by the third timestamp, matching the first true label in the first label data and the first measurement in the first training data to obtain the sample data; determining the changed position information of the third target device, sending the changed position information to the third device, receiving the updated first tag data sent by the third device according to the changed position information, and comparing the device identification information of the second target device and the device identification information of the second target device in the updated first tag data with the device identification information of the second target device When the device identification information of the first target device in the first training data is consistent, and the time indicated by the second timestamp information in the first training data is later than or equal to the time indicated by the third timestamp information in the updated first label data, matching the first true label in the first label data and the first measurement in the first training data to obtain the sample data; Determine change position information of a third target device, send the change position information to the third device, receive updated first label data sent by the third device according to the change position information, and when the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and when the time indicated by the third timestamp information in the updated first label data is later than or equal to the time indicated by the second timestamp information in the first training data, and the time indicated by the second timestamp information in the first training data is later than or equal to the time indicated by the third timestamp information in the first label data, match the first true label in the first label data and the first measurement in the first training data to obtain the sample data; Determine the change position information of the third target device, send the change position information to the third device, receive the updated first label data sent by the third device according to the change position information, and when the device identification information of the second target device in the updated first label data is consistent with the device identification information of the first target device in the first training data, and when the time indicated by the third timestamp information in the updated first label data is earlier than the time indicated by the second timestamp information in the first training data, match the first true label in the updated first label data and the first measurement in the first training data to obtain the sample data.

21. A training data collection method, applied to a third device, the method comprising: receiving data request information; According to the data request information, type information of the first training data and / or first label data are sent.

22. The method according to claim 21, wherein: The data request information includes at least one of the following: The type of the first true label; The required quantity of sample data; location-related information of the first device; Type information of first training data; Generalization requirements of sample data; Accuracy requirements for sample data; The requirement information for obtaining configuration of a target reference signal for the first training data is used to determine the configuration of a target reference signal used to obtain the first training data.

23. The method according to claim 21, wherein: The first tag data includes at least one of the following: First true label; Device identification information of the second target device used to send the target reference signal The third timestamp information related to the first real label.

24. The method according to claim 21, wherein: After receiving the data request information, the method further includes: Determining a second device according to the data request information; Among them, the second device is a device for generating sample data, and the sample data is used to train an artificial intelligence AI model or a machine learning ML model.

25. The method according to claim 21, wherein: In a case where the data request information includes the type of the first real label, and the type of the first real label is location information, the first real label in the first label data is obtained by at least one of the following methods: receiving location information sent by a second device; Location information obtained through a pre-set positioning method; The location information of the second device is acquired in advance.

26. The method according to claim 25, wherein: The first true label includes at least one of the following: Location information; fourth timestamp information associated with the location information; Confidence information associated with the location information.

27. The method of claim 21, wherein: When the data request information includes the type of the first real label, and the type of the first real label is a first arrival time TOA value, the first real label in the first label data is obtained based on the location information of the second device and the location information of the first target device; wherein the first target device is a device that sends a target reference signal.

28. The method of claim 21, wherein: The method further comprises: Send updated first label data to the second device according to the position information of the third target device corresponding to the second timestamp information in the first training data; wherein the position information of the third target device corresponding to the second timestamp information is sent by the third target device to the third device, or the position information of the third target device corresponding to the second timestamp information is determined by the third device according to the second timestamp information and a pre-set positioning method; the first training data is measured according to the target reference signal; the third target device is a device with a non-fixed position between the device sending the target reference signal and the device receiving the target reference signal.

29. The method according to claim 21, wherein: The method further comprises: Receive the change location information sent by the third target device Sending updated first tag data according to the changed position information; The third target device is a device whose position is not fixed among the device that sends the target reference signal and the device that receives the target reference signal.

30. A training data collection device, applied to a first device, the device comprising: A first sending module, used for sending data request information; and a first processing module, the first processing module being configured to perform at least one of the following: Get sample data; Obtain artificial intelligence AI model or machine learning ML model; The sample data is obtained according to the first label data and the first training data; the artificial intelligence AI model or the machine learning ML model is trained based on the sample data.

31. A training data collection device, applied to a second device, the device comprising: A first generating module, used for generating sample data; The sample data is obtained according to the acquired first label data and first training data; The sample data is used to train an artificial intelligence (AI) model or a machine learning (ML) model.

32. A training data collection device, applied to a third device, the device comprising: A first receiving module, used for receiving data request information; The second sending module is used to send the type information of the first training data and / or the first label data according to the data request information.

33. A communication device comprising: A processor, a memory, and a program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the steps of the training data collection method as described in any one of claims 1 to 6, or, when executed by the processor, implements the steps of the training data collection method as described in any one of claims 7 to 20, or, when executed by the processor, implements the steps of the training data collection method as described in any one of claims 21 to 29.

34. A readable storage medium having a program stored thereon, wherein when the program is executed by a processor, the program implements the steps in the training data collection method as described in any one of claims 1 to 6, or implements the steps in the training data collection method as described in any one of claims 7 to 20, or implements the steps in the training data collection method as described in any one of claims 21 to 29.

Images