Data collection method and apparatus

Abstract

Provided in the embodiments of the present application are a data collection method and apparatus. The method comprises: a first network device sending first configuration information to a terminal device, wherein the first configuration information instructs the terminal device to perform actions related to data collection, and data includes ground truth label data for artificial intelligence / machine learning (AI / ML) functions and / or features.

Description

Data collection method and apparatus TECHNICAL FIELD

[0001] The present application relates to the field of communication technology. BACKGROUND

[0002] With the commercialization of 5G (the fifth generation of mobile communication technology) and the large-scale development of the industrial Internet industry, the application of artificial intelligence (AI) technology in the field of wireless communication has sprung up, among which AI / ML model management based on machine learning (ML), especially deep learning (DL) or reinforcement learning technology is particularly important in various wireless AI applications.

[0003] In the AI / ML life cycle management (LCM), training is a crucial link, and a model or model-based AI / ML function must be built through training. The most important thing in training is the data collection process.

[0004] Currently, the AI / ML function / model applied in wireless communication is mainly based on the method of supervised learning, and the data needed to be collected includes the following two parts:

[0005] Data corresponding to the model input;

[0006] True value label data corresponding to the model output.

[0007] The training process is to find the internal relationship between the two parts of data, so these two parts of data are indispensable for the training process.

[0008] It should be noted that the above introduction to the technical background is only to facilitate the clear and complete description of the technical solutions of the present application, and to facilitate the understanding of those skilled in the art. The above technical solutions cannot be considered as known to those skilled in the art merely because they are described in the background section of the present application.

[0009] SUMMARY

[0010] The inventors found that for the wireless positioning application of AI / ML in wireless communication, there are two problems as follows:

[0011] 1) High precision ground truth label data is difficult to obtain: compared with other use cases of AI / ML in wireless communication (such as CSI compression, beam management, etc.), the ground truth label data (for example, the position information of the terminal device) required by wireless positioning is difficult to obtain, and even if the above position information can be obtained, the accuracy of the position information is difficult to guarantee;

[0012] 2) Channel measurement data corresponding to model input and ground truth label data corresponding to model output are difficult to pair: unlike other use cases of AI / ML in wireless communication (such as CSI compression, beam management, etc.), the two parts of data for wireless positioning may be obtained from different network elements, so it is necessary to ensure that the two parts of data can be reasonably paired during data collection, otherwise the collected data cannot be used for AI / ML model training.

[0013] To solve at least one of the above problems or other similar problems, embodiments of the present application provide a data collection method and device.

[0014] According to an aspect of an embodiment of the present application, a data collection method is provided, applied to a first network device, and the method comprises:

[0015] The first network device sends first configuration information to a terminal device, the first configuration information instructing the terminal device to perform a data collection related action, and the data comprising ground truth label data for AI / ML functions and / or features.

[0016] According to another aspect of an embodiment of the present application, a data collection method is provided, applied to a terminal device, and the method comprises:

[0017] The terminal device receives first configuration information sent by a first network device, the first configuration information instructing the terminal device to perform a data collection related action, and the data comprising ground truth label data for AI / ML functions and / or features.

[0018] According to still another aspect of an embodiment of the present application, a data collection device is provided, configured in a first network device, and the device comprises:

[0019] A sending unit sends first configuration information to a terminal device, the first configuration information instructing the terminal device to perform a data collection related action, and the data comprising ground truth label data for AI / ML functions and / or features.

[0020] According to still another aspect of an embodiment of the present application, a data collection device is provided, configured in a terminal device, and the device comprises:

[0021] The receiving unit receives first configuration information sent by the first network device, and the first configuration information indicates that the terminal device performs a data collection related action, and the data includes true value label data for an AI / ML function and / or feature.

[0022] One of the beneficial effects of the embodiments of the present application is that, according to the embodiments of the present application, through information sending and receiving between the first network device and the terminal device, effective data collection can be performed under the premise that the true value label data is available, thereby on the one hand, improving the data collection efficiency for AI / ML wireless communication use cases and the AI / ML model performance trained by using the data, and better supporting the AI / ML wireless communication use cases such as wireless positioning; on the other hand, reducing the invalid or inefficient air interface resource overhead for AI / ML data collection, and in particular, saving the uplink air interface resource overhead of the terminal device for reporting data to the network device, so that the air interface resource allocation of the entire communication system is more reasonable and efficient.

[0023] Specific embodiments of the application are disclosed in detail in the following description and claims. Specific embodiments of the application may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and fully convey the scope of the application to those skilled in the art. In the description and claims of the emerging embodiments, each of the words "comprise" "include" and "contain" and variations thereof (e.g., "comprises," "comprising," "includes," "including," and "contain") are not intended to exclude the presence of any additional item component, integer, step, act, process, or the like, nor are they necessarily intended to "consist only of the listed items.

[0024] Features described and / or illustrated with respect to one implementation can be used in one or more other implementations in the same or similar manner, in combination with or in place of features in other implementations.

[0025] It should be emphasized that the term "comprises / comprising" when used in this text is taken to mean the presence of the stated features, integers, steps or components but not the exclusion of one or more additional features, integers, steps, components or groups thereof. BRIEF DESCRIPTION OF DRAWINGS

[0026] Elements and features of the embodiments of the application described in one or more figures or embodiments can be combined with elements and features illustrated in one or more other figures or embodiments. Additionally, in the drawings, like reference numerals indicate corresponding parts throughout the several views, and can be used to indicate corresponding parts in more than one embodiment.

[0027] The accompanying drawings, which are included to provide a further understanding of the embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. It is expressly understood that the drawings are only illustrative of the embodiments of the application and should not be considered as limiting the scope of the application. In the drawings:

[0028] FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present application;

[0029] FIG. 2 is a schematic diagram of a data collection method of an embodiment of the present application;

[0030] FIG. 3 is a schematic diagram of information interaction of a first network device and a terminal device of a data collection method according to an embodiment of the present application;

[0031] FIG. 4 is another schematic diagram of a data collection method of an embodiment of the present application;

[0032] FIG. 5 is a schematic diagram of a data collection apparatus of an embodiment of the present application;

[0033] FIG. 6 is another schematic diagram of a data collection apparatus of an embodiment of the present application;

[0034] FIG. 7 is a schematic diagram of system constitution of a network device of an embodiment of the present application;

[0035] FIG. 8 is a schematic diagram of system constitution of a terminal device of an embodiment of the present application. DETAILED DESCRIPTION

[0036] The foregoing and other features of the present application will become apparent to those of ordinary skill in the art upon reference to the following description and the accompanying drawings. In the description and drawings, particular embodiments of the present application are disclosed in detail. It should be understood that the present application is not limited to the embodiments described but includes all modifications, variations, and equivalents that fall within the scope of the appended claims.

[0037] In the embodiments of the present application, the terms "first", "second", and the like are used to distinguish different elements from each other, but do not indicate spatial arrangement or time sequence of the elements, and the elements should not be limited by these terms. The term "and / or" includes any one and all combinations of the associated listed terms. The terms "comprise", "include", "have", and the like are intended to mean the presence of the stated features, elements, components, or assemblies, but do not exclude the presence or addition of one or more other features, elements, components, or assemblies.

[0038] In the embodiments of the present application, the singular forms "a", "an", and "the" include the plural forms, should be broadly understood as "one" or "one type", and not limited to the meaning of "one"; in addition, the term "said" should be understood as including both the singular form and the plural form, unless the context clearly indicates otherwise. In addition, the term "according to" should be understood as "at least partially according to", and the term "based on" should be understood as "at least partially based on", unless the context clearly indicates otherwise.

[0039] In the embodiments of the present application, the term "communication network" or "wireless communication network" can refer to a network conforming to any communication standard, such as Long Term Evolution (LTE), LTE-Advanced (LTE-A), Wideband Code Division Multiple Access (WCDMA), High-Speed Packet Access (HSPA), and the like.

[0040] The communication between devices in the communication system can be performed according to any phase communication protocol, such as can include, but is not limited to, the following communication protocols: 1G (generation), 2G, 2.5G, 2.75G, 3G, 4G, 4.5G, and future 5G, New Radio (NR), and the like, and / or other currently known or to be developed communication protocols.

[0041] In the embodiments of the present application, the term "network device" refers to, for example, a device that accesses a terminal device to a communication network and provides services for the terminal device in the communication system. The network device can include, but is not limited to, the following devices: a base station (BS), a core network (CN), an operation administration and maintenance device (OAM), an OTT (Over The Top) server device, an access point (AP), a transmission reception point (TRP), a broadcast transmitter, a mobile management entity (MME), a gateway, a server, a radio network controller (RNC), a base station controller (BSC), and the like.

[0042] A base station can include, but is not limited to, a Node B (NodeB or NB), an evolved Node B (eNodeB or eNB), and a 5G base station (gNB), an IAB donor, and the like, and can further include a remote radio head (RRH), a remote radio unit (RRU), a relay, or a low-power node (e.g., a femto, a pico, and the like). Also, the term "base station" can include some or all functions thereof, and each base station can provide communication coverage for a specific geographic area. The term "cell" can refer to a base station and / or its coverage area, depending on the context in which the term is used.

[0043] A core network can include, but is not limited to, an MSC (Mobile Service Center), an SGSN (Serving GPRS Support Node), a GGSN (Gateway GPRS Support Node), an MME (Mobile Management Entity), an SGW (Serving Gateway), a PGW (PDN Gateway), a 5GC (5G Core Network). Also, the term "core network" can include some or all functions thereof.

[0044] In the embodiments of the present application, the term "user equipment" (UE) refers to a device that accesses a communication network through a network device and receives network services, for example, and can also be referred to as "terminal equipment" (TE). The terminal equipment can be fixed or mobile, and can also be referred to as a mobile station (MS), a terminal, a user, a subscriber station (SS), an access terminal (AT), a station, and the like.

[0045] The terminal equipment can include, but is not limited to, the following devices: a cellular phone, a personal digital assistant (PDA), a wireless modem, a wireless communication device, a handheld device, a machine type communication device, a laptop computer, a cordless phone, a smartphone, a smartwatch, a digital camera, and the like.

[0046] For another example, in scenarios such as Internet of Things (IoT), a terminal device can also be a machine or device that performs monitoring or measurement, for example, can include but is not limited to: a machine type communication (MTC) terminal, a vehicle-mounted communication terminal, a device-to-device (D2D) terminal, a machine-to-machine (M2M) terminal, and the like.

[0047] The following describes the scenarios of the embodiments of the present application by way of examples, but the present application is not limited thereto.

[0048] FIG. 1 is a schematic diagram of a communication system according to an embodiment of the present application, which schematically illustrates a case taking a terminal device and a network device as examples. As shown in FIG. 1, the communication system 100 can include a network device 101, terminal devices 102 and 103. For simplicity, FIG. 1 only takes two terminal devices and one network device as examples for illustration, but the embodiments of the present application are not limited thereto.

[0049] In the embodiments of the present application, the network device 101 and the terminal devices 102 and 103 can perform existing services or future implementable services transmission. For example, these services can include but are not limited to: enhanced mobile broadband (eMBB), massive machine type communication (mMTC), and ultra-reliable and low-latency communication (URLLC), etc.

[0050] It is worth noting that FIG. 1 shows that the terminal devices 102 and 103 are within the coverage of the network device 101, but the present application is not limited thereto. The terminal devices 102 and 103 can not be within the coverage of the network device 101.

[0051] In the embodiments of the present application, the network device 101 may be, for example, a gNB, or an entity of a core network (such as a Location Management Function (LMF) or an Access and Mobility Management Function (AMF)), or an entity of a higher layer network (such as an Operation Administration and Maintenance (OAM), or an Over the top server (OTT-server)), or a partial function or entity of any of the above devices.

[0052] The present application is applicable to use cases of deploying AI / ML functions / models in a wireless communication system, which can be deployed in a network device and / or a terminal device, and the use cases include, but are not limited to, wireless positioning.

[0053] The specific implementation of the embodiments of the present application will be described below in conjunction with the accompanying drawings. In the following description, unless otherwise specified, the meanings of "when", "if" and "in the case of" are the same and can be interchanged.

[0054] Embodiments of the first aspect

[0055] The embodiments of the present application provide a data collection method, taking the AI / ML wireless positioning function as an example, which is described from the side of a first network device. The first network device may be, for example, an LMF as a network-side positioning function management network element in 5G NR, and interacts with a terminal device for AI / ML function information, in addition, the first network device can also interact with a second network device for related information, the second network device may be, for example, an AMF as a network-side core network management network element in 5G NR. The present application is not limited thereto, and the first network device and the second network device can also be other network elements, depending on the implementation scenario.

[0056] FIG. 2 is a schematic diagram of a data collection method according to an embodiment of the present application, as shown in FIG. 2, the method comprises:

[0057] 210: The first network device sends first configuration information to the terminal device, the first configuration information indicating that the terminal device performs data collection related actions, and the data includes true value label data for AI / ML functions and / or features.

[0058] In the above embodiments, data collection-related actions include, but are not limited to, at least one of the following: starting data storage, pausing data storage, ending data storage, starting data reporting, pausing data reporting, and ending data reporting, etc.

[0059] It is worth noting that Figure 2 above is only an illustrative description of an embodiment of this application, but this application is not limited thereto. For example, other operations can be added. Those skilled in the art can make appropriate modifications based on the above content, and are not limited to the description in Figure 2 above.

[0060] According to the above embodiments, the terminal device can perform data collection-related actions based on the first configuration information. Thus, effective data collection can be carried out while ensuring the availability of truth label data. This improves the data collection efficiency for AI / ML wireless communication use cases and the performance of AI / ML models trained using the data, better supporting use cases such as wireless positioning for AI / ML wireless communication. On the other hand, it reduces the invalid or inefficient air interface resource overhead for AI / ML data collection, especially saving the uplink air interface resource overhead for the terminal device to report data to the network device, making the air interface resource allocation of the entire communication system more reasonable and efficient.

[0061] In some embodiments, the first configuration information configures at least one of the following to the terminal device:

[0062] Configure the data types for data storage and / or reporting on the terminal device;

[0063] Configure terminal devices to store and / or report auxiliary information related to data;

[0064] Configure events for the terminal device to start and / or pause and / or resume and / or stop data storage and / or reporting;

[0065] Configure the conditions for the terminal device to start and / or pause and / or resume and / or stop data storage and / or reporting.

[0066] For example, in a case that the first network device has already acquired the first data, or a data collection process of the first data has been started, the first network device can configure, through the first configuration information, a data type for which the terminal device is to store / report data; and / or, configure auxiliary information for which the terminal device is to store / report data related information, such as a timestamp corresponding to measurement data, and the like; and / or, configure an event for which the terminal device is to start / pause / resume / stop data storage / reporting, such as a terminal device state related event (e.g., a speed of the terminal device being too large, and the like), a channel environment related event (e.g., a line of sight (LOS) or non-line of sight (NLOS) state change being too large, and the like), a data measurement related event (e.g., a data collection time difference between the first data and the second data being too large, and the like), and the like; and / or, configure a condition for which the terminal device is to start / pause / resume / stop data storage / reporting, and the like.

[0067] In the above embodiments, the first data at least includes true value label data for an AI / ML function and / or feature, i.e., the aforementioned true value label data corresponding to an AI / ML model output, and the like. For different AI / ML wireless communication use cases, the true value label data is different. For example, for a wireless positioning use case, the true value label data can be position information of the terminal device, and the like. The second data at least includes model input data for an AI / ML function and / or feature, e.g., the aforementioned channel measurement data corresponding to an AI / ML model input, and the like. In the following description, the same data has the same meaning and will not be repeatedly described.

[0068] In some embodiments, as shown in FIG. 2, the method further includes:

[0069] 220: The first network device sends first information to the terminal device, the first information indicating related information of the terminal device reporting the first data;

[0070] 230: The first network device receives second information sent by the terminal device, the second information including related information of the terminal device about the first data.

[0071] In the above 220, the network device can indicate, through the first information, that the terminal device reports at least one of the following:

[0072] Whether the terminal device stores the first data and / or the first data currently stored by the terminal device and / or the second data;

[0073] Whether the terminal device has the ability to generate the first data and / or the ability of the terminal device to support generating the first data.

[0074] In the above embodiments, the network device can indicate the terminal device to report the currently stored data through the first information, without distinguishing the first data and the second data, and the terminal device reports the stored data according to the indication, or the network device can also indicate the terminal device to report the currently stored first data and / or second data through the first information, and the terminal device reports the corresponding data according to the indication.

[0075] In the above embodiments, for the AI / ML wireless positioning use case, the first data is, for example, the position information of the terminal device, and for other AI / ML wireless communication use cases, the first data can also be other.

[0076] In the above embodiments, for the AI / ML wireless positioning use case, the terminal device having the capability of generating the first data means, for example, that the terminal device supports a positioning method for generating the high-precision ground truth label data, which includes but is not limited to satellite positioning (GNSS, Global Navigation Satellite System), sensor positioning (SENSOR), Bluetooth positioning (BLUE-TOOTH), WLAN (Wireless Local Area Network) positioning, etc.

[0077] In the above embodiments, for the AI / ML wireless positioning use case, the terminal device having the capability of generating the first data means, for example, that the terminal device has the capability of monitoring the channel LOS / NLOS state and obtaining the channel LOS / NLOS indication information, etc.

[0078] In the above 230, according to the content of the first information, the terminal device can send the second information to the first network device, which corresponds to the first information, and the second information may, for example, include at least one of the following:

[0079] Information of whether the terminal device stores the first data and / or the first data and / or the second data currently stored by the terminal device;

[0080] Information of whether the terminal device has the capability of generating the first data and / or the capability of the terminal device for generating the first data.

[0081] For example, the second information can only contain information about whether the first data is supported, or can contain detailed information, such as the first data and / or the second data stored by the terminal device, the positioning method supported by the terminal device or the capability possessed by the terminal device, etc.

[0082] In the above embodiments, the number of interactions of the first information and the second information is not limited, for example, the first information and the second information can be interacted between the first network device and the terminal device multiple times, and the content of the first information and the second information in each interaction can be the same or different.

[0083] For example, in the first interaction, the first network device indicates the terminal device to report whether it stores high-precision true value label data through the first information, and the terminal device sends the information of whether it stores the high-precision true value label data to the first network device through the second information; in the next interaction, the first network device indicates the terminal device to report the high-precision true value label data stored by the terminal device through the first information, and the terminal device sends the high-precision true value label data stored by the terminal device to the first network device through the second information.

[0084] In some embodiments, the first information and the second information can be sent before the first configuration information, that is, after the terminal device and the first network device complete the interaction of the first information and the second information, the first network device sends the above-mentioned first configuration information to the terminal device.

[0085] In the above embodiments, the first network device can determine the content of the first configuration information according to the content of the first information and the second information.

[0086] In some possible implementations, the second information feeds back the first data currently stored by the terminal device, and the first network device can configure the terminal device with at least one of the following contents through the first configuration information:

[0087] configure the time when the terminal device starts to collect data;

[0088] configure the condition under which the terminal device starts to collect data;

[0089] configure the content and format of the data collected by the terminal device;

[0090] configure the reference signal used by the terminal device to collect data.

[0091] For example, if the first network device considers that the first data can be used for the training of the AI / ML function / model of the first network device, it can configure the terminal device to start data collection immediately through the first configuration information, and / or configure the terminal device to start data collection in a certain area, and / or configure the terminal device to collect data based on channel measurement data, configure the type of channel measurement data collected by the terminal device (such as whether to need measurement of channel phase information), and / or configure the downlink positioning reference signal (PRS, Positioning Reference Signal) of the terminal device.

[0092] In some possible implementation manners, the first network device can perform at least one of the following processes in a case where the second information feeds back that the terminal device currently stores the first data:

[0093] sending, to the terminal device, a condition and / or requirement of the first network device on the first data that can be used for training of an AI / ML function / model of the first network device;

[0094] indicating the terminal device to feed back or start data collection in a case where the condition and / or requirement is met;

[0095] not performing any action.

[0096] For example, if the first network device considers that the first data cannot be used for training of the AI / ML function / model of the first network device, it can send the condition and / or requirement of the first network device on the first data that can be used for training of the AI / ML function / model of the first network device, and indicate the terminal device to feed back or start data collection in a case where the condition / requirement is met, and the like, or the first network device can also not perform any action in a case where it considers that the first data cannot be used for training of the AI / ML function / model of the first network device.

[0097] In some possible implementation manners, in a case where the second information feeds back that the terminal device supports a capability of generating the first data, for example, the terminal device supports a positioning method such as GNSS, SENSOR, BLUE-TOOTH, WLAN positioning, and the like, the first network device can configure or instruct the terminal device through the first configuration information to perform at least one of the following:

[0098] configuring a type of the first data;

[0099] configuring a type of the second data;

[0100] instructing the terminal device to store the second data and the first data in a paired manner and / or identify the pairing.

[0101] In the above implementation manners, in a case where the first configuration information configures the type of the first data for the terminal device, the first configuration information can also instruct the terminal device to store the data of the type acquired through the supported capability of generating the first data.

[0102] For example, the first network device can configure, for the terminal device, a type of ground truth label data (the first data) required in a training process, and instruct the terminal device to store the data of the type acquired through a supported high-precision positioning method (the capability of generating the first data). The capability of generating the first data has been described above and will not be repeated here.

[0103] In the above implementation, in a case where the first configuration information configures the terminal device with the type of the second data, the first configuration information can further indicate the terminal device to perform at least one of the following processes when obtaining the first data by using the supported capability of generating the first data:

[0104] sending the notification information to the first network device to request the first network device to perform the configuration information related to data collection;

[0105] starting the data collection process directly in a case where all the configuration information related to data collection is already available at the terminal side.

[0106] For example, the first network device can configure the terminal device with the type of the model input data (the second data) required in the training process, and instruct the terminal device to perform at least one of the following actions when obtaining the ground truth label data (the first data) by using the supported high-precision positioning method (the capability of generating the first data):

[0107] sending the notification information to the first network device to request the first network device to perform the configuration information related to data collection;

[0108] starting the data collection process directly in a case where all the configuration information related to data collection is already available at the terminal side.

[0109] In the above implementation, in a case where the first configuration information indicates the terminal device to store the second data (for example, the model input data required in the training process) and the first data (for example, the ground truth label data required in the training process) in a paired manner, the first network device can further configure the terminal device, by using the first configuration information, to perform the pairing manner, the time range, the pairing condition (for example, the time difference between the first data and the second data, etc.), etc. of the pairing of the first data and the second data.

[0110] In some possible implementation, in a case where the second information feeds back the capability of generating the first data supported by the terminal device, for example, the terminal device has the capability of performing channel LOS / NLOS state monitoring and obtaining channel LOS / NLOS indication information, the first network device can configure or instruct the terminal device, by using the first configuration information, to perform at least one of the following:

[0111] configuring the data format of the data collection of the second data and / or the first data;

[0112] configuring the reference signal and / or other auxiliary information of the data collection of the second data and / or the first data;

[0113] configuring the starting condition of the data collection and / or the data storage of the second data and / or the first data.

[0114] The above data format is, for example, the storage and / or reporting accuracy of the location information of the terminal device, the sampling interval and / or the sampling number of the channel measurement data in the time domain, etc.

[0115] The above other auxiliary information is, for example, the base station location information, the channel LOS / NLOS state information, etc.

[0116] The above starting condition is, for example, the threshold of the channel LOS / NLOS state, the threshold of the terminal device received power, the threshold of the available TRP number, etc.

[0117] In some embodiments, as shown in FIG. 2, the method further includes:

[0118] 240: The first network device receives third information sent by the terminal device, the third information being used to request the auxiliary configuration information for data collection from the first network device, or the third information being used to request the auxiliary information for improving the capability of the terminal device to generate the first data.

[0119] In the above embodiments, after receiving the first configuration information, the terminal device can perform data collection related actions according to the first configuration information, for example, the above-mentioned starting data storage, suspending data storage, ending data storage, starting data reporting, suspending data reporting, and ending data reporting, etc.

[0120] In some possible implementations, after receiving the first configuration information, the terminal device can also send the above-mentioned third information to the first network device, through which the terminal device requests the auxiliary configuration information for data collection from the first network device, for example, the PRS configuration information preferred by the terminal device, etc.; or through which the terminal device requests the auxiliary information for improving the positioning accuracy of a specific positioning method from the first network device, for example, for the satellite positioning method, the terminal device can request the first network device to send the GNSS reference time information through the third information to improve the positioning accuracy of the satellite positioning method.

[0121] In the above embodiments, as shown in FIG. 2, the method can further include:

[0122] 250: The first network device sends second configuration information to the terminal device, the second configuration information including the auxiliary configuration information for the terminal device to perform data collection, or including the auxiliary information for improving the capability of the terminal device to generate the first data.

[0123] In the above embodiments, in response to the third information, the first network device can select to send the second configuration information to the terminal device, thereby the terminal device can perform data collection related actions according to the second configuration information, or continue to perform information interaction with the first network device before data collection, for example, the interaction of the first information and the second information in the operations 220 and 230, and / or the interaction of the third information and the second configuration information in the operations 240 and 250, and the like.

[0124] FIG. 3 is a schematic diagram of information interaction of a data collection method according to an embodiment of the present application. As shown in FIG. 3, the information interaction process includes:

[0125] 310: The first network device sends first information to the terminal device;

[0126] 320: The terminal device sends second information to the first network device;

[0127] 330: The first network device sends first configuration information to the terminal device;

[0128] 340: The terminal device sends third information to the first network device;

[0129] 350: The first network device sends second configuration information to the terminal device;

[0130] 360: The terminal device performs data collection related actions.

[0131] In the above embodiments, the operations 310 and 320 correspond to the operations 220 and 230 of the embodiment shown in FIG. 2 respectively, the operation 330 corresponds to the operation 210 of the embodiment shown in FIG. 2, and the operations 340 and 350 correspond to the operations 240 and 250 of the embodiment shown in FIG. 2 respectively. Since the operations 210-250 have been described in detail in the embodiment shown in FIG. 2, no further description is given here.

[0132] The above embodiments are only exemplary descriptions of the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications can be made on the basis of the above embodiments. For example, the above embodiments can be used alone, or one or more of the above embodiments can be combined.

[0133] According to the embodiments of the present application, through the information interaction between the first network device and the terminal device, effective data collection can be performed under the premise of ensuring the availability of the true value label data, thereby on the one hand, improving the data collection efficiency for AI / ML wireless communication use cases and the performance of the AI / ML model trained by using the data, and better supporting the AI / ML wireless communication use cases such as wireless positioning; on the other hand, reducing the invalid or inefficient air interface resource overhead for AI / ML data collection, especially saving the uplink air interface resource overhead of the terminal device for reporting data to the network device, so that the air interface resource allocation of the whole communication system is more reasonable and efficient.

[0134] Embodiments of the second aspect

[0135] The embodiments of the present application provide a data collection method, which is described from the side of the terminal device. The same content as the embodiments of the first aspect is not repeated.

[0136] FIG. 4 is a schematic diagram of a data collection method according to an embodiment of the present application. As shown in FIG. 4, the method comprises:

[0137] 410: The terminal device receives the first configuration information sent by the first network device, and the first configuration information indicates that the terminal device performs a data collection related action, and the data includes true value label data for AI / ML functions and / or features;

[0138] 420: The terminal device performs a data collection related action according to the first configuration information.

[0139] It is worth noting that the above FIG. 4 only schematically illustrates the embodiments of the present application, but the present application is not limited thereto. For example, the execution order between the operations can be appropriately adjusted, and in addition, some operations can be added or some operations can be reduced. Those skilled in the art can make appropriate modifications according to the above content, and the present application is not limited to the above FIG. 4.

[0140] According to the above embodiments, through the information interaction between the first network device and the terminal device, effective data collection can be performed under the premise of ensuring the availability of the true value label data, thereby on the one hand, improving the data collection efficiency for AI / ML wireless communication use cases and the performance of the AI / ML model trained by using the data, and better supporting the AI / ML wireless communication use cases such as wireless positioning; on the other hand, reducing the invalid or inefficient air interface resource overhead for AI / ML data collection, especially saving the uplink air interface resource overhead of the terminal device for reporting data to the network device, so that the air interface resource allocation of the whole communication system is more reasonable and efficient.

[0141] In operation 410, the terminal device can receive the first configuration information sent by the first network device (see operation 330 shown in FIG. 3). The related content of the first configuration information has been described in the embodiments of the first aspect, and will not be repeated here.

[0142] In operation 420, the terminal device can perform a data collection related action (see operation 360 shown in FIG. 3). The data collection related action has been described in the embodiments of the first aspect, and will not be repeated here.

[0143] In some embodiments, as shown in FIG. 3, the terminal device can also receive the first information sent by the first network device (see operation 310 shown in FIG. 3), and send the second information to the first network device (see operation 320 shown in FIG. 3). The related content of the first information and the second information has been described in the embodiments of the first aspect, and will not be repeated here.

[0144] In some embodiments, as shown in FIG. 3, the terminal device can also send the third information to the first network device (see operation 340 shown in FIG. 3), and optionally, the terminal device can also receive the second configuration information sent by the first network device (see operation 350 shown in FIG. 3). The related content of the third information and the second configuration information has been described in the embodiments of the first aspect, and will not be repeated here.

[0145] The above various embodiments only exemplarily illustrate the embodiments of the present application, but the present application is not limited thereto, and can be appropriately modified on the basis of the above various embodiments. For example, the above various embodiments can be used alone, or one or more of the above various embodiments can be combined.

[0146] According to the embodiments of the present application, through the information interaction between the first network device and the terminal device, effective data collection can be performed under the premise of guaranteeing the availability of the true value label data, thereby on the one hand, improving the data collection efficiency for AI / ML wireless communication use cases and the performance of the AI / ML model trained by using the data, and better supporting the AI / ML wireless communication use cases such as wireless positioning; on the other hand, reducing the invalid or inefficient air interface resource overhead for AI / ML data collection, especially saving the uplink air interface resource overhead of the terminal device reporting data to the network device, so that the air interface resource allocation of the whole communication system is more reasonable and efficient.

[0147] Embodiments of the third aspect

[0148] The embodiment of the present application provides a data collection device, which can be a network device or a component or assembly of the network device. The network device is the first network device of the first aspect, and the implementation can refer to the first aspect. The same content is not repeated.

[0149] Fig. 5 is a schematic diagram of the data collection device of the embodiment of the present application. As shown in Fig. 5, the device 500 includes:

[0150] The sending unit 510 sends the first configuration information to the terminal device, and the first configuration information indicates that the terminal device performs a data collection related action, and the data includes true value label data for AI / ML functions and / or features.

[0151] In some embodiments, the data collection related action includes at least one of the following: starting data storage, pausing data storage, ending data storage, starting data reporting, pausing data reporting, and ending data reporting.

[0152] In some embodiments, the first configuration information configures the terminal device with at least one of the following:

[0153] Configuring the terminal device to store and / or report data types;

[0154] Configuring the terminal device to store and / or report auxiliary information related to data;

[0155] Configuring the terminal device to start and / or pause and / or resume and / or stop data storage and / or reporting events;

[0156] Configuring the terminal device to start and / or pause and / or resume and / or stop data storage and / or reporting conditions.

[0157] In the above embodiments, the event includes at least one of the following:

[0158] Terminal device state related events;

[0159] Channel environment related events;

[0160] Data measurement related events.

[0161] In the above embodiments, the network device has obtained the first data, or the data collection process of the first data has started; wherein the first data includes at least true value label data for AI / ML functions and / or features. That is, the network device configures the terminal device with at least one of the above contents through the first configuration information when the first data has been obtained or the data collection process of the first data has started.

[0162] In some embodiments, the sending unit 510 sends, to the terminal device, first information indicating related information of the terminal device reporting the first data.

[0163] In the above embodiments, as shown in FIG. 5, the apparatus 500 further includes:

[0164] The receiving unit 520 receives second information sent by the terminal device, and the second information includes related information of the terminal device about the first data; the first data at least includes true value label data for AI / ML functions and / or features.

[0165] In the above embodiments, the first information indicates that the terminal device reports at least one of the following:

[0166] whether the terminal device stores the first data and / or the first data and / or the second data currently stored by the terminal device;

[0167] whether the terminal device has the ability to generate the first data and / or the ability of the terminal device to support the generation of the first data.

[0168] In the above embodiments, the second information includes at least one of the following:

[0169] information of whether the terminal device stores the first data and / or the first data and / or the second data currently stored by the terminal device;

[0170] information of whether the terminal device has the ability to generate the first data and / or the ability of the terminal device to support the generation of the first data.

[0171] In the above embodiments, the ability of the terminal device to generate the first data means that the terminal device supports a positioning method for generating the first data, which includes but is not limited to GNSS, SENSOR, BLUE-TOOTH, WLAN positioning, etc.; the ability of the terminal device to generate the first data can also mean that the terminal device has the ability to perform channel LOS / NLOS state monitoring and obtain channel LOS / NLOS indication information.

[0172] In the above embodiments, in the case where the second information feeds back the first data currently stored by the terminal device, the first configuration information can configure the terminal device with at least one of the following:

[0173] a time for the terminal device to start collecting data;

[0174] a condition for the terminal device to start collecting data;

[0175] content and format of the data collected by the terminal device;

[0176] A reference signal is configured for a terminal device to collect data.

[0177] For example, in a case where the network device considers that the first data can be used for training of an AI / ML function / model of the first network device, at least one of the above configurations is performed.

[0178] In the above embodiments, in a case where the second information feeds back the first data currently stored by the terminal device, the first network device can perform at least one of the following processes:

[0179] The first network device sends, to the terminal device, a condition and / or requirement for the first data that can be used for training of an AI / ML function / model of the first network device;

[0180] The terminal device is instructed to feed back or start data collection in a case where the condition and / or requirement is met;

[0181] No action is taken.

[0182] For example, in a case where the network device considers that the first data cannot be used for training of an AI / ML function / model of the first network device, at least one of the above processes is performed.

[0183] In the above embodiments, in a case where the second information feeds back a capability supported by the terminal device for generating the first data, the first configuration information can configure or instruct the terminal device on at least one of the following:

[0184] The type of the first data is configured;

[0185] The type of the second data is configured, the second data at least including model input data for an AI / ML function and / or feature;

[0186] The terminal device is instructed to store the second data and the first data in pairs and / or identify the pairs.

[0187] In the above embodiments, in a case where the first configuration information configures the type of the first data, the first configuration information can further instruct the terminal device to store the type of data obtained through the supported capability for generating the first data.

[0188] In the above embodiments, in a case where the first configuration information configures the type of the second data, the first configuration information can further instruct the terminal device to perform at least one of the following processes when obtaining the first data through the supported capability for generating the first data:

[0189] The terminal device sends notification information to the first network device to request configuration information related to data collection by the first network device;

[0190] The data collection process is directly started in the case that the terminal side has all the configuration information related to data collection.

[0191] In the above embodiment, in the case that the second information feedbacks the capability of the terminal device to generate the first data, the first configuration information can configure or instruct the terminal device at least one of the following:

[0192] configure the data format of the data collection of the second data and / or the first data, the second data at least including model input data for AI / ML functions and / or features;

[0193] configure the reference signal and / or other auxiliary information of the data collection of the second data and / or the first data;

[0194] configure the starting condition of the data collection and / or data storage of the second data and / or the first data.

[0195] In the above embodiment, the receiving unit 520 can further receive third information sent by the terminal device, the third information being used to request auxiliary configuration information for data collection from the network device, or the third information being used to request auxiliary information for improving the capability of the terminal device to generate the first data.

[0196] In the above embodiment, the sending unit 510 can further send second configuration information to the terminal device, the second configuration information including auxiliary configuration information for the terminal device to perform data collection, or including auxiliary information for improving the capability of the terminal device to generate the first data.

[0197] Embodiments of the present application further provide a data collection apparatus, which can be a terminal device or some component or assembly configured in the terminal device. Since the function of the apparatus to solve the problem is the same as that of the method of the embodiments of the second aspect, the specific implementation can refer to the embodiments of the second aspect, and the same content will not be repeated.

[0198] FIG. 6 is a schematic diagram of a data collection apparatus according to an embodiment of the present application. As shown in FIG. 6, the apparatus 600 includes:

[0199] a receiving unit 610, which receives first configuration information sent by a first network device, the first configuration information instructing the terminal device to perform data collection related actions, the data including true value label data for AI / ML functions and / or features;

[0200] a processing unit 620, which performs data collection related actions according to the first configuration information.

[0201] In some embodiments, the data collection related action comprises at least one of the following: starting data storage, pausing data storage, ending data storage, starting data reporting, pausing data reporting, and ending data reporting.

[0202] In some embodiments, the first configuration information configures the terminal device with at least one of the following:

[0203] a data type for which the terminal device is configured to store and / or report data;

[0204] auxiliary information for which the terminal device is configured to store and / or report data related information;

[0205] an event for which the terminal device is configured to start and / or pause and / or resume and / or stop data storage and / or reporting;

[0206] a condition for which the terminal device is configured to start and / or pause and / or resume and / or stop data storage and / or reporting.

[0207] In the above embodiments, the event comprises at least one of the following:

[0208] a terminal device state related event;

[0209] a channel environment related event;

[0210] a data measurement related event.

[0211] In the above embodiments, the first network device has obtained the first data or a data collection process of the first data has started; wherein the first data comprises at least true value label data for AI / ML functions and / or features.

[0212] In some embodiments, the receiving unit 610 further receives first information sent by the first network device, the first information indicating related information of the terminal device reporting the first data.

[0213] In the above embodiments, as shown in FIG. 6, the apparatus 600 further comprises:

[0214] a sending unit 630, configured to send second information to the first network device, the second information comprising related information of the terminal device about the first data; wherein the first data comprises at least true value label data for AI / ML functions and / or features.

[0215] In the above embodiments, the first information may, for example, indicate that the terminal device reports at least one of the following:

[0216] whether the terminal device stores the first data and / or the first data and / or the second data currently stored by the terminal device;

[0217] whether the terminal device has the capability of generating the first data and / or the capability of generating the first data supported by the terminal device.

[0218] In the above embodiments, the terminal device having the capability of generating the first data means that the terminal device supports a positioning method of generating the first data, which includes but is not limited to GNSS, SENSOR, BLUE-TOOTH, WLAN positioning, etc.; the terminal device having the capability of generating the first data can also mean that the terminal device has the capability of performing channel LOS / NLOS state monitoring and obtaining channel LOS / NLOS indication information, etc.

[0219] In the above embodiments, the second information may, for example, include at least one of the following:

[0220] whether the terminal device stores the first data and / or the first data and / or the second data currently stored by the terminal device;

[0221] whether the terminal device has the capability of generating the first data and / or the capability of generating the first data supported by the terminal device.

[0222] In the above embodiments, in the case where the second information feeds back the first data currently stored by the terminal device, the first configuration information may, for example, configure the terminal device with at least one of the following:

[0223] configure a time at which the terminal device starts to perform data collection;

[0224] configure a condition under which the terminal device starts to perform data collection;

[0225] configure content and format of data collection performed by the terminal device;

[0226] configure a reference signal used by the terminal device to perform data collection.

[0227] In the above embodiments, in the case where the second information feeds back the first data currently stored by the terminal device, the terminal device may, for example, perform at least one of the following:

[0228] receive a condition and / or requirement sent by the first network device for the first data that can be used for training of an AI / ML function / model of the first network device;

[0229] receive information sent by the first network device, which indicates that the terminal device feeds back or starts data collection under the condition of meeting the condition and / or requirement.

[0230] In the above embodiments, in the case where the second information feeds back the capability of generating the first data supported by the terminal device, for example, the terminal device supports the aforementioned positioning method, the first configuration information may, for example, configure or indicate the terminal device with at least one of the following:

[0231] configure a type of the first data;

[0232] configure a type of the second data, the second data comprising at least model input data for an AI / ML function and / or feature;

[0233] indicate the terminal device to store the second data and the first data in pairs and / or identify the pairs.

[0234] In the above embodiments, in a case where the first configuration information configures the type of the first data, the first configuration information can further indicate the terminal device to store the data of the type acquired through the supported capability of generating the first data.

[0235] In the above embodiments, in a case where the first configuration information configures the type of the second data, the first configuration information can further indicate the terminal device to perform at least one of the following processes when acquiring the first data through the supported capability of generating the first data:

[0236] send notification information to the first network device to request the first network device to perform data collection related configuration information;

[0237] start the data collection process directly in a case where the terminal side already has all the data collection related configuration information.

[0238] In the above embodiments, in a case where the second information feeds back the capability of generating the first data supported by the terminal device, for example, the terminal device has the capability of performing channel LOS / NLOS state monitoring and acquiring channel LOS / NLOS indication information, the first configuration information can configure or indicate the terminal device with at least one of the following:

[0239] configure a data format of data collection of the second data and / or the first data, the second data comprising at least model input data for an AI / ML function and / or feature;

[0240] configure a reference signal and / or other auxiliary information of data collection of the second data and / or the first data;

[0241] configure a starting condition of data collection and / or data storage of the second data and / or the first data.

[0242] In some embodiments, the sending unit 630 sends third information to the first network device, the third information being used to request the first network device for auxiliary configuration information for data collection, or the third information being used to request auxiliary information for improving the capability of generating the first data supported by the terminal device.

[0243] In the above embodiments, the receiving unit 610 can further receive second configuration information sent by the first network device, the second configuration information comprising auxiliary configuration information for the terminal device to collect data, or comprising auxiliary information for improving the capability of the terminal device to generate first data.

[0244] It is worth noting that the above Figs. 5 to 6 only schematically illustrate the embodiments of the present application, but the present application is not limited thereto. For example, other modules or components can be appropriately added or some of the modules or components can be appropriately reduced. Those skilled in the art can make appropriate modifications based on the above description, and the modifications are not limited to the description of the above Figs. 5 and 6.

[0245] In addition, for simplicity, only the connection relationship or signal path between the various components or modules is exemplarily shown in Figs. 5 to 6, but those skilled in the art should understand that various related technologies such as bus connection can be used. The various components or modules can be implemented by hardware facilities such as processors, memories, transmitters, receivers, etc.; the embodiments of the present application are not limited thereto.

[0246] The above embodiments only exemplarily illustrate the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications can be made on the basis of the above embodiments. For example, the above embodiments can be used alone, or one or more of the above embodiments can be combined.

[0247] According to the embodiments of the present application, through the information interaction between the first network device and the terminal device, effective data collection can be performed under the premise of ensuring the availability of the truth label data, thereby on the one hand improving the data collection efficiency for AI / ML wireless communication use cases and the performance of the AI / ML model trained by using the data, and better supporting the AI / ML wireless communication use cases such as wireless positioning; on the other hand, the invalid or inefficient air interface resource overhead for AI / ML data collection is reduced, especially the uplink air interface resource overhead of the terminal device reporting data to the network device is saved, so that the air interface resource allocation of the whole communication system is more reasonable and efficient.

[0248] Embodiments of the fourth aspect

[0249] The embodiments of the present application provide a communication system, which can be referred to Fig. 1, and the same content as the embodiments of the first aspect to the third aspect will not be described herein.

[0250] In some embodiments, the communication system 100 can at least include the network device 101 and the terminal device 102, 103, in some embodiments, the network device 101 performs the function of the first network device in the embodiments of the first aspect, and the terminal device 102, 103 performs the function of the terminal device in the embodiments of the second aspect. Since the functions of the first network device and the terminal device have been described in the embodiments of the first aspect to the second aspect, the contents are incorporated herein, and will not be described here.

[0251] The embodiments of the present application further provide a network device.

[0252] Fig. 7 is a schematic block diagram of a system structure of the network device according to the embodiments of the present application. As shown in Fig. 7, the network device 700 can include a processor 710 and a memory 720; the memory 720 is coupled to the processor 710. The memory 720 can store various data; in addition, it also stores a program 730 for information processing, and executes the program 730 under the control of the processor 710.

[0253] In one embodiment, the network device 700 as the first network device in the embodiments of the first aspect contains the function of the apparatus 500 in the embodiments of the third aspect, which can be integrated into the processor 710, or can be configured separately from the processor 710, for example, the apparatus 500 can be configured as a chip connected with the processor 710, and the function of the apparatus is realized through the control of the processor 710.

[0254] In addition, as shown in Fig. 7, the network device 700 can further include a transceiver 740, an antenna 750 and the like; the functions of the above components are similar to those of the prior art, and will not be described here. It is worth noting that the network device 700 does not necessarily include all the components shown in Fig. 7; in addition, the network device 700 can also include components not shown in Fig. 7, which can be referred to the prior art.

[0255] The embodiments of the present application further provide a terminal device.

[0256] Fig. 8 is a schematic block diagram of a system structure of the terminal device according to the embodiments of the present application. As shown in Fig. 8, the terminal device 800 can include a processor 810 and a memory 820; the memory 820 is coupled to the processor 810. It is worth noting that the figure is exemplary; other types of structures can also be used to supplement or replace the structure to realize the telecommunication function or other functions.

[0257] In one embodiment, the terminal device 800 as the terminal device in the embodiment of the second aspect comprises the functions of the apparatus 600 in the embodiment of the third aspect, which can be integrated into the processor 810 or configured separately from the processor 810, for example, the apparatus 600 can be configured as a chip connected with the processor 810 to realize the functions of the apparatus through the control of the processor 810.

[0258] As shown in FIG. 8, the terminal device 800 can further comprise a communication module 830, an input unit 840, a display 850, and a power supply 860. It is worth noting that the terminal device 800 does not necessarily comprise all the components shown in FIG. 8; in addition, the terminal device 800 can further comprise components not shown in FIG. 8, which can be referred to related art.

[0259] As shown in FIG. 8, the processor 810, also known as a controller or operation control, can comprise a microprocessor or other processor device and / or logic device, which receives input and controls the operation of various components of the terminal device 800.

[0260] The memory 820, for example, can be one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. Various data can be stored, and programs for performing related information can also be stored. The processor 810 can execute the programs stored in the memory 820 to achieve information storage or processing, etc. The functions of other components are similar to the existing ones, which will not be described here. The components of the terminal device 800 can be realized by dedicated hardware, firmware, software, or a combination thereof, without departing from the scope of the present application.

[0261] The embodiments of the present application further provide a computer readable program, which, when executed in a network device, causes a computer to execute the method of the embodiments of the first aspect in the network device.

[0262] The embodiments of the present application further provide a storage medium storing a computer readable program, which causes a computer to execute the method of the embodiments of the first aspect in the network device.

[0263] The embodiments of the present application further provide a computer readable program, which, when executed in a terminal device, causes a computer to execute the method of the embodiments of the second aspect in the terminal device.

[0264] The embodiments of the present application further provide a storage medium storing a computer readable program, which causes a computer to execute the method of the embodiments of the second aspect in the terminal device.

[0265] The embodiments of the present application further provide a computer program product comprising a computer program, wherein the computer program is executed by a processor to implement the method described in the embodiments of the first aspect or the second aspect.

[0266] The apparatus and method described above can be implemented by hardware, or by hardware in combination with software. The present application relates to a computer readable program, which, when executed by a logic component, enables the logic component to implement the apparatus or constituent components described above, or to implement the various methods or steps described above. The logic component is, for example, a field programmable logic component, a microprocessor, a processor used in a computer, or the like. The present application also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, or the like.

[0267] The method / apparatus described in combination with the embodiments of the present application can be directly embodied as hardware, a software module executed by a processor, or a combination of the two. For example, one or more of the functional block diagrams shown in the figures and / or a combination of one or more of the functional block diagrams can correspond to each software module of a computer program flow, or to each hardware module. The software modules can correspond to each step shown in the figures, respectively. These hardware modules can be implemented by, for example, fixing the software modules using a field programmable gate array (FPGA).

[0268] The software modules can be located in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a mobile disk, a CD-ROM, or any other form of storage medium known in the art. A storage medium can be coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium can be an integral part of the processor. The processor and the storage medium can be located in an ASIC. The software modules can be stored in the memory of the mobile terminal, or in a memory card that can be inserted into the mobile terminal. For example, if the device (such as a mobile terminal) uses a MEGA-SIM card or a large-capacity flash memory device, the software modules can be stored in the MEGA-SIM card or the large-capacity flash memory device.

[0269] One or more of the functional blocks described in the figures and / or one or more combinations of the functional blocks can be implemented as a general- purpose processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any appropriate combination of the foregoing, designed to perform the functions described herein for the functional blocks. One or more of the functional blocks described in the figures and / or one or more combinations of the functional blocks can also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.

[0270] The application has been described in relation to particular embodiments, but those skilled in the art will understand that the description is illustrative only and is not intended to limit the scope of the application. Various modifications and changes can be made by those skilled in the art to the particular embodiments without departing from the scope of the application as described in the claims.

[0271] In addition to the above embodiments disclosed in the present embodiment, the following notes are also disclosed:

[0272] 1. A network device comprising a memory and a processor, the memory storing a computer program, the processor configured to execute the computer program to implement a method comprising:

[0273] sending first configuration information to a terminal device, the first configuration information indicating the terminal device to perform a data collection related action, the data comprising ground truth label data for an AI / ML function and / or feature.

[0274] 2. A terminal device comprising a memory and a processor, the memory storing a computer program, the processor configured to execute the computer program to implement a method comprising:

[0275] receiving first configuration information sent by a first network device, the first configuration information indicating the terminal device to perform a data collection related action, the data comprising ground truth label data for an AI / ML function and / or feature.

[0276] 3. A computer readable program which, when executed in a network device, causes the computer to perform the method described below in a network device:

[0277] sending first configuration information to a terminal device, the first configuration information indicating the terminal device to perform a data collection related action, the data comprising ground truth label data for an AI / ML function and / or feature.

[0278] 4. A storage medium storing a computer readable program, wherein the computer readable program causes a computer to execute the method described below in a network device:

[0279] transmitting, to a terminal device, first configuration information indicating the terminal device to perform a data collection related action, the data comprising ground truth label data for an AI / ML function and / or feature.

[0280] 5. A computer readable program, wherein the program causes a computer to execute the method described below in a terminal device when the program is executed in the terminal device:

[0281] receiving, from a first network device, first configuration information indicating the terminal device to perform a data collection related action, the data comprising ground truth label data for an AI / ML function and / or feature.

[0282] 6. A storage medium storing a computer readable program, wherein the computer readable program causes a computer to execute the method described below in a terminal device:

[0283] receiving, from a first network device, first configuration information indicating the terminal device to perform a data collection related action, the data comprising ground truth label data for an AI / ML function and / or feature.

[0284] 7. A computer program product comprising a computer program, wherein the computer program, when executed by a processor, implements the method described below:

[0285] transmitting, to a terminal device, first configuration information indicating the terminal device to perform a data collection related action, the data comprising ground truth label data for an AI / ML function and / or feature; or,

[0286] receiving, from a first network device, first configuration information indicating the terminal device to perform a data collection related action, the data comprising ground truth label data for an AI / ML function and / or feature.

Claims

1. A data collection apparatus configured to a first network device, wherein, The apparatus comprises: a sending unit configured to send first configuration information to a terminal device, the first configuration information instructing the terminal device to perform a data collection related action, the data comprising ground truth label data for artificial intelligence / machine learning (AI / ML) functions and / or features.

2. The apparatus of claim 1, wherein, the data collection related action comprises at least one of starting data storage, pausing data storage, ending data storage, starting data reporting, pausing data reporting, and ending data reporting.

3. The apparatus of claim 1, wherein, the first configuration information configures the terminal device to perform at least one of the following: configuring the terminal device to perform data storage and / or reporting of data types; configuring the terminal device to perform data related information storage and / or reporting of auxiliary information; configuring the terminal device to start and / or pause and / or resume and / or stop data storage and / or reporting of events; configuring the terminal device to start and / or pause and / or resume and / or stop data storage and / or reporting of conditions.

4. The apparatus of claim 1, wherein, the apparatus further comprises a receiving unit; the sending unit sends first information to the terminal device, the first information instructing the terminal device to report information related to first data; the receiving unit receives second information sent by the terminal device, the second information comprising information related to the first data by the terminal device; wherein the first data comprises at least ground truth label data for AI / ML functions and / or features.

5. The apparatus of claim 4, wherein, the first information instructs the terminal device to report at least one of the following: whether the terminal device stores the first data and / or the first data and / or second data currently stored by the terminal device; whether the terminal device has the ability to generate the first data and / or the ability supported by the terminal device to generate the first data.

6. The apparatus of claim 4, wherein, the second information comprises at least one of the following: information on whether the terminal device stores the first data and / or the first data and / or second data currently stored by the terminal device, the second data comprising at least model input data for AI / ML functions and / or features; information on whether the terminal device has the ability to generate the first data and / or the ability supported by the terminal device to generate the first data.

7. The apparatus of claim 6, wherein, in a case where the second information feeds back the first data currently stored by the terminal device, the first configuration information configures the terminal device to perform at least one of the following: configuring the terminal device to start data collection at a time; configuring the terminal device to start data collection under a condition; configuring the terminal device to perform data collection in terms of content and format; configuring the terminal device to perform data collection with reference to a reference signal.

8. The apparatus of claim 6, wherein, In a case where the second information feeds back the first data currently stored by the terminal device, the sending unit sends, to the terminal device, conditions and / or requirements for qualified first data of the first network device, to instruct the terminal device to feed back or start data collection in a case where the conditions and / or requirements are met; or the sending unit does not take any action.

9. The apparatus of claim 6, wherein, In a case where the second information feeds back the capability of the terminal device to generate the first data, the first configuration information at least one of configures or instructs the terminal device as follows: configuring a type of the first data; configuring a type of the second data; and instructing the terminal device to store the second data and the first data in a paired manner.

10. The apparatus of claim 9, wherein, in a case where the first configuration information configures the type of the first data, the first configuration information further instructs the terminal device to store the type of data acquired by the capability of generating the first data.

11. The apparatus of claim 9, wherein, in a case where the first configuration information configures the type of the second data, the first configuration information further instructs the terminal device to at least one of perform the following processing when acquiring the first data by the capability of generating the first data: sending, to the first network device, notification information to request the first network device to perform data collection related configuration information; and starting a data collection process directly in a case where the terminal side has all data collection related configuration information.

12. The apparatus of claim 6, wherein, in a case where the second information feeds back the capability of the terminal device to generate the first data, the first configuration information at least one of configures or instructs the terminal device as follows: configuring a data format of data collection of the second data and / or the first data; configuring a reference signal and / or other auxiliary information of data collection of the second data and / or the first data; configuring a starting condition of data collection and / or data storage of the second data and / or the first data.

13. The apparatus of claim 1, wherein, The apparatus further comprises: a receiving unit configured to receive third information sent by the terminal device, the third information being used to request auxiliary configuration information for data collection from the first network device, or the third information being used to request auxiliary information for improving the capability of the terminal device to generate the first data.

14. A data collection apparatus configured in a terminal device, wherein, The apparatus comprises: a receiving unit configured to receive first configuration information sent by the first network device, the first configuration information instructing the terminal device to perform data collection related actions, the data including true value label data for AI / ML functions and / or features; a processing unit configured to perform data collection related actions according to the first configuration information.

15. The apparatus of claim 14, wherein, the apparatus further comprises a sending unit; the receiving unit receives first information sent by the first network device, the first information indicating related information of the terminal device reporting first data. The sending unit sends second information to the first network device, and the second information includes relevant information of the terminal device about the first data. The first data at least includes true value label data for AI / ML functions and / or features.

16. The apparatus of claim 15, wherein, The first information indicates that the terminal device reports at least one of the following: Whether the terminal device stores the first data and / or the first data and / or second data currently stored by the terminal device, and the second data at least includes model input data for AI / ML functions and / or features; Whether the terminal device has the ability to generate the first data and / or the ability supported by the terminal device to generate the first data. The second information includes at least one of the following:

17. The apparatus of claim 15, wherein, Whether the terminal device stores the first data and / or the first data and / or second data currently stored by the terminal device, and the second data at least includes model input data for AI / ML functions and / or features; Whether the terminal device has the ability to generate the first data and / or the ability supported by the terminal device to generate the first data. The apparatus further includes:

18. The apparatus of claim 14, wherein, The sending unit sends third information to the first network device, and the third information is used to request auxiliary configuration information for data collection from the first network device, or the third information is used to request auxiliary information for improving the ability supported by the terminal device to generate the first data.

19. The apparatus of claim 14, wherein, The receiving unit receives second configuration information sent by the first network device, and the second configuration information includes auxiliary configuration information for data collection of the terminal device, or includes auxiliary information for improving the ability supported by the terminal device to generate the first data.

20. A communication system including a first network device and a terminal device, wherein, The first network device includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to implement the following method: Send first configuration information to the terminal device, and the first configuration information indicates that the terminal device performs data collection related actions, and the data includes true value label data for AI / ML functions and / or features; The terminal device includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to implement the following method: Receive the first configuration information sent by the first network device; Perform data collection related actions according to the first configuration information. ​

Images