Qoe measurement method, apparatus, terminal and network-side device
Patent Information
- Application Number
- CN202510464438.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-14
- Publication Date
- 2026-10-20
AI Technical Summary
[0004]本申请实施例提供一种QoE测量方法、装置、终端及网络侧设备,能够解决相关QoE流程无法满足用户体验质量差的问题发现、原因分析或优化的问题
[0057]在本申请实施例中,终端通过网络侧设备配置的用于终端的QoE测量的第一信息,增强了QoE测量流程的灵活性;其中,扩展了QoE测量所支持的服务类型,或者扩展了各个服务类型下的子类型,或者扩展了QoE测量对应的QoE类型,或者扩展了QoE测量的QoE报告对应的上报类型,从而通过更灵活或者精细的QoE测量收集可以更准确的分析QoE问题,能够解决相关QoE采集流程无法满足新一代网络的性能需求的问题。
Smart Images

Figure HDA0005358098550000011 
Figure HDA0005358098550000012 
Figure HDA0005358098550000013
Abstract
Description
Technical Field
[0001] This application belongs to the field of communication technology, specifically relating to a QoE measurement method, apparatus, terminal, and network-side equipment. Background Technology
[0002] The main performance indicators of relevant mobile communication systems include peak data rate, latency, and reliability. Next-generation networks (such as 6G) should consider improved user experience quality in addition to these. Ideally, without considering emerging applications with higher performance requirements, the improved performance of next-generation networks (such as 6G) would reduce the probability of performance falling below the sensitivity threshold for user experience quality. However, considering practical factors such as frequency bands, coverage, network load, and environmental conditions (e.g., subways, elevators, high-speed rail, tunnels, underground parking lots, coastal areas), the probability of poor user experience quality is often not significantly reduced. Therefore, achieving better user experience quality requires data collection from actual commercial networks to identify problems, analyze causes, and optimize performance.
[0003] However, the relevant Quality of Experience (QoE) measurement process lacks flexibility and cannot meet the needs of identifying, analyzing the causes of, or optimizing poor user experience quality in next-generation networks. Summary of the Invention
[0004] This application provides a QoE measurement method, apparatus, terminal, and network-side device, which can solve the problems of discovering, analyzing the causes, or optimizing the failure of related QoE processes to meet poor user experience quality.
[0005] Firstly, a method for measuring Quality of Experience (QoE) is provided, the method comprising:
[0006] The terminal receives first information sent by the first network-side device; the first information is used to configure the terminal's QoE measurement.
[0007] The terminal performs QoE measurement and sends a QoE report based on the first information;
[0008] The first information includes at least one of the following:
[0009] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0010] Subtypes of service types;
[0011] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0012] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0013] Secondly, a QoE measurement method is provided, the method comprising:
[0014] The first network-side device sends first information to the terminal; the first information is used to configure the terminal's QoE measurement.
[0015] The first network-side device receives a QoE report sent by the terminal after performing QoE measurement based on the first information; wherein the first information includes at least one of the following:
[0016] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0017] Subtypes of service types;
[0018] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0019] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0020] Thirdly, a QoE measurement method is provided, which includes:
[0021] The second network-side device receives an auxiliary measurement request sent by the terminal, the auxiliary measurement request being used to request the second network-side device to measure the QoE of the terminal;
[0022] The second network-side device measures the QoE of the terminal and obtains a QoE report based on the auxiliary measurement request.
[0023] Fourthly, a QoE measurement method is provided, which includes:
[0024] The terminal sends an auxiliary measurement request to the second network-side device, the auxiliary measurement request being used to request the second network-side device to measure the terminal's QoE;
[0025] The terminal receives an auxiliary measurement response sent by the second network-side device, the auxiliary measurement response being used to indicate whether to accept or reject the auxiliary measurement request.
[0026] Fifthly, a QoE measurement device is provided, the device comprising:
[0027] The first receiving module is used to receive first information sent by the first network-side device; the first information is used to configure the terminal's QoE measurement.
[0028] The first processing module is used to perform QoE measurement based on the first information;
[0029] The first sending module is used to send QoE reports;
[0030] The first information includes at least one of the following:
[0031] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0032] Subtypes of service types;
[0033] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0034] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0035] Sixthly, a QoE measurement device is provided, the device comprising:
[0036] The fifth sending module is used to send first information to the terminal; the first information is used to configure the terminal's QoE measurement.
[0037] The fifth receiving module is configured to receive a QoE report sent by the terminal after performing QoE measurement based on the first information; wherein the first information includes at least one of the following:
[0038] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0039] Subtypes of service types;
[0040] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0041] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0042] In a seventh aspect, a QoE measurement device is provided, the device comprising:
[0043] The ninth receiving module is used to receive an auxiliary measurement request sent by the terminal, wherein the auxiliary measurement request is used to request the second network-side device to measure the QoE of the terminal;
[0044] The third processing module is used to measure the QoE of the terminal and obtain a QoE report based on the auxiliary measurement request.
[0045] Eighthly, a QoE measurement device is provided, the device comprising:
[0046] The tenth sending module is used to send an auxiliary measurement request to the second network-side device, the auxiliary measurement request being used to request the second network-side device to measure the QoE of the terminal;
[0047] The tenth receiving module is used to receive an auxiliary measurement response sent by the second network-side device, wherein the auxiliary measurement response is used to indicate whether to accept or reject the auxiliary measurement request.
[0048] In a ninth aspect, a QoE measuring device is provided, the device being configured to perform the steps of the method described in the first aspect, or implement the steps of the method described in the second aspect, or implement the steps of the method described in the third aspect, or implement the steps of the method described in the fourth aspect.
[0049] In a tenth aspect, a terminal is provided, the terminal including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the first aspect, or implementing the steps of the method as described in the fourth aspect.
[0050] Eleventhly, a terminal is provided, including a processor and a communication interface, wherein the communication interface is configured to receive first information sent by a first network-side device; the first information is configured to configure QoE measurement of the terminal; the processor is configured to perform QoE measurement according to the first information; the communication interface is further configured to send a QoE report; or, the communication interface is configured to send an auxiliary measurement request to a second network-side device, the auxiliary measurement request being configured to request the second network-side device to measure the QoE of the terminal, and to receive an auxiliary measurement response sent by the second network-side device, the auxiliary measurement response being configured to indicate acceptance or rejection of the auxiliary measurement request.
[0051] In a twelfth aspect, a network-side device is provided, the network-side device including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the second aspect, or implementing the steps of the method as described in the third aspect.
[0052] In a thirteenth aspect, a network-side device is provided, including a processor and a communication interface, wherein the communication interface is used to send first information to a terminal; the first information is used to configure QoE measurement of the terminal; and to receive a QoE report sent by the terminal after performing QoE measurement based on the first information; or the communication interface is used to receive an auxiliary measurement request sent by the terminal, the auxiliary measurement request being used to request a second network-side device to measure the QoE of the terminal; the processor is used to measure the QoE of the terminal according to the auxiliary measurement request to obtain a QoE report.
[0053] In a fourteenth aspect, a readable storage medium is provided, on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect, or the steps of the method described in the second aspect, or the steps of the method described in the third aspect, or the steps of the method described in the fourth aspect.
[0054] In a fifteenth aspect, a wireless communication system is provided, comprising: a terminal and a network-side device, wherein the terminal is configured to perform the steps of the method described in the first aspect, and the network-side device is configured to perform the steps of the method described in the second aspect, or the steps of the method described in the third aspect, or the steps of the method described in the fourth aspect.
[0055] In a sixteenth aspect, a chip is provided, the chip including a processor and a communication interface coupled to the processor, the processor being configured to run a program or instructions to implement the steps of the method as described in the first aspect, or the steps of the method as described in the second aspect, or the steps of the method as described in the third aspect, or the steps of the method as described in the fourth aspect.
[0056] In a seventeenth aspect, a computer program / program product is provided, the computer program / program product being stored in a storage medium, the computer program / program product being executed by at least one processor to implement the steps of the method as described in the first aspect, or the steps of the method as described in the second aspect, or the steps of the method as described in the third aspect, or the steps of the method as described in the fourth aspect.
[0057] In this embodiment, the terminal enhances the flexibility of the QoE measurement process by using the first information configured by the network-side device for QoE measurement. Specifically, it expands the service types supported by QoE measurement, or the sub-types under each service type, or the QoE type corresponding to QoE measurement, or the reporting type corresponding to the QoE report of QoE measurement. This allows for more flexible or refined QoE measurement collection, enabling more accurate analysis of QoE issues and resolving the problem that related QoE collection processes cannot meet the performance requirements of next-generation networks. Attached Figure Description
[0058] Figure 1 A block diagram illustrating a wireless communication system to which embodiments of this application may be applied;
[0059] Figure 2 This represents one of the steps of the QoE measurement method provided in the embodiments of this application;
[0060] Figure 3 This is the second flowchart illustrating the steps of the QoE measurement method provided in this application embodiment;
[0061] Figure 4 This is the third flowchart illustrating the steps of the QoE measurement method provided in this application embodiment;
[0062] Figure 5 This is the fourth flowchart illustrating the steps of the QoE measurement method provided in this application embodiment;
[0063] Figure 6 This is a schematic diagram of one of the QoE measuring devices provided in the embodiments of this application;
[0064] Figure 7 This is the second schematic diagram of the structure of the QoE measuring device provided in the embodiments of this application;
[0065] Figure 8 This is the third schematic diagram showing the structure of the QoE measuring device provided in the embodiments of this application;
[0066] Figure 9 This is the fourth schematic diagram showing the structure of the QoE measuring device provided in the embodiments of this application;
[0067] Figure 10 This is a schematic diagram of the structure of the communication device provided in the embodiments of this application;
[0068] Figure 11 This is a schematic diagram of the structure of the terminal provided in the embodiments of this application;
[0069] Figure 12 This is a schematic diagram illustrating the structure of the network-side device provided in the embodiments of this application. Detailed Implementation
[0070] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0071] The terms "first," "second," etc., used in this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same class, not limited in number; for example, the first object can be one or more. Furthermore, "or" in this application indicates at least one of the connected objects. For example, the scope of protection for "A or B" covers at least three scenarios: Scenario 1: including A but not B; Scenario 2: including B but not A; Scenario 3: including both A and B. In addition, the terms "A and / or B," "at least one of A and B," and "at least one of A or B" also cover at least the above three scenarios. The character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0072] The term "instruction" in this application can be either a direct instruction (or explicit instruction) or an indirect instruction (or implicit instruction). A direct instruction can be understood as the sender explicitly informing the receiver of specific information, the required operation, or the requested result in the instruction sent. An indirect instruction can be understood as the receiver determining the corresponding information based on the instruction sent by the sender, or making a judgment and determining the required operation or requested result based on the judgment result.
[0073] It is worth noting that the technologies described in this application are not limited to Long Term Evolution (LTE) / LTE-Advanced (LTE-A) systems, but can also be used in other wireless communication systems, such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Orthogonal Frequency Division Multiple Access (OFDMA), Single-carrier Frequency-Division Multiple Access (SC-FDMA), or other systems. The terms "system" and "network" in this application are often used interchangeably, and the described technologies can be used with the systems and radio technologies mentioned above, as well as with other systems and radio technologies. The following description describes New Radio (NR) systems for illustrative purposes, and the term NR is used in most of the following description; however, these technologies can also be applied to systems other than NR systems, such as 6th generation (6G) radio systems. th Generation 6G communication system.
[0074] Figure 1This diagram illustrates a block diagram of a wireless communication system applicable to embodiments of this application. The wireless communication system includes a terminal 11 and a network-side device 12. The terminal 11 can also be referred to as User Equipment (UE), and can be a mobile phone, tablet computer, laptop computer, notebook computer, personal digital assistant (PDA), handheld computer, netbook, ultra-mobile personal computer (UMPC), mobile internet device (MID), augmented reality (AR), virtual reality (VR) device, robot, wearable device, flight vehicle, vehicle user equipment (VUE), shipboard equipment, pedestrian user equipment (PUE), smart home devices (home appliances with wireless communication capabilities, such as refrigerators, televisions, washing machines, or furniture), game consoles, personal computers (PCs), ATMs, or self-service machines, etc. Wearable devices include: smartwatches, smart bracelets, smart earphones, smart glasses, smart jewelry (smart bracelets, smart chains, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. Among these, in-vehicle devices can also be referred to as in-vehicle terminals, in-vehicle controllers, in-vehicle modules, in-vehicle components, in-vehicle chips, or in-vehicle units, etc. It should be noted that the specific type of terminal 11 is not limited in this application embodiment. Network-side equipment 12 may include access network equipment or core network equipment, wherein access network equipment may also be referred to as Radio Access Network (RAN) equipment, radio access network function, or radio access network unit. Access network equipment may include base stations, Wireless Local Area Network (WLAN) access points (APs), or Wireless Fidelity (WiFi) nodes, etc.Among them, base stations can be referred to as Node B (NB), Evolved Node B (eNB), Next Generation Node B (gNB), New Radio Node B (NR Node B), Access Point, Relay Base Station (RBS), Serving Base Station (SBS), Base Transceiver Station (BTS), Radio Base Station, Radio Transceiver, Basic Service Set (BSS), Extended Service Set (ESS), Home Node B (HNB), Home Evolved Node B, Transmit / Receive Point (TRP), Non-Terrestrial Network (NTN) equipment (such as satellite or high altitude platform stations). The term "base station" can be any suitable term in the field, such as "station" or any other appropriate term in the relevant field, as long as the same technical effect is achieved. The term "base station" is not limited to specific technical terms. It should be noted that the embodiments of this application only use the base station in the NR system as an example for introduction, and do not limit the specific type of base station.
[0075] Core network equipment, also known as core network nodes, core network functions, or core network elements, includes, but is not limited to, at least one of the following: Mobility Management Entity (MME), Access and Mobility Management Function (AMF), Session Management Function (SMF), User Plane Function (UPF), Policy Control Function (PCF), Policy and Charging Rules Function (PCRF), Edge Application Server Discovery Function (EASDF), Unified Data Management (UDM), Unified Data Repository (UDR), Home Subscriber Server (HSS), Centralized network configuration (CNC), Network Repository Function (NRF), Network Exposure Function (NEF), Local NEF (L-NEF), and Binding Support. Functions include BSF, Application Function (AF), Location Management Function (LMF), Gateway Mobile Location Centre (GMLC), Network Data Analytics Function (NWDAF), and Non-Terrestrial Network (NTN) equipment (such as satellite or high altitude platform station).It should be noted that the embodiments of this application only use the core network equipment in the NR system as an example for introduction, and do not limit the specific type of core network equipment. If the name of the core network equipment mentioned in the embodiments of this application changes in subsequent protocol versions (e.g., 6G), it is also within the scope of protection of this application.
[0076] Optionally, the core network equipment can be implemented by one or more functional modules in a single device, or by multiple devices working together; this application does not specifically limit this. It is understood that the aforementioned functional modules can be network elements in hardware devices, software functional modules running on dedicated hardware, or virtualized functional modules instantiated on a platform (e.g., a cloud platform).
[0077] The QoE process is used by the network to configure the UE to collect QoE data and report it to the network-side equipment. Below are some scenario examples to further illustrate the problems existing in the relevant QoE processes.
[0078] Taking streaming media services as an example, common application scenarios include video playback, music playback, and live streaming. Video playback: For example, watching movies, TV series, and variety shows on online video platforms allows users to start watching shortly after the video loads, unlike traditional download methods where the entire video file must be downloaded before playback. Music playback: Online music platforms allow users to listen to songs in real-time without downloading the entire music file to their device beforehand. Users can switch songs at any time and enjoy a continuous music playback experience. Live streaming: This includes live sports events, news broadcasts, live e-commerce, and game streaming. The broadcaster collects and uploads audio and video data in real-time, while the user receives and plays it in real-time, enabling real-time information transmission and interaction. Among these common application scenarios, the network performance requirements, from highest to lowest, are typically live streaming, video playback, and music playback. Therefore, if QoE is collected uniformly based on streaming services, it may lead to over-collection of QoE measurements for a certain sub-category (for example, music playback is usually smooth and does not require collection), or it may cause data on poor user experience quality in a certain sub-category to be submerged in the overall data of that type (for example, live streaming may experience stuttering due to the inability to pre-cache, and the proportion of poor QoE may be low when analyzing the overall data of streaming services, but if we break it down to the poor QoE quality of live streaming services, then the proportion of poor QoE may be higher).
[0079] Taking special deployment scenarios as an example, the probability of poor user experience quality may be higher in certain scenarios, such as subways, elevators, high-speed trains, tunnels, underground parking lots, and seaside areas. UEs also struggle to obtain real-time and accurate location information, making it difficult to distinguish the actual situation of poor user experience quality (e.g., inside or outside an elevator). For example, in a subway scenario, different UEs may be performing different types of services (e.g., MTSI, streaming service). Even if different UEs are performing the same type of service, the sub-category of that service (IMS voice, IMS video; or WeChat video, WeChat voice, video playback, live streaming) may differ. Some UEs may experience poor user experience quality inside the train car, while others may experience it on the platform outside the car. Therefore, enhanced data collection methods are needed to support network and / or UE problem detection, cause analysis, and optimization.
[0080] The current QoE process suffers from at least one of the following problems, resulting in poor flexibility:
[0081] (1) It supports few service types and does not consider new services under the next generation of networks;
[0082] (2) The service type granularity is relatively coarse. Coarse-grained QoE collection may lead to the collection of QoE of unnecessary sub-services under this service type, consuming more power, or affecting the user experience quality of the sub-services in progress.
[0083] (3) It only supports QoE collection and reporting of terminals, and the data collection is not comprehensive.
[0084] The QoE measurement method provided in this application will be described in detail below with reference to the accompanying drawings and through some embodiments and application scenarios.
[0085] like Figure 2 As shown in the embodiment of this application, a method for measuring Quality of Experience (QoE) is provided, the method comprising:
[0086] Step 201: The terminal receives first information sent by the first network-side device; the first information is used to configure the terminal's QoE measurement.
[0087] Step 202: The terminal performs QoE measurement and sends a QoE report based on the first information.
[0088] In this embodiment, the first network-side device may be a wireless access network node (such as a base station), a core network function node (such as an AMF), or a new service function node, without specific limitations. Among these, the new service function node may potentially be a data plane function (DPF), a sensing function (SF), an artificial intelligence function (AIF), a computing function (CF), an AI control function (AICF), a computing control function (CCF), an external service AI function (NET for AIF), an internal service AI function (such as a network data analytics function (NWDAF)), an external service computing function (NET for Computing function (NETforCF), an internal service computing function (Computing for NET function (CforNETF), an internal service sensing function (Sensing for NET function), or an external service sensing function (NET for Sensing function), etc.
[0089] In at least one embodiment of this application, the first information includes at least one of the following:
[0090] Service type, used to indicate the service type of QoE measurement in network configuration; the service type includes at least one of the following: Extended Reality (XR) service, Sensing service, Artificial Intelligence (AI) service, Computing service, Streaming service, and Multimedia Telephony Service (MTSI) of Internet Protocol Multimedia Subsystem;
[0091] Subtypes of service types; optionally, depending on the services that different terminals or networks are interested in at different times, this subtype can be a type with a smaller range than the service type range;
[0092] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0093] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0094] In one implementation, when the first information only includes a service type, the service type includes at least one of the following: XR service, perception service, AI service, and computing service.
[0095] In this embodiment, the terminal enhances the flexibility of the QoE measurement process by using the first information configured by the network-side device for QoE measurement. This expands the service types supported by QoE measurement, allowing for more accurate analysis of QoE issues related to the expanded service types through more flexible QoE measurement collection. This addresses the problem that related QoE measurements do not support new service types such as sensing or AI.
[0096] Optionally, current voice or video call services include those provided by operators through the IP Multimedia Subsystem (IMS) and those provided by over-the-top (OTT) service providers. Optionally, the aforementioned sensing services may include: sensing services provided by operators; the aforementioned AI services may include: AI services provided by operators; the aforementioned computing services may include: computing services provided by operators.
[0097] In another implementation, the first information is extended to include subtypes under each service type. This allows for more accurate analysis of QoE issues in the extended subtypes through more refined QoE measurement collection. It also avoids the problem that potential QoE issues in a particular service subtype are difficult to detect or analyze due to interference from other QoE measurements under that service type.
[0098] Optionally, the QoE type can be reported immediately after collection, such as ImmediateQoE; or it can be stored first and then reported, such as LoggedQoE.
[0099] For QoE types that store data before reporting, it's important to note that this differs from logged MDT (Logged Minimum Drive Test). Logged MDT primarily considers MDT measurements and reporting by terminals in idle mode. However, logged QoE is geared towards connected terminals. It addresses situations where poor QoE quality might occur due to poor uplink and / or downlink signal quality, or high cell load. In such cases, immediate reporting after data collection could degrade the terminal's experience or reduce spectral efficiency. This is because poor uplink or downlink signal quality may require more spectrum resources to complete QoE measurement and reporting. Alternatively, QoE measurement and reporting may consume resources, reducing the service's overall resources and thus lowering the terminal's experience.
[0100] In one implementation, for the data collection phase, a "store first, report later" approach can be adopted. Optionally, the first network-side device can also configure the maximum length of stored data, such as 128 bytes, through first information or other information. That is, after storing 128 bytes of data, the terminal reports the QoE measurement for this QoE measurement. Alternatively, the maximum length of stored data can be configured through first information or other information, such as 1024 bytes. That is, after storing 1024 bytes of data, the terminal stops storing the QoE measurement for this QoE measurement and reports the QoE measurement when the UE or network is under low load. In other words, "store first, report later" can mean reporting immediately after storing data reaches a certain threshold, or reporting only after storing data reaches a certain threshold and meeting specific conditions, such as when the UE or network is under low load. In another implementation, for the real-time QoE quality optimization phase, a "collect immediately, report later" approach can be adopted, allowing the network time to dynamically adjust its configuration based on the QoE measurement.
[0101] In this embodiment, the QoE type corresponding to the QoE measurement is expanded in the first information, thereby assisting the terminal in achieving more flexible QoE measurement reporting and solving the problem that the existing QoE acquisition process cannot meet the performance requirements of next-generation networks. It is understood that the first network-side device can configure the corresponding QoE type for the terminal according to different performance requirements.
[0102] Optionally, the first information may further include a reporting type, which indicates the reporting method of the QoE report.
[0103] Optionally, the QoE report can be submitted via event-triggered reporting or periodic reporting.
[0104] In this embodiment of the application, the reporting type corresponding to the QoE report of QoE measurement is expanded in the first information, so as to configure the QoE report in a more flexible way and solve the problem that the existing QoE acquisition process cannot meet the performance requirements of the next generation network.
[0105] Optionally, by configuring the QoE type and / or reporting type in the first information, QoE measurements can be filtered, reducing the amount of data in QoE reports and enabling QoE measurements in more granular situations, thereby better supporting QoE collection and experience optimization in scenarios of concern to operators or terminals.
[0106] In at least one embodiment of this application, the first information can be sent to a terminal, a terminal group in the cell, or broadcast to all terminals in the cell via an RRC message.
[0107] Optionally, the first network-side device or other network devices (such as operation and maintenance systems) that interact with the first network-side device can send the first information to a terminal group in the cell or broadcast it to all terminals in the cell according to the scene characteristics covered during cell deployment, thereby collecting experience quality reports reported by multiple terminals in the deployment scenario to meet the performance requirements of the next-generation network.
[0108] In one implementation, the trace collection entity (TCE), operation and maintenance (OAM) system, core network function, radio access network node, or network-side device can select a suitable terminal to send first information based on received requests (such as QoE measurement requests sent by terminals, OAM, core network, application functions, or base station-triggered QoE measurement requests) or its own needs, instructing the corresponding terminal to perform QoE measurement; or the first network-side device can select a suitable terminal to send first information based on terminal capability information (such as QoE measurement capability information reported by the terminal) or terminal authorization information (such as user consent), instructing the corresponding terminal to perform QoE measurement.
[0109] In some embodiments, the subtype of the perception service includes at least one of the following:
[0110] Object detection and tracking services, such as indoor intrusion detection, outdoor intrusion detection (e.g., detection of animals or people intruding into a yard), drone detection, and detection and tracking of people, drones, or animals.
[0111] Environmental monitoring services, such as rainfall monitoring, flood monitoring, and geomorphological change monitoring;
[0112] Motion monitoring services, such as respiratory monitoring and gesture recognition.
[0113] In some embodiments, the subtypes of AI services include at least one of the following:
[0114] AI model inference service;
[0115] AI model training services;
[0116] AI model distribution service, which includes sending complete AI models as well as updating some AI parameters based on previous models, is not specifically limited here;
[0117] Segmentation AI model inference services, including segmentation AI model inference between the terminal and the network, or segmentation AI model inference between the terminal and the application server; for example, segmentation AI image / video recognition, etc.
[0118] Large text-based model business services;
[0119] Video-based large-scale model business services;
[0120] AI task offloading service, that is, the terminal generates an AI task, sends it to the network (such as a 5G network or 6G network) for processing, and then receives the result generated by the network.
[0121] AI tasks are online computing services, meaning data sent from a terminal to a destination address (such as another terminal or application server). In this data transmission process, the UE first sends the data to the network (such as a 5G or 6G network), the network processes the data using AI, and then sends it to the destination address. Alternatively, the application server sends data to the target terminal; in this process, the application server first sends the data to (such as a 5G or 6G network), the network processes the data using AI, and then sends it to the destination terminal.
[0122] In some embodiments, the subtype of the computing service includes at least one of the following:
[0123] Video rendering services;
[0124] Video segmentation and rendering service;
[0125] Terminal computing offloading service means that the terminal generates computing tasks, sends them to the network (such as a 5G network or a 6G network) for processing, and then receives the computing results from the network.
[0126] In-network computing services refer to data sent from a terminal to a destination address (such as another UE or application server). In this data transmission process, the terminal first sends the data to the network (such as a 5G or 6G network), the network processes the data, and then sends it to the destination address. Alternatively, an application server can send data to a target terminal. In this process, the application server first sends the data to (such as a 5G or 6G network), the network processes the data, and then sends it to the destination terminal.
[0127] Large-scale network video services refer to large-scale network video services that generate computational tasks at network destination addresses, send them to the network for processing, and then perform these tasks.
[0128] In some embodiments, the subtype of the streaming service includes at least one of the following:
[0129] Application-based voice services, such as WeChat voice calls;
[0130] Application-based video services, such as WeChat video calls;
[0131] Audio playback service;
[0132] Video playback service;
[0133] Live streaming service.
[0134] In some embodiments, the subtypes of the multimedia telephony service of the Internet Protocol Multimedia Subsystem include at least one of the following:
[0135] Voice service;
[0136] Video services;
[0137] Video playback service;
[0138] Live streaming service.
[0139] In some embodiments, the subtypes of XR services include at least one of the following: Augmented Reality (AR) services; Virtual Reality (VR) services.
[0140] In at least one embodiment of this application, the report type can typically be either periodically triggered or event-triggered. For a report type configured as event-triggered, the terminal is triggered to report measurement results via measurement report trigger configuration information. Specifically, the measurement report trigger configuration information is a measurement report event; the first information further indicates a measurement report event, which is used to trigger the terminal to report a QoE report.
[0141] In one implementation, the first information directly carries the measurement reporting event, or other information in the first information indirectly indicates the measurement reporting event. For example, the measurement reporting event can be indirectly indicated through the service type or subtype.
[0142] In some embodiments, the measurement reporting event includes at least one of the following:
[0143] (1) The QoE measurement value meets the first threshold; for example, the entry condition is that the Mean Opinion Score (MOS) value related to speech quality is less than 3 points, and the exit condition is that the MOS value is greater than 3; or the entry condition is that the initial playback delay is not greater than 1 second, and the exit condition is that the initial playback delay is less than 0.5 seconds; or the entry condition is that the average number of stutters per minute is greater than 1, and the exit condition is that the average number of stutters per minute is greater than 2; or the entry condition is that the perception performance index (such as position accuracy, speed accuracy) is less than the first threshold, and the exit condition is that the aforementioned perception performance index is greater than the first threshold; or the entry condition is that the perception performance index (distance resolution, speed resolution or perception latency) is greater than the first threshold, and the exit condition is that the aforementioned perception performance index is less than the first threshold; or the AI performance index (such as inference accuracy) is not greater than the first threshold; or the computational performance index (such as computational latency) is not less than the first threshold, etc. If a QoE measurement configuration contains multiple service types or multiple service subtypes, the measurement reporting event can be represented in a list format as the threshold that the QoE measurement of each service type or subtype needs to meet, or it can be the average QoE measurement value of multiple service types or multiple service subtypes that meets the first threshold.
[0144] (2) The difference between QoE measurements satisfies the second threshold; optionally, the difference between QoE measurements can be the difference between the average values of QoE measurements over two specified time intervals, or the difference between QoE measurements at two specific time points, or the difference between the maximum and minimum values of QoE measurements within a certain time interval. It is understood that the difference between QoE measurements can reflect or indicate changes in QoE. For example, if the difference between the MOS value in time interval T1 and the MOS value in time interval T1+delta is greater than 2, it indicates a deterioration in speech quality; conversely, if the difference between the MOS value in time interval T1+delta and the MOS value in time interval T1 is greater than 2, it indicates an improvement in speech quality. Similarly, if the difference between the initial playback delay in time interval T1+delta and the initial playback delay in time interval T1 is greater than 1. For example, the difference between QoE measurements represents the change in QoE within delta T1 for the aforementioned perception performance indicators, AI performance indicators, or computing performance indicators. Specific examples such as position accuracy, inference accuracy, or computing latency will not be provided here. The difference between the aforementioned QoE measurements within delta T1 can reflect or indicate the change in QoE within delta T1.
[0145] (3) The fluctuations between QoE measurements meet the third threshold; the fluctuations are used to indicate the stability of QoE; for example, the variance or standard deviation of QoE measurements within the delta T2 time interval is not greater than the third threshold; for example, when the QoE measurements within a certain time interval are X1……Xn and the mean is X', the variance = 1 / n*(X1-X'). 2 +……+(Xn-X') 2 ;
[0146] (4) The time interval of QoE measurement meets the fourth threshold; optionally, the time interval can be obtained by the following parameters: QoE measurement start time and end time; or QoE measurement start time and measurement time length; or QoE measurement end time and measurement time length;
[0147] (5) The location or environment information of the terminal during QoE measurement meets the first condition; for example, the location or environment type of the terminal during measurement is indoor or outdoor, or the location or environment type of the terminal during measurement is inside a subway car or subway platform, or the location type of the terminal during measurement is inside or outside an elevator car, or the location type of the terminal during measurement is inside a high-speed rail car or high-speed rail platform or high-speed rail surrounding area, or the location type of the terminal during measurement is inside or outside an underground parking garage, or the location type of the terminal during measurement is inside or outside a tunnel, or the location type of the terminal during measurement is on a ship or beach or surrounding residential area, etc.
[0148] (6) Event A1 indicates that the service quality of the serving cell is higher than the fifth threshold; for example, Event A1, Serving becomes better than threshold;
[0149] (7) Event A2 indicates that the service quality of the serving cell is lower than the sixth threshold; for example, Event A2, Serving becomes worse than threshold;
[0150] (8) Event A3 indicates that the difference between the service quality of the neighboring cell and the service quality of the serving cell is greater than the seventh threshold; for example, Event A3, Neighbour becomes offset better than SpCell;
[0151] (9) Event A4 indicates that the service quality of the neighboring cell is higher than the eighth threshold; for example, Event A4, Neighbour becomes better than threshold.
[0152] (10) Event A5 indicates that the service quality of the serving cell is lower than the ninth threshold and the service quality of the neighboring cell is higher than the tenth threshold; for example, Event A5, SpCell becomes worse than threshold1 and neighbor becomes better than threshold2.
[0153] (11) Event A6 indicates that the service quality of the neighboring cell is higher than that of the secondary cell; for example, Event A6, Neighbour becomes offset better than SCell;
[0154] (12) Event B1 indicates that the service quality of the inter-system neighbor is greater than the eleventh threshold; for example, Event B1, InterRAT neighbor becomes better than threshold.
[0155] (13) Event B2 indicates that the service quality of the serving cell is lower than the twelfth threshold and the service quality of the inter-system neighboring cells is higher than the thirteenth threshold; for example, Event B2, PCell becomes worse than threshold1 and inter RATneighbour becomes better than threshold2.
[0156] (14) Event I1 indicates that the interference power is higher than the fourteenth threshold; for example, Event I1, Interference becomes higher than threshold.
[0157] (15) Event C1 indicates that the sidelink channel busy ratio is above a threshold; for example, Event C1, The sidelinkchannel busy ratio is above a threshold;
[0158] (16) Event C2 indicates that the sidelink channel busy ratio is below the sixteenth threshold; for example, Event C2, The sidelinkchannel busy ratio is below a threshold;
[0159] (17) Event D1 indicates that the distance between the terminal and the first reference location is greater than the seventeenth threshold; for example, Event D1, Distance between UE and referenceLocation1 is above threshold1 and distance between UE and referenceLocation2 is below threshold2;
[0160] (18) Event D2 indicates that the distance between the UE and the serving cell moving reference location is less than the eighteenth threshold; for example, Event D2, Distance between UE and the serving cell moving reference location is above threshold1 and distance between UE and a moving reference location is below threshold2.
[0161] It should be noted that the thresholds mentioned in the embodiments of this application, such as at least one of the first threshold to the eighteenth threshold, can be determined by network side configuration, terminal implementation, or pre-agreed by protocol, and are not specifically limited here.
[0162] Optionally, the entry conditions mentioned in the embodiments of this application can be understood as the conditions for starting to report QoE reports; the exit conditions can be understood as the conditions for stopping to report QoE reports.
[0163] In at least one embodiment of this application, the QoE report includes at least one of the following:
[0164] The QoE measurement information that satisfies the measurement reporting event;
[0165] The first indication information is used to indicate that the QoE measurement quantity satisfies the measurement reporting event.
[0166] It should be noted that the events mentioned in the embodiments of this application can also be understood as conditions; for example, a measurement reporting event can also be called a measurement reporting condition.
[0167] It should be noted that QoE measurement can also be understood as QoE measurement value, and no specific limitation is made here.
[0168] In one example, entry and exit conditions for an event are defined. For instance, the first event is that the QoE measurement value meets a first threshold. The entry condition is that QoE is less than A, and the exit condition is that QoE is greater than B, where A and B can be the same or different. When the QoE measurement value measured by the terminal is less than A, one possibility is that the terminal reports a QoE measurement value less than A; or the terminal reports a first indication message to indicate that the QoE measurement meets the first event, i.e., the QoE measurement value is cell A. Conversely, if the QoE measurement value measured by the terminal is greater than B, then the terminal neither reports the first indication message nor the QoE measurement value.
[0169] In some embodiments, the QoE measurement information includes at least one of the following:
[0170] A first identifier (such as measurement ID) is used to identify the QoE measurement;
[0171] Service type;
[0172] Subtypes of service types;
[0173] QoE measurements corresponding to the service type and / or the subtype;
[0174] A time stamp is used to identify the time of QoE measurement.
[0175] The downlink signal measurement value corresponding to the timestamp; such as RSRP (Reference Signal Receiving Power), RSRQ (Reference Signal Receiving Quality), SINR (Signal to Interference plus Noise Ratio) or SNR (Signal to Noise Ratio), etc.
[0176] The acceleration of the terminal;
[0177] Terminal speed;
[0178] The terminal's sensing results; for example, the terminal can sense signals by sending and receiving them on its own, or by receiving sensing signals sent by a base station or other terminals. Sensing results can be obtained in enclosed spaces (such as elevators, high-speed train carriages, etc.) or open spaces larger than N meters (such as high-speed train platforms, subway platforms, etc.).
[0179] The direction of movement of the terminal.
[0180] The QoE measurement includes at least one of the following:
[0181] Average throughput, initial playback latency, or buffering level, etc.;
[0182] Mean opinion score (MOS) related to speech quality;
[0183] Video resolution, frame rate, packet loss rate, jitter, or latency, etc.
[0184] During a video call, the frame rate per second, the stuttering of audio and video, and whether the audio and video are synchronized are all important factors.
[0185] Position accuracy, velocity accuracy, distance resolution, velocity resolution, recognition accuracy, false alarm probability, false alarm rate, and sensing service latency or refresh rate.
[0186] AI model inference accuracy, AI model inference latency, AI model training latency, AI model training accuracy, AI service computing speed, and AI service computing intensity;
[0187] Calculate latency, calculation speed, calculation intensity, and calculation failure rate (or calculation success rate); for example, the calculation failure rate is calculated as the number of failed requests per unit time (e.g., per second, per 5 minutes, per day, etc.) divided by the total number of valid requests per unit time; as another example, the calculation success rate is calculated as the number of successful requests per unit time (e.g., per second, per 5 minutes, per day, etc.) divided by the total number of valid requests per unit time.
[0188] It should be noted that the service type or subtype in the first information is network configuration information, and the service type or subtype of the service type is optional when the terminal sends the QoE report. For example, if the network configures only one service type and / or subtype under a measurement ID using the first information, then the QoE measurement report does not need to include the service type or subtype of the service type. As another example, if the network configures QoE measurements for multiple service subtypes of a service using the first information, the terminal indicates the subtype of the service type corresponding to the QoE measurement by using the subtype of the service type when sending the QoE report.
[0189] In one implementation, the first network-side device receives QoE reports from terminals. By collecting QoE data for new service types or subtypes, the first network-side device (or, through interaction with other network functions) can better analyze whether QoE issues exist. Configuring the reporting of trigger events allows for more precise collection of QoE measurements for service types that meet the trigger event. Compared to reporting all QoE, this reduces the amount of data and provides more flexible support for QoE collection in special scenarios where operators or terminals may experience poor quality of life (such as location type or signal quality characteristics). For example, configuring the reporting of trigger events can collect QoE data in subway cars where the average number of video stutters is greater than 1 and the serving cell's RSRP is greater than a threshold.
[0190] In at least one embodiment of this application, the method further includes:
[0191] The terminal sends QoE measurement capability information to the first network-side device; the QoE measurement capability information includes at least one of the following:
[0192] QoE measurement indication is used to indicate whether the terminal supports QoE measurement;
[0193] The terminal supports the following service types for QoE measurement:
[0194] The terminal supports subtypes of the QoE measurement service types.
[0195] Since QoE involves the application processor (AP) on the terminal, it typically requires the cooperation of the terminal modem, operating system, and other components to perform QoE measurement and reporting. Therefore, terminal-reported QoE measurement capability information is more helpful for the network to select appropriate terminals for QoE collection.
[0196] In some embodiments of this application, the QoE measurement can be triggered by a first network-side device through first information, or it can be triggered by a terminal.
[0197] The terminal-triggered QoE measurement process helps the terminal trigger network-side devices to collect QoE measurements of that terminal. Optionally, the network-side devices can perform QoE quality analysis on the terminal and optimize its QoE quality through configuration. The advantage of this approach is that the terminal can initiate QoE measurements on demand based on the experience quality of a specific service type or subtype, rather than passively receiving QoE measurement configurations from the network-side devices. Terminal-triggered QoE measurement collection is more effective in identifying and addressing poor QoE quality issues at the terminal, enabling optimization tailored to that specific terminal. This embodiment can effectively identify and resolve issues caused by differences in the experience quality of various terminals.
[0198] In one implementation, the method further includes:
[0199] The terminal sends a first QoE measurement request to the first network-side device, the first QoE measurement request being used to request QoE measurement;
[0200] The terminal receives a first QoE measurement response sent by the first network-side device, the first QoE measurement response being used to indicate acceptance of the first QoE measurement request.
[0201] In another implementation, the method further includes:
[0202] The terminal sends a second QoE measurement request to the first network-side device, the second QoE measurement request being used to request a QoE measurement; correspondingly, step 201 includes:
[0203] The terminal receives a second QoE measurement response sent by the first network-side device. The second QoE measurement response is used to indicate acceptance of the second QoE measurement request, and the second QoE measurement response also carries the first information.
[0204] In this embodiment, the terminal sends a QoE measurement request to the first network device. Since different terminals use different services at different times with varying frequencies, and different users have different levels of concern regarding the QoE of different services, and different users have different QoE requirements for the same service (e.g., some users prioritize high definition, while others prioritize smoothness), the terminal determines which QoE measurement request to send based on its needs (a first QoE measurement request and / or a second QoE measurement request). This embodiment supports terminal-triggered QoE measurements, which facilitates QoE collection and optimization for a specific terminal.
[0205] As an optional embodiment, a first network-side device receives a QoE measurement request sent by a terminal. The first network-side device (or the first network-side device interacting with other network functions) determines whether to accept the QoE measurement request. For example, if the terminal's QoE measurement helps the network discover, analyze, or resolve problems, and the network can schedule appropriate resources to satisfy the QoE measurement request, then the QoE measurement request is accepted. The first network-side device sends a QoE measurement response to the terminal, the QoE measurement response including at least "accept" or "reject," indicating whether the corresponding QoE measurement request is accepted or rejected. Optionally, if the QoE request is accepted, the QoE measurement response may further include the aforementioned first information; or, the first information may be a new message independent of the QoE measurement response, for example, the first network-side device sends the first information to the terminal after sending the QoE measurement response or simultaneously with it. Optionally, if the QoE request is rejected, the QoE measurement response may further include a rejection reason, such as insufficient resources or lack of interest.
[0206] In some embodiments, the first QoE measurement request and / or the second QoE measurement request includes at least one of the following:
[0207] Service type indicates the type of QoE measurement requested by the terminal;
[0208] Subtype of service type, indicating the subtype of the above service type;
[0209] QoE type, indicating the type of QoE measurement requested by the terminal;
[0210] Reporting type indicates the reporting type of the QoE report requested by the terminal for the QoE measurement;
[0211] Measurement reporting event, indicating the measurement reporting event of the QoE measurement requested by the terminal.
[0212] It should be noted that the definitions of the above service types, subtypes, QoE types, reporting types, and measurement reporting events are consistent with those in the above embodiments, and will not be repeated here.
[0213] Optionally, after receiving the QoE measurement response from the first network-side device, if the first network-side device accepts the QoE measurement request, then the terminal performs QoE measurement based on the first information and sends a QoE report.
[0214] In some embodiments, after the first network-side device receives the QoE report sent by the terminal:
[0215] Optionally, the first network-side device (or the first network-side device interacting with other network functions) determines whether to continue collecting QoE based on the received QoE report. If it is necessary to continue collecting QoE, the first network-side device can select an appropriate terminal to continue collecting QoE by using the procedure of triggering QoE measurement by the network-side device.
[0216] Optionally, the first network-side device (or the first network-side device interacting with other network functions) discovers or analyzes the experience quality issues of the terminal that triggered QoE collection, and sends a configuration message to the terminal to optimize the experience quality. The configuration message may include switching configuration information, uplink resource configuration, downlink resource configuration, QoS parameter configuration, etc. For example, for terminals in a subway scenario, the ultimate goal is to enable terminals inside the carriage to access cells covering the track area, and terminals on the platform to access cells covering the platform area.
[0217] In summary, in this embodiment, the first information configured by the terminal for QoE measurement through the network-side device enhances the flexibility of the QoE measurement process. Specifically, it expands the service types supported by QoE measurement, or expands the subtypes under each service type, or expands the QoE type corresponding to QoE measurement, or expands the reporting type corresponding to the QoE report of QoE measurement. This allows for more flexible or refined QoE measurement collection, enabling more accurate analysis of QoE issues and addressing the problem that existing QoE collection processes cannot meet the performance requirements of next-generation networks.
[0218] like Figure 3 As shown in the embodiments of this application, a QoE measurement method is also provided, the method comprising:
[0219] Step 301: The first network-side device sends first information to the terminal; the first information is used to configure the terminal's QoE measurement.
[0220] Step 302: The first network-side device receives a QoE report sent by the terminal after performing QoE measurement based on the first information.
[0221] In this embodiment, the first network-side device may be a wireless access network node (such as a base station), a core network function node (such as an AMF), or a new service function node, without specific limitations. Among these, the new service function node may potentially be a data plane function (DPF), a sensing function (SF), an artificial intelligence function (AIF), a computing function (CF), an AI control function (AICF), a computing control function (CCF), an external service AI function (NET for AIF), an internal service AI function (such as a network data analytics function (NWDAF)), an external service computing function (NET for Computing function (NETforCF), an internal service computing function (Computing for NET function (CforNETF), an internal service sensing function (Sensing for NET function), or an external service sensing function (NET for Sensing function), etc.
[0222] In at least one embodiment of this application, the first information includes at least one of the following:
[0223] Service type, used to indicate the service type of QoE measurement in network configuration; the service type includes at least one of the following: Extended Reality (XR) service, Sensing service, Artificial Intelligence (AI) service, Computing service, Streaming service, and Multimedia Telephony Service (MTSI) of Internet Protocol Multimedia Subsystem;
[0224] Subtypes of service types; optionally, depending on the services that different terminals or networks are interested in, the subtype can be a type smaller than the service type range;
[0225] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0226] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0227] In one implementation, the terminal enhances the flexibility of the QoE measurement process by using the first information configured for QoE measurement by the network-side device. This expands the service types supported by QoE measurement, allowing for more accurate analysis of QoE issues related to the expanded service types through more flexible QoE measurement collection. This addresses the current problem that QoE measurement does not support new service types such as sensing or AI.
[0228] In another implementation, the first information is extended to include subtypes under each service type. This allows for more accurate analysis of QoE issues in the extended subtypes through more refined QoE measurement collection. It also avoids the problem that potential QoE issues in a particular service subtype are difficult to detect or analyze due to interference from other QoE measurements under that service type.
[0229] Optionally, in this embodiment of the application, the QoE type corresponding to the QoE measurement is extended in the first information, thereby assisting the terminal to achieve more flexible QoE measurement reporting, which can solve the problem that the existing QoE acquisition process cannot meet the performance requirements of the next-generation network.
[0230] Optionally, in this embodiment of the application, the reporting type corresponding to the QoE report of the QoE measurement is expanded in the first information, so as to configure the QoE report in a more flexible manner and solve the problem that the existing QoE acquisition process cannot meet the performance requirements of the next generation network.
[0231] Optionally, the QoE type can be reported immediately after collection, such as ImmediateQoE; or it can be stored first and then reported, such as LoggedQoE.
[0232] Optionally, the first network-side device or other network devices (such as operation and maintenance systems) that interact with the first network-side device can send the first information to a terminal group in the cell or broadcast it to all terminals in the cell according to the scene characteristics covered during cell deployment, thereby collecting experience quality reports reported by multiple terminals in the deployment scenario to meet the performance requirements of the next-generation network.
[0233] In one implementation, the trace collection entity (TCE), operation and maintenance (OAM) system, core network function, or radio access network node can select a suitable terminal to send first information based on the received request or its own needs, instructing the corresponding terminal to perform QoE measurement; or the first network-side device can select a suitable terminal to send first information based on terminal capability information (such as QoE measurement capability information reported by the terminal) or terminal authorization information (such as user consent), instructing the corresponding terminal to perform QoE measurement.
[0234] In at least one embodiment of this application, the report type can typically be either periodically triggered or event-triggered. For a report type configured as event-triggered, the terminal is triggered to report measurement results via measurement report trigger configuration information. Specifically, the measurement report trigger configuration information is a measurement report event; the first information further indicates a measurement report event, which is used to trigger the terminal to report a QoE report.
[0235] In one implementation, the first information directly carries the measurement reporting event, or other information in the first information indirectly indicates the measurement reporting event. For example, the measurement reporting event can be indirectly indicated through the service type or subtype.
[0236] In some embodiments, the measurement reporting event includes at least one of the following:
[0237] (1) The QoE measurement value meets the first threshold;
[0238] (2) The difference between the QoE measurements satisfies the second threshold;
[0239] (3) The fluctuations between QoE measurements satisfy the third threshold;
[0240] (4) The time interval for QoE measurement satisfies the fourth threshold;
[0241] (5) The location or environmental information of the terminal during QoE measurement meets the first condition;
[0242] (6) Event A1 indicates that the service quality of the serving cell is higher than the fifth threshold;
[0243] (7) Event A2 indicates that the service quality of the serving cell is below the sixth threshold;
[0244] (8) A3 event indicates that the difference between the service quality of the neighboring cell and the service quality of the serving cell is greater than the seventh threshold;
[0245] (9) Event A4 indicates that the service quality of the neighboring cell is higher than the eighth threshold;
[0246] (10) A5 event indicates that the service quality of the serving cell is lower than the ninth threshold and the service quality of the neighboring cells is higher than the tenth threshold.
[0247] (11) Incident A6 indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell;
[0248] (12) B1 event, indicating that the service quality of neighboring cells in different systems is greater than the eleventh threshold;
[0249] (13) Event B2 indicates that the service quality of the serving cell is lower than the twelfth threshold and the service quality of neighboring cells in different systems is higher than the thirteenth threshold;
[0250] (14) I1 event, indicating that the interference power is higher than the fourteenth threshold;
[0251] (15) C1 event, indicating that the side link channel busy rate is higher than the fifteenth threshold;
[0252] (16) C2 event, indicating that the sidelink channel busy rate is lower than the sixteenth threshold;
[0253] (17) D1 event, indicating that the distance from the terminal to the first reference position is greater than the seventeenth threshold;
[0254] (18) D2 event, indicating that the distance between the terminal and the mobile reference location of the serving cell is less than the eighteenth threshold.
[0255] Optionally, the entry conditions mentioned in the embodiments of this application can be understood as the conditions for starting to report QoE reports; the exit conditions can be understood as the conditions for stopping to report QoE reports.
[0256] In at least one embodiment of this application, the QoE report includes at least one of the following:
[0257] The QoE measurement information that satisfies the measurement reporting event;
[0258] The first indication information is used to indicate that the QoE measurement quantity satisfies the measurement reporting event.
[0259] It should be noted that the events mentioned in the embodiments of this application can also be understood as conditions; the QoE measurement can also be understood as the QoE measurement value, and no specific limitation is made here.
[0260] In some embodiments, the QoE measurement information includes at least one of the following:
[0261] A first identifier (such as measurement ID) is used to identify the QoE measurement;
[0262] Service type;
[0263] Subtypes of service types;
[0264] QoE measurements corresponding to the service type and / or the subtype;
[0265] A time stamp is used to identify the time of QoE measurement.
[0266] The downlink signal measurement value corresponding to the timestamp;
[0267] The acceleration of the terminal;
[0268] Terminal speed;
[0269] The terminal's perception results;
[0270] The direction of movement of the terminal.
[0271] The QoE measurement includes at least one of the following:
[0272] Average throughput, initial playback latency, or buffering level, etc.;
[0273] Mean opinion score (MOS) related to speech quality;
[0274] Video resolution, frame rate, packet loss rate, jitter, or latency, etc.
[0275] During a video call, the frame rate per second, the stuttering of audio and video, and whether the audio and video are synchronized are all important factors.
[0276] Position accuracy, velocity accuracy, distance resolution, velocity resolution, recognition accuracy, false alarm probability, false alarm rate, and sensing service latency or refresh rate.
[0277] AI model inference accuracy, AI model inference latency, AI model training latency, AI model training accuracy, AI service computing speed, and AI service computing intensity;
[0278] Calculate latency, calculation speed, calculation intensity, and calculation failure rate (or calculation success rate); for example, the calculation failure rate is calculated as the number of failed requests per unit time (e.g., per second, per 5 minutes, per day, etc.) divided by the total number of valid requests per unit time; as another example, the calculation success rate is calculated as the number of successful requests per unit time (e.g., per second, per 5 minutes, per day, etc.) divided by the total number of valid requests per unit time.
[0279] It should be noted that the service type or subtype in the first information is network configuration information, and is optional when reported by the terminal. For example, when the network configures multiple service subtypes for QoE measurement under a measurement ID, the terminal will include the service type subtype when reporting the QoE report.
[0280] In one implementation, the first network-side device receives QoE reports from terminals. By collecting QoE data for new service types or subtypes, the first network-side device (or, through interaction with other network functions) can better analyze whether QoE issues exist. Configuring the reporting of trigger events allows for more precise collection of QoE measurements for service types that meet the trigger event. Compared to reporting all QoE, this reduces the amount of data and provides more flexible support for QoE collection in special scenarios where operators or terminals may experience poor quality of life (such as location type or signal quality characteristics). For example, configuring the reporting of trigger events can collect QoE data in subway cars where the average number of video stutters is greater than 1 and the serving cell's RSRP is greater than a threshold.
[0281] In at least one embodiment of this application, the method further includes:
[0282] The first network-side device receives QoE measurement capability information sent by the terminal; the QoE measurement capability information includes at least one of the following:
[0283] QoE measurement indication is used to indicate whether the terminal supports QoE measurement;
[0284] The terminal supports the following service types for QoE measurement:
[0285] The terminal supports subtypes of the service types for QoE measurement;
[0286] The first network-side device determines the first information based on the obtained QoE measurement capability information.
[0287] Since QoE involves the application processor (AP) on the terminal, it typically requires the cooperation of the terminal modem, operating system, and other components to perform QoE measurement and reporting. Therefore, terminal-reported QoE measurement capability information is more helpful for the network to select appropriate terminals for QoE collection.
[0288] In some embodiments of this application, the QoE measurement can be triggered by a first network-side device through first information, or it can be triggered by a terminal.
[0289] The terminal-triggered QoE measurement process helps the terminal trigger the network to collect QoE measurements for that terminal. Optionally, the network can perform QoE quality analysis on the terminal and optimize its QoE quality through configuration. The advantage of this approach is that the terminal can initiate QoE measurements on demand based on the experience quality of a specific service type or subtype, rather than passively receiving QoE measurement configurations from the network. Terminal-triggered QoE measurement collection is more effective in identifying and addressing poor QoE quality issues and their causes, enabling optimization tailored to that terminal. This embodiment can effectively identify and resolve issues caused by differences in the experience quality of various terminals.
[0290] In one implementation, the method further includes:
[0291] The first network-side device receives a first QoE measurement request sent by the terminal, the first QoE measurement request being used to request QoE measurement;
[0292] The first network-side device sends a first QoE measurement response to the terminal based on the first QoE measurement request. The first QoE measurement response is used to indicate acceptance of the first QoE measurement request.
[0293] In another implementation, the method further includes:
[0294] The first network-side device receives a second QoE measurement request sent by the terminal, the second QoE measurement request being used to request QoE measurement; correspondingly, step 301 includes:
[0295] The first network-side device sends a second QoE measurement response to the terminal according to the second QoE measurement request. The second QoE measurement response is used to indicate acceptance of the second QoE measurement request, and the second QoE measurement response also carries the first information.
[0296] In this embodiment, the terminal sends a QoE measurement request to the first network device. Since different terminals use different services at different times with varying frequencies, different users have different levels of concern regarding the QoE of different services, and different users have different QoE requirements for the same service (e.g., some users prioritize high definition, while others prioritize smoothness). Therefore, the terminal determines which QoE measurement request to send based on its needs (a first QoE measurement request and / or a second QoE measurement request).
[0297] As an optional embodiment, a first network-side device receives a QoE measurement request sent by a terminal. The first network-side device (or the first network-side device interacting with other network functions) determines whether to accept the QoE measurement request. For example, if the terminal's QoE measurement helps the network discover, analyze, or resolve problems, and the network can schedule appropriate resources to satisfy the QoE measurement request, then the QoE measurement request is accepted. The first network-side device sends a QoE measurement response to the terminal, the QoE measurement response including at least an acceptance or rejection statement to indicate acceptance or rejection of the corresponding QoE measurement request. Optionally, if the QoE request is accepted, the QoE measurement response may further include the aforementioned first information; or, the first information may be a new message independent of the QoE measurement response, for example, the first network-side device sends the first information to the terminal after sending the QoE measurement response or simultaneously with it. Optionally, if the QoE request is rejected, the QoE measurement response may further include a rejection reason, such as insufficient resources or lack of interest.
[0298] In some embodiments, the first QoE measurement request and / or the second QoE measurement request includes at least one of the following:
[0299] Service type indicates the type of QoE measurement requested by the terminal;
[0300] Subtype of service type, indicating the subtype of the above service type;
[0301] QoE type, indicating the type of QoE measurement requested by the terminal;
[0302] Reporting type indicates the reporting type of the QoE report requested by the terminal for the QoE measurement;
[0303] Measurement reporting event, indicating the measurement reporting event of the QoE measurement requested by the terminal.
[0304] It should be noted that the definitions of the above service types, subtypes, QoE types, reporting types, and measurement reporting events are consistent with those in the above embodiments, and will not be repeated here.
[0305] Optionally, after the terminal receives the QoE measurement response from the first network-side device, if the first network-side device accepts the QoE measurement request, then the terminal performs a QoE measurement based on the first information and sends a QoE report. After the first network-side device receives the QoE report from the terminal:
[0306] Optionally, the first network-side device (or the first network-side device interacting with other network functions) determines whether to continue collecting QoE based on the received QoE report. If it is necessary to continue collecting QoE, the first network side can select a suitable terminal to continue collecting QoE using a network-triggered QoE measurement procedure.
[0307] Optionally, the first network-side device (or the first network-side device interacting with other network functions) discovers or analyzes the experience quality issues of the terminal that triggered QoE collection, and sends a configuration message to the terminal to optimize the experience quality. The configuration message may include switching configuration information, uplink resource configuration, downlink resource configuration, QoS parameter configuration, etc. For example, for terminals in a subway scenario, the ultimate goal is to enable terminals inside the carriage to access cells covering the track area, and terminals on the platform to access cells covering the platform area.
[0308] In summary, in this embodiment, the network-side device configures the terminal with first information for QoE measurement, enhancing the flexibility of the QoE measurement process. Specifically, it expands the service types supported by QoE measurement, or expands the subtypes under each service type, or expands the QoE type corresponding to QoE measurement, or expands the reporting type corresponding to the QoE report of QoE measurement. This allows for more flexible or refined QoE measurement collection, enabling more accurate analysis of QoE issues and addressing the problem that existing QoE collection processes cannot meet the performance requirements of next-generation networks.
[0309] like Figure 4 As shown in the embodiments of this application, a QoE measurement method is also provided, the method comprising:
[0310] Step 401: The second network-side device receives an auxiliary measurement request sent by the terminal. The auxiliary measurement request is used to request the second network-side device to measure the QoE of the terminal.
[0311] Step 402: The second network-side device measures the QoE of the terminal according to the auxiliary measurement request and obtains a QoE report.
[0312] In this embodiment, the second network-side device can be a wireless access network node (such as a base station), a core network function node (such as an AMF), or a new service function node, without specific limitations. Among these, the new service function node may potentially be a data plane function (DPF), a sensing function (SF), an artificial intelligence function (AIF), a computing function (CF), an AI control function (AICF), a computing control function (CCF), an external service AI function (NET for AIF), an internal service AI function (such as a network data analytics function (NWDAF)), an external service computing function (NET for Computing function (NETforCF), an internal service computing function (Computing for NET function (CforNETF), an internal service sensing function (Sensing for NET function), or an external service sensing function (NET for Sensing function), etc.
[0313] This application embodiment assumes that the network can obtain the terminal's QoE, and the terminal requests the network's assistance in collecting QoE measurements. As mentioned earlier, QoE measurement and reporting by the terminal typically requires the collaboration of the terminal's modem, operating system, and application functions. For services provided by operators, such as the aforementioned multimedia telephony service of the Internet Protocol Multimedia Subsystem, operator-provided sensing services, AI services, or computing services, the network can obtain the terminal's QoE. Simultaneously, some OTT application servers also cooperate with operators, so the network may also obtain the QoE of terminals providing these cooperative services. Furthermore, network-assisted QoE measurement and collection by the terminal helps the network monitor and optimize the user experience for that terminal and can save on the transmission overhead of QoE reports.
[0314] In some embodiments of this application, the auxiliary measurement request includes at least one of the following:
[0315] Service type, used to indicate the type of auxiliary measurement service requested by the terminal; the service type includes at least one of the following: extended reality XR service, sensing service, artificial intelligence AI service, computing service, streaming media service, and multimedia telephony service of Internet Protocol Multimedia Subsystem;
[0316] Subtypes of service types; optionally, depending on the services that different terminals or networks are interested in, the subtype can be a type smaller than the service type range;
[0317] QoE type, the QoE type includes at least one of the following: immediate transmission after acquisition, storage before transmission;
[0318] The sending type indicates the method of sending QoE reports; the sending type includes at least one of the following: no report, event-triggered sending, and periodic sending;
[0319] A measurement target list is used to indicate the cells for which the QoE measurement of the terminal is performed; the cells include the serving cell and / or neighboring cells; optionally, the cells for which the QoE measurement of the terminal is performed can be the terminal's serving cell by default;
[0320] Measure the sent event.
[0321] Optionally, carrying the service type and / or subtype in the auxiliary measurement request enables network-side devices to collect QoE for new services or more accurate service subtypes. This supports 6G sensing services, AI services, or computing services, and also solves the problem that the QoE of a service subtype is hidden in all the data of the service type to which the subtype belongs, making it difficult to discover the problem of poor experience quality and analyze the cause.
[0322] Optionally, QoE measurements can be filtered by configuring QoE type and / or transmission type, reducing the amount of data in QoE reports and enabling QoE measurements in more granular situations, thereby better supporting QoE collection and experience optimization in scenarios of concern to operators or terminals.
[0323] This application's embodiments support terminal-triggered QoE measurement, which helps in QoE collection and optimization for a specific terminal.
[0324] This application embodiment supports the terminal requesting the network-side device to measure the terminal's QoE. On the one hand, this allows the terminal to obtain QoE information from the network-side device. On the other hand, the network-side device can also perform network configuration based on the terminal's QoE measurement to achieve rapid QoE optimization and loop closure, saving the transmission resources of QoE reports.
[0325] Optionally, the QoE type can be sent immediately after acquisition, such as Immediate QoE; or it can be stored first and then sent, such as Logged QoE.
[0326] In one implementation, during the data collection phase, a "store first, then send" approach can be used. This reduces the number of times network-side devices send QoE reports, lowering communication overhead. In another implementation, during the real-time QoE quality optimization phase, data can be collected and sent immediately, ensuring the network sends QoE reports promptly.
[0327] Alternatively, voice or video call services are currently provided by both operators through the IP Multimedia Subsystem (IMS) and by over-the-top (OTT) service providers.
[0328] Optionally, the aforementioned sensing services may include: sensing services provided by the operator; the aforementioned AI services may include: AI services provided by the operator; and the aforementioned computing services may include: computing services provided by the operator.
[0329] Optionally, for transmission types configured as event-triggered, the measurement transmission trigger configuration triggers the second network-side device to report measurement results. For transmission types configured not to report, the measurement transmission trigger configuration can be called a QoE optimization trigger configuration, or a trigger configuration that instructs the terminal to request QoE optimization. Typically, the measurement transmission trigger configuration includes a measurement transmission event.
[0330] It should be noted that the definitions of the subtypes of the above service types are the same as those in the above embodiments, and will not be repeated here.
[0331] In some embodiments, the measurement transmission event includes at least one of the following:
[0332] (1) The QoE measurement value of the serving cell meets the nineteenth threshold; for example, the entry condition is that the MOS (Mean Opinion Score) value related to voice quality is less than 3 points, and the exit condition is that the MOS value is greater than 3; or the entry condition is that the initial playback delay is not greater than 1 second, and the exit condition is that the initial playback delay is less than 0.5 seconds; or the entry condition is that the average number of stutters per minute is greater than 1, and the exit condition is that the average number of stutters per minute is greater than 2; or the entry condition is that the perception performance index (such as position accuracy, speed accuracy) is less than the fifth threshold, and the exit condition is that the aforementioned perception performance index is greater than the fifth threshold; or the entry condition is that the perception performance index (distance resolution, speed resolution or perception latency) is greater than the fifth threshold, and the exit condition is that the aforementioned perception performance index is less than the fifth threshold; or the AI performance index (such as inference accuracy) is not greater than the fifth threshold; or the computational performance index (such as computational latency) is not less than the fifth threshold, etc. If a QoE measurement configuration includes multiple service types or multiple service subtypes, the measurement sending event can be represented in a list format as the threshold that the QoE measurement of each service type or subtype needs to meet, or it can be the average QoE measurement value of multiple service types or multiple service subtypes that meets the fifth threshold.
[0333] (2) The difference between the QoE measurements of the serving cell meets the twentieth threshold; optionally, the difference between the QoE measurements can be the difference between the average values of QoE measurements over two specified time intervals, or the difference between the QoE measurements at two specific time points, or the difference between the maximum and minimum QoE measurements within a certain time interval. It is understood that the difference between QoE measurements can reflect or indicate changes in QoE. For example, if the difference between the MOS value in time interval T1 and the MOS value in time interval T1+delta is greater than 2, it indicates a deterioration in voice quality. As another example, if the difference between the MOS value in time interval T1+delta and the MOS value in time interval T1 is greater than 2, it indicates an improvement in voice quality. As yet another example, if the difference between the initial playback delay in time interval T1+delta and the initial playback delay in time interval T1 is greater than 1. For example, the difference between QoE measurements represents the change in QoE within delta T1 for the aforementioned perception performance indicators, AI performance indicators, or computing performance indicators. Specific examples such as position accuracy, inference accuracy, or computing latency will not be provided here. The difference between the aforementioned QoE measurements within delta T1 can reflect or indicate the change in QoE within delta T1.
[0334] (3) The fluctuations between the QoE measurements of the serving cell meet the twenty-first threshold; the fluctuations are used to indicate the stability of QoE; the fluctuations are used to indicate the stability of QoE; for example, the variance or standard deviation of the QoE measurements within the time interval delta T2 is not greater than the third threshold; for example, when the QoE measurements within a certain time interval are X1……Xn, and the mean is X', the variance = 1 / n*(X1-X'). 2 +……+(Xn-X') 2 ;
[0335] (4) The predicted QoE value of the neighboring cell meets the twenty-second threshold. When the network has the QoE prediction capability, it can assist the terminal in predicting the QoE measurement of the neighboring cell.
[0336] (5) The QoE quality of the serving cell is less than the twenty-third threshold, and the predicted QoE value of the neighboring cell meets the twenty-fourth threshold.
[0337] (6) The difference between the predicted QoE value of the neighboring cell and the measured QoE value of the serving cell satisfies the 25th threshold, and the predicted QoE value of the neighboring cell is greater than the measured QoE value of the serving cell.
[0338] (7) The time interval of QoE measurement satisfies the twenty-sixth threshold; optionally, the time interval can be obtained by the following parameters: QoE measurement start time and end time; or QoE measurement start time and measurement duration; or QoE measurement end time and measurement duration.
[0339] (8) The location information or environmental information of the terminal during QoE measurement meets the first condition; for example, the location type or environmental type of the terminal during measurement is indoor or outdoor, or the location type or environmental type of the terminal during measurement is inside a subway car or subway platform, or the location type of the terminal during measurement is inside or outside an elevator car, or the location type of the terminal during measurement is inside a high-speed rail car or high-speed rail platform or high-speed rail surrounding area, or the location type of the terminal during measurement is inside or outside an underground parking garage, or the location type of the terminal during measurement is inside or outside a tunnel, or the location type of the terminal during measurement is on a ship or beach or surrounding residential area, etc.
[0340] (9) Event A1 indicates that the service quality of the serving cell is higher than the fifth threshold; for example, Event A1, Serving becomes better than threshold;
[0341] (10) Event A2 indicates that the service quality of the serving cell is lower than the sixth threshold; for example, Event A2, Serving becomes worse than threshold;
[0342] (11) Event A3 indicates that the difference between the service quality of the neighboring cell and the service quality of the serving cell is greater than the seventh threshold; for example, Event A3, Neighbour becomes offset better than SpCell;
[0343] (12) Event A4 indicates that the service quality of the neighboring cell is higher than the eighth threshold; e.g., Event A4, Neighbour becomes better than threshold);
[0344] (13) Event A5 indicates that the service quality of the serving cell is lower than the ninth threshold and the service quality of the neighboring cell is higher than the tenth threshold; for example, Event A5, SpCell becomes worse than threshold1 and neighbor becomes better than threshold2.
[0345] (14) Event A6 indicates that the service quality of the neighboring cell is higher than that of the secondary cell; for example, Event A6, Neighbour becomes offset better than SCell;
[0346] (15) Event B1 indicates that the service quality of the inter-system neighbor is greater than the eleventh threshold; for example, Event B1, InterRAT neighbor becomes better than threshold.
[0347] (16) Event B2 indicates that the service quality of the serving cell is lower than the twelfth threshold and the service quality of the inter-system neighboring cells is higher than the thirteenth threshold; for example, Event B2, PCell becomes worse than threshold1 and inter RATneighbour becomes better than threshold2.
[0348] (17) Event I1 indicates that the interference power is higher than the fourteenth threshold; for example, Event I1, Interference becomes higher than threshold.
[0349] (18) Event C1 indicates that the sidelink channel busy ratio is above the fifteenth threshold; for example, Event C1, The sidelinkchannel busy ratio is above a threshold;
[0350] (19) Event C2 indicates that the sidelink channel busy ratio is below the sixteenth threshold; for example, Event C2, The sidelinkchannel busy ratio is below a threshold;
[0351] (20) Event D1 indicates that the distance between the UE and referenceLocation1 is above threshold1 and the distance between the UE and referenceLocation2 is below threshold2.
[0352] (21) Event D2 indicates that the distance between the UE and the serving cell moving reference location is less than the eighteenth threshold; for example, Event D2, Distance between UE and the serving cell moving reference location is above threshold1 and distance between UE and a moving reference location is below threshold2.
[0353] Optionally, the aforementioned measurement transmission event may further include: QoE problem delimitation, also known as poor experience quality cause analysis. QoE problem delimitation refers to the ability of the network-side device to delimit the poor experience quality when it discovers a QoE problem after performing QoE measurements. An example of QoE problem delimitation includes at least one of the following: terminal, network-side device, application server, and environment, respectively indicating that the poor experience quality is caused by the terminal, network, application server, or environment. It is necessary to support situations where the service is provided by an operator's network, such as when the operator provides sensing services or AI services. If the problem is with the sensing function or AI node, then the QoE problem delimitation is the network. Alternatively, the network-side device can be further divided into two categories: network transmission and network service QoE problem delimitation. Another example includes the terminal, network-side device, or others. Since the terminal is more concerned with whether the problem is its own, the latter two can basically meet this requirement. Optionally, the aforementioned measurement transmission event may also include the confidence level of the QoE problem delimitation. Since the network side may also be analyzing based on the data collected at the moment, the delimitation of the QoE problem needs to be explained with confidence level.
[0354] In at least one embodiment of this application, the method further includes:
[0355] The second network-side device sends an auxiliary measurement response to the terminal, the auxiliary measurement response being used to indicate whether to accept or reject the auxiliary measurement request.
[0356] In some embodiments, the second network-side device receives a QoE measurement request from the terminal. The second network-side device (or interacts with other network functions) determines whether to accept the QoE measurement request. The second network-side device sends a QoE measurement response to the terminal, the QoE measurement response including at least an acceptance or rejection statement to indicate whether the QoE measurement request is accepted or rejected. Optionally, if the QoE request is rejected, the QoE measurement response may further include a reason for rejection, such as insufficient resources.
[0357] It should be noted that the auxiliary measurement request mentioned in the embodiments of this application can also be referred to as a network-assisted auxiliary measurement request, and the auxiliary measurement response can also be referred to as a network-assisted QoE measurement response.
[0358] In at least one embodiment of this application, the method further includes:
[0359] The second network-side device sends the QoE report to the terminal.
[0360] If the second network-side device accepts a network-assisted QoE measurement request, and the transmission type is periodic or event-triggered, then the terminal receives the QoE report sent by the second network-side device. The QoE report may contain QoE reports from multiple cells.
[0361] Optionally, the QoE report includes at least one of the following:
[0362] The QoE measurement information that satisfies the measurement transmission event;
[0363] The second indication information is used to indicate that the QoE measurement quantity satisfies the measurement transmission event.
[0364] In some embodiments, the QoE measurement information includes at least one of the following:
[0365] A first identifier (such as measurement ID) is used to identify the QoE measurement;
[0366] Service type;
[0367] Subtypes of service types;
[0368] QoE measurements corresponding to the service type and / or the subtype;
[0369] A time stamp is used to identify the time of a QoE measurement.
[0370] The uplink signal measurement value corresponding to the timestamp; such as RSRP (Reference Signal Receiving Power), RSRQ (Reference Signal Receiving Quality), SINR (Signal to Interference plus Noise Ratio) or SNR (Signal to Noise Ratio), etc.
[0371] The sensing results acquired by the second network-side device; for example, if the second network-side device has sensing capabilities, then it can generate sensing results. Or, for example, if the second network-side device is an IMS (In-Service Management System), then it can acquire sensing results from the core network sensing function. The core network sensing function obtains sensing results based on the sensing measurements taken by the base station. The base station can perform sensing through self-transmitted and self-received sensing signals, or by receiving sensing signals sent by other base stations or terminals. Sensing results include whether there is a Line of Sight (LOS) path between the terminal and the serving cell, etc.
[0372] The target cell load information corresponding to the QoE measurement, such as uplink physical resource block (PRB) utilization, downlink PRB utilization, number of active users, uplink throughput, or downlink throughput. This information may be serving cell load information and / or neighboring cell load information;
[0373] Terminal-level performance information, such as average uplink RLC (Radio Link Control) throughput, average downlink RLC throughput, average packet delay (uplink, downlink, or round trip), and average packet loss rate (uplink / downlink average packet loss rate).
[0374] The QoE measurement includes at least one of the following:
[0375] Average throughput, initial playback latency, or buffering level, etc.;
[0376] The MOS (mean opinion score) related to speech quality;
[0377] Video resolution, frame rate, packet loss rate, jitter, or latency, etc.
[0378] During a video call, the frame rate per second, the stuttering of audio and video, and whether the audio and video are synchronized are all important factors.
[0379] Position accuracy, velocity accuracy, distance resolution, velocity resolution, recognition accuracy, false alarm probability, false alarm rate, and sensing service latency or refresh rate.
[0380] AI model inference accuracy, AI model inference latency, AI model training latency, AI model training accuracy, AI service computing speed, and AI service computing intensity;
[0381] Calculate latency, calculation speed, calculation intensity, and calculation failure rate (or calculation success rate); for example, the calculation failure rate is calculated as the number of failed requests per unit time (e.g., per second, per 5 minutes, per day, etc.) divided by the total number of valid requests per unit time; as another example, the calculation success rate is calculated as the number of successful requests per unit time (e.g., per second, per 5 minutes, per day, etc.) divided by the total number of valid requests per unit time.
[0382] Optionally, the terminal can determine whether to perform cell handover based on the QoE prediction of neighboring cells.
[0383] In some embodiments, if the second network-side device accepts a QoE measurement request and the transmission type is "no report," then the terminal receives a configuration message sent by the second network-side device. The second network-side device (or the second network-side device interacting with other network functions) discovers or analyzes the terminal's quality of experience (QoS) issues and sends a configuration message to the terminal to optimize the QoS. The configuration message may include switching configuration information, uplink resource configuration, downlink resource configuration, and QoS parameter configuration. For example, for terminals in a subway scenario, the ultimate goal is to enable terminals inside the carriage to access cells covering the track area, and terminals on the platform to access cells covering the platform area.
[0384] In summary, in the QoE measurement method provided in this application embodiment, the terminal requests a second network-side device to measure its QoE via an auxiliary measurement request. This allows the second network-side device to measure the terminal's QoE based on the auxiliary measurement request and obtain a QoE report. This facilitates QoE monitoring and optimization for the terminal by the second network-side device and saves on QoE report transmission overhead. It is understood that this application embodiment also supports the terminal requesting the network to collect its QoE. This allows the terminal to obtain QoE information from the application server side, and the network can also perform network configuration based on the terminal's QoE collection to achieve a rapid QoE optimization loop, saving QoE report transmission resources.
[0385] like Figure 5As shown in the embodiments of this application, a QoE measurement method is also provided, the method comprising:
[0386] Step 501: The terminal sends an auxiliary measurement request to the second network-side device, the auxiliary measurement request being used to request the second network-side device to measure the QoE of the terminal;
[0387] Step 502: The terminal receives an auxiliary measurement response sent by the second network-side device, the auxiliary measurement response being used to indicate whether to accept or reject the auxiliary measurement request.
[0388] In some embodiments, the second network-side device receives a network-assisted QoE measurement request sent by the terminal. The second network-side device (or interacting with other network functions) determines whether to accept the network-assisted QoE measurement request. The second network-side device sends a network-assisted QoE measurement response to the terminal. The network-assisted QoE measurement response includes at least an acceptance or rejection option to indicate whether the QoE measurement request is accepted or rejected. Optionally, if the QoE request is rejected, the QoE measurement response may further include a rejection reason, such as insufficient resources.
[0389] In this embodiment, the second network-side device can be a wireless access network node (such as a base station), a core network function node (such as an AMF), or a new service function node, without specific limitations. Among these, the new service function node may potentially be a data plane function (DPF), a sensing function (SF), an artificial intelligence function (AIF), a computing function (CF), an AI control function (AICF), a computing control function (CCF), an external service AI function (NET for AIF), an internal service AI function (such as a network data analytics function (NWDAF)), an external service computing function (NET for Computing function (NETforCF), an internal service computing function (Computing for NET function (CforNETF), an internal service sensing function (Sensing for NET function), or an external service sensing function (NET for Sensing function), etc.
[0390] This application embodiment assumes that the network can obtain the terminal's QoE, and the terminal requests the network to assist in QoE measurement and collection. As mentioned above, terminal QoE measurement and reporting typically requires the collaboration of the terminal's modem, operating system, and application functions. For services provided by operators, such as the aforementioned multimedia telephony service of the Internet Protocol Multimedia Subsystem, operator-provided sensing services, AI services, or computing services, the network can obtain the terminal's QoE. Simultaneously, some OTT application servers also cooperate with operators, so the network may also obtain the QoE of terminals providing these cooperative services. Furthermore, network-assisted terminal QoE measurement and collection helps the network monitor and optimize the user experience for that terminal, and can save on QoE report transmission overhead. It is understood that this application embodiment also supports the terminal requesting the network to collect its QoE, enabling the terminal to obtain QoE information from the application server side, and allowing the network to perform network configuration based on the terminal's QoE collection to achieve a rapid QoE optimization loop, saving QoE report transmission resources.
[0391] In some embodiments of this application, the auxiliary measurement request includes at least one of the following:
[0392] Service type, used to indicate the type of auxiliary measurement service requested by the terminal; the service type includes at least one of the following: extended reality XR service, sensing service, artificial intelligence AI service, computing service, streaming media service, and multimedia telephony service of Internet Protocol Multimedia Subsystem;
[0393] Subtypes of service types; optionally, depending on the services that different terminals or networks are interested in at different times, the subtypes of service types can be subtypes composed of multiple services that are smaller than the scope of service types, or they can be a single service;
[0394] QoE type, the QoE type includes at least one of the following: immediate transmission after acquisition, storage before transmission;
[0395] The sending type indicates the method of sending QoE reports; the sending type includes at least one of the following: no report, event-triggered sending, and periodic sending;
[0396] A measurement target list is used to indicate the cells for which the QoE measurement of the terminal is performed; the cells include the serving cell and / or neighboring cells; optionally, the cells for which the QoE measurement of the terminal is performed can be the terminal's serving cell by default;
[0397] Measure the sent event.
[0398] Optionally, the QoE type can be sent immediately after acquisition, such as Immediate QoE; or it can be stored first and then sent, such as Logged QoE.
[0399] Alternatively, voice or video call services are currently provided by both operators through the IP Multimedia Subsystem (IMS) and by over-the-top (OTT) service providers.
[0400] Optionally, the aforementioned sensing services may include: sensing services provided by the operator; the aforementioned AI services may include: AI services provided by the operator; and the aforementioned computing services may include: computing services provided by the operator.
[0401] Optionally, for transmission types configured as event-triggered, the second network-side device is triggered to send measurements or measurement results via the measurement transmission trigger configuration. For transmission types configured as non-reporting, the measurement transmission trigger configuration can be called a QoE optimization trigger configuration, or a trigger configuration that instructs the terminal to request QoE optimization. Typically, the measurement transmission trigger configuration includes a measurement transmission event.
[0402] It should be noted that the definitions of the subtypes of the above service types are the same as those in the above embodiments, and will not be repeated here.
[0403] In some embodiments, the measurement transmission event includes at least one of the following:
[0404] (1) The QoE measurement value of the serving cell meets the nineteenth threshold;
[0405] (2) The difference between the QoE measurements of the serving cells meets the twentieth threshold;
[0406] (3) The fluctuations between the QoE measurements of the serving cells meet the twenty-first threshold;
[0407] (4) The predicted QoE value of the neighboring cell meets the twenty-second threshold. When the network has the QoE prediction capability, it can assist the terminal in predicting the QoE measurement of the neighboring cell.
[0408] (5) The QoE quality of the serving cell is less than the twenty-third threshold, and the predicted QoE value of the neighboring cell meets the twenty-fourth threshold.
[0409] (6) The difference between the predicted QoE value of the neighboring cell and the measured QoE value of the serving cell satisfies the 25th threshold, and the predicted QoE value of the neighboring cell is greater than the measured QoE value of the serving cell.
[0410] (7) The time interval of QoE measurement satisfies the twenty-sixth threshold;
[0411] (8) The location or environmental information of the terminal during QoE measurement meets the first condition;
[0412] (9) Event A1 indicates that the service quality of the serving cell is higher than the fifth threshold;
[0413] (10) Event A2 indicates that the service quality of the serving cell is below the sixth threshold;
[0414] (11) Event A3 indicates that the difference between the service quality of the neighboring cell and the service quality of the serving cell is greater than the seventh threshold;
[0415] (12) Event A4 indicates that the service quality of the neighboring cell is higher than the eighth threshold;
[0416] (13) Event A5 indicates that the service quality of the serving cell is lower than the ninth threshold and the service quality of the neighboring cells is higher than the tenth threshold.
[0417] (14) Incident A6 indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell;
[0418] (15) B1 event, indicating that the service quality of neighboring cells in different systems is greater than the eleventh threshold;
[0419] (16) B2 event indicates that the service quality of the serving cell is lower than the twelfth threshold and the service quality of neighboring cells in different systems is higher than the thirteenth threshold;
[0420] (17) I1 event indicates that the interference power is higher than the fourteenth threshold;
[0421] (18) C1 event, indicating that the side link channel busy rate is higher than the fifteenth threshold;
[0422] (19) C2 event, indicating that the side link channel busy rate is lower than the sixteenth threshold;
[0423] (20) D1 event, indicating that the distance from the terminal to the first reference position is greater than the seventeenth threshold;
[0424] (21) D2 event indicates that the distance between the terminal and the mobile reference location of the serving cell is less than the eighteenth threshold.
[0425] In at least one embodiment of this application, the method further includes:
[0426] The terminal receives the QoE report sent by the second network-side device.
[0427] If the second network-side device accepts a network-assisted QoE measurement request, and the transmission type is periodic or event-triggered, then the terminal receives the QoE report sent by the second network-side device. The QoE report may contain QoE reports from multiple cells.
[0428] Optionally, the QoE report includes at least one of the following:
[0429] The QoE measurement information that satisfies the measurement transmission event;
[0430] The second indication information is used to indicate that the QoE measurement quantity satisfies the measurement transmission event.
[0431] In some embodiments, the QoE measurement information includes at least one of the following:
[0432] A first identifier (such as measurement ID) is used to identify the QoE measurement;
[0433] Service type;
[0434] Subtypes of service types;
[0435] QoE measurements corresponding to the service type and / or the subtype;
[0436] A time stamp is used to identify the time of a QoE measurement.
[0437] The uplink signal measurement value corresponding to the timestamp; such as RSRP (Reference Signal Receiving Power), RSRQ (Reference Signal Receiving Quality), SINR (Signal to Interference plus Noise Ratio) or SNR (Signal to Noise Ratio), etc.
[0438] The sensing results acquired by the second network-side device; for example, if the second network-side device has sensing capabilities, then it can generate sensing results. Or, for example, if the second network-side device is an IMS (In-Service Management System), then it can acquire sensing results from the core network sensing function. The core network sensing function obtains sensing results based on the sensing measurements taken by the base station. The base station can perform sensing through self-transmitted and self-received sensing signals, or by receiving sensing signals sent by other base stations or terminals. Sensing results include whether there is a Line of Sight (LOS) path between the terminal and the serving cell, etc.
[0439] The target cell load information corresponding to the QoE measurement, such as uplink physical resource block (PRB) utilization, downlink PRB utilization, number of active users, uplink throughput, or downlink throughput. This information may be serving cell load information and / or neighboring cell load information;
[0440] Terminal-level performance information, such as average uplink RLC (Radio Link Control) throughput, average downlink RLC throughput, average packet delay (uplink, downlink, or round trip), and average packet loss rate (uplink / downlink average packet loss rate).
[0441] The QoE measurement includes at least one of the following:
[0442] Average throughput, initial playback latency, or buffering level, etc.;
[0443] Mean opinion score (MOS) related to speech quality;
[0444] Video resolution, frame rate, packet loss rate, jitter, or latency, etc.
[0445] During a video call, the frame rate per second, the stuttering of audio and video, and whether the audio and video are synchronized are all important factors.
[0446] Position accuracy, velocity accuracy, distance resolution, velocity resolution, recognition accuracy, false alarm probability, false alarm rate, and sensing service latency or refresh rate.
[0447] AI model inference accuracy, AI model inference latency, AI model training latency, AI model training accuracy, AI service computing speed, and AI service computing intensity;
[0448] Calculate latency, calculation speed, calculation intensity, and calculation failure rate (or calculation success rate); for example, the calculation failure rate is calculated as the number of failed requests per unit time (e.g., per second, per 5 minutes, per day, etc.) divided by the total number of valid requests per unit time; as another example, the calculation success rate is calculated as the number of successful requests per unit time (e.g., per second, per 5 minutes, per day, etc.) divided by the total number of valid requests per unit time.
[0449] Optionally, the terminal can determine whether to perform cell handover based on the QoE prediction of neighboring cells.
[0450] In summary, in the QoE measurement method provided in this application embodiment, the terminal requests a second network-side device to measure the terminal's QoE through an auxiliary measurement request. This allows the second network-side device to measure the terminal's QoE based on the auxiliary measurement request and obtain a QoE report. This facilitates QoE monitoring and optimization for the terminal by the second network-side device and saves on QoE report transmission overhead. It is understood that this application embodiment also supports the terminal requesting the network to collect the terminal's QoE. This allows the terminal to obtain QoE information from the application server side, and the network can also perform network configuration based on the terminal's QoE collection to achieve a rapid QoE optimization loop, saving QoE report transmission resources.
[0451] It should be noted that the first network-side device and the second network-side device mentioned in the embodiments of this application can be the same network-side device or different network-side devices. For example, they can be different core network devices, different access network devices, or different access network devices under a core network. No specific limitation is made here.
[0452] In at least one embodiment of this application, the QoE measurement method applied between a first network-side device and a terminal and the QoE measurement method applied between a second network-side device and a terminal provided in this application can be used in combination, that is... Figures 2-5 The steps involved in the embodiments can be combined to solve technical problems. For example, the terminal may receive the first information configured by the first network-side device and then send an auxiliary measurement request to the second network-side device; or, the terminal may send an auxiliary measurement request to the second network-side device and then receive the first information configured by the first network-side device; no specific limitation is made here.
[0453] The QoE measurement method provided in this application can be executed by a QoE measurement device. This application uses an example of a QoE measurement device executing the QoE measurement method to illustrate the QoE measurement device provided in this application.
[0454] This application provides a QoE measurement device. As an example, the QoE measurement device can be a communication device or a component within a communication device, such as a chip. The communication device can be a terminal, a network-side device, or a server, etc. Exemplarily, the terminal can be, but is not limited to, the type of terminal 11 listed above, and the network-side device can be, but is not limited to, the type of network-side device 12 listed above. This application does not impose specific limitations.
[0455] The QoE measurement device includes a receiving module, a transmitting module, and a processing module. These modules can be implemented in software or hardware. When implemented in hardware, the processing module can be implemented by a processor. For example, the processor can include general-purpose processors, special-purpose processors, etc., such as central processing units (CPUs), microprocessors, digital signal processors (DSPs), artificial intelligence (AI) processors, graphics processing units (GPUs), application-specific integrated circuits (ASICs), network processors (NPs), field-programmable gate arrays (FPGAs), or other programmable logic devices, gate circuits, transistors, discrete hardware components, etc. The receiving and transmitting modules can be implemented by a communication interface, which can include one or more of the following: transceivers, pins, circuits, buses, radio frequency units, etc.
[0456] For details, see Figure 6 When the QoE measurement device is a terminal or a component within a terminal, the QoE measurement device 600 includes:
[0457] The first receiving module 601 is used to receive first information sent by the first network-side device; the first information is used to configure the terminal's QoE measurement.
[0458] The first processing module 602 is used to perform QoE measurement based on the first information;
[0459] The first sending module 603 is used to send QoE reports;
[0460] The first information includes at least one of the following:
[0461] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0462] Subtypes of service types;
[0463] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0464] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0465] In some embodiments, the first information further indicates a measurement reporting event, which is used to trigger the terminal to report a QoE report;
[0466] The measurement reporting event includes at least one of the following:
[0467] The QoE measurement value meets the first threshold;
[0468] The difference between the QoE measurements satisfies the second threshold;
[0469] The fluctuations between QoE measurements satisfy a third threshold; these fluctuations are used to indicate the stability of QoE.
[0470] The time interval for QoE measurement meets the fourth threshold;
[0471] The location or environmental information of the terminal during QoE measurement meets the first condition;
[0472] An A1 event indicates that the service quality of the serving cell is higher than the fifth threshold.
[0473] An A2 event indicates that the service quality of the serving cell is below the sixth threshold.
[0474] An A3 event indicates that the difference between the service quality of a neighboring cell and the service quality of the serving cell is greater than the seventh threshold.
[0475] An A4 event indicates that the service quality of a neighboring cell is higher than the eighth threshold.
[0476] An A5 event indicates that the service quality of the serving cell is below the ninth threshold, while the service quality of neighboring cells is above the tenth threshold.
[0477] The A6 incident indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell;
[0478] B1 event indicates that the service quality of neighboring cells in a different system is greater than the eleventh threshold.
[0479] A B2 event indicates that the service quality of the serving cell is below the twelfth threshold, while the service quality of neighboring cells in different systems is above the thirteenth threshold.
[0480] An I1 event indicates that the interference power is higher than the fourteenth threshold.
[0481] C1 event indicates that the sidelink channel busy rate is higher than the fifteenth threshold;
[0482] C2 event indicates that the sidelink channel busy rate is below the sixteenth threshold;
[0483] The D1 event indicates that the distance from the terminal to the first reference position is greater than the seventeenth threshold.
[0484] The D2 event indicates that the distance between the terminal and the serving cell's mobile reference location is less than the eighteenth threshold.
[0485] In some embodiments, the subtype of the perception service includes at least one of the following:
[0486] Target detection and tracking services;
[0487] Environmental monitoring services;
[0488] Exercise monitoring services.
[0489] In some embodiments, the subtypes of AI services include at least one of the following:
[0490] AI model inference service;
[0491] AI model training services;
[0492] AI model distribution service;
[0493] Segmentation AI model inference service;
[0494] Large text-based model business services;
[0495] Video-based large-scale model business services;
[0496] AI task uninstallation service;
[0497] AI task online computing services.
[0498] In some embodiments, the subtype of the computing service includes at least one of the following:
[0499] Video rendering services;
[0500] Video segmentation and rendering services;
[0501] Terminal computing offloading service;
[0502] Online computing services;
[0503] Large-scale business services for online video.
[0504] In some embodiments, the subtype of the streaming service includes at least one of the following:
[0505] Application voice service;
[0506] Application video service;
[0507] Audio playback service;
[0508] Video playback service;
[0509] Live streaming service.
[0510] In some embodiments, the subtypes of the multimedia telephony service of the Internet Protocol Multimedia Subsystem include at least one of the following:
[0511] Voice service;
[0512] Video services;
[0513] Video playback service;
[0514] Live streaming service.
[0515] In some embodiments, the subtypes of XR services include at least one of the following: Augmented Reality (AR) services; Virtual Reality (VR) services.
[0516] In some embodiments, the QoE report includes at least one of the following:
[0517] The QoE measurement information that satisfies the measurement reporting event;
[0518] The first indication information is used to indicate that the QoE measurement quantity satisfies the measurement reporting event.
[0519] In some embodiments, the QoE measurement information includes at least one of the following:
[0520] A first identifier is used to identify the QoE measurement;
[0521] Service type;
[0522] Subtypes of service types;
[0523] QoE measurements corresponding to the service type and / or the subtype;
[0524] A timestamp is used to identify the time of a QoE measurement.
[0525] The downlink signal measurement value corresponding to the timestamp;
[0526] The acceleration of the terminal;
[0527] Terminal speed;
[0528] The terminal's perception results;
[0529] The direction of movement of the terminal.
[0530] In some embodiments, the apparatus further includes:
[0531] The second sending module is configured to send QoE measurement capability information to the first network-side device; the QoE measurement capability information includes at least one of the following:
[0532] QoE measurement indication is used to indicate whether the terminal supports QoE measurement;
[0533] The terminal supports the following service types for QoE measurement:
[0534] The terminal supports subtypes of the QoE measurement service types.
[0535] In some embodiments, the apparatus further includes:
[0536] The third sending module is used to send a first QoE measurement request to the first network-side device, wherein the first QoE measurement request is used to request QoE measurement.
[0537] The third receiving module is used to receive the first QoE measurement response sent by the first network-side device, wherein the first QoE measurement response is used to indicate acceptance of the first QoE measurement request.
[0538] In some embodiments, the apparatus further includes:
[0539] The fourth sending module is used to send a second QoE measurement request to the first network-side device, wherein the second QoE measurement request is used to request QoE measurement;
[0540] The first receiving module includes:
[0541] The first receiving submodule is configured to receive a second QoE measurement response sent by the first network-side device. The second QoE measurement response is used to indicate acceptance of the second QoE measurement request, and the second QoE measurement response also carries the first information.
[0542] In some embodiments, the first QoE measurement request and / or the second QoE measurement request includes at least one of the following:
[0543] Service type;
[0544] Subtypes of service types;
[0545] QoE type;
[0546] Reporting type;
[0547] Measurement and reporting events.
[0548] The QoE measurement device provided in this application enhances the flexibility of the QoE measurement process by using the first information configured for terminal QoE measurement on the network-side equipment. Specifically, it expands the service types supported by QoE measurement, or expands the subtypes under each service type, or expands the QoE type corresponding to QoE measurement, or expands the reporting type corresponding to QoE measurement QoE reports. This allows for more flexible or refined QoE measurement collection, enabling more accurate analysis of QoE issues and addressing the problem that existing QoE collection processes cannot meet the performance requirements of next-generation networks.
[0549] For details, see Figure 7 When the QoE measurement device is a network-side device or a component within a network-side device, the QoE measurement device 700 includes:
[0550] The fifth sending module 701 is used to send first information to the terminal; the first information is used to configure the terminal's QoE measurement.
[0551] The fifth receiving module 702 is configured to receive a QoE report sent by the terminal after performing QoE measurement based on the first information; wherein the first information includes at least one of the following:
[0552] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0553] Subtypes of service types;
[0554] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0555] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0556] In some embodiments, the apparatus further includes:
[0557] The sixth receiving module is configured to receive QoE measurement capability information sent by the terminal; the QoE measurement capability information includes at least one of the following:
[0558] QoE measurement indication is used to indicate whether the terminal supports QoE measurement;
[0559] The terminal supports the following service types for QoE measurement:
[0560] The terminal supports subtypes of the service types for QoE measurement;
[0561] The second processing module is used to determine the first information based on the obtained QoE measurement capability information.
[0562] In some embodiments, the apparatus further includes:
[0563] The seventh receiving module is used to receive a first QoE measurement request sent by the terminal, wherein the first QoE measurement request is used to request QoE measurement;
[0564] The seventh sending module is configured to send a first QoE measurement response to the terminal according to the first QoE measurement request, wherein the first QoE measurement response is used to indicate acceptance of the first QoE measurement request.
[0565] In some embodiments, the apparatus further includes:
[0566] The eighth receiving module is used to receive a second QoE measurement request sent by the terminal, wherein the second QoE measurement request is used to request QoE measurement;
[0567] The fifth sending module includes:
[0568] The fifth sending submodule is used to send a second QoE measurement response to the terminal according to the second QoE measurement request. The second QoE measurement response is used to indicate acceptance of the second QoE measurement request, and the second QoE measurement response also carries the first information.
[0569] The QoE measurement device provided in this application provides network-side equipment configuration for terminal QoE measurement, enhancing the flexibility of the QoE measurement process. Specifically, it expands the service types supported by QoE measurement, or expands the sub-types under each service type, or expands the QoE type corresponding to QoE measurement, or expands the reporting type corresponding to QoE measurement QoE reports. This allows for more flexible or refined QoE measurement collection, enabling more accurate analysis of QoE issues and resolving the problem that existing QoE collection processes cannot meet the performance requirements of next-generation networks.
[0570] For details, see Figure 8 When the QoE measurement device is a network-side device or a component within a network-side device, the QoE measurement device 800 includes:
[0571] The ninth receiving module 801 is used to receive an auxiliary measurement request sent by the terminal, wherein the auxiliary measurement request is used to request the second network-side device to measure the QoE of the terminal;
[0572] The third processing module 802 is used to measure the QoE of the terminal and obtain a QoE report according to the auxiliary measurement request.
[0573] In some embodiments, the apparatus further includes:
[0574] The ninth sending module is used to send an auxiliary measurement response to the terminal, the auxiliary measurement response being used to indicate whether the auxiliary measurement request is accepted or rejected.
[0575] In some embodiments, the auxiliary measurement request includes at least one of the following:
[0576] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem.
[0577] Subtypes of service types;
[0578] QoE type, the QoE type includes at least one of the following: immediate transmission after acquisition, storage before transmission;
[0579] The sending type indicates the method of sending QoE reports; the sending type includes at least one of the following: no report, event-triggered sending, and periodic sending;
[0580] A list of measurement targets, used to indicate the cells for which QoE measurements of the terminal will be performed; the cells include serving cells and / or neighboring cells;
[0581] Measure the sent event.
[0582] In some embodiments, the measurement transmission event includes at least one of the following:
[0583] The QoE measurement value of the serving cell meets the nineteenth threshold;
[0584] The difference between the QoE measurements of the serving cells meets the twentieth threshold;
[0585] The fluctuations between QoE measurements of the serving cell satisfy the twenty-first threshold; the fluctuations are used to indicate the stability of QoE;
[0586] The predicted QoE values of neighboring cells meet the twenty-second threshold.
[0587] The QoE quality of the serving cell is less than the twenty-third threshold, and the predicted QoE values of the neighboring cells meet the twenty-fourth threshold;
[0588] The difference between the predicted QoE value of the neighboring cell and the measured QoE value of the serving cell satisfies the 25th threshold, and the predicted QoE value of the neighboring cell is greater than the measured QoE value of the serving cell.
[0589] The time interval for QoE measurement satisfies the twenty-sixth threshold;
[0590] The location or environmental information of the terminal during QoE measurement meets the first condition;
[0591] An A1 event indicates that the service quality of the serving cell is higher than the fifth threshold.
[0592] An A2 event indicates that the service quality of the serving cell is below the sixth threshold.
[0593] An A3 event indicates that the difference between the service quality of a neighboring cell and the service quality of the serving cell is greater than the seventh threshold.
[0594] An A4 event indicates that the service quality of a neighboring cell is higher than the eighth threshold.
[0595] An A5 event indicates that the service quality of the serving cell is below the ninth threshold, while the service quality of neighboring cells is above the tenth threshold.
[0596] The A6 incident indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell;
[0597] B1 event indicates that the service quality of neighboring cells in a different system is greater than the eleventh threshold.
[0598] A B2 event indicates that the service quality of the serving cell is below the twelfth threshold, while the service quality of neighboring cells from other systems is above the thirteenth threshold.
[0599] An I1 event indicates that the interference power is higher than the fourteenth threshold.
[0600] C1 event indicates that the sidelink channel busy rate is higher than the fifteenth threshold;
[0601] C2 event indicates that the sidelink channel busy rate is below the sixteenth threshold;
[0602] The D1 event indicates that the distance from the terminal to the first reference position is greater than the seventeenth threshold.
[0603] The D2 event indicates that the distance between the terminal and the serving cell's mobile reference location is less than the eighteenth threshold.
[0604] In some embodiments, the apparatus further includes:
[0605] The twelfth sending module is used to send the QoE report to the terminal.
[0606] In some embodiments, the QoE report includes at least one of the following:
[0607] The QoE measurement information that satisfies the measurement transmission event;
[0608] The second indication information is used to indicate that the QoE measurement quantity satisfies the measurement transmission event.
[0609] In some embodiments, the QoE measurement information includes at least one of the following:
[0610] A first identifier is used to identify the QoE measurement;
[0611] Service type;
[0612] Subtypes of service types;
[0613] QoE measurements corresponding to the service type and / or the subtype;
[0614] A timestamp is used to identify the time of a QoE measurement.
[0615] The uplink signal measurement value corresponding to the timestamp;
[0616] The perception results obtained by the second network-side device;
[0617] The target cell load information corresponding to the QoE measurement;
[0618] Terminal-level performance information of the terminal.
[0619] In the QoE measurement device provided in this application embodiment, the terminal requests a second network-side device to measure the terminal's QoE via an auxiliary measurement request. This allows the second network-side device to measure the terminal's QoE based on the auxiliary measurement request and obtain a QoE report. This facilitates QoE monitoring and optimization for the terminal by the second network-side device and saves on QoE report transmission overhead. It is understood that this application embodiment also supports the terminal requesting the network to collect the terminal's QoE. This allows the terminal to obtain QoE information from the application server side, and the network can also perform network configuration based on the terminal's QoE collection to achieve a rapid QoE optimization loop, saving QoE report transmission resources.
[0620] For details, see Figure 9 When the QoE measurement device is a terminal or a component within a terminal, the QoE measurement device 900 includes:
[0621] The tenth sending module 901 is used to send an auxiliary measurement request to the second network-side device, the auxiliary measurement request being used to request the second network-side device to measure the QoE of the terminal;
[0622] The tenth receiving module 902 is used to receive an auxiliary measurement response sent by the second network-side device, the auxiliary measurement response being used to indicate acceptance or rejection of the auxiliary measurement request.
[0623] In some embodiments, the auxiliary measurement request includes at least one of the following:
[0624] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0625] Subtypes of service types;
[0626] QoE type, the QoE type includes at least one of the following: immediate transmission after acquisition, storage before transmission;
[0627] The sending type indicates the method of sending QoE reports; the sending type includes at least one of the following: no report, event-triggered sending, and periodic sending;
[0628] A list of measurement targets, used to indicate the cells for which QoE measurements of the terminal will be performed; the cells include serving cells and / or neighboring cells;
[0629] Measure the sent event.
[0630] In some embodiments, the measurement transmission event includes at least one of the following:
[0631] The QoE measurement value of the serving cell meets the nineteenth threshold;
[0632] The difference between the QoE measurements of the serving cells meets the twentieth threshold;
[0633] The fluctuations between QoE measurements of the serving cell satisfy the twenty-first threshold; the fluctuations are used to indicate the stability of QoE;
[0634] The predicted QoE values of neighboring cells meet the twenty-second threshold.
[0635] The QoE quality of the serving cell is less than the twenty-third threshold, and the predicted QoE values of the neighboring cells meet the twenty-fourth threshold;
[0636] The difference between the predicted QoE value of the neighboring cell and the measured QoE value of the serving cell satisfies the 25th threshold, and the predicted QoE value of the neighboring cell is greater than the measured QoE value of the serving cell.
[0637] The time interval for QoE measurement satisfies the twenty-sixth threshold;
[0638] The location or environmental information of the terminal during QoE measurement meets the first condition;
[0639] An A1 event indicates that the service quality of the serving cell is higher than the fifth threshold.
[0640] An A2 event indicates that the service quality of the serving cell is below the sixth threshold.
[0641] An A3 event indicates that the difference between the service quality of a neighboring cell and the service quality of the serving cell is greater than the seventh threshold.
[0642] An A4 event indicates that the service quality of a neighboring cell is higher than the eighth threshold.
[0643] An A5 event indicates that the service quality of the serving cell is below the ninth threshold, while the service quality of neighboring cells is above the tenth threshold.
[0644] The A6 incident indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell;
[0645] B1 event indicates that the service quality of neighboring cells in a different system is greater than the eleventh threshold.
[0646] A B2 event indicates that the service quality of the serving cell is below the twelfth threshold, while the service quality of neighboring cells in different systems is above the thirteenth threshold.
[0647] An I1 event indicates that the interference power is higher than the fourteenth threshold.
[0648] C1 event indicates that the sidelink channel busy rate is higher than the fifteenth threshold;
[0649] C2 event indicates that the sidelink channel busy rate is below the sixteenth threshold;
[0650] The D1 event indicates that the distance from the terminal to the first reference position is greater than the seventeenth threshold.
[0651] The D2 event indicates that the distance between the terminal and the serving cell's mobile reference location is less than the eighteenth threshold.
[0652] In some embodiments, the apparatus further includes:
[0653] The eleventh receiving module is used to receive the QoE report sent by the second network-side device.
[0654] In some embodiments, the QoE report includes at least one of the following:
[0655] The QoE measurement information that satisfies the measurement transmission event;
[0656] The second indication information is used to indicate that the QoE measurement quantity meets the measurement transmission event.
[0657] In some embodiments, the QoE measurement information includes at least one of the following:
[0658] A first identifier is used to identify the QoE measurement;
[0659] Service type;
[0660] Subtypes of service types;
[0661] QoE measurements corresponding to the service type and / or the subtype;
[0662] A timestamp is used to identify the time of a QoE measurement.
[0663] The downlink signal measurement value corresponding to the timestamp;
[0664] The uplink signal measurement value corresponding to the timestamp;
[0665] The perception results obtained by the second network-side device;
[0666] The target cell load information corresponding to the QoE measurement;
[0667] Terminal-level performance information of the terminal.
[0668] In the QoE measurement device provided in this application embodiment, the terminal requests a second network-side device to measure the terminal's QoE via an auxiliary measurement request. This allows the second network-side device to measure the terminal's QoE based on the auxiliary measurement request and obtain a QoE report. This facilitates QoE monitoring and optimization for the terminal by the second network-side device and saves on QoE report transmission overhead. It is understood that this application embodiment also supports the terminal requesting the network to collect the terminal's QoE. This allows the terminal to obtain QoE information from the application server side, and the network can also perform network configuration based on the terminal's QoE collection to achieve a rapid QoE optimization loop, saving QoE report transmission resources.
[0669] It should be noted that the QoE measuring device provided in this application embodiment is a device capable of performing the above-described QoE measuring method. Therefore, all embodiments of the above-described QoE measuring method are applicable to this device and can achieve the same or similar beneficial effects, which will not be repeated here.
[0670] The QoE measurement device provided in this application embodiment can achieve... Figures 2 to 5 The various processes implemented in the method embodiments achieve the same technical effect, and will not be described again here to avoid repetition.
[0671] like Figure 10As shown in the illustration, this application also provides a communication device 1000, including a processor 1001 and a memory 1002. The memory 1002 stores a program or instructions that can run on the processor 1001. For example, when the communication device 1000 is a terminal, the program or instructions executed by the processor 1001 implement the various steps of the above-described QoE measurement method embodiment and achieve the same technical effect. When the communication device 1000 is a network-side device, the program or instructions executed by the processor 1001 implement the various steps of the above-described QoE measurement method embodiment and achieve the same technical effect. To avoid repetition, this will not be described again here.
[0672] This application embodiment also provides a terminal, including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement, for example... Figure 2 or Figure 5 The steps in the method embodiment shown are illustrated. This terminal embodiment corresponds to the above-described terminal-side method embodiment. All implementation processes and methods of the above-described method embodiments can be applied to this terminal embodiment and achieve the same technical effect. The terminal can be... Figure 6 or Figure 9 The QoE measurement device shown. Specifically, Figure 11 A schematic diagram of the hardware structure of a terminal to implement an embodiment of this application.
[0673] The terminal 1100 includes, but is not limited to, at least some of the following components: radio frequency unit 1101, network module 1102, audio output unit 1103, input unit 1104, sensor 1105, display unit 1106, user input unit 1107, interface unit 1108, memory 1109, and processor 1110.
[0674] Those skilled in the art will understand that the terminal 1100 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1110 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 11 The terminal structure shown does not constitute a limitation on the terminal. The terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0675] It should be understood that, in this embodiment, the input unit 1104 may include a graphics processor 11041 and a microphone 11042. The graphics processor 11041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1106 may include a display panel 11061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1107 includes at least one of a touch panel 11071 and other input devices 11072. The touch panel 11071 is also called a touch screen. The touch panel 11071 may include a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.
[0676] In this embodiment, after receiving downlink data from the network-side device, the radio frequency unit 1101 can transmit it to the processor 1110 for processing; in addition, the radio frequency unit 1101 can send uplink data to the network-side device. Typically, the radio frequency unit 1101 includes, but is not limited to, antennas, amplifiers, transceivers, couplers, low-noise amplifiers, duplexers, etc.
[0677] The memory 1109 can be used to store software programs or instructions, as well as various data. The memory 1109 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1109 may include volatile memory or non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1109 in this embodiment includes, but is not limited to, these and any other suitable types of memory.
[0678] Processor 1110 may include one or more processing units; optionally, processor 1110 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 1110.
[0679] The radio frequency unit 1101 is used to receive first information sent by the first network-side device; the first information is used to configure the QoE measurement of the terminal.
[0680] Processor 1110 is configured to perform QoE measurement and send a QoE report based on the first information;
[0681] The first information includes at least one of the following:
[0682] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0683] Subtypes of service types;
[0684] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0685] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0686] Alternatively, the radio frequency unit 1101 is configured to send an auxiliary measurement request to a second network-side device, the auxiliary measurement request being used to request the second network-side device to measure the QoE of the terminal; and to receive an auxiliary measurement response sent by the second network-side device, the auxiliary measurement response being used to indicate acceptance or rejection of the auxiliary measurement request.
[0687] In this embodiment, the network-side device configures first information for terminal QoE measurement, enhancing the flexibility of the QoE measurement process. This includes expanding the service types supported by QoE measurement, or expanding the sub-types under each service type, or expanding the QoE type corresponding to the QoE measurement, or expanding the reporting type corresponding to the QoE report. This allows for more flexible or refined QoE measurement collection, enabling more accurate analysis of QoE issues and addressing the problem that existing QoE collection processes cannot meet the performance requirements of next-generation networks. Alternatively, the terminal may request the second network-side device to measure its QoE through an auxiliary measurement request. The second network-side device then performs the terminal's QoE measurement based on the auxiliary measurement request and obtains a QoE report. This facilitates QoE monitoring and optimization for the terminal by the second network-side device and saves on QoE report transmission overhead. It is understood that the embodiments of this application also support the terminal requesting the network to collect the terminal's QoE, which on the one hand enables the terminal to obtain QoE information from the application server side, and on the other hand, the network can also perform network configuration based on the terminal's QoE collection to achieve a fast QoE optimization loop, saving the transmission resources of QoE reports.
[0688] It is understood that the implementation process of each implementation method mentioned in this embodiment can refer to the relevant description of the method embodiment and achieve the same or corresponding technical effect. To avoid repetition, it will not be described again here.
[0689] This application embodiment also provides a network-side device, including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement, for example... Figure 3 or Figure 4 The steps of the method embodiment shown are illustrated. This network-side device embodiment corresponds to the above-described network-side device method embodiment. All implementation processes and methods of the above-described method embodiments can be applied to this network-side device embodiment and can achieve the same technical effect.
[0690] Specifically, embodiments of this application also provide a network-side device. For example... Figure 12 As shown, the network-side device 1200 includes: a processor 1201, a network interface 1202, and a memory 1203. This network-side device can be... Figure 7 or Figure 8 The QoE measurement device shown. The network interface 1202 is, for example, a common public radio interface (CPRI).
[0691] The network interface 1202 is used to send first information to the terminal; the first information is used to configure the terminal's QoE measurement; and to receive a QoE report sent by the terminal after performing QoE measurement based on the first information; wherein the first information includes at least one of the following:
[0692] Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem;
[0693] Subtypes of service types;
[0694] QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting;
[0695] Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
[0696] Alternatively, network interface 1202 is used to receive an auxiliary measurement request sent by the terminal, the auxiliary measurement request being used to request the second network-side device to measure the QoE of the terminal; processor 1201 is used to measure the QoE of the terminal according to the auxiliary measurement request and obtain a QoE report.
[0697] Furthermore, the network-side device 1200 in this embodiment of the application also includes: a program or instructions stored in the memory 1203 and executable on the processor 1201, wherein the processor 1201 calls the program or instructions in the memory 1203 to execute. Figure 7 or Figure 8 The methods executed by each module shown achieve the same technical effect, and to avoid repetition, they will not be described in detail here.
[0698] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described QoE measurement method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0699] The processor mentioned above is either the processor in the terminal described in the above embodiments or the processor in the network-side device. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk. In some examples, the readable storage medium may be a non-transient readable storage medium.
[0700] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described QoE measurement method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0701] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0702] This application also provides a computer program / program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described QoE measurement method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0703] This application also provides a communication system, including: a terminal and a network-side device (the network-side device includes a first network-side device and / or a second network-side device), wherein the terminal can be used to perform the steps of the QoE measurement method as described above, and the network-side device can be used to perform the steps of the QoE measurement method as described above.
[0704] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0705] From the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of computer software products plus necessary general-purpose hardware platforms, and of course, they can also be implemented by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.), and the computer software product includes several instructions to cause the terminal or network-side device to execute the methods described in the various embodiments of this application.
[0706] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other implementations under the guidance of this application without departing from the spirit and scope of the claims. All of these implementations are within the protection scope of this application.
Claims
1. A method for measuring Quality of Experience (QoE), characterized in that, The method includes: The terminal receives first information sent by the first network-side device; the first information is used to configure the terminal's QoE measurement. The terminal performs QoE measurement and sends a QoE report based on the first information; The first information includes at least one of the following: Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem; Subtypes of service types; QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting; Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
2. The method according to claim 1, characterized in that, The first information also indicates a measurement reporting event, which is used to trigger the terminal to report a QoE report; The measurement reporting event includes at least one of the following: The QoE measurement value meets the first threshold; The difference between the QoE measurements satisfies the second threshold; The fluctuations between QoE measurements satisfy a third threshold; these fluctuations are used to indicate the stability of QoE. The time interval for QoE measurement meets the fourth threshold; The location or environmental information of the terminal during QoE measurement meets the first condition; An A1 event indicates that the service quality of the serving cell is higher than the fifth threshold. An A2 event indicates that the service quality of the serving cell is below the sixth threshold. An A3 event indicates that the difference between the service quality of a neighboring cell and the service quality of the serving cell is greater than the seventh threshold. An A4 event indicates that the service quality of a neighboring cell is higher than the eighth threshold. An A5 event indicates that the service quality of the serving cell is below the ninth threshold, while the service quality of neighboring cells is above the tenth threshold. The A6 incident indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell; B1 event indicates that the service quality of neighboring cells in a different system is greater than the eleventh threshold. A B2 event indicates that the service quality of the serving cell is below the twelfth threshold, while the service quality of neighboring cells in different systems is above the thirteenth threshold. An I1 event indicates that the interference power is higher than the fourteenth threshold. C1 event indicates that the sidelink channel busy rate is higher than the fifteenth threshold; C2 event indicates that the sidelink channel busy rate is below the sixteenth threshold; The D1 event indicates that the distance from the terminal to the first reference position is greater than the seventeenth threshold. The D2 event indicates that the distance between the terminal and the serving cell's mobile reference location is less than the eighteenth threshold.
3. The method according to claim 1, characterized in that, The subtypes of the perception service include at least one of the following: Target detection and tracking services; Environmental monitoring services; Exercise monitoring services.
4. The method according to claim 1, characterized in that, AI service subtypes include at least one of the following: AI model inference service; AI model training services; AI model distribution service; Segmentation AI model inference service; Large text-based model business services; Video-based large-scale model business services; AI task uninstallation service; AI task online computing services.
5. The method according to claim 1, characterized in that, The subtypes of the computing service include at least one of the following: Video rendering services; Video segmentation and rendering service; Terminal computing offloading service; Online computing services; Large-scale business services for online video.
6. The method according to claim 1, characterized in that, The subtypes of the streaming service include at least one of the following: Application voice service; Application video service; Audio playback service; Video playback service; Live streaming service.
7. The method according to claim 1, characterized in that, The subtypes of multimedia telephony services in the Internet Protocol Multimedia Subsystem include at least one of the following: Voice service; Video services; Video playback service; Live streaming service.
8. The method according to claim 1, characterized in that, XR service subtypes include at least one of the following: Augmented Reality (AR) services; Virtual Reality (VR) services.
9. The method according to any one of claims 2-8, characterized in that, The QoE report includes at least one of the following: The QoE measurement information that satisfies the measurement reporting event; The first indication information is used to indicate that the QoE measurement quantity satisfies the measurement reporting event.
10. The method according to claim 9, characterized in that, The QoE measurement information includes at least one of the following: A first identifier is used to identify the QoE measurement; Service type; Subtypes of service types; QoE measurements corresponding to the service type and / or the subtype; A timestamp is used to identify the time of a QoE measurement. The downlink signal measurement value corresponding to the timestamp; The acceleration of the terminal; Terminal speed; The terminal's perception results; The direction of movement of the terminal.
11. The method according to any one of claims 1-10, characterized in that, The method further includes: The terminal sends QoE measurement capability information to the first network-side device; the QoE measurement capability information includes at least one of the following: QoE measurement indication is used to indicate whether the terminal supports QoE measurement; The terminal supports the following service types for QoE measurement; The terminal supports subtypes of the QoE measurement service types.
12. The method according to any one of claims 1-10, characterized in that, The method further includes: The terminal sends a first QoE measurement request to the first network-side device, the first QoE measurement request being used to request QoE measurement; The terminal receives a first QoE measurement response sent by the first network-side device, the first QoE measurement response being used to indicate acceptance of the first QoE measurement request.
13. The method according to any one of claims 1-10, characterized in that, The method further includes: The terminal sends a second QoE measurement request to the first network-side device, the second QoE measurement request being used to request QoE measurement; The terminal receives first information sent by the first network-side device, including: The terminal receives a second QoE measurement response sent by the first network-side device. The second QoE measurement response is used to indicate acceptance of the second QoE measurement request, and the second QoE measurement response also carries the first information.
14. The method according to claim 12 or 13, characterized in that, The first QoE measurement request and / or the second QoE measurement request include at least one of the following: Service type; Subtypes of service types; QoE type; Reporting type; Measurement and reporting events.
15. A QoE measurement method, characterized in that, The method includes: The first network-side device sends first information to the terminal; the first information is used to configure the terminal's QoE measurement. The first network-side device receives a QoE report sent by the terminal after performing QoE measurement based on the first information; wherein the first information includes at least one of the following: Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem; Subtypes of service types; QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting; Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
16. The method according to claim 15, characterized in that, The method further includes: The first network-side device receives QoE measurement capability information sent by the terminal; the QoE measurement capability information includes at least one of the following: QoE measurement indication is used to indicate whether the terminal supports QoE measurement; The terminal supports the following service types for QoE measurement; The terminal supports subtypes of the service types for QoE measurement; The first network-side device determines the first information based on the obtained QoE measurement capability information.
17. The method according to claim 15 or 16, characterized in that, The method further includes: The first network-side device receives a first QoE measurement request sent by the terminal, the first QoE measurement request being used to request QoE measurement; The first network-side device sends a first QoE measurement response to the terminal based on the first QoE measurement request. The first QoE measurement response is used to indicate acceptance of the first QoE measurement request.
18. The method according to claim 15 or 16, characterized in that, The method further includes: The first network-side device receives a second QoE measurement request sent by the terminal, the second QoE measurement request being used to request a QoE measurement; The first network-side device sends first information to the terminal, including: The first network-side device sends a second QoE measurement response to the terminal according to the second QoE measurement request. The second QoE measurement response is used to indicate acceptance of the second QoE measurement request, and the second QoE measurement response also carries the first information.
19. A QoE measurement method, characterized in that, The method includes: The second network-side device receives an auxiliary measurement request sent by the terminal, the auxiliary measurement request being used to request the second network-side device to measure the QoE of the terminal; The second network-side device measures the QoE of the terminal and obtains a QoE report based on the auxiliary measurement request.
20. The method according to claim 19, characterized in that, The method further includes: The second network-side device sends an auxiliary measurement response to the terminal, the auxiliary measurement response being used to indicate whether to accept or reject the auxiliary measurement request.
21. The method according to claim 19, characterized in that, The auxiliary measurement request includes at least one of the following: Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem. Subtypes of service types; QoE type, the QoE type includes at least one of the following: immediate transmission after acquisition, storage before transmission; The sending type indicates the method of sending QoE reports; the sending type includes at least one of the following: no report, event-triggered sending, and periodic sending; A list of measurement targets, used to indicate the cells for which QoE measurements of the terminal will be performed; the cells include serving cells and / or neighboring cells; Measure the sent event.
22. The method according to claim 21, characterized in that, The measurement transmission event includes at least one of the following: The QoE measurement value of the serving cell meets the nineteenth threshold; The difference between the QoE measurements of the serving cells meets the twentieth threshold; The fluctuations between the QoE measurements of the serving cells meet the twenty-first threshold. The fluctuations are used to indicate the stability of QoE; The predicted QoE values of neighboring cells meet the twenty-second threshold. The QoE quality of the serving cell is less than the twenty-third threshold, and the predicted QoE values of the neighboring cells meet the twenty-fourth threshold; The difference between the predicted QoE value of the neighboring cell and the measured QoE value of the serving cell satisfies the 25th threshold, and the predicted QoE value of the neighboring cell is greater than the measured QoE value of the serving cell. The time interval for QoE measurement satisfies the twenty-sixth threshold; The location or environmental information of the terminal during QoE measurement meets the first condition; An A1 event indicates that the service quality of the serving cell is higher than the fifth threshold. An A2 event indicates that the service quality of the serving cell is below the sixth threshold. An A3 event indicates that the difference between the service quality of a neighboring cell and the service quality of the serving cell is greater than the seventh threshold. An A4 event indicates that the service quality of a neighboring cell is higher than the eighth threshold. An A5 event indicates that the service quality of the serving cell is below the ninth threshold, while the service quality of neighboring cells is above the tenth threshold. The A6 incident indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell; B1 event indicates that the service quality of neighboring cells in a different system is greater than the eleventh threshold. A B2 event indicates that the service quality of the serving cell is below the twelfth threshold, while the service quality of neighboring cells from other systems is above the thirteenth threshold. An I1 event indicates that the interference power is higher than the fourteenth threshold. C1 event indicates that the sidelink channel busy rate is higher than the fifteenth threshold; C2 event indicates that the sidelink channel busy rate is below the sixteenth threshold; The D1 event indicates that the distance from the terminal to the first reference position is greater than the seventeenth threshold. The D2 event indicates that the distance between the terminal and the serving cell's mobile reference location is less than the eighteenth threshold.
23. The method according to any one of claims 19-22, characterized in that, The method further includes: The second network-side device sends the QoE report to the terminal.
24. The method according to claim 21 or 23, characterized in that, The QoE report includes at least one of the following: The QoE measurement information that satisfies the measurement transmission event; The second indication information is used to indicate that the QoE measurement quantity satisfies the measurement transmission event.
25. The method according to claim 24, characterized in that, The QoE measurement information includes at least one of the following: A first identifier is used to identify the QoE measurement; Service type; Subtypes of service types; QoE measurements corresponding to the service type and / or the subtype; A timestamp is used to identify the time of a QoE measurement. The uplink signal measurement value corresponding to the timestamp; The perception results obtained by the second network-side device; The target cell load information corresponding to the QoE measurement; Terminal-level performance information of the terminal.
26. A QoE measurement method, characterized in that, The method includes: The terminal sends an auxiliary measurement request to the second network-side device, the auxiliary measurement request being used to request the second network-side device to measure the terminal's QoE; The terminal receives an auxiliary measurement response sent by the second network-side device, the auxiliary measurement response being used to indicate whether to accept or reject the auxiliary measurement request.
27. The method according to claim 26, characterized in that, The auxiliary measurement request includes at least one of the following: Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem; Subtypes of service types; QoE type, the QoE type includes at least one of the following: immediate transmission after acquisition, storage before transmission; The sending type indicates the method of sending QoE reports; the sending type includes at least one of the following: no report, event-triggered sending, and periodic sending; A list of measurement targets, used to indicate the cells for which QoE measurements of the terminal will be performed; the cells include serving cells and / or neighboring cells; Measure the sent event.
28. The method according to claim 27, characterized in that, The measurement transmission event includes at least one of the following: The QoE measurement value of the serving cell meets the nineteenth threshold; The difference between the QoE measurements of the serving cells meets the twentieth threshold; The fluctuations between the QoE measurements of the serving cells meet the twenty-first threshold. The fluctuations are used to indicate the stability of QoE; The predicted QoE values of neighboring cells meet the twenty-second threshold. The QoE quality of the serving cell is less than the twenty-third threshold, and the predicted QoE values of the neighboring cells meet the twenty-fourth threshold; The difference between the predicted QoE value of the neighboring cell and the measured QoE value of the serving cell satisfies the 25th threshold, and the predicted QoE value of the neighboring cell is greater than the measured QoE value of the serving cell. The time interval for QoE measurement satisfies the twenty-sixth threshold; The location or environmental information of the terminal during QoE measurement meets the first condition; An A1 event indicates that the service quality of the serving cell is higher than the fifth threshold. An A2 event indicates that the service quality of the serving cell is below the sixth threshold. An A3 event indicates that the difference between the service quality of a neighboring cell and the service quality of the serving cell is greater than the seventh threshold. An A4 event indicates that the service quality of a neighboring cell is higher than the eighth threshold. An A5 event indicates that the service quality of the serving cell is below the ninth threshold, while the service quality of neighboring cells is above the tenth threshold. The A6 incident indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell; B1 event indicates that the service quality of neighboring cells in a different system is greater than the eleventh threshold. A B2 event indicates that the service quality of the serving cell is below the twelfth threshold, while the service quality of neighboring cells in different systems is above the thirteenth threshold. An I1 event indicates that the interference power is higher than the fourteenth threshold. C1 event indicates that the sidelink channel busy rate is higher than the fifteenth threshold; C2 event indicates that the sidelink channel busy rate is below the sixteenth threshold; The D1 event indicates that the distance from the terminal to the first reference position is greater than the seventeenth threshold. The D2 event indicates that the distance between the terminal and the serving cell's mobile reference location is less than the eighteenth threshold.
29. The method according to any one of claims 26-28, characterized in that, The method further includes: The terminal receives the QoE report sent by the second network-side device.
30. The method according to claim 29, characterized in that, The QoE report includes at least one of the following: The QoE measurement information that satisfies the measurement transmission event; The second indication information is used to indicate that the QoE measurement quantity meets the measurement transmission event.
31. The method according to claim 30, characterized in that, The QoE measurement information includes at least one of the following: A first identifier is used to identify the QoE measurement; Service type; Subtypes of service types; QoE measurements corresponding to the service type and / or the subtype; A timestamp is used to identify the time of a QoE measurement. The uplink signal measurement value corresponding to the timestamp; The perception results obtained by the second network-side device; The target cell load information corresponding to the QoE measurement; Terminal-level performance information of the terminal.
32. A QoE measuring device, characterized in that, The device includes: The first receiving module is used to receive first information sent by the first network-side device; the first information is used to configure the terminal's QoE measurement. The first processing module is used to perform QoE measurement based on the first information; The first sending module is used to send QoE reports; The first information includes at least one of the following: Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem; Subtypes of service types; QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting; Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
33. The apparatus according to claim 32, characterized in that, The first information also indicates a measurement reporting event, which is used to trigger the terminal to report a QoE report; The measurement reporting event includes at least one of the following: The QoE measurement value meets the first threshold; The difference between the QoE measurements satisfies the second threshold; The fluctuations between QoE measurements satisfy a third threshold; these fluctuations are used to indicate the stability of QoE. The time interval for QoE measurement meets the fourth threshold; The location or environmental information of the terminal during QoE measurement meets the first condition; An A1 event indicates that the service quality of the serving cell is higher than the fifth threshold. An A2 event indicates that the service quality of the serving cell is below the sixth threshold. An A3 event indicates that the difference between the service quality of a neighboring cell and the service quality of the serving cell is greater than the seventh threshold. An A4 event indicates that the service quality of a neighboring cell is higher than the eighth threshold. An A5 event indicates that the service quality of the serving cell is below the ninth threshold, while the service quality of neighboring cells is above the tenth threshold. The A6 incident indicates that the service quality of the neighboring cell is higher than that of the auxiliary cell; B1 event indicates that the service quality of neighboring cells in a different system is greater than the eleventh threshold. A B2 event indicates that the service quality of the serving cell is below the twelfth threshold, while the service quality of neighboring cells in different systems is above the thirteenth threshold. An I1 event indicates that the interference power is higher than the fourteenth threshold. C1 event indicates that the sidelink channel busy rate is higher than the fifteenth threshold; C2 event indicates that the sidelink channel busy rate is below the sixteenth threshold; The D1 event indicates that the distance from the terminal to the first reference position is greater than the seventeenth threshold. The D2 event indicates that the distance between the terminal and the serving cell's mobile reference location is less than the eighteenth threshold.
34. The apparatus according to claim 32 or 33, characterized in that, The device further includes: The second sending module is configured to send QoE measurement capability information to the first network-side device; the QoE measurement capability information includes at least one of the following: QoE measurement indication is used to indicate whether the terminal supports QoE measurement; The terminal supports the following service types for QoE measurement; The terminal supports subtypes of the QoE measurement service types.
35. The apparatus according to claim 32 or 33, characterized in that, The device further includes: The third sending module is used to send a first QoE measurement request to the first network-side device, wherein the first QoE measurement request is used to request QoE measurement. The third receiving module is used to receive the first QoE measurement response sent by the first network-side device, wherein the first QoE measurement response is used to indicate acceptance of the first QoE measurement request.
36. The apparatus according to claim 32 or 33, characterized in that, The device further includes: The fourth sending module is used to send a second QoE measurement request to the first network-side device, wherein the second QoE measurement request is used to request QoE measurement; The first receiving module includes: The first receiving submodule is configured to receive a second QoE measurement response sent by the first network-side device. The second QoE measurement response is used to indicate acceptance of the second QoE measurement request, and the second QoE measurement response also carries the first information.
37. A QoE measuring device, characterized in that, The device includes: The fifth sending module is used to send first information to the terminal; the first information is used to configure the terminal's QoE measurement. The fifth receiving module is configured to receive a QoE report sent by the terminal after performing QoE measurement based on the first information; wherein the first information includes at least one of the following: Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem; Subtypes of service types; QoE type, the QoE type includes at least one of the following: reporting immediately after collection, and storing first and then reporting; Reporting type, which indicates the reporting method of QoE reports; the reporting type includes at least one of the following: event-triggered reporting, periodic reporting.
38. The apparatus according to claim 37, characterized in that, The device further includes: The sixth receiving module is configured to receive QoE measurement capability information sent by the terminal; the QoE measurement capability information includes at least one of the following: QoE measurement indication is used to indicate whether the terminal supports QoE measurement; The terminal supports the following service types for QoE measurement; The terminal supports subtypes of the service types for QoE measurement; The second processing module is used to determine the first information based on the obtained QoE measurement capability information.
39. The apparatus according to claim 37 or 38, characterized in that, The device further includes: The seventh receiving module is used to receive a first QoE measurement request sent by the terminal, wherein the first QoE measurement request is used to request QoE measurement; The seventh sending module is configured to send a first QoE measurement response to the terminal according to the first QoE measurement request, wherein the first QoE measurement response is used to indicate acceptance of the first QoE measurement request.
40. The apparatus according to claim 37 or 38, characterized in that, The device further includes: The eighth receiving module is used to receive a second QoE measurement request sent by the terminal, wherein the second QoE measurement request is used to request QoE measurement; The fifth sending module includes: The fifth sending submodule is used to send a second QoE measurement response to the terminal according to the second QoE measurement request. The second QoE measurement response is used to indicate acceptance of the second QoE measurement request, and the second QoE measurement response also carries the first information.
41. A QoE measuring device, characterized in that, The device includes: The ninth receiving module is used to receive an auxiliary measurement request sent by the terminal, wherein the auxiliary measurement request is used to request the second network-side device to measure the QoE of the terminal; The third processing module is used to measure the QoE of the terminal and obtain a QoE report based on the auxiliary measurement request.
42. The apparatus according to claim 41, characterized in that, The device further includes: The ninth sending module is used to send an auxiliary measurement response to the terminal, the auxiliary measurement response being used to indicate whether the auxiliary measurement request is accepted or rejected.
43. The apparatus according to claim 41, characterized in that, The auxiliary measurement request includes at least one of the following: Service types; the service types include at least one of the following: extended reality (XR) service, perception service, artificial intelligence (AI) service, computing service, streaming media service, and multimedia telephony service of the Internet Protocol Multimedia Subsystem. Subtypes of service types; QoE type, the QoE type includes at least one of the following: immediate transmission after acquisition, storage before transmission; The sending type indicates the method of sending QoE reports; the sending type includes at least one of the following: no report, event-triggered sending, and periodic sending; A list of measurement targets, used to indicate the cells for which QoE measurements of the terminal will be performed; the cells include serving cells and / or neighboring cells; Measure the sent event.
44. A QoE measuring device, characterized in that, The device includes: The tenth sending module is used to send an auxiliary measurement request to the second network-side device, the auxiliary measurement request being used to request the second network-side device to measure the QoE of the terminal; The tenth receiving module is used to receive an auxiliary measurement response sent by the second network-side device, wherein the auxiliary measurement response is used to indicate whether to accept or reject the auxiliary measurement request.
45. The apparatus according to claim 44, characterized in that, The device further includes: The eleventh receiving module is used to receive the QoE report sent by the second network-side device.
46. A terminal, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the QoE measurement method as claimed in any one of claims 1 to 14, or to implement the steps of the QoE measurement method as claimed in any one of claims 26 to 31.
47. A network-side device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the QoE measurement method as claimed in any one of claims 15 to 18, or to implement the steps of the QoE measurement method as claimed in any one of claims 19 to 25.
48. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the QoE measurement method as described in any one of claims 1 to 14, or implement the steps of the QoE measurement method as described in any one of claims 15 to 18, or implement the steps of the QoE measurement method as described in any one of claims 19 to 25, or implement the steps of the QoE measurement method as described in any one of claims 26 to 31.