Tactile evaluation method and device

Abstract

A tactile evaluation method and device, the method comprising: acquiring application layer parameters and network side parameters of a target service, the application layer parameters comprising tactile information of the target service, the network side parameters comprising at least one of time delay, reliability or jitter of the target service; and according to the application layer parameter and the network side parameter, determining a tactile evaluation index of the target service, the tactile evaluation index being used for evaluating the user tactile experience quality of the target service. According to the tactile evaluation method and device provided by the embodiment of the invention, time and labor cost can be saved, and the accuracy of tactile evaluation can be improved.

Description

Technical Field

[0001] The present application relates to the field of communications, and more specifically, to a tactile evaluation method and device. Background Art

[0002] In recent years, with the continuous development of communication systems, data transmission delay has been continuously reduced, and transmission capacity has been increasing. Communication systems have gradually infiltrated some multimedia services with strong real-time requirements and large data capacity requirements, such as video transmission, cloud gaming, and extended reality (XR), among which XR includes virtual reality (VR) and augmented reality (AR). Multimodal services, as a new service, add the dimension of tactile experience on the basis of XR, which can realize remote touch and remote control, and realize remote perception in multiple aspects such as vision, hearing, touch, and kinesthetics.

[0003] In the tactile Internet, the quality of the user's tactile experience during human-computer interaction can be evaluated using tactile evaluation indicators. Existing tactile evaluation indicators include subjective evaluation indicators and objective evaluation indicators. Among them, subjective evaluation indicators can be, for example, quality of user experience (QoE), and objective evaluation indicators can be, for example, perceptual mean square error (P-MSE), haptic perceptually weighted peak signal-to-noise ratio (HPW-PSNR), and haptic structural similarity (HSSIM).

[0004] The above objective evaluation indicators cannot accurately reflect people's real feelings and have low accuracy. The above subjective evaluation indicators need to be measured by gathering a large number of subjects to conduct relevant tests and give a mean opinion score (MOS). When facing different scenarios and different tasks, they need to be tested again, which consumes a lot of time and manpower, is very costly, and each person has different scoring standards. Summary of the invention

[0005] The present application provides a tactile evaluation method and device, which can save time and labor costs, and can improve the accuracy of tactile evaluation.

[0006] In a first aspect, a tactile evaluation method is provided, comprising: obtaining application layer parameters and network side parameters of a target service, the application layer parameters including tactile information of the target service, and the network side parameters including at least one of latency, reliability or jitter of the target service; determining a tactile evaluation index of the target service according to the application layer parameters and the network side parameters, the tactile evaluation index being used to evaluate the user tactile experience quality of the target service.

[0007] The tactile evaluation method of the embodiment of the present application obtains application layer parameters and network side parameters of the target service, and determines the tactile evaluation index of the target service according to the application layer parameters and the network side parameters. Compared with the existing objective evaluation index, since the application layer parameters include the tactile information of the target service, the tactile evaluation index determined in this way can more accurately reflect the real feelings of people and improve the accuracy of tactile evaluation. Compared with the existing subjective evaluation index, since different services correspond to different tactile information, the tactile evaluation method of the present application can obtain a tactile evaluation result corresponding to the current scene or the current task, without manual operation, which can save time and labor costs.

[0008] It should be understood that the above-mentioned "obtaining" may include obtaining from other devices (such as core network devices or terminal devices), and may also include obtaining from the inside of the access network device (such as obtaining from the memory of the access network device), and the embodiments of the present application are not limited to this.

[0009] Optionally, the target service of the embodiment of the present application may include only the tactile service, or may include a video service in addition to the tactile service.

[0010] Optionally, in the case where the target service includes a tactile service and a video service, optionally, the above application layer parameters also include video media information of the target service.

[0011] In combination with the first aspect, in some implementations of the first aspect, obtaining the application layer parameters of the target service includes: receiving first information from a core network device, where the first information includes the application layer parameters.

[0012] It should be understood that the application layer parameters included in the first information are application layer parameters of the application server. The application server can send third information including the application layer parameters to the core network device through the N6 interface, and the core network device receives the third information, extracts the application layer parameters therefrom, and then carries the application layer parameters in the first information and forwards them to the access network device through the N3 interface. Correspondingly, the access network device receives the first information including the application layer parameters.

[0013] Exemplarily, in the process of an application server sending application layer parameters to a core network device, the field carrying the above-mentioned application layer parameters may be located at a real-time transport protocol (RTP) layer (for example, in an RTP packet header at the RTP layer), or at a user datagram protocol (UDP) layer (for example, in a UDP packet header at the UDP layer), or at a newly added protocol layer between the RTP layer and the UDP layer, or at a newly added field between the RTP layer and the UDP layer, and this embodiment of the present application is not limited to this.

[0014] Exemplarily, in the process of the core network device sending application layer parameters to the access network device, the field carrying the above application layer parameters can be an extended header of the user plane GPRS tunnel transmission protocol (user GPRS tunnel protocol, GTP-U, where GPRS is the abbreviation of general packet radio service (GPRS)) message, that is, the above first information can be a GTP-U message.

[0015] In combination with the first aspect, in some implementations of the first aspect, obtaining the application layer parameters of the target service includes: receiving second information from a terminal device, where the second information includes the application layer parameters.

[0016] It should be understood that the application layer parameters included in the first information are application layer parameters of the terminal device. The terminal device can send the second information including the application layer parameters to the access network device through the Uu interface.

[0017] In combination with the first aspect, in certain implementations of the first aspect, the second information is carried in radio resource control RRC signaling, media access control element MAC CE or uplink control information UCI.

[0018] In combination with the first aspect, in certain implementations of the first aspect, the application layer parameters include application layer parameters from an application server and / or application layer parameters from a terminal device; determining the tactile evaluation index of the target service based on the application layer parameters and the network side parameters includes: determining the tactile evaluation index based on the application layer parameters from the application server and / or the application layer parameters from the terminal device, and the network side parameters.

[0019] In one possible implementation, the access network device may determine the tactile evaluation index of the target service based on the application layer parameters from the application server and the network side parameters. In another possible implementation, the access network device may determine the tactile evaluation index of the target service based on the application layer parameters from the terminal device and the network side parameters. In yet another possible implementation, the access network device may determine the tactile evaluation index based on the application layer parameters from the application server, the application layer parameters from the terminal device, and the network side parameters.

[0020] In combination with the first aspect, in certain implementations of the first aspect, the tactile evaluation index is obtained by weighted summing the first value and / or the second value, and the third value, the first value is the value obtained by inputting the application layer parameter from the application server into the first function, the second value is the value obtained by inputting the application layer parameter from the terminal device into the second function, and the third value is the value obtained by inputting the network side parameter into the third function.

[0021] In combination with the first aspect, in certain implementations of the first aspect, the target service includes a tactile service and a video service, the network side parameters include network side parameters corresponding to the tactile service and network side parameters corresponding to the video service, and the application layer parameters also include video media information; determining the tactile evaluation index of the target service based on the application layer parameters and the network side parameters includes: determining the tactile evaluation index based on the tactile information, the network side parameters corresponding to the tactile service, the video media information, the network side parameters corresponding to the video service, and the synchronization difference between the tactile service and the video service.

[0022] In combination with the first aspect, in certain implementations of the first aspect, the tactile evaluation index is obtained by weighted summing a fourth value, a fifth value, and the synchronization difference, the fourth value is a value obtained by inputting the network side parameters corresponding to the tactile information and the tactile service into a fourth function, and the fifth value is a value obtained by inputting the network side parameters corresponding to the video information and the video service into a fifth function.

[0023] In combination with the first aspect, in certain implementations of the first aspect, determining the tactile evaluation index of the target service based on the application layer parameters and the network side parameters includes: inputting the application layer parameters and the network side parameters into a trained neural network model to obtain the tactile evaluation index.

[0024] In the embodiment of the present application, the trained neural network model can be regarded as a black box system, which can be obtained by training models including but not limited to GBDT, SVM, random forest, etc. In this way, the subjective perception quality of a given tactile experience can be predicted, that is, given the above-mentioned application layer parameters and network side parameters, the tactile evaluation index can be predicted.

[0025] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when the application layer parameters and / or network side parameters of the target service are different parameters, collecting multiple scores of the target service from each user among multiple users, and the application layer parameters and / or network side parameters corresponding to each score in the multiple scores; using the multiple scores as labels, inputting the application layer parameters and / or network side parameters corresponding to each score in the multiple scores into the neural network model, training the neural network model, and obtaining the trained neural network model.

[0026] Optionally, the access network device can train and save multiple (for example, more than 10) models. In one possible implementation, the access network device can use the saved multiple models to make predictions respectively, and then calculate the average of the prediction results of each model in the multiple models as the final prediction value, that is, the tactile evaluation index of the target service. This is conducive to improving the stability and accuracy of the prediction results.

[0027] The embodiment of the present application determines the tactile evaluation index through the calculation of a neural network, and collects the user's subjective evaluation score by allowing the user to adjust the application layer parameters and / or the network side parameter values, which is closer to the user's real experience. Training based on this data set can effectively improve the accuracy of the tactile experience perception quality evaluation index.

[0028] In combination with the first aspect, in some implementations of the first aspect, the tactile information includes at least one of the following: vibration time, vibration intensity, tactile compression rate, tactile encoding key parameters, force feedback intensity, or interaction intensity.

[0029] It should be understood that the above-mentioned interaction intensity may refer to the closeness of human-computer interaction, which is related to the dynamics and complexity of the human-computer interaction environment. The above-mentioned tactile compression rate may be a value obtained by dividing the compressed data volume by the original data volume, or a value obtained by dividing the original data volume by the compressed data volume, or may be in the form of a percentage, but the embodiments of the present application do not limit this. In combination with the first aspect, in certain implementations of the first aspect, the application layer parameters also include video media information, and the video media information includes at least one of the following: frame rate, period, or protocol data unit PDU set (set) information. It should be understood that the PDU set information may include information such as the serial number of the PDU set, the end identifier of the PDU set, the serial number of the PDU in the PDU set, the importance identifier of the PDU set, the size of the PDU set, etc., and the embodiments of the present application do not specifically limit this.

[0030] In a second aspect, a tactile evaluation device is provided, which is used to execute the method in any possible implementation of the first aspect. Specifically, the device includes a module for executing the method in any possible implementation of the first aspect.

[0031] In a third aspect, a tactile evaluation device is provided, comprising: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement a method as in any possible implementation of the first aspect above.

[0032] In one implementation, the tactile evaluation device is an access network device. When the sideline communication device is an access network device, the communication interface may be a transceiver, or an input / output interface.

[0033] In another implementation, the tactile evaluation device is a chip configured in an access network device.

[0034] Optionally, the number of the processors is one or more, and the number of the memories is one or more.

[0035] Optionally, the memory may be integrated with the processor, or the memory may be provided separately from the processor.

[0036] In the specific implementation process, the memory can be a non-transitory memory, such as a read-only memory (ROM), which can be integrated with the processor on the same chip or can be set on different chips respectively. The embodiments of the present application do not limit the type of memory and the setting method of the memory and the processor.

[0037] It should be understood that the relevant data interaction process, such as sending indication information, can be a process of outputting indication information from a processor, and receiving capability information can be a process of receiving input capability information from a processor. Specifically, the processed output data can be output to a transmitter, and the input data received by the processor can come from a receiver. Among them, the transmitter and the receiver can be collectively referred to as a transceiver.

[0038] The processing device in the third aspect mentioned above can be a chip. The processor can be implemented by hardware or by software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc.; when implemented by software, the processor can be a general-purpose processor, which is implemented by reading the software code stored in the memory. The memory can be integrated in the processor or can be located outside the processor and exist independently.

[0039] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method in any possible implementation manner of the first aspect.

[0040] According to a fifth aspect, a computer program product is provided. When the instructions are executed on a computer, the computer implements the method in any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A schematic diagram of a communication system provided in an embodiment of the present application;

[0042] Figure 2 is a schematic diagram of another communication system provided by an embodiment of the present application;

[0043] Figure 3 is a schematic flow chart of a tactile evaluation method provided in an embodiment of the present application;

[0044] Figure 4 is a schematic flow chart of a tactile evaluation method provided in an embodiment of the present application;

[0045] Figure 5 is a schematic block diagram of a tactile evaluation device provided in an embodiment of the present application;

[0046] Figure 6 It is a schematic block diagram of another tactile evaluation device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0048] In order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish the same or similar items with substantially the same functions and effects. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit the difference.

[0049] It should be noted that, in this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0050] In addition, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can mean: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c, where a, b, c can be single or multiple.

[0051] The technical solutions of the embodiments of the present application can be applied to various communication systems, such as: long term evolution (LTE) system, LTE frequency division duplex (FDD) system, LTE time division duplex (TDD), universal mobile telecommunication system (UMTS), worldwide interoperability for microwave access (WiMAX) communication system, fifth generation (5G) system or new radio (NR), future evolved communication systems, such as sixth generation (6G) system, etc.

[0052] Figure 1 FIG. 1 is a schematic diagram showing a communication system 100 to which an embodiment of the present application is applied. Figure 1 As shown, the communication system 100 includes: an application server 110, a core network device 120, an access network device 130 and a terminal device 140.

[0053] The application server 110 is used to perform operations such as encoding, decoding, and rendering of business data, and transmit the business data to the terminal device 140 through the network side. The network side includes a core network device 120 and an access network device 130. The core network device 120 can be connected to the access network device 130 in a wireless or wired manner. The terminal device 140 can be connected to the access network device 130 in a wireless manner within the coverage range of the access network device 130.

[0054] The access network device 130 and the terminal device 140 can communicate via a wireless link. The access network device 130 or the terminal device 140 can be configured with multiple antennas, which may include at least one transmitting antenna for sending signals and at least one receiving antenna for receiving signals. In addition, the access network device 130 or the terminal device 140 also additionally includes a transmitter chain and a receiver chain. It can be understood by those skilled in the art that they can include multiple components related to signal transmission and reception (such as processors, modulators, multiplexers, demodulators, demultiplexers or antennas, etc.). Therefore, the access network device 130 and the terminal device 140 can communicate via multi-antenna technology.

[0055] It should be understood that Figure 1 This is just a schematic diagram. The communication system 100 may also include other network devices, such as wireless relay devices and wireless backhaul devices. Figure 1 The embodiment of the present application does not limit the number of core network devices, access network devices and terminal devices included in the communication system 100.

[0056] The access network equipment and core network equipment in the embodiments of the present application may be collectively referred to as network equipment.

[0057] The core network device of the embodiment of the present application may be a core network device in a 4G system, such as a mobile management entity (MME), a serving gateway (SGW), etc., or a core network device in a 5G system, such as an access and mobility management function (AMF) network element, a user plane function (UPF) network element, etc. It may also be a core network device with other names, which is not limited in the embodiment of the present application.

[0058] The access network device can be any device with wireless transceiver function. Access network equipment includes, but is not limited to, evolved Node B (eNB), radio network controller (RNC), Node B (NB), base station controller (BSC), base transceiver station (BTS), home base station (e.g., home evolved NodeB, or home Node B, HNB), baseband unit (BBU), access point (AP) in wireless fidelity (WiFi) system, wireless relay node, wireless backhaul node, transmission point (TP) or transmission and reception point (TRP), etc. It can also be a 5G base station (next-Generation Node B, gNB) in a 5G, such as NR, system, or a transmission point (TRP or TP), one or a group of (including multiple antenna panels) antenna panels of a base station in a 5G system, or it can also be a network node constituting a gNB or a transmission point, such as a baseband unit (BBU) or a distributed unit (DU), etc.

[0059] In some deployments, the gNB may include a centralized unit (CU) and a DU. The gNB may also include an active antenna unit (AAU). The CU implements some functions of the gNB, and the DU implements some functions of the gNB. For example, the CU may be responsible for processing non-real-time protocols and services, such as the functions of the radio resource control (RRC) layer, the service data adaptation protocol (SDAP) layer, and / or the packet data convergence protocol (PDCP) layer. The DU may be responsible for processing physical layer protocols and real-time services. For example, the functions of the radio link control (RLC) layer, the media access control (MAC) layer, and the physical (PHY) layer may be implemented. A DU may be connected to only one CU or to multiple CUs, and a CU may be connected to multiple DUs, and the CU and DU may communicate through the F1 interface. The AAU may implement some physical layer processing functions, RF processing, and related functions of active antennas. Since the information of the RRC layer will eventually be delivered to the PHY layer and become the information of the PHY layer, or be converted from the information of the PHY layer, therefore, under this architecture, high-level signaling, such as RRC layer signaling, can also be considered to be sent by DU, or by DU+AAU.

[0060] It is understandable that the access network device may be a device including one or more of a CU node, a DU node, and an AAU node. In addition, the CU may be classified as an access network device in an access network (radio access network, RAN), or the CU may be classified as an access network device in a core network (core network, CN), and this application does not limit this.

[0061] The access network equipment provides services for the cell. The terminal equipment communicates with the cell through the transmission resources (for example, frequency domain resources, or spectrum resources) allocated by the access network equipment. The cell can belong to a macro base station (for example, macro eNB or macro gNB, etc.), or it can belong to a base station corresponding to a small cell. The small cell here may include: metro cell, micro cell, pico cell, femto cell, etc. These small cells have the characteristics of small coverage and low transmission power, and are suitable for providing high-speed data transmission services.

[0062] In an embodiment of the present application, the terminal device may also be referred to as user equipment (UE), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent or user device.

[0063] The terminal device can be a device that provides voice / data connectivity to users, for example, a handheld device with wireless connection function, a vehicle-mounted device, etc. At present, some examples of terminals can be: mobile phones, tablet computers (pad), computers with wireless transceiver functions (such as laptops, PDAs, etc.), mobile Internet devices (mobile internet devices, MIDs), virtual reality (virtual reality, VR) devices, augmented reality (augmented reality, AR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, cellular phones, cordless phones, session initiation protocol (session initiation protocol, SIP) phones, wireless local loop (wireless local loop, WLL) stations, personal digital assistants (personal digital assistants) assistant, PDA), handheld devices with wireless communication function, computing devices or other processing devices connected to a wireless modem, vehicle-mounted devices, wearable devices, terminal devices in 5G networks or terminal devices in future evolved public land mobile communication networks (public land mobile network, PLMN), etc.

[0064] Among them, wearable devices can also be called wearable smart devices, which are a general term for the intelligent design and development of wearable devices for daily wear using wearable technology, such as glasses, gloves, watches, clothing and shoes. Wearable devices are portable devices that are worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not only hardware devices, but also realize powerful functions through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include full-featured, large-sized, and independent of smartphones to achieve complete or partial functions, such as smart watches or smart glasses, as well as those that only focus on a certain type of application function and need to be used in conjunction with other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.

[0065] In addition, the terminal device can also be a terminal device in the Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network of human-machine interconnection and object-to-object interconnection. IoT technology can achieve massive connections, deep coverage, and terminal power saving through narrowband (NB) technology, for example.

[0066] In an embodiment of the present application, a terminal device or a network device includes a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system layer. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and a memory (also called main memory). The operating system can be any one or more computer operating systems that implement business processing through a process, such as a Linux operating system, a Unix operating system, an Android operating system, an iOS operating system, or a windows operating system. The application layer includes applications such as a browser, an address book, a word processing software, and an instant messaging software. In addition, the embodiment of the present application does not specifically limit the specific structure of the execution subject of the method provided in the embodiment of the present application, as long as it can communicate according to the method provided in the embodiment of the present application by running a program that records the code of the method provided in the embodiment of the present application, for example, the execution subject of the method provided in the embodiment of the present application can be a terminal device or a network device, or a functional module in a terminal device or a network device that can call a program and execute a program.

[0067] In addition, various aspects or features of the present application can be implemented as methods, devices or products using standard programming and / or engineering techniques. The term "product" used in this application covers computer programs that can be accessed from any computer-readable device, carrier or medium. For example, computer-readable media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks or tapes, etc.), optical disks (e.g., compact discs (CDs), digital versatile discs (DVDs), etc.), smart cards and flash memory devices (e.g., erasable programmable read-only memory (EPROM), cards, sticks or key drives, etc.). In addition, the various storage media described herein may represent one or more devices and / or other machine-readable media for storing information. The term "machine-readable medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing and / or carrying instructions and / or data.

[0068] The following describes the 5G communication system by taking the terminal device as UE, the access network device as gNB, and the core network equipment including AMF network element, user plane function (UPF) network element, session management function (SMF) network element, policy control function (PCF) network element, application function (AF) network element and network exposure function (NEF) network element as an example.

[0069] Figure 2 FIG. 2 is a schematic diagram of a communication system 200 according to an embodiment of the present application. Figure 2 As shown, the communication system 200 may specifically include the following network elements:

[0070] 1. Application server: used to perform operations such as encoding, decoding, and rendering of business data, and transmit business data to UE through the network side.

[0071] 2. Data network (DN): A network used to provide data transmission, such as the Internet.

[0072] 3. UPF network element: UPF is the user plane function responsible for forwarding user data.

[0073] 4. gNB.

[0074] 5.UE.

[0075] Optionally, the communication system 200 further includes:

[0076] 6. AF network element: used for data routing affected by applications, accessing network open function network elements, or interacting with the policy framework for policy control, etc.

[0077] 7. PCF network element: A unified policy framework used to guide network behavior and provide policy rule information for control plane functional network elements (such as AMF network elements, SMF network elements, etc.).

[0078] 8. NEF network element: used to securely open the services and capabilities provided by the 3rd generation partnership project (3GPP) network functions to the outside world, and also allows AF network elements to provide information to 3GPP network functions.

[0079] 9. SMF network element: mainly used for session management, allocation and management of Internet protocol (IP) addresses of terminal devices, selection of endpoints for manageable user plane functions, policy control, or charging function interfaces, and downlink data notification.

[0080] 10. AMF network element: Mainly used for mobility management and access management, etc. It can be used to implement other functions of the mobility management entity (MME) except session management, such as lawful monitoring or access authorization (or authentication).

[0081] In the above communication system 200, the UE can access the 5G network through the Uu interface and communicate with the gNB; the gNB and UPF network elements can communicate through the N3 interface; the UPF network element and DN can communicate through the N6 interface; the UPF and SMF network elements can communicate through the N4 interface; the gNB and AMF network elements can communicate through the N2 interface; the UE and AMF network elements can communicate through the N1 interface; the AMF network element and SMF network element can communicate through the N11 interface; the SMF network element and PCF network element can communicate through the N7 interface; the AF network element and PCF network element can communicate through the N5 interface; the AF network element and NEF network element can communicate through the N33 interface. It should be noted that Figure 2 The interface name between the network elements in the communication system 200 is only an example. In a specific implementation, the interface name of the communication system 200 may also be other names, and the embodiment of the present application does not specifically limit this.

[0082] It should be noted that Figure 2The names of the various network elements (such as SMF, AF, UPF, etc.) included in are only examples and do not limit the functions of the network elements themselves. In 5G networks and other future networks, the above-mentioned network elements may also have other names, and the embodiments of the present application do not specifically limit this. For example, in a 6G network, some or all of the above-mentioned network elements may use the terminology in 5G, or may use other names, etc., which are uniformly explained here and will not be repeated below. In addition, it should be understood that the name of the message (or signaling) transmitted between the above-mentioned network elements is only an example and does not constitute any limitation on the function of the message itself.

[0083] Of course, other network elements may also be deployed in the above-mentioned communication system 200, such as network slice selection function (NSSF) network elements, etc., and the embodiment of the present application does not make any specific limitations on this.

[0084] It should be understood that the above-mentioned communication system 200 applied to the embodiment of the present application is only an example of the network architecture described from the perspective of the service-oriented architecture, and the network architecture applicable to the embodiment of the present application is not limited to this. Any network architecture that can realize the functions of the above-mentioned network elements is applicable to the embodiment of the present application.

[0085] With the communication system (such as Figure 1 The communication system 100 shown or Figure 2 With the continuous development of the communication system 200 shown in the figure, the data transmission delay is continuously reduced, the transmission capacity is getting larger and larger, and the communication system is gradually infiltrating some multimedia services with strong real-time performance and large data capacity requirements, such as video transmission, cloud gaming, and extended reality (XR), etc., where XR includes virtual reality (VR) and augmented reality (AR). Multimodal services, as a new service, add a tactile experience dimension to XR, which can realize remote touch and remote control, and realize remote perception in multiple aspects such as vision, hearing, touch, and kinesthetics. It has great development space in related fields such as industrial automation, health care, and distance education, providing users with a full range of interactive experience, with great application value and commercial potential.

[0086] As a kind of multimodal service, the tactile Internet can be divided into the following four categories:

[0087] First, immersive tactile XR: Compared with traditional XR services, immersive tactile XR can create an immersive and realistic experience for users through complete simulation and real-time interaction of sensory information such as vision, hearing, and touch, and take users to travel between the virtual and real worlds.

[0088] Second, remote control: Under existing technologies, operators can only perform remote control through video. The tactile Internet further enables touch, which can significantly enhance the operator's sense of presence and improve the accuracy of operation. This remote control will be widely used in industrial and medical scenarios.

[0089] Third, education and training: As learners perform fine motor skill tasks, coaches will be able to feel the learners’ movements and correct them when necessary, and learners will be able to see, hear and feel the exact movements their coaches make. Whether they are engineers, pilots or surgeons, the concept of “hands-on” will take on a whole new meaning.

[0090] Fourth, tactile broadcasting: Based on traditional broadcasting, tactile features are introduced, and tactile streams and broadcast streams are transmitted along the channel, which can enhance the audience's viewing experience.

[0091] In the tactile Internet, the quality of the user's tactile experience during human-computer interaction can be evaluated using tactile evaluation indicators. Existing tactile evaluation indicators include subjective evaluation indicators and objective evaluation indicators. Among them, subjective evaluation indicators can be, for example, QoE, and objective evaluation indicators can be, for example, P-MSE, HPW-PSNR, and HSSIM.

[0092] The above existing objective evaluation indicators cannot accurately reflect people's real feelings and have low accuracy. In particular, HSSIM has many parameters that need to be obtained through experiments, and different environments and tasks of different complexity also need to correspond to different parameter values. The above existing subjective evaluation indicators need to be measured by convening a large number of subjects to conduct relevant tests and give a mean opinion score (MOS). When facing different scenarios and different tasks, they need to be tested again, which consumes a lot of time and manpower. Not only is the cost very high, but everyone's scoring criteria are different.

[0093] In view of this, the present application proposes a tactile evaluation method and device, which obtains application layer parameters and network side parameters of a target business, and determines the tactile evaluation index of the target business according to the application layer parameters and the network side parameters. Compared with the existing objective evaluation index, since the application layer parameters include the tactile information of the target business, the tactile evaluation index determined in this way can more accurately reflect people's real feelings and improve the accuracy of tactile evaluation. Compared with the existing subjective evaluation index, since different businesses correspond to different tactile information, the tactile evaluation method of the present application can obtain a tactile evaluation result corresponding to the current scene or current task, without manual operation, which can save time and labor costs.

[0094] Next, combine Figure 3 The tactile evaluation method 300 of the embodiment of the present application is described in detail. The method 300 can be applied to Figure 1 The communication system 100 shown can also be applied to Figure 2 The communication system 200 shown can also be applied to other communication systems, which is not limited in the present embodiment. The method 300 can be executed by an access network device or by a chip in the access network device, and includes the following steps:

[0095] S301, acquiring application layer parameters and network side parameters of a target service, wherein the application layer parameters include tactile information of the target service, and the network side parameters include at least one of latency, reliability, or jitter of the target service.

[0096] The above-mentioned "obtaining" may include obtaining from other devices (such as core network devices or terminal devices), or may include obtaining from the inside of an access network device (such as obtaining from the memory of an access network device), which is not limited in this embodiment of the present application.

[0097] Exemplarily, the tactile information may include at least one of vibration time, vibration intensity, tactile compression rate, tactile coding key parameters, force feedback intensity, or interaction intensity. Different tactile compression rates, different tactile coding key parameters, and different interaction intensities have a significant impact on the transmission reliability of the service, and different vibration times, different vibration intensities, and different force feedback intensities also have an impact on the user's subjective experience.

[0098] It should be understood that the above-mentioned interaction intensity may refer to the closeness of human-computer interaction, which is related to the dynamics and complexity of the human-computer interaction environment. The above-mentioned tactile compression rate may be the value obtained by dividing the compressed data volume by the original data volume, or the value obtained by dividing the original data volume by the compressed data volume, or may be in the form of a percentage, but the embodiments of the present application are not limited to this.

[0099] It should be understood that the target service of the embodiment of the present application may include only the tactile service, or may include the video service in addition to the tactile service.

[0100] In the case where the target service includes a tactile service and a video service, optionally, the above-mentioned application layer parameters also include video media information of the target service. Exemplarily, the video media information may include at least one of a frame rate, a period, or a protocol data unit (PDU) set information. Among them, the PDU set information may include the sequence number of the PDU set, the end identifier of the PDU set, the sequence number of the PDU in the PDU set, the importance identifier of the PDU set, the size of the PDU set, and other information, which is not specifically limited in the embodiments of the present application.

[0101] S302: Determine a tactile evaluation index of the target service according to the application layer parameter and the network side parameter, where the tactile evaluation index is used to evaluate a user tactile experience quality of the target service.

[0102] It should be understood that the haptic evaluation index may also be referred to as a haptic evaluation result, haptic multi-indicator assessment fusion (HMAF), etc., or may have other names in other scenarios, which is not limited in the embodiments of the present application.

[0103] The tactile evaluation method of the embodiment of the present application obtains application layer parameters and network side parameters of the target service, and determines the tactile evaluation index of the target service according to the application layer parameters and the network side parameters. Compared with the existing objective evaluation index, since the application layer parameters include the tactile information of the target service, the tactile evaluation index determined in this way can more accurately reflect the real feelings of people and improve the accuracy of tactile evaluation. Compared with the existing subjective evaluation index, since different services correspond to different tactile information, the tactile evaluation method of the present application can obtain a tactile evaluation result corresponding to the current scene or the current task, without manual operation, which can save time and labor costs.

[0104] Furthermore, after the access network device determines the tactile evaluation index of the target service, the access network device can select a scheduling strategy corresponding to the tactile evaluation index and perform data transmission of the target service according to the scheduling strategy to improve network transmission resource utilization, thereby improving user experience.

[0105] Optionally, the above-mentioned application layer parameters may include application layer parameters from an application server and / or application layer parameters from a terminal device. In one possible implementation, the access network device may determine the tactile evaluation index of the target service based on the application layer parameters from the application server and the network side parameters. In another possible implementation, the access network device may determine the tactile evaluation index of the target service based on the application layer parameters from the terminal device and the network side parameters. In yet another possible implementation, the access network device may determine the tactile evaluation index of the target service based on the application layer parameters from the application server, the application layer parameters from the terminal device, and the network side parameters.

[0106] It should be understood that the application layer parameters of the application server and the application layer parameters of the terminal device may be completely the same, partially the same, or different, and the embodiments of the present application do not limit this. For uplink services, the application layer parameters of the terminal device may include vibration time, vibration intensity, tactile compression rate, tactile coding key parameters, force feedback intensity, interaction intensity, etc., that is, these parameters can be provided by the terminal device to the access network device. For downlink services, the above parameters can be provided by the application server to the access network device, that is, the application layer parameters of the application server may include vibration time, vibration intensity, tactile compression rate, tactile coding key parameters, force feedback intensity, interaction intensity, etc.

[0107] Optionally, the application layer parameters of the terminal device may also include device parameters such as device type, model, product specifications, resolution, refresh rate, etc. These device parameters are provided by the terminal device to the access network device for both uplink and downlink services.

[0108] As an optional embodiment, the above S301 includes: receiving first information from a core network device, where the first information includes the application layer parameters.

[0109] It should be understood that in this embodiment, the application layer parameters included in the first information are application layer parameters of the application server. The application server can send third information including the application layer parameters to the core network device through the N6 interface, and the core network device receives the third information, extracts the application layer parameters therefrom, and then carries the application layer parameters in the first information and forwards them to the access network device through the N3 interface. Correspondingly, the access network device receives the first information including the application layer parameters.

[0110] Exemplarily, in the process of an application server sending application layer parameters to a core network device, the field carrying the above-mentioned application layer parameters may be located at a real-time transport protocol (RTP) layer (for example, in an RTP packet header at the RTP layer), or at a user datagram protocol (UDP) layer (for example, in a UDP packet header at the UDP layer), or at a newly added protocol layer between the RTP layer and the UDP layer, or at a newly added field between the RTP layer and the UDP layer, and this embodiment of the present application is not limited to this.

[0111] Exemplarily, in the process of the core network device sending application layer parameters to the access network device, the field carrying the above application layer parameters can be an extended header of the user plane GPRS tunnel transmission protocol (user GPRS tunnel protocol, GTP-U, where GPRS is the abbreviation of general packet radio service (GPRS)) message, that is, the above first information can be a GTP-U message.

[0112] Exemplarily, the format of the GTP-U message may be as shown in Table 1 below.

[0113] Table 1

[0114]

[0115] As shown in Table 1, the GTP-U message includes the following fields: version, protocol type (PT), extension header flag (E), serial number (S), number marking (PN), message type (message type), network layer protocol data unit (N-protocol data unit, N-PDU), number (number), extension header (extension header), (*) indicates an empty bit, such as 0. It should be understood that the GTP-U message may also include other fields, which are not all shown in Table 1.

[0116] As an optional embodiment, the above S301 also includes: receiving second information from the terminal device, where the second information includes the application layer parameters.

[0117] It should be understood that in this embodiment, the application layer parameters included in the first information are application layer parameters of the terminal device. The terminal device can send the second information including the application layer parameters to the access network device through the Uu interface.

[0118] Exemplarily, the second information may be carried in radio resource control (RRC) signaling, media access control element (MAC CE) or uplink control message (UCI), which is not limited in the embodiments of the present application.

[0119] For ease of understanding, the following takes the application layer parameters including the application layer parameters from the application server and the application layer parameters from the terminal device as an example. Figure 4 The embodiments of the present application are described in detail.

[0120] Figure 4 FIG. 4 is a schematic flow chart of another tactile evaluation method 400 provided in an embodiment of the present application. The method 400 can be applied to Figure 1 The communication system 100 shown can also be applied to Figure 2 The communication system 200 shown can also be applied to other communication systems, which is not limited in the present embodiment. The method 400 includes the following steps:

[0121] S401, the application server sends third information to the core network device, where the third information includes application layer parameters of the application server; correspondingly, the core network device receives the third information.

[0122] S402, the core network device sends first information to the access network device, where the first information includes application layer parameters of the above-mentioned application server; correspondingly, the access network device receives the first information.

[0123] S403, the terminal device sends second information to the access network device, where the second information includes application layer parameters of the terminal device; correspondingly, the access network device receives the second information.

[0124] S404: The access network device determines a tactile evaluation index of the target service according to the first information, the second information, and network side parameters.

[0125] It should be understood that the above S403 may be executed after S401 and S402, or before S401 and S402, or may be executed in parallel with S401 and S402, which is not limited in the embodiment of the present application.

[0126] The following describes in detail how the tactile evaluation index is determined in the embodiments of the present application.

[0127] In the embodiment of the present application, the access network device may determine the tactile evaluation index of the target service in a variety of different ways.

[0128] Method 1: The access network device can determine the tactile evaluation index of the target service through a formula.

[0129] In a possible implementation, the tactile evaluation index may be calculated from three perspectives: application layer parameters of the application server, network side parameters, and application layer parameters of the terminal device.

[0130] Case 1: If the access network device receives an application layer parameter from an application server, the tactile evaluation index may be obtained by weighted summing a first value and a third value, wherein the first value is a value obtained by inputting the application layer parameter from the application server into a first function, and the third value is a value obtained by inputting the network side parameter into a third function.

[0131] Exemplarily, the tactile evaluation index under case 1 is marked as HMAF 1 , the first function is denoted as f 1 , the third function is denoted as f 3 , the calculation formula corresponding to case 1 can be:

[0132] HMAF 1 =w 1 ×f 1 (a)+w 2 ×f 3 (c)

[0133] Among them, w 1 and w 2 is the weighting coefficient, w 1 +w 2 =1, a is the application layer parameter of the application server, and c is the network side parameter.

[0134] Case 2: If the access network device receives application layer parameters from the terminal device, the tactile evaluation index can be obtained by weighted summing the second value and the third value, where the second value is the value obtained by inputting the application layer parameters from the terminal device into the second function, and the third value is the value obtained by inputting the network side parameters into the third function.

[0135] Exemplarily, the tactile evaluation index is labeled as HMAF 2 , the second function is denoted as f 2 , the third function is denoted as f 3 , the calculation formula corresponding to case 2 can be:

[0136] HMAF 2 =w 3 ×f 2 (b)+w 4 ×f 3 (c)

[0137] Among them, w 3 and w 4 is the weighting coefficient, w 3 +w 4 =1, b is the application layer parameter of the terminal device, and c is the network side parameter.

[0138] Case 3, if the access network device receives both the application layer parameters from the application server and the application layer parameters from the terminal device, the tactile evaluation index may be obtained by weighted summing the first value, the second value and the third value.

[0139] Exemplarily, the tactile evaluation index is labeled as HMAF 3 , the first function is denoted as f 1 , the second function is denoted as f 2 , the third function is denoted as f 3 , the calculation formula corresponding to case 3 can be:

[0140] HMAF 3 =w 5 ×f 1 (a)+w 6 ×f 2 (b)+w 7 ×f 3 (c)

[0141] Among them, w 5 、w 6 and w 7 is the weighting coefficient, w 5 +w 6 +w 7 =1, a is the application layer parameter of the application server, b is the application layer parameter of the terminal device, and c is the network side parameter.

[0142] Assuming that the application layer parameter a of the above application server includes the vibration time T and the force feedback intensity F, then f 1 (a) can be expressed as:

[0143] f 1 (T,F)=100-w 11 ×(T-100) 2 -w 12 ×(F-70) 2 ,

[0144] Among them, w 11 and w12 is the weighting coefficient, w 11 +w 12 =1.

[0145] From 1 From the formula (T, F), we can see that the optimal value of vibration time is 100, and the optimal value of force feedback intensity is 70. If the value of T is greater than or less than the optimal value of vibration time, or the value of F is greater than or equal to the optimal value of force feedback intensity, the user experience will decrease with the quadratic function.

[0146] Assuming that the application layer parameter b of the above terminal device includes the sampling frequency T_sampling of the terminal device, then f 2 (b) can be expressed as:

[0147] f 2 (T_sampling) = w 21 ×log(T_sampling+1),

[0148] Among them, w 21 is the weighting coefficient.

[0149] From 2 From the formula of (T_sampling), we can see that different terminal devices have different granularity for tactile rendering. The higher the sampling and rendering frequency of the terminal device, the closer the user's tactile experience is to the real feeling. When the sampling frequency is relatively low, increasing the sampling frequency can greatly improve the user experience; when the sampling frequency is already very high and the user can no longer distinguish a higher sampling frequency, the improvement of the user experience by increasing the sampling frequency will gradually decrease.

[0150] Assuming that the above network side parameter c includes packet delay budget (PDB) and packet error rate (PER), then f 3 (PDB,PER) can be expressed as:

[0151] f 3 (PDB,PER) = w 31 ×(100-PDB)+w 32 ×(l×(100-PER*100)),

[0152] Among them, w 31 and w 32 is the weighting coefficient, w 31 +w 32 =1, l is a preset coefficient. It should be understood that the above PDB is the PDB of the target service, and the above PER is the PER of the target service.

[0153] Furthermore, if we calculate according to the business dimension, f 3 The expression of (c) includes the following two cases:

[0154] In the case where the target service only includes tactile services, f 3 (c) can be expressed as:

[0155] f 3 (PDB 1 ,PER 1 )=w 33 ×(100-PDB 1 )+w 34 ×(l×(100-PER 1 *100)),

[0156] Among them, w 33 and w 34 is the weighting coefficient, w 33 +w 34 =1,PDB 1 PDB for haptic business, PER 1 is the PER of the tactile service, and l is the preset coefficient.

[0157] In the case where the target service includes a tactile service and a video service, f 3 (c) can be expressed as:

[0158]

[0159] Among them, w 35 、w 36 、w 37 、w 38 and w 39 is the weighting coefficient, w 35 +w 36 +w 37 +w 38 +w 39 =1, l is a preset coefficient, and d is the synchronization difference between the tactile service and the video service.

[0160] It should be understood that the synchronization difference refers to two signals generated simultaneously, which have different delays after transmission. The delay difference arriving on the network side can also be called synchronization error, which is not limited in the embodiments of the present application.

[0161] Exemplarily, the above l=2 / 3.

[0162] For example, the above w 35 =0.3, w 36 =0.3, w 37 =0.2, w 38 =0.2, w39 =0.1.

[0163] In another possible implementation, the tactile evaluation index may be calculated according to different modes of services, that is, it may be calculated according to dimensions such as tactile services and video services.

[0164] In case 1, the target service only includes the tactile service, the network side parameter is the network side parameter corresponding to the tactile service, and the application layer parameter is the tactile information.

[0165] In a possible implementation, the tactile evaluation index may be determined based on a network-side parameter corresponding to the tactile service. Optionally, the tactile evaluation index may be a seventh value, which is a value obtained by inputting the network-side parameter corresponding to the tactile service into the fourth function.

[0166] Exemplarily, the tactile evaluation index is labeled as HMAF 4 , the fourth function is denoted as f 4 , the calculation formula corresponding to this method can be:

[0167] HMAF 4 =f 4 (e)

[0168] Wherein, e is a network side parameter corresponding to the tactile service.

[0169] Assuming that the network side parameters e corresponding to the above tactile service include PDB, PER and jitter, then f 4 (e) can be expressed as:

[0170] f 4 (e)=(100-PDB)+(100-PER×100)-|jitter|,

[0171] In another possible implementation, the tactile evaluation index may be determined based on the network side parameters and tactile information corresponding to the tactile service. Optionally, the tactile evaluation index may be an eighth value obtained by inputting the network side parameters and tactile information corresponding to the tactile service into the fourth function.

[0172] Exemplarily, the tactile evaluation index is labeled as HMAF 5 , the fourth function is denoted as f 4 , the calculation formula corresponding to this method can be:

[0173] HMAF 5 =f 5 (e,g),

[0174] Among them, e is the network side parameter corresponding to the tactile service, and g is the tactile information.

[0175] Case 2: The target service includes a tactile service and a video service, the application layer information received by the access network device includes tactile information and video media information, the network side parameters include network side parameters corresponding to the tactile service and network side parameters corresponding to the video service, and the application layer parameters include tactile information and video media information.

[0176] In a possible implementation, the tactile evaluation index may be determined based on network side parameters (i.e., network side parameters corresponding to the tactile service and network side parameters corresponding to the video service). The tactile evaluation index may be obtained by weighted summing the ninth value, the tenth value, and the eleventh value, wherein the ninth value is a value obtained by inputting the network side parameters corresponding to the tactile service into the fourth function, the tenth value is a value obtained by inputting the network side parameters corresponding to the video service into the fifth function, and the eleventh value is a value obtained by inputting the synchronization difference between the network side parameters of the tactile service and the video service into the sixth function.

[0177] Exemplarily, the tactile evaluation index is labeled as HMAF 6 , the fourth function is denoted as f 4 , the fifth function is denoted as f 5 , the sixth function is recorded as f 6 , the calculation formula corresponding to this method can be:

[0178] HMAF 6 =w 8 ×f 4 (e)+w 9 ×f 5 (i)+w 10 ×f 6 (d),

[0179] Among them, w 8 、w 9 and w 10 is the weighting coefficient, w 8 +w 9 +w 10 =1, e is the network side parameter corresponding to the tactile service, i is the network side parameter corresponding to the video service, and d is the synchronization difference between the tactile service and the video service.

[0180] Assume that e includes PDB 1 and PER 1 , i include PDB 2 and PER 2 , then the corresponding tactile evaluation formula HMAF 6 for:

[0181]

[0182] Among them, w44 、w 45 、w 46 、w 47 and w 48 is the weighting coefficient, w 44 +w 45 +w 46 +w 47 +w 48 =1, s is a preset coefficient, and d is the synchronization difference between the tactile service and the video service.

[0183] Exemplarily, the above s=2 / 3.

[0184] For example, the above w 44 =0.3, w 45 =0.3, w 46 =0.2, w 47 =0.2, w 48 =0.1.

[0185] In another possible implementation, the tactile evaluation index may be determined based on network side parameters (i.e., network side parameters corresponding to the tactile service and network side parameters corresponding to the video service) and application layer parameters (i.e., tactile information and video media information). The tactile evaluation index may be obtained by weighted summing the fourth value, the fifth value, and the sixth value, wherein the fourth value is a value obtained by inputting the tactile information and the network side parameters corresponding to the tactile service into the fourth function, the fifth value is a value obtained by inputting the video media information and the network side parameters corresponding to the video service into the fifth function, and the sixth value is a value obtained by inputting the synchronization difference between the tactile service and the video service into the sixth function.

[0186] Exemplarily, the tactile evaluation index is labeled as HMAF 7 , the fourth function is denoted as f 4 , the fifth function is denoted as f 5 , the sixth function is recorded as f 6 , the calculation formula corresponding to case 2 can be:

[0187] HMAF 7 =w 17 ×f 4 (e,g)+w 18 ×f 5 (i,k)+w 19 ×f 6 (d)

[0188] Among them, w 17 、w 18 and w 19 is the weighting coefficient, w 17 +w 18 +w19 =1, e is the network side parameter corresponding to the tactile service, g is the tactile information, i is the network side parameter corresponding to the video service, k is the video media information, and d is the synchronization difference between the tactile service and the video service.

[0189] Assume that e includes PDB 1 , PER 1 、jitter 1 and compressibility (Cpre), including PDB 2 , PER 2 and jitter 2 , then the corresponding tactile evaluation formula HMAF 7 for:

[0190]

[0191] Among them, w 51 、w 52 and w 53 is the weighting coefficient, w 51 +w 52 +w 53 =1, d is the synchronization difference between the tactile service and the video service.

[0192] For example, the above w 51 =0.5, w 52 =0.4, w 53 =0.1.

[0193] Method 2: The access network device can determine the tactile evaluation index of the target service through a table.

[0194] In a possible implementation, the access network device may look up a table according to different modes of services to obtain a tactile evaluation index, that is, the access network device may look up a table according to dimensions such as tactile services and video services.

[0195] Case 1: the target service only includes tactile service.

[0196] Assuming that the network side parameters include PDB and PER, and the tactile information includes the tactile compression rate, a possible form of a table is:

[0197] Table 2

[0198] index PDB PER Haptic compression rate Tactile evaluation index 1 0~5ms >99.999 Uncompressed 100 2 5~10ms 99.99～99.999 20％ 90 … … … … … <![CDATA[N 1 ]]> >25ms 99 100％ 0

[0199] As shown in Table 2, different PDB, PER and tactile compression rates correspond to different tactile evaluation index scores. The access network device can find the tactile evaluation index corresponding to the PDB, PER and tactile compression rate of the target service from Table 2. It should be understood that Table 2 also includes tactile evaluation indexes corresponding to other different values ​​of PDB, PER and tactile compression rate, which are not listed here one by one. 1 is an integer greater than 1.

[0200] For example, if the PDB of the target service is 7ms, the PER is 99.999, and the tactile compression rate is 20%, the tactile evaluation index of the target service is 90. If the tactile evaluation index required by the user of the target service is 100, the access network device can improve the tactile evaluation index of the subsequent transmission of the target service by shortening the delay, reducing the MCS, etc., to meet the user's needs.

[0201] For example, if the PDB of the target service is 27ms, the PER is 99, and the tactile compression rate is 100%, the tactile evaluation index of the target service is 0. At this time, the access network device may consider that the target service cannot meet the user's needs, and thus stop subsequent data transmission to save resources.

[0202] Optionally, if any of the above parameters is predefined and a table corresponding to different values ​​of the parameter is preset, the value of the parameter can be used to first select the table corresponding to the parameter and then perform a query.

[0203] Taking compression rate as an example, when compression rate = 10%, the corresponding possible form of a table is:

[0204] Table 3

[0205] index PDB PER Tactile evaluation index 1 0~5ms >99.999 100 2 5~10ms 99.99～99.999 90 … … … … <![CDATA[N 2 ]]> >25ms 99 0

[0206] As shown in Table 3, when the compression rate = 10%, different PDBs and PERs correspond to different tactile evaluation index scores. The access network device can first determine Table 3 based on the compression rate of the target service being 10%, and then find the tactile evaluation index corresponding to the PDB and PER of the target service from Table 3. It should be understood that Table 3 also includes tactile evaluation indexes corresponding to other different values ​​of PDB and PER, which are not listed here one by one. The above N 2 is an integer greater than 1.

[0207] When the compression rate = 20%, the corresponding possible form of a table is:

[0208] Table 4

[0209] index PDB PER Tactile evaluation index 1 0~5ms >99.999 90 2 5~10ms 99.99～99.999 80 … … … … <![CDATA[N 3 ]]> >25ms 99 0

[0210] As shown in Table 4, when the compression rate = 20%, different PDBs and PERs correspond to different tactile evaluation index scores. The access network device can first determine Table 4 based on the compression rate of the target service being 20%, and then find the tactile evaluation index corresponding to the PDB and PER of the target service from Table 4. It should be understood that Table 4 also includes tactile evaluation indexes corresponding to other different values ​​of PDB and PER, which are not listed here one by one. 3 is an integer greater than 1.

[0211] Case 2: The target service includes a video service and a tactile service.

[0212] Assuming that the network side parameters include PDB and PER, and the tactile information includes tactile compression rate, the network side parameters include PDB of tactile service, PER of tactile service, PDB of video service and PER of video service, then a possible form of a table is:

[0213] Table 5

[0214]

[0215] As shown in Table 5, different PDBs of tactile services, PERs of tactile services, PDBs of video services, PERs of video services, and tactile compression rates correspond to different tactile evaluation index scores. The access network device can find out the tactile evaluation indexes corresponding to the PDBs of tactile services, PERs of tactile services, PDBs of video services, PERs of video services, and tactile compression rates of the target services from Table 5. It should be understood that Table 5 also includes tactile evaluation indexes corresponding to different values ​​of other PDBs, PERs, and tactile compression rates, which are not listed here one by one. The above N 4 is an integer greater than 1.

[0216] The specific table lookup methods of Tables 3 to 5 are the same as those of Table 2 and will not be repeated here.

[0217] It should be understood that the above table may be agreed upon by the protocol or pre-configured. In addition, the above table may also exist in other forms, which are not specifically limited in the embodiments of the present application.

[0218] It should also be understood that the access network device can select the corresponding table according to different service types; or, the application server or terminal device notifies the access network device to select the corresponding table, and the embodiments of the present application do not specifically limit this.

[0219] Method three: The access network equipment can determine the tactile evaluation index of the target service through a neural network model.

[0220] Optionally, the above S404 may include: inputting the application layer parameters and the network side parameters into a trained neural network model to obtain the tactile evaluation index.

[0221] In the embodiment of the present application, the trained neural network model can be regarded as a black box system, and can be obtained by training models including but not limited to Gradient Boosting Decision Tree (GBDT), Support Vector Machine (SVM), random forest, etc. In this way, the subjective perceived quality of a given tactile experience can be predicted, that is, given the above-mentioned application layer parameters and network side parameters, the tactile evaluation index can be predicted.

[0222] The following introduces the training process of the neural network model.

[0223] It should be understood that the trained neural network model used in the embodiments of the present application may be saved after training by the access network device, or may be trained by other devices and sent to the access network device. The embodiments of the present application are not limited to this.

[0224] As an optional embodiment, the above method also includes: when the application layer parameters and / or network side parameters of the target service are different parameters, collecting multiple scores of the target service from each user among multiple users, and the application layer parameters and / or network side parameters corresponding to each score in the multiple scores; using the multiple scores as labels, inputting the application layer parameters and / or network side parameters corresponding to each score in the multiple scores into the neural network model, training the neural network model, and obtaining the trained neural network model.

[0225] Specifically, the model training process is divided into the following three stages:

[0226] Phase 1, data collection.

[0227] The data set in the embodiment of the present application is collected based on a subjective test method. The embodiment of the present application fully considers the user's usage, quantifies the tactile evaluation index, and requires the user to score the experience quality of the test scene after actual experience, that is, to obtain the experience quality value of the test scene.

[0228] In the embodiment of the present application, the user can freely adjust the values ​​of the application layer parameters and the network side parameters through the test interface of the neural network model to change the tactile perception in the scene and experience it. When the user interacts with the objects in the test scene, he will feel the change in the quality of the tactile interaction brought about by the change in the parameter value, and then the user can give the tactile experience quality value he thinks based on his subjective feelings.

[0229] Since each user has different standards for subjective testing, the corresponding relationship shown in Table VI is designed.

[0230] Exemplarily, the embodiment of the present application quantifies the experience quality value to 1-5 points, see Table 6.

[0231] Table 6

[0232] Quality of Experience Value standard 1 Total distortion 2 There are serious differences 3 There is a big difference 4 Slight but noticeable difference 5 Almost indistinguishable from the reference object

[0233] It should be noted that the experience quality values ​​in Table 6 can also be quantified to 1-10, 1-100 or other score ranges, and the embodiments of the present application do not specifically limit this.

[0234] In the application embodiment, it is assumed that the number of user experience is fixed as T, and the influencing factor is recorded as m. i (i=1,2,3,...,n), then the experience quality score of a certain influencing factor is:

[0235]

[0236] Let G = α 1 ×Q 1 +α 2 ×Q 2 +...+α n ×Q n , and G∈[0,1], α i is the weight of the influencing factors, and the sum of the weights of all influencing factors is 1. Then, the total score of the user experience quality is quantified to 1-5 points, and Q = β × G + 1 is set, so that Q ∈ [1,5], Q is the experience quality value of the current user, where β is the quantization coefficient.

[0237] It should be understood that the above-mentioned influencing factors are a general term for application layer parameters and network side parameters, and may include both application layer parameters and network side parameters.

[0238] Through the above manner, multiple scores of each of the multiple users for the target service, as well as application layer parameters and / or network side parameters corresponding to each of the multiple scores can be obtained.

[0239] Phase 2: Data processing: In the embodiment of the present application, a box plot can be used to remove outlier data from the collected parameter data, perform data cleaning, and obtain cleaned data.

[0240] Phase 3: model training.

[0241] The cleaned data is input into a machine learning model (including but not limited to GBDT, SVM, random forest and other models) for training. Specifically, in the cleaned data, multiple scoring values ​​of the user are used as labels, and the application layer parameters and / or network side parameters corresponding to the multiple scoring values ​​are input into the neural network model for training. During the training process, a part of the data (for example, 80% of the data) is divided into a training set, and another part of the data (for example, 20% of the data) is used as a validation set. By adjusting the model parameters, a model that meets the conditions is obtained. Exemplarily, a model whose probability statistics of the model predicted value data and the true value data are greater than a confidence threshold can be selected for saving, or a model whose root mean square error (RMSE) between the model predicted value data and the true value data is less than a preset threshold can be selected for saving.

[0242] Optionally, the access network device can train and save multiple (for example, more than 10) models. In one possible implementation, the access network device can use the saved multiple models to make predictions respectively, and then calculate the average of the prediction results of each model in the multiple models as the final prediction value, that is, the tactile evaluation index of the target service. This is conducive to improving the stability and accuracy of the prediction results.

[0243] The embodiment of the present application determines the tactile evaluation index through the calculation of a neural network, and collects the user's subjective evaluation score by allowing the user to adjust the application layer parameters and / or the network side parameter values, which is closer to the user's real experience. Training based on this data set can effectively improve the accuracy of the tactile experience perception quality evaluation index.

[0244] It should be understood that the order of execution of the above methods does not necessarily mean the order in which they are executed. The order in which each process is executed should be determined by its function and internal logic.

[0245] Combined with the above Figures 1 to 4 , describes in detail the tactile evaluation method according to the embodiment of the present application, and will be combined with Figure 5 and Figure 6 , a tactile evaluation device according to an embodiment of the present application is described in detail.

[0246] Figure 5 The tactile evaluation device 500 provided in an embodiment of the present application is shown. The device 500 includes: an acquisition unit 510 and a processing unit 520 .

[0247] In a possible implementation, the apparatus 500 is used to execute the steps corresponding to the access network device in the above method 400.

[0248] Among them, the acquisition unit 510 is used to obtain application layer parameters and network side parameters of the target service, the application layer parameters include tactile information of the target service, and the network side parameters include at least one of the delay, reliability or jitter of the target service; the processing unit 520 is used to determine the tactile evaluation index of the target service based on the application layer parameters and the network side parameters, and the tactile evaluation index is used to evaluate the user tactile experience quality of the target service.

[0249] Optionally, the apparatus further includes a receiving unit configured to receive first information from a core network device, wherein the first information includes the application layer parameters.

[0250] Optionally, the first information is a user plane GPRS tunnel transmission protocol GTP-U message, and the application layer parameters are carried in an extended header of the GTP-U message.

[0251] Optionally, the apparatus further includes a receiving unit configured to receive second information from a terminal device, wherein the second information includes the application layer parameters.

[0252] Optionally, the second information is carried in radio resource control RRC signaling, media access control element MACCE or uplink control information UCI.

[0253] Optionally, the application layer parameters include application layer parameters from an application server and / or application layer parameters from a terminal device;

[0254] The processing unit is specifically used for:

[0255] The tactile evaluation index is determined according to the application layer parameters from the application server and / or the application layer parameters from the terminal device, and the network side parameters.

[0256] Optionally, the tactile evaluation index is obtained by weighted summing the first value and / or the second value and the third value, the first value being the value obtained by inputting the application layer parameter from the application server into the first function, the second value being the value obtained by inputting the application layer parameter from the terminal device into the second function, and the third value being the value obtained by inputting the network side parameter into the third function.

[0257] Optionally, the target service includes a tactile service and a video service, the network side parameters include a network side parameter corresponding to the tactile service and a network side parameter corresponding to the video service, and the application layer parameters further include video media information;

[0258] The processing unit is further specifically used for:

[0259] The tactile evaluation index is determined according to the tactile information, network side parameters corresponding to the tactile service, the video media information, network side parameters corresponding to the video service, and a synchronization difference between the tactile service and the video service.

[0260] Optionally, the tactile evaluation index is obtained by weighted summing a fourth value, a fifth value and the synchronization difference, the fourth value is a value obtained by inputting the tactile information and the network side parameters corresponding to the tactile service into a fourth function, and the fifth value is a value obtained by inputting the video information and the network side parameters corresponding to the video service into a fifth function.

[0261] Optionally, the processing unit is specifically configured to:

[0262] The application layer parameters and the network side parameters are input into a trained neural network model to obtain the tactile evaluation index.

[0263] Optionally, the processing unit is further configured to:

[0264] When the application layer parameters and / or network side parameters of the target service are different parameters, it is used to collect multiple scores of each user of multiple users for the target service, and the application layer parameters and / or network side parameters corresponding to each score of the multiple scores;

[0265] Using the multiple scores as labels, the application layer parameters and / or network side parameters corresponding to each score in the multiple scores are input into the neural network model, and the neural network model is trained to obtain the trained neural network model.

[0266] Optionally, the tactile information includes at least one of the following: vibration time, vibration intensity, tactile compression rate, tactile encoding key parameters, force feedback intensity, or interaction intensity.

[0267] Optionally, the application layer parameters further include video media information, and the video media information includes at least one of the following: frame rate, period, or protocol data unit PDU set information.

[0268] It should be understood that the device 500 here is embodied in the form of a functional unit. The term "unit" here may refer to an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor or a group processor, etc.) and a memory for executing one or more software or firmware programs, a merged logic circuit and / or other suitable components that support the described functions. In an optional example, those skilled in the art can understand that the device 500 can be specifically the access network device in the above-mentioned embodiment, and the device 500 can be used to execute the various processes and / or steps corresponding to the access network device in the above-mentioned method embodiment. To avoid repetition, it will not be repeated here.

[0269] The device 500 of each of the above schemes has the function of implementing the corresponding steps performed by the terminal device in the above method; the function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. For example, the acquisition unit can be replaced by a receiver, and other units, such as a processing unit, can be replaced by a processor, respectively performing the sending and receiving operations and related processing operations in each method embodiment.

[0270] In the embodiments of the present application, Figure 5 The device 500 in the embodiment may also be a chip or a chip system, such as a system on chip (SoC). Correspondingly, the acquisition unit 510 may be a transceiver circuit of the chip, which is not limited here.

[0271] Figure 6 Another tactile evaluation device 600 provided by an embodiment of the present application is shown. The device 600 includes a processor 610, a transceiver 620, and a memory 630. The processor 610, the transceiver 620, and the memory 630 communicate with each other through an internal connection path, the memory 630 is used to store instructions, and the processor 610 is used to execute the instructions stored in the memory 630 to control the transceiver 620 to send and / or receive signals.

[0272] It should be understood that the device 600 can be specifically the access network device in the above embodiment, and can be used to execute the various steps and / or processes corresponding to the access network device in the above method embodiment. Optionally, the memory 630 may include a read-only memory and a random access memory, and provide instructions and data to the processor. A part of the memory may also include a non-volatile random access memory. For example, the memory may also store information about the device type. The processor 610 may be used to execute instructions stored in the memory, and when the processor 610 executes the instructions stored in the memory, the processor 610 is used to execute the various steps and / or processes of the above method embodiment corresponding to the access network device. The transceiver 620 may include a transmitter and a receiver, the transmitter may be used to implement the various steps and / or processes corresponding to the above transceiver for performing the sending action, and the receiver may be used to implement the various steps and / or processes corresponding to the above transceiver for performing the receiving action.

[0273] It should be understood that in the embodiments of the present application, the processor of the above-mentioned device may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0274] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software units in a processor for execution. The software unit can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor executes the instructions in the memory, and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0275] The present application also provides a computer-readable storage medium, which is used to store a computer program, and the computer program is used to implement the method corresponding to the access network device in the above embodiment.

[0276] The present application also provides a computer program product, which includes a computer program (also referred to as code or instruction). When the computer program runs on a computer, the computer can execute the method corresponding to the access network device shown in the above embodiment.

[0277] Those of ordinary skill in the art will appreciate that the various method steps and units described in the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the steps and components of each embodiment have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those of ordinary skill in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0278] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0279] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or it can be an electrical, mechanical or other form of connection.

[0280] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0281] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0282] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0283] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A tactile evaluation method, characterized in that: include: Acquire application layer parameters and network side parameters of a target service, wherein the application layer parameters include tactile information of the target service, and the network side parameters include at least one of latency, reliability, or jitter of the target service; A tactile evaluation index of the target service is determined according to the application layer parameter and the network side parameter, where the tactile evaluation index is used to evaluate a user tactile experience quality of the target service.

2. The method according to claim 1, characterized in that: The obtaining of the application layer parameters of the target service includes: Receive first information from a core network device, where the first information includes the application layer parameter.

3. The method according to claim 2, characterized in that The first information is a user plane GPRS tunnel transmission protocol GTP-U message, and the application layer parameter is carried in an extension header of the GTP-U message.

4. The method according to claim 1 or 2, characterized in that: The obtaining of the application layer parameters of the target service includes: Second information is received from a terminal device, where the second information includes the application layer parameter.

5. The method according to claim 4, characterized in that The second information is carried in radio resource control RRC signaling, media access control element MAC CE or uplink control information UCI.

6. The method according to any one of claims 1 to 5, characterized in that The application layer parameters include application layer parameters from an application server and / or application layer parameters from a terminal device; The determining, according to the application layer parameter and the network side parameter, a tactile evaluation index of the target service includes: The tactile evaluation index is determined according to the application layer parameters from the application server and / or the application layer parameters from the terminal device, and the network side parameters.

7. The method according to claim 6, characterized in that The tactile evaluation index is obtained by weighted summing the first value and / or the second value and the third value, wherein the first value is a value obtained by inputting the application layer parameter from the application server into the first function, the second value is a value obtained by inputting the application layer parameter from the terminal device into the second function, and the third value is a value obtained by inputting the network side parameter into the third function.

8. The method according to any one of claims 1 to 5, characterized in that The target service includes a tactile service and a video service, the network side parameters include a network side parameter corresponding to the tactile service and a network side parameter corresponding to the video service, and the application layer parameters also include video media information; The determining, according to the application layer parameter and the network side parameter, a tactile evaluation index of the target service includes: The tactile evaluation index is determined according to the tactile information, network side parameters corresponding to the tactile service, the video media information, network side parameters corresponding to the video service, and a synchronization difference between the tactile service and the video service.

9. The method according to claim 8, characterized in that The tactile evaluation index is obtained by weighted summing the fourth value, the fifth value and the synchronization difference, the fourth value is a value obtained by inputting the tactile information and the network side parameters corresponding to the tactile service into the fourth function, and the fifth value is a value obtained by inputting the video information and the network side parameters corresponding to the video service into the fifth function.

10. The method according to any one of claims 1 to 5, characterized in that The determining, according to the application layer parameter and the network side parameter, a tactile evaluation index of the target service includes: The application layer parameters and the network side parameters are input into a trained neural network model to obtain the tactile evaluation index.

11. The method according to claim 10, characterized in that The method further comprises: In the case where the application layer parameters and / or network side parameters of the target service are different parameters, collecting multiple scores of each user from multiple users for the target service, and the application layer parameters and / or network side parameters corresponding to each score in the multiple scores; Using the multiple scores as labels, the application layer parameters and / or network side parameters corresponding to each score in the multiple scores are input into the neural network model, and the neural network model is trained to obtain the trained neural network model.

12. The method according to any one of claims 1 to 11, characterized in that The tactile information includes at least one of the following: Vibration time, vibration intensity, tactile compression rate, tactile encoding key parameters, force feedback intensity, or interaction intensity.

13. The method according to any one of claims 1 to 12, characterized in that The application layer parameters also include video media information, and the video media information includes at least one of the following: Frame rate, period, or protocol data unit (PDU) aggregation information.

14. A tactile evaluation device, characterized in that: include: an acquisition unit, configured to acquire application layer parameters and network side parameters of a target service, wherein the application layer parameters include tactile information of the target service, and the network side parameters include at least one of latency, reliability or jitter of the target service; A processing unit is used to determine a tactile evaluation index of the target service according to the application layer parameter and the network side parameter, wherein the tactile evaluation index is used to evaluate the user tactile experience quality of the target service.

15. The device according to claim 14, characterized in that The device also includes: A receiving unit is used to receive first information from a core network device, where the first information includes the application layer parameters.

16. The device according to claim 15, characterized in that The first information is a user plane GPRS tunnel transmission protocol GTP-U message, and the application layer parameter is carried in an extension header of the GTP-U message.

17. The device according to claim 14 or 15, characterized in that The device also includes: A receiving unit is used to receive second information from a terminal device, where the second information includes the application layer parameters.

18. The device according to claim 17, characterized in that The second information is carried in radio resource control RRC signaling, media access control element MAC CE or uplink control information UCI.

19. The device according to any one of claims 14 to 18, characterized in that The application layer parameters include application layer parameters from an application server and / or application layer parameters from a terminal device; The processing unit is specifically configured to determine the tactile evaluation index according to the application layer parameter from the application server and / or the application layer parameter from the terminal device, and the network side parameter.

20. The device according to claim 19, characterized in that The tactile evaluation index is obtained by weighted summing the first value and / or the second value and the third value, wherein the first value is a value obtained by inputting the application layer parameter from the application server into the first function, the second value is a value obtained by inputting the application layer parameter from the terminal device into the second function, and the third value is a value obtained by inputting the network side parameter into the third function.

21. The device according to any one of claims 14 to 18, characterized in that The target service includes a tactile service and a video service, the network side parameters include a network side parameter corresponding to the tactile service and a network side parameter corresponding to the video service, and the application layer parameters also include video media information; The processing unit is further specifically configured to determine the tactile evaluation index according to the tactile information, network side parameters corresponding to the tactile service, the video media information, network side parameters corresponding to the video service, and a synchronization difference between the tactile service and the video service.

22. The device according to claim 21, characterized in that The tactile evaluation index is obtained by weighted summing the fourth value, the fifth value and the synchronization difference, the fourth value is a value obtained by inputting the tactile information and the network side parameters corresponding to the tactile service into the fourth function, and the fifth value is a value obtained by inputting the video information and the network side parameters corresponding to the video service into the fifth function.

23. The device according to any one of claims 14 to 18, characterized in that The processing unit is specifically used for: The application layer parameters and the network side parameters are input into a trained neural network model to obtain the tactile evaluation index.

24. The device according to claim 23, characterized in that The processing unit is further specifically used for: When the application layer parameters and / or network side parameters of the target service are different parameters, it is used to collect multiple scores of each user of multiple users for the target service, and the application layer parameters and / or network side parameters corresponding to each score of the multiple scores; Using the multiple scores as labels, the application layer parameters and / or network side parameters corresponding to each score in the multiple scores are input into the neural network model, and the neural network model is trained to obtain the trained neural network model.

25. The device according to any one of claims 14 to 24, characterized in that The tactile information includes at least one of the following: Vibration time, vibration intensity, tactile compression rate, tactile encoding key parameters, force feedback intensity, or interaction intensity.

26. The device according to any one of claims 14 to 25, characterized in that The application layer parameters also include video media information, and the video media information includes at least one of the following: Frame rate, period, or protocol data unit (PDU) aggregation information.

27. A tactile evaluation device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 13.

28. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method according to any one of claims 1 to 13.

29. A computer program product, comprising instructions, characterized in that: When the instructions are executed on a computer, the computer is caused to implement the method according to any one of claims 1 to 13.

Images