Measurement method and device, electronic equipment, storage medium and program product

Abstract

The invention provides a measurement method and device, electronic equipment, a storage medium and a program product, and the method comprises the steps: carrying out the first simulation processing of to-be-processed business data of a terminal through employing a simulation server, and obtaining first simulation process data; the simulation server is used for simulating a server in the service system and processing to-be-processed service data of the terminal in parallel with the server; and measuring the first simulation process data by using a measurement module to obtain a first processing performance index. In conclusion, according to the technical scheme provided by the invention, the bypass type measurement system can be embedded in the service system, namely, the parallel measurement channel is constructed by means of the simulation server. When measurement is needed, the system can capture real to-be-processed service data of the terminal in real time and reproduce simulation processing, data analysis and analysis are synchronously completed on the premise that main service is not interfered, the real-time performance of measurement and analysis is high, and the measurement result is more accurate.

Description

Technical Field

[0001] This disclosure relates to the field of communication technology, and in particular to a measurement method, apparatus, electronic device, storage medium, and program product. Background Technology

[0002] Currently, the measurement and analysis system is independent of the business system. When performing analysis and measurement, it collects business data from all business network elements that process business data and data after business processing is completed for any type of business data, and then performs analysis and measurement. However, its measurement and analysis has low real-time performance and low accuracy. Summary of the Invention

[0003] This disclosure provides a measurement method, apparatus, electronic device, storage medium, and program product to address, to some extent, the problems of low real-time performance and low accuracy in measurement and analysis.

[0004] According to one aspect of this disclosure, a measurement method is provided, the method comprising: performing a first simulation processing on the pending business data of a terminal using a simulation server to obtain first simulation process data; the simulation server being used to simulate a server in a business system and processing the pending business data of the terminal in parallel with the server; and measuring the first simulation process data using a measurement module to obtain a first processing performance index.

[0005] Furthermore, according to one aspect of the method of this disclosure, a simulation server is used to perform a first simulation processing on the terminal's pending service data to obtain first simulation process data, including: acquiring the pending service data based on the IP Multimedia Subsystem (IMS) mechanism; and performing a first simulation processing based on the service type of the pending service data to obtain first simulation process data.

[0006] Furthermore, according to one aspect of the method disclosed herein, based on the IP Multimedia Subsystem (IMS) mechanism, acquiring service data to be processed includes: acquiring a terminal's INVITE call request or re-INVITE call request; acquiring response information of the terminal's INVITE call request or re-INVITE call request; the response information of the INVITE call request or re-INVITE call request includes at least one of the following: ringing information and call answering information.

[0007] Furthermore, according to one aspect of the method of this disclosure, the service type includes at least one of the following: signaling, media; when the service type of the service data to be processed is signaling, a first simulation processing is performed based on the service type of the service data to be processed to obtain first simulation process data, including: determining an INVITE call request or a re-INVITE call request, and the signaling characteristics of the response information of the INVITE call request or the re-INVITE call request; the signaling characteristics include at least one of the following: reception time, call identifier, call address, source address; the first simulation process data is determined based on the signaling characteristics.

[0008] Furthermore, according to one aspect of the method of this disclosure, when the service type of the service data to be processed is media, a first simulation process is performed based on the service type of the service data to be processed to obtain first simulation process data, including: determining an INVITE call request or a re-INVITE call request, and the media characteristics of the response information of the INVITE call request or the re-INVITE call request; the media characteristics include at least one of the following: media type, encoding / decoding format, and transmission address; determining the media transmission path based on the media characteristics; and determining the first simulation process data based on the media transmission path.

[0009] Furthermore, according to one aspect of the method disclosed, the method further includes: subscribing to the business data to be processed using a simulation server to obtain the business data to be processed.

[0010] Furthermore, according to one aspect of the method of this disclosure, the first processing performance indicator includes at least one of the following: latency and throughput; the first processing performance indicator is obtained by measuring the first simulation process data using a measurement module, including: when the first processing performance indicator is latency, determining the difference between the sending time of the request message and the receiving time of the response message in the first simulation process data to obtain the latency; when the first processing performance indicator is throughput, determining the number of first simulation process data successfully transmitted within a first interval in the first simulation process data to obtain the throughput.

[0011] Furthermore, according to one aspect of the method of this disclosure, the method further includes: using a simulation server or a measurement module to determine whether the terminal is a measurement terminal; when the terminal is a normal terminal, the simulation server and the measurement module are in a non-working state; when the terminal is a measurement terminal, determining a first processing performance index.

[0012] Furthermore, according to one aspect of the method of this disclosure, determining whether a terminal is a measurement terminal using a simulation server or a measurement module includes: obtaining first identification information of the terminal; the first identification information includes at least one of the following: International Mobile Equipment Identity (IMEI), Mobile Equipment Identity (MEID), and Universal Unique Identifier (UUID); matching the first identification information with second identification information; and determining that the terminal is a measurement terminal when the first identification information and the second identification information are successfully matched.

[0013] Furthermore, according to one aspect of the method disclosed, the method further includes: using a simulation server to perform a second simulation processing on the processing business data between the terminal and the server to obtain second simulation process data; and using a measurement module to measure the second simulation process data to obtain a second processing performance index.

[0014] Furthermore, according to one aspect of the method of this disclosure, the method further includes: displaying a first processing performance indicator when the terminal calls the target user.

[0015] Furthermore, according to one aspect of the method disclosed herein, the service system includes at least one of the following: Long Term Evolution Voice Bearer System (VoLTE), New Radio Voice Bearer System (VoNR), and Enhanced Voice Network System.

[0016] According to another aspect of this disclosure, a measurement system is provided, comprising: a simulation server for implementing the method as described in any of the preceding claims; and a measurement device for implementing the method as described in any of the preceding claims.

[0017] According to another aspect of this disclosure, a measurement apparatus is provided, comprising: a simulation unit for performing a first simulation processing on pending business data of a terminal using a simulation server to obtain first simulation process data; the simulation server for simulating a server in a business system and processing the pending business data of the terminal in parallel with the server; and a measurement unit for measuring the first simulation process data using a measurement module to obtain a first processing performance index.

[0018] According to another aspect of this disclosure, an electronic device is provided, comprising: a memory for storing computer-readable instructions; and a processor for executing the computer-readable instructions, causing the electronic device to perform the method as described in any embodiment of one aspect.

[0019] According to another aspect of this disclosure, a non-transitory computer-readable storage medium is provided for storing computer-readable instructions that, when executed by a processor, cause the processor to perform the method as described in any embodiment of one aspect.

[0020] According to another aspect of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the method as described in any embodiment of one aspect.

[0021] This disclosure provides a measurement method, apparatus, electronic device, storage medium, and program product. The disclosure utilizes a simulation server to perform a first simulation process on the terminal's pending business data, obtaining first simulation process data. The simulation server simulates a server in the business system and processes the terminal's pending business data in parallel with the server. A measurement module measures the first simulation process data to obtain a first processing performance index. Thus, a bypass measurement system is embedded in the business system, i.e., a parallel measurement channel is constructed using the simulation server. When measurement is required, the system can capture real-time terminal pending business data and reproduce the simulation process. Without interfering with the main business, it synchronously completes data parsing and analysis, resulting in high real-time measurement and analysis and more accurate measurement results.

[0022] It should be understood that both the foregoing general description and the following detailed description are exemplary and intended to provide further illustration of the claimed technology. Attached Figure Description

[0023] The above and other objects, features, and advantages of this disclosure will become more apparent from the more detailed description of the embodiments thereof in conjunction with the accompanying drawings. The drawings are provided to further illustrate the embodiments of this disclosure and form part of the specification. They are used together with the embodiments of this disclosure to explain the disclosure and do not constitute a limitation thereof. In the drawings, the same reference numerals generally represent the same components or steps.

[0024] Figure 1 A schematic diagram of the architecture of a measurement system provided in an embodiment of this disclosure;

[0025] Figure 2 A schematic diagram of the system architecture of a measurement system in a Voice over Long-Term Evolution (VoLTE) or Voice over New Radio (VoNR) system provided in this disclosure embodiment;

[0026] Figure 3 A system architecture diagram of a measurement system in an enhanced communication network system provided in this disclosure embodiment;

[0027] Figure 4 A schematic flowchart of a measurement method provided in an embodiment of this disclosure;

[0028] Figure 5This is a schematic diagram illustrating the signaling measurement process in VoLTE or VoNR as provided in the embodiments of this disclosure;

[0029] Figure 6 This is a schematic diagram illustrating the signaling measurement process in an enhanced voice network system according to an embodiment of this disclosure;

[0030] Figure 7 A schematic diagram illustrating the process of media measurement in VoLTE or VoNR provided for embodiments of this disclosure;

[0031] Figure 8 This is a schematic flowchart illustrating media measurement in an enhanced voice network system according to an embodiment of the present disclosure;

[0032] Figure 9 This is a schematic diagram illustrating the process of performing media measurement after updating media data in VoLTE or VoNR, provided as an embodiment of this disclosure.

[0033] Figure 10 This is a schematic diagram illustrating the process of performing measurements after updating media data in an enhanced call network system, as provided in an embodiment of this disclosure.

[0034] Figure 11 This is a schematic diagram of the measurement process for a measurement terminal in an enhanced voice network system provided by an embodiment of this disclosure;

[0035] Figure 12 A communication diagram of a common terminal in an enhanced voice network system provided by an embodiment of this disclosure;

[0036] Figure 13 A structural block diagram of a measuring device provided in an embodiment of this disclosure;

[0037] Figure 14 A hardware block diagram of an electronic device provided in an embodiment of this disclosure;

[0038] Figure 15 This is a schematic diagram of a computer-readable storage medium provided in an embodiment of this disclosure. Detailed Implementation

[0039] To make the objectives, technical solutions, and advantages of this disclosure more apparent, exemplary embodiments according to this disclosure will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this disclosure, and not all embodiments of this disclosure. It should be understood that this disclosure is not limited to the exemplary embodiments described herein.

[0040] Currently, existing measurement and analysis systems are independent of business systems. When performing analysis and measurement, for any type of business data, they collect business data from all business network elements that process the business data and the data after the business processing is completed, and then perform analysis and measurement. However, their measurement and analysis has low real-time performance and low accuracy.

[0041] Therefore, this application proposes a measurement method that embeds a bypass measurement system into a business system, i.e., constructing a parallel measurement channel using a simulation server. When measurement is required, the system can capture real-time business data to be processed by the terminal and reproduce the simulation processing. Without interfering with the main business, it simultaneously completes data parsing and analysis, resulting in high real-time measurement and analysis and more accurate measurement results. First, please refer to... Figure 1 , Figure 1 This is a schematic diagram of the architecture of a measurement system provided in an embodiment of this disclosure. Figure 1 As shown, the measurement system includes at least a simulation server and a measurement module.

[0042] The simulation server can include a simulation application server and a simulation media server, which work together to monitor and analyze the performance of terminal service processing. The simulation application server mimics the operating logic of a real application server, accurately processing signaling requests sent by the terminal and responding like a real server. The simulation media server focuses on simulating media services, from media format parsing and transmission path planning to media stream quality control. The two complement each other; the former handles data at the business logic level, while the latter is responsible for media content simulation, jointly generating detailed simulation process data to lay a solid foundation for subsequent performance analysis.

[0043] The measurement module is primarily responsible for at least one function, including content analysis, signaling analysis, transmission analysis, and task management. In content analysis, it can keenly discern the inherent characteristics of business data, quickly identify whether the data is signaling information or media content, and further analyze its specific type and composition. In signaling analysis, it can accurately calculate at least one indicator, such as latency, based on various characteristics of the signaling data. In transmission analysis, it can monitor the path of media data transmission and calculate throughput. As for task management, it accurately identifies measurement terminals, rationally allocates the working status of the simulation server, and systematically plans the measurement process to ensure the efficient and orderly operation of the entire measurement system.

[0044] For example, Figure 2This is a schematic diagram of the system architecture of a measurement system in a Voice over Long-Term Evolution (VoLTE) or Voice over New Radio (VoNR) system, provided as an embodiment of this disclosure. Figure 3 This is a system architecture diagram of a measurement system in an enhanced communication network system provided in an embodiment of this disclosure.

[0045] from Figure 2 and Figure 3 As can be seen, regardless of the type of business system, the measurement system is connected to that business system and includes a simulation application server and a measurement module. The simulation application server further includes a simulation application server S102 and a simulation media server S103. The measurement module includes content analysis S104, signaling analysis S105, transmission analysis S106, and task management functions S107.

[0046] Figure 4 This is a schematic flowchart illustrating a measurement method provided in an embodiment of this disclosure. Figure 4 As shown, the method includes:

[0047] In step S401, the simulation server performs a first simulation process on the terminal's pending business data to obtain first simulation process data; the simulation server is used to simulate the server in the business system and processes the terminal's pending business data in parallel with the server.

[0048] In step S402, the measurement module is used to measure the data of the first simulation process to obtain the first processing performance index.

[0049] In this disclosure, the first simulation process data can be understood as the complete data interaction trajectory and status information recorded by the simulation server when it simulates the processing of the terminal's business data based on the operating logic of the business system. This may include, but is not limited to, the entire process details of business data from entering the simulation server, undergoing signaling parsing and media simulation processing, to the output result.

[0050] In this disclosure, the first processing performance index can be understood as a numerical parameter reflecting the terminal's service processing capability, extracted after professional analysis and quantitative calculation of the first simulation process data by the measurement module, and used to measure system performance. Taking latency as an example, it can intuitively show the time consumption from the issuance of a service request to the receipt of a response; the smaller the value, the faster the processing speed and the better the system performance.

[0051] Specifically, the measurement system can acquire the terminal's pending services periodically, non-periodically, or based on preset measurement tasks. After acquiring the pending service data, the simulation server performs a first simulation processing on the data according to the service type (signaling or media), generating first simulation process data containing complete interaction records. Then, based on this data, the measurement module performs differential analysis on signaling and media services according to preset calculation rules to obtain a first processing performance index. Simultaneously, the measurement module can also compare the first processing performance index with a preset threshold. When the index exceeds the threshold range, an alarm mechanism is automatically triggered, without specific limitations.

[0052] By deploying the simulation server in parallel with the actual business system server, it is possible to obtain business processing performance data in real time and accurately without affecting the normal operation of the terminal. The collaborative work of the simulation server and the measurement module ensures full automation of the process from data simulation and information collection to indicator calculation, greatly improving the efficiency and reliability of performance measurement and providing strong technical support for communication network optimization and service quality improvement.

[0053] In summary, embedding a bypass measurement system into the business system involves building a parallel measurement channel using a simulation server. When measurement is required, this system can capture real-time business data from the terminal and reproduce the simulation process. Without interfering with the main business, it can simultaneously complete data parsing and analysis, resulting in high real-time measurement and analysis performance and more accurate measurement results.

[0054] The following details how this disclosure utilizes a simulation server for simulation, including the following methods:

[0055] Based on the IP Multimedia Subsystem (IMS) mechanism, acquire the service data to be processed;

[0056] Based on the business type of the business data to be processed, the first simulation processing is performed to obtain the first simulation process data.

[0057] In this disclosure, the IP Multimedia Subsystem (IMS) mechanism can be understood as a standardized communication architecture built on an IP network. It follows the specifications set by international standards organizations, enabling flexible deployment and management of multimedia services. The core components of the IMS mechanism include network elements such as the Call Session Control Function (CSCF), Multimedia Resource Function (MRF), and Home Subscriber Server (HSS). It supports the Session Initiation Protocol (SIP) as the signaling control protocol, providing a unified service experience across different access networks. Furthermore, it enables the integration of third-party applications through open service capability interfaces, serving as a key technological foundation for the convergence of various communication services such as voice, video, and instant messaging.

[0058] In this disclosure, the service type may include, but is not limited to, at least one of the following: signaling and media. Signaling services refer to control information used to establish, manage, and release communication sessions, which can be transmitted between terminals and the network, primarily responsible for controlling and coordinating session states. Media services refer to data carrying actual communication content, including but not limited to at least one of voice streams, video streams, and file transfers, which can be directly transmitted between terminals.

[0059] In this embodiment, the method for acquiring pending business data can be based on IMS requiring terminals to report pending business data conforming to IMS format in real time, periodically, non-periodically, or at preset intervals; it can also be based on subscribing to pending business data conforming to IMS format from terminals, with no specific limitation. After acquiring the pending business data, it is necessary to distinguish different business characteristics and processing requirements. For signaling services, the simulation server can meticulously break down each control message, from the initiation time and path planning of the request information to the reception and feedback of the response information, completely simulating every step of the signaling flow in the real network, and retaining the entire process of request establishment, management, and release in the form of data traces. When facing media services, the simulation server can simulate and construct a dedicated transmission channel according to the format and transmission requirements of audio, video, and other content, recording the transmission status and data loss of the media stream in the virtual path. In this way, whether it is signaling data or media data, it can form the first simulation process data that accurately restores the actual operation of the business, laying a solid foundation for subsequent performance insights.

[0060] The following will elaborate on how this disclosure utilizes the IMS mechanism to obtain the business data to be processed, including the following methods:

[0061] Obtain the terminal's session invitation INVITE call request or re-session invitation re-INVITE call request;

[0062] Obtain the response information of the terminal's INVITE call request or re-INVITE call request; the response information of the INVITE call request or re-INVITE call request includes at least one of the following: ringing information, call answering information.

[0063] In this disclosure, an INVITE call request can be understood as a core signaling request used by the calling terminal to initiate a multimedia session under the Session Initiation Protocol (SIP) framework. When the calling terminal wishes to establish at least one of the following with the called terminal: a voice call, video conference, or other real-time communication, it can send an INVITE request to the IMS system, triggering the entire session establishment process. A re-INVITE call request can be understood as an instruction used to dynamically adjust session parameters during an established multimedia session. When both parties need to modify the configuration of the existing session (such as adding or removing media streams, switching video resolution, or adjusting audio encoding format), the initiating party can send a re-INVITE request. This request carries the updated session parameters, requiring the other party to renegotiate. After both parties reach an agreement, the session is dynamically updated to meet changing communication needs.

[0064] In this disclosure, ringing information can be understood as the message sent to the calling party during a call when the called party's device receives an INVITE request and is ready to respond, but has not yet answered, to indicate that the calling party and the called party are ringing. This message is usually displayed as a 180 Ringing response message.

[0065] In this disclosure, call response information can be understood as the information sent by the called party to the calling party when the called party answers the call, indicating that the session has been successfully established. Generally, a 200 OK response message is used as the marker of call response, and subsequent media stream interaction will take place.

[0066] Specifically, the simulation server can acquire pending business data based on the IMS mechanism by real-time monitoring channels through data acquisition points deployed in the IMS network. When a terminal issues an INVITE or re-INVITE call request, the data acquisition point captures the request message and transmits it completely to the simulation server. Upon receiving the request, the simulation server parses the message content according to the protocol specifications, extracts and records the timestamp, forming the initial request signaling data record. Simultaneously, the simulation server continuously monitors the channel feedback for the request response information. Once the called party returns a ringing message (180 Ringing), the server quickly identifies the response message, records the start time and duration of the ringing, and uses this information for subsequent analysis of performance metrics such as call setup latency. When a call answer message (200 OK) is received, the simulation server can further parse the 200 OK message and, combined with the previous request data, completely reconstruct the signaling interaction trajectory of the entire session establishment process, thereby obtaining comprehensive and accurate pending business data, providing a solid data foundation for subsequent simulation processing and performance analysis.

[0067] The following details how the simulation server simulates and processes signaling data to obtain the first simulation process data. The methods include:

[0068] The signaling characteristics for determining the response information of an INVITE call request or a re-INVITE call request, and the signaling characteristics for the response information of the INVITE call request or the re-INVITE call request; the signaling characteristics include at least one of the following: reception time, call identifier, call address, and source address;

[0069] Based on signaling characteristics, the data for the first simulation process are determined.

[0070] In this disclosure, signaling features can be understood as a set of parameters that uniquely identify and describe the SIP signaling interaction process. These parameters, like the "DNA" of signaling, not only record the physical attributes of the signaling message (such as reception time and transmission path) but also carry the logical information of the session (such as session identity and participant information), and are essential elements for constructing simulation process data. By analyzing signaling features, the simulation server can reconstruct the complete lifecycle of a session, including at least one stage such as session initiation, progress, modification, and termination. The signaling features include at least one of the following: reception time, which can be understood as the precise timestamp of the SIP signaling message arriving at the system, recorded by the simulation server using a high-precision clock; call identifier, which can be understood as randomly generated by the calling terminal and remains unchanged throughout the entire session lifecycle; call address, which typically represents the logical address or identity of the called party; and source address, used to identify the physical location and logical identity of the signaling initiator.

[0071] In this embodiment, the simulation server processes signaling data through the following logic: First, feature parsing is performed, extracting parameters such as the reception time (e.g., a timestamp accurate to milliseconds), call identifier (unique Call-ID), call address (called party SIP URI), and source address (caller IP / port) from the INVITE / re-INVITE request and response messages. Next, a signaling chain is constructed chronologically, recording the complete interaction process from request initiation to response reception (e.g., 200 OK at time T2). Finally, the signaling features and interaction trajectory are integrated into first simulation process data, such as a structured record containing time series, state transitions (e.g., INVITE → 180 Ringing → 200 OK), and parameter mappings (e.g., source / destination address correspondence), for subsequent calculation of metrics such as latency.

[0072] In one exemplary embodiment, Figure 5 This is a schematic diagram illustrating the signaling measurement process in VoLTE or VoNR as provided in an embodiment of this disclosure. Figure 6 This is a schematic diagram illustrating the signaling measurement process in an enhanced voice network system, provided as an embodiment of this disclosure.

[0073] Among them, from Figure 5 It can be seen that the signaling measurement process in VoLTE or VoNR systems includes:

[0074] S501: The measurement system is configured to measure the signaling data of user A;

[0075] S502-S506: The user initiates a call request INVITE, executes the existing IMS process, and reaches the simulation application server through A-SBC(A), CSCF(A), and AS(A);

[0076] S507: The emulation application server records information about event 1 (call start), including the time the message was received, the UE-B's terminal information, and the network information where the UE-B is located.

[0077] S508: The emulation application server forwards the call request INVITE to CSCF(A);

[0078] S509: CSCF(A) forwards the call request INVITE to the UE-B network;

[0079] S510: UE-A and UE-B complete the basic call negotiation by executing the existing IMS process through the VoLTE / VoNR network and the emulation application server;

[0080] S511: UE-B terminal ringing;

[0081] S512-S513: The 180 (ringing) message sent by UE-B reaches the emulation application server via CSCF(A);

[0082] S514: The simulation application server records information about event 5 (user ringing), including the time the message was received, the UE-B's terminal information, and the network information where the UE-B is located.

[0083] S515-S519: The simulation application server forwards the 180 response to CSCF(A), executes the existing IMS process, and forwards the 180 response to UE-A;

[0084] S520: UE-A executes the existing IMS procedure to confirm the 180 response;

[0085] S521: User Response;

[0086] S522-S523: The 500 OK (response) message sent by UE-B reaches the emulation application server via CSCF(A);

[0087] S524: The simulation application server records information about event 3 (user response), including the time the message was received, the UE-B's terminal information, and the network information where the UE-B is located.

[0088] S525-S529: The simulation application server forwards the 500 OK response to CSCF(A), executes the existing IMS process, and forwards the 500 OK response to UE-A.

[0089] At this point, the measurement system has collected the signaling information of UE-A, and can analyze and evaluate signaling-related information such as call delay.

[0090] Among them, from Figure 6 It can be seen that the process of signaling measurement in an enhanced voice communication network system includes:

[0091] S601-S604: The simulation application server subscribes to the call event notification of a specified user from the enhanced communication system, instructs the enhanced communication system to report the call event to the simulation application server, and does not need to wait for the simulation server to issue control instructions. The subscription request carries the address information of the simulation server to receive the notification message.

[0092] S605-S612: When the enhanced call system receives an initial call request (INVITE), it reports a call start event (BEGIN) to the emulation application server through the capability open network element. The emulation application server records the event information.

[0093] S613-S615: Enhanced call system connection to second terminal B;

[0094] S616-S621: The second terminal B sends a call ringing response (180) to the enhanced communication system. The enhanced communication system reports the call ringing event (RINGING) to the simulation application server through the open network element. The simulation application server records the event information.

[0095] S622-S625: Enhanced call system completes the interaction with the ringing response (180) information of the first terminal A; media stream information of terminal B.

[0096] S626-S631: The second terminal B sends an answer response (200) to the enhanced call system. The enhanced call system reports the call ringing event (ANSWER) to the simulation application server through the capability open network element. The simulation application server records the event information.

[0097] S632-S634: Enhanced communication system completes the interaction of response (200) information with the first terminal A;

[0098] At this point, the measurement system can calculate information such as call delay based on information such as call event 1, call event 2, and call event 3.

[0099] The following details how the simulation server simulates and processes media data to obtain the first simulation process data. The methods include:

[0100] The media characteristics of the response information for the INVITE call request or re-INVITE call request are determined; the media characteristics include at least one of the following: media type, encoding / decoding format, and transmission address;

[0101] Determine the media transmission path based on media characteristics;

[0102] Based on the media transmission path, the data for the first simulation process is determined.

[0103] In this disclosure, media characteristics can be understood as a set of parameters describing the attributes and transmission configuration of media service data, serving as the basis for the simulation server to construct media transmission. These characteristics act like identity tags for media services, defining not only the content type and encoding method of media data but also planning the data transmission path in the network, providing fundamental information for the simulation processing of media streams. Media characteristics may include, but are not limited to, at least one of the following: Media type, which can be understood as a classification identifier for media data content; common types include audio, video, and data. Encoding / decoding format, which can be understood as the rules and standards for compressing, encoding, and decoding media data. Transmission address, which can be understood as the source and destination identifiers for media data transmission in the network, typically including IP address and port number.

[0104] In this disclosure, the media transmission path can be understood as the logical link from the sending end through network nodes (such as routers, gateways, multimedia resource function processors P, etc.) to the receiving end. The determination of this path depends not only on the transmission address but also on the network topology, node load, and transmission strategy. Based on the media characteristics, the media transmission path can be determined to simulate the actual transmission route of media streams in a real network environment.

[0105] In this embodiment of the disclosure, when the data to be processed is media, the simulation server generates first simulation process data according to the following process: First, it parses the media characteristics from the INVITE / re-INVITE request and response messages. Then, based on the media transmission address, the simulation server plans the media transmission path. For example, the server can select the optimal path according to the node load status, such as "terminal A→P→terminal B", and record the information of each hop node on the path. Finally, the simulation server combines the media characteristics and the transmission path to generate the first simulation process data. This data contains detailed information about media transmission, such as the transmission latency of the media stream at each node, bandwidth usage, and possible retransmission events.

[0106] In one exemplary embodiment, Figure 7 This is a schematic diagram illustrating the process of media measurement in VoLTE or VoNR, provided for embodiments of this disclosure. Figure 8 This is a schematic diagram illustrating the process of media measurement in an enhanced call network system, as provided in an embodiment of this disclosure.

[0107] Among them, from Figure 7 As can be seen, the media measurement process in VoLTE or VoNR includes:

[0108] S701: The measurement system is set to measure the media data of user A;

[0109] S702-S706: The user initiates a call request INVITE, executes the existing IMS process, and reaches the simulation application server through A-SBC(A), CSCF(A), and AS(A);

[0110] S707: The simulation application server performs media anchoring operations according to the measurement task, passing the media of both user A and user B through the simulation media server.

[0111] S708: The simulation application server requests media resources from the simulation media server;

[0112] S709: The emulation application server sends an INVITE request to the CSCF(A), in which the media information of UE-A is replaced with the information of the emulation media server;

[0113] S710: CSCF forwards the INVITE request to the network where UE-B is located;

[0114] S711-S712: UE-B returns a 187 response, which carries UE-B's media information;

[0115] S713: The emulation application server replaces the media information of UE-B in the 187 response with the information of the emulation media server and forwards it to CSCF(A);

[0116] S714-S717: The 187 response is forwarded to UE-A via CSCF(A), AS(A), and A-SBC(A);

[0117] S718: UE-A and UE-B complete the basic call negotiation by executing the existing IMS process through the VoLTE / VoNR network and the emulation application server;

[0118] S719: User Response;

[0119] S720-S721: The 200 OK (response) message sent by UE-B reaches the emulation application server via CSCF(A);

[0120] S722-S723: The emulation application server instructs the emulation media server to perform media monitoring;

[0121] S724-S728: The emulation application server forwards the 200 OK response to CSCF(A), executes the existing IMS process, and forwards the 200 OK response to UE-A.

[0122] At this point, both UE-A and UE-B media are measured by the measurement system, which can analyze and evaluate information such as media latency.

[0123] Among them, from Figure 8 As can be seen, the media measurement process in an enhanced voice communication network system includes:

[0124] The S801-S804 simulation application server subscribes to call event notifications for designated users from the enhanced communication system, instructs the enhanced communication system to report call events to the simulation application server, and needs to wait for the simulation server to issue control instructions. The subscription request includes the address information of the simulation server to receive notification messages.

[0125] When the S805-S812 enhanced communication system receives an initial call request (INVITE), it reports a call start event (BEGIN) to the emulation application server through the capability open network element. The emulation application server records this event information.

[0126] The S813-S825 emulation application server sends media anchoring control commands to the enhanced communication system, instructing UE-A and UE-B to stream media across the media plane;

[0127] After the S826-S835 user responds, the simulation application server receives the user respond call event and sends a media copy request to the media plane, requesting the media plane to copy a copy of the media streams of user A and user B to the simulation media server.

[0128] At this point, the measurement system can evaluate media latency, jitter, and other results based on the received media stream information from UE-A and UE-B and the message information.

[0129] In one exemplary embodiment, Figure 9 This is a schematic diagram illustrating the process of performing media measurement after updating media data in VoLTE or VoNR, as provided in an embodiment of this disclosure. Figure 10 This is a schematic diagram illustrating the process of performing measurements after updating media data in an enhanced call network system, as provided in an embodiment of this disclosure.

[0130] Among them, from Figure 9 As can be seen, the process of performing media measurement after updating media data in VoLTE or VoNR includes:

[0131] S901: The measurement system is configured to measure the service quality data of user A;

[0132] S902-S906: The user initiates a call request INVITE, executes the existing IMS process, and reaches the simulation application server through A-SBC(A), CSCF(A), and AS(A);

[0133] S907-S908: The simulation application server performs media anchoring operations according to the measurement task, and the media of both user A and user B are passed through the simulation media server.

[0134] S909: The emulation application server sends an INVITE request to the CSCF(A), in which the media information of UE-A is replaced with the information of the emulation media server;

[0135] S910: The CSCF forwards the INVITE request to the network where UE-B is located;

[0136] S911-S912: UE-B returns a 183 response, which carries UE-B's media information;

[0137] S913: The emulation application server replaces the media information of UE-B in the 183 response with the information of the emulation media server and forwards it to CSCF(A);

[0138] S914-S917: The 183 response is forwarded to UE-A via CSCF(A), AS(A), and A-SBC(A);

[0139] S918: UE-A and UE-B complete the basic call negotiation by executing the existing IMS process through the VoLTE / VoNR network and the emulation application server;

[0140] S919-S920: User responds, UE-B and UE-A establish a call;

[0141] S921-S924: AS(A) performs business control based on the user's subscription and sends media plane information to the simulation application server via re-INVITE;

[0142] S925: The simulation application server interacts with the simulation media server to update media information and connect the media plane to the simulation media server;

[0143] S926-S928: The emulation application server forwards the re-INVITE request to UE-B and completes the new media negotiation;

[0144] At this point, all media processed by Media Surface (A) are subjected to a measurement system, which can analyze and evaluate information such as media latency and media content quality after processing.

[0145] Among them, from Figure 10 It can be seen that the measurement process after updating media data in the enhanced voice network system includes:

[0146] The S1001-S1004 simulation application servers subscribe to call event notifications for designated users from the enhanced communication system, instruct the enhanced communication system to report call events to the simulation application server, and need to wait for the simulation server to issue control instructions. The subscription request includes the address information of the simulation server to receive notification messages.

[0147] When the S1005-S1013 enhanced communication system receives an initial call request (INVITE), it reports the call start event to the emulation application server through the capability open network element. The emulation application server records the event information and completes signaling interaction with UE-A and UE-B through the enhanced communication network.

[0148] After the user answers in S1014-S1024, the simulation application server receives the user answer call event and sends a media anchoring control command to the enhanced communication system, instructing UE-A and UE-B to stream the media through the media plane.

[0149] The S1025-S1032 emulation application server emulates specific services, sends media control requests to the media plane, performs media processing, and instructs the processed media stream to be copied to the emulation media server.

[0150] At this point, the measurement system can assess the media condition based on the media stream information received after processing from the media surface.

[0151] The following details the method for the simulation server of this disclosure to obtain business data to be processed, which also includes:

[0152] The simulation server is used to subscribe to the business data to be processed, and the business data to be processed is obtained.

[0153] In this embodiment of the disclosure, subscription can be performed when acquiring pending service data. Subscription can be understood as the simulation server sending a subscription request to the terminal through the IMS network interface to establish a long-term data acquisition channel. For example, the simulation server can subscribe to the terminal's signaling and media data updates based on user identifiers (such as IMSI) or service types (such as VoLTE calls). When the terminal generates new pending services, the relevant data is automatically pushed to the simulation server. In this way, dynamic capture of service data can be achieved without actively polling the terminal status in real time, reducing system resource consumption while ensuring the timeliness and completeness of data acquisition.

[0154] The following details how the measurement module of this disclosure measures and obtains the first processing performance index, including:

[0155] The first processing performance metric disclosed herein may include, but is not limited to, at least one of the following: latency and throughput. Latency can be understood as the time consumed from the initiation of a service request to the completion of a response, and is a metric for measuring the real-time performance of the system. Throughput can be understood as the amount of effective data successfully transmitted per unit time, and is used to evaluate the data processing and transmission efficiency of the system.

[0156] Methods for obtaining the first processing performance index include:

[0157] When the first processing performance indicator is latency, the latency is obtained by determining the difference between the sending time of the request message and the receiving time of the response message in the first simulation process data.

[0158] When the first processing performance indicator is throughput, the number of first simulation process data successfully transmitted within the first interval in the first simulation process data is determined to obtain the throughput.

[0159] In this embodiment of the disclosure, when the first processing performance indicator is latency, the measurement module can extract the sending time (recorded by the terminal timestamp or simulation server) of the request message (such as INVITE) and the receiving time of the response message (such as 200OK) from the first simulation process data, and calculate the time difference between the two as the latency. For example, if the INVITE sending time is T1 = 10:00:00.000 and the 200OK receiving time is T2 = 10:00:02.500, then the latency is 2500 milliseconds (ms).

[0160] In another embodiment of this disclosure, when the first processing performance indicator is throughput, the measurement module sets a statistical interval and counts the amount of media data successfully transmitted through the simulated transmission path within that interval as the throughput. For example, if 100 audio data packets are transmitted within the first interval (10:00:00-10:00:01), and each packet has a payload of 200 bytes, then the throughput is 100 × 200 bytes / second = 20,000 bytes / second (approximately 156.25 kbps).

[0161] Using the above method, the measurement module transforms abstract simulation process data into quantifiable performance indicators, thereby representing accurate measurement results.

[0162] The following details the method that, prior to measurement, includes:

[0163] Use a simulation server or measurement module to determine whether the terminal is a measurement terminal;

[0164] When the terminal is a regular terminal, the simulation server and measurement module are in a non-working state;

[0165] When the terminal is a measurement terminal, the first processing performance index is determined.

[0166] In this embodiment of the disclosure, before performing simulation measurements, the simulation server or measurement module needs to determine whether the terminal is a preset measurement terminal. Only when the terminal is confirmed as a measurement terminal will the subsequent simulation processing and performance measurement process be triggered, in order to avoid causing resource consumption or data interference to ordinary user terminals.

[0167] In one exemplary embodiment, Figure 11This is a schematic diagram of the measurement process for a measurement terminal in an enhanced call network system, provided as an embodiment of this disclosure. Figure 12 This is a communication diagram of a common terminal in an enhanced voice network system provided by an embodiment of this disclosure.

[0168] from Figure 11 It can be seen that the measurement process performed by the measurement terminal includes:

[0169] The S1101 measurement system interacts with a customized measurement terminal to issue measurement tasks. The test tasks include the calling number, the calling method (audio, video, etc.), the number of calls, the information collected, and the data reporting path, etc.

[0170] The S1102 measurement system interacts with the enhanced call network to set up call event reporting strategies for the numbers corresponding to the customized measurement terminals.

[0171] The S1103 customized measurement terminal automatically initiates or receives calls via an enhanced call network;

[0172] The S1104 enhanced communication system reports signaling data to the measurement system, including terminal information, call events, network information, and time information.

[0173] The S1105 enhanced call system reports media data to the measurement system, including information such as the user's audio stream and video stream.

[0174] At this point, the measurement system can enhance the signaling and media information reported by the call system based on the information reported by the customized measurement terminal, and evaluate the user's call quality.

[0175] from Figure 12 It can be seen that the communication process of a regular terminal includes:

[0176] Ordinary terminals initiate or receive calls to the enhanced voice network manually. During this time, the measurement system is not in operational mode. It should be noted that under certain special conditions, the measurement system can still perform measurements when required by the ordinary terminal. The measurement process includes:

[0177] The S1201 measurement system interacts with the enhanced call network to set up call event reporting strategies for the numbers corresponding to the customized measurement terminals;

[0178] The S1202 ordinary terminal initiates or receives calls to or from the enhanced voice network manually.

[0179] The S1203 enhanced communication system reports signaling data to the measurement system, including terminal information, call events, network information, and time information.

[0180] The S1204 enhanced communication system reports media data to the measurement system, including information such as the user's audio stream and video stream.

[0181] At this point, the measurement system can enhance the signaling and media information reported by the call system based on the information reported by the customized measurement terminal, and evaluate the user's call quality.

[0182] The following details how to determine whether a terminal is a measurement terminal, including the following methods:

[0183] Obtain the terminal's first identification information; the first identification information includes at least one of the following: International Mobile Equipment Identity (IMEI), Mobile Equipment Identity (MEID), and Universal Unique Identifier (UUID);

[0184] Match the first identification information with the second identification information;

[0185] When the first identification information and the second identification information are successfully matched, the terminal is determined to be a measurement terminal.

[0186] In this disclosure, the first identification information can be understood as a unique identifier at the terminal hardware or software level, used to accurately identify individual devices or sessions. Specifically: International Mobile Equipment Identity (IMEI): a globally unique device identifier consisting of 15 digits. Mobile Equipment Identity (MEID): a network device identifier consisting of 14 hexadecimal digits. Universally Unique Identifier (UUID): a generated 128-bit globally unique string.

[0187] In this disclosure, the second identification information can be understood as a pre-configured whitelist of measurement terminals, which includes the terminal identifiers authorized to perform performance measurements (such as the IMEI of a specific test phone, the UUID of a test session, etc.).

[0188] In this embodiment, the first identification information of the terminal can be obtained by parsing the SIP signaling message (such as INVITE) initiated by the terminal, or by interacting with the HSS to query the device identifier in the terminal's subscription data. Next, the obtained first identification information is compared precisely with pre-configured second identification information (whitelist) using string matching or hash matching. If either identifier matches successfully, the terminal is determined to be a measurement terminal, triggering subsequent simulation and measurement processes.

[0189] The measurement methods of this disclosure are further described below:

[0190] The simulation server is used to perform a second simulation process on the business data processed by the terminal and the server to obtain the second simulation process data;

[0191] The second simulation process data is measured using the measurement module to obtain the second processing performance index.

[0192] In this embodiment, the simulation server can perform a first simulation processing on the terminal's pending business, and a second simulation processing on the actual business data exchanged between the terminal and the server, obtaining second simulation process data. This second simulation process data can be understood as a complete simulation record of the server's business processing logic and network transmission path, obtained through reverse engineering. Specifically, by analyzing the response data returned by the server and combining it with the business requests from the terminal side, it reverse-engineers the details of the server's processing flow, including but not limited to data routing strategies, load balancing mechanisms, and cache hit rates. Through this simulation mechanism, this disclosure achieves comprehensive monitoring of the entire business processing flow, extending from single-terminal performance evaluation to full-link optimization of the "terminal-network-server" chain, significantly improving the depth and systematic nature of performance measurement.

[0193] The measurement methods of this disclosure are further described below:

[0194] When the terminal calls the target user, the first processing performance indicator is displayed.

[0195] In this disclosure, the display method may include, but is not limited to, at least one of the following: displaying latency and other metrics in real time in the form of a floating window on the terminal call interface; generating visual charts (such as line charts and bar charts) to compare historical performance data; and displaying abnormal metrics through pop-up windows. Furthermore, it may support user-defined display content, such as displaying only metrics relevant to the current business (emphasizing latency for voice calls and highlighting throughput for video calls).

[0196] In this embodiment, once the measurement system completes the calculation and analysis of the first and second processing performance indicators, it can automatically retrieve and display the latest performance indicator data when the terminal calls the target user, at least once the terminal is powered on, during network switching, or during periodic performance testing. This allows users to intuitively understand the communication quality status, and network maintenance personnel can quickly locate performance bottlenecks based on real-time data, achieving closed-loop management from user perception to network optimization, effectively improving terminal service processing efficiency and user experience.

[0197] The following describes the specific types of business systems, which may include, but are not limited to, at least one of the following: VoLTE voice bearer system, VoNR voice bearer system, and enhanced voice network system.

[0198] VoLTE enables voice services to be transmitted over LTE data networks via the IP Multimedia Subsystem (IMS), completely eliminating the need for traditional circuit-switched (CS) voice modes. VoNR is a voice communication technology based on 5G NR (New Radio) networks, inheriting the IMS architecture of VoLTE and adapting to 5G features, making it a native voice solution for 5G networks. Enhanced call network systems are communication systems that improve the quality of traditional calls through technological upgrades or architectural optimizations.

[0199] All three business systems mentioned above are implemented based on the IMS mechanism, and through optimization of different network layer technologies, they continuously improve the user's communication experience.

[0200] This disclosure also provides a measurement system, the measurement system comprising:

[0201] A simulation server for implementing the method as described in any of the above embodiments;

[0202] A measuring device for implementing the method described above.

[0203] This disclosure also provides a measuring device. Figure 13 A structural block diagram of a measuring device provided in an embodiment of this disclosure, such as... Figure 13 As shown, the measuring device 1300 includes:

[0204] The simulation unit 1301 is used to perform a first simulation process on the terminal's pending business data using a simulation server to obtain first simulation process data.

[0205] The measurement unit 1302 is used to simulate the server in the business system and to process the terminal's pending business data in parallel with the server; the measurement module is used to measure the first simulation process data to obtain the first processing performance index.

[0206] In one exemplary embodiment, the simulation unit 1301 is specifically used to: acquire service data to be processed based on the IP Multimedia Subsystem (IMS) mechanism; and perform a first simulation process based on the service type of the service data to be processed to obtain first simulation process data.

[0207] In one exemplary embodiment, the simulation unit 1301 is specifically used to: obtain the terminal's session invitation INVITE call request or re-session invitation re-INVITE call request; obtain the response information of the terminal's INVITE call request or re-INVITE call request; the response information of the INVITE call request or re-INVITE call request includes at least one of the following: ringing information, call answering information.

[0208] In one exemplary embodiment, the simulation unit 1301 is specifically used for: the service type including at least one of the following: signaling, media; when the service type of the service data to be processed is signaling, performing a first simulation process based on the service type of the service data to be processed to obtain first simulation process data, including: determining an INVITE call request or a re-INVITE call request, and the signaling characteristics of the response information of the INVITE call request or the re-INVITE call request; the signaling characteristics include at least one of the following: reception time, call identifier, call address, source address; determining the first simulation process data based on the signaling characteristics.

[0209] In one exemplary embodiment, the simulation unit 1301 is specifically configured to: when the service type of the service data to be processed is media, perform a first simulation process based on the service type of the service data to be processed to obtain first simulation process data, including: determining the media characteristics of the response information of the INVITE call request or re-INVITE call request; the media characteristics include at least one of the following: media type, encoding / decoding format, and transmission address; determining the media transmission path based on the media characteristics; and determining the first simulation process data based on the media transmission path.

[0210] In one exemplary embodiment, the simulation unit 1301 is further configured to: subscribe to the business data to be processed using the simulation server to obtain the business data to be processed.

[0211] In one exemplary embodiment, the measurement unit 1302 is specifically used for: the first processing performance indicator includes at least one of the following: latency and throughput; measuring the first simulation process data using the measurement module to obtain the first processing performance indicator, including: when the first processing performance indicator is latency, determining the difference between the sending time of the request message and the receiving time of the response message in the first simulation process data to obtain the latency; when the first processing performance indicator is throughput, determining the number of first simulation process data successfully transmitted within a first interval in the first simulation process data to obtain the throughput.

[0212] In one exemplary embodiment, the measurement unit 1302 is further configured to: determine whether the terminal is a measurement terminal using a simulation server or a measurement module; when the terminal is a normal terminal, the simulation server and the measurement module are in a non-working state; when the terminal is a measurement terminal, determine a first processing performance index.

[0213] In one exemplary embodiment, the measurement unit 1302 is further configured to: determine whether the terminal is a measurement terminal using a simulation server or a measurement module, including: obtaining first identification information of the terminal; the first identification information includes at least one of the following: International Mobile Equipment Identity (IMEI), Mobile Equipment Identity (MEID), and Universal Unique Identifier (UUID); matching the first identification information with second identification information; and determining that the terminal is a measurement terminal when the first identification information and the second identification information are successfully matched.

[0214] In one exemplary embodiment, the simulation unit 1301 is further configured to: perform a second simulation process on the processing business data between the terminal and the server using a simulation server to obtain second simulation process data; and measure the second simulation process data using a measurement module to obtain a second processing performance index.

[0215] In one exemplary embodiment, the measurement unit 1302 is further configured to: display a first processing performance indicator when the terminal calls the target user.

[0216] In one exemplary embodiment, the simulation unit 1301 is specifically used for: the service system including at least one of the following: Long Term Evolution Voice Bearer System (VoLTE), New Radio Voice Bearer System (VoNR), and Enhanced Call Network System.

[0217] Figure 14 This is a hardware block diagram of an electronic device provided according to an embodiment of the present disclosure. The electronic device 1400 according to an embodiment of the present disclosure includes at least a processor and a memory for storing computer-readable instructions. When the computer-readable instructions are loaded and executed by the processor, the processor performs the measurement method described in any of the preceding embodiments of the present disclosure.

[0218] Figure 14 The illustrated electronic device 1400 specifically includes a central processing unit (CPU) 1401, a graphics processing unit (GPU) 1402, and a memory 1403. These units are interconnected via a bus 1404. The CPU 1401 and / or GPU 1402 can function as the aforementioned processor, and the memory 1403 can function as the aforementioned memory storing computer-readable instructions. Furthermore, the electronic device 1400 may also include a communication unit 1405, a storage unit 1406, an output unit 1407, an input unit 1408, and an external device 1409, all of which are also connected to the bus 1404.

[0219] Figure 15 This is a schematic diagram of a computer-readable storage medium provided in an embodiment of this disclosure. (As shown...) Figure 15As shown, a computer-readable storage medium 1500 according to an embodiment of the present disclosure stores computer-readable instructions 1501 thereon. When the computer-readable instructions 1501 are executed by a processor, the measurement method described above with reference to any embodiment of the present disclosure is performed. The computer-readable storage medium includes, but is not limited to, volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, optical disk, magnetic disk, etc.

[0220] This disclosure further provides a computer program product, including a computer program that, when executed by a processor, implements the measurement method described in any of the preceding embodiments of this disclosure.

[0221] The present disclosure provides a measurement method, apparatus, electronic device, storage medium, and program product. This disclosure utilizes a simulation server to perform a first simulation processing on the terminal's pending business data, obtaining first simulation process data. The simulation server simulates a server in the business system and processes the terminal's pending business data in parallel with the server. A measurement module measures the first simulation process data to obtain a first processing performance index. Thus, a bypass measurement system is embedded in the business system, i.e., a parallel measurement channel is constructed using the simulation server. When measurement is required, the system can capture real-time terminal pending business data and reproduce the simulation processing. Without interfering with the main business, it synchronously completes data parsing and analysis, resulting in high real-time measurement and analysis and more accurate measurement results.

[0222] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this disclosure.

[0223] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0224] The block diagrams of devices, apparatuses, devices, and systems disclosed herein are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0225] Additionally, as used herein, the “or” used in a list of items beginning with “at least one” indicates a separate list, such that a list of, for example, “at least one of A, B, or C” means A or B or C, or AB or AC or BC, or ABC (i.e., A and B and C). Furthermore, the word “exemplary” does not imply that the described example is preferred or better than other examples.

[0226] It should also be noted that in the systems and methods of this disclosure, the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered as equivalent solutions to this disclosure.

[0227] Various changes, substitutions, and modifications can be made to the technology described herein without departing from the teachings defined by the appended claims. Furthermore, the scope of the claims of this disclosure is not limited to the specific aspects of the processes, machines, manufactures, events, means, methods, and actions described above. Currently existing or later-developed processes, machines, manufactures, events, means, methods, or actions that perform substantially the same function or achieve substantially the same result as the corresponding aspects described herein can be utilized. Therefore, the appended claims include such processes, machines, manufactures, events, means, methods, or actions within their scope.

[0228] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0229] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.

Claims

1. A measurement method, characterized in that, The method includes: The simulation server is used to perform a first simulation process on the terminal's pending business data to obtain first simulation process data; the simulation server is used to simulate the server in the business system and processes the terminal's pending business data in parallel with the server. The first simulation process data is measured using a measurement module to obtain the first processing performance index.

2. The method according to claim 1, characterized in that, The first simulation processing of the terminal's pending business data using a simulation server to obtain first simulation process data includes: The service data to be processed is obtained based on the IP Multimedia Subsystem (IMS) mechanism. Based on the business type of the business data to be processed, the first simulation processing is performed to obtain the first simulation process data.

3. The method according to claim 2, characterized in that, The acquisition of the service data to be processed based on the IP Multimedia Subsystem (IMS) mechanism includes: Obtain the terminal's session invitation INVITE call request or re-session invitation re-INVITE call request; Obtain the response information of the terminal's INVITE call request or re-INVITE call request; the response information of the INVITE call request or re-INVITE call request includes at least one of the following: ringing information, call answering information.

4. The method according to claim 2 or 3, characterized in that, The service type includes at least one of the following: signaling, media; when the service type of the service data to be processed is signaling, the first simulation processing is performed based on the service type of the service data to be processed to obtain the first simulation process data, including: Determine the signaling characteristics of the response information for the INVITE call request or re-INVITE call request; the signaling characteristics include at least one of the following: reception time, call identifier, call address, and source address; Based on the signaling characteristics, the data for the first simulation process are determined.

5. The method according to claim 4, characterized in that, When the service type of the service data to be processed is media, the first simulation processing is performed based on the service type of the service data to be processed to obtain the first simulation process data, including: The media characteristics of the response information to the INVITE call request or re-INVITE call request are determined; the media characteristics include at least one of the following: media type, codec format, and transmission address; Based on the aforementioned media characteristics, the media transmission path is determined; Based on the media transmission path, the data for the first simulation process is determined.

6. The method according to claim 2, characterized in that, The method further includes: The simulation server is used to subscribe to the business data to be processed, thereby obtaining the business data to be processed.

7. The method according to claim 1, characterized in that, The first processing performance indicator includes at least one of the following: latency and throughput; the measurement of the first simulation process data using the measurement module to obtain the first processing performance indicator includes: When the first processing performance indicator is the delay, the difference between the sending time of the request message and the receiving time of the response message in the first simulation process data is determined to obtain the delay; When the first processing performance indicator is the throughput, the number of first simulation process data successfully transmitted within the first interval in the first simulation process data is determined to obtain the throughput.

8. The method according to claim 1, characterized in that, The method further includes: The simulation server or the measurement module is used to determine whether the terminal is a measurement terminal; When the terminal is a regular terminal, the simulation server and the measurement module are in a non-working state; When the terminal is the measurement terminal, the first processing performance index is determined.

9. The method according to claim 8, characterized in that, The step of determining whether the terminal is a measurement terminal using the simulation server or the measurement module includes: Obtain the first identification information of the terminal; the first identification information includes at least one of the following: International Mobile Equipment Identity (IMEI), Mobile Equipment Identity (MEID), and Universal Unique Identifier (UUID); Match the first identification information with the second identification information; When the first identification information and the second identification information are successfully matched, the terminal is determined to be the measurement terminal.

10. The method according to claim 1, characterized in that, The method further includes: The simulation server is used to perform a second simulation process on the processing business data between the terminal and the server to obtain second simulation process data; The measurement module is used to measure the data of the second simulation process to obtain the second processing performance index.

11. The method according to claim 1, characterized in that, The method further includes: When the terminal calls the target user, the first processing performance metric is displayed.

12. The method according to claim 1, characterized in that, The service system includes at least one of the following: Long Term Evolution Voice Bearer System (VoLTE), New Radio Voice Bearer System (VoNR), and Enhanced Voice Network System.

13. A measurement system, characterized in that, The measurement system includes: A simulation server for implementing the method as described in any one of claims 1-12; A measuring device for implementing the method as described in claim 1 or 10.

14. A measuring device, characterized in that, The device includes: The simulation unit is used to perform a first simulation process on the terminal's pending business data using a simulation server to obtain first simulation process data; the simulation server is used to simulate the server in the business system and processes the terminal's pending business data in parallel with the server. The measurement unit is used to measure the data of the first simulation process using the measurement module to obtain the first processing performance index.

15. An electronic device, characterized in that, include: Memory, used to store computer-readable instructions; as well as A processor for executing the computer-readable instructions, causing the electronic device to perform the method as described in any one of claims 1-12.

16. A non-transitory computer-readable storage medium for storing computer-readable instructions, characterized in that, When the computer-readable instructions are executed by a processor, the processor performs the method as described in any one of claims 1-12.

17. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method as described in any one of claims 1-12.

Images