Terminal voice quality measurement system and method

Abstract

Embodiments of the present application provide a terminal voice quality evaluation system and method. The system comprises a test module, a base station simulator, a virtual terminal and a MOS device. A test script runs on the test module. The test script is used to instruct the base station simulator, the virtual terminal, the MOS device and a terminal to be tested to execute a terminal voice quality test procedure. The base station simulator is used to simulate a base station function when receiving a control instruction sent by the test script. The MOS device is used to transmit a voice file between the virtual terminal and the terminal to be tested. The virtual terminal is used to test the voice quality of the terminal to be tested through the base station simulator and the MOS device based on the control instruction sent by the test script, and generate a voice quality test result based on the voice file. Embodiments of the present application can conveniently complete terminal voice quality testing, reduce the requirements and cost of voice testing, and support rich voice service scenario testing.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a terminal voice quality evaluation system and method. Background Technology

[0002] With the development of mobile internet and the popularization of smart terminals, people have higher and higher requirements for voice quality. Therefore, in order to promote the optimization of voice network services and improve the voice quality of smart terminals, it is necessary to conduct quantitative evaluation of the voice performance behavior of smart terminals.

[0003] Currently, related technologies use Mean Opinion Score (MOS) devices to evaluate the voice quality of the terminal under test. Specifically, this involves connecting the MOS device to both the terminal under test and the smart terminal via audio cables. After both terminals are registered on the existing network, the terminal under test initiates a calling or receiving process and conducts a voice call through voice resource negotiation. The MOS device then plays the speech data to the terminal under test, while the smart terminal records the call content. Based on the speech data and the recorded call content, an algorithm analyzes the data to derive the voice quality evaluation result. This method requires the two terminals to make calls to each other, placing high demands on the performance of the smart terminal. Furthermore, constructing a test environment using the existing network increases workload, and modifying test environment parameters is cumbersome. Additionally, it requires an Internet Protocol Multimedia Subsystem (IMS) server for voice resource negotiation and relay, resulting in high testing costs and complex testing procedures.

[0004] In summary, the relevant technologies require two terminals to make calls to each other, which places high demands on the performance of smart terminals. Furthermore, the workload of constructing a test environment using the existing network is large, and the process of modifying test environment parameters is cumbersome. In addition, the IMS server is required for voice resource negotiation and relay, resulting in high testing costs and cumbersome testing procedures. These problems urgently need to be solved. Summary of the Invention

[0005] This application provides a terminal voice quality evaluation system and method to solve the problems in related technologies, such as the need for two terminals to make calls to each other, high performance requirements for smart terminals, large workload when constructing a test environment using the existing network, cumbersome process of modifying test environment parameters, high testing cost and complicated testing operation steps, the need for IMS server to negotiate and relay voice resources.

[0006] In a first aspect, embodiments of this application provide a terminal voice quality evaluation system, comprising: a testing module, a base station simulator, a virtual terminal, and an average subjective opinion score (MOS) device, wherein...

[0007] The test module is connected to the virtual terminal via a first network cable, to the base station simulator via a second network cable, and to the terminal under test via a serial port cable. The test script runs on the test module and is used to instruct the base station simulator, the virtual terminal, the MOS device, and the terminal under test to perform the terminal voice quality test process.

[0008] The base station simulator is connected to the terminal under test via an RF cable or over-the-air (OTA) technology. The base station simulator is also connected to the virtual terminal via a third network cable. The base station simulator is used to simulate base station functions when it receives control commands sent by the test script.

[0009] The MOS device is connected to the virtual terminal via a fourth network cable, and the MOS device is connected to the terminal under test via an audio cable. The MOS device is used to transmit voice files between the virtual terminal and the terminal under test.

[0010] The virtual terminal is used to test the voice quality of the terminal under test through the base station simulator and MOS device by sending control commands based on the test script, and to generate voice quality test results based on the voice file.

[0011] Optionally, the test script is specifically used for:

[0012] The base station simulator is instructed to establish a serving cell, and the terminal under test is instructed to power on.

[0013] The base station simulator is instructed to complete the cell registration process and the Internet Protocol Multimedia Subsystem (IMS) registration process with the terminal under test;

[0014] The virtual terminal is instructed to perform voice quality testing on the terminal under test using the base station simulator and the MOS device.

[0015] Obtain the voice quality test results generated by the virtual terminal.

[0016] Optionally, before instructing the virtual terminal to perform voice quality testing on the terminal under test through the base station simulator and the MOS device, the method further includes:

[0017] The terminal under test is instructed to initiate a calling process to the virtual terminal and to negotiate the SIP voice resource initiation protocol with the terminal under test to obtain the SIP voice resource negotiation result.

[0018] The SIP voice resource negotiation results are configured to the virtual terminal by modifying the configuration file.

[0019] Optionally, the virtual terminal is specifically used for:

[0020] Based on the SIP voice resource negotiation results, the voice quality of the terminal under test is tested using the base station simulator and the MOS device.

[0021] Optionally, the virtual terminal is specifically used for:

[0022] Play the first corpus, convert the first corpus into a first voice file based on the SIP voice resource negotiation result, and send the first voice file to the terminal under test through the base station simulator;

[0023] The device receives a second voice file sent by the MOS device. The second voice file is a voice file generated by the terminal under test after processing the received first voice file into a second corpus based on the SIP voice resource negotiation result, playing it, transmitting it to the MOS device, and then converting the second corpus by the MOS device.

[0024] The first audio file is compared with the second audio file to generate audio quality test results.

[0025] Optionally, the virtual terminal is specifically used for:

[0026] The system receives a third voice file sent by the terminal under test through the base station simulator. The third voice file is a third corpus played by the terminal under test and is a voice file obtained by processing the third corpus based on the SIP voice resource negotiation result.

[0027] The device receives a fourth voice file sent by the MOS device. The fourth voice file is a voice file generated by the MOS device after the third speech corpus played by the terminal under test is transmitted to the MOS device and converted by the MOS device.

[0028] The third audio file is compared with the fourth audio file to generate audio quality test results.

[0029] Optionally, the SIP voice resource negotiation result includes the voice encoding format, Internet Protocol (IP) address, and port number.

[0030] Optionally, the voice quality test results include the average subjective opinion score (MOS), test time, and voice delay.

[0031] Secondly, embodiments of this application also provide a terminal voice quality evaluation method, including:

[0032] The test module sends a first control command to the base station simulator through the test script to instruct the base station simulator to establish a serving cell, and sends a second control command to the terminal under test through the test script to instruct the terminal under test to power on.

[0033] The test module sends a third control command to the terminal under test through the test script, instructing the terminal under test to complete the cell registration process and the Internet Protocol Multimedia Subsystem (IMS) registration process with the base station simulator;

[0034] The test module sends a fourth control command to the virtual terminal through the test script, instructing the virtual terminal to perform voice quality testing on the terminal under test through the base station simulator and MOS device;

[0035] The testing module obtains the voice quality test results generated by the virtual terminal through the test script.

[0036] Optionally, before the test module sends a fourth control command to the virtual terminal via the test script to instruct the virtual terminal to perform voice quality testing on the terminal under test via the base station simulator and MOS device, it further includes:

[0037] The test module instructs the terminal under test to initiate a calling process to the virtual terminal through the test script, and performs SIP voice resource negotiation with the terminal under test to obtain the SIP voice resource negotiation result.

[0038] The test module uses the test script to configure the SIP voice resource negotiation result to the virtual terminal by modifying the configuration file.

[0039] The virtual terminal performs voice quality testing on the terminal under test using the base station simulator and MOS device, specifically including:

[0040] Based on the SIP voice resource negotiation results, the virtual terminal tests the voice quality of the terminal under test through the base station simulator and MOS device.

[0041] The terminal voice quality evaluation system and method provided in this application include a test module, a base station simulator, a virtual terminal, and a MOS device. The test module is used to instruct the base station simulator, the virtual terminal, the MOS device, and the terminal under test to execute a voice quality test process. The base station simulator is used to simulate base station functions upon receiving control instructions sent by the test script. The MOS device is used to transmit voice files between the virtual terminal and the terminal under test. The virtual terminal is used to test the voice quality of the terminal under test through the base station simulator and the MOS device based on the control instructions sent by the test script, and to generate voice quality test results based on the voice files. This system can conveniently complete terminal voice quality testing, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios. Attached Figure Description

[0042] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0043] Figure 1 This is a schematic diagram of the terminal voice quality evaluation system provided in the embodiments of this application;

[0044] Figure 2 This is one of the flowcharts illustrating the voice quality test of the terminal under test provided in this application embodiment;

[0045] Figure 3 This is the second schematic diagram of the process for performing voice quality testing on the terminal under test provided in the embodiments of this application;

[0046] Figure 4 This is a flowchart illustrating the terminal voice quality evaluation method provided in the embodiments of this application. Detailed Implementation

[0047] In the embodiments of this application, the term "and / or" describes the relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following associated objects have an "or" relationship.

[0048] In the embodiments of this application, the term "multiple" refers to two or more, and other quantifiers are similar.

[0049] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0050] This application provides a terminal voice quality evaluation system and method to solve the problems in related technologies, such as the need for two terminals to make calls to each other, high performance requirements for smart terminals, large workload when constructing a test environment using the existing network, cumbersome process of modifying test environment parameters, high testing cost due to the need for IMS server for voice resource negotiation and relay, and complicated test operation steps. It can save costs, is simple and convenient to operate, improves testing efficiency, is applicable to a wide range of voice service scenarios, and reduces the requirements for terminal voice quality testing.

[0051] The terminal devices involved in the embodiments of this application can be devices that provide voice and / or data connectivity to users, handheld devices with wireless connectivity, or other processing devices connected to a wireless modem. The names of the terminal devices may differ in different systems; for example, in a 5G system, a terminal device can be called User Equipment (UE). Wireless terminal devices can communicate with one or more core networks (CNs) via a Radio Access Network (RAN). Wireless terminal devices can be mobile terminal devices, such as mobile phones (or "cellular" phones) and computers with mobile terminal devices, for example, portable, pocket-sized, handheld, computer-embedded, or vehicle-mounted mobile devices that exchange voice and / or data with the RAN. Examples include Personal Communication Service (PCS) phones, cordless phones, Session Initiated Protocol (SIP) phones, Wireless Local Loop (WLL) stations, and Personal Digital Assistants (PDAs). Wireless terminal equipment can also be referred to as a system, subscriber unit, subscriber station, mobile station, mobile station, remote station, access point, remote terminal, access terminal, user terminal, user agent, or user device, but is not limited to these terms in the embodiments of this application.

[0052] Figure 1 This is a schematic diagram of the terminal voice quality evaluation system provided in the embodiments of this application, as shown below. Figure 1 As shown in the figure, this application provides a terminal voice quality evaluation system, which includes: a test module 100, a base station simulator 110, a virtual terminal 120, and an average subjective opinion score (MOS) device 130, wherein,

[0053] The test module 100 is connected to the virtual terminal via a first network cable, to the base station simulator 110 via a second network cable, and to the terminal under test via a serial port cable. The test script runs on the test module 100 and is used to instruct the base station simulator 110, the virtual terminal 120, the MOS device 130, and the terminal under test to perform the terminal voice quality test process.

[0054] It should be noted that, in order to address the issues of high testing costs and cumbersome testing procedures caused by the need for an IMS server for voice resource negotiation and relay in related technologies, this system uses test scripts running in the test module to replace the IMS server. This allows for flexible configuration of IMS parameters, reduces testing costs, simplifies testing procedures, and effectively improves testing efficiency.

[0055] In one implementation, if the test module is located on the first electronic device, then the test script runs on the first electronic device.

[0056] In one implementation, the base station simulator is software-based and runs on a second electronic device.

[0057] In one implementation, the virtual terminal is software-based and runs on a third electronic device.

[0058] Optionally, the first electronic device, the second electronic device, and the third electronic device may be different electronic devices.

[0059] In one implementation, the communication interface between the test module and the virtual terminal uses a remote login (telnet) method.

[0060] In one implementation, the communication interface between the test module and the terminal under test adopts a Universal Serial Bus (USB) interface.

[0061] It should be noted that, in order to be applicable to different voice service scenarios, the embodiments of this application provide a test list containing at least one voice quality test scenario in the test script. The test script selects a voice quality test scenario from the test list and starts execution. Each voice quality test scenario can be executed repeatedly.

[0062] The base station simulator 110 is connected to the terminal under test via an RF cable or over-the-air (OTA) technology. The base station simulator 110 is connected to the virtual terminal 120 via a third network cable. The base station simulator 110 is used to simulate base station functions when it receives control commands sent by the test script.

[0063] It should be noted that, in order to address the issues of the large workload and cumbersome process of modifying test environment parameters when constructing test environments using existing networks in related technologies, this system adopts a software-based base station simulator to simulate base station functions. Under the control of the test script's test process, the base station simulator can simulate most network scenarios and can automatically perform multi-scenario, multi-round voice quality testing.

[0064] It should be noted that because the test script can flexibly control the base station simulator, the test process can be extended to more complex test scenarios, such as receiving a call while the terminal under test is downloading a service, or handover during a call between the terminal under test and the virtual terminal.

[0065] In one embodiment, the base station simulator 110 is used to simulate base station functions upon receiving control commands sent by the test script, specifically including:

[0066] The base station simulator establishes a serving cell based on control commands sent by the test script.

[0067] The base station simulator uses control commands sent by the test script to complete the cell registration process and the IMS registration process with the terminal under test.

[0068] The MOS device 130 is connected to the virtual terminal 120 via a fourth network cable, and the MOS device 130 is connected to the terminal under test via an audio cable. The MOS device 130 is used to transmit voice files between the virtual terminal 120 and the terminal under test.

[0069] In one implementation, the MOS device communicates with the virtual terminal via a socket.

[0070] In one implementation, the MOS device is connected to the terminal under test via an earphone audio cable, compatible with both Type-C and 3.5mm audio interfaces.

[0071] In one embodiment, the MOS device is used to transmit voice files between the virtual terminal and the terminal under test, specifically including:

[0072] The MOS device is used to convert the second speech data played by the terminal under test into a second speech file and send the second speech file to the virtual terminal. The second speech data is the first speech data played by the virtual terminal. The virtual terminal converts the first speech data into a first speech file based on the SIP voice resource negotiation result and sends the first speech file to the terminal under test through the base station simulator. The terminal under test converts the received first speech file into speech data based on the SIP voice resource negotiation result.

[0073] Alternatively, the MOS device is used to convert the third corpus into a fourth speech file and send the fourth speech file to the virtual terminal, wherein the third corpus is the corpus played by the terminal under test and transmitted to the MOS device.

[0074] The virtual terminal 120 is used to test the voice quality of the terminal under test through the base station simulator 110 and MOS device 130 based on the control commands sent by the test script, and to generate voice quality test results based on the voice file.

[0075] It should be noted that, in order to solve the problem of high performance requirements for smart terminals in related technologies that require two terminals to make calls to each other, this system uses a software-based virtual terminal to replace the traditional smart terminal, which establishes voice communication with the terminal under test, effectively reducing the requirements and costs of terminal voice quality testing.

[0076] Optionally, the speech quality test results include the mean subjective opinion score (MOS), test time, and speech latency.

[0077] It should be noted that MOS is a widely accepted standard for quantifying speech quality. This application uses MOS to evaluate speech quality in its embodiments, and the speech quality evaluation criteria are shown in Table 1.

[0078] Table 1 Speech Quality Assessment Standards

[0079]

[0080] As shown in Table 1, MOS (Mean Orientation) is divided into four levels: Excellent, Good, Average, Poor, and Inferior. Each level of MOS corresponds to a specific score range and user satisfaction. Specifically, an Excellent MOS range of 4.0-5.0 indicates very good user satisfaction, with clear hearing, minimal latency, and smooth communication; a Good MOS range of 3.5-4.0 indicates slightly poor user satisfaction, with clear hearing, minimal latency, but communication is not smooth and there is some background noise; an Average MOS range of 3.0-3.5 indicates acceptable user satisfaction, with some hearing and latency, but communication is still possible; a Poor MOS range of 1.5-3.0 indicates barely acceptable user satisfaction, with some hearing and latency, and communication is repeated many times; and an Inferior MOS range of 0-1.5 indicates extremely poor user satisfaction, with incomprehensible audio, high latency, and poor communication.

[0081] The terminal voice quality evaluation system provided in this application includes a test module, a base station simulator, a virtual terminal, and a MOS device. The test module instructs the base station simulator, virtual terminal, MOS device, and terminal under test to execute a voice quality test process through a test script. The base station simulator is used to simulate base station functions upon receiving control commands sent by the test script. The MOS device is used to transmit voice files between the virtual terminal and the terminal under test. The virtual terminal is used to test the voice quality of the terminal under test through the base station simulator and MOS device based on the control commands sent by the test script, and generates voice quality test results based on the voice files. This system can conveniently complete terminal voice quality testing, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios.

[0082] Optionally, the test script is specifically used for:

[0083] The base station simulator 110 is instructed to establish a serving cell, and the terminal under test is instructed to power on.

[0084] The base station simulator 110 is instructed to complete the cell registration process and the Internet Protocol Multimedia Subsystem (IMS) registration process with the terminal under test.

[0085] The virtual terminal 120 is instructed to perform voice quality testing on the terminal under test through the base station simulator 110 and the MOS device 130.

[0086] Obtain the voice quality test results generated by the virtual terminal 120.

[0087] In one implementation, the test script selects and executes a voice test scenario from the test list. The test script instructs the base station simulator to establish a serving cell and sends an AT (Attention) command to the terminal under test via a serial port to instruct the terminal under test to power on and search for nearby serving cells.

[0088] Furthermore, when the terminal under test finds the serving cell established by the base station simulator, the test script instructs the base station simulator and the terminal under test to complete the cell registration process and the IMS registration process.

[0089] Understandably, after the terminal under test is powered on, it first completes the cell registration process, then initiates the IMS registration process and authentication. Next, it performs the SIP registration process. Once the SIP registration is complete, voice calls can be made.

[0090] Furthermore, the test script instructs the virtual terminal to perform voice quality tests on the terminal under test using a base station simulator and a MOS device, and obtain the voice quality test results. Further, the test script logs into the virtual terminal via telnet, retrieves and saves the voice quality test results generated by the virtual terminal, displays the results on the software interface, and uses AT commands via a serial port connection to instruct the terminal under test to deregister from cell registration and IMS registration, and saves the test log.

[0091] Optionally, if there are unexecuted test cases in the test list, the test script executes the next test case in the order of the test list. The test ends when all test cases in the test list have been executed.

[0092] The terminal voice quality evaluation system provided in this application embodiment uses a test script to instruct the base station simulator to establish a serving cell, instruct the terminal under test to power on, instruct the base station simulator and the terminal under test to complete the cell registration process and IMS registration process, and instruct the virtual terminal to perform voice quality testing on the terminal under test through the base station simulator and MOS device. This system can conveniently complete terminal voice quality testing, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios.

[0093] Optionally, before instructing the virtual terminal 120 to perform voice quality testing on the terminal under test through the base station simulator 110 and the MOS device 130, the method further includes:

[0094] The terminal under test is instructed to initiate a calling process to the virtual terminal 120 and to negotiate the SIP voice resource initiation protocol with the terminal under test to obtain the SIP voice resource negotiation result.

[0095] The SIP voice resource negotiation results are configured to the virtual terminal 120 by modifying the configuration file.

[0096] Optionally, the SIP voice resource negotiation result includes the voice encoding format, Internet Protocol IP address, and port number.

[0097] In one implementation, the test script sends AT commands to the terminal under test via a serial port to instruct the terminal under test to initiate a calling process to the virtual terminal and to negotiate SIP voice resources with the terminal under test. During the SIP voice resource negotiation process, the voice encoding format, IP address, and port number are determined as the SIP voice resource negotiation result.

[0098] The speech encoding format is the encoding format used to convert the corpus into a speech file; the IP address includes the IP addresses of the receiving end and the sending end; the port number includes the port number of the receiving end and the sending end.

[0099] Furthermore, the test script configures the SIP voice resource negotiation results to the virtual terminal by modifying the configuration file.

[0100] The terminal voice quality evaluation system provided in this application embodiment uses a test script to instruct the terminal under test to initiate a call process to a virtual terminal and negotiate SIP voice resources with the terminal under test to obtain the SIP voice resource negotiation result. The SIP voice resource negotiation result is then configured to the virtual terminal by modifying the configuration file, and the virtual terminal is instructed to perform voice quality testing on the terminal under test based on the SIP voice resource negotiation result through a base station simulator and a MOS device. This system can conveniently complete terminal voice quality testing, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios.

[0101] Optionally, the virtual terminal 120 is specifically used for:

[0102] Based on the SIP voice resource negotiation results, the voice quality of the terminal under test is tested using the base station simulator 110 and the MOS device 130.

[0103] In one implementation, after configuration, the test script logs into the virtual terminal via telnet and sends control commands to the virtual terminal.

[0104] Furthermore, upon receiving control commands from the test script, the virtual terminal tests the voice quality of the terminal under test based on the SIP voice resource negotiation results using a base station simulator and a MOS device.

[0105] The terminal voice quality evaluation system provided in this application uses a virtual terminal to test the voice quality of the terminal under test based on the SIP voice resource negotiation results, through a base station simulator and MOS equipment. This system can conveniently complete terminal voice quality testing, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios.

[0106] Optionally, Figure 2 This is one of the flowcharts illustrating the voice quality testing process for the terminal under test provided in this application embodiment, such as... Figure 2 As shown, the virtual terminal 120 is specifically used to perform the following steps:

[0107] Step 200: Play the first corpus, convert the first corpus into a first voice file based on the SIP voice resource negotiation result, and send the first voice file to the terminal under test through the base station simulator 110.

[0108] In one implementation, the test script logs into the virtual terminal via telnet and sends control commands to the virtual terminal.

[0109] Furthermore, upon receiving control commands from the test script, the virtual terminal plays the first corpus, then converts the first corpus into a first audio file based on the SIP voice resource negotiation result, and sends the first audio file to the terminal under test via the base station simulator. That is, the first corpus is converted into a first audio file based on the voice encoding format in the SIP voice resource negotiation result, and the first audio file is sent to the terminal under test according to the IP address and port number in the SIP voice resource negotiation result.

[0110] It should be noted that the first corpus is the corpus that is pre-stored locally on the virtual terminal.

[0111] Step 201: Receive the second voice file sent by the MOS device 130. The second voice file is a voice file generated by the terminal under test after processing the received first voice file into a second corpus based on the SIP voice resource negotiation result, playing it, transmitting it to the MOS device 130, and then converting the second corpus by the MOS device 130.

[0112] Understandably, after receiving the first voice file, the terminal under test converts the first voice file into a second voice file based on the SIP voice resource negotiation result and plays the second voice file. Since the MOS device and the terminal under test are connected via an audio cable, after the MOS device receives the second voice file, it will convert the second voice file into a second voice file and send it to the virtual terminal.

[0113] Step 202: Compare the first audio file with the second audio file to generate audio quality test results.

[0114] In other words, in addition to sending the first voice file, the virtual terminal also receives a second voice file sent by the MOS device. The virtual terminal compares the first voice file it sent with the second voice file it received to generate the voice quality test result of the terminal under test.

[0115] The voice quality test results include MOS, test time, and voice latency.

[0116] The terminal voice quality evaluation system provided in this application embodiment uses a virtual terminal to play a first corpus, convert the first corpus into a first voice file, send the first voice file to the terminal under test through a base station simulator, and receive a second voice file sent by a MOS device. The first voice file is compared with the second voice file to generate a voice quality test result. This system can conveniently complete terminal voice quality testing, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios.

[0117] Optionally, Figure 3This is the second schematic diagram of the process for performing voice quality testing on the terminal under test provided in the embodiments of this application, such as... Figure 3 As shown, the virtual terminal 120 is specifically used to perform the following steps:

[0118] Step 300: Receive a third voice file sent by the terminal under test through the base station simulator 110. The third voice file is a voice file obtained by the terminal under test playing a third corpus and processing the third corpus based on the SIP voice resource negotiation result.

[0119] Step 301: Receive the fourth voice file sent by the MOS device 130. The fourth voice file is the voice file generated by the MOS device 130 after the third speech data played by the terminal under test is transmitted to the MOS device 130 and converted by the MOS device 130.

[0120] Step 302: Compare the third audio file with the fourth audio file to generate audio quality test results.

[0121] Understandably, the test script sends control commands to the terminal under test via serial port to instruct the terminal under test to play the third corpus. On the one hand, the terminal under test converts the third corpus into a third voice file based on the SIP voice resource negotiation result and sends it to the virtual terminal through the base station simulator. On the other hand, since the terminal under test is connected to the MOS device via an audio cable, the third corpus will be transmitted to the MOS device. After receiving the third corpus, the MOS device converts the third corpus into a fourth voice file and sends the fourth voice file to the virtual terminal.

[0122] Then, the virtual terminal compares the third and fourth audio files to generate the audio quality test results of the terminal under test.

[0123] The voice quality test results include MOS, test time, and voice latency.

[0124] It should be noted that the third corpus is the corpus pre-stored locally on the terminal under test.

[0125] The terminal voice quality evaluation system provided in this application embodiment has a test script that instructs the terminal under test to play a third corpus. The virtual terminal generates a voice quality test result based on the third voice file sent by the terminal under test through the base station simulator and the fourth voice file sent by the MOS device. This system can conveniently complete terminal voice quality testing, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios.

[0126] Figure 4 This is a flowchart illustrating the terminal voice quality evaluation method provided in an embodiment of this application. Figure 4As shown in the figure, this application provides a terminal voice quality evaluation method, which includes the following steps:

[0127] Step 400: The test module sends a first control command to the base station simulator through the test script to instruct the base station simulator to establish a serving cell, and sends a second control command to the terminal under test through the test script to instruct the terminal under test to power on.

[0128] It should be noted that, in order to be applicable to different voice service scenarios, this embodiment of the invention provides a test list containing at least one voice quality test scenario. The test module selects a voice quality test scenario from the test list through a test script and starts execution.

[0129] It should be noted that, since the test module can flexibly control the base station simulator through the test script, the test process can be extended to more complex test scenarios, such as receiving a call while the terminal under test is downloading a service, or handover during a call between the terminal under test and the virtual terminal.

[0130] In one implementation, the test script runs on a test module, which is a first electronic device.

[0131] In one implementation, the base station simulator is software-based and runs on a second electronic device.

[0132] The second electronic device is completely different from the first electronic device.

[0133] Optionally, the first control command is used to instruct the base station simulator to establish a serving cell.

[0134] Optionally, the second control command is used to instruct the terminal under test to power on, for example, the AT (Attention) command.

[0135] In one implementation, the test module selects and executes a voice test scenario from the test list through a test script. The test module sends a first control command to the base station simulator through the test script. The first control command is used to instruct the base station simulator to establish a serving cell.

[0136] Furthermore, the test module sends a second control command to the terminal under test through a test script. The second control command is used to instruct the terminal under test to power on. The second control command can be an AT (Attention) command.

[0137] Step 401: The test module sends a third control command to the terminal under test through the test script to instruct the terminal under test to complete the cell registration process and the Internet Protocol Multimedia Subsystem (IMS) registration process with the base station simulator.

[0138] It should be noted that, in order to solve the problem of increased workload and cumbersome process of modifying test environment parameters when constructing test environments using existing networks in related technologies, this application embodiment adopts a base station simulator based on software implementation to simulate base station functions. Under the test process control of the test script, the base station simulator can simulate most network scenarios and can automatically realize multi-scenario and multi-round voice quality testing.

[0139] Optionally, the third control command is used to instruct the terminal under test to complete the cell registration process and the Internet Protocol Multimedia Subsystem (IMS) registration process with the base station simulator.

[0140] In one implementation, when the terminal under test finds the serving cell established by the base station simulator, the test module sends a third control command to the terminal under test through a test script. The third control command is used to instruct the base station simulator and the terminal under test to complete the cell registration process and the IMS registration process.

[0141] Understandably, after the terminal under test is powered on, it first completes the cell registration process, then initiates the IMS registration process and authentication. Next, it performs the SIP registration process. Once the SIP registration is complete, voice calls can be made.

[0142] Step 402: The test module sends a fourth control command to the virtual terminal through the test script to instruct the virtual terminal to perform voice quality testing on the terminal under test through the base station simulator and MOS device.

[0143] It should be noted that, in order to solve the problem that the related technologies require two terminals to make calls to each other, which places high demands on the performance of the smart terminals, this application embodiment uses a software-based virtual terminal to replace the traditional smart terminal, and establishes voice communication with the terminal under test, which effectively reduces the requirements and costs of terminal voice quality testing.

[0144] In one implementation, the virtual terminal is software-based and runs on a third electronic device, which is different from both the first and second electronic devices.

[0145] In one implementation, the terminal under test is a smart terminal.

[0146] Optionally, the fourth control command is used to instruct the virtual terminal to perform voice quality testing on the terminal under test through the base station simulator and MOS device.

[0147] In one embodiment, the test module sends a fourth control instruction to the virtual terminal through a test script. The fourth control instruction is used to instruct the virtual terminal to perform voice quality testing on the terminal under test through a base station simulator and a MOS device, and obtain the voice quality test results.

[0148] Step 403: The testing module obtains the voice quality test results generated by the virtual terminal through the test script.

[0149] In one implementation, the test module logs into the virtual terminal via telnet using a test script, obtains and saves the voice quality test results generated by the virtual terminal, displays the voice quality test results on the software interface, and sends AT commands to the terminal under test via a serial port connection cable. The AT commands are used to instruct the terminal under test to deregister from cell registration and IMS registration, and save the test log.

[0150] Optionally, if there are unexecuted test cases in the test list, the test module executes the next test case in the order of the test list using the test script. The test ends when all test cases in the test list have been executed.

[0151] The terminal voice quality evaluation method provided in this application instructs the base station simulator to establish a serving cell through a test script, instructs the terminal under test to power on, instructs the base station simulator and the terminal under test to complete the cell registration process and IMS registration process, and instructs the virtual terminal to perform voice quality testing on the terminal under test through the base station simulator and MOS device. This method can conveniently complete terminal voice quality testing, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios.

[0152] Optionally, before the test module sends a fourth control command to the virtual terminal via the test script to instruct the virtual terminal to perform voice quality testing on the terminal under test via the base station simulator and MOS device, it further includes:

[0153] The test module instructs the terminal under test to initiate a calling process to the virtual terminal through the test script, and performs SIP voice resource negotiation with the terminal under test to obtain the SIP voice resource negotiation result.

[0154] The test module uses the test script to configure the SIP voice resource negotiation result to the virtual terminal by modifying the configuration file.

[0155] The virtual terminal performs voice quality testing on the terminal under test using the base station simulator and MOS device, specifically including:

[0156] Based on the SIP voice resource negotiation results, the virtual terminal tests the voice quality of the terminal under test through the base station simulator and MOS device.

[0157] Optionally, the SIP voice resource negotiation result includes the voice encoding format, Internet Protocol IP address, and port number.

[0158] In one implementation, the test module sends AT commands to the terminal under test via a serial port through a test script. The AT commands are used to instruct the terminal under test to initiate a calling process to the virtual terminal and to negotiate SIP voice resources with the terminal under test. During the SIP voice resource negotiation process, the voice encoding format, IP address, and port number are determined as the SIP voice resource negotiation result.

[0159] The speech encoding format is the encoding format used to convert the corpus into a speech file; the IP address includes the IP addresses of the receiving end and the sending end; the port number includes the port number of the receiving end and the sending end.

[0160] Furthermore, the test module uses test scripts to configure the SIP voice resource negotiation results to the virtual terminal by modifying the configuration file.

[0161] Optionally, the virtual terminal, based on the SIP voice resource negotiation result, tests the voice quality of the terminal under test using the base station simulator and MOS device, specifically including:

[0162] The virtual terminal plays a first corpus, converts the first corpus into a first audio file based on the SIP voice resource negotiation result, and sends the first audio file to the terminal under test through the base station simulator; the virtual terminal receives a second audio file sent by the MOS device, the second audio file being a second corpus generated by the terminal under test after processing the received first audio file into a second corpus based on the SIP voice resource negotiation result, playing it, transmitting it to the MOS device, and having the MOS device convert the second corpus; the virtual terminal compares the first audio file with the second audio file to generate a voice quality test result.

[0163] Alternatively, the virtual terminal receives a third voice file sent by the terminal under test through the base station simulator. The third voice file is a voice file obtained by processing the third speech data played by the terminal under test based on the SIP voice resource negotiation result. The virtual terminal also receives a fourth voice file sent by the MOS device. The fourth voice file is a voice file generated by the MOS device after the third speech data played by the terminal under test has been transmitted to the MOS device and converted by the MOS device. The virtual terminal compares the third voice file with the fourth voice file to generate a voice quality test result.

[0164] In one implementation, after the test module configures the virtual terminal, it logs into the virtual terminal via telnet using a test script and instructs the virtual terminal to test the voice quality of the terminal under test using a base station simulator and a MOS device based on the SIP voice resource negotiation results.

[0165] The terminal voice quality evaluation method provided in this application instructs the terminal under test to initiate a calling process to a virtual terminal through a test script, and to negotiate SIP voice resources with the terminal under test to obtain the SIP voice resource negotiation result. The SIP voice resource negotiation result is configured to the virtual terminal by modifying the configuration file, and the virtual terminal is instructed to test the voice quality of the terminal under test through a base station simulator and MOS device based on the SIP voice resource negotiation result. This method can conveniently complete the terminal voice quality test, reduce the requirements and costs of voice testing, and support testing of a wide range of voice service scenarios.

[0166] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0167] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-executable instructions. These computer-executable instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0168] These processor-executable instructions may also be stored in a processor-readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the processor-readable memory produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0169] These processors can execute instructions that can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable device for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0170] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A terminal voice quality evaluation system, characterized by comprising: The application relates to a test module, a base station simulator, a virtual terminal and a mean opinion score (MOS) device, wherein, the test module is connected with the virtual terminal through a first network cable, connected with the base station simulator through a second network cable, and connected with a terminal to be tested through a serial port connection line; a test script runs on the test module, and the test script is used for instructing the base station simulator, the virtual terminal, the MOS device and the terminal to be tested to execute a terminal voice quality test process; and the test script is also used for configuring IMS parameters; the base station simulator is connected with the terminal to be tested through radio frequency lines or over-the-air technology (OTA), and the base station simulator is connected with the virtual terminal through a third network cable; the base station simulator is used for simulating base station functions under the condition that control instructions sent by the test script are received; the MOS device is connected with the virtual terminal through a fourth network cable, and connected with the terminal to be tested through an audio cable; the MOS device is used for transmitting voice files between the virtual terminal and the terminal to be tested; the virtual terminal is used for testing the voice quality of the terminal to be tested through the base station simulator and the MOS device based on control instructions sent by the test script, and generating a voice quality test result based on the voice files. The test script is specifically used for:

2. The terminal voice quality measurement system according to claim 1, wherein instructing the base station simulator to establish a service cell and instructing the terminal to be tested to start up; instructing the base station simulator to complete a cell registration process and an internet protocol multimedia subsystem (IMS) registration process with the terminal to be tested; instructing the virtual terminal to test the voice quality of the terminal to be tested through the base station simulator and the MOS device; obtaining a voice quality test result generated by the virtual terminal. Before the virtual terminal tests the voice quality of the terminal to be tested through the base station simulator and the MOS device, the test script is also used for:

3. The terminal voice quality measurement system according to claim 2, wherein instructing the terminal to be tested to initiate a calling process to the virtual terminal; the test script and the terminal to be tested perform session initiation protocol (SIP) voice resource negotiation to obtain an SIP voice resource negotiation result; configuring the SIP voice resource negotiation result to the virtual terminal by modifying a configuration file. The virtual terminal is specifically used for:

4. The terminal voice quality measurement system according to claim 3, wherein testing the voice quality of the terminal to be tested based on the SIP voice resource negotiation result through the base station simulator and the MOS device. The virtual terminal is specifically used for:

5. The terminal voice quality measurement system according to claim 4, wherein playing a first corpus, converting the first corpus into a first voice file based on the SIP voice resource negotiation result, and sending the first voice file to the terminal to be tested through the base station simulator; receiving a second voice file sent by the MOS device; the second voice file is a voice file generated by the MOS device after the terminal to be tested processes received first voice files into a second corpus based on the SIP voice resource negotiation result, plays the second corpus and transmits the second corpus to the MOS device; comparing the first voice file with the second voice file to generate a voice quality test result. The virtual terminal is specifically used for:

6. The terminal voice quality measurement system according to claim 4, wherein ​ receive a third voice file sent by the terminal under test through the base station simulator, the third voice file being a voice file obtained by processing a third corpus played by the terminal under test based on the SIP voice resource negotiation result; receive a fourth voice file sent by the MOS device, the fourth voice file being a voice file generated by the MOS device after the third corpus played by the terminal under test is transmitted to the MOS device and converted by the MOS device; compare the third voice file with the fourth voice file to generate a voice quality test result.

7. The end-to-end speech quality assessment system according to any of claims 3-6, characterized in that, The SIP voice resource negotiation result includes a voice coding format, an Internet Protocol (IP) address, and a port number.

8. The end-to-end speech quality assessment system according to any of claims 2-6, characterized in that, The voice quality test result includes a Mean Opinion Score (MOS), a test time, and a voice delay.

9. A terminal voice quality assessment method based on the terminal voice quality assessment system according to any one of claims 1-8, characterized by, The test module sends a first control instruction to the base station simulator through the test script to instruct the base station simulator to establish a service cell and sends a second control instruction to the terminal under test through the test script to instruct the terminal under test to start up. The test module sends a third control instruction to the terminal under test through the test script to instruct the terminal under test to complete a cell registration process and an Internet Protocol Multimedia Subsystem (IMS) registration process with the base station simulator. The test module sends a fourth control instruction to the virtual terminal through the test script to instruct the virtual terminal to perform a voice quality test on the terminal under test through the base station simulator and the MOS device. The test module obtains a voice quality test result generated by the virtual terminal through the test script. Before the test module sends the fourth control instruction to the virtual terminal through the test script to instruct the virtual terminal to perform the voice quality test on the terminal under test through the base station simulator and the MOS device, the test module further includes:

10. The terminal voice quality evaluation method of claim 9, wherein, The test module instructs the terminal under test to initiate a calling process to the virtual terminal through the test script and performs a Session Initiation Protocol (SIP) voice resource negotiation with the terminal under test through the test script to obtain a SIP voice resource negotiation result. The test module configures the SIP voice resource negotiation result to the virtual terminal by modifying a configuration file through the test script. The virtual terminal performs the voice quality test on the terminal under test through the base station simulator and the MOS device, specifically including: The virtual terminal performs the voice quality test on the terminal under test through the base station simulator and the MOS device based on the SIP voice resource negotiation result. ​

Images