A method and system for testing performance of a dispatch communication system based on BICC signaling

Abstract

The application provides a kind of scheduling communication system performance test method and system based on BICC signaling, the method comprises: building client and server in Linux system, deploying SQL server on Windows system, and configuring WAV file, WAV file transcoding tool in SQL server, creating configuration information table of performance test and carrying out data configuration;Read each configuration information, find corresponding WAV file according to WAV file path in the configuration information, the WAV file and the information other than WAV file path in the configuration information constitute test data;The test data and the WAV file transcoding tool are issued to client and server;Server and client generate test cases according to the test data issued respectively;Client initiates call as calling, server responds call as called, and carries out performance test according to test case.

Description

Technical Field

[0001] This invention relates to a method for testing the performance of a scheduling system, specifically, to a method and system for testing the performance of a scheduling communication system based on BICC signaling. Background Technology

[0002] With the popularization and development of communication products, the performance of dispatch communication systems is receiving increasing attention and importance from users. During the testing process of dispatch communication systems, in order to meet the product performance requirements, testers need to conduct comprehensive testing of the overall performance of the dispatch communication system before it can be accepted and released.

[0003] The ITU-T has proposed a protocol derived from ISUP, namely Bearer Independent Call Control (BICC). The main idea of ​​the BICC protocol is to separate call control from bearer control, allowing call control signaling to be carried on various networks (such as SS7 networks, ATM networks, and IP networks). Existing BICC call testers on the market include devices from Agilent, but they all require high costs to support NGN-BICC signaling. This prevents personnel who need to understand BICC call control and bearer from conducting relevant practical explorations.

[0004] This is because during performance testing, such as Figure 1 As shown, existing NGN equipment requires HSS, MGW, MSC and other equipment for environment setup and connection before relevant tests can be conducted, which increases time, resources and personnel costs. Furthermore, testers need to be familiar with the voice files or voice streams used by multiple encodings in order to determine whether the voice encoding is correct, which also increases personnel costs.

[0005] In order to solve the above problems, people have been seeking an ideal technological solution. Summary of the Invention

[0006] The purpose of this invention is to address the shortcomings of existing technologies by providing a method and system for testing the performance of a scheduling communication system based on BICC signaling.

[0007] To achieve the above objectives, the technical solution adopted by this invention is: a performance testing method for a scheduling communication system based on BICC signaling, comprising the following steps:

[0008] The client and server are set up on the Linux system, and the SQL server is deployed on the Windows system. WAV files and WAV file transcoding tools are configured in the SQL server. A configuration information table for performance testing is created and the data is configured. Each configuration information includes the calling and called numbers, voice encoding, PT value, WAV file path, packet delay timer for voice injection, whether the injected voice needs to be transcoded, as well as the IP and port number configuration of the signaling plane and media plane of the client and server, the protocol used by the signaling plane of the client and server, and the call initiation termination method.

[0009] Read each piece of configuration information, find the corresponding WAV file according to the WAV file path in the configuration information, and the WAV file and the information other than the WAV file path in the configuration information constitute the test data;

[0010] The connection status between the client and the server is detected. If the connection is established, the test data and the WAV file transcoding tool are sent to the client and the server.

[0011] The server generates and stores corresponding call response test cases or registration response test cases in memory based on the test data sent to it; the client generates and stores corresponding call request test cases or registration request test cases in memory based on the test data sent to it.

[0012] The server sends a message to the client indicating that the client is running normally and is ready to initiate a call. The client initiates the call as the caller, and the server responds as the called party. Performance testing is performed based on the call request test case, the call response test case, the registration request test case, and the registration response test case.

[0013] Based on the above, during the call setup process, the client and server directly use the voice encoding in the test data as the voice encoding generated by the signaling negotiation during the signaling negotiation phase.

[0014] Based on the above, during the call setup process, after the client and server generate the calling and called media plane IPs through negotiation during the signaling negotiation phase, they compare the generated calling and called media plane IPs with the media plane IPs of the client and server in the test data. If they are inconsistent, the calling and called media plane IPs generated in the signaling negotiation are encapsulated into the IP layer through IP raw socket encapsulation to form an IP voice stream for transmission; otherwise, the IP voice stream is directly formed using the negotiated calling and called media plane IPs.

[0015] This invention also provides a performance testing system for a scheduling communication system based on BICC signaling, comprising the following units:

[0016] The environment setup unit is used to set up the client and server on the Linux system, deploy the SQL server on the Windows system, configure WAV files and WAV file transcoding tools in the SQL server, create configuration information tables for performance testing and configure data. Each configuration information includes the calling and called numbers, voice encoding, PT value, WAV file path, packet delay timer for voice injection, whether the injected voice needs to be transcoded, as well as the IP and port number configurations of the signaling plane and media plane of the client and server, the protocols used by the signaling plane of the client and server, and the call initiation termination method.

[0017] The test data generation unit is used to read each piece of configuration information, find the corresponding WAV file according to the WAV file path in the configuration information, and the WAV file and the information other than the WAV file path in the configuration information constitute the test data; and to detect the connection status of the client and the server. If the connection is established, the test data and the WAV file transcoding tool are sent to the client and the server.

[0018] The server is connected to the test data generation unit and is used to generate corresponding call response test cases or registration response test cases in memory based on the sent test data, and store them; send a message to the client that the client is running normally and waiting for a call to be initiated; and, as the called party responding to the client's call, execute the call response test cases and the registration response test cases to interact with the client for performance testing.

[0019] The client is connected to the test data generation unit and is used to generate and store corresponding call request test cases or registration request test cases in memory based on the sent test data; and when it receives a message that the client is running normally and is waiting to initiate a call, it initiates a call to the server as the caller, executes the call request test cases and the registration request test cases, and interacts with the server to perform performance testing.

[0020] Based on the above, during the call setup process, after the client and the server generate the calling and called media plane IPs through negotiation during the signaling negotiation phase, they compare the generated calling and called media plane IPs with the media plane IPs of the client and the server in the test data. If they are inconsistent, the calling and called media plane IPs generated in the signaling negotiation are encapsulated into the IP layer through raw socket encapsulation of IP, forming an IP voice stream for transmission; otherwise, the IP voice stream is directly formed using the negotiated calling and called media plane IPs.

[0021] This invention has outstanding substantive features and significant progress compared to the prior art. Specifically, this invention designs a performance testing method that uses WAV files to inject speech with full BICC messages. It can perform performance testing according to the standard BICC protocol without requiring relevant testers to understand the key components of the BICC protocol or to have high technical reserves.

[0022] Even if the WAV file does not correspond to the speech codec and PT, the file can be converted to other encoding files by the WAV file transcoding tool to correspond to the speech codec and PT, and then the speech back-injection can be performed. This makes it unnecessary for relevant testers to understand the protocol followed by each encoding during the configuration phase.

[0023] It does not require terminal equipment or high-performance servers; deployment can be completed with just three general-purpose servers to build and test the BICC signaling and media plane environment, greatly reducing time, resource, and labor costs.

[0024] The protocol stack, call control protocol, and circuit management protocol of this system are all open source, which allows for basic secondary development and research in terms of cost and resources.

[0025] During the call setup process, after the client and server generate the calling and called media plane IPs through signaling negotiation during the signaling negotiation phase, they compare the generated calling and called media plane IPs with the media plane IPs of the client and server in the test data. If they are inconsistent, the called and called media plane IPs generated in the signaling negotiation are encapsulated into the IP layer through raw socket encapsulation of IP, forming an IP voice stream for transmission; otherwise, the IP voice stream is formed directly using the negotiated calling and called media plane IPs. This allows the media plane IP to be consistent with the signaling plane IP when the server resource is a single network card, realizing single network card media stream interaction and simplifying the configuration to complete protocol testing; when the server resource is a multi-network card, multi-network card media stream interaction can be realized. Attached Figure Description

[0026] Figure 1 This is a schematic diagram of the existing BICC testing process.

[0027] Figure 2 This is a flowchart of Embodiment 1 of the present invention. Detailed Implementation

[0028] like Figure 2 As shown, this embodiment provides a performance testing method for a scheduling communication system based on BICC signaling, including the following steps:

[0029] Set up the client and server on a Linux system, and deploy the SQL server on a Windows system, preferably Windows Server 2012. Configure WAV files and WAV file transcoding tools in the SQL server, create a configuration information table for performance testing and configure the data. Each configuration information includes the calling and called numbers, voice encoding, PT value, WAV file path, packet delay timer for voice injection, whether the injected voice needs to be transcoded, whether the client and server need to register, IP and port number configuration for the signaling plane and media plane of the client and server, the protocol used for the signaling plane of the client and server, and the call initiation termination method.

[0030] Read each piece of configuration information, find the corresponding WAV file according to the WAV file path in the configuration information, and the WAV file and the information other than the WAV file path in the configuration information constitute the test data;

[0031] The connection status between the client and the server is detected. If the connection is established, the test data and the WAV file transcoding tool are sent to the client and the server.

[0032] The server generates and stores corresponding call response test cases or registration response test cases in memory based on the test data sent to it; the client generates and stores corresponding call request test cases or registration request test cases in memory based on the test data sent to it.

[0033] The server sends a message to the client indicating that the client is running normally and is ready to initiate a call. The client initiates the call as the caller, and the server responds as the called party. Performance testing is performed based on the call request test case, the call response test case, the registration request test case, and the registration response test case.

[0034] In specific implementation, the signaling plane of the client and server uses TCP or UDP; the termination method of the call can be set as: release after the voice injection ends or release after a certain number of seconds of injection.

[0035] Understandably, after the configuration information is set, the system waits for the client and server of the scheduling communication system to connect to the SQL server and send the configuration information based on the identity information. Specifically, it determines whether the connection is from a client based on the identity information. If it is a client connection, the corresponding configuration information is sent to the client; otherwise, it is a server connection, and the corresponding configuration information is sent to the server.

[0036] In specific implementation, the client and the server connect to the SQL server configuration program via UDP / TCP SOCKET; the WAV file and the WAV file transcoding tool in the test data are transferred to the corresponding paths on the client and the server via FTP; and the data in the test data other than the WAV file is sent to the client and the server via HTTP.

[0037] As can be seen, this embodiment does not require terminal equipment or high-performance servers. It only requires three general-purpose servers to complete the deployment, build and test the BICC signaling and media plane environment, and greatly reduce time, resource and labor costs.

[0038] In practice, during data configuration, the configured PT value is validated based on the voice encoding. If the PT value does not match the PT value corresponding to the voice encoding, the configured PT value is automatically modified to the PT value corresponding to the voice encoding. For example, the PT encoding value corresponding to PCMA is 8; the PT encoding value corresponding to G723 is 4; the PT encoding value corresponding to G729 is 18; and the PT encoding value corresponding to AMR / AMRWB is in the range of 96 to 127. If the entered PT encoding value does not match the PT encoding value corresponding to the voice encoding, it will be automatically checked and rewritten to the correct PT encoding value.

[0039] It is understood that when the server of the scheduling communication system receives the configuration information, it extracts the corresponding information from the configuration information according to the BICC protocol to fill in the call response message or registration response message, so as to generate call response test cases or registration response test cases, and stores them using hash storage method; since no manual input is required from the user, the user does not need to master the BICC protocol.

[0040] Similarly, when the client of the scheduling communication system receives the configuration information, it extracts the corresponding information from the configuration information according to the BICC protocol to fill in the call request and registration request, generates call request test cases or registration request test cases, and stores them using hash storage.

[0041] Furthermore, after receiving the configuration information, the server of the scheduling communication system determines whether registration is required based on the configuration message. If registration is not required, it sends a message indicating normal operation and pending call to the client of the scheduling communication system, waits for the call message initiated by the client of the scheduling communication system to execute the call response test case, and ends the call response test case after the voice echo is completed. If registration is required, it waits for the registration information initiated by the client of the scheduling communication system to execute the registration response test case, and further waits for the call message initiated by the client of the scheduling communication system to execute the call response test case, and ends the call response test case after the voice echo is completed.

[0042] Similarly, after receiving the configuration information, the client of the scheduling communication system determines whether registration is required based on the configuration message. If registration is not required, it waits for the server to send a message indicating that the system is running normally and is ready to initiate a call, and then executes the call request test case to initiate the call information. If registration is required, it first executes the registration request test case to initiate the registration process to the server, and after registration is completed, it executes the call request test case to initiate the call information to the server.

[0043] It should be noted that the configuration information also includes registration completion conditions. The client of the dispatch communication system verifies whether the registration response of the calling and called numbers is consistent with the registration completion conditions in the configuration information. If they are consistent, the registration is determined to be complete.

[0044] When voice callback is required during a call, the client and server determine whether the conditions for direct callback are met based on the WAV file, voice encoding, and PT value. If the conditions are met, voice callback is performed directly based on the WAV file; otherwise, the WAV file is converted to a file corresponding to another encoding using the WAV file transcoding tool, and then voice callback is performed based on the converted file. For example, if the voice encoding is G711, voice callback can be performed directly; if the voice encoding is another encoding, it is converted to a file corresponding to that other encoding using the WAV file transcoding tool.

[0045] It can be seen that even if the WAV file does not correspond to the speech codec and PT, the file can be converted to other encoding files by the WAV file transcoding tool to correspond to the speech codec and PT, and then the speech back-annotation can be performed. This makes it unnecessary for relevant testers to understand the protocol followed by each encoding during the configuration phase.

[0046] Furthermore, in specific implementation, the client and server use the open-source SCTP+OPENSGW protocol stack, the open-source call control protocol IAM-APM-ACM-ANM-REL-RLC, and the open-source circuit management protocol GRS-GRA.

[0047] The open-source license allows for basic secondary development and research in terms of cost and resources.

[0048] Example 2

[0049] The difference between this embodiment and Embodiment 1 is that:

[0050] During call setup, the client and server directly use the voice code in the test data as the voice code generated during the signaling negotiation phase. For example, if the voice code in the test data is G723, then G723 will be used as the voice code for the IAM-APM signaling negotiation for subsequent processing.

[0051] During the call setup process, after the client and server generate the calling and called media plane IPs through negotiation during the signaling negotiation phase, they compare the generated calling and called media plane IPs with the media plane IPs of the client and server in the test data. If they are inconsistent, the calling and called media plane IPs generated in the signaling negotiation are encapsulated into the IP layer through IP raw socket encapsulation to form an IP voice stream for transmission; otherwise, the IP voice stream is formed directly using the negotiated calling and called media plane IPs.

[0052] The above solution enables the media plane IP to be consistent with the signaling plane IP when the server resource is a single network card, realizing single network card media stream interaction and simplifying the configuration to complete protocol testing; when the server resource is multiple network cards, it can realize multi-network card media stream interaction.

[0053] Example 3

[0054] This embodiment also provides a performance testing system for a scheduling communication system based on BICC signaling, including the following units:

[0055] The environment setup unit is used to set up the client and server on the Linux system, deploy the SQL server on the Windows system, configure WAV files and WAV file transcoding tools in the SQL server, create configuration information tables for performance testing and configure data. Each configuration information includes the calling and called numbers, voice encoding, PT value, WAV file path, packet delay timer for voice injection, whether the injected voice needs to be transcoded, as well as the IP and port number configurations of the signaling plane and media plane of the client and server, the protocols used by the signaling plane of the client and server, and the call initiation termination method.

[0056] The test data generation unit is used to read each piece of configuration information, find the corresponding WAV file according to the WAV file path in the configuration information, and the WAV file and the information other than the WAV file path in the configuration information constitute the test data; and to detect the connection status of the client and the server. If the connection is established, the test data and the WAV file transcoding tool are sent to the client and the server.

[0057] The server is connected to the test data generation unit and is used to generate corresponding call response test cases or registration response test cases in memory based on the sent test data, and store them; send a message to the client that the client is running normally and waiting for a call to be initiated; and, as the called party responding to the client's call, execute the call response test cases and the registration response test cases to interact with the client for performance testing.

[0058] The client is connected to the test data generation unit and is used to generate and store corresponding call request test cases or registration request test cases in memory based on the sent test data; and when it receives a message that the client is running normally and is waiting to initiate a call, it initiates a call to the server as the caller, executes the call request test cases and the registration request test cases, and interacts with the server to perform performance testing.

[0059] Based on the above, during the call setup process, after the client and the server generate the calling and called media plane IPs through negotiation during the signaling negotiation phase, they compare the generated calling and called media plane IPs with the media plane IPs of the client and the server in the test data. If they are inconsistent, the calling and called media plane IPs generated in the signaling negotiation are encapsulated into the IP layer through raw socket encapsulation of IP, forming an IP voice stream for transmission; otherwise, the IP voice stream is directly formed using the negotiated calling and called media plane IPs.

[0060] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this invention. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0061] In the several embodiments provided by this invention, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For example, the division of each unit is merely a logical functional division, and there may be other division methods in actual implementation. For example, one or more units or components may be combined or integrated into another computer device, or some features may be ignored or not executed.

[0062] The steps in the method of this invention can be adjusted, combined, or deleted according to actual needs. Similarly, the units in the device of this invention can be combined, divided, or deleted according to actual needs.

[0063] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0064] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a terminal, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention.

[0065] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and such modifications or substitutions should all be covered within the scope of protection of the present invention.

Claims

1. A performance testing method for a scheduling communication system based on BICC signaling, characterized in that, Includes the following steps: The client and server are set up on the Linux system, and the SQL server is deployed on the Windows system. WAV files and WAV file transcoding tools are configured in the SQL server. A configuration information table for performance testing is created and the data is configured. Each configuration information includes the calling and called numbers, voice encoding, PT value, WAV file path, packet delay timer for voice injection, whether the injected voice needs to be transcoded, as well as the IP and port number configuration of the signaling plane and media plane of the client and server, the protocol used by the signaling plane of the client and server, and the call initiation termination method. Read each piece of configuration information, find the corresponding WAV file according to the WAV file path in the configuration information, and the WAV file and the information other than the WAV file path in the configuration information constitute the test data; The connection status between the client and the server is detected. If the connection is established, the test data and the WAV file transcoding tool are sent to the client and the server. Based on the distributed test data, the server generates corresponding call response test cases or registers response test cases in memory and stores them. Based on the sent test data, the client generates and stores the corresponding call request test cases or registration request test cases in memory. The server sends a message to the client that the client is running normally and is waiting to initiate a call. The client initiates a call as the caller, and the server responds to the call as the called party. Performance testing is performed based on the call request test case, the call response test case, the registration request test case, and the registration response test case. During the call setup process, after the client and server generate the calling and called media plane IPs through negotiation during the signaling negotiation phase, they compare the generated calling and called media plane IPs with the media plane IPs of the client and server in the test data. If they are inconsistent, the calling and called media plane IPs generated in the signaling negotiation are encapsulated into the IP layer through IP raw socket encapsulation to form an IP voice stream for transmission; otherwise, the IP voice stream is formed directly using the negotiated calling and called media plane IPs.

2. The performance testing method for a scheduling communication system according to claim 1, characterized in that: In voice back-annotation, the client and server determine whether the conditions for direct back-annotation are met based on the WAV file, voice encoding, and PT value. If the conditions for direct back-annotation are met, voice back-annotation is performed directly based on the WAV file. Otherwise, the WAV file is converted to a file with other encodings using the WAV file transcoding tool, and then voice back-annotation is performed based on the converted file.

3. The performance testing method for a scheduling communication system according to claim 1, characterized in that: When configuring data, the configured PT value is verified based on the voice code. If the PT value is inconsistent with the PT value corresponding to the voice code, the configured PT value is automatically modified to the PT value corresponding to the voice code.

4. The performance testing method for a scheduling communication system according to claim 1, characterized in that: During the call setup process, the client and server use the voice code in the test data directly as the voice code generated during the signaling negotiation phase.

5. The performance testing method for a scheduling communication system according to claim 1, characterized in that: The WAV file and the WAV file transcoding tool in the test data are transferred to the corresponding paths on the client and server via FTP. The data in the test data other than the WAV file are sent to the client and server via HTTP.

6. The performance testing method for a scheduling communication system according to claim 1, characterized in that: The client uses hash storage to store the generated call request test cases and registration request test cases; the server uses hash storage to store the generated call response test cases and registration response test cases.

7. The performance testing method for a scheduling communication system according to claim 1, characterized in that: The client and server use the open-source SCTP+OPENSGW protocol stack, the open-source call control protocol IAM-APM-ACM-ANM-REL-RLC, and the open-source circuit management protocol GRS-GRA.

8. A performance testing system for a scheduling communication system based on BICC signaling, characterized in that, Includes the following units: The environment setup unit is used to set up the client and server on the Linux system, deploy the SQL server on the Windows system, configure WAV files and WAV file transcoding tools in the SQL server, create configuration information tables for performance testing and configure data. Each configuration information includes the calling and called numbers, voice encoding, PT value, WAV file path, packet delay timer for voice injection, whether the injected voice needs to be transcoded, as well as the IP and port number configurations of the signaling plane and media plane of the client and server, the protocols used by the signaling plane of the client and server, and the call initiation termination method. The test data generation unit is used to read each piece of configuration information, find the corresponding WAV file according to the WAV file path in the configuration information, and the WAV file and the information other than the WAV file path in the configuration information constitute the test data; and to detect the connection status of the client and the server. If the connection is established, the test data and the WAV file transcoding tool are sent to the client and the server. The server is connected to the test data generation unit and is used to generate corresponding call response test cases or register response test cases in memory based on the sent test data, and store them. Send a message to the client indicating that the client is running normally and awaiting a call. And, as a called party responding to the client's call, execute the call response test case and the registration response test case to interact with the client for performance testing; The client is connected to the test data generation unit and is used to generate and store corresponding call request test cases or registration request test cases in memory based on the sent test data. Upon receiving a message that the client is running normally and is ready to initiate a call, the client initiates a call to the server as the caller, executes the call request test case and the registration request test case, and interacts with the server to perform performance testing.

9. The performance testing system for a scheduling communication system based on BICC signaling according to claim 8, characterized in that, During the call setup process, after the client and the server generate the calling and called media plane IPs through negotiation during the signaling negotiation phase, they compare the generated calling and called media plane IPs with the media plane IPs of the client and the server in the test data. If they are inconsistent, the calling and called media plane IPs generated in the signaling negotiation are encapsulated into the IP layer through raw socket encapsulation of IP to form an IP voice stream for transmission; otherwise, the IP voice stream is formed directly using the negotiated calling and called media plane IPs.

Images