Short message service test method and system, electronic equipment and storage medium

Abstract

The invention provides a short message service testing method and system, electronic equipment and a storage medium, and aims to solve the problem that short message testing is not comprehensive and lacks summarization, the method comprises the following steps: selecting four types of simulation equipment of a short message service topological structure according to testing requirements and testing objects, and completing configuration and parameter adjustment of the corresponding simulation equipment; performing network planning, establishing a network architecture of a simulation environment, dividing VLANs (Virtual Local Area Network), and performing IP (Internet Protocol) address planning; determining the proportion of the generated short message service according to the proportions of different types and different scenes of the test requirements and the proportions of various number segments; making a short message service request according to the proportion so as to generate corresponding user data for the short message service; sending a short message service request through the short message service topology network to complete various preset service tests; and evaluating the service test result. According to the invention, the test environment better fits the current production environment; the test function is comprehensive, and the test result can be evaluated.

Description

Technical Field

[0001] The present disclosure relates to the field of communication technology, and in particular to a method for testing a text message service, a system for testing a text message service, an electronic device, and a computer-readable storage medium. Background Art

[0002] Enterprise SMS services are an important channel for many companies to communicate with customers, conduct marketing, and provide services. With the acceleration of digital transformation, it is becoming increasingly important to ensure the quality, reliability, and compliance of enterprise SMS services. Effective testing methods can help companies improve the quality of SMS services, enhance customer experience, and reduce operational risks. However, the existing use of existing networks to test SMS functions also has many shortcomings, such as: lack of logic verification: the existing technical test solution only has two types of simulation functions, SMS simulation and gateway simulation, which cannot cover the SMS business logic and cannot effectively verify the normal operation of the entire SMS business flow; the configurations of various SMS business components such as IP, VLAN (Virtual Local Area Network) division, SMS communication protocol configuration and other logical configurations cannot be verified; the test function is not comprehensive: the existing technical solution is limited to the function simulation and testing capabilities of SMS services for simple SMS sending and receiving, and cannot test the detailed functions in the SMS services; lack of summary ability: the existing technical solution lacks the ability to summarize and generalize the values ​​of the test results, and cannot find the specific problems exposed by the test in detail according to the test results, but can only draw conclusions on whether it is feasible, which is of limited help to subsequent maintenance operations. Summary of the invention

[0003] In order to at least solve the problems of the existing technology that the SMS test lacks logical verification, the test function is not comprehensive, and the summarization ability is lacking. The present invention provides a test method for SMS service, a test system for SMS service, an electronic device, and a computer-readable storage medium, which simulates a complete SMS service chain, so that the test environment is more in line with the current production environment; the test function is comprehensive, and the test results can be evaluated, which is convenient for subsequent business optimization and risk prevention and control.

[0004] In a first aspect, the present disclosure provides a method for testing a short message service, the method comprising:

[0005] Select four types of simulation devices of the SMS service topology structure according to the test requirements and test objects to form a complete SMS service topology network, and complete the configuration and parameter adjustment of the corresponding simulation devices. The four types of simulation devices include SMS application layer devices, SMS gateway layer devices, SMS service layer devices, and user terminal layer devices;

[0006] After completing the configuration of the simulation equipment, carry out network planning, build the network architecture of the simulation environment, divide VLANs, plan IP addresses, and ensure the connectivity and isolation between each simulation equipment layer;

[0007] Determine the proportion of automatically randomly generated SMS services based on the proportion of different types and scenarios and the proportion of various number segments required by the test;

[0008] Making a short message service request according to the determined proportion of the short message service to generate corresponding user data for the short message service;

[0009] Send SMS service requests through the SMS service topology network to complete various preset service tests;

[0010] Evaluate business test results.

[0011] Furthermore,

[0012] The SMS application layer device is used to simulate the client API interface (Application Programming Interface) and the SMS communication protocol through Python framework tools, simulate the deployment of the SMS service interface, connect to the downstream SMS gateway, and simulate different SMS sending scenarios. By opening the relevant API ports and the access rights of the SMS protocol, the SMS service platform of the test customer can be seamlessly connected to the test environment;

[0013] The SMS gateway layer device is used to receive SMS requests from the SMS application service layer and route them to the corresponding SMS center, including protocol simulation, routing simulation, channel simulation, and operator service simulation;

[0014] The SMS service layer device is used to simulate the function of the network center, and implement various SMS management functions by extending the basic functions on the open source SMSC (Short Message Service Center) architecture OpenSMPP (Open short message peer to peer);

[0015] The user terminal layer equipment is used to simulate a large number of mobile user terminals and configure terminals of different types and conditions according to the situation.

[0016] Further, making a short message service request according to the determined proportion of the short message service to generate corresponding user data for the short message service includes:

[0017] According to the determined proportion of SMS services, a corresponding request carrier is generated through a preset message definition module and the carrier is sent to each simulator;

[0018] After receiving the carrier, the simulator uses the set SMS template combined with the protocol identifier of the source address and destination address pairing and randomly selects the data encoding scheme to complete the SMS structure construction, and generates random user data through the simulator type and language module.

[0019] Furthermore, the method further comprises:

[0020] In the generated request carrier, a certain proportion of erroneous requests, out-of-province requests and nuisance SMS requests are simulated according to the test requirements.

[0021] Furthermore, the preset service test includes at least one of the following tests:

[0022] The success rate test of SMS reception and transmission includes: using log statistics to check whether the SMS server or gateway can correctly receive and send SMS messages of various formats and contents, and to calculate the success rate of receiving and sending test SMS messages of a certain level;

[0023] The SMS concurrent processing capability test includes: testing the SMS processing capability and performance of the SMS server or gateway under high concurrency conditions by setting simulated traffic volumes of different magnitudes;

[0024] The test of the recognition and filtering capabilities of abnormal SMS messages includes: testing whether the SMS server or gateway can correctly recognize and filter various abnormal or illegal SMS messages by reading the SMS return log and gateway release log;

[0025] SMS sending speed and delay test, including: testing the end-to-end transmission speed and delay from SMS receiving to sending;

[0026] Accuracy testing of SMS billing and statistics, including: verifying gateway bills and SMS sending records to test whether the billing and statistical data generated by the SMS server or gateway are accurate;

[0027] Fault simulation and recovery testing includes: simulating various faults to test whether the system can detect and take appropriate fault tolerance, retransmission, and degradation measures in a timely manner.

[0028] Furthermore, the business test results are evaluated:

[0029] Collect information of each device in various service test environments, and evaluate various evaluation indicators of SMS services based on the collected information;

[0030] The evaluation indicators include: the success rate of SMS reception and transmission, SMS concurrent processing capability, abnormal SMS identification and filtering capability, SMS transmission speed and delay, SMS billing and statistics accuracy, fault simulation and recovery capability.

[0031] In a second aspect, the present disclosure provides a testing system for a short message service, the system comprising:

[0032] A topology network construction module is configured to select four types of simulation devices of the SMS service topology structure according to the test requirements and the test object to form a complete SMS service topology network, and complete the configuration and parameter adjustment of the corresponding simulation devices. The four types of simulation devices include SMS application layer devices, SMS gateway layer devices, SMS service layer devices, and user terminal layer devices;

[0033] A network planning module, which is configured to perform network planning after the topology network construction module completes the configuration of the simulated device, build a network architecture of the simulated environment, divide VLANs, perform IP address planning, and ensure connectivity and isolation between each simulated device layer;

[0034] A determination module is configured to determine the proportion of automatically randomly generated SMS services according to the proportion of different types and scenarios and the proportion of various number segments required by the test;

[0035] A generating module, which is configured to make a short message service request according to the determined proportion of the short message service, so as to generate corresponding user data for the short message service;

[0036] A service test module, which is configured to send SMS service requests through the SMS service topology network to complete various preset service tests;

[0037] An evaluation module is configured to evaluate the business test results.

[0038] Furthermore,

[0039] The SMS application layer device is used to simulate the client API interface and the SMS communication protocol through Python framework tools, simulate the deployment of the SMS service interface, connect to the downstream SMS gateway, and simulate different SMS sending scenarios. By opening the relevant API ports and the access rights of the SMS protocol, the SMS service platform of the test customer can be seamlessly connected to the test environment.

[0040] The SMS gateway layer device is used to receive SMS requests from the SMS application service layer and route them to the corresponding SMS center, including protocol simulation, routing simulation, channel simulation, and operator service simulation;

[0041] The SMS service layer device is used to simulate the function of the network center, and implement various SMS management functions by extending the basic functions on the open source SMSC architecture OpenSMPP;

[0042] The user terminal layer equipment is used to simulate a large number of mobile user terminals and configure terminals of different types and conditions according to the situation.

[0043] In a third aspect, the present disclosure provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and when the processor runs the computer program stored in the memory, the processor executes the test method for the SMS service as described in any one of the first aspects.

[0044] In a fourth aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method for testing the SMS service described in any one of the first aspects above is implemented.

[0045] Beneficial effects:

[0046] The present invention discloses a test method for SMS service, a test system for SMS service, an electronic device and a storage medium; the business logic chain is complete, and the test part structure simulates the complete SMS service chain. From business logic configuration to network division, the environmental process of the existing SMS service can be simulated, so that the test environment is more in line with the current production environment, and the test confidence capability is improved; the test function is comprehensive, and a comprehensive SMS service function test is provided to enhance the reliability of the test results; the summarizing ability is strong, and the evaluation results are converted into various indicators by evaluating the business test results, so as to ensure the consistency and integrity of the test data while facilitating the subsequent business optimization and risk prevention and control of the test. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A flowchart of a method for testing a text message service provided in the first embodiment of the present disclosure;

[0048] Figure 2 An architectural diagram of a short message service topology network provided in an embodiment of the present disclosure;

[0049] Figure 3 A schematic diagram of an evaluation system for a test phase provided by an embodiment of the present disclosure;

[0050] Figure 4 This is an architecture diagram of a testing system for a short message service provided in Embodiment 2 of the present disclosure;

[0051] Figure 5 This is an architecture diagram of an electronic device provided in Embodiment 3 of the present disclosure. DETAILED DESCRIPTION

[0052] In order to enable those skilled in the art to better understand the technical solution of the present disclosure, the present disclosure is further described in detail below in conjunction with the drawings and embodiments. It should be understood that the specific embodiments and drawings described herein are only used to explain the present invention, rather than to limit the present invention.

[0053] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence; and, in the absence of conflict, the embodiments in the present disclosure and the features in the embodiments can be arbitrarily combined with each other.

[0054] The terms used in the embodiments of the present disclosure are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure. The singular forms of "a", "said" and "the" used in the embodiments of the present disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings.

[0055] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present disclosure, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0056] The technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned problems existing in the prior art are described in detail below with specific embodiments. It is understandable that in the embodiments of the present application, the execution subject can perform some or all of the steps in the embodiments of the present application, and these steps or operations are only examples. The embodiments of the present application can also perform other operations or deformations of various operations. In addition, each step can be performed in a different order presented in the embodiments of the present application, and it is possible not to perform all the operations in the embodiments of the present application. And, the following several specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0057] Figure 1 A flow chart of a method for testing a short message service provided in the first embodiment of the present disclosure is shown as follows: Figure 1 As shown, the method includes:

[0058] Step S101: Select four types of simulation devices of the SMS service topology structure according to the test requirements and the test object to form a complete SMS service topology network, and complete the configuration and parameter adjustment of the corresponding simulation devices, wherein the four types of simulation devices include SMS application layer devices, SMS gateway layer devices, SMS service layer devices, and user terminal layer devices;

[0059] Step S102: After completing the configuration of the simulated device, perform network planning, build the network architecture of the simulated environment, divide VLANs, perform IP address planning, and ensure connectivity and isolation between each simulated device layer;

[0060] Step S103: Determine the proportion of automatically randomly generated SMS services according to the proportion of different types and scenarios and the proportion of various number segments required by the test;

[0061] Step S104: making a short message service request according to the determined proportion of the short message service, so as to generate corresponding user data for the short message service;

[0062] Step S105: Sending a short message service request through the short message service topology network to complete various preset service tests;

[0063] Step S106: Evaluate the service test results.

[0064] Based on the current situation that the structure and business process of SMS services are divided by province, the disclosed embodiment designs a complete full-link simulation environment in combination with the core position of the SMS service server in the interaction of the SMS service process. The simulation environment includes a set of simulation topology structures based on SMS service logic, and the division of each layer within the structure realizes the simulation of SMS services through automated scripts that simulate real devices. According to the process of SMS services, the topology structure is divided into SMS application layer, SMS gateway layer, mobile network layer, and user terminal layer.

[0065] The SMS service test platform builds automated service tests, connects to the above four types of simulation equipment (i.e., the simulation equipment corresponding to the SMS application layer, SMS gateway layer, mobile network layer, and user terminal layer) through the GNS3 open source architecture tool, and provides a graphical network topology design interface to facilitate the rapid construction of complex network environments. Combined with the automated system and the visual interface, architecture configuration and routing planning can be directly performed.

[0066] Before each test, four types of simulation equipment are selected according to the test requirements and test objects to form a complete SMS service topology network. Appropriate equipment is selected according to the proposed test plan, and the configuration and parameter adjustment of the corresponding simulation equipment are completed. After the configuration is completed, network planning is carried out, the network architecture of the simulation environment is built, VLANs are reasonably divided, and IP address planning is designed to ensure connectivity and isolation between each layer, that is, the connection between the client and the gateway, the connection between the gateway and the SMS center, and the connection between the user and the SMS center. All other access is isolated.

[0067] After the architecture is completed, the test object is connected to form a complete SMS service closed-loop test environment. In the test phase, the simulation part of the gateway except the test object is uniformly controlled by the management and control module.

[0068] It should be noted that the SMS application layer and SMS gateway layer also have relevant designs for connecting to the test object while configuring the simulation structure. The test object builds the test environment by accessing a link in the topology structure. For example, if you need to test the local SMS gateway, remove the corresponding simulation part in the test environment and connect to the real test object.

[0069] Before the test begins, the proportion of automatically randomly generated SMS services is determined based on the proportions of different types and scenarios (bank SMS services, verification code services, SMS notification services, etc.) and the proportions of various number segments (within the province, outside the province, and number segments of other operators).

[0070] The automation module is called according to the determined ratio to make SMS service requests. SMS content can be made in various existing ways, such as randomly generating corresponding user data (i.e. SMS content) through a text model; sending the request through a simulator, and after reaching the business application simulator through the SMS gateway, the simulator also generates a simulated SMS and replies to the user simulator, thus completing a test process for the downlink SMS service. The entire test process will include hundreds or even thousands of business test processes of different time periods and types according to the test requirements, and various preset business tests will be completed according to the requirements.

[0071] The business test results are evaluated and summarized to verify whether the actual business capabilities of the test object (SMS service server or SMS gateway) meet the standards, whether there are loopholes in the logic of the business process, and whether the relevant configuration of the SMS service is correct.

[0072] The business logic chain of the disclosed embodiment is complete, and the test part structure simulates the complete SMS business chain. From business logic configuration to network division, it can simulate the environmental process of existing SMS business, making the test environment more in line with the current production environment, improving the test confidence capability, and providing comprehensive SMS business function testing, thereby enhancing the reliability of test results and having strong summarizing capabilities. By evaluating the business test results and converting the evaluation results into various indicators, the consistency and integrity of the test data are ensured, while facilitating subsequent business optimization and risk prevention and control in the test.

[0073] Furthermore,

[0074] The SMS application layer device is used to simulate the client API interface and the SMS communication protocol through Python framework tools, simulate the deployment of the SMS service interface, connect to the downstream SMS gateway, and simulate different SMS sending scenarios. By opening the relevant API ports and the access rights of the SMS protocol, the SMS service platform of the test customer can be seamlessly connected to the test environment.

[0075] The SMS gateway layer device is used to receive SMS requests from the SMS application service layer and route them to the corresponding SMS center, including protocol simulation, routing simulation, channel simulation, and operator service simulation;

[0076] The SMS service layer device is used to simulate the function of the network center, and implement various SMS management functions by extending the basic functions on the open source SMSC architecture OpenSMPP;

[0077] The user terminal layer equipment is used to simulate a large number of mobile user terminals and configure terminals of different types and conditions according to the situation.

[0078] SMS service topology network Figure 2 As shown in the figure, the GNS3 open source architecture tool is used to connect to the simulated devices at each layer. When testing a specific device, the test object can also be connected to a link in the topology structure to build a test environment. The functions of the devices at each layer are as follows:

[0079] SMS application layer:

[0080] This layer is the specific SMS application layer for corporate customers. It uses Python's Flank, Selenium, Twisted and other framework tools to simulate the client API interface and the SMS communication protocol, simulate the deployment of the SMS service interface, support SMS submission, status query, uplink reception and other functions, and connect to the downstream SMS gateway. At the same time, it also simulates different SMS sending scenarios, such as batch sending, scheduled sending, triggered sending, etc., to generate real SMS sending requests. It meets the SMS service platform functions of common industries such as banking, e-commerce, and logistics. In terms of docking test objects, open the access rights of relevant API ports and SMS protocols to achieve seamless docking of the test customer's SMS business platform into the test environment.

[0081] SMS gateway layer:

[0082] This layer deploys the SMS gateway system, receives SMS requests from the SMS application service layer, and routes them to the corresponding SMS center. It is the core part of the SMS service and involves SMS-related services. The simulation part is first of all protocol simulation, which develops simulated SMPP and SGIP clients and servers through the SMPP and SGIP (Short Message Gateway Interface Protocol) protocol libraries. The routing simulation uses configuration files and databases to define the routing rules of the simulated gateway to determine the SMS delivery channel and target operator based on conditions such as the sending number, receiving number, and SMS content, and simulates multiple routing strategies such as: priority routing, load balancing routing, and failover routing. The channel simulation adopts a similar implementation method to the routing simulation, defining the parameters of each channel through configuration files and databases, such as IP address, port, protocol type, account number, and password. The operator service simulation receives messages from the channel simulation module through the SMSC and SGIP gateways. The message is checked and processed as necessary, the number format is checked, and the blacklist filtering function is implemented. It returns the corresponding response and status report, simulates the behavior of the real operator gateway, and determines the message delivery path based on the number routing logic, the mobile phone number segment, location and other information, and generates relevant billing data and bills.

[0083] SMS service layer:

[0084] This layer simulates the functions of the network center and implements SMS management functions by extending the basic functions on the open source SMSC architecture OpenSMPP, such as SMS storage and forwarding, routing, queue management, protocol conversion, status report generation, billing, filtering, priority processing and validity period management.

[0085] User terminal layer:

[0086] This layer uses mobile phone simulators or real devices to simulate a large number of mobile user terminals. Different types of terminals are configured according to the situation, such as smart phones and feature phones. The distribution of different brands, models, operating systems and the behavior of user terminals, such as normal reception, shutdown, busy hours, etc., are considered to affect the delivery status of SMS.

[0087] The test part structure of the embodiment of the present disclosure simulates a complete SMS service chain, and can simulate the environmental process of the existing SMS service from business logic configuration to network division, so that the test environment is more in line with the current production environment, thereby improving the test confidence capability.

[0088] Further, making a short message service request according to the determined proportion of the short message service to generate corresponding user data for the short message service includes:

[0089] According to the determined proportion of SMS services, a corresponding request carrier is generated through a preset message definition module and the carrier is sent to each simulator;

[0090] After receiving the carrier, the simulator uses the set SMS template combined with the protocol identifier of the source address and destination address pairing and randomly selects the data encoding scheme to complete the SMS structure construction, and generates random user data through the simulator type and language module.

[0091] The control module calls the automation module to make SMS service requests according to the determined ratio. The automation module generates the corresponding request carrier according to the preset message definition module and sends the carrier to each simulator. After receiving the carrier, the simulator uses the set SMS template combined with the protocol identifier paired with the source address and destination address (user number, corporate SMS signature) and randomly selects the data encoding scheme to complete the SMS structure construction, and randomly generates random user data (i.e. SMS content) through the simulator type and language module. The actual effect is as follows: when the user simulator receives the carrier requesting the verification code service, the corresponding text model is used to generate the corresponding user data. The request is sent through the simulator, and after reaching the business application simulator through the SMS gateway, the simulator also generates a simulated SMS and replies to the user simulator, thus completing a test process for the downlink SMS service. The entire test process will include hundreds or even thousands of business test processes of different time periods and types according to the test requirements.

[0092] Furthermore, the method further comprises:

[0093] In the generated request carrier, a certain proportion of erroneous requests, out-of-province requests and nuisance SMS requests are simulated according to the test requirements.

[0094] By adding error requests, out-of-province requests, and harassing SMS requests, the system's ability to identify and filter abnormal SMS can be tested, making the test more comprehensive.

[0095] Furthermore, the preset service test includes at least one of the following tests:

[0096] The success rate test of SMS reception and transmission includes: using log statistics to check whether the SMS server or gateway can correctly receive and send SMS messages of various formats and contents, and to calculate the success rate of receiving and sending test SMS messages of a certain level;

[0097] The SMS concurrent processing capability test includes: testing the SMS processing capability and performance of the SMS server or gateway under high concurrency conditions by setting simulated traffic volumes of different magnitudes;

[0098] The test of the recognition and filtering capabilities of abnormal SMS messages includes: testing whether the SMS server or gateway can correctly recognize and filter various abnormal or illegal SMS messages by reading the SMS return log and gateway release log;

[0099] SMS sending speed and delay test, including: testing the end-to-end transmission speed and delay from SMS receiving to sending;

[0100] Accuracy testing of SMS billing and statistics, including: verifying gateway bills and SMS sending records to test whether the billing and statistical data generated by the SMS server or gateway are accurate;

[0101] Fault simulation and recovery testing includes: simulating various faults to test whether the system can detect and take appropriate fault tolerance, retransmission, and degradation measures in a timely manner.

[0102] The test of this solution is to verify whether the actual business capabilities of the test object (SMS service server or SMS gateway) meet the standards, whether there are loopholes in the logic of the business process, and whether the relevant configuration of the SMS service is correct. It is a logic test based on the soft environment. The preset business tests include one or more of the following tests, which are selected according to the implementation situation.

[0103] Success rate of SMS receiving and sending:

[0104] The test environment uses log statistics to check whether the SMS server or gateway can correctly receive and send SMS messages of various formats (such as text, Unicode, etc.) and contents (such as Chinese and English, symbols, long SMS, etc.). Statistics are collected on the success rate of receiving and sending a certain amount of test SMS messages (such as 1,000 messages), and the success rate should meet certain standards (such as more than 99%). Check the error code and cause of the failed SMS messages, such as content violation, invalid number, network failure, etc., to ensure that the error handling meets expectations.

[0105] Concurrent SMS processing capability:

[0106] Test the SMS processing capability and performance of SMS servers or gateways under high concurrency conditions by setting simulated traffic volumes of different magnitudes. Design SMS stress test scenarios with different concurrency levels (such as 10, 100, and 1,000 messages per second) to evaluate indicators such as processing delay and resource usage. Investigate the SMS loss rate, duplication rate, and disorder rate during concurrent processing to ensure data consistency and integrity.

[0107] Ability to identify and filter abnormal SMS messages:

[0108] Read the SMS return log and gateway release log to test whether the SMS server or gateway can correctly identify and filter various abnormal or illegal SMS. Construct different types of abnormal SMS (such as keywords, blacklist numbers, spam content, etc.) to evaluate the system's recognition rate, interception rate, and misjudgment rate. Check whether the alarm notification and log records of abnormal SMS are timely and accurate, which is convenient for subsequent business optimization and risk prevention and control.

[0109] SMS sending speed and latency:

[0110] Testing the end-to-end transmission speed and latency of SMS from reception to delivery is related to the user experience of SMS services. Statistics are collected on indicators such as average delivery speed (e.g., messages / minute) and average first delivery latency (e.g., seconds). Different SMS types and priorities should meet different requirements. Investigate the fluctuations of delivery speed and latency under different load and network conditions, which should not exceed the acceptable range.

[0111] Accuracy of SMS billing and statistics:

[0112] Verify the gateway bill and SMS sending records to test whether the billing and statistical data generated by the SMS server or gateway are accurate. Construct sending and receiving scenarios of different SMS types, numbers, and times, and compare the difference between the system billing and the actual billing. The difference rate should be within a reasonable range. Verify the accuracy of statistical indicators such as the number of successful and failed SMS messages and the number of classified summaries to provide a reliable basis for subsequent data analysis and decision-making.

[0113] Fault simulation and recovery testing:

[0114] By adjusting the simulator to simulate faults such as power outages, network interruptions, full disks, and software crashes, test whether the system detects and takes appropriate measures such as fault tolerance, retransmission, and downgrade in a timely manner. Test the processing and recovery capabilities of the SMS server or gateway under various faults or abnormal conditions to ensure business continuity. After the fault is recovered, whether the system can automatically or manually return to normal working conditions, the data should remain consistent, and no new problems should be introduced.

[0115] By providing comprehensive SMS business function testing, it basically covers the common services of existing SMS business and enhances the reliability of test results.

[0116] Furthermore, the business test results are evaluated:

[0117] Collect information from each device in various service test environments, and evaluate various evaluation indicators of SMS services based on the collected information;

[0118] The evaluation indicators include: the success rate of SMS reception and transmission, SMS concurrent processing capability, abnormal SMS identification and filtering capability, SMS transmission speed and delay, SMS billing and statistics accuracy, fault simulation and recovery capability.

[0119] The present disclosure embodiment designs an evaluation system for the entire test phase such as Figure 3 As shown in the figure, by providing the ability to collect configuration information at all levels in the test environment and converting the information into various evaluation indicators of SMS services, the consistency and integrity of the test data are ensured through automated log collection and data processing, while facilitating subsequent business optimization and risk prevention.

[0120] The test method for the SMS service of the disclosed embodiment has a high degree of customization. The customized construction of the test environment is realized through the integrated simulator architecture and the visual interface. In combination with the actual production environment, a test environment that meets the requirements can be constructed to the greatest extent. The business logic chain is complete, and the test part structure simulates the complete SMS service chain. From business logic configuration to network division, the environmental process of the existing SMS service can be simulated, making the test environment more in line with the current production environment. The test confidence capability is improved. The test function is comprehensive, providing comprehensive SMS service function testing, basically covering the common services of the existing SMS service, and enhancing the reliability of the test results. The strong summarization ability provides the ability to collect configuration information at all levels in the test environment, and converts the information into various indicators of the SMS service. Through automated log collection and data processing, the consistency and integrity of the test data are ensured, while facilitating the subsequent business optimization and risk prevention and control of the test.

[0121] By building a simulated test environment and configuring relevant data for existing SMS services under the framework of this disclosure, the new gateway will be connected to the test environment after completion to conduct relevant tests based on functional implementation and complete the acceptance of the relevant gateway system. In the subsequent customer migration phase after the system is launched, customer services will also be connected to the test environment for business logic testing, and the test data results will be submitted to the provincial government and enterprises as the basis for business migration and relevant materials for docking with customers, so as to promote the smooth progress of business migration.

[0122] The second embodiment of the present disclosure provides a testing system for SMS services, such as Figure 4 As shown, the system comprises:

[0123] A topology network construction module 11 is configured to select four types of simulation devices of the SMS service topology structure according to the test requirements and the test object to form a complete SMS service topology network, and complete the configuration and parameter adjustment of the corresponding simulation devices. The four types of simulation devices include SMS application layer devices, SMS gateway layer devices, SMS service layer devices, and user terminal layer devices;

[0124] A network planning module 12, which is configured to perform network planning after the topology network construction module completes the configuration of the simulated device, build a network architecture for the simulated environment, divide VLANs, perform IP address planning, and ensure connectivity and isolation between each simulated device layer;

[0125] A determination module 13 is configured to determine the proportion of automatically randomly generated SMS services according to the proportion of different types and different scenarios and the proportion of various number segments required by the test;

[0126] A generating module 14, which is configured to make a short message service request according to the determined proportion of the short message service, so as to generate corresponding user data for the short message service;

[0127] A service test module 15, which is configured to send out SMS service requests through the SMS service topology network and complete various preset service tests;

[0128] The evaluation module 16 is configured to evaluate the service test results.

[0129] Furthermore,

[0130] The SMS application layer device is used to simulate the client API interface and the SMS communication protocol through Python framework tools, simulate the deployment of the SMS service interface, connect to the downstream SMS gateway, and simulate different SMS sending scenarios. By opening the relevant API ports and the access rights of the SMS protocol, the SMS service platform of the test customer can be seamlessly connected to the test environment.

[0131] The SMS gateway layer device is used to receive SMS requests from the SMS application service layer and route them to the corresponding SMS center, including protocol simulation, routing simulation, channel simulation, and operator service simulation;

[0132] The SMS service layer device is used to simulate the function of the network center, and implement various SMS management functions by extending the basic functions on the open source SMSC architecture OpenSMPP;

[0133] The user terminal layer equipment is used to simulate a large number of mobile user terminals and configure terminals of different types and conditions according to the situation.

[0134] Furthermore, the generating module 14 is specifically configured as follows:

[0135] According to the determined proportion of SMS services, a corresponding request carrier is generated through a preset message definition module and the carrier is sent to each simulator;

[0136] After receiving the carrier, the simulator uses the set SMS template combined with the protocol identifier of the source address and destination address pairing and randomly selects the data encoding scheme to complete the SMS structure construction, and generates random user data through the simulator type and language module.

[0137] Furthermore, the generating module 14 is further configured to:

[0138] In the generated request carrier, a certain proportion of erroneous requests, out-of-province requests and nuisance SMS requests are simulated according to the test requirements.

[0139] Furthermore, the preset service test includes at least one of the following tests:

[0140] The success rate test of SMS reception and transmission includes: using log statistics to check whether the SMS server or gateway can correctly receive and send SMS messages of various formats and contents, and to calculate the success rate of receiving and sending test SMS messages of a certain level;

[0141] The SMS concurrent processing capability test includes: testing the SMS processing capability and performance of the SMS server or gateway under high concurrency conditions by setting simulated traffic volumes of different magnitudes;

[0142] The test of the recognition and filtering capabilities of abnormal SMS messages includes: testing whether the SMS server or gateway can correctly recognize and filter various abnormal or illegal SMS messages by reading the SMS return log and gateway release log;

[0143] SMS sending speed and delay test, including: testing the end-to-end transmission speed and delay from SMS receiving to sending;

[0144] Test the accuracy of SMS billing and statistics, including: verifying the gateway bill and SMS sending records to test whether the billing and statistical data generated by the SMS server or gateway are accurate;

[0145] Fault simulation and recovery testing includes: simulating various faults to test whether the system can detect and take appropriate fault tolerance, retransmission, and degradation measures in a timely manner.

[0146] Furthermore, the evaluation module 16 is specifically configured as follows:

[0147] Collect information from each device in various service test environments, and evaluate various evaluation indicators of SMS services based on the collected information;

[0148] The evaluation indicators include: the success rate of SMS reception and transmission, SMS concurrent processing capability, abnormal SMS identification and filtering capability, SMS transmission speed and delay, SMS billing and statistics accuracy, fault simulation and recovery capability.

[0149] The testing system for the SMS service of the disclosed embodiment is used to implement the testing method for the SMS service in the first method embodiment, so the description is relatively simple. For details, please refer to the relevant description in the previous method embodiment, which will not be repeated here.

[0150] In addition, if Figure 5 As shown, the third embodiment of the present disclosure further provides an electronic device, including a memory 100 and a processor 200, wherein the memory 100 stores a computer program, and when the processor 200 runs the computer program stored in the memory 100, the processor 200 executes the above-mentioned various possible methods.

[0151] The memory 100 is connected to the processor 200. The memory 100 may be a flash memory, a read-only memory or other memory, and the processor 200 may be a central processing unit or a single-chip microcomputer.

[0152] In addition, an embodiment of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored, and the computer program is executed by a processor to perform the above-mentioned various possible methods.

[0153] The computer-readable storage medium includes volatile or non-volatile, removable or non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules or other data). Computer-readable storage media include, but are not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable read only memory), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory), Digital Video Disc (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer.

[0154] It is to be understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of the present disclosure, but the present disclosure is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and substance of the present disclosure, and these modifications and improvements are also considered to be within the scope of protection of the present disclosure.

Claims

1. A method for testing a short message service, characterized in that: The method comprises: Select four types of simulation devices of the SMS service topology structure according to the test requirements and test objects to form a complete SMS service topology network, and complete the configuration and parameter adjustment of the corresponding simulation devices. The four types of simulation devices include SMS application layer devices, SMS gateway layer devices, SMS service layer devices, and user terminal layer devices; After completing the configuration of the simulation equipment, carry out network planning, build the network architecture of the simulation environment, divide the virtual LAN VLAN, plan the IP address, and ensure the connectivity and isolation between the various simulation equipment layers; Determine the proportion of automatically randomly generated SMS services based on the proportion of different types and scenarios and the proportion of various number segments required by the test; Making a short message service request according to the determined proportion of the short message service to generate corresponding user data for the short message service; Send SMS service requests through the SMS service topology network to complete various preset service tests; Evaluate business test results.

2. The method according to claim 1, characterized in that The SMS application layer device is used to simulate the client application programming interface API interface and the SMS communication protocol through the Python framework tool, and simulate the deployment of the SMS service interface, connect to the downstream SMS gateway, and simulate different SMS sending scenarios. By opening the relevant API ports and the access rights of the SMS protocol, the SMS service platform of the test customer can be seamlessly connected to the test environment; The SMS gateway layer device is used to receive SMS requests from the SMS application service layer and route them to the corresponding SMS center, including protocol simulation, routing simulation, channel simulation, and operator service simulation; The SMS service layer device is used to simulate the functions of the network center, and implement various SMS management functions by extending the basic functions on the open source SMSC architecture open source short message peer-to-peer protocol OpenSMPP; The user terminal layer equipment is used to simulate a large number of mobile user terminals and configure terminals of different types and conditions according to the situation.

3. The method according to claim 1, characterized in that The making of the SMS service request according to the determined proportion of the SMS service to generate corresponding user data for the SMS service includes: According to the determined proportion of SMS services, a corresponding request carrier is generated through a preset message definition module and the carrier is sent to each simulator; After receiving the carrier, the simulator uses the set SMS template combined with the protocol identifier of the source address and destination address pairing and randomly selects the data encoding scheme to complete the SMS structure construction, and generates random user data through the simulator type and language module.

4. The method according to claim 3, characterized in that: The method further comprises: In the generated request carrier, a certain proportion of erroneous requests, out-of-province requests and nuisance SMS requests are simulated according to the test requirements.

5. The method according to claim 1, characterized in that The preset service test includes at least one of the following tests: The success rate test of SMS reception and transmission includes: using log statistics to check whether the SMS server or gateway can correctly receive and send SMS messages of various formats and contents, and to calculate the success rate of receiving and sending test SMS messages of a certain level; The SMS concurrent processing capability test includes: testing the SMS processing capability and performance of the SMS server or gateway under high concurrency conditions by setting simulated traffic volumes of different magnitudes; The test of the recognition and filtering capabilities of abnormal SMS messages includes: testing whether the SMS server or gateway can correctly recognize and filter various abnormal or illegal SMS messages by reading the SMS return log and gateway release log; SMS sending speed and delay test, including: testing the end-to-end transmission speed and delay from SMS receiving to sending; Test the accuracy of SMS billing and statistics, including: verifying the gateway bill and SMS sending records to test whether the billing and statistical data generated by the SMS server or gateway are accurate; Fault simulation and recovery testing includes: simulating various faults to test whether the system can detect and take appropriate fault tolerance, retransmission, and degradation measures in a timely manner.

6. The method according to claim 5, characterized in that The business test results are evaluated as follows: Collect information from each device in various service test environments, and evaluate various evaluation indicators of SMS services based on the collected information; The evaluation indicators include: the success rate of SMS reception and transmission, SMS concurrent processing capability, abnormal SMS identification and filtering capability, SMS transmission speed and delay, SMS billing and statistics accuracy, fault simulation and recovery capability.

7. A testing system for SMS service, characterized in that: The system comprises: A topology network construction module is configured to select four types of simulation devices of the SMS service topology structure according to the test requirements and the test object to form a complete SMS service topology network, and complete the configuration and parameter adjustment of the corresponding simulation devices. The four types of simulation devices include SMS application layer devices, SMS gateway layer devices, SMS service layer devices, and user terminal layer devices; A network planning module, which is configured to perform network planning after the topology network construction module completes the configuration of the simulated device, build a network architecture of the simulated environment, divide VLANs, perform IP address planning, and ensure connectivity and isolation between each simulated device layer; A determination module is configured to determine the proportion of automatically randomly generated SMS services according to the proportion of different types and scenarios and the proportion of various number segments required by the test; A generating module, which is configured to make a short message service request according to the determined proportion of the short message service, so as to generate corresponding user data for the short message service; A service test module, which is configured to send SMS service requests through the SMS service topology network to complete various preset service tests; An evaluation module is configured to evaluate the business test results.

8. The system according to claim 7, characterized in that The SMS application layer device is used to simulate the client API interface and the SMS communication protocol through Python framework tools, simulate the deployment of the SMS service interface, connect to the downstream SMS gateway, and simulate different SMS sending scenarios. By opening the relevant API ports and the access rights of the SMS protocol, the SMS service platform of the test customer can be seamlessly connected to the test environment. The SMS gateway layer device is used to receive SMS requests from the SMS application service layer and route them to the corresponding SMS center, including protocol simulation, routing simulation, channel simulation, and operator service simulation; The SMS service layer device is used to simulate the function of the network center, and implement various SMS management functions by extending the basic functions on the open source SMSC architecture OpenSMPP; The user terminal layer equipment is used to simulate a large number of mobile user terminals and configure terminals of different types and conditions according to the situation.

9. An electronic device, characterized in that: It comprises a memory and a processor, wherein the memory stores a computer program, and when the processor runs the computer program stored in the memory, the processor executes the method for generating an operating report based on enterprise indicator assets as described in any one of claims 1-6.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for generating an operating report based on enterprise indicator assets according to any one of claims 1 to 6 is implemented.

Images