OTA pressure testing system

Abstract

The invention provides an OTA pressure testing system, and belongs to the technical field of OTA pressure testing, and the OTA pressure testing system comprises a scene configuration module which is used for configuring testing parameters and a testing process so as to generate a testing script; the test parameters at least comprise pressure test times, user operation parameters, upgrading duration, downloading duration and an upgrading mode; the simulation pressure module is used for simulating user front-end operation to drive the OTA system according to the test script; the real-time monitoring module is used for collecting performance indexes of the OTA system; and the report generation module is used for generating a test report according to the performance indexes. According to the method, the operation behaviors of large-scale users on the front-end interface are truly simulated, so that high-efficiency concurrent pressure testing is realized, and performance monitoring in front-end and back-end interaction of the OTA system is comprehensively covered.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of OTA pressure testing, and particularly relates to an OTA pressure testing system. BACKGROUND

[0002] With the development of automobile intelligence, OTA technology has become the core means of vehicle software update. It is crucial to ensure the stability of the OTA system in a high concurrency scenario, so an effective pressure testing scheme is needed. There are mainly two types of schemes in the prior art: one is direct interface pressure testing based on the HTTP (HyperText Transfer Protocol) protocol. This method can simulate high concurrency requests, but it cannot restore the complex interactive behavior of real users on the front-end interface, and the test coverage is insufficient. The other is testing based on browser automation tools. This method can simulate user operations, but it has inherent defects such as large resource consumption, low test efficiency, difficulty in achieving large-scale concurrency, and poor stability due to its dependence on a complete browser. SUMMARY

[0003] The present application aims to solve at least one of the technical problems in the prior art, and proposes an OTA pressure testing system based on simulated clicks.

[0004] In a first aspect, an embodiment of the present application provides an OTA pressure testing system, comprising: a scene configuration module configured to configure test parameters and test procedures for generating a test script; the test parameters at least include the number of pressure tests, user operation parameters, upgrade duration, download duration, and upgrade method; a simulated pressure module configured to simulate user front-end operations to drive the OTA system according to the test script; a real-time monitoring module configured to collect performance indicators of the OTA system; and a report generation module configured to generate a test report according to the performance indicators.

[0005] In an embodiment of the present application, the scene configuration module comprises: a scene definition unit configured to receive test parameters and test procedures through a graphical interface; the user operation parameters are configured according to operation behaviors and operation interval times, or are configured according to recorded real user operations; the operation behaviors at least include clicking, inputting, and scrolling; and a script generation unit configured to obtain a test script according to the test parameters and the test procedures.

[0006] In the embodiment of the present application, the test procedure comprises: in response to receiving an update request of a user, detecting a software update on the device; determining whether a new version is detected; if a new version is detected, driving the device to perform an upgrade operation according to an upgrade duration, a download duration and an upgrade mode; the upgrade mode at least comprises an immediate upgrade and an upgrade after a preset time; if a new version is not detected, determining whether the number of times that a new version is not detected currently exceeds a preset threshold; if the preset threshold is exceeded, ending the current update; if the preset threshold is not exceeded, recording the current detection and re-executing the step of detecting a software update on the device.

[0007] In the embodiment of the present application, the simulation pressure module comprises: a simulation click engine configured to simulate user operation behaviors to drive the OTA system based on the test script; and a pressure scheduling unit configured to manage and control concurrent execution of multiple test instances based on test resources and pressure test times.

[0008] In the embodiment of the present application, the simulation click engine comprises: a rendering subunit configured to load and render an OTA system front-end interface; an analysis subunit configured to analyze a DOM structure of the OTA system front-end interface and locate operable elements; and a simulation subunit configured to simulate click, input and scroll operations on the operable elements.

[0009] In the embodiment of the present application, the pressure scheduling unit comprises: a resource allocation subunit configured to distribute test instances to a back-end server; and a pressure mode subunit configured to control a number of concurrent test instances based on a pressure mode and pressure test times; the pressure mode comprises at least one of a step-by-step pressure increase, a peak pressure or a continuous pressure.

[0010] In the embodiment of the present application, the performance indicators comprise front-end performance indicators and back-end resource indicators; the real-time monitoring module comprises: a front-end probe unit configured to collect front-end performance indicators from the simulation click engine; the front-end performance indicators at least comprise front-end response time, operation success rate and page loading time indicators; a back-end monitoring unit configured to collect back-end resource indicators of an OTA system back-end server; the back-end resource indicators at least comprise CPU usage, memory usage and network traffic indicators; and an event recording unit configured to record abnormal events and error information generated by the front-end or the back-end during the test process.

[0011] The second aspect of the present application provides an OTA pressure test method applied to the OTA pressure test system, comprising: configuring test parameters and test procedures for generating a test script; the test parameters at least comprise pressure test times, user operation parameters, upgrade duration, download duration and upgrade mode; simulating user front-end operations to drive the OTA system according to the test script; collecting performance indicators of the OTA system; and generating a test report according to the performance indicators.

[0012] The third aspect of the present application provides an electronic device, comprising: one or more processors; a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors perform the OTA stress test method described above.

[0013] The fourth aspect of the present application also provides a computer-readable storage medium having stored executable instructions, which, when executed by a processor, cause the processor to perform the OTA stress test method described above.

[0014] The chip monitoring system provided by the present application, by constructing a complete system including scene configuration, simulation pressure, real-time monitoring and report generation, at least partially solves the technical problems of fragmentation of test links, inability to simulate user scenarios and low test efficiency in the prior art, realizes the technical effect of efficient, real and comprehensive automatic pressure test on the OTA system. BRIEF DESCRIPTION OF DRAWINGS

[0015] Figure 1 The structure block diagram of the OTA stress test system provided by the embodiment of the present application is shown in the figure;

[0016] Figure 2 The test flow diagram provided by the embodiment of the present application is shown in the figure;

[0017] Figure 3 The structure block diagram of the simulation pressure module in the embodiment of the present application is shown in the figure;

[0018] Figure 4 The flow diagram of the OTA stress test method provided by the embodiment of the present application is shown in the figure;

[0019] Figure 5 The structure block diagram of the electronic device provided by the embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0020] In order for those skilled in the art to better understand the technical solutions of the present application, the exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to help understanding, and should be considered only as exemplary. Therefore, those skilled in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, in order to be clear and concise, the description in the following description omits the description of well-known functions and structures.

[0021] In the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.

[0022] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0023] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. "Coupled" or "connected" or similar terms are not restricted to physical or mechanical connections or associations, but can also include electrical connections, whether direct or indirect.

[0024] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted in an overly literal or overly formal sense unless expressly so defined herein.

[0025] In the technical solutions of the present application, the collection, storage, use, processing, transmission, provision and disclosure of user personal information comply with relevant laws and regulations and do not violate public order and good customs. The use of user data in the technical solutions complies with relevant national laws and regulations (for example, "Information Security Technology Personal Information Security Specification" and the like). For example, appropriate measures are taken for personal information access control; restrictions are given to the display of personal information; the use purpose of personal information does not exceed the direct or reasonably related range; the use of personal information eliminates the explicit identity pointing and avoids precise positioning to a specific individual.

[0026] First, the technical terms involved in the present application are described as follows:

[0027] OTA (Over-the-Air Technology): Over-the-Air Technology, which refers to remotely downloading and installing software packages to devices (such as cars and mobile phones) through wireless networks without physical connection.

[0028] Stress test: Test the processing limit and stability of the system by simulating load.

[0029] DOM structure (Document Object Model): Document Object Model. Parsing DOM structure refers to the browser parsing a tree structure from the web page code. Programs can change the content, structure or style of the web page by operating the tree. In the present application, parsing DOM is to accurately find the button or input box that needs to be clicked without opening the complete browser.

[0030] Lightweight browser kernel: refers to a software library containing only the core rendering engine of the browser, removing unnecessary components such as the graphical user interface. In the present application, it can be used to accurately understand and operate the web page with minimal resource consumption.

[0031] Concurrency: refers to multiple tasks (test instances) being executed simultaneously within the same time interval. In the present application, high concurrency means simulating a large number of virtual user operations simultaneously.

[0032] Performance indicators: data that measures system performance. Front-end performance indicators focus on user experience; back-end resource indicators focus on server health.

[0033] In the prior art, the direct interface call method based on the HTTP protocol is often used for OTA system stress testing. This technology directly accesses the background interface of the OTA system by simulating a large number of HTTP requests, testing the response ability and stability of the system under high concurrency. The test tool usually uses general performance test tools such as JMeter and LoadRunner to simulate multiple user concurrent requests by configuring test scripts. However, only the interface layer is tested, and the front-end user interaction process cannot be covered; real factors such as front-end rendering and user operation interval are ignored; potential problems in front-end and back-end interaction, such as page loading abnormalities and click response delays, cannot be detected; and the test is insufficient for OTA functions that require complex user interaction, such as multi-step upgrade processes. Considering user operations, there are also test solutions based on browser automation tools such as Selenium, which simulate user operations in the browser by controlling real browsers to perform testing. This technology can record or write test scripts to simulate user clicks, inputs and other operations in the browser to perform functional testing on the front-end interface of the OTA system. However, this solution consumes a lot of resources, and each test instance needs to start a complete browser, making it difficult to achieve high concurrency; browser rendering and page loading result in slow testing speed; the test script is affected by browser version and page element changes, resulting in high maintenance cost; it is difficult to accurately control the concurrency and stress indicators, and it is difficult to effectively simulate large-scale user operation scenarios.

[0034] Figure 1 The structural diagram of an OTA stress testing system provided by the embodiment of the present application is shown in Figure 1As shown, the embodiment of the present application provides an OTA stress test system, comprising: a scene configuration module, configured to configure test parameters and test procedures for generating a test script; the test parameters at least include stress test times, user operation parameters, upgrade duration, download duration and upgrade mode; a simulation stress module, configured to simulate user front-end operation to drive the OTA system according to the test script; a real-time monitoring module, configured to collect performance indexes of the OTA system; and a report generation module, configured to generate a test report according to the performance indexes.

[0035] Through the embodiment of the present application, rich test scene configuration options are provided to meet the diversified test requirements of different OTA systems, accurate controllable stress test indexes and scene configurations are provided, the operation behavior of large-scale users on the front-end interface is more realistically simulated through simulated click operation, the performance bottleneck points in the front-end and back-end interaction of the OTA system are comprehensively covered, and high-efficiency, low-resource-consumption high-concurrency stress test is realized.

[0036] On the basis of the above embodiment, the scene configuration module comprises: a scene definition unit, configured to receive test parameters and test procedures through a graphical interface; the user operation parameters are configured according to operation behavior and operation interval time, or are configured according to recorded real user operation; the operation behavior at least includes click, input and scroll; and a script generation unit, configured to obtain a test script according to the test parameters and the test procedures.

[0037] In this embodiment, the scene configuration module provides a graphical interface to configure test scenes, including test procedure steps, operation interval time, concurrent user number and other parameters; supports recording real user operation and converting it into a test script; and provides OTA specific test templates, such as firmware upgrade procedures, configuration update procedures and the like.

[0038] Specifically, the graphical interface provides a drop-down menu, an input box and a procedure dragging panel; the recording function captures operation sequences by listening to browser events; and the script generation unit converts configuration parameters and procedure sequences into executable script codes.

[0039] Through the embodiment of the present application, the programming threshold and complexity of the test script are reduced through the graphical interface and the operation recording function, the test personnel can quickly build complex test scenes without coding, and the efficiency and convenience of test preparation are improved.

[0040] Figure 2 The test procedure schematic diagram provided by the embodiment of the present application is as shown in Figure 2As shown, the test flow comprises: detecting the software update on the device in response to receiving the update request of the user; determining whether a new version is detected; if the new version is detected, driving the device to perform the upgrade operation according to the upgrade duration, the download duration and the upgrade mode; the upgrade mode at least comprises immediately upgrading and upgrading after a preset time; if the new version is not detected, determining whether the number of times that the current new version is not detected exceeds a preset threshold; if the preset threshold is exceeded, ending the current update; if the preset threshold is not exceeded, recording the current detection and re-executing the step of detecting the software update on the device.

[0041] In the embodiment of the application, the driving device to perform the upgrade operation further comprises determining whether the upgrade package is encrypted, and if encrypted, simulating user input of a password and performing the upgrade after the password verification is passed.

[0042] Specifically, a random time interval can be set after each user operation to simulate user hesitation; the preset threshold of checking the update is 3 times, for example, and the test flow is marked as normally ended due to no update after the threshold is exceeded.

[0043] Through the embodiment of the application, the complete behavior path of the real user when performing OTA upgrade is simulated by defining a detailed test flow comprising update detection, version determination, upgrade decision and retry mechanism, so that the stress test scenario is closer to the actual situation.

[0044] Figure 3 The structure diagram of the simulation stress module in the embodiment of the application is shown in Figure 3 As shown, the simulation stress module comprises: a simulation click engine for simulating user operation behaviors to drive the OTA system based on a test script; and a stress scheduling unit for managing and controlling the concurrent execution of multiple test instances based on test resources and stress test times.

[0045] Through the embodiment of the application, the simulation of user operation and the application of system stress are coordinated to ensure the behavior authenticity and controllable stress, and the high-concurrency user operation is simulated.

[0046] On the basis of the above-mentioned embodiment, the simulation click engine comprises: a rendering subunit for loading and rendering the OTA system front-end interface; an analysis subunit for analyzing the DOM structure of the OTA system front-end interface and positioning the operable elements; and a simulation subunit for simulating the click, input and scroll operations on the operable elements.

[0047] In this embodiment, the simulation click engine can be implemented based on a lightweight browser kernel without starting a complete browser; the OTA system front end interface DOM structure is parsed to accurately locate the operable elements, specifically, the elements are located in the DOM tree through a selector; the operation is triggered by calling a JavaScript event (such as element.click ()), to simulate real user click, input, scroll and other operation behaviors, and the operation interval time is randomized to be closer to real user behaviors.

[0048] Through the embodiments of the present application, the elements are located by parsing the DOM rather than rendering a complete page, resource consumption is reduced under the premise of ensuring operation accuracy, and high concurrency simulation is achieved.

[0049] On the basis of the above-mentioned embodiments, the pressure scheduling unit comprises: a resource allocation subunit for distributing test instances to the backend server; a pressure mode subunit for controlling the number of concurrent test instances based on the pressure mode and the number of pressure tests; the pressure mode comprises at least one of step-by-step pressure increase, peak pressure or continuous pressure.

[0050] In this embodiment, the pressure scheduling unit maintains a test instance pool for unified management, and dynamically allocates instances according to the load of the test machine; the step-by-step pressure increase mode can be configured to linearly increase the number of concurrent users to the peak value within a preset time; the peak pressure mode can be configured to start all concurrent users in a short time; the continuous pressure can be configured to start the concurrent users uniformly until the number of pressure tests is reached.

[0051] Through the embodiments of the present application, by setting resource allocation and multiple pressure mode control, test resources are dynamically allocated and the application strategy of concurrent pressure is accurately controlled, to realize accurate detection of system performance inflection point, limit capacity and stability.

[0052] On the basis of the above-mentioned embodiments, the performance indicators include front end performance indicators and backend resource indicators; the real-time monitoring module comprises: a front end probe unit for collecting front end performance indicators from the simulation click engine; the front end performance indicators at least include front end response time, operation success rate and page loading time indicators; a backend monitoring unit for collecting backend resource indicators of the OTA system backend server; the backend resource indicators at least include CPU usage, memory usage and network traffic indicators; an event recording unit for recording abnormal events and error information generated by the front end or the backend during the test process.

[0053] In this embodiment, optionally, the front end probe unit obtains the page loading time through the Performance API; the backend monitoring unit pulls resource data through the interface of a server monitoring tool (such as Prometheus); the event recording unit stores the abnormal information in association with the timestamp.

[0054] Through the embodiment of the present application, a comprehensive monitoring perspective from a front-end user perception to a back-end system resource consumption is established, and performance problems can be accurately located.

[0055] Figure 4 A flowchart of an OTA stress testing method provided by the embodiment of the present application is shown in Figure 4 The present application also provides an OTA stress testing method applied to the OTA stress testing system, which includes: S1, configuring test parameters and a test flow for generating a test script; the test parameters at least include a stress testing number, user operation parameters, an upgrade duration, a download duration and an upgrade mode; S2, simulating user front-end operation to drive the OTA system according to the test script; S3, collecting performance indexes of the OTA system; and S4, generating a test report according to the performance indexes.

[0056] Based on the same inventive concept, the embodiment of the present application also provides an electronic device. Figure 5 A structure block diagram of an electronic device provided by the embodiment of the present application is shown in Figure 5 The embodiment of the present application provides an electronic device including one or more processors 101, a memory 102, and one or more I / O interfaces 103. The memory 102 stores one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the OTA stress testing method in any of the above embodiments; the one or more I / O interfaces 103 are connected between the processor and the memory, and are configured to realize information interaction between the processor and the memory.

[0057] The processor 101 is a device with data processing capability, including but not limited to a central processing unit (CPU) and the like; the memory 102 is a device with data storage capability, including but not limited to a random access memory (RAM, more specifically SDRAM, DDR, etc.), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), and a flash memory (FLASH); the I / O interface (read-write interface) 103 is connected between the processor 101 and the memory 102, and can realize information interaction between the processor 101 and the memory 102, including but not limited to a data bus (Bus) and the like.

[0058] In some embodiments, the processor 101, the memory 102 and the I / O interface 103 are connected to each other through a bus 104, and further connected to other components of the computing device.

[0059] In some embodiments, the one or more processors 101 include a field programmable gate array.

[0060] The embodiment of the present application also provides a computer readable medium. The computer readable medium stores a computer program, wherein the program is executed by a processor to implement the steps in the OTA stress test method in any of the above embodiments. The computer readable storage medium can be a volatile or non-volatile computer readable storage medium.

[0061] The embodiment of the present application also provides a computer program product comprising computer readable code or a non-volatile computer readable storage medium carrying computer readable code, when the computer readable code is run in a processor of an electronic device, the processor in the electronic device executes the OTA stress test method.

[0062] Those skilled in the art can understand that all or some of the steps in the method disclosed above, the functions of the modules / units in the system and the device can be implemented as software, firmware, hardware and appropriate combinations thereof. In the hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be performed by several physical components in cooperation. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software can be distributed on a computer readable storage medium, which can include computer storage media (or non-transitory media) and communication media (or transitory media).

[0063] As known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable program instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM), static random access memory (SRAM), flash memory or other memory technology, portable compact disc read only memory (CD-ROM), digital versatile disc (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is known to those skilled in the art that communication media typically includes computer readable program instructions, data structures, program modules or other data in modulated data signals such as carrier waves or other transport mechanisms, and can include any information delivery medium.

[0064] The computer readable program instructions described herein can be downloaded to respective computing / processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and / or a wireless network. The network can comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and / or edge servers. A network adapter card or network interface in each computing / processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing / processing device.

[0065] Computer readable program instructions for carrying out operations of the present application can be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions can execute entirely on the user's computing / processing device, partly on the user's computing / processing device, as a stand-alone software package, partly on the user's computing / processing device and partly on a remote computing / processing device or entirely on the remote computing / processing device or server. In the latter scenario, the remote computing / processing device can be connected to the user's computing / processing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing / processing device, for example, through the Internet using an Internet Service Provider. In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate array (FPGA), or programmable logic array (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present application.

[0066] The computer program product described herein can be embodied specifically by hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied specifically as a computer storage medium, and in another alternative embodiment, the computer program product is embodied specifically as a software product, such as a software development kit (SDK) or the like.

[0067] The computer program product described herein can be embodied specifically by hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied specifically as a computer storage medium, and in another alternative embodiment, the computer program product is embodied specifically as a software product, such as a software development kit (SDK) or the like.

[0068] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer- readable storage medium having no data storage cycles that change state. The instructions can be executed by one or more processors of a computer, other programmable data processing apparatus, or other devices to produce a computer-implemented process such that the instructions which execute via the one or more processors of the computer or other programmable data processing devices create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. The computer program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0069] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0070] The flow and block diagrams in the drawings show the architectural, functional, and operational views of possible implementations of systems, methods, and computer program products according to the present application. In this regard, each block in the flow and block diagrams can represent a module, a segment, or a portion of instructions which contain one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0071] Example embodiments have been disclosed and, although specific terms are employed, they are used in a generic and descriptive sense only and not for purposes of limitation. In some instances, it will be apparent to those skilled in the art that features, characteristics or elements described with reference to one embodiment can be used in combination with features, characteristics or elements described with reference to other embodiments unless otherwise explicitly stated. Accordingly, it will be appreciated that various adaptations and modifications of the embodiments described can be accomplished without departing from the scope of the application as defined by the appended claims.

Claims

1. An OTA stress testing system, characterized in that, include: The scenario configuration module is used to configure test parameters and test processes for generating test scripts. The test parameters include at least the number of load tests, user operation parameters, upgrade duration, download duration, and upgrade method; The simulated stress module is used to simulate user front-end operations to drive the OTA system according to the test script; The real-time monitoring module is used to collect performance metrics of the OTA system. The report generation module is used to generate a test report based on the performance indicators.

2. The system according to claim 1, wherein, The scene configuration module includes: The scenario definition unit is used to receive the test parameters and the test process through a graphical interface; the user operation parameters are configured according to the operation behavior and operation interval time, or according to the recorded real user operation; the operation behavior includes at least clicking, inputting, and scrolling; The script generation unit is used to generate test scripts based on the test parameters and the test process.

3. The system according to claim 2, wherein, The testing process includes: In response to receiving an update request from a user, the device checks for software updates. Determine if a new version has been detected; If a new version is detected, the device will be driven to perform an upgrade operation based on the upgrade duration, download duration, and upgrade method; the upgrade method includes at least immediate upgrade and upgrade after a preset time. If no new version is detected, determine whether the number of times a new version has not been detected exceeds a preset threshold. If it exceeds the preset threshold, end the update. If it does not exceed the preset threshold, record the failure and re-execute the steps to detect software updates on the device.

4. The system according to claim 1, wherein, The simulated pressure module includes: A click simulation engine is used to simulate user actions based on the test script to drive the OTA system; The stress scheduling unit is used to manage and control the concurrent execution of multiple test instances based on test resources and the number of stress tests.

5. The system according to claim 4, wherein, The simulated click engine includes: The rendering subunit is used to load and render the front-end interface of the OTA system. The parsing subunit is used to parse the DOM structure of the OTA system's front-end interface and locate operable elements; The simulation subunit is used to simulate click, input, and scrolling operations on the operable element.

6. The system according to claim 4, wherein, The pressure scheduling unit includes: The resource allocation subunit is used to distribute test instances to backend servers; The pressure mode subunit is used to control the number of concurrent test instances based on the pressure mode and the number of pressure tests; the pressure mode includes at least one of gradual pressure increase, peak pressure, or continuous pressure.

7. The system according to claim 1, wherein, The performance metrics include front-end performance metrics and back-end resource metrics; the real-time monitoring module includes: A front-end probe unit is used to collect front-end performance metrics from the simulated click engine; the front-end performance metrics include at least front-end response time, operation success rate, and page load time. The backend monitoring unit is used to collect backend resource indicators of the OTA system's backend server; the backend resource indicators include at least CPU utilization, memory utilization, and network traffic indicators. The event logging unit is used to record abnormal events and error messages generated by the front-end or back-end during the testing process.

8. An OTA stress testing method, characterized in that, Applied to the OTA stress testing system as described in any one of claims 1 to 7, comprising: Configure test parameters and test procedures to generate test scripts; the test parameters include at least the number of load tests, user operation parameters, upgrade duration, download duration, and upgrade method; Based on the test script, simulate user front-end operations to drive the OTA system; Collect performance metrics of the OTA system; A test report is generated based on the performance metrics.

9. An electronic device, characterized in that, include: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in claim 8.

10. A computer-readable medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method as described in claim 8.

Images