An application testing method, system, electronic device and storage medium

Abstract

The present application discloses an application testing method, system, electronic device and storage medium, belonging to the technical field of computer technology, and is used to achieve efficient testing of applications. The application testing method includes: configuring a flash partition for the target application and installing the target application into the flash partition; generating a structure body of a test instance according to the program code of the target application; testing the target application by executing the test instance and storing the execution result of the test instance; and returning the execution result to the test request side through an interface. The present application can provide a unified external testing solution for communication modules and can achieve application testing in complex scenarios.

Description

Technical Field

[0001] This application relates to the field of computer technology, and particularly to an application testing method, system, electronic device and storage medium. Background Art

[0002] With the rise of the Internet of Things (IOT) industry, communication modules have played an increasingly important role in all walks of life. Communication modules are easy to use and efficient for upper-layer services. More and more manufacturers have started to use communication modules to test applications. However, during the process of using communication modules for application testing, the upper-layer services need to provide the source code and third-party interfaces of the application. Different manufacturers' applications have their own authentication and encryption methods, and the application testing process is relatively cumbersome.

[0003] Therefore, how to provide a unified external testing solution for communication modules and enable application testing in complex scenarios is a technical problem that needs to be solved by those skilled in the art at present. Summary of the Invention

[0004] The purpose of this application is to provide an application testing method, an application testing system, a storage medium and an electronic device, which can provide a unified external testing solution for communication modules and enable application testing in complex scenarios.

[0005] To solve the above technical problem, this application provides an application testing method, which is applied to a communication module running a time series database. The application testing method includes:

[0006] Configure a flash partition for the target application and install the target application into the flash partition;

[0007] Generate a structure body of a test instance according to the program code of the target application;

[0008] Test the target application by executing the test instance and store the execution result of the test instance;

[0009] Return the execution result to the test request end through an interface.

[0010] Optionally, returning the execution result to the test request end through an interface includes:

[0011] Determine the query condition of the test request end;

[0012] Query the execution result corresponding to the query condition through the iterator and callback function of the time series database, and return the execution result corresponding to the query condition to the test request end.

[0013] Optionally, before testing the target application by executing the test instance, it further includes:

[0014] Appending the structure of the test instance to the main structure of the time series database; wherein, the main structure further includes the structures of other test instances;

[0015] Correspondingly, the testing the target application by executing the test instance includes:

[0016] Running the main structure of the time series database so as to test the target application by executing the test instance.

[0017] Optionally, the fields of the structure include any one or a combination of several of the incoming time, end time, status interface, and execution result.

[0018] Optionally, before testing the target application by executing the test instance, it further includes:

[0019] Storing the third-party static library of the target application in the flash partition so as to execute the test instance by using the third-party static library.

[0020] Optionally, testing the target application by executing the test instance includes:

[0021] Performing a preset test on the target application by executing the test instance; wherein, the preset test includes any one or a combination of several of scenario test, stress test, and function test.

[0022] Optionally, configuring the flash partition for the target application includes:

[0023] Generating an index partition table corresponding to the target application; wherein, the index partition table includes partition name, flash device name, offset address, partition size, and partition description;

[0024] Configuring the flash partition for the target application according to the index partition table.

[0025] This application further provides an application test system, which is applied to a communication module running a time series database. The application test system includes:

[0026] A partition configuration module, configured to configure a flash partition for a target application and install the target application into the flash partition;

[0027] A structure generation module, configured to generate a structure of a test instance according to the program code of the target application;

[0028] A test module for testing the target application by executing the test instance and storing the execution result of the test instance;

[0029] A result return module for returning the execution result to the test request side through an interface.

[0030] The present application also provides a storage medium, on which a computer program is stored, and when the computer program is executed, the steps executed by the above application test method are implemented.

[0031] The present application also provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, the steps executed by the above application test method are implemented.

[0032] The present application provides an application test method, which is applied to a communication module running a time-series database. The application test method includes: configuring a flash partition for the target application and installing the target application into the flash partition; generating a structure body of a test instance according to the program code of the target application; testing the target application by executing the test instance and storing the execution result of the test instance; returning the execution result to the test request side through an interface.

[0033] A time-series database runs in the communication module of the present application. A flash partition is configured for the target application in the communication module, and then the target application is installed in the flash partition to implement the function of the target application. The present application generates a structure body of a test instance according to the program code of the target application, and realizes the test of the target application by executing the test instance. The present application returns the execution result of the test instance to the test request side to complete the test process. The present application can integrate complex scenarios of multiple scenarios, multiple application points, and multi-functional composite applications, provide a unified external test solution for the communication module, and can implement application testing in complex scenarios. The present application also provides an application test system, an electronic device, and a storage medium at the same time, which have the above beneficial effects and will not be elaborated here. Description of the Drawings

[0034] In order to more clearly illustrate the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0035] Figure 1 A flowchart of an application test method provided by an embodiment of the present application;

[0036] Figure 2It is a schematic diagram of a conventional application test using a communication module;

[0037] Figure 3 It is a schematic diagram of a test architecture provided by an embodiment of the present application;

[0038] Figure 4 It is a flowchart of a method for implementing an application test using a lightweight embedded time series database provided by an embodiment of the present application;

[0039] Figure 5 It is a schematic diagram of the actual scenario interaction relationship of the application test provided by an embodiment of the present application;

[0040] Figure 6 It is a schematic diagram of the structure of an application test system provided by an embodiment of the present application. Detailed implementation manners

[0041] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Apparently, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0042] Please refer to the following Figure 1 , Figure 1 It is a flowchart of an application test method provided by an embodiment of the present application.

[0043] The specific steps may include:

[0044] S101: Configure a flash partition for the target application and install the target application into the flash partition;

[0045] Among them, this embodiment can be applied to a communication module running a time series database. Before this step, a test instruction sent by a test request end may exist, and by parsing the test instruction, the target application to be tested and the test type can be determined. The above test type may include any one or a combination of several of function test, scenario test, and stress test.

[0046] After determining the target application to be tested, this embodiment can configure a corresponding flash partition for the target application in the flash memory of the communication module, and then install the target application into the flash partition to implement the function of the target application in the flash partition.

[0047] S102: Generate a structure body of a test instance according to the program code of the target application;

[0048] After the target application is installed in the flash partition, the program code of the target application can be obtained, and a structure of a test instance can be generated in the flash partition. The above test instance refers to the test instance of the target application, and the test instance can be generated according to the program code and test type of the target application. For example, a test instance for performing a stress test on the target application, a test instance for performing a function test on the target application, etc. can be generated.

[0049] S103: Test the target application by executing the test instance, and store the execution result of the test instance;

[0050] Among them, in this embodiment, the above structure can be run in the flash partition to execute the test instance, so as to complete the test of the target application. This embodiment can also store the execution result of the test instance in the flash partition. As a feasible implementation manner, before testing the target application by executing the test instance, this embodiment can also store the third-party static library of the target application in the flash partition, so as to execute the test instance by using the third-party static library.

[0051] Specifically, this step can test the target application in the following manner: perform a preset test on the target application by executing the test instance; among them, the preset test includes any one or a combination of scenario test, stress test, and function test.

[0052] S104: Return the execution result to the test request end through an interface.

[0053] Among them, the communication module can also generate a corresponding interface for the test request end, and return the execution result to the test request end through the interface. As a feasible implementation manner, this embodiment can first determine the query condition of the test request end; query the execution result corresponding to the query condition through the iterator and callback function of the time series database, and return the execution result corresponding to the query condition to the test request end. The above query condition can be a time-based query condition or a result-based query condition.

[0054] In the communication module of this embodiment, a time-series database is running. A flash partition is configured for the target application in the communication module, and then the target application is installed in the flash partition to implement the functions of the target application. In this embodiment, a structure body of a test instance is generated according to the program code of the target application, and the target application is tested by executing the test instance. In this embodiment, the execution result of the test instance is returned to the test request side to complete the test process. This embodiment can integrate complex scenarios of multi-scenarios, multi-application points, and multi-functional composite applications, provide a unified external test solution for the communication module, and can implement application testing in complex scenarios.

[0055] As for Figure 1 As a further description of the corresponding embodiment, there may be a main structure body in the time-series database. The main structure body includes structure bodies of test instances of multiple applications to be tested. For example, the main structure body also includes structure bodies of other test instances. Before executing the test instance, this embodiment may append the structure body of the test instance to the main structure body of the time-series database. Further, this embodiment may run the main structure body of the time-series database so as to test the target application by executing the test instance. When running the main structure body, each structure body may be executed in sequence according to the execution order of the structure bodies so as to test multiple applications.

[0056] Specifically, the fields of the above structure body include any one or a combination of incoming time, end time, status interface, and execution result. An example of the structure body of the time-series database FiboTSD is as follows:

[0057]

[0058] As for Figure 1 As a further introduction to the corresponding embodiment, this embodiment may configure the flash partition for the target application in the following manner: generate an index partition table corresponding to the target application; wherein, the index partition table includes partition name, flash device name, offset address, partition size, and partition description; configure the flash partition for the target application according to the index partition table. Please refer to Table 1:

[0059] Table 1 Index Partition Table

[0060] Partition Name Flash Device Name Offset Address Partition Size Partition Description APP "8910_chip” 0 64KB OPEN Program OTA Norflash0 64*1024 1MB OTA Download Area Application Norflash0 8*1024 400K Third-Party Application Area

[0061] The names of the above index partition tables cannot be repeated, and the partition size and start address cannot exceed the flash device range; the index partition table is divided by partition information of corresponding functions, and can be user-defined configured in a multi-instance scenario.

[0062] The following uses an embodiment in actual application to illustrate the process described in the above embodiment.

[0063] See also Figure 2 , Figure 2 This is a schematic diagram of conventional application testing using a communication module. Figure 2 Application means application, Third LIB means third-party static library, OEM code means original equipment manufacturer's code, AT means AT command, API means interface, and Protocol means protocol layer. Figure 2 As shown, the communication module equipment involves upper-layer functional services. In the multi-party cooperation mode, the operations of each party are relatively invisible, which greatly increases the R&D cycle time and labor costs. The communication module side provides basic communication functions and underlying protocols, and provides external debugging interfaces. Finally, the upper layer confirms that some platform adaptation services or functional services are complete and correct, and then achieves unified delivery. In the above scheme, the communication module side assumes more functions. The upper-layer application manufacturer will provide a third-party static library or business code logic to the communication module vendor and require adaptation for different platforms such as RTOS, Linux, OpenWRT, etc. to ensure that the system-related interfaces used by the upper layer, protocol-related and other application-related interfaces are normal. The upper-layer application vendor can provide a third-party library, or business process source code and third-party interface, but the authentication, encryption verification and other operations of the application are not visible to the communication module. The communication module provides the task pull-up of the business process, or the adaptation implementation process, which is invisible to the upper-layer application vendor.

[0064] It can be seen that the above-mentioned existing solutions for application testing using communication modules have at least the following defects: (1) Invisible black box business testing. Different customer applications have their own authentication and encryption business processing methods. The same business usage scenarios are also highly targeted, and there are risks in functional assurance; (2) Under the multi-party cooperation model, the efficiency of adaptation and joint debugging is low, which is a great challenge to human resources, business resources and time cycle; (3) Subsequent business maintenance is difficult. There are risks in solving problems, upgrading and maintaining scenarios that are not involved.

[0065] In order to solve the defects existing in the above-mentioned related technologies, the present application provides an efficient application testing solution based on a lightweight embedded time series database, which can solve the invisible business function testing, save labor costs and development cycle, and solve the problem of difficulty in subsequent upgrades and maintenance.

[0066] See also Figure 3 , Figure 3It is a schematic diagram of a test architecture provided by an embodiment of the present application. In the figure, AT represents AT commands, OPENCPU represents an application mode with a module as the main processor, Protocol is the protocol layer, FiboTSD represents a lightweight series embedded time series database, TSL (Test Script Language) is a test script language, FiboTSD iterator represents an iterator of the embedded time series database, Statistical represents statistics, Database manage represents database management, SIM Driver represents a subscriber identity module driver, SD Driver represents a secure digital card driver, GPIO Driver represents a general-purpose input / output driver, USB Driver represents a universal serial bus driver, UART Driver represents a universal asynchronous receiver / transmitter driver, Keypad Driver represents a keypad driver, SPI Driver represents a serial peripheral interface driver, and HardWare represents hardware. Based on the architecture of the open FlashDB, the FiboTSD solution optimizes and modifies the problems existing in the characteristics of existing multi-party cooperation solutions, which can effectively avoid existing problems and defects during actual use, maximize the practicability and ease of use of the communication module, and provide the possibility for the underlying module to play a greater role in the Internet of Things platform.

[0067] Figure 3 The role and function of the lightweight series embedded time series database in the current communication module are shown. The original function of the lightweight series embedded time series database is to provide an embedded software product data storage solution. Different from the traditional file system database, based on FlashDB, the lightweight series embedded time series database inherits the original strong performance, has the characteristics of multiple partitions and multiple instances, and almost zero memory occupancy. The lightweight series embedded time series database can provide an entry for a multi-party unified development environment and extended applications such as efficient self-checking and debugging.

[0068] Please refer to Figure 4 , Figure 4 It is a flowchart of a method for implementing application testing using a lightweight series embedded time series database provided by an embodiment of the present application. Figure 4In FiboTSD, Init represents database initialization, Append represents appending, Regist represents registration. The test unit metadata is used to store the code of the application to be tested. FiboTSD Iterator represents an iterator, and FiboTSD_read represents reading the execution result. Node1 - 4 represent the nodes storing the execution results of test instances. Database manage represents database management, Spi flash represents serial flash, Open API represents Open Application Programming Interface, and PLATFORM represents the platform. The registration and appending process of the test unit metadata can be as follows: modify the value of the structure object status and append it to the lightweight embedded time - series database. During the process of querying the execution result, the iterator API (iterator) can be used to traverse and search all API execution records and output them through callbacks. In the structure fdb_tsl_t, the input time, end time, status interface, execution result, etc. are defined respectively, and the final execution result is obtained through the Fibotsd_read instruction.

[0069] From the above discussion, it can be seen that in the actual multi - party cooperation scheme, when developers use the communication module, after initializing their own application APIs and business logics, they can synchronously append their own test interfaces or business codes, perform function self - testing or stress testing through FiboTSD and synchronously record the test - related information and execution results. As a reference, a sample description can also be provided in the communication module so that users can understand the application test process according to the sample description. Please refer to Figure 5 , Figure 5 FIG. is a schematic diagram of the actual scenario - effect relationship of the application test provided by the embodiment of the present application. Users can test third - party applications through the time - series database in the communication module. TEST UNIT is the test unit that implements the application test in the communication module, and Sample is the sample description.

[0070] The above - mentioned scheme integrates complex scenarios of multi - scenarios, multi - application points, and multi - function composite applications. For the underlying communication module, it is a unified external scheme, which can better adapt to the Internet of Things ecosystem and provide a perfect landing platform for the access of more applications. This scheme can provide efficient self - testing and development processes such as distributed storage of test units and application scenario units, metadata points, real - time query, historical data query and statistics, and sample mechanism. This scheme can better compress the project cycle and the "black - box scenario" under multi - party cooperation. The multi - platform compatibility of the execution results in this scheme can better expand the module ecosystem and add more possibilities for upper - layer applications.

[0071] The following provides an OTA (differential upgrade) application test example in the OPEN mode of the communication module. The test process is as follows:

[0072] Step 1: Configure the flash partition table to allocate flash partitions for OTA applications.

[0073]

[0074] Step 2: Supplement the fibo_ota main application program to the open mode solution; the above application program can be the OTA application of the communication module itself or the OTA service process code of the upper MCU.

[0075] Step 3: Initialize and configure the single test instance structure body, and register and append the modified structure body to the main structure body of fibotsd twice through the interface fibotsd_tsl_append.

[0076] fibotsd_tsl_append(fibotsdb,fibotsd_make(&blob,&status,sizeof(status)));

[0077] Step 4: Power on the device to execute the ota instance. FiboTSD will automatically count the results to the callback function through the iterator after each execution, realizing real-time query of the current record, which can be divided into result query and time query. Statistics in other cases can be configured independently.

[0078]

[0079] This embodiment is implemented based on the FiboTSD time series database mechanism. Relying on the characteristics of the communication module itself, it integrates complex integrated environments such as multiple applications, multiple scenarios, and multiple instances to achieve unified control of the underlying module, which can achieve the effect of efficient self-checking development, reduce the multi-point interaction process in the actual process, and improve the user's secondary development experience.

[0080] Please refer to Figure 6 , Figure 6 which is a schematic structural diagram of an application test system provided by an embodiment of the present application. The system is applied to a communication module running a time series database. The application test system includes:

[0081] A partition configuration module 601, configured to configure a flash partition for a target application and install the target application to the flash partition;

[0082] A structure generation module 602, configured to generate a structure body of a test instance according to the program code of the target application;

[0083] A test module 603, configured to test the target application by executing the test instance and store the execution result of the test instance;

[0084] A result return module 604 for returning the execution result to the test request side through an interface.

[0085] In the communication module of this embodiment, a time series database is running. A flash partition is configured for the target application in the communication module, and then the target application is installed in the flash partition to implement the functions of the target application. In this embodiment, a structure body of a test instance is generated according to the program code of the target application, and the target application is tested by executing the test instance. In this embodiment, the execution result of the test instance is returned to the test request side to complete the test process. This embodiment can integrate complex scenarios of multiple scenarios, multiple application points, and multi-functional composite applications, and provide a unified external test solution for the communication module, and can implement application testing in complex scenarios.

[0086] Furthermore, the result return module 604 is used to determine the query conditions of the test request side; and is also used to query the execution result corresponding to the query conditions through the iterator and callback function of the time series database, and return the execution result corresponding to the query conditions to the test request side.

[0087] Furthermore, it further includes:

[0088] An append module for appending the structure body of the test instance to the main structure body of the time series database before testing the target application by executing the test instance; wherein, the main structure body further includes the structure bodies of other test instances;

[0089] Correspondingly, the test module 603 is used to run the main structure body of the time series database so as to test the target application by executing the test instance.

[0090] Furthermore, the fields of the structure body include any one or a combination of any several of the incoming time, end time, status interface, and execution result.

[0091] Furthermore, it further includes:

[0092] A static library storage module for storing the third-party static library of the target application in the flash partition before testing the target application by executing the test instance, so as to execute the test instance by using the third-party static library.

[0093] Furthermore, the test module 603 is used to perform a preset test on the target application by executing the test instance; wherein, the preset test includes any one or a combination of any several of scenario test, stress test, and function test.

[0094] Further, the partition configuration module 601 is configured to generate an index partition table corresponding to the target application; wherein, the index partition table includes a partition name, a flash device name, an offset address, a partition size, and a partition description; and is further configured to configure the flash partition for the target application according to the index partition table.

[0095] Since the embodiments in the system part correspond to the embodiments in the method part, for the descriptions of the embodiments in the system part, please refer to the descriptions of the embodiments in the method part, which will not be elaborated here temporarily.

[0096] The present application also provides a storage medium, on which a computer program is stored, and when the computer program is executed, the steps provided in the above embodiments can be implemented. The storage medium may include: various media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disc that can store program codes.

[0097] The present application also provides an electronic device, which may include a memory and a processor. When the processor calls the computer program stored in the memory, the steps provided in the above embodiments can be implemented. Of course, the electronic device may further include various network interfaces, power supplies, and other components.

[0098] The embodiments in the specification are described in a progressive manner. Each embodiment focuses on the differences from other embodiments. The same or similar parts among the embodiments can be referred to each other. For the system disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the description in the method part. It should be noted that for those of ordinary skill in the art in the technical field of the present application, without departing from the principle of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the protection scope of the claims of the present application.

[0099] It should also be noted that in this specification, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or device comprising said element.

Claims

1. An application testing method, characterized in that, Applied to a communication module running a time-series database, the application testing method includes: Configure a flash partition for the target application and install the target application into the flash partition; Generate a structure body of a test instance according to the program code of the target application; Test the target application by executing the test instance and store the execution result of the test instance; Return the execution result to the test request end through an interface; Wherein, before testing the target application by executing the test instance, it further includes: Append the structure body of the test instance to the main structure body of the time-series database; wherein, the main structure body further includes structure bodies of other test instances; Correspondingly, the testing the target application by executing the test instance includes: Run the main structure body of the time-series database so as to test the target application by executing the test instance.

2. The application test method according to claim 1, wherein The returning the execution result to the test request end through an interface includes: Determine the query condition of the test request end; Query the execution result corresponding to the query condition through the iterator and callback function of the time-series database and return the execution result corresponding to the query condition to the test request end.

3. The application testing method according to claim 1, wherein, The fields of the structure body include any one or a combination of several of the incoming time, end time, status interface, and execution result.

4. The application testing method according to claim 1, wherein Before testing the target application by executing the test instance, it further includes: Store the third-party static library of the target application into the flash partition so as to execute the test instance by using the third-party static library.

5. The application testing method according to claim 1, wherein The testing the target application by executing the test instance includes: Perform a preset test on the target application by executing the test instance; wherein, the preset test includes any one or a combination of several of scenario test, stress test, and function test.

6. The application test method according to claim 1, wherein, The configuring a flash partition for the target application includes: Generate an index partition table corresponding to the target application; wherein, the index partition table includes partition name, flash device name, offset address, partition size, and partition description; Configure the flash partition for the target application according to the index partition table.

7. An application testing system, characterized in that, Applied to a communication module running a time-series database, the application testing system includes: A partition configuration module, configured to configure a flash partition for a target application and install the target application into the flash partition; A structure body generation module, configured to generate a structure body of a test instance according to the program code of the target application; A testing module, configured to test the target application by executing the test instance and store the execution result of the test instance; A result returning module, configured to return the execution result to the test request end through an interface; An appending module, configured to append the structure body of the test instance to the main structure body of the time-series database before testing the target application by executing the test instance; wherein, the main structure body further includes structure bodies of other test instances; Correspondingly, the process of the test module testing the target application by executing the test instance includes: running the main structure of the time series database so as to test the target application by executing the test instance.

8. An electronic device, characterized in that, It includes a memory and a processor. When the computer program is stored in the memory and the processor calls the computer program in the memory, the steps of the application test method according to any one of claims 1 to 6 are implemented.

9. A storage medium, characterized in that, Computer-executable instructions are stored in the storage medium. When the computer-executable instructions are loaded and executed by a processor, the steps of the application test method according to any one of claims 1 to 6 are implemented.

Images