System testing method, device, electronic equipment and storage medium

Abstract

The present invention discloses a system testing method, device, electronic device and storage medium. It includes: obtaining test configuration information, wherein the test configuration information includes one or more of motion behavior pattern and test area type; determining simulation trajectory parameter information based on the motion behavior pattern and / or test area type, and generating multiple simulation trajectory data based on the simulation trajectory parameter information; for each simulation trajectory data, performing a test process on the simulation trajectory data by the system to be tested, and obtaining a test result corresponding to the simulation trajectory data; for each test result corresponding to the simulation trajectory data, determining the test evaluation index data corresponding to the test result, and determining the test evaluation result of the system to be tested based on the test evaluation index data of each test result. This scheme is used to test the system to be tested by determining a plurality of simulation trajectory data corresponding to the motion behavior pattern and / or test area type, thereby improving the accuracy and efficiency of system testing.

Description

Technical Field

[0001] The present invention relates to the field of automatic testing technology, and in particular to a system testing method, device, electronic equipment and storage medium. Background Art

[0002] In the chemical industry, personnel positioning technology is crucial to ensure safe production, improve emergency response capabilities and optimize on-site management. Personnel positioning technologies widely used in the chemical industry include GPS, wireless radio frequency identification technology (RFID), Bluetooth low energy (BLE), ultra-wideband (UWB) technology, Wi-Fi positioning, and more are based on multiple positioning technologies (GPS, UWB, Wi-Fi, etc.). At present, the test verification stage is often based on the above actual equipment, and the personnel trajectory data is verified through physical equipment and host computer communication. However, due to the dual limitations of hardware equipment and actual personnel trajectory data samples, the host computer system's sample requirements for test data cannot be met, resulting in the inability to guarantee the correctness of the system test results and low system test efficiency. Summary of the invention

[0003] The present invention provides a system testing method, device, electronic equipment and storage medium to solve the problem that a variety of trajectory data cannot be obtained for testing the system and the problem that the system testing result is inaccurate.

[0004] According to one aspect of the present invention, there is provided a system testing method, comprising:

[0005] Acquire test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type;

[0006] Determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generate a plurality of simulation trajectory data based on the simulation trajectory parameter information;

[0007] For each simulated trajectory data, the system to be tested performs a test process on the simulated trajectory data to obtain a test result corresponding to the simulated trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning analysis on the simulated trajectory data;

[0008] For each test result corresponding to the simulation trajectory data, the test evaluation index data corresponding to the test result is determined, and the test evaluation result of the system to be tested is determined based on the test evaluation index data of each test result.

[0009] Optionally, the motion behavior pattern includes one or more of a walking mode, a cycling mode and a driving mode; the test area type includes one or more of an outdoor area type and an indoor area type; the simulation trajectory parameter information is determined based on the motion behavior pattern and / or the test area type, including: obtaining a mapping relationship between the motion behavior pattern and one or more of the test area types and the simulation trajectory parameter information respectively; and determining the simulation trajectory parameter information based on the motion behavior pattern and / or the test area type and the corresponding mapping relationship.

[0010] Optionally, the simulation trajectory parameter information is determined based on the motion behavior pattern and / or the test area type and the corresponding mapping relationship, including one or more of the following: determining the simulation trajectory parameter information that matches the motion behavior pattern from the mapping relationship based on the motion behavior pattern; determining the simulation trajectory parameter information that matches the test area type from the mapping relationship based on the test area type; obtaining multiple test scenarios by combining the motion behavior pattern and the test area type, and determining the simulation trajectory parameter information that matches the test scenario from the mapping relationship based on the motion behavior pattern and the test area type corresponding to each test scenario.

[0011] Optionally, the simulation trajectory parameter information includes starting point position information, at least one moving direction, a moving speed and an interval time; multiple simulation trajectory data are generated based on the simulation trajectory parameter information, including: taking the starting point position information as the starting point, determining multiple trajectory point data in each moving direction based on at least one moving direction, a moving speed and an interval time; and forming simulation trajectory data in the corresponding moving direction based on the multiple trajectory point data in each moving direction.

[0012] Optionally, after forming simulated trajectory data in the corresponding moving direction based on multiple trajectory point data in each moving direction, it also includes: for the simulated trajectory data in each moving direction, verifying the trajectory point data in the simulated trajectory data in the moving direction based on the target area map data, and determining the trajectory point data that does not meet the preset verification conditions; adjusting the trajectory point data that does not meet the preset verification conditions, and updating the corresponding simulated trajectory data based on the adjusted trajectory point data; and / or determining trajectory curvature data corresponding to each trajectory point in the simulated trajectory data, determining the trajectory points that do not meet the preset trajectory curvature threshold based on the trajectory curvature data corresponding to each trajectory point and the preset trajectory curvature threshold; adjusting the trajectory point data of the trajectory points that do not meet the preset trajectory curvature threshold, and updating the corresponding simulated trajectory data based on the adjusted trajectory point data.

[0013] Optionally, the test evaluation index data includes one or more of the trajectory point loss rate and the trajectory point position accuracy data; for each test result corresponding to the simulated trajectory data, the test evaluation index data corresponding to the test result is determined, including: for each test result corresponding to the simulated trajectory data, determining the first trajectory point number of the simulated trajectory data, and determining the second trajectory point number of the test result corresponding to the simulated trajectory data, and determining the trajectory point loss rate of the test result corresponding to the simulated trajectory data based on the first trajectory point number and the second trajectory point number; and / or, for each test result corresponding to the simulated trajectory data, matching the simulated trajectory data with the test result corresponding to the simulated trajectory data according to the timestamp information, and calculating the position deviation data between the trajectory points corresponding to the same timestamp information, obtaining the position deviation data corresponding to each timestamp information, and determining the trajectory point position accuracy data of the test result corresponding to the simulated trajectory data based on the position deviation data.

[0014] Optionally, the test evaluation results of the system to be tested are determined based on the test evaluation indicator data of each test result, including: for each test result, weighting the trajectory point loss rate and / or trajectory point position accuracy data in the test evaluation indicator data of the test result based on preset weight data to obtain a comprehensive test evaluation result of the test result; and determining the test evaluation results of the system to be tested based on the comprehensive test evaluation results of each test result.

[0015] According to another aspect of the present invention, there is provided a system testing device, comprising:

[0016] A test configuration information acquisition module, used to acquire test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type;

[0017] A simulation trajectory data determination module, used to determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generate a plurality of simulation trajectory data based on the simulation trajectory parameter information;

[0018] A test result determination module is used to, for each simulated trajectory data, execute a test process on the simulated trajectory data through the system to be tested, and obtain a test result corresponding to the simulated trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning analysis on the simulated trajectory data;

[0019] The test evaluation result determination module is used to determine the test evaluation index data corresponding to each test result corresponding to the simulation trajectory data, and determine the test evaluation result of the system to be tested based on the test evaluation index data of each test result.

[0020] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0021] at least one processor; and

[0022] a memory communicatively connected to at least one processor; wherein,

[0023] The memory stores a computer program that can be executed by at least one processor. The computer program is executed by at least one processor so that the at least one processor can execute the system testing method of any embodiment of the present invention.

[0024] According to another aspect of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the system testing method of any embodiment of the present invention when executed.

[0025] The technical solution of the embodiment of the present invention is to obtain test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type; determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generate multiple simulation trajectory data based on the simulation trajectory parameter information; for each simulation trajectory data, perform a test process on the simulation trajectory data by the system to be tested to obtain a test result corresponding to the simulation trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning and analysis on the simulation trajectory data; for each test result corresponding to the simulation trajectory data, determine test evaluation index data corresponding to the test result, and determine the test evaluation result of the system to be tested based on the test evaluation index data of each test result. This solution determines the corresponding simulation trajectory parameter data by setting different dynamic behavior patterns and / or test area types in the test configuration information to obtain multiple types of simulation trajectory data, and then tests the system to be tested according to the multiple simulation trajectory data, and determines the test evaluation results of the system to be tested according to the test results corresponding to the multiple simulation trajectory data, solves the problem that the sample requirements of the system to be tested for the test data cannot be met, thereby resulting in the inability to guarantee the correctness of the system test results, improves the diversity of test data, can provide diverse and comprehensive test data for the system to be tested, and determines the test evaluation results of the system to be tested according to the multiple trajectory data, thereby improving the accuracy of system testing of the system to be tested.

[0026] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0028] Figure 1 is a flow chart of a system testing method provided by Embodiment 1 of the present invention;

[0029] Figure 2 is a flow chart of a system testing method provided by Embodiment 2 of the present invention;

[0030] Figure 3 is a structural schematic diagram of a system testing device provided in Embodiment 3 of the present invention;

[0031] Figure 4 It is a structural schematic diagram of an electronic device for implementing the system testing method of an embodiment of the present invention. DETAILED DESCRIPTION

[0032] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0033] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0034] Embodiment 1

[0035] Figure 1This is a flow chart of a system testing method provided by the first embodiment of the present invention. This embodiment is applicable to the case of testing a system. The method can be executed by a system testing device. The system testing device can be implemented in the form of hardware and / or software. The system testing device can be configured in electronic devices such as computers and servers. Figure 1 As shown, the method includes:

[0036] S110: Acquire test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type.

[0037] Among them, the test configuration information can be specifically understood as parameter information set for system testing. In the present embodiment, the test configuration information specifically represents information set for determining the simulation trajectory data required for the system test. The test configuration information includes but is not limited to motion behavior patterns and test area types. Among them, the motion behavior patterns specifically represent the movement mode of the mobile target, including but not limited to walking mode, riding mode and driving mode. For example, the mobile target can be regarded as a staff member or movable device in a chemical plant area; the test area type represents the type of drivable area, including but not limited to indoor area type and outdoor area type. It should be noted that the indoor area type and outdoor area type can be more finely classified according to the actual scenario. For example, the outdoor area type can also be subdivided into area types that include tank buildings and area types that do not include tank buildings. By performing cluster analysis on historical positioning data, regional type clustering results can be obtained, and regional types and motion behavior patterns corresponding to the historical positioning data can be determined based on the regional type clustering results. The regional types and motion behavior patterns obtained by analysis can then be stored in a target storage space pre-set for the test configuration information. The regional types and motion behavior patterns obtained by analysis can also be adjusted according to actual test requirements to obtain richer motion behavior patterns and test regional types that meet actual test scenarios, which helps to generate richer trajectory point data to improve the accuracy and applicability of system testing.

[0038] Specifically, when a system test instruction is received, or when it is detected that the system to be tested needs to be tested, test configuration information is obtained from the target storage space. The test configuration information includes but is not limited to the motion behavior pattern and the test area type.

[0039] S120 , determining simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generating a plurality of simulation trajectory data based on the simulation trajectory parameter information.

[0040] It is understandable that the speed of the moving target in different motion behavior modes is different, so the generated trajectory point data is also different. The drivable road sections and obstacle positions in the areas corresponding to different test area types are different, which will also affect the generated trajectory point data. Therefore, the corresponding simulation trajectory parameter information can be set in advance for one or more of the motion behavior modes and test area types, respectively, to generate a variety of simulation trajectory data that conforms to the actual scene. The simulation trajectory parameter information can be specifically understood as the parameter information required to generate the simulation trajectory data, including but not limited to the starting point position information, moving direction, moving speed and interval time.

[0041] Specifically, when the test configuration information is obtained, the corresponding simulation trajectory parameter information is matched according to one or more of the motion behavior patterns and test area types in the test configuration information, and then a preset trajectory generation algorithm is called, a large amount of trajectory point data is generated according to the trajectory generation algorithm and the simulation trajectory parameter information, and the generated trajectory point data are connected to obtain multiple simulation trajectory data.

[0042] In this embodiment, by matching the motion behavior pattern in the test configuration information with one or more items of the test area type with the corresponding simulation trajectory parameter information, and then generating simulation trajectory data corresponding to each simulation trajectory parameter information, a method for generating a variety of simulation trajectory data is implemented, thereby providing a large number of test samples for system testing to meet the system's sample requirements for test data, which helps to improve the accuracy and applicability of system testing.

[0043] Optionally, the motion behavior pattern includes one or more of a walking mode, a cycling mode and a driving mode; the test area type includes one or more of an outdoor area type and an indoor area type; the simulation trajectory parameter information is determined based on the motion behavior pattern and / or the test area type, including: obtaining a mapping relationship between the motion behavior pattern and one or more of the test area types and the simulation trajectory parameter information respectively; and determining the simulation trajectory parameter information based on the motion behavior pattern and / or the test area type and the corresponding mapping relationship.

[0044] Specifically, the mapping relationship between the motion behavior pattern and one or more of the test area types and the simulation trajectory parameter information is obtained from the target storage space, and specifically matched in the preset storage space according to one or more of the walking mode, riding mode and driving mode to obtain the mapping relationship of the corresponding mode, or matched in the preset storage space according to one or more of the outdoor area type and the indoor area type to obtain the mapping relationship of the corresponding area type; exemplarily, if the test configuration information only includes the motion behavior pattern, then only the mapping relationship corresponding to each mode in the motion behavior pattern can be obtained. After obtaining the mapping relationship, one or more of the motion behavior pattern and the test area type are matched with the corresponding mapping relationship to obtain the corresponding simulation trajectory parameter information.

[0045] Optionally, the simulation trajectory parameter information is determined based on the motion behavior pattern and / or the test area type and the corresponding mapping relationship, including one or more of the following: determining the simulation trajectory parameter information that matches the motion behavior pattern from the mapping relationship based on the motion behavior pattern; determining the simulation trajectory parameter information that matches the test area type from the mapping relationship based on the test area type; obtaining multiple test scenarios by combining the motion behavior pattern and the test area type, and determining the simulation trajectory parameter information that matches the test scenario from the mapping relationship based on the motion behavior pattern and the test area type corresponding to each test scenario.

[0046] Specifically, if the test configuration information only includes the motion behavior pattern, then only the mapping relationship corresponding to each mode in the motion behavior pattern can be obtained, and then the mapping relationship is matched according to each mode in the motion behavior pattern, and the simulation trajectory parameter information corresponding to each mode is obtained respectively. If the test configuration information only includes the test area type, then only the mapping relationship corresponding to each area type in the test area type can be obtained, and then the mapping relationship is matched according to each area type in the test area type, and the simulation trajectory parameter information corresponding to each area type is obtained respectively. If the test configuration information includes the motion behavior pattern and the test area type, any mode in the motion behavior pattern and any test area in the test area type are combined to obtain a test scene that meets the combination condition, and the motion behavior pattern and the test area type corresponding to each test scene are matched from the mapping relationship to obtain the simulation trajectory parameter information matched with each test scene, wherein the combination condition specifically represents a combination list of any mode in the motion behavior pattern and any test area in the test area type, exemplarily, a combination of a walking mode and an indoor area type, a combination of a walking mode and an outdoor area type, and a driving mode and an outdoor area type.

[0047] S130 , for each piece of simulated trajectory data, executing a test process on the simulated trajectory data by the system to be tested, and obtaining a test result corresponding to the simulated trajectory data.

[0048] The system to be tested can be specifically understood as a system that performs a test process according to the simulated trajectory data, and can be, for example, a positioning software system or a positioning data analysis system. The test result includes positioning data obtained after the system to be tested performs positioning and analysis processing on the simulated trajectory data, and for example, the test result includes trajectory point location information and time information.

[0049] Specifically, when a plurality of simulation trajectory data are generated, the plurality of simulation trajectory data are used as test samples of the system to be tested, and the system to be tested executes a test process according to the simulation trajectory data. After the test process is completed, the system to be tested outputs the test results of each simulation trajectory data.

[0050] In a specific embodiment, each generated simulation trajectory data can be packaged, specifically according to the protocol format that can be received by the system to be tested, to obtain a data packet corresponding to each simulation trajectory data. During the data packaging process, the data packet can be encoded, compressed, and encrypted to reduce the size of the data packet, thereby improving the efficiency of data packet transmission and the security of the data. Verification information can also be added to the data packet to improve data security and provide a basis for data recovery. When the data packet is transmitted, the data packet can be converted into a byte stream form so that it can be transmitted between different hardware devices and systems. Among them, the data receiving end can be the system to be tested. After receiving the data packet corresponding to the simulation trajectory data, the system to be tested performs a test process on the data packet to obtain the test results corresponding to each data packet.

[0051] S140 . Determine test evaluation index data corresponding to each test result corresponding to each simulation trajectory data, and determine a test evaluation result of the system to be tested based on the test evaluation index data of each test result.

[0052] Among them, the test evaluation index data can be specifically understood as the index data used to evaluate the test results, used to characterize the difference between the test results and the corresponding simulation trajectory data, and the test evaluation index data include but are not limited to the trajectory point loss rate and the trajectory point position accuracy data. The trajectory point loss rate characterizes the trajectory point loss of the test result relative to the simulation trajectory data, and the trajectory point position accuracy data characterizes the position deviation between each position information in the test result and the position information of the trajectory point in the simulation trajectory data. The test evaluation result can be specifically understood as the evaluation result characterizing the system to be tested, and the test evaluation result of the system to be tested is determined specifically according to the test evaluation index data of the test results corresponding to each simulation trajectory data. The test evaluation result of the system to be tested can be determined by statistically analyzing the test evaluation index data of the test results corresponding to the simulation trajectory data. Exemplarily, the test evaluation result of the system to be tested can be determined by weighting the test evaluation index data of the test results corresponding to the simulation trajectory data. According to the obtained weighted processing result, it should be noted that the corresponding weight data is set for different test evaluation indicators according to the importance of different test evaluation index data, which is not limited here.

[0053] Specifically, the test results corresponding to each simulated trajectory data are evaluated, and the test results corresponding to each simulated trajectory data are compared with the simulated trajectory data to determine the trajectory point loss rate and trajectory point position accuracy data of the test results corresponding to each simulated trajectory data, and then the test evaluation index data of each test result are weighted to obtain the weighted processing result of each test result, and the test evaluation result of the system to be tested is determined according to the weighted processing result of each test result. Exemplarily, the corresponding average value can be determined based on the weighted processing result of each test result, and it is judged whether the average value meets the preset mean threshold. If the average value meets the preset mean threshold, it is determined that the test evaluation result of the system to be tested is that the system to be tested meets the test standard, which indicates that the system to be tested meets the requirements for accuracy and completeness; if the average value does not meet the preset mean threshold, it is determined that the test evaluation result of the system to be tested is that the system to be tested does not meet the test standard, which indicates that the system to be tested does not meet the requirements for accuracy and completeness.

[0054] In this embodiment, by determining the test evaluation index data corresponding to the test results of each simulation trajectory data, and then determining the test evaluation results of the system to be tested according to the test evaluation index data of each test result, it is possible to analyze the test results from multiple dimensions, determine a variety of test evaluation index data, and then judge the system to be tested based on the multiple test evaluation index data, thereby improving the accuracy of the test of the system to be tested.

[0055] Optionally, the test evaluation index data includes one or more of the trajectory point loss rate and the trajectory point position accuracy data; for each test result corresponding to the simulated trajectory data, the test evaluation index data corresponding to the test result is determined, including: for each test result corresponding to the simulated trajectory data, determining the first trajectory point number of the simulated trajectory data, and determining the second trajectory point number of the test result corresponding to the simulated trajectory data, and determining the trajectory point loss rate of the test result corresponding to the simulated trajectory data based on the first trajectory point number and the second trajectory point number; and / or, for each test result corresponding to the simulated trajectory data, matching the simulated trajectory data with the test result corresponding to the simulated trajectory data according to the timestamp information, and calculating the position deviation data between the trajectory points corresponding to the same timestamp information, obtaining the position deviation data corresponding to each timestamp information, and determining the trajectory point position accuracy data of the test result corresponding to the simulated trajectory data based on the position deviation data.

[0056] Specifically, for each test result corresponding to the simulated trajectory data, the positioning information in the test result corresponding to the simulated trajectory data is traversed, and the information of each trajectory point in the corresponding simulated trajectory data is compared, and the test evaluation index data corresponding to the test result is determined according to the comparison result. The corresponding trajectory loss rate is determined by simulating the trajectory data and counting the number of trajectory points corresponding to the test results corresponding to the simulated trajectory data, specifically by counting the number of trajectory points corresponding to the positioning information in the test result corresponding to the simulated trajectory data as the second trajectory point number, counting the number of trajectory points in the simulated trajectory data as the first trajectory point number, determining the difference between the first trajectory point number and the second trajectory point number, calculating the ratio of the difference to the first trajectory point number, and the obtained ratio is used as the trajectory point loss rate of the test result corresponding to the simulated trajectory data. The trajectory point position accuracy data is determined by using the position information of the trajectory points corresponding to the simulated trajectory data and the test results corresponding to the statistical simulated trajectory data. Specifically, the simulated trajectory data and the test results corresponding to the simulated trajectory data are matched according to the timestamp information, and the distance calculation is performed on the position information of the trajectory points corresponding to the same timestamp information to determine the distance deviation data corresponding to each timestamp information. The number of timestamps with distance deviation data is counted, and then the ratio of the timestamps with distance deviation data to the total number of timestamps in the test results is calculated. The ratio can be used as the trajectory point position accuracy data of the test result.

[0057] Optionally, the test evaluation results of the system to be tested are determined based on the test evaluation indicator data of each test result, including: for each test result, weighting the trajectory point loss rate and / or trajectory point position accuracy data in the test evaluation indicator data of the test result based on preset weight data to obtain a comprehensive test evaluation result of the test result; and determining the test evaluation results of the system to be tested based on the comprehensive test evaluation results of each test result.

[0058] Among them, the preset weight data can be specifically understood as data used to characterize the importance of the test evaluation indicators. The weight data of each test evaluation indicator can be pre-set according to the actual test requirements, or the importance of each test evaluation indicator can be determined by analyzing the historical positioning data, thereby pre-setting the corresponding test evaluation indicator weight data according to the importance, and storing the preset weight data in the configuration information or the target storage device.

[0059] Specifically, for each test result, when determining the test evaluation index data of each test result, the preset weight data is obtained from the configuration information, and the test evaluation index data of each test result is weighted and summed according to the preset weight data, and the obtained weighted summation result is used as the comprehensive test evaluation result of the corresponding test result. Then, it is determined whether the comprehensive test evaluation result of each test result meets the corresponding preset evaluation result threshold, and the number of test results that do not meet the corresponding preset evaluation result threshold is obtained. If the number exceeds the preset number threshold, it is determined that the test evaluation result of the system to be tested is that the system to be tested has not passed the system test; if the number does not exceed the preset number threshold, it is determined that the test evaluation result of the system to be tested is that the system to be tested has passed the system test.

[0060] The technical solution of this embodiment is to obtain test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type; determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generate multiple simulation trajectory data based on the simulation trajectory parameter information; for each simulation trajectory data, perform a test process on the simulation trajectory data by the system to be tested to obtain a test result corresponding to the simulation trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning and analysis on the simulation trajectory data; for each test result corresponding to the simulation trajectory data, determine test evaluation index data corresponding to the test result, and determine a test evaluation result of the system to be tested based on the test evaluation index data of each test result. This solution determines the corresponding simulation trajectory parameter data by setting different dynamic behavior patterns and / or test area types in the test configuration information to obtain multiple types of simulation trajectory data, and then tests the system to be tested according to the multiple simulation trajectory data, and determines the test evaluation results of the system to be tested according to the test results corresponding to the multiple simulation trajectory data, solves the problem that the sample requirements of the system to be tested for the test data cannot be met, thereby resulting in the inability to guarantee the correctness of the system test results, improves the diversity of test data, can provide diverse and comprehensive test data for the system to be tested, and determines the test evaluation results of the system to be tested according to the multiple trajectory data, thereby improving the accuracy of system testing of the system to be tested.

[0061] Embodiment 2

[0062] Figure 2 It is a flowchart of a system testing method provided by the second embodiment of the present invention. This embodiment is a further optimization of the method of the above embodiment. Optionally, the simulation trajectory parameter information is determined based on the motion behavior pattern and / or the test area type. The simulation trajectory parameter information includes the starting point position information, at least one moving direction, moving speed and interval time; taking the starting point position information as the starting point, multiple trajectory point data in each moving direction are determined based on at least one moving direction, moving speed and interval time; based on the multiple trajectory point data in each moving direction, the simulation trajectory data in the corresponding moving direction is formed. Figure 2 As shown, the method includes:

[0063] S210: Acquire test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type.

[0064] S220: Determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, where the simulation trajectory parameter information includes starting point position information, at least one moving direction, a moving speed, and an interval time.

[0065] The simulation trajectory parameter information includes starting point location information, at least one moving direction, moving speed and interval time. Any location point can be selected from the map data corresponding to the test area as the starting point, and the location information of the corresponding location point can be obtained and used as the starting point location information. The test area can be a region pre-divided according to the two-dimensional map data corresponding to the chemical area, or a test area generated by a pre-built regional derivation model according to preset regional restrictions. The regional derivation model specifically refers to a model for generating a test area based on geographic information, scene requirements and regional generation constraint rules to ensure that each subsequent generated trajectory point meets the requirements of the test area, wherein the regional generation constraint rules include but are not limited to the shape of the test area, whether the test area can overlap and the number of test areas. The moving direction specifically represents the moving direction of the movable target in the test area. Multiple corresponding moving directions can be set according to the test requirements to generate various types of simulation trajectory data. For example, the moving direction can be represented by the inclination, which refers to the angle between the moving direction and the edge of the drivable road, and each angle corresponds to a moving direction.

[0066] Specifically, according to the motion behavior pattern and / or test area type corresponding to the test configuration information, one or more of the preset motion behavior pattern and test area type are matched with the mapping relationship between the simulation trajectory parameter information, so as to determine the simulation trajectory parameter information corresponding to the motion behavior pattern and / or test area type, that is, to determine the simulation trajectory parameter information corresponding to different motion behavior patterns, or the simulation trajectory parameter information corresponding to different test area types, or the simulation trajectory parameter information corresponding to the combination of the motion behavior pattern and the test area type. The simulation trajectory parameter information includes but is not limited to the starting point position information, at least one moving direction, moving speed and interval time.

[0067] S230: Taking the starting point position information as the starting point, determine a plurality of track point data in each moving direction based on at least one moving direction, a moving speed and an interval time.

[0068] Specifically, the position point corresponding to the starting point position information is used as the starting point, and the coordinate information of each trajectory point is calculated in sequence along each moving direction according to the moving speed and the interval time, and the coordinate information and the corresponding time point are used as the trajectory point data of the corresponding trajectory point. In a specific embodiment, the moving direction can be represented by an angle, and then the coordinate information of each trajectory point can be calculated using trigonometric functions. The coordinate information of the trajectory point can be calculated by the following formula:

[0069] x i+1 =x i +v*Δt*cosθ

[0070] y i+1 =y i +v*Δt*sinθ

[0071] Among them, x i ,y i Refers to the horizontal and vertical coordinates of the current trajectory point; x i+1 ,y i+1 Refers to the horizontal and vertical coordinates of the next trajectory point adjacent to the current trajectory point; Δt is the time interval; v is the moving speed within each time interval. The calculation formula based on the coordinate information of the trajectory point is used to calculate to obtain multiple trajectory point data in each moving direction. It should be noted that in some embodiments, the simulation trajectory parameter information also includes the number of trajectory points and the number of trajectories. The number of trajectory points represents the number of trajectory points generated in one moving direction, and the number of trajectories represents the number of generated trajectories. The number of trajectories can be consistent with the number of moving directions, or the number of trajectories can be more than the number of moving directions. If the number of trajectories is more than the number of moving directions, multiple moving trajectories need to be generated in one moving direction.

[0072] S240: Form simulated trajectory data in the corresponding moving direction based on the plurality of trajectory point data in each moving direction.

[0073] Specifically, when a plurality of trajectory point data in each moving direction is determined, the trajectory points in each moving direction are sequentially sorted according to the corresponding time information sequence to form simulated trajectory data in the corresponding moving direction.

[0074] Optionally, after forming simulated trajectory data in the corresponding moving direction based on multiple trajectory point data in each moving direction, it also includes: for the simulated trajectory data in each moving direction, verifying the trajectory point data in the simulated trajectory data in the moving direction based on the target area map data, and determining the trajectory point data that does not meet the preset verification conditions; adjusting the trajectory point data that does not meet the preset verification conditions, and updating the corresponding simulated trajectory data based on the adjusted trajectory point data; and / or determining trajectory curvature data corresponding to each trajectory point in the simulated trajectory data, determining the trajectory points that do not meet the preset trajectory curvature threshold based on the trajectory curvature data corresponding to each trajectory point and the preset trajectory curvature threshold; adjusting the trajectory point data of the trajectory points that do not meet the preset trajectory curvature threshold, and updating the corresponding simulated trajectory data based on the adjusted trajectory point data.

[0075] The target area map data specifically represents the map data of the area where the movable target is allowed to move. For example, the map data corresponding to the chemical plant area can be identified to determine the drivable area, and the map data corresponding to the drivable area is used as the target area map data. The preset verification conditions specifically represent the conditions set for verifying each track point in the simulated trajectory data. The conditions include that each track point in the simulated trajectory data is included in the target area map data. In order to ensure that the generated simulated trajectory data belongs to the target area map data, the accuracy of the simulated trajectory data generation is improved, thereby improving the accuracy of subsequent testing of the system to be tested.

[0076] Specifically, after the simulated trajectory data in the corresponding moving direction is formed based on the multiple trajectory point data in each moving direction, the simulated trajectory data in each moving direction is verified. In one embodiment, the corresponding target area map data is obtained, and the trajectory point data in the simulated trajectory data in the moving direction are matched with the position point information in the target area map data respectively, and the trajectory point data that does not match the position point information in the target area map data is screened out, and the screened out trajectory point data is used as the trajectory point data that does not meet the preset verification conditions; further, the trajectory point data that does not meet the preset verification conditions is adjusted. For example, the position information closest to each trajectory point corresponding to the trajectory point data that does not meet the preset verification conditions can be selected in the target area map data, and the obtained position information is adjusted to the trajectory point data of the corresponding trajectory point, and the trajectory data of the closest trajectory point in the corresponding simulated trajectory data is replaced by the adjusted trajectory point data. In another embodiment, the trajectory curvature data corresponding to each trajectory point in the simulated trajectory data is determined, and the verification result is determined according to the trajectory curvature data corresponding to each trajectory point. For each trajectory point, the trajectory curvature data corresponding to each trajectory point is compared with a preset trajectory curvature threshold to determine the trajectory point that does not meet the preset trajectory curvature threshold, and the trajectory point that does not meet the preset trajectory curvature threshold is smoothed, so as to adjust the corresponding trajectory point to obtain the adjusted trajectory point data of the trajectory point, and the data of the trajectory point in the corresponding simulated trajectory data is replaced by the adjusted trajectory point data to obtain the calibrated simulated trajectory data in each moving direction. It should be noted that the simulated trajectory data is a set of trajectory points on the same plane, and the i-th trajectory point (x i ,y i ) The calculation formula of the trajectory curvature k corresponding to is as follows:

[0077]

[0078] Among them, (x i-1 ,y i-1 )、(x i ,y i )、(x i+1 ,y i+1 ) represent the coordinate data of any three adjacent trajectory points. It should be noted that if the curvature data corresponding to the trajectory point is too large, it indicates that there is a turning or sharp turn problem at the corresponding trajectory point.

[0079] S250 . For each simulated trajectory data, the system to be tested performs a test process on the simulated trajectory data to obtain a test result corresponding to the simulated trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning analysis on the simulated trajectory data.

[0080] S260 . Determine test evaluation index data corresponding to each test result corresponding to each simulation trajectory data, and determine a test evaluation result of the system to be tested based on the test evaluation index data of each test result.

[0081] The technical solution of this embodiment is to obtain test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type; determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, the simulation trajectory parameter information including starting point position information, at least one moving direction, a moving speed and an interval time; take the starting point position information as the starting point, determine multiple trajectory point data in each moving direction based on at least one moving direction, a moving speed and an interval time; form simulation trajectory data in the corresponding moving direction based on the multiple trajectory point data in each moving direction; for each simulation trajectory data, perform a test process on the simulation trajectory data by the system to be tested to obtain a test result corresponding to the simulation trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning and analysis on the simulation trajectory data; for each test result corresponding to the simulation trajectory data, determine test evaluation index data corresponding to the test result, and determine the test evaluation result of the system to be tested based on the test evaluation index data of each test result. This solution determines the corresponding simulation trajectory parameter data by setting different dynamic behavior patterns and / or test area types in the test configuration information to obtain multiple types of simulation trajectory data, and then tests the system to be tested according to the multiple simulation trajectory data, and determines the test evaluation results of the system to be tested according to the test results corresponding to the multiple simulation trajectory data, solves the problem that the sample requirements of the system to be tested for the test data cannot be met, thereby resulting in the inability to guarantee the correctness of the system test results, improves the diversity of test data, can provide diverse and comprehensive test data for the system to be tested, and determines the test evaluation results of the system to be tested according to the multiple trajectory data, thereby improving the accuracy of system testing of the system to be tested.

[0082] Embodiment 3

[0083] Figure 3 Schematic diagram of the structure of a system testing device provided by Embodiment 3 of the present invention. Figure 3 As shown, the device comprises:

[0084] A test configuration information acquisition module 310 is used to acquire test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type;

[0085] A simulation trajectory data determination module 320 is used to determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generate a plurality of simulation trajectory data based on the simulation trajectory parameter information;

[0086] The test result determination module 330 is used to perform a test process on each simulated trajectory data through the system to be tested to obtain a test result corresponding to the simulated trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning analysis on the simulated trajectory data;

[0087] The test evaluation result determination module 340 is used to determine the test evaluation index data corresponding to each test result corresponding to the simulation trajectory data, and determine the test evaluation result of the system to be tested based on the test evaluation index data of each test result.

[0088] The technical solution of this embodiment is to obtain test configuration information through a test configuration information acquisition module, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type; a simulation trajectory data determination module determines simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generates multiple simulation trajectory data based on the simulation trajectory parameter information; a test result determination module performs a test process on the simulation trajectory data for each simulation trajectory data through a system to be tested, and obtains a test result corresponding to the simulation trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning and analysis on the simulation trajectory data; a test evaluation result determination module determines test evaluation indicator data corresponding to the test result for each test result corresponding to the simulation trajectory data, and determines a test evaluation result of the system to be tested based on the test evaluation indicator data of each test result. This solution determines the corresponding simulation trajectory parameter data by setting different dynamic behavior patterns and / or test area types in the test configuration information to obtain multiple types of simulation trajectory data, and then tests the system to be tested according to the multiple simulation trajectory data, and determines the test evaluation results of the system to be tested according to the test results corresponding to the multiple simulation trajectory data, solves the problem that the sample requirements of the system to be tested for the test data cannot be met, thereby resulting in the inability to guarantee the correctness of the system test results, improves the diversity of test data, can provide diverse and comprehensive test data for the system to be tested, and determines the test evaluation results of the system to be tested according to the multiple trajectory data, thereby improving the accuracy of system testing of the system to be tested.

[0089] On the basis of the above embodiment, optionally, the motion behavior mode includes one or more of a walking mode, a riding mode and a driving mode; the test area type includes one or more of an outdoor area type and an indoor area type. The simulation trajectory data determination module 320 is specifically used to obtain the mapping relationship between the motion behavior mode and one or more of the test area types and the simulation trajectory parameter information respectively; and determine the simulation trajectory parameter information based on the motion behavior mode and / or the test area type and the corresponding mapping relationship.

[0090] Optionally, the simulation trajectory data determination module 320 is specifically used to determine the simulation trajectory parameter information that matches the motion behavior pattern from a mapping relationship based on the motion behavior pattern; determine the simulation trajectory parameter information that matches the test area type from a mapping relationship based on the test area type; obtain multiple test scenarios based on a combination of the motion behavior pattern and the test area type, and determine the simulation trajectory parameter information that matches the test scenario from a mapping relationship based on the motion behavior pattern and the test area type corresponding to each test scenario.

[0091] Optionally, the simulation trajectory parameter information includes starting point position information, at least one moving direction, a moving speed and an interval time; the simulation trajectory data determination module 320 is specifically used to determine multiple trajectory point data in each moving direction based on the starting point position information and at least one moving direction, a moving speed and an interval time; based on the multiple trajectory point data in each moving direction, the simulation trajectory data in the corresponding moving direction is formed.

[0092] Optionally, after forming simulated trajectory data in the corresponding moving direction based on multiple trajectory point data in each moving direction, the simulated trajectory data determination module 320 is further specifically used to verify the trajectory point data in the simulated trajectory data in the moving direction based on the target area map data for each simulated trajectory data in the moving direction, and determine the trajectory point data that does not meet the preset verification conditions; adjust the trajectory point data that does not meet the preset verification conditions, and update the corresponding simulated trajectory data based on the adjusted trajectory point data; and / or determine the trajectory curvature data corresponding to each trajectory point in the simulated trajectory data, determine the trajectory points that do not meet the preset trajectory curvature threshold based on the trajectory curvature data corresponding to each trajectory point and the preset trajectory curvature threshold; adjust the trajectory point data of the trajectory points that do not meet the preset trajectory curvature threshold, and update the corresponding simulated trajectory data based on the adjusted trajectory point data.

[0093] Optionally, the test evaluation index data includes one or more of the trajectory point loss rate and the trajectory point position accuracy data; the test evaluation result determination module 340 is specifically used to determine the first trajectory point number of the simulated trajectory data, and determine the second trajectory point number of the test result corresponding to the simulated trajectory data for each test result corresponding to the simulated trajectory data, and determine the trajectory point loss rate of the test result corresponding to the simulated trajectory data based on the first trajectory point number and the second trajectory point number; and / or, for each test result corresponding to the simulated trajectory data, match the simulated trajectory data with the test result corresponding to the simulated trajectory data according to the timestamp information, and calculate the position deviation data between the trajectory points corresponding to the same timestamp information, obtain the position deviation data corresponding to each timestamp information, and determine the trajectory point position accuracy data of the test result corresponding to the simulated trajectory data based on the position deviation data.

[0094] Optionally, the test evaluation result determination module 340 is specifically used to perform weighted processing on the trajectory point loss rate and / or trajectory point position accuracy data in the test evaluation index data of the test result for each test result based on preset weight data to obtain a comprehensive test evaluation result of the test result; and determine the test evaluation result of the system to be tested based on the comprehensive test evaluation result of each test result.

[0095] The system testing device provided in the embodiment of the present invention can execute the system testing method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0096] Embodiment 4

[0097] Figure 4 1 is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. The electronic device 10 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0098] like Figure 4 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0099] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0100] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a system testing method.

[0101] In some embodiments, the system test method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the system test method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the system test method in any other appropriate manner (e.g., by means of firmware).

[0102] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0103] The computer programs for implementing the system testing method of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0104] Embodiment 5

[0105] Embodiment 5 of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to cause a processor to execute a system testing method, the method comprising:

[0106] Acquire test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type;

[0107] Determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generate a plurality of simulation trajectory data based on the simulation trajectory parameter information;

[0108] For each simulated trajectory data, the system to be tested performs a test process on the simulated trajectory data to obtain a test result corresponding to the simulated trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning analysis on the simulated trajectory data;

[0109] For each test result corresponding to the simulation trajectory data, the test evaluation index data corresponding to the test result is determined, and the test evaluation result of the system to be tested is determined based on the test evaluation index data of each test result.

[0110] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0111] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0112] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0113] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0114] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0115] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A system testing method, characterized in that: include: Acquire test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type; Determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generate a plurality of simulation trajectory data based on the simulation trajectory parameter information; For each of the simulated trajectory data, the system to be tested performs a test process on the simulated trajectory data to obtain a test result corresponding to the simulated trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning analysis on the simulated trajectory data; For each test result corresponding to the simulation trajectory data, the test evaluation index data corresponding to the test result is determined, and the test evaluation result of the system to be tested is determined based on the test evaluation index data of each test result.

2. The method according to claim 1, characterized in that The motion behavior mode includes one or more of a walking mode, a riding mode and a driving mode; the test area type includes one or more of an outdoor area type and an indoor area type; The determining of simulation trajectory parameter information based on the motion behavior pattern and / or the test area type includes: Acquire a mapping relationship between one or more of the motion behavior pattern and the test area type and simulation trajectory parameter information respectively; The simulation trajectory parameter information is determined based on the motion behavior pattern and / or the test area type and the corresponding mapping relationship.

3. The method according to claim 2, characterized in that The determining of the simulation trajectory parameter information based on the motion behavior pattern and / or the test area type and the corresponding mapping relationship includes one or more of the following: Determining simulation trajectory parameter information matching the motion behavior pattern from the mapping relationship based on the motion behavior pattern; Determining simulation trajectory parameter information matching the test area type from the mapping relationship based on the test area type; Based on the combination of the motion behavior pattern and the test area type, multiple test scenarios are obtained, and based on the motion behavior pattern and test area type corresponding to each test scenario, simulation trajectory parameter information matching the test scenario is determined from the mapping relationship.

4. The method according to claim 1, characterized in that: The simulation trajectory parameter information includes starting point position information, at least one moving direction, moving speed and interval time; The generating a plurality of simulation trajectory data based on the simulation trajectory parameter information comprises: Taking the starting point position information as the starting point, determining a plurality of track point data in each of the moving directions based on the at least one moving direction, the moving speed and the interval time; Based on the plurality of trajectory point data in each of the moving directions, simulated trajectory data in the corresponding moving direction is formed.

5. The method according to claim 4, characterized in that After forming the simulated trajectory data in the corresponding moving direction based on the plurality of trajectory point data in each moving direction, the method further includes: For each simulated trajectory data in the moving direction, verify the trajectory point data in the simulated trajectory data in the moving direction based on the target area map data, and determine the trajectory point data that does not meet the preset verification conditions; adjust the trajectory point data that does not meet the preset verification conditions, and update the corresponding simulated trajectory data based on the adjusted trajectory point data; And / or, determining the trajectory curvature data corresponding to each trajectory point in the simulated trajectory data, determining the trajectory points that do not meet the preset trajectory curvature threshold based on the trajectory curvature data corresponding to each trajectory point and the preset trajectory curvature threshold; adjusting the trajectory point data of the trajectory points that do not meet the preset trajectory curvature threshold, and updating the corresponding simulated trajectory data based on the adjusted trajectory point data.

6. The method according to claim 1, characterized in that The test evaluation index data includes one or more of the trajectory point loss rate and trajectory point position accuracy data; The step of determining the test evaluation index data corresponding to each test result corresponding to the simulation trajectory data includes: For each test result corresponding to the simulated trajectory data, determine a first trajectory point quantity of the simulated trajectory data, and determine a second trajectory point quantity of the test result corresponding to the simulated trajectory data, and determine a trajectory point loss rate of the test result corresponding to the simulated trajectory data based on the first trajectory point quantity and the second trajectory point quantity; and / or, For each test result corresponding to the simulated trajectory data, the simulated trajectory data and the test result corresponding to the simulated trajectory data are matched according to the timestamp information, and the position deviation data between the trajectory points corresponding to the same timestamp information is calculated to obtain the position deviation data corresponding to each timestamp information, and the trajectory point position accuracy data of the test result corresponding to the simulated trajectory data is determined based on the position deviation data.

7. The method according to claim 1, characterized in that The determining the test evaluation result of the system to be tested based on the test evaluation indicator data of each test result includes: For each of the test results, weighted processing is performed on the trajectory point loss rate and / or trajectory point position accuracy data in the test evaluation index data of the test result based on preset weight data to obtain a comprehensive test evaluation result of the test result; A test evaluation result of the system to be tested is determined based on a comprehensive test evaluation result of each of the test results.

8. A system testing device, characterized in that: include: A test configuration information acquisition module, used to acquire test configuration information, wherein the test configuration information includes one or more of a motion behavior pattern and a test area type; A simulation trajectory data determination module, used to determine simulation trajectory parameter information based on the motion behavior pattern and / or the test area type, and generate a plurality of simulation trajectory data based on the simulation trajectory parameter information; A test result determination module is used to, for each of the simulated trajectory data, execute a test process on the simulated trajectory data through the system to be tested, and obtain a test result corresponding to the simulated trajectory data, wherein the test result includes positioning data obtained by the system to be tested performing positioning analysis on the simulated trajectory data; The test evaluation result determination module is used to determine the test evaluation index data corresponding to each test result corresponding to the simulation trajectory data, and determine the test evaluation result of the system to be tested based on the test evaluation index data of each test result.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the system testing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the system testing method according to any one of claims 1 to 7 when executed.

Images