Automatic testing method and device for BAMS equipment

Abstract

The invention relates to the technical field of battery management system testing, in particular to an automatic testing method and device for BAMS equipment. The method comprises the following steps: in response to a test instruction input by a user, generating test data, and controlling a simulation BCMS to generate a simulation test signal according to the test data; the analog BCMS is used for generating an analog test signal; the simulation test signal is used for testing the response performance of the BAMS; sending the simulation test signal to the BAMS equipment, and monitoring a response action of the BAMS equipment in response to the simulation test signal; calculating a response index of the BAMS equipment according to the response action, and evaluating the response performance of the BAMS equipment according to the response index; the response index comprises response time and accuracy; according to the method, the simulation BCMS is used for carrying out performance testing on the BAMS equipment, and the problem that coverage is not comprehensive when the BAMS equipment is tested through the real BCMS equipment is effectively avoided.

Description

Technical Field

[0001] The present application relates to the technical field of battery management system testing, and in particular to a method and device for automated testing of BAMS equipment. Background Art

[0002] The battery energy storage system (BESS) plays an important role in modern power systems and can effectively regulate the storage and output of electricity. The battery management system (BMS) is a key component in the energy storage system, which is used to monitor and manage the status and performance of the battery. The battery management system is usually divided into two levels: the battery cluster management system (BCMS) and the battery array management system (BAMS). The BCMS is responsible for collecting the voltage, current, temperature and other information of the battery modules in the cluster and uploading it to the BAMS, and managing the battery modules in the cluster to achieve the balancing function within the cluster; while the BAMS is responsible for the centralized management of the batteries of the entire energy storage battery stack, connecting to each battery cluster management unit downward, interacting with other equipment upward, and feeding back the operating status information of the battery array.

[0003] During the design and maintenance of energy storage systems, the operation strategies of BAMS devices need to be fully tested to ensure their stability and reliability under various working conditions. However, most existing testing methods rely on real BCMS devices for joint debugging. However, during the testing process, real BCMS devices are restricted by hardware conditions and environmental factors, resulting in incomplete testing coverage of BAMS devices. Summary of the invention

[0004] Based on this, it is necessary to provide a BAMS equipment automated testing method and device to address the above technical issues.

[0005] In a first aspect, the present application proposes a BAMS equipment automated testing method, the method comprising: In response to a test instruction input by a user, test data is generated, and the simulated BCMS is controlled to generate a simulated test signal according to the test data; the simulated BCMS is used to generate the simulated test signal; the simulated test signal is used to test the response performance of the BAMS device; Sending a simulation test signal to the BAMS device and monitoring a response action of the BAMS device in response to the simulation test signal; According to the response action, the response index of the BAMS device is calculated, and the response performance of the BAMS device is evaluated according to the response index; the response index includes response time and accuracy.

[0006] In one embodiment, in response to a test instruction input by a user, the steps of generating test data and controlling the simulated BCMS to generate a simulated test signal according to the test data include: Parse the test instructions input by the user, convert them into test data and generate test cases; the test instructions include operation mode, environmental parameters and fault injection; the test data is used to simulate BCMS to generate simulation test signals; Check the rationality of test cases; Control the simulation BCMS to generate the running status data corresponding to any test step in the test case and convert it into a simulation test signal.

[0007] In one embodiment, the method further comprises: When the response time of the BAMS device exceeds the preset response time, the simulated BCMS is controlled to repeatedly send the simulated test signal of the current test step; If it is detected that the waiting reaction time of the response action of the BAMS device is less than the preset reaction time, then continue to execute the subsequent test steps; If the waiting reaction time is not less than the preset reaction time, and the current test step is not a related step of other test steps, the current test step is skipped and the subsequent test steps are executed; If the waiting reaction time is not less than the preset reaction time and the current test step is an associated step of other test steps, restart the test and execute the current test step.

[0008] In one embodiment, the method further comprises: If the response action of the BAMS device is inconsistent with the expected response action, and the current test step is fault handling, increase the simulation parameter range of fault handling; If the response action of the BAMS device is inconsistent with the expected response action and the current test step is a mode conversion, the simulated BCMS is controlled to send a simulated test signal corresponding to the operating status data after the mode conversion.

[0009] In one embodiment, the method further comprises: In the event of an abnormal failure of the BAMS device, if the BAMS device has a self-healing mechanism and the waiting recovery time for the response action of the BAMS device to return to normal is less than the preset recovery time, continue to execute the current test step; If the waiting recovery time is less than the preset recovery time or the BAMS device does not have a self-healing mechanism, a restart instruction and a simulation test signal corresponding to the current test step are repeatedly sent to the BAMS device; If the waiting recovery time is not less than the preset recovery time, the current test step is skipped, and the restart instruction and the simulation test signal corresponding to the subsequent test steps are repeatedly sent to the BAMS device.

[0010] In one embodiment, the method further comprises: If the parameter range of the environmental parameters in the test case exceeds the preset range of the BAMS device, reduce the step size of the environmental parameters in the test case and extend the preset response time; If the environmental parameter corresponding to the current test step exceeds the preset range of the BAMS device, additional detection items for the BAMS device are added, and the detection items include current detection.

[0011] In one embodiment, the method further comprises: If the parameter range of the environmental parameters or operating mode in the test case is smaller than the preset range of the BAMS device, an additional parameter range is generated to insert the test case; If the test time exceeds the preset test time, the test steps without associated steps in the test case will be tested first, and the test order of the test steps with associated steps will be put at the back.

[0012] In one embodiment, the method further comprises: If the operating mode in the test case needs to be tested repeatedly, and the number of response action errors of the BAMS device in one operating mode test is less than the preset number, reduce the number of repeated tests of the operating mode.

[0013] In one embodiment, the method further comprises: Calculate response indicators based on the response actions of the BAMS device in response to the adjusted test case; the response indicators also include action integrity and resource utilization; The response speed of BAMS equipment to the operating mode under different working conditions is evaluated according to the first response index; the first response index is calculated by the response action of the operating mode of the test case; The BAMS equipment's handling capability and response speed to faults are evaluated according to the second response index; the second response index is calculated by the response action of the fault injection in the test case; The adaptability of the BAMS equipment to the environment is evaluated according to the third response index; the third response index is calculated by the response action of the test case being the environmental parameter.

[0014] In a second aspect, the present application proposes a BAMS equipment automated testing device, comprising: The test case management module is used to generate test data in response to the test instructions input by the user, and control the simulated BCMS to generate simulated test signals according to the test data; the simulated BCMS is used to generate simulated test signals; the simulated test signals are used to test the response performance of the BAMS equipment; A test execution module, used for sending a simulation test signal to the BAMS device and monitoring the response action of the BAMS device in response to the simulation test signal; The test analysis module is used to calculate the response index of the BAMS device according to the response action, and evaluate the response performance of the BAMS device according to the response index; the response index includes response time and accuracy.

[0015] The present application provides an automated testing method for BAMS equipment. The method generates test cases by responding to and identifying test data input by a user, and can automatically arrange test cases for BAMS equipment according to user needs. The method generates simulated test signals for test equipment in various operating states, complex environments, and when failures occur according to test cases by simulating BCMS, thereby ensuring the stability of test signals and the comprehensiveness of test cases. The method calculates response indicators of BAMS equipment, scores the performance of BAMS equipment according to the response indicators, and can comprehensively evaluate the performance of BAMS equipment under different working conditions, effectively avoiding the problem of incomplete coverage of BAMS equipment testing using real equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 A flowchart of the steps of a BAMS equipment automated testing method in one embodiment; Figure 2 A flow chart of steps for simulating a BCMS to generate a simulated test signal in one embodiment; Figure 3 A flowchart of the steps of handling a response timeout fault in one embodiment; Figure 4 A flowchart of the steps of troubleshooting a response error in one embodiment; Figure 5 A flowchart of the steps of handling abnormal faults of BAMS equipment in one embodiment; Figure 6 is a flowchart of the steps of troubleshooting for extreme environmental conditions in one embodiment; Figure 7 A flowchart of steps for troubleshooting insufficient test case coverage in one embodiment; Figure 8 A flowchart of steps for evaluating device performance according to a BAMS device response action in one embodiment; Fig. 9 The present invention is a structural framework diagram of a BAMS equipment automation testing device in one embodiment. DETAILED DESCRIPTION

[0018] In order to facilitate understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Embodiments of the present application are provided in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0019] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0020] In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features.

[0021] In this application, unless otherwise clearly specified and limited, the terms "initial", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0022] It should be noted that when an element is considered to be "connected" to another element, it can be directly connected to the other element, or connected to the other element through an intermediate element. In addition, the "connection" in the following embodiments should be understood as "electrical connection", "communication connection", etc. if there is transmission of electrical signals or data between the connected objects.

[0023] When used herein, the singular forms "a", "an", and "said / the" may also include plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "include / comprise" or "have" and the like specify the presence of stated features, wholes, steps, operations, components, parts, or combinations thereof, but do not exclude the possibility of the presence or addition of one or more other features, wholes, steps, operations, components, parts, or combinations thereof. At the same time, the term "and / or" used in this specification includes any and all combinations of the relevant listed items.

[0024] The embodiment of the present application provides a method for automated testing of BAMS equipment, the method comprising constructing a simulated BCMS; the simulated BCMS is used to generate a simulated test signal; the simulated test signal is used to test the response performance of the BAMS; Figure 1 As shown, the method includes the following steps S102 to S106: S102, in response to a test instruction input by a user, generating test data, and controlling the simulated BCMS to generate a simulated test signal according to the test data; the simulated BCMS is used to generate the simulated test signal; the simulated test signal is used to test the response performance of the BAMS device; Specifically, a simulated BCMS is designed, which has a simulation algorithm that can not only simulate the operating data of a real BCMS device according to the input battery operating status and fault status, but also receive and identify the control signal of a real BAMS device, simulate the operating data of the real BCMS device after responding to the control signal, and finally output the operating data to the real BAMS device in the form of a simulated signal. The operating data may include voltage, current and temperature.

[0025] Furthermore, the test instructions input by the user are converted into test data that can be recognized by the simulated BCMS, and the voltage, current and temperature data of different test steps in the test are obtained through simulation calculation of the simulated BCMS, and finally converted into simulated test signals for testing; the simulated test signals also include environmental parameters and fault injection in the test instructions.

[0026] S104, sending a simulation test signal to the BAMS device, and monitoring the response action of the BAMS device in response to the simulation test signal.

[0027] Specifically, the simulated BCMS can communicate with BAMS devices through communication protocols suitable for energy storage systems such as Modbus and CAN bus; it can simultaneously obtain response actions of multiple target BAMS devices and save them to a database or file system. The response actions may include extracting battery parameters, sending alarm information and system operation commands.

[0028] S106, calculating the response index of the BAMS device according to the response action, and evaluating the response performance of the BAMS device according to the response index; the response index includes response time and accuracy.

[0029] Specifically, the acquired response actions are pre-processed for noise reduction; the response time is calculated based on the moment when the simulated BCMS sends out the simulated test signal and the moment when the BAMS device sends out the response action; based on the preset expected response result of the BAMS device, whether each response action is correct or not is judged, and the accuracy is calculated.

[0030] For example, the response time may be the average response time :

[0031] in, For the a The response time of each test step, n is the total number of responses, 0 <a≤n ; Accuracy satisfy:

[0032] in, r The number of times the response action meets the expected response action, n is the total number of responses; Furthermore, set the test score S :

[0033] in, is the average response time, is the expected average response time, is the accuracy, is the expected accuracy, is the response time weight, is the accuracy weight; if the test score S If it is not less than the preset value, the BAMS equipment performance is judged to meet expectations, otherwise it does not meet expectations.

[0034] Optionally, set response time or accuracy as a key indicator. If the key indicator does not meet expectations, the test score will be S If the value is not less than the preset value, it is also determined that the performance of the BAMS equipment does not meet expectations.

[0035] The present application provides a BAMS equipment automation testing method, which generates test cases by responding to and identifying test instructions input by users, and can automatically arrange test cases for BAMS equipment according to user needs; by simulating BCMS instead of real test equipment, simulated test signals of test equipment in various operating states, complex environments and when failures occur are generated according to test cases, thereby ensuring the stability of test signals and the comprehensiveness of test cases; calculating response indicators of BAMS equipment, and scoring the response performance of BAMS equipment according to the response indicators, which can comprehensively evaluate the response performance of BAMS equipment under different working conditions, and effectively avoid the problem of incomplete coverage of BAMS equipment testing using real equipment.

[0036] In an exemplary embodiment, Figure 2 As shown, in response to the test instruction input by the user, generating test data, and controlling the simulated BCMS to generate a simulated test signal according to the test data includes the following steps S202 to S206: S202, parse the test instructions input by the user, convert them into test data and generate test cases; the test instructions include operation mode, environmental parameters and fault injection; the test data is used to simulate BCMS to generate simulation test signals.

[0037] Specifically, it supports users to select modular preset test instructions on the GUI, and also to add custom test instructions through the programming language; based on the test instructions input by the user, test cases are automatically generated and presented to the user, allowing the user to preview, modify test cases and specify the execution order of test cases; by simulating the initial state parameters of the running state and environmental parameters, as well as the subsequent state parameter change process, and setting the parameters of fault injection, test cases corresponding to different test purposes are generated, and the test cases can be arranged in serial or parallel.

[0038] Among them, the operating modes may include: charging mode, discharging mode, sleep mode, balanced charging, emergency stop state and start-up shutdown command; environmental parameters may include: ambient temperature, ambient humidity and external load; fault injection may include: battery overvoltage, battery undervoltage, abnormal temperature, abnormal current and communication interruption.

[0039] S204, verify the rationality of the test case.

[0040] Specifically, before the test is executed, the test cases generated according to the test instructions input by the user and modified by the user are verified to ensure that the test data after the test case conversion conforms to the simulation logic of the simulated BCMS.

[0041] S206, controlling the simulated BCMS to generate the running status data corresponding to any test step in the test case, and converting it into a simulated test signal.

[0042] Specifically, according to the test data converted from serial or parallel test cases, the simulated BCMS can simulate and generate the operating status data of the BCMS equipment under each test step in the whole test process, and convert it into simulated test signals and send them to the BAMS equipment.

[0043] Exemplarily, in response to a test case in which the operating state is a charging mode, the simulated BCMS generates a suitable charging voltage and charging current as an initial operating state, and simultaneously generates a data curve of the operating state that varies with time.

[0044] Exemplarily, in response to a test case in which the fault injection is an overheating fault, if the overheating fault occurs after 5 minutes, the simulated BCMS generates operating status data of the battery overheating fault after 5 minutes.

[0045] Exemplarily, in response to a test case in which the environmental parameter is a temperature change, the simulated BCMS periodically sends the changed environmental temperature data.

[0046] In an exemplary embodiment, Figure 3 As shown, the method further includes the following steps S302 to S308: S302, when the response time of the BAMS device exceeds the preset response time, control the simulated BCMS to repeatedly send the simulated test signal of the current test step.

[0047] Specifically, due to a freeze in the BAMS device or a delay in communication between the simulated BCMS and the BAMS device, the response time of the BAMS device may exceed the preset response time; in the event of such a problem, the simulated BCMS can give the BAMS device additional response time by sending the simulated test signal of the current test step multiple times at intervals, waiting for the BAMS device to respond normally.

[0048] S304: If it is detected that the waiting reaction time of the response action of the BAMS device is less than the preset reaction time, then the subsequent test steps are continued.

[0049] Specifically, the additional response time is set as the preset reaction time; after the analog test signal corresponding to the current test step is sent for the second time, the waiting reaction time is calculated; if the waiting reaction time is less than the preset reaction time and the BAMS device is detected to have issued a response action, it is judged that the BAMS device responds normally and the test can continue.

[0050] S306: If the waiting reaction time is not less than the preset reaction time and the current test step is not an associated step of other test steps, the current test step is skipped and subsequent test steps are executed.

[0051] It is understandable that the functions in BAMS equipment are not all independent of each other, but are related. The realization of the latter function may depend on the realization of several previous functions; the test steps corresponding to these conditional functions and result functions are related test steps; related steps should be complete and orderly in the test, otherwise there will be a problem of incomplete test coverage.

[0052] Specifically, after the simulation test signal is sent for the second time, if the waiting response time is not less than the preset response time, and the BAMS device still does not issue a response action, and the current test step has no related steps, the current test step can be skipped and the subsequent test step can be executed first, and the order of the current test step can be put back.

[0053] S308: If the waiting reaction time is not less than the preset reaction time and the current test step is an associated step of other test steps, restart the test and execute the current test step.

[0054] Specifically, after the analog test signal is sent for the second time, if the waiting response time is not less than the preset response time and the BAMS device still does not issue a response action, but the current test step has an associated step, a restart instruction and an analog test signal corresponding to the current test step are sent to the BAMS device.

[0055] In an exemplary embodiment, Figure 4 As shown, the method further includes the following steps S402 to S404: S402: If the response action of the BAMS device is inconsistent with the expected response action and the current test step is fault handling, increase the simulation parameter range of the fault handling.

[0056] Specifically, due to an error in judging the current operating status of the battery or an error in processing the signal of the BCMS device, the BAMS device may have a problem in which the response action is inconsistent with the expected response action. When such a problem is detected, if the current test step is to test the fault handling capability of the BAMS device, the fault simulation intensity can be increased until the BAMS device reports an error, so as to test the BAMS device's ultimate tolerance to the fault.

[0057] S404: If the response action of the BAMS device is inconsistent with the expected response action and the current test step is a mode conversion, control the simulated BCMS to send a simulated test signal corresponding to the operating status data after the mode conversion.

[0058] Specifically, if the current test step is an associated step of the subsequent test step, and the response action of the BAMS device under the current test step is inconsistent with the expectation, it means that the BAMS device function corresponding to the current test step may not be correctly triggered. However, for the smooth progress of the test process, the simulated BCMS can record the error log and directly output the simulated test signal of the subsequent test step.

[0059] For example, if the purpose of the current test step is to make the BAMS device enter the standby mode, but under the current test step, the BAMS device does not correctly issue a response action to switch to the standby mode, then the simulated BCMS can be controlled to normally output a simulated test signal corresponding to the operating status data after the BAMS device successfully switches modes.

[0060] In an exemplary embodiment, Figure 5 As shown, the method further includes the following steps S502 to S506: S502, in the event of an abnormal failure of the BAMS device, if the BAMS device has a self-healing mechanism and the waiting time for the response action of the BAMS device to return to normal is less than the preset recovery time, continue to execute the current test step.

[0061] It is understandable that in order to prevent the battery from becoming unusable due to BAMS device failure, the BAMS device may have a self-healing mechanism that can detect the cause of the failure and repair it when it fails, so that the BAMS device automatically returns to normal and ensures that the battery can be used for a long time.

[0062] Specifically, during the test process, when the operating parameters of the test step have not yet approached the limit of the BAMS device, the BAMS device may still send an error signal or communication interruption due to hardware overload or other conditions; in this case, if the BAMS device has a self-healing mechanism, you can wait for the BAMS device to self-heal until the BAMS device and the simulated BCMS stop reporting errors or resume communication; start timing from the receipt of the BAMS device error action or the detection of BAMS device communication interruption, and when the waiting recovery time is less than the preset recovery time, wait for the BAMS to self-heal, record the self-healing time, and execute the current test step again.

[0063] S504: If the waiting recovery time is less than the preset recovery time or the BAMS device does not have a self-healing mechanism, a restart instruction and a simulation test signal corresponding to the current test step are repeatedly sent to the BAMS device.

[0064] Specifically, if the BAMS device has no self-healing mechanism, then when the waiting recovery time is less than the preset recovery time, the restart instruction and the simulated test signal corresponding to the current test step are sent multiple times at intervals. After the BAMS device restarts and restores normal communication, the current test step continues to be executed.

[0065] S506: If the waiting recovery time is not less than the preset recovery time, the current test step is skipped, and the restart instruction and the simulation test signal corresponding to the subsequent test steps are repeatedly sent to the BAMS device.

[0066] Specifically, if the function of the BAMS device still cannot be restored to normal after the waiting recovery time exceeds the preset recovery time, it may be because the simulation test signal corresponding to the test step is inconsistent with the program of the BAMS device; in this case, the fault log of the test step is recorded, and the current test step is skipped, and a restart instruction and a simulation test signal for the subsequent test step are issued; if the current test step has associated steps, delete other associated test steps, and report an error to the user after the test and output the fault log.

[0067] In an exemplary embodiment, Figure 6 As shown, the method further includes the following steps S602 to S604: S602: If the parameter range of the environmental parameter in the test case exceeds the preset range of the BAMS device, reduce the step length of the environmental parameter in the test case and extend the preset response time.

[0068] Specifically, in order to test the adaptability of BAMS equipment in extreme environments, the range of environmental parameter changes set by the user in the test case may exceed the response range preset by the program in the BAMS device; when the test environmental parameters exceed the preset response range, the BAMS device may have a response delay; in this case, the change step size of the environmental parameters in the control test case is reduced, and the waiting time for the BAMS device to respond is extended to ensure that the BAMS device has enough time to adapt to environmental changes until the BAMS device reaches its tolerance limit and issues an error report.

[0069] S604: If the environmental parameter corresponding to the current test step exceeds the preset range of the BAMS device, add a detection item to the BAMS device, and the detection item includes current detection.

[0070] Specifically, if the environmental parameters corresponding to the current test step are already outside the preset response range of the BAMS device, additional detection items for certain modules in the BAMS device, such as current detection, can be added to check whether the response actions of certain modules of the BAMS in extreme environments are as expected.

[0071] In an exemplary embodiment, Figure 7As shown, the method further includes the following steps S702 to S704: S702, if the parameter range of the environmental parameter or the operating mode in the test case is smaller than the preset range of the BAMS device, an additional parameter range is generated to insert the test case; Specifically, if the parameter variation range of the environmental parameters and operating modes in the test case is smaller than the preset response range of the BAMS device, the test case has insufficient coverage and cannot comprehensively detect the performance of the BAMS device; in this case, a non-overlapping range between the current test case and the preset response range of the BAMS device can be generated and inserted into the test case to complete the parameter range of the BAMS device test case.

[0072] Exemplarily, in a charge and discharge test, if the test case lacks a certain voltage test interval, the voltage interval is inserted into the test case, and the analog BCMS is controlled to generate an analog test signal for this voltage test interval to ensure that the voltage parameter interval is fully verified.

[0073] S704, if the test time exceeds the preset test time, the test steps without associated steps in the test case are tested first, and the test order of the test steps with associated steps is put at the back.

[0074] Specifically, because problems may occur in one of the related test steps during the test, multiple related steps need to be re-triggered, which greatly increases the actual test time. In actual testing, the total test time is often preset. When the test time exceeds the preset total time, the test will be interrupted to prevent program errors in the BAMS device from causing a test loop. However, interrupting the test will result in insufficient test coverage of the BAMS device function. In this case, the test steps of the unrelated steps can be tested first, and the test order of the related test steps can be adjusted later to ensure the test coverage of the BAMS device function.

[0075] In an exemplary embodiment, the method further includes: If the operating mode in the test case needs to be tested repeatedly, and the number of response action errors of the BAMS device in one operating mode test is less than the preset number, reduce the number of repeated tests of the operating mode.

[0076] Specifically, for the purpose of reducing the actual testing time, during the testing of the operating mode, if after a complete test, the number of times the response action of the BAMS device is determined to be erroneous is less than a preset number, the number of repeated tests of the operating mode will be reduced or the repeated tests of the operating mode will be skipped directly.

[0077] In an exemplary embodiment, Figure 8 As shown, the method further includes the following steps S802 to S808: S802, calculating a response index according to the response action of the BAMS device in response to the adjusted test case; the response index also includes action integrity and resource utilization.

[0078] It is understandable that during the test process, real-time adjustment of test cases can not only improve test flexibility, reduce the occurrence of faults, handle faults in a timely manner, and improve test efficiency; it can also make the performance of BAMS equipment in the test closer to the actual working conditions and obtain more accurate test results.

[0079] Specifically, during the test process, due to various problems that may arise, the parameter range or execution order of the test cases needs to be adjusted; after the test, the BAMS device response actions are obtained based on the adjusted test cases, and the response time, accuracy, action integrity and resource utilization are calculated. Based on these response indicators, the response performance of the BAMS device can be more accurately evaluated.

[0080] Among them, action integrity refers to whether the response action type of the BAMS device includes all the preset response action types, which can be obtained by the ratio of the response action type and the preset response action type; resource utilization refers to the occupancy of system resources and network resources by the BAMS device when responding to test cases.

[0081] S804, evaluating the response speed of the BAMS device to the operation mode under different working conditions according to the first response index; the first response index is calculated by the response action of the test case being the operation mode.

[0082] Specifically, by calculating the response time and accuracy based on the response action of the BAMS device when executing a test case including an operating mode, the response speed of the BAMS device to simulated test signals of different operating modes under different operating times and different environmental parameters can be evaluated. The response speed may include the number of times the simulated BCMS responds accurately per unit time.

[0083] S806, evaluating the processing capability and response speed of the BAMS device to the fault according to the second response index; the second response index is calculated by the response action of the test case as the fault injection.

[0084] Specifically, by calculating the response time, accuracy, response integrity and resource utilization based on the response actions of the BAMS device when executing test cases including fault injection, the BAMS device's ability to handle different faults under different operating modes and environmental parameters can be comprehensively evaluated.

[0085] Among them, the response time can reflect the BMAS equipment's fault recognition and processing speed; the accuracy rate can reflect the BAMS equipment's fault recognition and processing capabilities; the response integrity can reflect the BAMS equipment's parallel processing capabilities for processes such as issuing instructions to the BCMS, adjusting resource configuration, and reporting errors to superior equipment; and the resource utilization rate can reflect the software and hardware system performance of the BAMS equipment.

[0086] S808, evaluating the adaptability of the BAMS device to the environment according to the third response index; the third response index is calculated by the response action of the test case being the environmental parameter.

[0087] Specifically, by calculating the response time, accuracy, response integrity and resource utilization based on the response actions of the BAMS equipment when executing test cases including changes in environmental parameters, the adaptability of the BAMS equipment to different environments under different working conditions can be comprehensively evaluated.

[0088] It should be understood that although Figure 1-Figure 8 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1-Figure 8 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

[0089] Based on the same inventive concept, the embodiment of the present application also provides a BAMS equipment automated testing device 900 for implementing the above-mentioned. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above-mentioned method, so the specific limitations in one or more embodiments of the BAMS equipment automated testing device provided below can refer to the limitations of the BAMS equipment automated testing method above, and will not be repeated here.

[0090] A BAMS equipment automated testing device 900, such as Fig. 9 As shown, it includes the following modules 901 to 903: Module 901, test case management module, is used to generate test data in response to the test instructions input by the user, and control the simulated BCMS to generate simulated test signals according to the test data. The simulated BCMS is used to generate simulated test signals; the simulated test signals are used to test the response performance of the BAMS equipment; Module 902, a test execution module, is used to send a simulation test signal to the BAMS device and monitor the response action of the BAMS device in response to the simulation test signal.

[0091] Module 903, a test analysis module, is used to calculate the response index of the BAMS device according to the response action, and evaluate the response performance of the BAMS device according to the response index; the response index includes response time and accuracy.

[0092] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0093] In the description of this specification, the description with reference to the terms "some embodiments", "other embodiments", "ideal embodiments", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiment or example.

[0094] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0095] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A BAMS equipment automated testing method, characterized in that: The method comprises: In response to a test instruction input by a user, test data is generated, and the simulated BCMS is controlled to generate a simulated test signal according to the test data; the simulated BCMS is used to generate the simulated test signal; the simulated test signal is used to test the response performance of the BAMS device; sending the analog test signal to the BAMS device, and monitoring a response action of the BAMS device in response to the analog test signal; According to the response action, a response index of the BAMS device is calculated, and the response performance of the BAMS device is evaluated according to the response index; the response index includes response time and accuracy.

2. The method according to claim 1, characterized in that The step of generating test data in response to a test instruction input by a user and controlling the simulated BCMS to generate a simulated test signal according to the test data comprises: Parse the test instructions input by the user, convert them into test data and generate test cases; the test instructions include operation mode, environmental parameters and fault injection; the test data is used by the simulated BCMS to generate the simulated test signal; Verify the rationality of the test cases; The simulated BCMS is controlled to generate the running status data corresponding to any test step in the test case and convert it into the simulated test signal.

3. The method according to claim 2, characterized in that The method further comprises: When the response time of the BAMS device exceeds the preset response time, controlling the simulated BCMS to repeatedly send the simulated test signal of the current test step; If it is detected that the waiting reaction time of the response action of the BAMS device is less than the preset reaction time, then continue to execute the subsequent test steps; If the waiting reaction time is not less than the preset reaction time, and the current test step is not an associated step of other test steps, then the current test step is skipped and the subsequent test step is executed; If the waiting reaction time is not less than the preset reaction time, and the current test step is an associated step of the other test steps, restart the test and execute the current test step.

4. The method according to claim 2, characterized in that: The method further comprises: If the response action of the BAMS device is inconsistent with the expected response action, and the current test step is fault handling, increase the simulation parameter range of the fault handling; If the response action of the BAMS device is inconsistent with the expected response action, and the current test step is a mode conversion, the simulated BCMS is controlled to send a simulated test signal corresponding to the operating status data after the mode conversion.

5. The method according to claim 2, characterized in that: The method further comprises: In the case of an abnormal failure of the BAMS device, if the BAMS device has a self-healing mechanism and the waiting recovery time for the response action of the BAMS device to return to normal is less than the preset recovery time, continue to execute the current test step; If the waiting recovery time is less than the preset recovery time or the BAMS device does not have a self-healing mechanism, repeatedly sending a restart instruction and a simulation test signal corresponding to the current test step to the BAMS device; If the waiting recovery time is not less than the preset recovery time, the current test step is skipped, and the restart instruction and the simulation test signal corresponding to the subsequent test steps are repeatedly sent to the BAMS device.

6. The method according to claim 2, characterized in that The method further comprises: If the parameter range of the environmental parameter in the test case exceeds the preset range of the BAMS device, reducing the step size of the environmental parameter in the test case and extending the preset response time; If the environmental parameter corresponding to the current test step exceeds the preset range of the BAMS device, an additional detection item for the BAMS device is added, and the detection item includes current detection.

7. The method according to claim 2, characterized in that The method further comprises: If the parameter range of the environmental parameter or the operating mode in the test case is smaller than the preset range of the BAMS device, generating an additional parameter range to be inserted into the test case; If the test time exceeds the preset test time, the test steps without associated steps in the test case will be tested first, and the test order of the test steps with associated steps will be put at the back.

8. The method according to claim 2, characterized in that: The method further comprises: If the operating mode in the test case needs to be repeatedly tested, and the number of response action errors of the BAMS device in one test of the operating mode is less than a preset number, the number of repeated tests of the operating mode is reduced.

9. The method according to any one of claims 3 to 8, characterized in that: The method further comprises: Calculating the response index according to the response action of the BAMS device in response to the adjusted test case; the response index also includes action integrity and resource utilization; Evaluating the response speed of the BAMS device to the operating mode under different working conditions according to a first response index; the first response index is calculated by the response action of the test case being the operating mode; Evaluate the processing capability and response speed of the BAMS device to the fault according to a second response indicator; the second response indicator is calculated by the response action of the test case being the fault injection; The adaptability of the BAMS device to the environment is evaluated according to a third response indicator; the third response indicator is calculated by the response action of the test case being the environmental parameter.

10. A BAMS equipment automated testing device, characterized in that: The device comprises: A test case management module, for generating test data in response to a test instruction input by a user, and controlling the simulated BCMS to generate a simulated test signal according to the test data; the simulated BCMS is used to generate the simulated test signal; the simulated test signal is used to test the response performance of the BAMS device; A test execution module, configured to send the analog test signal to the BAMS device and monitor a response action of the BAMS device in response to the analog test signal; The test analysis module is used to calculate the response index of the BAMS device according to the response action, and evaluate the response performance of the BAMS device according to the response index; the response index includes response time and accuracy.

Images