Method and device for simulation and verification of test cases for spacecraft test evaluation

By establishing a digital model and an automated simulation verification system in spacecraft test and identification, the safety hazards that rely on manual verification in the existing technology are solved, and automated closed-loop simulation verification is realized, which improves the safety and perfection of the experimental design.

CN114510818BActive Publication Date: 2024-11-29中国人民解放军63790部队保障部 +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111632462.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-29
Publication Date
2024-11-29
Estimated Expiration
2041-12-29

AI Technical Summary

Technical Problem

In the prior art, the safety and perfection verification and evaluation of spacecraft test and identification use cases rely entirely on manual labor, which leads to designers need to master complete knowledge and maintain high alertness, which can easily bring safety risks and lack of automated test and identification use cases verification. environment.

Method used

By establishing a digital model of the spacecraft, the real test and identification use cases are driven at the logical level of telemetry and remote control function, the automated closed-loop simulation verification of test and identification use cases is realized, and an automated analysis and evaluation report is formed based on the simulation verification results.

Benefits of technology

It realizes automated simulation verification of spacecraft test and identification use cases, simplifies the workload of global test and identification design and evaluation, shortens the task cycle, and enhances the safety and perfection of test design.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114510818B_ABST
    Figure CN114510818B_ABST
Patent Text Reader

Abstract

The present invention discloses a method and device for simulating and verifying test cases for spacecraft test and appraisal, which can solve the problem that the verification and evaluation of the safety and integrity of spacecraft test and appraisal cases completely rely on manual methods. A rule model corresponding to the telemetry and remote control function of the spacecraft test and appraisal project is established; the remote control instructions and telemetry data of the historical spacecraft test and appraisal projects within the time interval are obtained to establish a data model; the rule model and the data model with the same attribute label are combined to form an input-output closed-loop simulation verification model; the remote control command code history record recorded in the data model is compared with the remote control command code input by the rule model, and when the remote control command code is consistent and matches the timing relationship, the telemetry and remote control protocol conversion interface is used to convert the telemetry data output by the data model into the corresponding telemetry parameters under the rule model, completing a round of simulation from excitation to feedback.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of spacecraft test identification and computer simulation, and in particular to a method and device for simulating and verifying test cases for spacecraft test identification. Background Art

[0002] There are many types of spacecraft systems, with large differences in operating modes and states. During the entire life cycle, the operating environment and test and experimental processes vary greatly with the development and use stages and application tasks, resulting in the separation of development and testing, experimental training, maintenance and support process stages, poor state inheritance, and repeated design of test cases. During the testing and experimentation of space-based systems, the verification of complex logical functions within subsystems and between multiple systems gradually shifts to automated test sequence verification. Currently, it is no longer possible to quickly, efficiently, and accurately test and verify the test and training logic functions by relying on manpower.

[0003] The design of automated test sequences contains the design concept of safety and flexibility. The perfection and maturity of the sequence design completely depend on the professional technical level and engineering experience of the test and identification designer. At present, spacecraft has realized an integrated and universal test and identification case design and development environment, but the verification of system test and identification cases can only rely on manual inspection by designers without debugging and simulation environment. Designers need to master comprehensive knowledge and maintain high vigilance to ensure the safety of the case, which is prone to safety hazards in high-density model missions.

[0004] Therefore, a universal test identification case simulation verification technology is needed to simulate and verify the use cases implemented by designers. In addition, this method should be compatible with the existing spacecraft test identification process and tool system, so that the simulation verification design work and results can be easily transplanted into the real test identification business process. Thereby simplifying the workload of global test identification design and evaluation, shortening the mission cycle, and enhancing the safety and completeness of test design. At present, there is a lack of methods for simulation verification and evaluation of the safety and completeness of spacecraft test identification use cases at home and abroad, there is no system-level simulation verification platform based on test identification, there is a lack of joint test evaluation means for test identification function performance, and there is a lack of automated test identification use case verification environment.

[0005] In this context, the present invention proposes a method and device for simulating and verifying test cases for spacecraft test and identification. The method is based on the spacecraft test and identification logic rules and historical data sets, establishes a rule-based model and an empirical data model, and realizes the simulation verification and evaluation of the test and identification operation sequence and its evaluation rules by connecting the spacecraft digital model with the real spacecraft test and identification system. The method of the present invention is based on a virtualized telemetry and remote control data interface, and uses a virtual spacecraft behavior logic unit composed of a rule model and an empirical data model to drive the test and identification case, providing an environmental basis for evaluating the correctness and completeness of the test and identification case. The present invention will help to realize the simulation verification of universal and shared test and identification of space-based and its supporting systems in multiple stages and multiple working modes, which is conducive to shortening the development cycle, reducing the development, training, use and maintenance costs, improving the efficiency of test and identification applications, and effectively ensuring the rapid deployment of space-based systems. Summary of the invention

[0006] In view of this, the present invention provides a method and device for simulating and verifying test cases for spacecraft test and identification, which can solve the problem that the verification and evaluation of the safety and integrity of current spacecraft test and identification cases completely rely on manual methods. The present invention establishes a digital model of the spacecraft, drives the operation of real test and identification cases at the telemetry and remote control function logic level, realizes automated closed-loop simulation verification of the test and identification cases, and forms an automated analysis and evaluation report based on the simulation verification results. The present invention can expand the physical test business of the existing test and identification system to the direction of virtual testing, shorten the test and identification design and verification iteration cycle, reduce development and management costs, and improve the coverage, flexibility and safety of spacecraft test and identification tests.

[0007] In order to solve the above technical problems, the present invention is implemented as follows.

[0008] A test case simulation method for spacecraft test evaluation, comprising:

[0009] Step S1: Determine a spacecraft test and identification project, establish a rule model corresponding to the telemetry and remote control function of the spacecraft test and identification project based on a preset atomic unit, and add an attribute tag to the rule model; the atomic unit is the smallest unit that executes a set of remote control data annotation and telemetry data interpretation function sequences;

[0010] Step S2: obtaining an execution time interval of a historical spacecraft test and identification project with the same attribute tag as the spacecraft test and identification project, obtaining remote control instructions and telemetry data of the historical spacecraft test and identification project within the time interval from historical data, establishing a data model, and adding the attribute tag to the data model;

[0011] Step S3: combining the rule model and the data model with the same attribute label, taking the remote control command output by the rule model as the input of the data model, and taking the telemetry data in the data model as the input of the rule model, to form an input-output closed-loop simulation verification model;

[0012] Step S4: Establish a telemetry and remote control protocol conversion interface, call the simulation verification model in the spacecraft test and identification system, use the telemetry and remote control protocol conversion interface to convert the remote control instructions described in text in the rule model in the simulation verification model into remote control instruction codes, output the remote control instruction codes to the data model according to the timing relationship in the rule model, compare the remote control instruction code history records recorded in the data model with the remote control instruction codes input by the rule model, and when the remote control instruction codes are consistent and match the timing relationship, output the telemetry data recorded after the occurrence of the remote control instruction code in the data model according to the timing relationship, use the telemetry and remote control protocol conversion interface to convert the telemetry data output by the data model into the corresponding telemetry parameters under the rule model, and complete a round of simulation from excitation to feedback;

[0013] Step S5: If the simulation verification model is executed, the method ends; otherwise, the simulation time is increased by 1 step time and the process goes to step S4.

[0014] Preferably, the step S2, obtaining remote control instructions and telemetry data of historical spacecraft test and identification items with the same attribute label as the spacecraft test and identification items within the time interval from historical data, and establishing a data model, comprises:

[0015] Step S21: Obtain all telemetry and remote control data belonging to the input project attributes and time range from the historical data to form a standard format data file D; the data file D contains a series of remote control instructions CD, and each remote control instruction is arranged in chronological order;

[0016] Step S22: define i as the index of the current command to be searched in CT, i is initialized to 1, define j as the index of the current command to be searched in CD, j is initialized to 1; the rule model is referred to as RM, RM includes multiple atomic units, the atomic units are combined in series and in parallel, each atomic unit includes a large number of remote control instructions, define a series of remote control instructions included in RM, the series of remote control instructions constitute a set of remote control instructions, the remote control instructions in the set are sorted in chronological order, and the remote control instruction set is recorded as CT;

[0017] Step S23: Starting from the jth instruction in CD, sequentially traverse to see if it contains the i-th instruction in CT. If so, go to step S24; if not, go to step S25;

[0018] Step S24: Assume that the instruction found in CD that is consistent with the i-th instruction in CT is the k-th instruction, record the k-th instruction in CD and its occurrence time into the data model DM, and determine whether there is a next instruction in CT. If yes, assign i to i+1, assign j to k+1, and go to step S23; if no, go to step S26;

[0019] Step S25: Calculate the local matching rate and determine whether the local matching rate is less than the local matching rate limit. If so, go to step S26; otherwise, ignore the i-th instruction of CD, assign i to i+1, and go to step S23;

[0020] Step S26: Calculate the global matching rate and determine whether the global matching rate is less than the global matching rate limit. If so, a DM similar to RM is not successfully constructed and the method ends. If not, for each remote control command recorded by DM, extract the telemetry data of the time when each matching command occurs and within a period of T thereafter in the data file D, record it in DM, and the method ends.

[0021] Preferably, the local matching rate is: the ratio of the number of instructions found in the data file D that are identical to the instructions in the CT to the number of CT instructions that have been searched up to the calculation time, as follows:

[0022]

[0023] The global matching rate is: after the search is completed, the ratio of the number of instructions found in data file D that are identical to the instructions in CT to the total number of instructions in CT is as follows

[0024]

[0025] Preferably, when scheduling the simulation verification model, the spacecraft test and identification system will use the first instruction of the rule model as the simulation starting point, and drive the rule model and data model to run with a fixed step length. The output of the rule model is based on its preset timing relationship; the output of the data model is based on the remote control instruction input to it by the rule model and the current simulation time. If the data model contains the remote control instruction code input to it by the rule model, and the interval between the current simulation time and the simulation starting point exceeds the time interval between the remote control instruction and the first remote control instruction in the data model, then in the subsequent T period, the data model outputs the telemetry data corresponding to the remote control instruction to the rule model at each time point according to the simulation step length.

[0026] The present invention provides a test case verification method for spacecraft test evaluation, which verifies the simulation method as described above, and includes the following steps:

[0027] Step S6: Obtain the number of instruction reception timeouts, timeout length, and invalid instruction reception times of the rule model and / or data model during the simulation process to determine the maturity of the test case; wherein, the invalid instruction is a remote control instruction output by the rule model but not recorded by the data model; instruction reception timeout refers to the situation that the simulation time when the data model receives the remote control instruction exceeds the preset time of the recording time corresponding to the instruction, and the preset time can be set. The number of instruction reception timeouts is the number of occurrences of the above situation; the instruction reception timeout length is the total timeout length corresponding to all instruction reception timeout situations; the maturity is calculated as follows:

[0028]

[0029] Among them, the number of instruction reception timeouts and the length of instruction reception timeout represent the discontinuity of instructions sent by the use case, and the number of invalid instruction receptions represents the erroneous instructions sent by the test identification use case.

[0030] The present invention provides a test case simulation device for spacecraft test evaluation, the device comprising:

[0031] A rule model generation module is configured to determine a spacecraft test and identification project, establish a rule model corresponding to the telemetry and remote control function of the spacecraft test and identification project based on a preset atomic unit, and add an attribute tag to the rule model; the atomic unit is the smallest unit that executes a set of remote control data annotation and telemetry data interpretation function sequences;

[0032] A data model generation module: configured to obtain an execution time interval of a historical spacecraft test and identification project having the same attribute tag as the spacecraft test and identification project, obtain remote control instructions and telemetry data of the historical spacecraft test and identification project within the time interval from historical data, establish a data model, and add the attribute tag to the data model;

[0033] Simulation verification model generation module: configured to combine the rule model and the data model with the same attribute label, use the remote control command output by the rule model as the input of the data model, and use the telemetry data in the data model as the input of the rule model, to form an input-output closed-loop simulation verification model;

[0034] Simulation module: configured to establish a telemetry and remote control protocol conversion interface, call the simulation verification model in the spacecraft test and identification system, use the telemetry and remote control protocol conversion interface to convert the remote control instructions described in text in the rule model in the simulation verification model into remote control instruction codes, output the remote control instruction codes to the data model according to the timing relationship in the rule model, compare the remote control instruction code history records recorded in the data model with the remote control instruction codes input by the rule model, and when the remote control instruction codes are consistent and match the timing relationship, output the telemetry data recorded after the occurrence of the remote control instruction code in the data model according to the timing relationship, use the telemetry and remote control protocol conversion interface to convert the telemetry data output by the data model into the corresponding telemetry parameters under the rule model, and complete a round of simulation from excitation to feedback;

[0035] Judgment module: If the simulation verification model is executed, the execution is completed and ends; otherwise, the simulation time is increased by 1 step time, and the simulation module is triggered.

[0036] The present invention provides a test case verification device for spacecraft test evaluation, which verifies the simulation device as described above, including:

[0037] Verification module: configured to obtain the number of instruction reception timeouts, timeout length and invalid instruction reception times of the rule model and / or data model during the simulation process, and determine the maturity of the test case; wherein the invalid instruction is a remote control instruction output by the rule model but not recorded by the data model; instruction reception timeout refers to the situation that the simulation time when the data model receives the remote control instruction exceeds the preset time of the recording time corresponding to the instruction, and the preset time can be set. The number of instruction reception timeouts is the number of occurrences of the above situation; the instruction reception timeout length is the total timeout length corresponding to all instruction reception timeout situations; the maturity is calculated as follows:

[0038]

[0039] Among them, the number of instruction reception timeouts and the length of instruction reception timeout represent the discontinuity of instructions sent by the use case, and the number of invalid instruction receptions represents the erroneous instructions sent by the test identification use case.

[0040] Beneficial effects:

[0041] (1) The solution described in the present invention supports the input of spacecraft telemetry and remote control logic rules in various forms to form a rule-based model, which is convenient for simulating test identification cases involving verification of software logic. In response to different simulation verification requirements, the solution provides a fast batch data extraction function based on real spacecraft test identification conditions, which can quickly extract relevant historical telemetry and remote control data under predefined conditions and scenarios, customize digital models according to simulation verification conditions, and form a simulation verification environment for specific test identification cases, thereby enhancing the authenticity and credibility of the simulation verification of the test identification cases. At the same time, the solution can also automatically generate analysis and evaluation reports based on the simulation results of the test identification cases, assisting test identification designers in modifying and improving the test identification cases.

[0042] (2) The scheme of the present invention constitutes an interoperable middleware between the spacecraft test and evaluation system and various spacecraft digital models or simulation systems. By providing a rich data interface, it can drive rules-based telemetry and remote control input and output models, single-machine / subsystem digital mechanism models, software logic models compiled in standard formats, and empirical data set models formed by historical data, etc., to form a virtualized whole-star equipment model and test and evaluation case simulation verification environment. The scheme can provide universal and scalable interface support for digital simulation verification in various forms and levels, and enhance the interoperability of digital models and spacecraft test systems.

[0043] (3) The scheme described in the present invention fills the methodological gap in the relevant field and can combine various forms of spacecraft models to provide verification and evaluation support means for test identification use cases. It can verify its logical correctness in a real, reliable and safe manner, thereby improving the efficiency of test identification and evaluation work, improving the evaluation quality of test identification use cases, and reducing safety risks and management costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A schematic diagram of a flow chart of a test case simulation method for spacecraft test identification according to an embodiment of the present invention;

[0045] Figure 2 The present invention is a flowchart of a test case simulation method for spacecraft test identification according to another embodiment of the present invention. DETAILED DESCRIPTION

[0046] The present invention is described in detail below in conjunction with the accompanying drawings and embodiments.

[0047] The present invention provides a test case simulation method for spacecraft test evaluation, such as Figure 1 As shown, the following steps are included:

[0048] Step S1: Determine a spacecraft test and identification project, establish a rule model corresponding to the telemetry and remote control function of the spacecraft test and identification project based on a preset atomic unit, and add an attribute tag to the rule model; the atomic unit is the smallest unit that executes a set of remote control data annotation and telemetry data interpretation function sequences;

[0049] Step S2: obtaining an execution time interval of a historical spacecraft test and identification project with the same attribute tag as the spacecraft test and identification project, obtaining remote control instructions and telemetry data of the historical spacecraft test and identification project within the time interval from historical data, establishing a data model, and adding the attribute tag to the data model;

[0050] Step S3: combining the rule model and the data model with the same attribute label, taking the remote control command output by the rule model as the input of the data model, and taking the telemetry data in the data model as the input of the rule model, to form an input-output closed-loop simulation verification model;

[0051] Step S4: Establish a telemetry and remote control protocol conversion interface, call the simulation verification model in the spacecraft test and identification system, use the telemetry and remote control protocol conversion interface to convert the remote control instructions described in text in the rule model in the simulation verification model into remote control instruction codes, output the remote control instruction codes to the data model according to the timing relationship in the rule model, compare the remote control instruction code history records recorded in the data model with the remote control instruction codes input by the rule model, and when the remote control instruction codes are consistent and match the timing relationship, output the telemetry data recorded after the occurrence of the remote control instruction code in the data model according to the timing relationship, use the telemetry and remote control protocol conversion interface to convert the telemetry data output by the data model into the corresponding telemetry parameters under the rule model, and complete a round of simulation from excitation to feedback;

[0052] Step S5: If the simulation verification model is executed, the method ends; otherwise, the simulation time is increased by 1 step time and the process goes to step S4.

[0053] The present invention establishes a spacecraft rule model and a data model based on historical test data for simulation verification of spacecraft test and identification cases. The data model is constructed using an instruction matching algorithm, which is based on real spacecraft test and identification cases and test data to quickly extract relevant telemetry and remote control information under predefined conditions, forming a simulation verification environment for specific test and identification cases.

[0054] In the step S1, the atomic unit is the minimum unit for executing a set of remote control data injection and telemetry data reading function sequences. The atomic unit is pre-set and has multiple types of atomic units, for example, conditional judgment and selection atomic units, loop atomic units, interrupt atomic units, timing atomic units, and custom static equation atomic units. The conditional judgment and selection atomic unit is used to judge parameters and select subsequent execution branches; the loop atomic unit is used to execute loop operations under specified conditions; the interrupt atomic unit is used to jump out of the loop atom and transfer to another set of execution sequences; the timing atomic unit is used to wait for a fixed length of time; and the custom equation atomic unit is used to calculate telemetry in the form of a function.

[0055] In this embodiment, based on the design report or the spacecraft test and identification details document, and the pre-set atomic units, the pre-set atomic units are combined in a serial or parallel manner to establish a rule model corresponding to a spacecraft function to be tested by the spacecraft test and identification project, and attribute labels of the spacecraft test and identification project are added to the rule model, and the rule model is stored in a model library.

[0056] The pre-set atomic units are combined in a serial and parallel manner, wherein adding and editing atomic units on the original time series line is a serial combination of atomic units; creating a new time series line, adding and editing atomic units on the new time series line, and executing them in parallel with the original time series line is a parallel combination of atomic units.

[0057] The rule model is referred to as RM. RM contains multiple atomic units. The atomic units are combined in series and parallel with each other. Each atomic unit includes many remote control instructions. A series of remote control instructions contained in RM is further defined. The series of remote control instructions constitute a set of remote control instructions. The remote control instructions in the set are sorted in chronological order. The remote control instruction set is recorded as CT.

[0058] like Figure 2 As shown, the step S2, obtaining the remote control instructions and telemetry data of the historical spacecraft test and identification items with the same attribute label as the spacecraft test and identification items within the time interval from the historical data, and establishing the data model includes:

[0059] Step S21: Obtain all telemetry and remote control data belonging to the input project attributes and time range from the historical data to form a standard format data file D; the data file D contains a series of remote control instructions CD, and each remote control instruction is arranged in chronological order;

[0060] Step S22: define i as the index of the current instruction to be searched in CT, i is initialized to 1, define j as the index of the current instruction to be searched in CD, j is initialized to 1;

[0061] Step S23: Starting from the jth instruction in CD, sequentially traverse to see if it contains the i-th instruction in CT. If so, go to step S24; if not, go to step S25;

[0062] Step S24: Assume that the instruction found in CD that is consistent with the i-th instruction in CT is the k-th instruction, record the k-th instruction in CD and its occurrence time into the data model DM, and determine whether there is a next instruction in CT. If yes, assign i to i+1, assign j to k+1, and go to step S23; if no, go to step S26;

[0063] Step S25: Calculate the local matching rate and determine whether the local matching rate is less than the local matching rate limit. If so, go to step S26; otherwise, ignore the i-th instruction of CD, assign i to i+1, and go to step S23;

[0064] Step S26: Calculate the global matching rate and determine whether the global matching rate is less than the global matching rate limit. If so, a DM similar to RM is not successfully constructed and the method ends. If not, for each remote control command recorded by DM, extract the telemetry data of the time when each matching command occurs and within a period of T thereafter in the data file D, record it in DM, and the method ends.

[0065] In this embodiment, the local matching rate is defined as: the ratio of the number of instructions found in the data file D that are identical to the instructions in the CT to the number of CT instructions that have been searched, as follows:

[0066]

[0067] The global matching rate is defined as the ratio of the number of instructions found in the data file D that are identical to the instructions in CT to the total number of instructions in CT after the search is completed, as follows:

[0068]

[0069] The local match rate limit is smaller than the global match rate limit to tolerate the short-term mismatch in the early search process. The local match rate threshold and the global match rate threshold are determined based on experience and can be taken as 0.2 and 0.8 respectively. Further, in this embodiment, the data file D may contain a large number of remote control commands and telemetry data history records that are not related to the remote control command CT in the rule model RM. Therefore, from the perspective of the set, CT and CD have an intersection, but CT does not necessarily belong to CD. CD may contain historical data content far exceeding the remote control commands in CT. In the process of finally extracting the data model DM, the recorded remote control commands and their occurrence times are stored in DM. Assuming that any remote control command in the recorded command set is ctr, and its corresponding occurrence time is t0, all telemetry data related to ctr in the data file D from t0 to t0+T are extracted and recorded in DM, and these remote control and telemetry data are spliced ​​according to relative time to form the final data model DM. The time period T is a preset value, generally 1 minute.

[0070] In this embodiment, the final determined global matching rate is the final matching rate, which is used to measure the differences in the test cases identified in the data experiment.

[0071] In step S3, based on the rule model and the data model, a simulation verification model library of input and output behaviors in the spacecraft system-level operating environment is constructed. The model is organized by the subsystem category corresponding to the model to form a tree structure, and the category of the test and identification project is used as an attribute label to support indexing the model by subsystem category and test and identification project category.

[0072] In step S4, the rule model describes the remote control command with text and describes the telemetry data with parameters, the data model describes the remote control command with remote control command code and describes the telemetry data with telemetry code, and the telemetry remote control protocol conversion interface completes the corresponding conversion of different description methods of remote control commands and telemetry data in the rule model and the data model.

[0073] In this embodiment, when scheduling the simulation verification model, the spacecraft test and evaluation system will use the first instruction of the rule model as the simulation starting point, and drive the rule model and the data model to run with a fixed step length. The output of the rule model is based on its preset timing relationship; the output of the data model is based on the remote control instruction input to it by the rule model and the current simulation time. If the data model contains the remote control instruction code input to it by the rule model, and the interval between the current simulation time and the simulation starting point exceeds the time interval between the remote control instruction and the first remote control instruction in the data model, then in the subsequent T period, the data model outputs the telemetry data corresponding to the remote control instruction to the rule model at each time point according to the simulation step length.

[0074] The present invention also provides a test case verification method for spacecraft test evaluation, which is used to verify the simulated test case as described above, and includes the following steps:

[0075] Step S6: Obtain the number of instruction reception timeouts, timeout length, and invalid instruction reception times of the rule model and / or data model during the simulation process to determine the maturity of the test case; wherein, the invalid instruction is a remote control instruction output by the rule model but not recorded by the data model; instruction reception timeout refers to the situation that the simulation time when the data model receives the remote control instruction exceeds the preset time of the recording time corresponding to the instruction, and the preset time can be set. The number of instruction reception timeouts is the number of occurrences of the above situation; the instruction reception timeout length is the total timeout length corresponding to all instruction reception timeout situations; the maturity is calculated as follows:

[0076]

[0077] Among them, the number of instruction reception timeouts and the length of instruction reception timeout represent the discontinuity of instructions sent by the use case, and the number of invalid instruction receptions represents the erroneous instructions sent by the test identification use case.

[0078] Furthermore, the number of command acceptance timeouts, the number of invalid command acceptances, the total number of command acceptances, the length of command reception timeouts, and the maturity are counted in the form of reports to assist in evaluating the completeness of the test cases.

[0079] The present invention performs simulation verification on experimental identification test cases.

[0080] The projects are as follows:

[0081]

[0082] The simulation test output results are as follows:

[0083]

[0084]

[0085]

[0086] The present invention also provides a test case simulation device for spacecraft test and evaluation, the device comprising a rule model generation module: configured to determine a spacecraft test and evaluation item, establish a rule model corresponding to the telemetry and remote control function of the spacecraft test and evaluation item based on a preset atomic unit, and add an attribute tag to the rule model; the atomic unit is the smallest unit for executing a set of remote control data annotation and telemetry data interpretation function sequences;

[0087] A data model generation module: configured to obtain an execution time interval of a historical spacecraft test and identification project having the same attribute tag as the spacecraft test and identification project, obtain remote control instructions and telemetry data of the historical spacecraft test and identification project within the time interval from historical data, establish a data model, and add the attribute tag to the data model;

[0088] Simulation verification model generation module: configured to combine the rule model and the data model with the same attribute label, use the remote control command output by the rule model as the input of the data model, and use the telemetry data in the data model as the input of the rule model, to form an input-output closed-loop simulation verification model;

[0089] Simulation module: configured to establish a telemetry and remote control protocol conversion interface, call the simulation verification model in the spacecraft test and identification system, use the telemetry and remote control protocol conversion interface to convert the remote control instructions described in text in the rule model in the simulation verification model into remote control instruction codes, output the remote control instruction codes to the data model according to the timing relationship in the rule model, compare the remote control instruction code history records recorded in the data model with the remote control instruction codes input by the rule model, and when the remote control instruction codes are consistent and match the timing relationship, output the telemetry data recorded after the occurrence of the remote control instruction code in the data model according to the timing relationship, use the telemetry and remote control protocol conversion interface to convert the telemetry data output by the data model into the corresponding telemetry parameters under the rule model, and complete a round of simulation from excitation to feedback;

[0090] Judgment module: If the simulation verification model is executed, the execution is completed and ends; otherwise, the simulation time is increased by 1 step time, and the simulation module is triggered.

[0091] The present invention also provides a test case verification device for spacecraft test identification, the device includes a verification module: configured to obtain the number of instruction reception timeouts, timeout length and invalid instruction reception number of the rule model and / or data model in the simulation process, and determine the maturity of the test case; wherein the invalid instruction is a remote control instruction output by the rule model but not recorded by the data model; the instruction reception timeout refers to the situation that the simulation time when the data model receives the remote control instruction exceeds the preset time of the recording time corresponding to the instruction, the preset time can be set, and the number of instruction reception timeouts is the number of occurrences of the above situation; the instruction reception timeout length is the total timeout length corresponding to all instruction reception timeout situations; the maturity is calculated as follows:

[0092]

[0093] Among them, the number of instruction reception timeouts and the length of instruction reception timeout represent the discontinuity of instructions sent by the use case, and the number of invalid instruction receptions represents the erroneous instructions sent by the test identification use case.

[0094] The above specific embodiments only describe the design principle of the present invention. The shapes and names of the components in the description may be different and are not limited. Therefore, those skilled in the art in the field of the present invention may modify or replace the technical solutions recorded in the above embodiments; and these modifications and replacements do not deviate from the creative purpose and technical solutions of the present invention and should all fall within the protection scope of the present invention.

Claims

1. A test case simulation method for spacecraft test evaluation, characterized in that: The steps include: Step S1: Determine a spacecraft test and identification project, establish a rule model corresponding to the telemetry and remote control function of the spacecraft test and identification project based on a preset atomic unit, and add an attribute tag to the rule model; The atomic unit is the smallest unit that executes a set of remote control data injection and telemetry data interpretation function sequences; Step S2: obtaining an execution time interval of a historical spacecraft test and identification project with the same attribute tag as the spacecraft test and identification project, obtaining remote control instructions and telemetry data of the historical spacecraft test and identification project within the time interval from historical data, establishing a data model, and adding the attribute tag to the data model; The step S2, obtaining remote control instructions and telemetry data of historical spacecraft test and evaluation items with the same attribute label as the spacecraft test and evaluation items within the time interval from historical data, and establishing a data model, includes: Step S21: Obtain all telemetry and telecontrol data belonging to the input project attributes and time range from the historical data to form a standard format data file D; The data file D contains a series of remote control commands CD, and each remote control command is arranged in chronological order; Step S22: define i as the index of the current command to be searched in CT, i is initialized to 1, define j as the index of the current command to be searched in CD, j is initialized to 1; the rule model is referred to as RM, RM includes multiple atomic units, the atomic units are combined in series and in parallel, each atomic unit includes a large number of remote control instructions, define a series of remote control instructions included in RM, the series of remote control instructions constitute a set of remote control instructions, the remote control instructions in the set are sorted in chronological order, and the remote control instruction set is recorded as CT; Step S23: Starting from the jth instruction in CD, sequentially traverse to see if it contains the i-th instruction in CT. If so, go to step S24; if not, go to step S25; Step S24: Assume that the instruction found in CD that is consistent with the i-th instruction in CT is the k-th instruction, record the k-th instruction in CD and its occurrence time into the data model DM, and determine whether there is a next instruction in CT. If yes, assign i to i+1, assign j to k+1, and go to step S23; if no, go to step S26; Step S25: Calculate the local matching rate and determine whether the local matching rate is less than the local matching rate limit. If so, go to step S26; otherwise, ignore the i-th instruction of CD, assign i to i+1, and go to step S23; Step S26: Calculate the global matching rate and determine whether the global matching rate is less than the global matching rate limit. If so, a DM similar to the RM is not successfully constructed and the method ends. If not, for each remote control command recorded by the DM, extract the telemetry data within the time period T after the occurrence of each matching command in the data file D and record it in the DM, and the method ends. The local matching rate is the ratio of the number of instructions found in the data file D that are identical to the instructions in CT to the number of CT instructions that have been searched, as follows: The global matching rate is: after the search is completed, the ratio of the number of instructions found in data file D that are identical to the instructions in CT to the total number of instructions in CT is as follows Step S3: combining the rule model and the data model with the same attribute label, taking the remote control command output by the rule model as the input of the data model, and taking the telemetry data in the data model as the input of the rule model, to form an input-output closed-loop simulation verification model; Step S4: Establish a telemetry and remote control protocol conversion interface, call the simulation verification model in the spacecraft test and identification system, use the telemetry and remote control protocol conversion interface to convert the remote control instructions described in text in the rule model in the simulation verification model into remote control instruction codes, output the remote control instruction codes to the data model according to the timing relationship in the rule model, compare the remote control instruction code history records recorded in the data model with the remote control instruction codes input by the rule model, and when the remote control instruction codes are consistent and match the timing relationship, output the telemetry data recorded after the occurrence of the remote control instruction code in the data model according to the timing relationship, use the telemetry and remote control protocol conversion interface to convert the telemetry data output by the data model into the corresponding telemetry parameters under the rule model, and complete a round of simulation from excitation to feedback; Step S5: If the simulation verification model is executed, the method ends; otherwise, the simulation time is increased by 1 step time and the process goes to step S4.

2. The method according to claim 1, characterized in that When scheduling the simulation verification model, the spacecraft test and identification system will use the issuance of the first instruction of the rule model as the simulation starting point, and drive the rule model and the data model to run with a fixed step size; the output of the rule model is based on its preset timing relationship; the output of the data model is based on the remote control instruction input to it by the rule model and the current simulation time. If the data model contains the remote control instruction code input to it by the rule model, and the interval time between the current simulation time and the simulation starting point exceeds the time interval between the remote control instruction and the first remote control instruction in the data model, then in the subsequent T period of time, the data model outputs the telemetry data corresponding to the remote control instruction to the rule model at each time point according to the simulation step size.

3. A test case verification method for spacecraft test evaluation, verifying the simulation method as claimed in any one of claims 1-2, comprising the following steps: Step S6: Obtain the number of instruction reception timeouts, timeout lengths, and invalid instruction reception times of the rule model and / or data model during the simulation process to determine the maturity of the test case; wherein, Invalid instructions are remote control instructions output by the rule model but not recorded by the data model; instruction reception timeout refers to the situation that the simulation time when the data model receives the remote control instruction exceeds the preset time of the instruction corresponding to the recording time, and the preset time can be set. The number of instruction reception timeouts is the number of occurrences of the above situation; the instruction reception timeout length is the total timeout length corresponding to all instruction reception timeout situations; the maturity is calculated as follows: Among them, the number of instruction reception timeouts and the length of instruction reception timeout represent the discontinuity of instructions sent by the use case, and the number of invalid instruction receptions represents the erroneous instructions sent by the test identification use case.

4. A test case simulation device for spacecraft test evaluation, applied to the simulation method as claimed in claim 1, characterized in that: include: A rule model generation module: configured to determine a spacecraft test and identification project, establish a rule model corresponding to the telemetry and remote control function of the spacecraft test and identification project based on a preset atomic unit, and add an attribute tag to the rule model; The atomic unit is the smallest unit that executes a set of remote control data injection and telemetry data interpretation function sequences; A data model generation module: configured to obtain an execution time interval of a historical spacecraft test and identification project having the same attribute tag as the spacecraft test and identification project, obtain remote control instructions and telemetry data of the historical spacecraft test and identification project within the time interval from historical data, establish a data model, and add the attribute tag to the data model; Simulation verification model generation module: configured to combine the rule model and the data model with the same attribute label, use the remote control command output by the rule model as the input of the data model, and use the telemetry data in the data model as the input of the rule model, to form an input-output closed-loop simulation verification model; Simulation module: configured to establish a telemetry and remote control protocol conversion interface, call the simulation verification model in the spacecraft test and identification system, use the telemetry and remote control protocol conversion interface to convert the remote control instructions described in text in the rule model in the simulation verification model into remote control instruction codes, output the remote control instruction codes to the data model according to the timing relationship in the rule model, compare the remote control instruction code history records recorded in the data model with the remote control instruction codes input by the rule model, and when the remote control instruction codes are consistent and match the timing relationship, output the telemetry data recorded after the occurrence of the remote control instruction code in the data model according to the timing relationship, use the telemetry and remote control protocol conversion interface to convert the telemetry data output by the data model into the corresponding telemetry parameters under the rule model, and complete a round of simulation from excitation to feedback; Judgment module: If the simulation verification model is executed, the execution is completed and ends; otherwise, the simulation time is increased by 1 step time, and the simulation module is triggered.

5. A test case verification device for spacecraft test evaluation, verifying the simulation device as claimed in claim 4, comprising: Verification module: configured to obtain the number of instruction reception timeouts, timeout length and invalid instruction reception times of the rule model and / or data model during the simulation process, and determine the maturity of the test case; wherein the invalid instruction is a remote control instruction output by the rule model but not recorded by the data model; instruction reception timeout refers to the situation that the simulation time when the data model receives the remote control instruction exceeds the preset time of the recording time corresponding to the instruction, and the preset time can be set. The number of instruction reception timeouts is the number of occurrences of the above situation; the instruction reception timeout length is the total timeout length corresponding to all instruction reception timeout situations; the maturity is calculated as follows: Among them, the number of instruction reception timeouts and the length of instruction reception timeout represent the discontinuity of instructions sent by the use case, and the number of invalid instruction receptions represents the erroneous instructions sent by the test identification use case.

Citation Information

Patent Citations

  • Modeled onboard data processing simulation testing method

    CN105512372A

  • Model-based automated test method for spacecraft system

    CN107066382A