Method and system for detecting standard conformity of test data

Abstract

The invention discloses a method and a system for detecting the standard conformity of test data. The method comprises the following steps: constructing a standard reference library; determining an inspection task, and determining a data source of the detected test data based on the inspection task; configuring a process engine for standard conformity detection; and obtaining the detected test data based on the data source, and carrying out standard conformity detection on the detected test data based on the process engine and the standard reference library to obtain a detection result. According to the method, the standard conformity checking work of the test data related software can be automatically completed, and based on the extensible process engine, universal test data standard conformity checking is achieved by providing data analysis, checking methods, checking algorithms, report templates and other tools which can be flexibly configured, the checking efficiency is improved, and the checking progress is guaranteed.

Description

Technical Field

[0001] The present invention relates to the technical field of data detection, and more particularly, to a method and system for detecting standard compliance of test data. Background Art

[0002] In the process of equipment development, a large number of tests are required to verify the functions and performance indicators of the equipment design. In order to effectively collect, store, manage, analyze and apply test data, it is necessary to establish necessary information tools and systems. In the process of building the system, it is necessary to use test data standards as a basis to achieve standardized collection and storage of test data, facilitate the analysis, mining, exchange and sharing of test data, and enhance the value of test data.

[0003] In order to ensure that the test data standards can be well implemented, it is necessary to conduct a standard compliance check on the test data management system according to the standards. First, build a standard benchmark library based on the data standard text, then connect the inspection platform and tools to the inspected system, and check the integrity, accuracy, uniqueness and excess of the data. After the inspection is completed, perform data analysis and report generation.

[0004] At present, due to the large number of standards and specifications in the test field and the complexity and variety of the specifications, standard compliance checks for test data management software are mostly carried out manually, and the inspection process is time-consuming and laborious. With the development of information technology, standard compliance inspection tools have been initially applied in standard compliance inspections in the fields of equipment support technical manual standards and aerospace electronic drawing standards. However, due to the different fields and difficulties of standard formulation, the existence of misunderstanding errors and special deviations in the implementation of standards, standard compliance inspection tools are difficult to be universal, and standard compliance inspection tools in specific fields cannot be promoted and applied to other fields.

[0005] In order to check the compliance with the standards, the existing technical solution is to use manual direct operation of the software to check the compliance with the standards of the software according to the external display of the software. The main work includes:

[0006] 1) Check indicator extraction

[0007] Indicators for standard compliance checking are extracted based on the test data standard document. The granularity requirement is moderate, which can facilitate standard compliance checking and reflect the standard compliance of the inspected object.

[0008] 2) Determination of evaluation method

[0009] After checking each inspection indicator, it is necessary to formulate corresponding evaluation rules to determine whether the inspection indicator meets the standard requirements. At the same time, after completing the inspection of all inspection indicators required by the standard, it is necessary to formulate a standard compliance level to evaluate the standard compliance of the inspected object.

[0010] 3) Standards compliance inspection

[0011] Manually operate the inspected object, verify the inspection indicators through the feedback results of the inspected object, so as to determine whether each inspection indicator meets the standard requirements, and record the inspection results.

[0012] 4) Evaluation of inspection results

[0013] After completing the inspection of all inspection indicators, all inspection results are counted, and the standard compliance of the inspected objects is evaluated according to the standard compliance level, and all non-compliant inspection indicators are listed.

[0014] The disadvantages of the existing technical solutions include:

[0015] 1) Heavy workload and low efficiency

[0016] This technical solution requires targeted operations for each inspection indicator, with many operations, and the operation methods for different inspection indicators may vary greatly. After the inspection is completed, the inspection results need to be manually counted, which is a lot of work.

[0017] 2) The accuracy of the inspection results cannot be guaranteed

[0018] Due to the large differences in the content of the standards and specifications, some inspection indicators may not be able to obtain inspection results through the operation software, and some inspection indicators may not be operated enough due to the large amount of data, and the accuracy of the inspection results is questionable. Due to the above reasons, the accuracy of the final inspection results cannot be guaranteed.

[0019] Therefore, a scalable method for testing the standard compliance of test data is needed. Summary of the invention

[0020] The present invention provides a method and system for detecting the standard compliance of test data, so as to solve the problem of how to detect the standard compliance of test data.

[0021] In order to solve the above problem, according to one aspect of the present invention, a method for detecting standard compliance of test data is provided, the method comprising:

[0022] Build a standard benchmark library;

[0023] Determine an inspection task, and determine a data source of the detected test data based on the inspection task;

[0024] Configuration of the process engine for standards compliance testing;

[0025] The detected test data is acquired based on the data source, and standard compliance detection is performed on the detected test data based on the process engine and the standard reference library to acquire a detection result.

[0026] Preferably, the method further comprises:

[0027] Before building the standard reference library, basic data is imported; wherein the basic data includes: test data standards, compliance inspection status, compliance inspection results and inspected units.

[0028] Preferably, the construction of a standard benchmark library includes:

[0029] Recognize the content of the standard text and convert the content of the standard text into a converted text from which words can be extracted;

[0030] Performing word segmentation processing on the converted text, and extracting data according to preset extraction rules, so as to extract different data to corresponding positions;

[0031] Based on the preset data mapping rules, the extracted data is associated with the standard benchmark library to realize the construction of the standard benchmark library.

[0032] Preferably, the method further comprises:

[0033] Perform data correction and completion operations on the data in the standard reference library.

[0034] Preferably, the process engine includes: a data source parsing engine, an inspection indicator importing engine, an inspection interpretation engine, an inspection result displaying engine and an inspection report generating engine.

[0035] According to another aspect of the present invention, there is provided a system for detecting standard compliance of test data, the system comprising:

[0036] A standard benchmark library building unit, used for building a standard benchmark library;

[0037] A data source determination unit, used to determine an inspection task, and determine a data source of the detected test data based on the inspection task;

[0038] Configuration unit, used for configuration of process engine for standard compliance detection;

[0039] The detection unit is used to obtain the detected test data based on the data source, and perform standard compliance detection on the detected test data based on the process engine and the standard reference library to obtain a detection result.

[0040] Preferably, the system further comprises:

[0041] The basic data import unit is used to import basic data before building the standard reference library; wherein the basic data includes: test data standards, compliance check status, compliance check results and inspected units.

[0042] Preferably, the standard reference library building unit builds the standard reference library, including:

[0043] Recognize the content of the standard text and convert the content of the standard text into a converted text from which words can be extracted;

[0044] Performing word segmentation processing on the converted text, and extracting data according to preset extraction rules, so as to extract different data to corresponding positions;

[0045] Based on the preset data mapping rules, the extracted data is associated with the standard benchmark library to realize the construction of the standard benchmark library.

[0046] Preferably, the standard reference library building unit is further used for:

[0047] Perform data correction and completion operations on the data in the standard reference library.

[0048] Preferably, the process engine includes: a data source parsing engine, an inspection indicator importing engine, an inspection interpretation engine, an inspection result displaying engine and an inspection report generating engine.

[0049] The present invention provides a method and system for testing the standard compliance of test data, including: building a standard reference library; determining an inspection task, and determining the data source of the test data to be inspected based on the inspection task; configuring a process engine for standard compliance inspection; acquiring the test data to be inspected based on the data source, and performing a standard compliance inspection on the test data to be inspected based on the process engine and the standard reference library to obtain the inspection result. The present invention can automatically complete the standard compliance inspection of test data related software, and based on an extensible process engine, by providing flexibly configurable data analysis, inspection methods, inspection algorithms, report templates and other tools, thereby realizing a universal test data standard compliance inspection, improving inspection efficiency, and ensuring inspection progress. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] A more complete understanding of exemplary embodiments of the present invention may be obtained by referring to the following drawings:

[0051] Figure 1 A flowchart of a method 100 for detecting standard compliance of test data according to an embodiment of the present invention;

[0052] Figure 2 A flowchart of a standard compliance test according to an embodiment of the present invention;

[0053] Figure 3 A flowchart for building a standard benchmark library according to an embodiment of the present invention;

[0054] Figure 4 FIG. 4 is a schematic diagram of the structure of a system 400 for detecting standard compliance of test data according to an embodiment of the present invention. DETAILED DESCRIPTION

[0055] Now, exemplary embodiments of the present invention are described with reference to the accompanying drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. These embodiments are provided to disclose the present invention in detail and completely and to fully convey the scope of the present invention to those skilled in the art. The terms used in the exemplary embodiments shown in the accompanying drawings are not intended to limit the present invention. In the accompanying drawings, the same units / elements are marked with the same reference numerals.

[0056] Unless otherwise specified, the terms (including technical terms) used herein have the commonly understood meanings to those skilled in the art. In addition, it is understood that the terms defined in commonly used dictionaries should be understood to have the same meanings as those in the context of the relevant fields, and should not be understood as idealized or overly formal meanings.

[0057] Figure 1 FIG. 1 is a flow chart of a method 100 for detecting standard compliance of test data according to an embodiment of the present invention. Figure 1 As shown, the method for detecting the standard compliance of test data provided by the embodiment of the present invention can automatically complete the standard compliance inspection of test data related software, and based on the extensible process engine, by providing flexibly configurable data analysis, inspection methods, inspection algorithms, report templates and other tools, thereby realizing universal test data standard compliance inspection, improving inspection efficiency, and ensuring inspection progress. The method 100 for detecting the standard compliance of test data provided by the embodiment of the present invention starts from step 101. In step 101, a standard reference library is constructed.

[0058] Preferably, the method further comprises:

[0059] Before building the standard reference library, basic data is imported; wherein the basic data includes: test data standards, compliance inspection status, compliance inspection results and inspected units.

[0060] Preferably, the construction of a standard benchmark library includes:

[0061] Recognize the content of the standard text and convert the content of the standard text into a converted text from which words can be extracted;

[0062] Performing word segmentation processing on the converted text, and extracting data according to preset extraction rules, so as to extract different data to corresponding positions;

[0063] Based on the preset data mapping rules, the extracted data is associated with the standard benchmark library to realize the construction of the standard benchmark library.

[0064] Preferably, the method further comprises:

[0065] Perform data correction and completion operations on the data in the standard reference library.

[0066] Combination Figure 2 As shown, in the present invention, basic data is imported before the standard compliance check is performed, including:

[0067] 1) Test data standards: including standard number, standard name, implementation date, issuing agency, etc.;

[0068] 2) Compliance check status: including not started, in progress, suspended, and completed;

[0069] 3) Compliance check results: including pass and fail;

[0070] 4) Inspected unit: including the unit name and affiliated organization.

[0071] In the present invention, a standard reference library needs to be created before the standard compliance check is performed, so that the data of the inspected object can be compared with the standard reference library to verify the accuracy, completeness, uniqueness and excess of the data. The data in the standard reference library is automatically extracted and manually verified. The standard reference library construction process is as follows: Figure 3 Specifically, it includes:

[0072] 1) Text recognition: Use OCR technology to recognize standard text content in PDF format and convert the standard text into extractable text format;

[0073] 2) Data extraction: After using natural language processing technology to perform word segmentation, different data are extracted to corresponding positions according to data extraction rules;

[0074] 3) Data mapping: Based on data mapping rules, the extracted data is associated with the standard benchmark library according to the mapping rules, and the data is automatically stored;

[0075] 4) Manual verification: For the benchmark database, data correction and data completion are performed manually to ensure the data quality in the benchmark database.

[0076] In step 102, an inspection task is determined, and a data source of the detected test data is determined based on the inspection task.

[0077] In step 103, the process engine for standard compliance detection is configured.

[0078] Preferably, the process engine includes: a data source parsing engine, an inspection indicator importing engine, an inspection interpretation engine, an inspection result displaying engine and an inspection report generating engine.

[0079] In the present invention, the planning of inspection tasks includes: the name of the inspection task, the affiliated unit, the inspected unit, the inspection date and other information, the name of the inspected object and the standard based on. At the same time, the data source of the inspected object is set, including the database name and the table where the data is located. The process engine of the standard compliance inspection of the present invention is composed of a series of engines, including: data source parsing engine, inspection indicator import engine, inspection judgment engine, inspection result display engine, and inspection report generation engine.

[0080] in,

[0081] 1) Data source parsing engine configuration: According to the data type of the inspected object, different data parsing templates are configured to clean and convert the data so as to compare it with the data in the standard reference library;

[0082] 2) Inspection index import engine configuration: By default, the corresponding inspection indexes need to be checked according to the standard name, but in some special cases, users can still configure the indicators to be checked and the order of inspection indicators through the visual interface;

[0083] 3) Inspection and interpretation engine configuration: According to the characteristics of each inspection indicator, select the appropriate inspection algorithm, such as the uniqueness inspection indicator, select the uniqueness-related inspection algorithm, and the accuracy inspection indicator, select the accuracy-related inspection algorithm;

[0084] 4) Inspection result display engine: Inspection result content includes inspection indicator pass rate, number of inspection indicator pass, number of inspection indicator fail, inspection indicator pass details, inspection indicator fail reasons, etc. Users can select the information of interest as needed to form an inspection result display template;

[0085] 5) Inspection report generation engine: using the inspection report template definition tool, according to the inspection report template requirements, associate the required inspection result information to form an inspection report template.

[0086] In step 104, the detected test data is acquired based on the data source, and the detected test data is tested for standard compliance based on the process engine and the standard reference library to obtain a test result.

[0087] In the present invention, the tested test data is acquired based on the data source, and the tested test data is tested for standard compliance based on the process engine and the standard reference library to obtain the test results. The system displays the inspection results based on a template and automatically generates an inspection report.

[0088] The beneficial effects of the present invention are: (1) Improved work efficiency: by adopting process engine technology, the standard compliance check process is automated, reducing the number of human intervention steps and improving the efficiency of standard compliance checks; (2) Improved system value: by adopting extensible configuration technology, data source configuration, inspection algorithm configuration, and inspection report format configuration can be achieved to adapt to compliance checks of various test data standards, thereby improving system value.

[0089] Figure 4 FIG. 4 is a schematic diagram of a system 400 for detecting standard compliance of test data according to an embodiment of the present invention. Figure 4 As shown, a system 400 for detecting standard compliance of test data provided by an embodiment of the present invention includes: a standard reference library building unit 401, a data source determining unit 402, a configuration unit 403 and a detection unit 404.

[0090] Preferably, the standard reference library building unit 401 is used to build a standard reference library.

[0091] Preferably, the system further comprises:

[0092] The basic data import unit is used to import basic data before building the standard reference library; wherein the basic data includes: test data standards, compliance check status, compliance check results and inspected units.

[0093] Preferably, the standard reference library building unit 401 builds the standard reference library, including:

[0094] Recognize the content of the standard text and convert the content of the standard text into a converted text from which words can be extracted;

[0095] Performing word segmentation processing on the converted text, and extracting data according to preset extraction rules, so as to extract different data to corresponding positions;

[0096] Based on the preset data mapping rules, the extracted data is associated with the standard benchmark library to realize the construction of the standard benchmark library.

[0097] Preferably, the standard reference library building unit 401 is further used for:

[0098] Perform data correction and completion operations on the data in the standard reference library.

[0099] Preferably, the data source determining unit 402 is used to determine an inspection task, and determine the data source of the detected test data based on the inspection task.

[0100] Preferably, the configuration unit 403 is used to configure a process engine for standard compliance detection.

[0101] Preferably, the process engine includes: a data source parsing engine, an inspection indicator importing engine, an inspection interpretation engine, an inspection result displaying engine and an inspection report generating engine.

[0102] Preferably, the detection unit 404 is used to obtain the detected test data based on the data source, and perform standard compliance detection on the detected test data based on the process engine and the standard reference library to obtain a detection result.

[0103] The system 400 for detecting the standard compliance of test data according to the embodiment of the present invention corresponds to the method 100 for detecting the standard compliance of test data according to another embodiment of the present invention, and will not be described in detail herein.

[0104] The invention has been described above with reference to a few embodiments. However, it is readily apparent to a person skilled in the art that other embodiments than the ones disclosed above are equally within the scope of the invention, as defined by the appended patent claims.

[0105] Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise therein. All references to "a / said / the [means, components, etc.]" are to be openly interpreted as at least one instance of said means, components, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not necessarily have to be performed in the exact order disclosed, unless explicitly stated otherwise.

[0106] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0107] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0108] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0109] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0110] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. A method for detecting the standard compliance of test data, characterized in that: The method comprises: Build a standard benchmark library; Determine an inspection task, and determine a data source of the detected test data based on the inspection task; Configuration of the process engine for standards compliance testing; The detected test data is acquired based on the data source, and standard compliance detection is performed on the detected test data based on the process engine and the standard reference library to acquire a detection result.

2. The method according to claim 1, characterized in that The method further comprises: Before building the standard reference library, basic data is imported; wherein the basic data includes: test data standards, compliance inspection status, compliance inspection results and inspected units.

3. The method according to claim 1, characterized in that The construction of the standard benchmark library includes: Recognize the content of the standard text and convert the content of the standard text into a converted text from which words can be extracted; Performing word segmentation processing on the converted text, and extracting data according to preset extraction rules, so as to extract different data to corresponding positions; Based on the preset data mapping rules, the extracted data is associated with the standard benchmark library to realize the construction of the standard benchmark library.

4. The method according to claim 3, characterized in that The method further comprises: Perform data correction and completion operations on the data in the standard reference library.

5. The method according to claim 1, characterized in that The process engine includes: a data source parsing engine, an inspection index importing engine, an inspection interpretation engine, an inspection result displaying engine and an inspection report generating engine.

6. A system for detecting the compliance of test data with standards, characterized in that: The system comprises: A standard benchmark library building unit, used for building a standard benchmark library; A data source determination unit, used to determine an inspection task, and determine a data source of the detected test data based on the inspection task; Configuration unit, used for configuration of process engine for standard compliance detection; The detection unit is used to obtain the detected test data based on the data source, and perform standard compliance detection on the detected test data based on the process engine and the standard reference library to obtain a detection result.

7. The system according to claim 6, characterized in that The system further comprises: The basic data import unit is used to import basic data before building the standard reference library; wherein the basic data includes: test data standards, compliance check status, compliance check results and inspected units.

8. The system according to claim 6, characterized in that The standard reference library building unit builds the standard reference library, including: Recognize the content of the standard text and convert the content of the standard text into a converted text from which words can be extracted; Performing word segmentation processing on the converted text, and extracting data according to preset extraction rules, so as to extract different data to corresponding positions; Based on the preset data mapping rules, the extracted data is associated with the standard benchmark library to realize the construction of the standard benchmark library.

9. The system according to claim 8, characterized in that The standard reference library building unit is also used for: Perform data correction and completion operations on the data in the standard reference library.

10. The system according to claim 6, characterized in that The process engine includes: a data source parsing engine, an inspection index importing engine, an inspection interpretation engine, an inspection result displaying engine and an inspection report generating engine.

Images