Automatic verification system

Abstract

The embodiment of the invention provides an automatic verification system. In one specific embodiment, the equipment, the equipment to be detected and the at least one standard equipment are automatically detected; the automatic verification device comprises a device driving module, an adaptation module, a mapping module, a workbench module and a rule engine module. The equipment driving module stores a driving library of various instruments, and a corresponding driver is matched for each interface in the driving library; the workbench module responds to a first setting operation of a user and configures the rule engine module; the rule engine module responds to the configuration of a user to the workbench module, defines a verification item, sets a verification process of the verification item, and obtains and executes a verification process template, so that the mapping module responds to the execution of the verification process template; and converting the verification process of the verification item into a program control instruction corresponding to the standard equipment or the equipment to be tested based on the mapping rule, and outputting the program control instruction to the corresponding standard equipment or the corresponding equipment to be tested through the equipment driving module.

Description

Technical Field

[0001] This disclosure relates to the field of radio metrology and testing technology. More specifically, it relates to an automatic verification system. Background Technology

[0002] Currently, radio metrology testing technology, as a key supporting technology in the field of modern information technology, is widely used in many important fields such as communication, navigation, radar, and aerospace. The accuracy and reliability of its metrological verification results directly determine the performance indicators, operational stability, and even the safety and controllability of electronic equipment. However, the current state of technology in the field of radio metrology verification still has many pain points that urgently need to be addressed, such as high reliance on manual labor. From the parameter configuration of metrological standard equipment and the physical connection between the tested equipment and the standard equipment, to data acquisition, error calculation, and result judgment in the verification process, each step requires operators to have in-depth theoretical knowledge of radio metrology and rich practical experience.

[0003] Therefore, many metrology institutions are also exploring the use of some automatic verification software. However, these software programs usually adopt a one-to-one customized design mode, that is, they develop dedicated connection modules and control programs for specific types of equipment. As a result, a verification system can only be applied to a few types of equipment and cannot achieve cross-model and cross-brand equipment compatibility verification. Summary of the Invention

[0004] The purpose of this disclosure is to provide an automatic verification system to solve at least one of the problems of high professional threshold, poor equipment compatibility, and inflexible and inconsistent verification configuration in the prior art.

[0005] To achieve the above objectives, the present disclosure adopts the following technical solution: The first aspect of this disclosure provides an automatic verification system, comprising: Automatic calibration equipment and at least one standard device; The automatic calibration equipment is communicatively connected to the device under test and at least one standard device. The automatic calibration equipment includes a device driver module, an adapter module, a mapping module, a workbench module, and a rule engine module; The device driver module stores a driver library for various instruments, which is used to identify the device under test and at least one standard device connected to different interfaces of the calibration equipment, and to match the corresponding driver for each interface from the driver library. The adapter module encapsulates programmable instructions for various devices under test and various standard devices. The mapping module stores the mapping rules between the verification process of the verification items and the programmable instructions in the adaptation module; The workbench module is used to configure the rule engine module in response to the user's first setting operation; The rule engine module, in response to the user's configuration of the workbench module, defines verification items, sets the verification process of the verification items, obtains and executes the verification process template so that the mapping module responds to the execution of the verification process template. Based on the mapping rules, the verification process of the verification items is converted into the corresponding standard equipment or the corresponding device under test program control instructions and output to the corresponding standard equipment or the corresponding device under test through the device driver module.

[0006] Furthermore, the automatic verification device also includes a storage module for storing the raw data during the execution of the verification process template. The raw data includes verification points, measured values, units, outliers, and the judgment results of verification items.

[0007] Furthermore, the storage module includes a filtering module for preprocessing the measured values ​​based on the Kalman filtering algorithm and the Laida criterion algorithm.

[0008] Furthermore, the automatic verification device also includes a report generation module; The workbench module is used to generate a report template by defining a rule engine module in response to the user's second setting operation. The report generation module is used to fill the report generation template based on the original data after the verification process template is executed.

[0009] Furthermore, the report generation template includes calibration or verification basis, equipment information, verification items, data tables, and the judgment results of the verification items.

[0010] Furthermore, the report generation module is also used to export the report generation template and add an electronic signature in response to the user's export operation after the verification process template is executed.

[0011] Furthermore, the rule engine module includes a verification item definition module and a verification process configuration module; The verification item definition module is used to respond to the user's configuration of the workbench module, set the verification item name, verification item parameters, number of repeated measurements, acquisition interval, outlier removal algorithm and error calculation formula, select the device to be controlled for the verification item and set the device type of the device to be controlled, so as to obtain the defined verification item.

[0012] Furthermore, the rule engine module also includes a verification process configuration module; The verification process configuration module stores multiple functional modules; The verification process configuration module is used to respond to the user's configuration of the workbench module, and set the execution order, loop conditions and judgment branch conditions among multiple functional modules of the defined verification items to obtain the initial verification process.

[0013] Furthermore, the functional modules include at least a device initialization module, a parameter setting module, a data acquisition module, an error calculation module, and a result determination module.

[0014] Furthermore, the rule engine module also includes a verification module; The verification module is used to verify the correlation between the execution steps and parameters in the verification items of multiple functional modules in the initial verification process after obtaining the initial verification process, and save the initial verification process to obtain the verification process template after successful verification.

[0015] The beneficial effects of this disclosure are as follows: This invention breaks away from the traditional one-to-one customization model of verification systems. Through the device driver module, a driver library containing various instruments is stored to identify the devices under test connected to different interfaces of the verification equipment and at least one standard device. The corresponding driver is matched for each interface from the driver library. Furthermore, the rule engine module is configured through the workbench module to achieve flexible configuration of verification items and verification processes. This allows a single system to support multiple applications, and users can flexibly add / delete steps in the verification process and adjust parameter thresholds and execution conditions according to their needs.

[0016] This invention automates everything from equipment control and process execution to report generation. Except for equipment wiring, this invention frees metrology personnel from tedious and repetitive work, greatly improving verification efficiency and quality. Attached Figure Description

[0017] The specific embodiments of this disclosure will be described in further detail below with reference to the accompanying drawings.

[0018] Figure 1 A schematic diagram of the structure of an automatic verification system according to an embodiment of the present disclosure is shown.

[0019] Figure 2 A schematic diagram of the structure of an automatic verification device according to an embodiment of the present disclosure is shown.

[0020] Figure 3 A schematic diagram of the structure of a computer system for implementing the apparatus provided in the embodiments of this disclosure is shown. Detailed Implementation

[0021] To more clearly illustrate this disclosure, the following description, in conjunction with embodiments and accompanying drawings, provides further insight. Similar components in the drawings are indicated by the same reference numerals. Those skilled in the art should understand that the specific description below is illustrative rather than restrictive and should not be construed as limiting the scope of protection of this disclosure.

[0022] Embodiments of the present invention provide an automatic verification system 10, such as... Figure 1 and Figure 2 As shown, it includes: Automatic calibration equipment 11 and at least one standard device 12; The device under test 13 and at least one standard device 12 are respectively connected to the automatic calibration device 11 in communication. The automatic calibration device 11 includes a device driver module 111, an adapter module 112, a mapping module 113, a workbench module 114, and a rule engine module 115; The device driver module 111 stores a driver library for various instruments, which is used to identify the device under test 13 and at least one standard device 12 connected to different interfaces of the calibration equipment, and to match the corresponding driver for each interface from the driver library. The adapter module 112 encapsulates programmable instructions for various devices under test 13 and various standard devices 12; The mapping module 113 stores the mapping rules between the verification process of the verification items and the program control instructions in the adaptation module 112. The workbench module 114 is used to configure the rule engine module 115 in response to the user's first setting operation; The rule engine module 115, in response to the user's configuration of the workbench module 114, defines verification items, sets the verification process of the verification items, obtains and executes the verification process template so that the mapping module 113 responds to the execution of the verification process template, and converts the verification process of the verification items into program control instructions of the corresponding standard device 12 or the corresponding device under test 13 based on the mapping rules, and outputs them to the corresponding standard device 12 or the corresponding device under test 13 through the device driver module 111.

[0023] In one specific example, the hardware interfaces of the automatic verification device 11 include a General-Purpose Interface Bus (GPIB) interface, a LAN interface, and a USB, supporting simultaneous connection of multiple devices; it can be connected to a display 14.

[0024] When device driver module 111 starts or refreshes, it automatically scans all hardware interfaces and actively communicates with connected devices to obtain their unique identification information and device address. The unique identification of the device includes the manufacturer, model, serial number, and response to standard query commands. Using the obtained identification information, it searches in a unified device driver library, matches and loads the dedicated driver for each identified specific device.

[0025] In a specific example, the automatic verification device 11 adopts a client / server architecture.

[0026] In a specific example, the device driver module 111 is used to communicate with the device, is compatible with both network and serial ports, identifies the device address, and contains a unified device driver library.

[0027] The adapter module 112 encapsulates the programmable instructions of various standard devices 12 and the device under test, and provides a unified application programming interface (API) to shield the differences in underlying interfaces and protocols. The API can be customized by the user.

[0028] In a specific example, the mapping module 113 is responsible for parsing and executing the verification process defined by the rule engine, and converting the high-level instructions set by the rule engine into specific device controls by calling the device driver and the adaptation layer.

[0029] In a specific example, the workbench module 114 uses a visual drag-and-drop configuration interface, allowing users to set the rule engine module 115 by dragging and dropping, such as the device initialization, parameter setting, data acquisition, error calculation—result judgment function modules. Test steps, loops, and judgment branches can be freely set to construct complex verification processes. Judgment branches support the use of mathematical formulas and pass / fail judgment logic.

[0030] In a specific example, the workbench module 114 primarily facilitates viewing verification / calibration tasks and results. It is divided into a task management area, an equipment status area, and a report management area. The task management area displays the completion progress of verification / calibration tasks using a dashboard and progress bar; the equipment status area is used to view the connection and operating status of connected equipment; and the report management area provides functions for generating, exporting, querying, and statistically analyzing reports.

[0031] Following the example above, the automatic verification device 11 scans the connected hardware interfaces through the device driver module 111, identifies the devices connected to the interfaces, automatically matches the corresponding driver in the unified device driver library, and displays "Device identified, driver loaded" in the device status area of ​​the "workbench module 114".

[0032] In a specific example, after the automatic verification device is powered on, the built-in automatic verification system 10 starts automatically, displays the system login interface, and the user enters the workbench module 114 after entering the account and password.

[0033] In a specific example, the automatic calibration device includes a temperature and voltage monitoring module, which collects data in real time from the temperature sensor installed inside the automatic calibration device, as well as the ambient temperature and power supply voltage inside the device. The data is displayed in real time in the system status monitoring bar, and all data are within the normal range. The cooling fan keeps running at low speed to ensure the stability of the device.

[0034] In a specific example, the working principle of the rule engine module 115 is as follows: In the rules engine module 115, customize the verification items. The first step is to set the verification item information; the second step is to select the equipment requiring programmable control from the verification items; the third step is to set the verification process for the verification items; and the fourth step is to set the verification point information. Among these steps: The first step is to set the verification item information, including the verification item name, verification item parameters, number of repeated measurements, acquisition interval, outlier removal method, error calculation formula, and upload the equipment connection diagram.

[0035] The second step is to select the equipment and equipment type that need to be programmed in the verification items. Taking the signal generator frequency item as an example, if the equipment type of the signal generator under test is the equipment under test and the equipment type of the measuring receiver is the frequency meter, then configure the corresponding channel in the multi-process hardware interface module of the automatic verification device.

[0036] The third step is to set up the verification process for the verification items. Drag and drop the "Equipment Initialization", "Parameter Setting", "Data Acquisition", "Error Calculation" and "Result Judgment" modules into the process canvas in sequence. Then, set detailed steps for each stage, namely, select the corresponding instruction, set the instruction order, and set the delay time.

[0037] The fourth step is to set the inspection point information, including the inspection point parameters, corresponding identifiers, and qualification criteria for the inspected equipment and standard equipment 12, supporting both absolute and relative value judgments.

[0038] In one possible implementation, the automatic verification device further includes a storage module 117 for storing raw data during the execution of the verification process template, the raw data including verification points, measured values, units, outliers, and the judgment results of verification items.

[0039] In a specific example, the storage module 117 supports the storage and processing of raw calibration / verification data, including verification points, measured values, units, outliers, etc. The module has built-in data preprocessing algorithms, including Kalman filtering and the Laida criterion, to ensure the accuracy of the acquired data.

[0040] In one possible implementation, the storage module 117 includes a filtering module for preprocessing the measured values ​​based on the Kalman filtering algorithm and the Laida criterion algorithm.

[0041] In one possible implementation, the automatic verification device further includes a report generation module 116.

[0042] The workbench module 114 is used to define a report generation template through the rule engine module 115 in response to the user's second setting operation; The report generation module 116 is used to fill the report generation template based on the original data after the verification process template is executed.

[0043] In one possible implementation, the report generation template includes calibration or verification basis, equipment information, verification items, data tables, and the judgment results of the verification items.

[0044] In a specific example, the report generation module 116 supports custom report generation templates. The system automatically fills in the verification or calibration report content based on the verification data, including calibration or verification basis, equipment information, verification items, data tables, result judgments, etc. An electronic signature is automatically added during export to prevent report tampering. The report management module supports report query and statistical functions.

[0045] In a specific example, a custom calibration or verification report template is defined in the rules engine module 115, and the places where data needs to be filled are identified with identifiers, such as the frequency being represented by ${freq}, where ${} is a placeholder.

[0046] In one possible implementation, the report generation module 116 is further configured to, in response to the user's export operation, export the report generation template and add an electronic signature after the verification process template has been executed.

[0047] In one possible implementation, the rule engine module 115 includes a verification item definition module and a verification process configuration module; The verification item definition module is used to respond to the user's configuration of the workbench module 114, set the verification item name, verification item parameters, number of repeated measurements, acquisition interval, outlier removal algorithm and error calculation formula, and select the device to be controlled for the verification item and set the device type of the device to be controlled, so as to obtain the defined verification item.

[0048] In one possible implementation, the rule engine module 115 further includes a verification process configuration module; The verification process configuration module stores multiple functional modules; The verification process configuration module is used to respond to the user's configuration of the workbench module 114, and set the execution order, loop conditions and judgment branch conditions among the multiple functional modules of the defined verification items to obtain the initial verification process.

[0049] In one possible implementation, the functional modules include at least a device initialization module, a parameter setting module, a data acquisition module, an error calculation module, and a result determination module.

[0050] In a specific example, the device initialization module performs preparatory work before the verification process begins, bringing all participating devices into a known and controllable baseline state. For instance, the device initialization module sends a reset command to clear the devices' previous settings. It performs self-tests or queries the device status to ensure there are no errors. Alternatively, it sets some default, general parameters strongly relevant to this verification, such as setting the trigger source of standard device 12 to bus trigger. This setting ensures that each verification begins under the same initial conditions, guaranteeing the repeatability and comparability of test results.

[0051] The parameter setting module is used to configure the precise working parameters required for this measurement for the tested equipment and standard equipment 12 according to the specific requirements of the calibration point.

[0052] The data acquisition module is used to drive the standard to perform actual measurements on the status of the device under test 13 and the standard device 12, and to acquire raw data.

[0053] The error calculation module converts the collected raw data into error or performance indicators with clear physical meaning based on metrology principles and preset formulas.

[0054] For example, the calculation error is the ratio of the difference between the measured value and the standard value to the standard value.

[0055] The result determination module compares the calculated error with the preset technical indicators and automatically gives conclusions such as qualified, out of tolerance, or uncertain.

[0056] In one possible implementation, the rule engine module 115 further includes a verification module; The verification module is used to verify the correlation between the execution steps and parameters in the verification items of multiple functional modules in the initial verification process after obtaining the initial verification process, and save the initial verification process to obtain the verification process template after successful verification.

[0057] In a specific example, the verification module, such as the step sequence and parameter correlation, after confirming that there are no errors, saves the configured process as a verification process template and the verification point information as a verification point template. Multiple verification point templates can be set for one verification item.

[0058] Within the workbench module, a calibration task is created. Basic information about the calibration equipment is entered, and the required calibration items and points are selected before starting the calibration task. The automatic calibration device collects and processes data according to the configured calibration process, and the data storage and processing module stores the process record. When a line change is required, the user is prompted to follow the steps to change the line. After the manual line change is completed, subsequent calibration items continue. After calibration / calibration is completed, the user selects to generate original records and reports. The report generation module 116 automatically retrieves data from the data storage and processing module and fills in the content based on the preset signal generator calibration report template, including calibration basis, equipment information under test, test data, and result judgment.

[0059] like Figure 3 As shown, a computer system suitable for implementing an automatic verification device provided in the above embodiments includes a central processing module (CPU), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage portion into a random access memory (RAM). Various programs and data required for the operation of the computer system are also stored in the RAM. The CPU, ROM, and RAM are connected via a bus. An input / output (I / O) interface is also connected to the bus.

[0060] The following components are connected to the I / O interface: input sections including keyboards, mice, etc.; output sections including liquid crystal displays (LCDs) and speakers, etc.; storage sections including hard disks, etc.; and communication sections including network interface cards such as LAN cards and modems. The communication sections perform communication processing via networks such as the Internet. Drives are also connected to the I / O interface as needed. Removable media, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive as needed so that computer programs read from them can be installed into the storage section as required.

[0061] Specifically, according to this embodiment, the process described in the flowchart above can be implemented as a computer software program. For example, this embodiment includes a computer program product comprising a computer program tangibly embodied on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium.

[0062] The flowcharts and schematic diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of the system, method, and computer program product of this embodiment. In this regard, each block in the flowchart or schematic diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the schematic diagram and / or flowchart, and combinations of blocks in the schematic diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0063] In the description of this disclosure, it should be noted that the terms "upper," "lower," etc., indicating the orientation or positional relationship are based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing this disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this disclosure. Unless otherwise expressly specified and limited, the terms "installed," "connected," and "linked" should be interpreted broadly, for example, they can be fixed connections, detachable connections, or integral connections; they can be mechanical connections or electrical connections; they can be direct connections or indirect connections through an intermediate medium; they can be internal connections between two elements. For those skilled in the art, the specific meaning of the above terms in this disclosure can be understood according to the specific circumstances.

[0064] It should also be noted that, in the description of this disclosure, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0065] Obviously, the above embodiments of this disclosure are merely examples for clearly illustrating this disclosure, and are not intended to limit the implementation of this disclosure. For those skilled in the art, other variations or modifications can be made based on the above description. It is impossible to exhaustively list all implementation methods here. Any obvious variations or modifications derived from the technical solutions of this disclosure are still within the protection scope of this disclosure.

Claims

1. An automatic verification system, characterized in that, include: Automatic calibration equipment and at least one standard device; The automatic calibration equipment is communicatively connected to the device under test and at least one standard device. The automatic calibration equipment includes a device driver module, an adapter module, a mapping module, a workbench module, and a rule engine module; The device driver module stores a driver library for various instruments, which is used to identify the device under test and at least one standard device connected to different interfaces of the calibration equipment, and to match the corresponding driver for each interface from the driver library. The adapter module encapsulates programmable instructions for various devices under test and various standard devices. The mapping module stores the mapping rules between the verification process of the verification items and the programmable instructions in the adaptation module; The workbench module is used to configure the rule engine module in response to the user's first setting operation; The rule engine module, in response to the user's configuration of the workbench module, defines verification items, sets the verification process of the verification items, obtains and executes the verification process template so that the mapping module responds to the execution of the verification process template. Based on the mapping rules, the verification process of the verification items is converted into the corresponding standard equipment or the corresponding device under test program control instructions and output to the corresponding standard equipment or the corresponding device under test through the device driver module.

2. The automatic verification system according to claim 1, characterized in that, The automatic verification device also includes a storage module for storing the raw data during the execution of the verification process template. The raw data includes verification points, measured values, units, outliers, and the judgment results of verification items.

3. The automatic verification system according to claim 2, characterized in that, The storage module includes a filtering module for preprocessing the measured values ​​based on the Kalman filtering algorithm and the Laida criterion algorithm.

4. The automatic verification system according to claim 2, characterized in that, The automatic verification device also includes a report generation module; The workbench module is used to generate a report template by defining a rule engine module in response to the user's second setting operation. The report generation module is used to fill the report generation template based on the original data after the verification process template is executed.

5. The automatic verification system according to claim 4, characterized in that, The report generation template includes calibration or verification basis, equipment information, verification items, data tables, and the judgment results of the verification items.

6. The automatic verification system according to claim 4, characterized in that, The report generation module is also used to export the report generation template and add an electronic signature in response to the user's export operation after the verification process template is executed.

7. The automatic verification system according to claim 1, characterized in that, The rule engine module includes a verification item definition module and a verification process configuration module; The verification item definition module is used to respond to the user's configuration of the workbench module, set the verification item name, verification item parameters, number of repeated measurements, acquisition interval, outlier removal algorithm and error calculation formula, select the device to be controlled for the verification item and set the device type of the device to be controlled, so as to obtain the defined verification item.

8. The automatic verification system according to claim 7, characterized in that, The rule engine module also includes a verification process configuration module; The verification process configuration module stores multiple functional modules; The verification process configuration module is used to respond to the user's configuration of the workbench module, and set the execution order, loop conditions and judgment branch conditions among multiple functional modules of the defined verification items to obtain the initial verification process.

9. The automatic verification system according to claim 8, characterized in that, The functional modules include at least a device initialization module, a parameter setting module, a data acquisition module, an error calculation module, and a result determination module.

10. The automatic verification system according to claim 8, characterized in that, The rule engine module also includes a verification module; The verification module is used to verify the correlation between the execution steps and parameters in the verification items of multiple functional modules in the initial verification process after obtaining the initial verification process, and save the initial verification process to obtain the verification process template after successful verification.

Images