Data integration system based on EMC correlation

Abstract

The invention belongs to the technical field of EMC test data management, and discloses a data integration system and method based on EMC correlation, and the system comprises a data collection module which is used for obtaining original test data from EMC test equipment and carrying out the standardization preprocessing; the central data processing and storage unit is used for storing EMC basic data and executing operations such as data statistics, trend analysis, compliance judgment or report integration based on an EMC analysis model and a user instruction; the Web service interaction module is used for generating a unified Web interaction interface to display a processing result and provide a user operation entrance; the central data processing and storage unit comprises an extension management sub-module which can respond to an extension establishment instruction and generate an extension client deployment package in a file packaging mode, and rapid deployment and connection of an extension are achieved. According to the method, the EMC data integration and management efficiency can be remarkably improved, the data analysis application depth is enhanced, and deployment and cooperation of multiple users and multiple test points are greatly simplified.

Description

Technical Field

[0001] The present invention relates to the technical field of electromagnetic compatibility (EMC) test data management, and in particular to an integrated system for collecting, processing, analyzing, displaying and managing EMC test data and an implementation method thereof. Background Art

[0002] Electromagnetic compatibility (EMC) is a measure of the ability of an electronic device or system to operate normally in its electromagnetic environment without causing unacceptable electromagnetic disturbance to anything in that environment.

[0003] EMC testing is a critical step in ensuring product compliance with relevant standards and regulations. During the testing process, a large amount of raw data and result information is generated. This data often comes from different test equipment, covers multiple test items, and may be in a variety of formats.

[0004] At present, the following problems are common in the management and application of EMC test data:

[0005] First, data is scattered. Data from different test items or equipment are often stored and managed independently, lacking an effective integration mechanism, making data search and correlation analysis difficult.

[0006] Second, functional modularity is insufficient or the degree of integration is low. Many data processing functions such as statistics, analysis, and report generation are scattered across different software tools or require manual operation, which is inefficient and error-prone.

[0007] Third, some existing data management software may not be well adapted to the laboratory's specific network environment, such as the convenient aggregation and collaborative work of data from multiple test points (extensions) in an internal LAN environment.

[0008] Fourthly, the deployment and configuration process of the extension client is complicated, which is not conducive to quickly establishing new test stations or adapting to the dynamic adjustment of test tasks.

[0009] Fifth, the user interface and function customization are not high, making it difficult to meet the needs of different users or specific EMC test scenarios, such as multi-language support and customized report templates.

[0010] Therefore, how to effectively integrate various types of data generated throughout the entire EMC testing process and provide an integrated, efficient, and easy-to-use data management and analysis platform has become a technical problem that needs to be urgently addressed in this field. Summary of the Invention

[0011] The main purpose of the present invention is to provide an EMC-related data integration system and method, aiming to overcome the problems of EMC data dispersion, low processing efficiency, low system integration, difficult extension deployment and poor user experience in the existing technology, and realize unified and efficient management and in-depth application of EMC test data.

[0012] To achieve the above object, the present invention provides the following technical solutions:

[0013] A data integration system based on EMC includes a data acquisition module, a central data processing and storage unit, and a Web service interaction module.

[0014] The data acquisition module is configured to acquire raw test data from at least one EMC test device and perform standardization preprocessing on the raw test data to generate EMC basic data in a standard format. Standardization preprocessing may involve operations such as data cleaning, format conversion, and unit unification to ensure consistency and accuracy in subsequent data processing.

[0015] The central data processing and storage unit, connected to the data acquisition module, is configured to receive and store the EMC basic data. This unit, the core of the system, performs at least one data processing operation on the stored EMC basic data based on a pre-set EMC analysis model and instructions issued by the user through the Web service interaction module. These data processing operations can cover a wide range of EMC data application scenarios, such as statistically summarizing test data from a specific time period, sample, or test item to analyze pass rates and the distribution of unqualified items; performing data trend analysis to identify potential performance drift or environmental impacts; and performing automated compliance assessments based on relevant EMC standards.

[0016] The Web service interaction module is connected to the central data processing and storage unit and is configured to generate a unified Web interaction interface. This Web interaction interface is the primary means for users to interact with the system. It can at least clearly and intuitively display the results of the aforementioned data processing operations, such as in the form of charts, lists, etc. It also provides user operation portals through which users can access various preset functions of the central data processing and storage unit, such as initiating new data analysis tasks, configuring report templates, and managing user information.

[0017] Crucially, the central data processing and storage unit of the present invention also includes a branch management submodule. In response to branch creation instructions received through a web interface, this submodule automatically generates a branch client deployment package in the form of a file package. This deployment package contains all the components and configuration information required to run the client program on the branch device, making it very convenient for users to quickly deploy the client on a new branch test site and automatically establish an effective data communication connection between the branch client and the central data processing and storage unit. This design greatly simplifies system deployment and expansion in a multi-test site environment.

[0018] Preferably, the data acquisition module is further configured to adapt to a variety of EMC test equipment interfaces, such as Ethernet, GPIB, RS232, and is compatible with multiple data protocols and formats. After acquiring the raw data, the module internally parses and converts it into a unified internal data structure, and then performs the aforementioned standardization preprocessing, thereby shielding the complexity brought about by the diversity of the underlying test equipment.

[0019] Preferably, the data processing operations performed by the central data processing and storage unit further include a report integration function. This function allows the system to automatically capture and populate filtered EMC basic data or the results of various data processing operations based on pre-set standardized report templates or report templates flexibly customized by the user according to their own needs, thereby quickly generating a structured and standardized EMC test report.

[0020] Furthermore, the web interface provided by the web service interaction module can also integrate regional environmental parameter monitoring. This function can display laboratory environmental parameters closely related to the EMC testing process in real time or near real time, such as the current test area's temperature, humidity, and background electromagnetic field strength. This information is crucial for evaluating the effectiveness of test conditions and the reliability of test results.

[0021] In order to enhance the international application capability and user experience of the system, the Web service interaction module may further support dynamic switching display of at least two user operation language interfaces, such as Chinese and English.

[0022] In terms of data processing accuracy, the central data processing and storage unit can apply specific data screening logic before performing data processing operations, especially data screening or analysis. This logic can be abstractly represented as D filstered =d∈D base |C1(d)∧C2(d)∧…∧C n (d). Here, D base represents the EMC basic data set to be processed, d is any single data record in the data set, and Ci (i = 1, 2, ..., n) represents a series of user-defined or system-preset filter predicates. For example, filter criteria could include test time range, sample model, test item name, test result status, etc. Only data that meets all specified criteria will be included in subsequent processing or analysis.

[0023] Regarding the extension client deployment package generated by the extension management submodule, after it is successfully deployed on the extension device, it can not only achieve connection with the central system, but also allow the extension device to upload its locally collected or generated supplementary test data to the central data processing and storage unit, or receive test task instructions and related configuration information uniformly issued by the central data processing and storage unit.

[0024] Accordingly, the present invention also provides a data integration method based on EMC, the steps of which correspond to the functions of the modules of the above system:

[0025] First, the original test data is obtained from the EMC test equipment through the data acquisition module, and standardized preprocessing is performed to generate EMC basic data.

[0026] The central data processing and storage unit then receives and securely stores this EMC basic data. It then performs operations such as statistics, trend analysis, or compliance determination on the EMC basic data based on the EMC analysis model and user instructions.

[0027] Afterwards, a unified Web interaction interface is generated through the Web service interaction module to display the processing results and provide user operation entry.

[0028] Finally, in response to the extension establishment instruction, the extension management submodule generates an extension client deployment package in a file packaging manner to achieve rapid deployment and connection of the extension.

[0029] Compared with the prior art, the present invention has the following significant beneficial effects:

[0030] 1. This invention significantly improves the efficiency of EMC data integration and management. Through centralized data collection, standardized data processing, and unified storage management, it effectively solves the problem of fragmented and inconsistent EMC data formats, making data easier to query, access, and maintain. Combined with a web-based interactive interface, users can conveniently access and operate various system functions, greatly improving work efficiency.

[0031] 2. This invention significantly enhances the depth of EMC data analysis and application, while optimizing the testing process. The system's built-in EMC analysis model and flexible data processing capabilities, such as statistical analysis, trend prediction, and automatic report generation, help users quickly extract valuable information from massive amounts of test data, identify potential issues, and support product design improvements and EMC performance optimization. Furthermore, features such as regional environmental monitoring help ensure standardized testing conditions.

[0032] 3. This invention greatly simplifies the deployment and collaboration of multiple users and test sites. Its innovative extension management submodule and file-packaging extension client rapid deployment mechanism significantly reduce the complexity and time cost of establishing extension systems at multiple test stations or remote laboratories, facilitating rapid expansion and flexible adjustment of the system. Combined with a web architecture, it also facilitates multi-user collaboration and enables switching between Chinese and English interfaces to meet the needs of diverse users. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive work, among which:

[0034] Figure 1 This is a system overall structure diagram of an EMC-related data integration system according to the present invention;

[0035] Figure 2 This is a detailed block diagram of a data acquisition module of an EMC-related data integration system according to the present invention;

[0036] Figure 3 This is a functional block diagram of a central data processing and storage unit of an EMC-related data integration system according to the present invention;

[0037] Figure 4 This is a functional block diagram of a Web service interaction module based on an EMC-related data integration system of the present invention;

[0038] Figure 5 This is a schematic diagram of the workflow of the extension management submodule of the EMC-related data integration system of the present invention;

[0039] Figure 6 This is a system method flow chart of the present invention based on an EMC-related data integration system. DETAILED DESCRIPTION

[0040] The following describes in detail the specific steps and operation procedures of an EMC-related data integration system of the present invention in conjunction with specific embodiments, so that ordinary technicians in the relevant technical field can implement the present invention. Through the following specific embodiments, technicians can fully understand and implement the technical solutions of the present invention.

[0041] Reference Figures 1 to 6 , an embodiment of the present invention provides a data integration system based on EMC.

[0042] The system first passes Figure 1 The data acquisition module A shown in FIG, its detailed structure can be found in Figure 2 ,and Figure 1 Connect various EMC test equipment D shown in Figure 1, such as spectrum analyzers, receivers, power meters, and darkroom controllers.

[0043] The module has built-in drivers or adaptation layers for different device models and communication protocols, such as TCP / IP, GPIB, serial port, etc. Figure 2 Indicated by B.

[0044] When the test equipment generates raw test data, such as a series of disturbance voltage readings V raw (f i ) or electromagnetic field strength value E raw (f i ) at different frequency points f i The data acquisition module will actively acquire or passively receive the measurement results.

[0045] After acquisition, the module performs preliminary parsing and converts it from a device-specific format, which may be a binary stream, CSV text, or a response to a specific instrument command, into a unified data structure within the system. Figure 2 Indicated by C.

[0046] This is followed by standardization preprocessing, corresponding to Figure 2 In the D part, for example, all voltage units are unified into dBμV, and frequency units are unified into MHz, and data cleaning is performed to remove obvious abnormal points or invalid data, and finally a structured EMC basic data record is formed, such as Figure 2 As shown in E in Figure 1, each record may contain fields such as test items, sample information, test conditions, frequency points, measurement values, and limits.

[0047] These EMC basic data are then transferred to the central data processing and storage unit, i.e. Figure 1 For detailed functions, see Part B shown in Figure 3 .

[0048] This unit is usually deployed on a server with sufficient computing and storage capabilities. Its core is a relational database or a NoSQL database optimized for time series data. Figure 3 B1 is used to persistently store a large amount of EMC basic data.

[0049] The core processor of the unit runs a series of preset EMC analysis models and data processing algorithms, which are Figure 3 This is achieved by the B2 data processing engine in .

[0050] For example, when a user requests to view the pass rate of the radiated emission (RE) test of a certain product model in the past month through the web interface, the central data processing and storage unit will perform the following operations:

[0051] 1) Retrieve the EMC basic data of all RE tests for a specified model product within a specified time range from the database.

[0052] 2) For each test data, the measured value is compared with the corresponding standard limit to determine whether it is qualified. The standard limit is also stored in the database or obtained from the configuration. This process is done by Figure 3 The B2c compliance determination module is completed.

[0053] 3) Count the number of qualified tests and the total number of tests, and calculate the pass rate P = (N mass / N total )×100, this is Figure 3 The function of the B2a data statistics module.

[0054] 4) Return the calculation results, such as the pass rate value, the unqualified frequency distribution, etc., to the Web service interaction module. The interaction path is as follows: Figure 3 The data processing engine is connected to the Web service interaction module through the API interface.

[0055] Web service interaction modules, such as Figure 1 As shown in C, its detailed functions can be found in Figure 4 , which acts as a bridge between users and the system's backend logic.

[0056] It usually adopts a B / S architecture, with the back end providing an API interface and the front end being a responsive web application that users can access through a browser on computers, tablets, and even mobile phones.

[0057] After receiving the pass rate and other results returned by the central data processing and storage unit, the module will dynamically render them to the preset dashboard or data statistics page, such as Figure 4 As shown in the C1 part of the figure, it may be presented in the form of percentage display, bar chart, pie chart, etc.

[0058] Users can also use controls on the interface, such as drop-down menus, date selectors, input boxes, etc. Figure 4 The C2 part of the , used to initiate a new data query, such as filtering data under a specific test standard, or requesting the generation of a test report containing detailed data, this operation will call Figure 3 The function of the B2d report integration module.

[0059] At this point, the Web service interaction module will package the user's request parameters and call the corresponding API of the central data processing and storage unit.

[0060] This module can also provide regional environmental parameter monitoring display, such as Figure 4 As shown in C3 in , it supports multi-language interface switching, such as Figure 4 As shown in C4.

[0061] Regarding the operation of the extension management submodule B3, this module Figure 1 and Figure 3 The workflow is as follows: Figure 5 shown.

[0062] Assume that the laboratory needs to add a new test station as an extension, that is, Figure 1 The administrator only needs to click the "New Extension" button on the "Extension Management" page of the main system's web interface to create a new extension. Figure 5 In step A, the system may ask you to enter some basic configuration information.

[0063] After confirmation, the extension management submodule, Figure 5 Part B of the installation will automatically package the pre-compiled extension client program, necessary configuration files, and possible encryption keys or license files into a compressed file or a lightweight installation program on the server side, such as Figure 5 As shown in G, this is Figure 1 F refers to the extension client deployment package.

[0064] After the administrator downloads this deployment package, Figure 5 In step H, unzip and run on the new extension computer to complete Figure 5 Step I in .

[0065] After the extension client is started, Figure 5 In step J, it will automatically try to connect to the central data processing and storage unit according to the configuration information in the package, such as Figure 5 As shown in step K in the above example, register yourself and prepare to receive tasks or upload data. Figure 5 The L step in .

[0066] This approach avoids the tedious manual installation and configuration process on each extension.

[0067] In terms of data filtering, this feature is provided by Figure 3 The B2e module in the

[15] module supports this. For example, a user wants to view all data under a 25°C ± 2°C environment, with the test item being "Conducted Emission CE", the frequency range being between 150kHz and 30MHz, and the disturbance level exceeding the limit, thus constituting a failure.

[0068] The central data processing and storage unit constructs a WHERE clause similar to that in an SQL query, or implements an AND operation of this series of conditions in the program logic, namely, C1: (temperature ≥ 23 AND temperature ≤ 27), C2: (test item = 'CE'), C3: (frequency ≥ 0.15 AND frequency ≤ 30), C4: (measured value > limit value).

[0069] Only data records that meet all four conditions will be extracted for subsequent display or analysis.

[0070] Report integration capabilities, i.e. Figure 3 The module shown in B2d allows the user to select a report template.

[0071] Based on the chapter structure and data field placeholders defined in the template, the system will automatically extract relevant test information, environmental conditions, summary results of all test items, detailed data graphs, etc. from the database, fill them into the template, and generate a report document in PDF or Word format.

[0072] Regional environmental parameter monitoring function, such as Figure 4 As shown in C3, the data collected in real time from the temperature and humidity sensors and electromagnetic probes connected to the system may be displayed in a specific area of ​​the web interface, and compared with the range required by the standard, and a prominent prompt will be given when the standard is exceeded.

[0073] Chinese and English switching function, such as Figure 4 As shown in C4 in the figure, a language selection button is usually provided in the upper right corner of the web interface or in the settings menu. After clicking it, all labels, menus, prompt information and other text contents on the interface will dynamically switch to the language selected by the user.

[0074] The process of the method embodiment of the present invention is as follows Figure 6 As shown, the steps correspond to the functions of each module of the above system, starting from Figure 6 From step A shown in Figure 6 The data acquisition steps B and C shown in Figure 6 The storage step D shown in Figure 6 The processing steps F, Figure 6The step G shown in FIG, and Figure 6 The extension establishment and communication steps I and J shown in FIG, finally end at Figure 6 Step K shown in .

[0075] Although specific embodiments of the present invention have been described above, those skilled in the art will appreciate that these specific embodiments are merely illustrative, and that those skilled in the art may omit, substitute, and modify the details of the methods and systems described above without departing from the principles and spirit of the present invention. For example, combining the above method steps to perform substantially the same functions in substantially the same manner to achieve substantially the same results falls within the scope of the present invention. Accordingly, the scope of the present invention is limited solely by the appended claims.

Claims

1. A data integration system based on EMC, characterized in that: include: a data acquisition module configured to acquire the raw test data from at least one EMC test device, and perform standardized preprocessing on the raw test data to generate EMC basic data in a standard format; a central data processing and storage unit, connected to the data acquisition module, configured to receive and store the EMC basic data, and perform at least one data processing operation on the EMC basic data based on a preset EMC analysis model and user instructions, the data processing operation including data statistics, trend analysis, or compliance determination; a Web service interaction module, connected to the central data processing and storage unit, configured to generate a unified Web interaction interface, the Web interaction interface at least displaying the results of the data processing operation and providing a user operation entry to invoke preset functions of the central data processing and storage unit; Among them, the central data processing and storage unit also includes an extension management submodule, which is configured to respond to the extension establishment instruction received through the Web interactive interface and generate an extension client deployment package in a file packaging manner. The extension client deployment package is used to quickly deploy on the extension device and establish data communication with the central data processing and storage unit.

2. The EMC-related data integration system according to claim 1, characterized in that: The data acquisition module is further configured to adapt to multiple EMC test equipment interfaces and data protocols, and convert raw test data from different sources into a unified internal data structure and then perform standardized preprocessing.

3. The EMC-related data integration system according to claim 1, characterized in that: The data processing operations performed by the central data processing and storage unit also include report integration, which can automatically fill in the filtered EMC basic data or the results of the data processing operations to generate an EMC test report based on a preset template or a user-defined template.

4. The EMC-related data integration system according to claim 1, characterized in that: The Web interactive interface provided by the Web service interactive module also includes a regional environmental parameter monitoring function for displaying environmental parameters related to EMC testing, wherein the environmental parameters include temperature, humidity and electromagnetic field background values.

5. The EMC-related data integration system according to claim 1, characterized in that: The Web service interaction module supports switching display of at least two user operation language interfaces.

6. The EMC-related data integration system according to claim 1, characterized in that: The central data processing and storage unit applies data screening logic D when performing data processing operations. filstered =d∈D base |C1(d)∧C2(d)∧…∧C n (d), where D base is the EMC basic data set, d is a single data in the data set, and C1 is a user-defined or system-preset filtering condition predicate.

7. The EMC-related data integration system according to claim 1, characterized in that: After the extension client deployment package generated by the extension management submodule is deployed on the extension device, the extension device is allowed to upload supplementary test data to the central data processing and storage unit or receive test task instructions issued by the central data processing and storage unit.

8. A data integration method based on EMC, characterized in that: The following steps are involved: First, raw test data is acquired from at least one EMC test device through a data acquisition module, and the raw test data is subjected to standardization preprocessing to generate EMC basic data in a standard format; Next, the EMC basic data is received and stored using a central data processing and storage unit; the central data processing and storage unit performs at least one data processing operation on the EMC basic data based on a preset EMC analysis model and user instructions, the data processing operation including data statistics, trend analysis, or compliance determination; Afterwards, a unified web interaction interface is generated through the web service interaction module, wherein the web interaction interface at least displays the result of the data processing operation and provides a user operation entrance to call the preset function of the central data processing and storage unit; Finally, in response to the extension establishment instruction received through the Web interactive interface, the extension management submodule of the central data processing and storage unit generates an extension client deployment package in a file packaging manner, which is used for rapid deployment on the extension device and establishing data communication with the central data processing and storage unit.

9. The EMC-related data integration method according to claim 8, characterized in that: After the data collection step, the process also includes converting the original test data from different sources into a unified internal data structure.

10. The EMC-related data integration method according to claim 8, characterized in that: The data processing operation performed by the central data processing and storage unit further includes a report integration step, wherein the report integration step automatically fills the filtered EMC basic data or the results of the data processing operation into an EMC test report based on a preset template or a user-defined template.

Images