Automobile electromagnetic compatibility radiation anti-interference test data processing method and system

Abstract

The invention discloses an automobile electromagnetic compatibility radiation anti-interference test data processing method and system, and belongs to the technical field of data processing, and the processing method comprises the steps: constructing metadata information, obtaining radiation anti-interference test data of automobile electronic equipment, processing the test data through the metadata information, and obtaining complete test data. Cleaning the test data, removing the test data with unsuccessful consistency and integrity verification, and identifying and processing abnormal test data and repeated test data; analyzing the cleaned test data, extracting a characteristic index, and setting a corresponding electromagnetic compatibility radiation anti-interference scoring rule for the characteristic index to obtain an automobile electromagnetic compatibility radiation anti-interference score; the radiation anti-interference test data of the automobile electronic equipment are comprehensively managed and analyzed, the real-time performance and integrity of the data are ensured, man-made interference is reduced, the radiation anti-interference test data are efficiently processed and displayed, and testers are assisted in rapidly analyzing and solving problems.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and particularly to a method and system for processing automotive electromagnetic compatibility radiation immunity test data. Background Art

[0002] With the rapid development of automotive technology, the number and complexity of various electronic devices in vehicles are constantly increasing. Electromagnetic compatibility radiation immunity testing is crucial for ensuring the normal operation of automotive electronic devices in complex electromagnetic environments. From engine control units to in-vehicle entertainment systems, from airbags to autonomous driving assistance systems, the normal operation of these devices is vital for the safety and reliability of vehicles. However, when these electronic devices operate in complex electromagnetic environments, they may be interfered by external electromagnetic radiation, resulting in performance degradation or even failure.

[0003] Traditional methods for processing electromagnetic compatibility radiation immunity test data have problems such as low efficiency and unintuitive data display. Test data is usually presented in the form of tables or texts, and users need to spend a lot of time manually analyzing and processing the data, making it difficult to quickly identify problems and take measures. In addition, traditional data processing methods are difficult to handle large-scale test data and cannot meet the requirements of modern automotive electronics testing.

[0004] With the continuous development of automotive electronic devices, their operating frequency range is getting wider, signal processing capabilities are getting stronger, and the requirements for electromagnetic compatibility radiation immunity testing are also getting higher. Existing test methods and data processing means are already difficult to meet the growing test requirements, and the above problems need to be solved urgently. Summary of the Invention

[0005] The purpose of the present invention is to provide a method and system for processing automotive electromagnetic compatibility radiation immunity test data to solve the problems raised in the above background art.

[0006] To achieve the above purpose, the present invention provides the following technical solution: A method for processing automotive electromagnetic compatibility radiation immunity test data, including: Constructing metadata information, obtaining radiation immunity test data of automotive electronic devices, and processing the test data through the metadata information to obtain complete test data; Cleaning the test data, removing test data that fails in consistency and integrity verification, and identifying and processing abnormal test data and duplicate test data; Analyzing the cleaned test data, extracting characteristic indicators, setting corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, and obtaining the automotive electromagnetic compatibility radiation immunity score.

[0007] Furthermore, metadata information is constructed, and radiation immunity test data of automotive electronic equipment is obtained. The test data is processed through the metadata information to obtain complete test data, which also includes: Connecting metadata information to the test data, wherein the metadata information includes an identification packet sequence, a timestamp, and a data length; The test data is processed by identifying the packet sequence and timestamp, and whether the processed test data is a complete packet of data is determined based on the identification packet and data length; If it is a complete package of data, clean the test data.

[0008] Furthermore, the test data is cleaned, the test data that fails the consistency and integrity check is removed, and the abnormal test data and duplicate test data are identified and processed. The consistency and integrity check includes: The metadata information includes the data information required by the test items. A first check code is generated according to the data information required by the test items. Each set of test data is converted into binary. Each bit of the converted data is processed by XOR addition, and the lowest 24 bits are retained to form a second check code. It is determined whether the first check code and the second check code are consistent. If they are consistent, they are stored in the database after verification. If they are inconsistent, the corresponding test data is removed to complete the consistency check. Each set of test data includes label data and test process data. Label data includes necessary label data and non-essential label data. Test process data includes necessary process data and non-essential process data. Determine whether the necessary label data and necessary process data are missing. If so, delete the corresponding data and keep the log. If not, store the corresponding data in the database.

[0009] Furthermore, the abnormal test data is identified and processed, including: The test process data includes test frequency band data and test result data. The test result data is Gaussian normalized to obtain the minimum dimension value. The minimum dimension value is reduced by principal component analysis and then visualized to obtain isolated points far away from the main data group. The isolated points are marked to determine whether the marked isolated points are abnormal test data. If so, they are deleted and the deletion log is retained.

[0010] Furthermore, the repeated test data is identified and processed, including: Perform hash encoding on the label data and the test result data in each set of test data to generate a hash value of the test data, and store the mapping relationship between the hash value and the test data; Get new test data, query and compare based on the hash value, if the hash value exists, the new test data is determined to be duplicate data; Query and compare according to the hash value to determine whether it is duplicate tag data or duplicate test process data; If the tag data is duplicate and the test process data is not duplicate, it is determined as the test data of multiple tests, and the latest test data is retained; If both the tag data and the test process data are duplicate, it is determined whether it is duplicate acquisition of test data or an abnormality occurs in the data acquisition process according to the time slice; If duplicate test data is acquired, the duplicate data is retained. If an abnormality occurs in the data acquisition process, the duplicate data is deleted.

[0011] Furthermore, analyze the cleaned test data, extract characteristic indicators, set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, and obtain the automotive electromagnetic compatibility radiation immunity score, including: Perform window first-in-first-out rolling processing on the cleaned test data according to the timing characteristics of the test data, and extract the characteristic indicators of the test data; Set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, obtain the automotive electromagnetic compatibility radiation immunity score, and give a visual display of the score result; Set the radiation threshold and frequency threshold. If it is determined according to the test data that the radiation value exceeds the radiation threshold, a radiation over-limit warning is given. If it is determined according to the test data that the frequency value exceeds the frequency threshold, a frequency over-limit warning is given.

[0012] On the other hand, a system for processing automotive electromagnetic compatibility radiation immunity test data is provided, which applies the automotive electromagnetic compatibility radiation immunity test data processing method described in any one of the above, including: A project generation module, which is used to generate a corresponding test project task list according to the test project for applying automotive electromagnetic compatibility radiation immunity. The test project task list includes the setting of test parameters in the test project; A data transmission module, which is used to construct metadata information, obtain the radiation immunity test data of automotive electronic devices, and process the test data through the metadata information to obtain complete test data; A data cleaning module, which receives the test data sent by the data transmission module, cleans the test data, eliminates the test data for which the consistency and integrity checks are unsuccessful, and identifies and processes abnormal test data and duplicate test data; A data analysis and processing module, which is used to analyze the cleaned test data, extract characteristic indicators, set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, and obtain the automotive electromagnetic compatibility radiation immunity score.

[0013] Furthermore, the data transmission module also includes: A metadata module for constructing metadata information, where the metadata information includes the identification packet sequence, timestamp, and data length; A buffer where the metadata information is stored; A connection module for connecting the metadata information with the test data and storing them in the buffer; A metadata processing module processes the test data through the identification packet sequence and timestamp. The processed test data is judged whether it is a complete packet of data according to the identification packet and data length. If it is a complete packet of data, the test data is cleaned.

[0014] Further, the data cleaning module further includes: A consistency verification module for verifying the consistency of the test data according to the first verification code and the second verification code; An integrity verification module for verifying the integrity of the test data according to whether there is a lack of label necessary data and process necessary data; An abnormal data processing module for identifying and processing abnormal test data according to whether the marked isolated points are abnormal test data; A duplicate data processing module for querying and comparing according to the hash value, identifying whether the new test data is duplicate data, test data of multiple tests, or an abnormality occurs in the process of obtaining data, and processing it.

[0015] Further, the data analysis and processing module includes: An analysis module for analyzing the cleaned test data and extracting characteristic indicators; A processing module for setting corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators to obtain the automotive electromagnetic compatibility radiation immunity score; A display module for visually displaying the score result; An early warning module for setting a radiation threshold and a frequency threshold, and giving an early warning of radiation exceeding the standard according to the test data if the radiation value exceeds the radiation threshold, and giving an early warning of frequency exceeding the standard according to the test data if the frequency value exceeds the frequency threshold.

[0016] Compared with the prior art, the beneficial effects of the present invention are as follows: The present invention realizes the comprehensive management and analysis of the radiation immunity test data of automotive electronic devices, ensuring the real-time nature and integrity of the data. This system can reduce human interference, efficiently process and display the radiation immunity test data, assist testers in quickly analyzing and solving problems, save the time for test data collection and processing, and at the same time, the alarm and early warning layer can give intelligent early warnings, predict potential problems, and optimize the test plan; The present invention realizes the data sharing of various test equipment data within the platform, realizes the function of automatic collection of electromagnetic compatibility immunity test data, and at the same time intelligently analyzes and ranks the electromagnetic compatibility immunity performance of vehicles according to the test results, having great social and commercial value. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a flowchart of the method for processing automotive electromagnetic compatibility radiation immunity test data in an embodiment of the present invention; Figure 2 It is a connection block diagram of the automotive electromagnetic compatibility radiation immunity test data processing system in an embodiment of the present invention; Figure 3 It is a logic block diagram for processing test data by metadata information in an embodiment of the present invention; Figure 4 It is a logic block diagram for checking the consistency and integrity of test data in an embodiment of the present invention; Figure 5 It is a logic block diagram for identifying and processing abnormal test data in an embodiment of the present invention; Figure 6 It is a logic block diagram for identifying and processing duplicate test data in an embodiment of the present invention; Figure 7 It is a logic diagram for analyzing and processing the cleaned test data in an embodiment of the present invention; Figure 8 It is a schematic diagram of the user login interface of the automotive electromagnetic compatibility radiation immunity test data processing system in an embodiment of the present invention; Figure 9 It is a schematic diagram of the bar chart showing the ranking of the maximum radiation values of users and vehicle models in an embodiment of the present invention; Figure 10 It is a schematic diagram of the over-standard frequency numbers of users and vehicle models in an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0018] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0019] In the description of the present invention, unless otherwise specified, "plurality" means two or more than two; the orientations or positional relationships indicated by the terms "upper", "lower", "left", "right", "inner", "outer", "front end", "rear end", "head", "tail", etc. are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", "third", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0020] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0021] Please refer to the instruction manual Figures 1 to 10 As shown, the present invention provides a technical solution: Figure 1 As shown, a method for processing automobile electromagnetic compatibility radiation immunity test data includes the following steps: S102, constructing metadata information, and obtaining radiation immunity test data of automotive electronic equipment, and processing the test data through the metadata information to obtain complete test data; Specifically, metadata information is connected to the test data, wherein the metadata information includes an identification packet sequence, a timestamp, and a data length; The test data is processed by identifying the packet sequence and timestamp, and whether the processed test data is a complete packet of data is determined based on the identification packet and data length; If it is a complete package of data, clean the test data.

[0022] Among them, Figure 3As shown in the figure, the present invention transmits the collected data to the data processing method for automotive electromagnetic compatibility radiated immunity test through a high-speed network to ensure the real-time and integrity of the data; the data transmission network adopts a reliable communication protocol to ensure the stability and security of the data during transmission; at the same time, a data continuation method is added at the data acquisition layer to ensure that the data carries corresponding checksum and metadata information when entering data cleaning, which is convenient for subsequent processing and data integrity. A certain buffer is set in the data acquisition link to receive the transmitted data, sort and packetize it. After the packetization is completed, it enters the data processing layer for processing; when collecting the test data of each test device, a data transmission middleware is added to add metadata information to the collected test data. The metadata information includes the identification of packet order, timestamp, checksum (CRC), and data length. Each group of data is integrated into the structure of metadata-continued test data and stored in the buffer through the corresponding communication protocol. According to the test engineering experience, the size of the buffer is set. The buffer stores the data with metadata information. When a new test data is output by the test device, the new data is preferentially continued to be stored in the buffer, and at the same time, the data in the buffer is processed synchronously. The original test data is preferentially processed according to the identification of packet order and timestamp. When it is recognized that the data in the buffer is a complete packet of data, it is output to the next data processing link. The data processing layer cleans the data, and at the same time, the buffer clears the processed data and redundant data; when it is impossible to recognize the data in the buffer as a complete packet of data, the buffer is cleared and the test device data is re-collected for operation.

[0023] S104. Clean the test data, eliminate the test data that fails in consistency and integrity verification, and identify and process abnormal test data and duplicate test data; Specifically, the consistency and integrity verification includes: The metadata information includes the data information required for the test item. Generate the first checksum according to the data information required for the test item. Convert each group of test data into binary, perform exclusive OR addition on each bit of the converted data, and retain the lowest 24 bits to form the second checksum. Determine whether the first checksum and the second checksum are consistent. If they are consistent, the data passes the verification and is stored in the database. If they are inconsistent, the corresponding test data is eliminated to complete the consistency verification; Each group of test data includes label data and test process data. The label data includes label necessary data and label non-necessary data. The test process data includes process necessary data and process non-necessary data. Respectively judge whether there is a lack of label necessary data and process necessary data. If there is a lack, the corresponding data is deleted and a log is retained. If there is no lack, the corresponding data is stored in the database.

[0024] Among them, such as Figure 4As shown, data consistency and integrity verification mainly verify the composition and integrity of data to ensure the reliability of received data. According to the characteristics of anti-interference data, consistency verification is performed on test data. The test data is divided into two parts. One part is label data such as vehicle models, and the other part is test process data, such as test frequency band data and test result data. CRC verification method is used for data uploading and transmission. The verification code (CRC) in the metadata information is used as the first verification code. Each group of data containing label data and test process data is converted into binary, and after conversion, exclusive OR verification is performed. The verification method is to perform exclusive OR addition on each bit of the data converted into binary. After processing, the last verification code of the lowest 24 bits is retained as the second verification code. After the verification passes, the data shows that the verification is successful. For data with unsuccessful verification, deletion operations are performed.

[0025] For the integrity verification of test data, first is the integrity verification of label data. According to business requirements, label data in the system is set as label necessary data and label non-necessary data. Label necessary data and label non-necessary data have the functions of required filling and optional filling respectively. For required data such as vehicle models and vehicle VIN, if new data is missing, it is determined that the data integrity verification fails. For optional data, no integrity verification is performed. Secondly, for test frequency band data and test result data, according to the characteristics of laboratory test equipment and test standards, etc., the test data frequency band must cover 20MHz - 2000MHz. Each group of data should contain required data such as group ID, field strength, modulation method, polarization method, and test conclusion. When there are problem components during the test process, the optional data should contain the name and category of the problem components, the frequency of the problem, etc. Integrity verification is performed on the above data content. If required data is missing, it is determined that the data integrity verification fails. For optional data, no integrity verification is performed.

[0026] Specifically, identify and process abnormal test data, including: Test process data includes test frequency band data and test result data. The test result data is processed by Gaussian normalization to obtain the minimum dimension value. After dimensionality reduction of the minimum dimension value through principal component analysis, visualization processing is performed to obtain isolated points far from the main data group, and the isolated points are marked. Determine whether the marked isolated points are abnormal test data. If so, delete them and retain the deletion log.

[0027] Among them, such as Figure 5As shown in the figure, after the test data passes the consistency and integrity checks, outlier processing is performed. According to the characteristics of the test data in the anti-interference data, the PCA+t-SNE outlier detection method applicable to multi-dimensional variables is adopted. First, the preliminary identification of outliers is carried out. According to the processing characteristics of PCA and the requirements of the subsequent ranking algorithm, the detection result data is first subjected to Gaussian normalization processing, and the cumulative explained variance of all data is calculated. When calculating the set principal component data, such as frequency band and field strength, the cumulative explained variance of the principal component data is calculated. During the calculation process, the smallest dimension k is selected so that the cumulative variance of all principal components exceeds the threshold. For example, the threshold is set to 95%. The found dimension k is the value for dimensionality reduction required by the PCA algorithm. The data is subjected to dimensionality reduction processing based on the k value that has retained sufficient principal components. The processed data is subjected to t-SNE visualization processing, and the isolated points far from the main data group are found according to the Local Outlier Factor (LOF) method, and the isolated points are marked.

[0028] Secondly, the analysis and processing of outliers are carried out. The isolated points found far from the main data group are analyzed to determine the abnormal performance of the isolated points in the original data space, and it is verified whether there are situations such as abnormal data transmission, measurement errors, rare but real test data values, data mixing anomalies, etc. The data is processed according to the specific situation. Except for rare but real test data values that need to retain the isolated point data, the isolated points in other situations are deleted, and the deletion log is retained for viewing.

[0029] Specifically, the repeated test data is identified and processed, including: The label data and test result data in each group of test data are subjected to hash value encoding to generate the hash value of the test data, and the mapping relationship between the hash value and the test data is stored; New test data is obtained, and query comparison is carried out according to the hash value. If the hash value exists, the new test data is determined to be duplicate data; Query comparison is carried out according to the hash value to determine whether it is the label data that is repeated or the test process data that is repeated; If the label data is repeated and the test process data is not repeated, it is determined to be the test data of multiple tests, and the latest test data is retained; If both the label data and the test process data are repeated, it is judged according to the time slice whether it is repeated acquisition of test data or an abnormality occurs in the data acquisition process; If the test data is repeatedly acquired, the duplicate data is retained. If an abnormality occurs in the data acquisition process, the duplicate data is deleted.

[0030] Among them, such as Figure 6As shown, according to the actual business requirements, there may be several working conditions for duplicate data. One is that the experiments conducted are repeated and the labeled data in the transmitted data is repeated. Another is that the same experiment is sent multiple times, resulting in duplicate labeled data and test result data. And another is that duplicate labeled data and result data are caused by data transmission errors. For the identification and processing of duplicate data, the hash value algorithm is mainly used. Hash value encoding is performed on the data after data verification and outlier processing. Currently, the relatively common MD5 encoding is used in the system. Each group of received labeled data and test result data is encoded, and the mapping relationship between the hash value and the original data is stored. If new data is received again, it is queried and compared according to the hash value. If the hash value exists, it is determined as duplicate data. At this time, it is necessary to compare according to the labeled data and test data respectively. If the labeled data is repeated and the test data is not repeated, it is considered multiple experiments, and the test result of the latest time is retained. If both the labeled data and the test data are repeated, it is necessary to distinguish whether it is sent multiple times, data transmission, or other anomalies according to the time slice. If it is sent multiple times, the duplicate data is retained. If it is data transmission or other reasons, the duplicate data is deleted.

[0031] S106. Analyze the cleaned test data, extract characteristic indicators, set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, and obtain the automotive electromagnetic compatibility radiation immunity score.

[0032] Specifically, analyzing the cleaned test data, extracting characteristic indicators, setting corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, and obtaining the automotive electromagnetic compatibility radiation immunity score includes: Perform window first-in-first-out rolling processing on the cleaned test data according to the timing characteristics of the test data, and extract the characteristic indicators of the test data; Set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, obtain the automotive electromagnetic compatibility radiation immunity score, and give a visual display of the score result; Set the radiation threshold and frequency threshold. If it is determined according to the test data that the radiation value exceeds the radiation threshold, a radiation over-limit warning is given. If it is determined according to the test data that the frequency value exceeds the frequency threshold, a frequency over-limit warning is given.

[0033] Among them, as Figure 7 shown, use the real-time stream Flink technology to analyze the cleaned data, extract key characteristic indicators, such as the functional performance level of the vehicle and characteristic indicators such as frequency band, amplitude, and field strength. Set a ranking strategy according to the extracted characteristic indicators, obtain the score of the immunity test according to the ranking strategy, and finally give a visual display of the score result.

[0034] Analyze and process the cleaned test data, extract key features, connect the data to the data analysis and processing module through the communication interface, perform window first-in-first-out rolling processing on the data according to the timing characteristics, extract key feature indicators such as the frequency band, amplitude, and field strength of the data, store the extracted feature indicators and output them to the analysis and processing module, and at the same time monitor the extraction status in real time for optimization processing. After the extracted data enters the analysis and processing module, process the data according to the ranking strategy; for example, distinguish whether this test is a single level or multiple levels according to the frequency band and field strength of the data, and then calculate the score according to the function type of the vehicle (such as types A, B, C, and D) and the performance level of the function (such as levels I, II, III, IV, and V). First, for a single-level test, if the field strength does not change within the full-frequency band test, the final score is the score of the relatively high function type and the relatively high performance level of the function. Secondly, for a multiple-level test, the full-frequency band test is divided into multiple levels, and the score of each level is calculated with reference to the single-level score. The final score of the full-frequency band is calculated according to the proportion of the corresponding frequency bands of each level to obtain the final score; visually display the score calculated from the test results; the visual display is used to intuitively display the test results. For example, the visual display includes map display, bar chart display, line chart display, etc. The map display shows the test results and geographical distribution trends of users of different vehicle manufacturers through the map, and the map display can intuitively present the distribution of test results of different vehicle manufacturers, helping users quickly understand the overall situation of the industry; such as Figure 9 and 10 shown, use a bar chart to display the comparison of the maximum radiation value ranking and the number of over-standard frequencies. The bar chart display can intuitively present the maximum radiation value and the number of over-standard frequencies of different vehicle manufacturers and models, providing users with a clear improvement direction; in addition, the change trend of the number of over-standard frequencies and the radiation value can be displayed through a line chart. The line chart display can intuitively present the change trend of the number of over-standard frequencies and the radiation value, helping users understand the fluctuations during the test process and the frequency domain characteristics of the equipment; the warning for over-standard test results includes setting the radiation threshold and frequency threshold. According to industry standards and enterprise requirements, set the thresholds for the radiation value and the number of over-standard frequencies. The threshold setting can ensure that there is a clear standard for data judgment during the test process, improving the accuracy and reliability of the test. When the data exceeds the threshold, the system automatically triggers an alarm and notifies the user by means of sound, text message, etc. The alarm trigger can timely remind the user to handle potential problems and avoid greater losses caused by equipment failures in terms of electromagnetic compatibility. For data close to the threshold, a warning prompt is issued to remind the user to pay attention and take preventive measures. The warning prompt can help the user discover potential problems in advance, take preventive measures, and avoid the further deterioration of the problem.

[0035] On the other hand, such as Figure 2As shown in the figure, a data processing system for automotive electromagnetic compatibility radiation immunity testing is provided. By applying the data processing method for automotive electromagnetic compatibility radiation immunity testing described in any one of the above, it includes: A project generation module 10, which is used to generate corresponding test project task sheets according to the test projects applied for automotive electromagnetic compatibility radiation immunity. The test project task sheets include the setting of test parameters in the test projects. A data transmission module 20, which is used to construct metadata information, obtain the radiation immunity test data of automotive electronic devices, process the test data through the metadata information, and obtain complete test data. A data cleaning module 30, which receives the test data sent by the data transmission module, cleans the test data, eliminates the test data that fails in consistency and integrity verification, and identifies and processes abnormal test data and duplicate test data. A data analysis and processing module 40, which is used to analyze the cleaned test data, extract characteristic indicators, set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, and obtain the automotive electromagnetic compatibility radiation immunity score.

[0036] In the above embodiments, as Figure 8 shown, the user inputs the account number and password to log in to the data processing system for automotive electromagnetic compatibility radiation immunity testing; it further includes a test equipment access module, which is used to access multiple automotive electromagnetic compatibility radiation immunity test equipment and collect the automotive electromagnetic compatibility radiation immunity test data in real time. Among them, the test equipment also includes a data collection module; the connection of the immunity test equipment mainly relies on the data collection module to collect the data of automotive electronic devices in the radiation immunity test from multiple test equipment, including information such as electric field strength, frequency range, amplitude, etc., and stores the data in the data processing system for automotive electromagnetic compatibility radiation immunity testing. The system performs data cleaning on the test data For example, the specific equipment connection status and functions are as follows: Signal source: It is used to generate electromagnetic radiation signals with specific frequencies and intensities, covering a frequency range of 10 kHz to 10 GHz to ensure the comprehensiveness of the test. The signal source can generate unmodulated sine wave signals, AM signals modulated at 1 kHz 80%, and PM signals with specific periods to meet different test requirements.

[0037] Power amplifier: It amplifies the signals generated by the signal source to meet the radiation intensity requirements for testing. The maximum output power can reach 100 W. The power amplifier can ensure that the signals do not distort during transmission and at the same time provide sufficient power to cover the field strength range required for testing.

[0038] Electric field strength probe: Used to measure the electric field strength in the test environment to ensure that the test conditions meet the standard requirements. The electric field strength probe has high sensitivity and broadband measurement capabilities, and can accurately capture the electric field strength at different frequencies.

[0039] Transmitting antenna: Used to transmit the signal output by the power amplifier in the form of electromagnetic waves to conduct radiation interference tests on the device under test. The transmitting antenna has good directivity and radiation characteristics, and can ensure that the signal evenly covers the test area.

[0040] Receiver: Receives the response signals of automotive electronic devices in the radiation immunity test, including parameters such as signal distortion and bit error rate, and supports multi-channel parallel reception. The receiver has high sensitivity and broadband reception capabilities, and can accurately capture the response signals of the device at different frequencies.

[0041] Data transmission network: Transmits the collected data to the big data platform through a high-speed network to ensure the real-time and integrity of the data. The data transmission network uses a reliable communication protocol to ensure the stability and security of the data during transmission.

[0042] In the system, anti-interference detection tasks are set according to the frequency band of the anti-interference antenna, and parameters such as the standing wave ratio, level, and antenna position of the test are set. After the parameter setting is completed, the test can be started, and the data acquisition layer performs data acquisition.

[0043] Optionally, the data transmission module further includes: Metadata module: Used to construct metadata information, where the metadata information includes packet sequence identification, timestamp, and data length; Buffer: The metadata information is stored in the buffer; Connection module: Used to connect the metadata information with the test data and store it in the buffer; Metadata processing module: Processes the test data through the packet sequence identification and timestamp. The processed test data determines whether it is a complete packet of data according to the packet identification and data length. If it is a complete packet of data, the test data is cleaned.

[0044] In the above embodiments, the present invention transmits the collected data to the automobile electromagnetic compatibility radiation immunity test data processing system through a high-speed network to ensure the real-time and integrity of the data; the data transmission network adopts a reliable communication protocol to ensure the stability and security of the data during the transmission process; at the same time, the continuation module adds a data continuation method to the data acquisition layer to ensure that the data has corresponding checksum and metadata information when entering the data cleaning, which is convenient for subsequent processing and data integrity. A certain buffer is set in the data acquisition link to receive the transmitted data, sort and assemble the data, and enter the data processing layer for processing after the assembly is completed; when collecting the test data of each test device, a data transmission middleware is added, and the metadata module adds metadata information to the collected test data, and the metadata information includes the sequence of identification packets, time The time stamp, check code (CRC) and data length are used to integrate each group of data into the structure of metadata-connected test data, and stored in the cache through the corresponding communication protocol. The size of the cache is set according to the test engineering experience. The cache stores data with metadata information. When the test equipment has new test data output, the metadata processing module gives priority to storing the new data in the cache, and synchronously processes the data in the cache. The original test data is processed first according to the identification packet sequence and timestamp. When the data in the cache is identified as a complete package of data, it is output to the data processing layer of the next data processing link for data cleaning. At the same time, the cache will clear the processed data and redundant data; when the data in the cache cannot be identified as a complete package of data, the cache is cleared and the test equipment data operation is re-collected.

[0045] Optionally, the data cleaning module further includes: A consistency check module, used for checking the consistency of the test data according to the first check code and the second check code; The integrity check module is used to check the integrity of the test data according to whether the necessary label data and the necessary process data are missing; An abnormal data processing module is used to identify and process abnormal data of the test data according to whether the marked isolated points are abnormal test data; The duplicate data processing module is used to perform query and comparison based on the hash value, identify whether the new test data is duplicate data, test data of multiple tests, or an abnormality in the data acquisition process, and handle it.

[0046] In the above embodiments, the consistency verification module generates a first verification code according to the data information required by the test item, performs binary conversion on each set of test data, performs exclusive OR addition on each bit of the converted data, and retains the lowest twenty-four bits to form a second verification code. It determines whether the first verification code and the second verification code are consistent. If they are consistent, the data passes the verification and is stored in the database. If they are inconsistent, the corresponding test data is excluded to complete the consistency verification; the integrity verification module determines whether there is a lack of necessary label data and necessary process data respectively. If there is a lack, the corresponding data is deleted and a log is retained. If there is no lack, the corresponding data is stored in the database.

[0047] The abnormal data processing module is used to perform Gaussian normalization on the test result data to obtain the minimum dimension value, perform dimensionality reduction on the minimum dimension value through principal component analysis and then perform visualization processing to obtain isolated points far from the main data group, mark the isolated points, and determine whether the marked isolated points are abnormal test data. If so, they are deleted and a deletion log is retained.

[0048] The duplicate data processing module is used to generate the hash value of the test data by performing hash value encoding on the label data and test result data in each set of test data, and store the mapping relationship between the hash value and the test data; obtain new test data, query and compare according to the hash value. If the hash value exists, it is determined that the new test data is duplicate data; query and compare according to the hash value to determine whether it is the label data that is duplicate or the test process data that is duplicate; if the label data is duplicate and the test process data is not duplicate, it is determined as the test data of multiple tests, and the latest test data is retained; if both the label data and the test process data are duplicate, it is determined according to the time slice whether it is duplicate acquisition of test data or an abnormality occurs in the data acquisition process; if it is duplicate acquisition of test data, the duplicate data is retained. If an abnormality occurs in the data acquisition process, the duplicate data is deleted.

[0049] Optionally, the data analysis and processing module includes: The analysis module is used to analyze the cleaned test data and extract characteristic indicators; The processing module is used to set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators to obtain the automotive electromagnetic compatibility radiation immunity score; The display module gives a visual display of the score result; The warning module is used to set a radiation threshold and a frequency threshold. If it is determined according to the test data that the radiation value exceeds the radiation threshold, a radiation over-standard warning is issued. If it is determined according to the test data that the frequency value exceeds the frequency threshold, a frequency over-standard warning is issued.

[0050] Among them, the analysis module uses real-time stream Flink technology to analyze the cleaned data and extract key feature indicators, such as the functional performance level of the vehicle, and feature indicators such as frequency band, amplitude, and field strength. The processing module sets a ranking strategy according to the extracted feature indicators to generate corresponding electromagnetic compatibility radiation immunity scoring rules for the feature indicators, obtains the scores of the immunity test according to the ranking strategy, and finally gives a visual display of the score results. The map display shows the distribution of vehicle manufacturers: mark the test results of different vehicle manufacturers on the map, including information such as the number of qualified and unqualified enterprises, the number of vehicle models, and the number of vehicles. The map display can intuitively present the distribution of test results of different vehicle manufacturers and help users quickly understand the overall situation of the industry; Geographic trends: show the distribution trends of test results in different regions through the depth of color or the size of icons. Geographic trend analysis can reveal the differences in electromagnetic compatibility levels in different regions and provide references for regional testing and improvement. As Figure 9 shown, the bar chart shows the maximum radiation value ranking: use the bar chart to show the maximum radiation value ranking of vehicle manufacturers and vehicle models to help users quickly identify high-risk objects. The bar chart display can intuitively present the maximum radiation values of different vehicle manufacturers and vehicle models and provide users with clear improvement directions. As Figure 10 shown, the comparison of the number of over-standard frequencies: compare the number of over-standard frequencies of different vehicle manufacturers and vehicle models through a bar chart to analyze the stability of the equipment. The comparison of the number of over-standard frequencies can reveal the differences in electromagnetic compatibility among different vehicle manufacturers and vehicle models and provide a basis for subsequent optimization and improvement. In addition, it also includes a line chart display, the change trend of the number of over-standard frequencies: show the change trend of the number of over-standard frequencies over time through a line chart to analyze the fluctuations during the test process. The line chart display can intuitively present the change trend of the number of over-standard frequencies, help users understand the fluctuations during the test process, and discover and solve problems in a timely manner. The change trend of the radiation value: show the change trend of the radiation value of the equipment at different frequencies to help users understand the frequency domain characteristics of the equipment. The analysis of the change trend of the radiation value can reveal the radiation characteristics of the equipment at different frequencies, provide valuable information for users, and guide subsequent testing and optimization work. The alarm and early warning layer monitors the early warning status of the test process. The alarm and early warning layer alarms and gives early warnings to the over-standard data according to the preset thresholds to remind users to handle potential problems in a timely manner. Radiation value threshold: Set the maximum allowable radiation value of the equipment at different frequencies according to industry standards and enterprise requirements. The threshold setting can ensure that there is a clear standard for data judgment during the test process and improve the accuracy and reliability of the test. Threshold for the number of over-standard frequencies: Set the upper limit of the allowable number of over-standard frequencies of the equipment. The setting of the threshold for the number of over-standard frequencies can help users quickly discover the electromagnetic compatibility problems of the equipment at multiple frequencies and provide a basis for subsequent improvement.

[0051] Although embodiments of the present invention have been shown and described, those of ordinary skill in the art will appreciate that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for processing automobile electromagnetic compatibility radiation immunity test data, characterized in that: include: Build metadata information and obtain radiation immunity test data of automotive electronic equipment, process the test data through metadata information, and obtain complete test data; Clean the test data, remove the test data that failed the consistency and integrity check, and identify and process abnormal test data and duplicate test data; The cleaned test data is analyzed, characteristic indicators are extracted, and corresponding electromagnetic compatibility radiation immunity scoring rules are set for the characteristic indicators to obtain the automobile electromagnetic compatibility radiation immunity score.

2. The method for processing automobile electromagnetic compatibility radiation immunity test data according to claim 1, characterized in that: Build metadata information and obtain radiation immunity test data of automotive electronic equipment. Process the test data through metadata information to obtain complete test data, including: Connecting metadata information to the test data, wherein the metadata information includes an identification packet sequence, a timestamp, and a data length; The test data is processed by identifying the packet sequence and timestamp, and whether the processed test data is a complete packet of data is determined based on the identification packet and data length; If it is a complete package of data, clean the test data.

3. The method for processing automobile electromagnetic compatibility radiation immunity test data according to claim 1, characterized in that: Clean the test data, remove the test data that failed the consistency and integrity check, identify and process the abnormal test data and duplicate test data. The consistency and integrity check includes: The metadata information includes the data information required by the test items. A first check code is generated according to the data information required by the test items. Each set of test data is converted into binary. Each bit of the converted data is processed by XOR addition, and the lowest 24 bits are retained to form a second check code. It is determined whether the first check code and the second check code are consistent. If they are consistent, they are stored in the database after verification. If they are inconsistent, the corresponding test data is removed to complete the consistency check. Each set of test data includes label data and test process data. Label data includes necessary label data and non-essential label data. Test process data includes necessary process data and non-essential process data. Determine whether the necessary label data and necessary process data are missing. If so, delete the corresponding data and keep the log. If not, store the corresponding data in the database.

4. The method for processing automobile electromagnetic compatibility radiation immunity test data according to claim 3 is characterized in that: Identify and process abnormal test data, including: The test process data includes test frequency band data and test result data. The test result data is Gaussian normalized to obtain the minimum dimension value. The minimum dimension value is reduced by principal component analysis and then visualized to obtain isolated points far away from the main data group. The isolated points are marked to determine whether the marked isolated points are abnormal test data. If so, they are deleted and the deletion log is retained.

5. The method for processing automobile electromagnetic compatibility radiation immunity test data according to claim 4 is characterized in that: Identify and process duplicate test data, including: Perform hash encoding on the label data and the test result data in each set of test data to generate a hash value of the test data, and store the mapping relationship between the hash value and the test data; Get new test data, query and compare based on the hash value, if the hash value exists, the new test data is determined to be duplicate data; Query and compare based on the hash value to determine whether the label data or the test process data is repeated; If the label data is repeated but the test process data is not repeated, it is considered as test data of multiple tests and the latest test data is retained; If both the label data and the test process data are repeated, it is determined based on the time slice whether the test data is obtained repeatedly or an abnormality occurs in the data acquisition process; If test data is obtained repeatedly, the duplicate data is retained; if an abnormality occurs during the data acquisition process, the duplicate data is deleted.

6. The method for processing automobile electromagnetic compatibility radiation immunity test data according to claim 1, characterized in that: Analyze the cleaned test data, extract characteristic indicators, set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, and obtain the automobile electromagnetic compatibility radiation immunity score, including: According to the time series characteristics of the test data, the cleaned test data is processed in a window-first-in-first-out rolling manner, and characteristic indicators of the test data are extracted; Set corresponding electromagnetic compatibility radiation immunity scoring rules for characteristic indicators, obtain the automobile electromagnetic compatibility radiation immunity score, and give a visual display of the score results; Set the radiation threshold and frequency threshold. If the radiation value exceeds the radiation threshold based on the test data, a radiation excess warning will be issued. If the frequency value exceeds the frequency threshold based on the test data, a frequency excess warning will be issued.

7. A vehicle electromagnetic compatibility radiation immunity test data processing system, using the vehicle electromagnetic compatibility radiation immunity test data processing method according to any one of claims 1 to 6, characterized in that: include: A project generation module is used to generate a corresponding test project task list according to the test items of the automobile electromagnetic compatibility radiation immunity application, and the test project task list includes the setting of test parameters in the test items; The data transmission module is used to construct metadata information and obtain radiation immunity test data of automotive electronic equipment, and process the test data through the metadata information to obtain complete test data; The data cleaning module receives the test data sent by the data transmission module, cleans the test data, removes the test data that fails the consistency and integrity check, and identifies and processes the abnormal test data and duplicate test data; The data analysis and processing module is used to analyze the cleaned test data, extract characteristic indicators, set corresponding electromagnetic compatibility radiation immunity scoring rules for the characteristic indicators, and obtain the automobile electromagnetic compatibility radiation immunity score.

8. The automotive electromagnetic compatibility radiation immunity test data processing system according to claim 7 is characterized in that: The data transmission module also includes: A metadata module, used to construct metadata information, wherein the metadata information includes an identification packet sequence, a timestamp, and a data length; Cache area, metadata information is stored in the cache area; A continuation module is used to concatenate the metadata information with the test data and store them in a buffer area; The metadata processing module processes the test data by identifying the packet sequence and timestamp. The processed test data is judged whether it is a complete packet of data based on the identification packet and data length. If it is a complete packet of data, the test data is cleaned.

9. The automotive electromagnetic compatibility radiation immunity test data processing system according to claim 7 is characterized in that: The data cleaning module also includes: A consistency check module, used for checking the consistency of the test data according to the first check code and the second check code; The integrity check module is used to check the integrity of the test data according to whether the necessary label data and the necessary process data are missing; An abnormal data processing module is used to identify and process abnormal data of the test data according to whether the marked isolated points are abnormal test data; The duplicate data processing module is used to perform query and comparison based on the hash value, identify whether the new test data is duplicate data, test data of multiple tests, or an abnormality in the data acquisition process, and handle it.

10. The automotive electromagnetic compatibility radiation immunity test data processing system according to claim 7, characterized in that: Data analysis and processing module, including: The analysis module is used to analyze the cleaned test data and extract characteristic indicators; A processing module is used to set corresponding electromagnetic compatibility radiation immunity scoring rules for characteristic indicators to obtain the electromagnetic compatibility radiation immunity score of the vehicle; The display module provides a visual display of the scoring results; The early warning module is used to set the radiation threshold and frequency threshold. If the radiation value exceeds the radiation threshold according to the test data, an early warning of radiation exceeding the standard will be issued. If the frequency value exceeds the frequency threshold according to the test data, an early warning of frequency exceeding the standard will be issued.

Images