Internet of vehicles data quality detection system, method, device and equipment

Abstract

The invention discloses an Internet of Vehicles data quality detection system, method, device and equipment. The system comprises a data access module, a rule management module, a core processing module and a visual display module, after receiving the Internet of Vehicles data, the core processing module detects whether the Internet of Vehicles data accords with each quality detection rule or not, if not, determines that the Internet of Vehicles data is invalid Internet of Vehicles data, generates quality index data, processes the Internet of Vehicles data according to invalid data processing types, and sends the processed Internet of Vehicles data to the Internet of Vehicles processing module; and sending the quality index data to a visual display module. According to the embodiment of the invention, quality detection can be carried out on each piece of Internet of Vehicles data sent to the management server in time according to each quality detection rule, whether the Internet of Vehicles data is high-quality Internet of Vehicles data or invalid Internet of Vehicles data is determined, and the invalid Internet of Vehicles data is processed by using a proper processing mode. And the timeliness of the Internet of Vehicles data quality detection process is improved.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a data quality detection system, method, apparatus, and equipment for vehicle networking. Background Technology

[0002] During vehicle operation, the vehicle controller typically sends vehicle-to-everything (V2X) data to the vehicle management server periodically. Each V2X data transmission from the vehicle controller includes vehicle identification information, recently collected vehicle-related data, and time information recorded by the controller. The management server stores this V2X data in its database and analyzes and monitors the vehicle's operation based on this data. To avoid wasting management server resources, the V2X data sent to the server needs quality control to determine whether it is high-quality or invalid. Equipment malfunctions, communication failures, and other anomalies during vehicle operation may result in numerical anomalies or missing location information in the V2X data sent to the management server. High-quality V2X data refers to data free from numerical anomalies and missing location information. Invalid V2X data refers to data containing numerical anomalies or missing location information. Storing, analyzing, and detecting invalid V2X data wastes the management server's storage and computing resources.

[0003] In related technologies, a common solution for vehicle-to-everything (V2X) data quality inspection involves caching V2X data sent to the management server in a message queue and periodically performing quality inspections on the cached V2X data in the message queue. However, this method, which only periodically inspects the cached V2X data in the message queue, cannot perform timely quality inspections on every piece of V2X data sent to the management server, resulting in low timeliness of the V2X data quality inspection process. Summary of the Invention

[0004] This invention provides a vehicle network data quality detection system, method, apparatus, and equipment to solve the problem that existing vehicle network data quality detection schemes cannot perform timely quality detection on every piece of vehicle network data sent to the management server, resulting in low timeliness of the vehicle network data quality detection process.

[0005] According to one aspect of the present invention, a vehicle network data quality detection system is provided, comprising: a data access module, a rule management module, a core processing module, and a visualization display module;

[0006] The data access module is used to send the vehicle network data to the core processing module after receiving the vehicle network data.

[0007] The core processing module is used to obtain various quality detection rules and corresponding invalid data processing types from the rule management module; after receiving vehicle network data, it checks whether the vehicle network data conforms to the various quality detection rules; if the vehicle network data does not conform to the target quality detection rules, it determines that the vehicle network data is invalid, generates quality index data for the vehicle network data, processes the vehicle network data according to the invalid data processing type corresponding to the target quality detection rules, and sends the quality index data of the vehicle network data to the visualization display module; if the vehicle network data conforms to the various quality detection rules, it determines that the vehicle network data is high-quality vehicle network data, generates quality index data for the vehicle network data, stores the vehicle network data in a preset database, and sends the quality index data of the vehicle network data to the visualization display module.

[0008] The rule management module is used to manage quality inspection rules;

[0009] The visualization module is used to visualize the quality indicator data sent by the core processing module.

[0010] According to another aspect of the present invention, a method for detecting the data quality of a vehicle network is provided, which is applied to the core processing module of a vehicle network data quality detection system, comprising:

[0011] Retrieve each quality inspection rule and the corresponding invalid data processing type from the rule management module;

[0012] After receiving the vehicle network data, it checks whether the vehicle network data meets the various quality inspection rules;

[0013] If the vehicle network data does not meet the target quality detection rules, the vehicle network data is determined to be invalid vehicle network data. Quality index data of vehicle network data is generated, the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rules, and the quality index data of vehicle network data is sent to the visualization display module.

[0014] If the vehicle network data meets all the quality inspection rules, it is determined that the vehicle network data is high-quality vehicle network data. The quality index data of the vehicle network data is generated, the vehicle network data is stored in the preset database, and the quality index data of the vehicle network data is sent to the visualization display module.

[0015] According to another aspect of the present invention, a vehicle network data quality detection device is provided, configured in the core processing module of a vehicle network data quality detection system, comprising:

[0016] The rule acquisition unit is used to acquire each quality inspection rule and the corresponding invalid data processing type from the rule management module;

[0017] The rule detection unit is used to detect whether the vehicle network data conforms to various quality detection rules after receiving the vehicle network data;

[0018] The invalid data processing unit is used to determine that the vehicle network data is invalid if the vehicle network data does not meet the target quality detection rules, generate quality index data of the vehicle network data, process the vehicle network data according to the invalid data processing type corresponding to the target quality detection rules, and send the quality index data of the vehicle network data to the visualization display module.

[0019] The high-quality data processing unit is used to determine that the vehicle network data is high-quality vehicle network data if it meets various quality inspection rules, generate quality index data of vehicle network data, store vehicle network data in a preset database, and send the quality index data of vehicle network data to the visualization display module.

[0020] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0021] At least one processor;

[0022] and a memory communicatively connected to the at least one processor;

[0023] The memory stores a computer program that is executed by the at least one processor, which enables the at least one processor to execute the vehicle network data quality detection method according to any embodiment of the present invention.

[0024] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions, the computer instructions being configured to cause a processor to execute and implement the vehicle network data quality detection method according to any embodiment of the present invention.

[0025] According to another aspect of the present invention, a computer program product is provided, the computer program product comprising a computer program that, when executed by a processor, implements the vehicle network data quality detection method according to any embodiment of the present invention.

[0026] In the technical solution of this invention embodiment, after receiving vehicle network data, the data access module sends the vehicle network data to the core processing module; the core processing module obtains each quality detection rule and the invalid data processing type corresponding to each quality detection rule from the rule management module; after receiving the vehicle network data, the core processing module checks whether the vehicle network data conforms to each quality detection rule; if the vehicle network data does not conform to the target quality detection rule, the core processing module determines that the vehicle network data is invalid vehicle network data, generates quality index data of the vehicle network data, processes the vehicle network data according to the invalid data processing type corresponding to the target quality detection rule, and sends the quality index data of the vehicle network data to the visualization display module; if the vehicle network data conforms to each quality detection rule, the core processing module determines that the vehicle network data is high-quality vehicle network data, generates quality index data of the vehicle network data. According to the description, the system stores vehicle network data in a preset database and sends the quality index data of the vehicle network data to the visualization module; the rule management module manages the quality detection rules; and the visualization module visualizes the quality index data sent by the core processing module. This solves the problem that the vehicle network data quality detection scheme in related technologies cannot perform quality detection on every piece of vehicle network data sent to the management server in a timely manner, resulting in low timeliness of the vehicle network data quality detection process. Based on the data access module, rule management module, core processing module, and visualization module, the system can perform quality detection on every piece of vehicle network data sent to the management server in a timely manner according to various quality detection rules, determine whether the vehicle network data is high-quality vehicle network data or invalid vehicle network data, and use appropriate processing methods to process invalid vehicle network data, thereby improving the timeliness of the vehicle network data quality detection process.

[0027] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0028] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0029] Figure 1 This is a schematic diagram of a vehicle network data quality detection system provided in Embodiment 1 of the present invention.

[0030] Figure 2 This is a flowchart of a vehicle network data quality detection method provided in Embodiment 2 of the present invention.

[0031] Figure 3 This is a schematic diagram of a vehicle network data quality detection device provided in Embodiment 3 of the present invention.

[0032] Figure 4 A schematic diagram of the structure of an electronic device for implementing the vehicle network data quality detection method of this embodiment of the invention. Detailed Implementation

[0033] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0034] It should be noted that the terms "target," "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising," "including," and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0035] Example 1

[0036] Figure 1 This is a schematic diagram of a vehicle-to-everything (V2X) data quality detection system according to Embodiment 1 of the present invention. This embodiment is applicable to situations where V2X data sent to a management server is subjected to quality detection to determine whether the V2X data is high-quality or invalid. This V2X data quality detection system can be configured in the vehicle's management server. The vehicle's management server can be a server used to analyze and detect the vehicle's driving process based on the vehicle's V2X data, monitor the vehicle's driving process, and provide the necessary functional services to the vehicle. Figure 1 As shown, the vehicle network data quality detection system may specifically include: a data access module 101, a rule management module 102, a core processing module 103, and a visualization display module 104. Its structure and functions are described below.

[0037] The data access module 101 is used to send the vehicle network data to the core processing module 103 after receiving the vehicle network data.

[0038] The core processing module 103 is used to obtain various quality detection rules and corresponding invalid data processing types from the rule management module 102. After receiving the vehicle network data, it checks whether the vehicle network data conforms to the various quality detection rules. If the vehicle network data does not conform to the target quality detection rules, it determines that the vehicle network data is invalid, generates quality index data for the vehicle network data, processes the vehicle network data according to the invalid data processing type corresponding to the target quality detection rules, and sends the quality index data of the vehicle network data to the visualization display module 104. If the vehicle network data conforms to the various quality detection rules, it determines that the vehicle network data is high-quality vehicle network data, generates quality index data for the vehicle network data, stores the vehicle network data in a preset database, and sends the quality index data of the vehicle network data to the visualization display module 104.

[0039] Rule management module 102 is used to manage quality inspection rules.

[0040] The visualization module 104 is used to visualize the quality indicator data sent by the core processing module 103.

[0041] Optionally, after receiving the vehicle network data, the data access module 101 sends the vehicle network data to the core processing module 103. Upon receiving the vehicle network data, the core processing module 103 checks whether the vehicle network data conforms to the latest quality detection rules obtained from the rule management module 102. The target quality detection rule can be any one of the various quality detection rules. If the vehicle network data does not conform to the target quality detection rule, it is determined to be invalid vehicle network data, quality index data is generated, the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rule, and the quality index data is sent to the visualization module 104. If the vehicle network data conforms to all the quality detection rules, the core processing module 103 determines that the vehicle network data is high-quality vehicle network data, generates quality index data, stores the vehicle network data in a preset database, and sends the quality index data to the visualization module 104. The rule management module 102 stores various quality detection rules and the invalid data processing types corresponding to each quality detection rule. The visualization module 104 can visualize the quality indicator data sent by the core processing module 103, making it easier for technicians to understand relevant information about the vehicle network data quality detection process in a timely manner.

[0042] Optionally, during the operation of a vehicle managed by the management server, the vehicle's controller periodically sends the vehicle's vehicle-to-everything (V2X) data to the vehicle's management server. Each V2X data sent by the vehicle controller may include the vehicle's identification information, the latest vehicle-related data collected by the vehicle controller, and the time information recorded by the vehicle controller. The vehicle's identification information may be information used to uniquely identify the vehicle. The various vehicle-related data include, but are not limited to, the vehicle's location information, speed, and fuel consumption. The location information may be the vehicle's latitude and longitude coordinates. The time information recorded by the vehicle controller may be the time when the various vehicle-related data were collected. The data access module 101 may be a hardware or software module set in the management server for receiving V2X data sent by the vehicle controller of the vehicle managed by the management server. After receiving each V2X data, the data access module 101 sends the received V2X data to the core processing module 103.

[0043] Optionally, each quality inspection rule can be a pre-set set of rules that high-quality connected vehicle data must meet. Each quality inspection rule can include: value range rules, transition rules, logical rules, and location information rules. A value range rule can be that the speed contained in the connected vehicle data must be greater than or equal to 0 km / h and less than 300 km / h. A transition rule can be that the difference between the speed contained in the connected vehicle data and the speed contained in its associated connected vehicle data must be less than or equal to 50 km / h. The associated connected vehicle data refers to the most recently received high-quality connected vehicle data before the current connected vehicle data is received. A logical rule can be that if the speed contained in the connected vehicle data is 0 km / h, the fuel consumption contained in the connected vehicle data must be less than or equal to 50 liters per 100 kilometers. A location information rule can be that the connected vehicle data contains location information. Generally, when connected vehicle data meets all the quality inspection rules, it indicates that the connected vehicle data does not have numerical anomalies or missing location information, and the connected vehicle data can be determined to be high-quality connected vehicle data. When connected vehicle data does not meet any one or more quality inspection rules, it indicates that the connected vehicle data has numerical anomalies or missing location information, and the connected vehicle data can be determined to be invalid connected vehicle data.

[0044] Optionally, for each quality inspection rule, the invalid data processing type corresponding to the quality inspection rule can be information used to characterize the appropriate processing method for the vehicle network data when it does not conform to the quality inspection rule. The invalid data processing type is marking, discarding, or repairing. When the invalid data processing type corresponding to the quality inspection rule is marking, it can be determined that the appropriate processing method for the vehicle network data when it does not conform to the quality inspection rule is to add a quality label of the quality inspection rule to the vehicle network data and store the tagged vehicle network data in a preset database. Each quality inspection rule has a quality label. The quality label of each quality inspection rule can be pre-set text used to characterize that the vehicle network data does not conform to the quality inspection rule. The preset database can be a database set in the management server for storing the vehicle network data that needs to be analyzed and inspected. When the invalid data processing type corresponding to the quality inspection rule is discarding, it can be determined that the appropriate processing method for the vehicle network data when it does not conform to the quality inspection rule is to delete the vehicle network data. When the invalid data processing type corresponding to the quality inspection rule is "repair," it can be determined that the appropriate method for processing vehicle network data that does not conform to the quality inspection rule is to repair the vehicle network data based on its associated vehicle network data, and then store the repaired vehicle network data in a preset database. Typically, the invalid data processing type for location information rules is "repair." When vehicle network data does not conform to location information rules, i.e., when the vehicle network data does not contain location information, the appropriate method for processing the vehicle network data is to repair the vehicle network data based on its associated vehicle network data, and then store the repaired vehicle network data in a preset database. Repairing vehicle network data based on its associated vehicle network data means adding the location information from the associated vehicle network data to the vehicle network data. The vehicle network data after adding the location information is the repaired vehicle network data.

[0045] Optionally, if the vehicle network data cannot be repaired, for example, if the location information in the associated vehicle network data cannot be obtained, then a quality label for the location information rule is added to the vehicle network data, and the vehicle network data with the added quality label is stored in a preset database.

[0046] Optionally, each quality inspection rule and the corresponding invalid data processing type are stored in the rule management module 102. The rule management module 102 can be a hardware or software module set up in the management server to manage quality inspection rules. Technical personnel can modify the quality inspection rules and corresponding invalid data processing types stored in the rule management module 102 according to business needs. The core processing module 103 can be a hardware or software module set up in the management server to detect whether vehicle network data conforms to various quality inspection rules and determine whether the vehicle network data is high-quality or invalid. The core processing module 103 can parse the vehicle network data, extract various data from it, and convert the vehicle network data into structured data objects for subsequent processing. The core processing module 103 can convert nested, unstructured data into a flat, structured data stream.

[0047] Optionally, the core processing module 103 obtains each quality detection rule and the corresponding invalid data processing type from the rule management module, including: the core processing module 103 periodically obtains each quality detection rule and the corresponding invalid data processing type from the rule management module at preset time intervals. The preset time interval can be a pre-set time interval. The core processing module 103 can perform the operation of obtaining each quality detection rule and the corresponding invalid data processing type from the rule management module once every preset time interval, thereby periodically obtaining the latest quality detection rules and the corresponding invalid data processing types. For example, the preset time interval is 5 minutes.

[0048] Optionally, after receiving vehicle network data, the data access module 101 sends the vehicle network data to the core processing module 103. After receiving vehicle network data, the core processing module 103 checks whether the vehicle network data conforms to the latest quality detection rules obtained from the rule management module 102. The core processing module 103 checks whether the vehicle network data conforms to the various quality detection rules, including: determining the detection components corresponding to each quality detection rule; and using the detection components corresponding to each quality detection rule to check whether the vehicle network data conforms to each quality detection rule in parallel.

[0049] Optionally, the detection component can be a software or hardware module used to detect whether vehicle network data conforms to specified quality inspection rules. The detection component corresponding to the quality inspection rule can be a detection component used to detect whether vehicle network data conforms to the quality inspection rule. The core processing module 103 is equipped with multiple detection components. The core processing module 103 can assign a corresponding detection component to each quality inspection rule, thereby determining the detection components corresponding to each quality inspection rule. The core processing module 103 can use the detection components corresponding to each quality inspection rule to detect whether the vehicle network data conforms to each quality inspection rule in parallel.

[0050] Optionally, the core processing module 103 can use detection components corresponding to the value range rules, transition rules, logical rules, and positioning information rules to detect in parallel whether the vehicle network data conforms to the value range rules, transition rules, logical rules, and positioning information rules.

[0051] Optionally, the vehicle network data is checked for compliance with the value range rules using a detection component corresponding to the value range rules. This includes performing the following operations using the detection component: determining whether the speed contained in the vehicle network data is greater than or equal to 0 km / h and less than 300 km / h; if the speed contained in the vehicle network data is greater than or equal to 0 km / h and less than 300 km / h, then the vehicle network data is determined to comply with the value range rules; if the speed contained in the vehicle network data is less than 0 km / h or the speed contained in the vehicle network data is greater than or equal to 300 km / h, then the vehicle network data is determined to not comply with the value range rules.

[0052] Optionally, the detection component corresponding to the transition rule is used to detect whether the vehicle network data conforms to the transition rule, including: performing the following operations through the detection component corresponding to the transition rule: calculating the difference between the speed contained in the vehicle network data and the speed contained in the associated vehicle network data, and determining whether the difference between the speed contained in the vehicle network data and the speed contained in the associated vehicle network data is less than or equal to 50 kilometers per hour; if the difference between the speed contained in the vehicle network data and the speed contained in the associated vehicle network data is less than or equal to 50 kilometers per hour, then the vehicle network data is determined to conform to the transition rule; if the difference between the speed contained in the vehicle network data and the speed contained in the associated vehicle network data is greater than 50 kilometers per hour, then the vehicle network data is determined to not conform to the transition rule.

[0053] Optionally, the vehicle network data is checked for compliance with the logical rules using a detection component corresponding to the logical rules. This includes performing the following operations using the detection component: determining whether the speed contained in the vehicle network data is 0 km / h; if the speed contained in the vehicle network data is 0 km / h, determining whether the fuel consumption contained in the vehicle network data is less than or equal to 50 liters per 100 km; if the fuel consumption contained in the vehicle network data is less than or equal to 50 liters per 100 km, determining that the vehicle network data complies with the logical rules; if the fuel consumption contained in the vehicle network data is greater than 50 liters per 100 km, determining that the vehicle network data does not comply with the logical rules; and if the speed contained in the vehicle network data is not 0 km / h, determining that the vehicle network data complies with the logical rules.

[0054] Optionally, a detection component corresponding to the location information rule is used to detect whether the vehicle network data conforms to the location information rule, including: determining whether the vehicle network data contains location information; if the vehicle network data contains location information, then the vehicle network data is determined to conform to the location information rule; if the vehicle network data does not contain location information, then the vehicle network data is determined to not conform to the location information rule.

[0055] Optionally, if the vehicle network data does not conform to the target quality detection rule, the core processing module 103 determines that the vehicle network data is invalid, generates quality index data for the vehicle network data, processes the vehicle network data according to the invalid data processing type corresponding to the target quality detection rule, and sends the quality index data of the vehicle network data to the visualization display module 104. When the vehicle network data is determined to be invalid, the generated quality index data includes: incrementing the trigger count of the target quality detection rule by 1, and determining the identifier information and trigger count of the target quality detection rule as the quality index data of the vehicle network data. For each quality detection rule, the identifier information of the quality detection rule can be text used to uniquely identify the quality detection rule. The trigger count of the quality detection rule can be the total number of times the vehicle network data is detected as not conforming to the quality detection rule. Initially, the trigger count of the quality detection rule is 0. The core processing module 103 increments the trigger count of the quality detection rule by 1 each time it detects that the vehicle network data does not conform to the quality detection rule.

[0056] Optionally, the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rule, including: if the invalid data processing type corresponding to the target quality detection rule is a tag, then a quality tag of the target quality detection rule is added to the vehicle network data, and the vehicle network data with the added quality tag is stored in a preset database.

[0057] Optionally, the vehicle network data can be processed according to the invalid data processing type corresponding to the target quality detection rule, including: if the invalid data processing type corresponding to the target quality detection rule is discard, then the vehicle network data can be deleted.

[0058] Optionally, the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rule, including: if the invalid data processing type corresponding to the target quality detection rule is repair, then the vehicle network data is repaired according to the associated vehicle network data, and the repaired vehicle network data is stored in a preset database.

[0059] Optionally, the vehicle network data can be processed according to the invalid data processing type corresponding to the target quality detection rule, including: if the vehicle network data does not conform to multiple quality detection rules, that is, the number of quality detection rules that the vehicle network data does not conform to is greater than or equal to two, then the vehicle network data is determined to be invalid vehicle network data and the vehicle network data is deleted.

[0060] Optionally, if the vehicle network data conforms to various quality inspection rules, the core processing module 103 determines that the vehicle network data is high-quality vehicle network data, generates quality indicator data for the vehicle network data, stores the vehicle network data in a preset database, and sends the quality indicator data for the vehicle network data to the visualization display module 104. When the vehicle network data is determined to be high-quality, the generation of quality indicator data for the vehicle network data includes: determining the identification information and trigger count of the target quality inspection rule as the quality indicator data for the vehicle network data.

[0061] Optionally, the visualization module 104 can be a hardware module configured in the management server for visualizing the quality indicator data sent by the core processing module 103. Visualizing the quality indicator data sent by the core processing module 103 includes: generating charts to display the quality indicator data sent by the core processing module 103, and displaying the generated charts on the quality inspection management page. The quality inspection management page can be a page configured in the visualization module 104 for interaction with technical personnel, providing them with information related to the quality inspection process.

[0062] Optionally, the visualization module 104 can display the identification information and trigger count of each quality inspection rule, vehicle data pass rate, and system processing throughput on the quality inspection management page. The vehicle data pass rate can be the ratio of the total number of high-quality vehicle network data sent by the vehicle's controller to the total number of vehicle network data sent by the vehicle's controller. The system processing throughput can be the total number of vehicle network data detected per unit time. The unit time can be 1 minute. The information displayed on the quality inspection management page is the data quality report generated in real time by the visualization module 104, facilitating the monitoring of the health of vehicles and vehicle network data managed by the management server and proactively identifying terminal device faults.

[0063] In the technical solution of this invention embodiment, after receiving vehicle network data, the data access module sends the vehicle network data to the core processing module; the core processing module obtains each quality detection rule and the invalid data processing type corresponding to each quality detection rule from the rule management module; after receiving the vehicle network data, the core processing module checks whether the vehicle network data conforms to each quality detection rule; if the vehicle network data does not conform to the target quality detection rule, the core processing module determines that the vehicle network data is invalid vehicle network data, generates quality index data of the vehicle network data, processes the vehicle network data according to the invalid data processing type corresponding to the target quality detection rule, and sends the quality index data of the vehicle network data to the visualization display module; if the vehicle network data conforms to each quality detection rule, the core processing module determines that the vehicle network data is high-quality vehicle network data, generates quality index data of the vehicle network data. According to the description, the system stores vehicle network data in a preset database and sends the quality index data of the vehicle network data to the visualization module; the rule management module manages the quality detection rules; and the visualization module visualizes the quality index data sent by the core processing module. This solves the problem that the vehicle network data quality detection scheme in related technologies cannot perform quality detection on every piece of vehicle network data sent to the management server in a timely manner, resulting in low timeliness of the vehicle network data quality detection process. Based on the data access module, rule management module, core processing module, and visualization module, the system can perform quality detection on every piece of vehicle network data sent to the management server in a timely manner according to various quality detection rules, determine whether the vehicle network data is high-quality vehicle network data or invalid vehicle network data, and use appropriate processing methods to process invalid vehicle network data, thereby improving the timeliness of the vehicle network data quality detection process.

[0064] The technical solution of this invention can meet the timeliness requirements of real-time vehicle network services, providing a readily available high-quality data source for the data analysis and application processes of the management server. This significantly improves service response speed and accuracy, and significantly enhances the accuracy and reliability of models such as driving behavior analysis models and fault warning models in the management server. It can also significantly reduce the occupation of storage, computing, and network resources by invalid vehicle network data, achieving cost savings. The dynamic rule configuration process in the technical solution of this invention makes data quality strategy management flexible, visible, and simple, greatly reducing operational complexity and labor costs. Furthermore, the technical solution of this invention not only provides cleaned data but also continuously generates quality indicator data, providing an intuitive basis for quickly locating large-scale terminal failures or data link anomalies.

[0065] Example 2

[0066] Figure 2 This is a flowchart illustrating a method for detecting the quality of vehicle-to-everything (V2X) data according to Embodiment 2 of the present invention. This embodiment is applicable to detecting the quality of V2X data sent to a management server to determine whether the V2X data is high-quality or invalid. This method can be applied to the core processing module of the V2X data quality detection system provided in the above embodiments of the present invention. Figure 2 As shown, the method in this embodiment specifically includes:

[0067] Step 201: Obtain each quality inspection rule and the corresponding invalid data processing type from the rule management module.

[0068] Optionally, obtain each quality inspection rule and the corresponding invalid data processing type from the rule management module, including: periodically obtaining each quality inspection rule and the corresponding invalid data processing type from the rule management module at preset time intervals.

[0069] Step 202: After receiving the vehicle network data, check whether the vehicle network data meets the various quality inspection rules.

[0070] Optionally, the process of detecting whether the vehicle network data conforms to various quality inspection rules includes: determining the inspection components corresponding to each quality inspection rule; and using the inspection components corresponding to each quality inspection rule to detect whether the vehicle network data conforms to each quality inspection rule in parallel.

[0071] Step 203: If the vehicle network data does not meet the target quality detection rules, the vehicle network data is determined to be invalid. Quality index data of the vehicle network data is generated, and the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rules. The quality index data of the vehicle network data is then sent to the visualization display module.

[0072] Optionally, the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rule, including: if the invalid data processing type corresponding to the target quality detection rule is a tag, then a quality tag of the target quality detection rule is added to the vehicle network data, and the vehicle network data with the added quality tag is stored in a preset database.

[0073] Optionally, the vehicle network data can be processed according to the invalid data processing type corresponding to the target quality detection rule, including: if the invalid data processing type corresponding to the target quality detection rule is discard, then the vehicle network data can be deleted.

[0074] Optionally, the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rule, including: if the invalid data processing type corresponding to the target quality detection rule is repair, then the vehicle network data is repaired according to the associated vehicle network data, and the repaired vehicle network data is stored in a preset database.

[0075] Step 204: If the vehicle network data meets all the quality inspection rules, then the vehicle network data is determined to be high-quality vehicle network data. The quality index data of the vehicle network data is generated, the vehicle network data is stored in the preset database, and the quality index data of the vehicle network data is sent to the visualization display module.

[0076] The technical solution of this invention involves obtaining various quality detection rules and corresponding invalid data processing types from a rule management module; upon receiving vehicle network data, checking whether the vehicle network data conforms to each quality detection rule; if the vehicle network data does not conform to the target quality detection rule, it is determined to be invalid vehicle network data, quality index data of the vehicle network data is generated, the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rule, and the quality index data of the vehicle network data is sent to a visualization module; if the vehicle network data conforms to each quality detection rule, it is determined to be high-quality vehicle network data, quality index data of the vehicle network data is generated, and the vehicle network data is then displayed. The system stores vehicle network data in a pre-defined database and sends the quality index data of the vehicle network data to the visualization module. This solves the problem that existing vehicle network data quality detection solutions cannot perform timely quality checks on every piece of vehicle network data sent to the management server, resulting in low timeliness of the vehicle network data quality detection process. Based on the data access module, rule management module, core processing module, and visualization module, the system can perform timely quality checks on every piece of vehicle network data sent to the management server according to various quality detection rules, determine whether the vehicle network data is high-quality or invalid, and use appropriate processing methods to process invalid vehicle network data, thereby improving the timeliness of the vehicle network data quality detection process.

[0077] Example 3

[0078] Figure 3 This is a schematic diagram of a vehicle-to-everything (V2X) data quality detection device provided in Embodiment 3 of the present invention. The device can be configured in the core processing module of the V2X data quality detection system provided in the above embodiments of the present invention. Figure 3 As shown, the device includes: a rule acquisition unit 301, a rule detection unit 302, an invalid data processing unit 303, and a high-quality data processing unit 304.

[0079] The system includes: a rule acquisition unit 301, which acquires various quality detection rules and corresponding invalid data processing types from the rule management module; a rule detection unit 302, which detects whether the received vehicle network data conforms to the various quality detection rules; an invalid data processing unit 303, which determines that the vehicle network data is invalid if it does not conform to the target quality detection rules, generates quality index data for the vehicle network data, processes the vehicle network data according to the invalid data processing type corresponding to the target quality detection rules, and sends the quality index data of the vehicle network data to the visualization display module; and a high-quality data processing unit 304, which determines that the vehicle network data is high-quality if it conforms to the various quality detection rules, generates quality index data for the vehicle network data, stores the vehicle network data in a preset database, and sends the quality index data of the vehicle network data to the visualization display module.

[0080] In the technical solution of this invention embodiment, after receiving vehicle network data, the data access module sends the vehicle network data to the core processing module; the core processing module obtains each quality detection rule and the invalid data processing type corresponding to each quality detection rule from the rule management module; after receiving the vehicle network data, the core processing module checks whether the vehicle network data conforms to each quality detection rule; if the vehicle network data does not conform to the target quality detection rule, the core processing module determines that the vehicle network data is invalid vehicle network data, generates quality index data of the vehicle network data, processes the vehicle network data according to the invalid data processing type corresponding to the target quality detection rule, and sends the quality index data of the vehicle network data to the visualization display module; if the vehicle network data conforms to each quality detection rule, the core processing module determines that the vehicle network data is high-quality vehicle network data, generates quality index data of the vehicle network data. According to the description, the system stores vehicle network data in a preset database and sends the quality index data of the vehicle network data to the visualization module; the rule management module manages the quality detection rules; and the visualization module visualizes the quality index data sent by the core processing module. This solves the problem that the vehicle network data quality detection scheme in related technologies cannot perform quality detection on every piece of vehicle network data sent to the management server in a timely manner, resulting in low timeliness of the vehicle network data quality detection process. Based on the data access module, rule management module, core processing module, and visualization module, the system can perform quality detection on every piece of vehicle network data sent to the management server in a timely manner according to various quality detection rules, determine whether the vehicle network data is high-quality vehicle network data or invalid vehicle network data, and use appropriate processing methods to process invalid vehicle network data, thereby improving the timeliness of the vehicle network data quality detection process.

[0081] In an optional embodiment of the present invention, the rule acquisition unit 301 is specifically used to: periodically acquire each quality detection rule and the invalid data processing type corresponding to each quality detection rule from the rule management module according to a preset time interval.

[0082] In an optional embodiment of the present invention, the rule detection unit 302, when performing the operation of detecting whether the vehicle network data conforms to each quality detection rule, is specifically used to: determine the detection component corresponding to each quality detection rule; and detect whether the vehicle network data conforms to each quality detection rule in parallel through the detection component corresponding to each quality detection rule.

[0083] In an optional embodiment of the present invention, when the invalid data processing unit 303 performs the operation of processing the vehicle network data according to the invalid data processing type corresponding to the target quality detection rule, it is specifically used to: if the invalid data processing type corresponding to the target quality detection rule is a tag, then add a quality tag of the target quality detection rule to the vehicle network data, and store the vehicle network data with the added quality tag in a preset database.

[0084] In an optional embodiment of the present invention, the invalid data processing unit 303 may, when performing the operation of processing vehicle network data according to the invalid data processing type corresponding to the target quality detection rule, specifically perform the following: if the invalid data processing type corresponding to the target quality detection rule is discard, then delete the vehicle network data.

[0085] In an optional embodiment of the present invention, when the invalid data processing unit 303 performs the operation of processing vehicle network data according to the invalid data processing type corresponding to the target quality detection rule, it is specifically used to: if the invalid data processing type corresponding to the target quality detection rule is repair, then repair the vehicle network data according to the associated vehicle network data of the vehicle network data, and store the repaired vehicle network data in a preset database.

[0086] The vehicle network data quality detection device provided in this embodiment of the invention can execute the vehicle network data quality detection method provided in any embodiment of the invention, and has the corresponding functional units and beneficial effects of executing the method.

[0087] Example 4

[0088] Figure 4A schematic diagram of an electronic device 10, which can be used to implement the vehicle-to-everything (V2X) data quality detection method according to embodiments of the present invention, is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, electronic devices, blade electronic devices, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0089] like Figure 4 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0090] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0091] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as vehicle-to-everything (V2X) data quality detection methods.

[0092] In some embodiments, the vehicle-to-everything (V2X) data quality detection method can be implemented as a computer program tangibly contained in a computer-readable storage medium, such as a storage unit. In some embodiments, part or all of the computer program can be loaded and / or installed on a heterogeneous hardware accelerator via ROM and / or a communication unit. When the computer program is loaded into RAM and executed by a processor, one or more steps of the V2X data quality detection method described above can be performed. Alternatively, in other embodiments, the processor can be configured to perform the V2X data quality detection method by any other suitable means (e.g., by means of firmware).

[0093] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0094] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or electronic device.

[0095] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0096] To provide user interaction, the systems and techniques described herein can be implemented on a heterogeneous hardware accelerator, which includes: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the heterogeneous hardware accelerator. Other types of devices can also be used to provide user interaction; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or haptic feedback); and input from the user can be received in any form (including sound input, voice input, or haptic input).

[0097] The systems and technologies described herein can be implemented in computing systems that include back-end components (e.g., as data electronic devices), or computing systems that include middleware components (e.g., application electronic devices), or computing systems that include front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and technologies described herein), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0098] A computing system can include clients and electronic devices. Clients and electronic devices are generally geographically separated and typically interact via communication networks. The client-electronic device relationship is created by computer programs running on the respective computers and establishing a client-electronic device relationship between them. Electronic devices can be cloud electronic devices, also known as cloud computing electronic devices or cloud servers, which are hosting products within the cloud computing service ecosystem. These address the shortcomings of traditional physical hosting and VPS services, such as high management difficulty and weak business scalability.

[0099] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0100] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A system for detecting data quality of Internet of Vehicles, characterized in that, include: The system includes a data access module, a rule management module, a core processing module, and a visualization module. The data access module is used to send the vehicle network data to the core processing module after receiving the vehicle network data. The core processing module is used to obtain various quality detection rules and corresponding invalid data processing types from the rule management module; after receiving vehicle network data, it checks whether the vehicle network data conforms to the various quality detection rules; if the vehicle network data does not conform to the target quality detection rules, it determines that the vehicle network data is invalid, generates quality index data for the vehicle network data, processes the vehicle network data according to the invalid data processing type corresponding to the target quality detection rules, and sends the quality index data of the vehicle network data to the visualization display module; if the vehicle network data conforms to the various quality detection rules, it determines that the vehicle network data is high-quality vehicle network data, generates quality index data for the vehicle network data, stores the vehicle network data in a preset database, and sends the quality index data of the vehicle network data to the visualization display module. The rule management module is used to manage quality inspection rules; The visualization module is used to visualize the quality indicator data sent by the core processing module.

2. The vehicle networking data quality detection method is applied to the core processing module in the vehicle networking data quality detection system of claim 1, characterized in that, include: Retrieve each quality inspection rule and the corresponding invalid data processing type from the rule management module; After receiving the vehicle network data, it checks whether the vehicle network data meets the various quality inspection rules; If the vehicle network data does not meet the target quality detection rules, the vehicle network data is determined to be invalid vehicle network data. Quality index data of vehicle network data is generated, the vehicle network data is processed according to the invalid data processing type corresponding to the target quality detection rules, and the quality index data of vehicle network data is sent to the visualization display module. If the vehicle network data meets all the quality inspection rules, it is determined that the vehicle network data is high-quality vehicle network data. The quality index data of the vehicle network data is generated, the vehicle network data is stored in the preset database, and the quality index data of the vehicle network data is sent to the visualization display module. 3.The IoT data quality detection method of claim 2, wherein, Retrieve each quality inspection rule and the corresponding invalid data processing type from the rule management module, including: According to preset time intervals, each quality inspection rule and the corresponding invalid data processing type are periodically retrieved from the rule management module. 4.The method of claim 2, wherein, The test verifies whether the vehicle network data complies with various quality inspection rules, including: Identify the testing components corresponding to each quality inspection rule; The vehicle network data is tested in parallel to determine whether it conforms to each quality inspection rule by using detection components corresponding to each quality inspection rule. 5.The IoT data quality detection method of claim 2, wherein, The vehicle network data is processed according to the invalid data processing type corresponding to the target quality inspection rules, including: If the invalid data processing type corresponding to the target quality detection rule is "mark", then add the quality label of the target quality detection rule to the vehicle network data, and store the vehicle network data with the added quality label in the preset database. 6.The IoT data quality detection method of claim 2, wherein, According to the invalid data processing type corresponding to the target quality detection rule, the vehicle networking data is processed, including: If the invalid data processing type corresponding to the target quality detection rule is discarded, the vehicle networking data is deleted.

7. The method of claim 2, wherein, According to the invalid data processing type corresponding to the target quality detection rule, the vehicle networking data is processed, including: If the invalid data processing type corresponding to the target quality detection rule is repair, according to the associated vehicle networking data of the vehicle networking data, the vehicle networking data is repaired, and the repaired vehicle networking data is stored in the preset database. 8.A device for detecting data quality of Internet of Vehicles, configured in a core processing module of the system for detecting data quality of Internet of Vehicles according to claim 1, characterized in that, Including: The rule acquisition unit is used to acquire each quality detection rule and the invalid data processing type corresponding to each quality detection rule from the rule management module; The rule detection unit is used to detect whether the vehicle networking data conforms to each quality detection rule after receiving the vehicle networking data; The invalid data processing unit is used to determine that the vehicle networking data is invalid vehicle networking data if the vehicle networking data does not conform to the target quality detection rule, generate quality index data of the vehicle networking data, process the vehicle networking data according to the invalid data processing type corresponding to the target quality detection rule, and send the quality index data of the vehicle networking data to the visual display module; The high-quality data processing unit is used to determine that the vehicle networking data is high-quality vehicle networking data if the vehicle networking data conforms to each quality detection rule, generate quality index data of the vehicle networking data, store the vehicle networking data in the preset database, and send the quality index data of the vehicle networking data to the visual display module.

9. An electronic device, comprising: The electronic device includes: At least one processor; And a memory connected in communication with the at least one processor; Wherein the memory stores a computer program executed by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the vehicle networking data quality detection method in any one of claims 2-7.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions, and the computer instructions are used to enable the processor to execute the vehicle networking data quality detection method in any one of claims 2-7 when executed.

Images