Method and device for processing data by vehicle end rule engine and electronic equipment
By adopting multi-threaded computing and data relationship diagram technology in the vehicle-side rule engine, the efficiency and flexibility of the vehicle-side rule engine when processing data in complex driving environments is solved, and the accuracy of data processing and the interactive capabilities of external systems are improved. Faster and accurate decision support is achieved.
Patent Information
- Application Number
- CN202410966828.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-18
- Publication Date
- 2024-11-19
AI Technical Summary
When the existing vehicle-side rule engines process complex and variable driving environment data, the data processing capabilities are limited, the rule configuration is not flexible enough, and the interaction capabilities with external systems are limited, resulting in slow response speed, low decision-making efficiency and accuracy.
Data processing rules are configured through graphical interfaces or programming interfaces, multi-threaded computing technology is used to perform parallel aggregation calculations, establish data relationship diagrams, and use the shortest path algorithm to determine the processing paths, support dynamic rule configuration and external system interaction, improve data processing efficiency and accuracy sex.
It significantly improves the efficiency and accuracy of data processing, enhances the adaptability and decision-making support capabilities of the vehicle-side rule engine, and alleviates the problems of limited data processing capabilities, inflexible rule configuration, and limited interaction with external systems.
Smart Images

Figure CN118981473A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of intelligent driving, and in particular to a method, device and electronic device for processing data by a vehicle-side rule engine. Background Art
[0002] In the development of intelligent driving systems, the function of vehicle-side rule engines has gradually become a key technical point, mainly used to process large amounts of real-time data from various vehicle sensors and external systems. Traditional vehicle-mounted systems usually process static data, while modern intelligent driving systems need to parse and respond to dynamic data streams in real time, which requires the system to be able to efficiently process data streams, perform real-time calculations, and dynamically configure complex rules.
[0003] Current technologies, such as in-vehicle communication systems and intelligent network vehicle systems, are already able to support basic data processing and some simple rule execution. However, these systems often face problems such as slow processing speed, inflexible rules, and limited ability to interact with external systems. For example, data processing in in-vehicle networks still mostly relies on central processing units for centralized computing, which can easily lead to increased delays when the amount of data increases dramatically, affecting the timeliness of decision execution.
[0004] In addition, existing technologies are also insufficient in supporting complex multi-source data stream processing. Real-time aggregation of multi-source data streams, efficient connection calculations, and flexible pipeline configurations are key technical requirements for improving the response speed and accuracy of intelligent driving systems. Existing systems often lack sufficient flexibility to support advanced data processing strategies, such as real-time multi-stream connection calculations and customized configuration of complex rules, which limits their application in complex driving environments.
[0005] Due to the above technical limitations, traditional vehicle-side rule engines have the following main problems when processing complex and changeable driving environment data:
[0006] Limited data processing capabilities: Existing systems often do not respond quickly enough to handle large amounts of real-time data and cannot meet high real-time requirements, such as immediate response to emergency driving situations;
[0007] Inflexible rule configuration: Existing vehicle-side systems mostly use preset fixed rules and lack the ability to dynamically configure complex rules, making it difficult to adapt to the ever-changing external environment and data types;
[0008] Limited interaction with external systems: The data interaction capabilities with external systems are limited, and external data sources such as real-time traffic information cannot be effectively utilized, further reducing the decision-making efficiency and accuracy of the system;
[0009] In summary, how to improve the data processing capabilities of the vehicle-side rule engine, the flexible configuration of rules and the ability to interact with external systems has become a technical problem that needs to be solved urgently. Summary of the invention
[0010] In view of this, an object of the present invention is to provide a method, device and electronic device for data processing by a vehicle-side rule engine, so as to alleviate the technical problems of the existing vehicle-side rule engine, such as limited data processing capability, inflexible rule configuration and limited interaction with external systems.
[0011] In a first aspect, an embodiment of the present invention provides a method for processing data by a vehicle-side rule engine, which is applied to a vehicle-side rule engine, and the method includes:
[0012] Obtain data processing rules configured by the user through a graphical interface or programming interface, and obtain external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors;
[0013] Performing parallel aggregation calculation processing on the external data and the sensor data within the preset time window using multi-threaded computing technology to obtain aggregated calculated data;
[0014] Label and classify the aggregated data, the external data, the sensor data, and the static data obtained from the cloud to obtain characteristics of the aggregated data, the external data, the sensor data, and the static data;
[0015] Establishing a data relationship graph of the aggregated data, the external data, the sensor data, and the static data based on the characteristics of the aggregated data, the characteristics of the external data, the sensor data, and the static data;
[0016] The shortest path algorithm is used to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship diagram, and data processing is performed according to the optimal processing path to obtain a processing result for final decision support.
[0017] Furthermore, the external data and the sensor data within the preset time window are processed by parallel aggregation calculation using multi-threaded computing technology, including:
[0018] Partitioning the external data and the sensor data using a hash function or a range partitioning method to obtain a plurality of partitioned data;
[0019] Allocating the plurality of partitioned data to each processing node, so that each processing node performs parallel aggregation computing processing on the corresponding partitioned data using multi-thread computing technology;
[0020] The execution status of the aggregate computing processing performed by each processing node is obtained, and the aggregate computing processing tasks are scheduled according to the execution status until all the aggregate computing processing tasks are completed to obtain the data after the aggregate computing.
[0021] Furthermore, the aggregated data, the external data, the sensor data, and the static data obtained from the cloud are labeled and classified, including:
[0022] Get predefined metadata;
[0023] The aggregated data, the external data, the sensor data and the static data are labeled and classified through the metadata to obtain the characteristics of the aggregated data, the characteristics of the external data, the sensor data and the static data.
[0024] Furthermore, a data relationship graph of the aggregated data, the external data, the sensor data and the static data is established based on the characteristics of the aggregated data, the characteristics of the external data, the sensor data and the static data, including:
[0025] Obtaining predefined connection relationships between various features;
[0026] The characteristics of the aggregated data, the characteristics of the external data, the characteristics of the sensor data and the characteristics of the static data are used according to the connection relationship to establish a data relationship graph of the aggregated data, the external data, the sensor data and the static data, wherein in the data relationship graph, nodes represent the aggregated data, the external data, the sensor data and the static data, and edges represent the connection relationship between the aggregated data, the external data, the sensor data and the static data.
[0027] Furthermore, the programming interface supports the use of SQL statements to configure the data processing rules.
[0028] Furthermore, the data processing rules support dynamic configuration of version control.
[0029] Furthermore, the vehicle-side rule engine supports developers to develop custom plug-ins using go SDK or python SDK, so as to integrate the developed plug-ins into the vehicle-side rule engine.
[0030] In a second aspect, an embodiment of the present invention further provides a device for processing data by a vehicle-side rule engine, which is applied to a vehicle-side rule engine, and the device includes:
[0031] An acquisition unit, used to acquire data processing rules configured by a user through a graphical interface or a programming interface, and to acquire external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors;
[0032] An aggregate calculation processing unit, used to perform parallel aggregate calculation processing on the external data and the sensor data within a preset time window using a multi-threaded computing technology to obtain aggregated calculated data;
[0033] a marking and classification unit, used for marking and classifying the aggregated and calculated data, the external data, the sensor data, and the static data obtained from the cloud, to obtain the characteristics of the aggregated and calculated data, the characteristics of the external data, the sensor data, and the static data;
[0034] an establishing unit, configured to establish a data relationship graph of the aggregated data, the external data, the sensor data, and the static data based on the characteristics of the aggregated data, the characteristics of the external data, the sensor data, and the static data;
[0035] A determination and data processing unit is used to use the shortest path algorithm to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship diagram, and perform data processing according to the optimal processing path to obtain a processing result for final decision support.
[0036] In a third aspect, an embodiment of the present invention further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any one of the methods described in the first aspect when executing the computer program.
[0037] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to execute any method described in the first aspect above.
[0038] In an embodiment of the present invention, a method for data processing by a vehicle-side rule engine is provided, which is applied to the vehicle-side rule engine, and the method includes: obtaining data processing rules configured by a user through a graphical interface or a programming interface, and obtaining external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors; performing parallel aggregation calculation processing on external data and sensor data within a preset time window using multi-threaded computing technology to obtain aggregated data; marking and classifying the aggregated data, external data, sensor data and static data obtained from the cloud to obtain characteristics of the aggregated data, characteristics of the external data, characteristics of the sensor data and characteristics of the static data; establishing a data relationship graph of the aggregated data, external data, sensor data and static data based on the characteristics of the aggregated data, characteristics of the external data, characteristics of the sensor data and characteristics of the static data; using the shortest path algorithm to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship graph, and performing data processing according to the optimal processing path to obtain a processing result for final decision support. From the above description, it can be seen that in the method of data processing by the vehicle-side rule engine of the present invention, the user can configure the data processing rules through a graphical interface or a programming interface. The configuration of the rules is more flexible, and it can also interact with the external system to obtain the external data of the external system. Then, the external data and sensor data within the preset time window are parallelly aggregated and calculated using multi-threaded computing technology. At the same time, a data relationship graph of the aggregated data, external data, sensor data and static data is established. Then, the shortest path algorithm is used to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship graph. Finally, data processing is performed according to the optimal processing path. In this way, the efficiency of data processing can be greatly improved, and efficient processing of real-time data streams can be realized. When processing data, the aggregated data, external data, sensor data and static data are comprehensively considered, which improves the accuracy of data processing and alleviates the technical problems of the existing vehicle-side rule engine, such as limited data processing capabilities, inflexible rule configuration, and limited interaction with external systems. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0040] Figure 1 A flow chart of a method for processing data by a vehicle-side rule engine provided in an embodiment of the present invention;
[0041] Figure 2 A schematic diagram of a device for processing data by a vehicle-side rule engine provided by an embodiment of the present invention;
[0042] Figure 3 A schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0043] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0044] Traditional vehicle-side rule engines have limited data processing capabilities, inflexible rule configuration, and restricted interactions with external systems.
[0045] Based on this, in the data processing method of the vehicle-side rule engine of the present invention, the user can configure the data processing rules through a graphical interface or a programming interface. The configuration of the rules is more flexible and can also interact with the external system to obtain the external data of the external system. Then, the external data and sensor data within the preset time window are parallelly aggregated and processed using multi-threaded computing technology. At the same time, a data relationship graph of the aggregated data, external data, sensor data and static data is established. Then, the shortest path algorithm is used to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship graph. Finally, data processing is performed according to the optimal processing path. In this way, the efficiency of data processing can be greatly improved, and efficient processing of real-time data streams can be achieved. When processing data, the aggregated data, external data, sensor data and static data are comprehensively considered to improve the accuracy of data processing.
[0046] To facilitate understanding of this embodiment, a method for data processing by a vehicle-side rule engine disclosed in an embodiment of the present invention is first introduced in detail.
[0047] Embodiment 1:
[0048] According to an embodiment of the present invention, an embodiment of a method for data processing by a vehicle-side rule engine is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0049] Figure 1 is a flow chart of a method for processing data by a vehicle-side rule engine according to an embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:
[0050] Step S102, obtaining data processing rules configured by the user through a graphical interface or a programming interface, and obtaining external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors;
[0051] In an embodiment of the present invention, the above-mentioned method for data processing by the vehicle-side rule engine can be applied to the vehicle-side rule engine, which allows users to customize and configure data processing rules through a graphical interface or a programming interface. Users can dynamically adjust and optimize data processing processes and rules according to actual needs, so that the vehicle-side rule engine can flexibly respond to various complex driving environments.
[0052] The graphical interface allows users to dynamically configure or modify data processing rules; the data processing rules configured by users will be converted into execution codes, which control the processing logic and operations of the data flow; in addition, the vehicle-side rule engine can also monitor the execution effect of the data processing rules, and automatically optimize the data processing rule configuration according to the execution effect to ensure processing efficiency and accuracy. For example, the prerequisites for the air conditioner to automatically turn on include: the car door is closed, the window is in the rolled-up state, the temperature reaches the preset temperature, the vehicle speed is less than the preset speed, and the power is greater than the preset power. When all the above prerequisites are met, the air conditioner can automatically turn on (that is, the data processing rules). If the vehicle-side rule engine monitors that the response of the above data processing rules is too slow, it can automatically optimize the data processing rule configuration.
[0053] The vehicle-side rule engine of the present invention also supports interaction with external systems, and designs an efficient communication protocol with external systems such as the vehicle-side MQTT message server. It supports the functions of obtaining external data from external systems and sending data to external systems, enhancing the information acquisition ability and environmental adaptability of the vehicle-side rule engine. In addition, through the API interface, it can be easily integrated with other external systems, such as: traffic information system, meteorological information system, etc.
[0054] Communication interface settings: Set up the communication interface with external systems (such as MQTT message server) to ensure that data can be transmitted securely and in real time.
[0055] Data exchange: realize two-way data exchange, that is, receive external data (such as traffic data and weather data) from external systems and send data to external systems.
[0056] API integration: Develop API interfaces so that other external systems can easily access and use the functions of the vehicle-side rule engine.
[0057] When working, various sensors of the vehicle collect sensor data, including speed, acceleration, GPS positioning, images and other data, and then the vehicle-side rule engine can obtain the above sensor data; in addition, an event-driven mechanism is adopted to monitor the collected sensor data in real time. Any change in the data will trigger the corresponding processing event. For example, if the vehicle is located in a school area and the speed is too fast, it will trigger an alarm event.
[0058] Step S104, performing parallel aggregation calculation processing on the external data and sensor data within the preset time window using multi-threaded computing technology to obtain aggregated calculated data;
[0059] Specifically, by using an efficient stream processing architecture (using a time-driven model (pache Flink) as a data stream processing model), it is possible to monitor and process sensor data from the edge of the vehicle and external data from external systems in real time. By setting a specific time window, real-time aggregation calculations can be performed on external data and sensor data to ensure the timeliness and accuracy of data processing. During implementation, a highly parallel processing algorithm can be used to increase the data processing speed, thereby supporting complex real-time decision making.
[0060] For the data in the preset time window, aggregate calculation operations are performed. These calculation operations may include: calculation of statistical indicators, such as average, maximum, minimum, etc. (determined according to data processing rules). The algorithm will traverse all the data in the window and perform corresponding aggregate calculations. In addition, multi-threaded computing technology is used to achieve parallel processing of data (for example, parallel processing of average and maximum values) to ensure the speed and efficiency of calculation.
[0061] Step S106, labeling and classifying the aggregated data, external data, sensor data, and static data obtained from the cloud, and obtaining characteristics of the aggregated data, characteristics of the external data, characteristics of the sensor data, and characteristics of the static data;
[0062] Specifically, different data sources need to be labeled and classified for subsequent processing. This can be done through metadata that describes the characteristics of each data source (i.e., aggregated data, external data, sensor data, and static data). The metadata can be: data type, frequency, size, etc. These metadata can be defined in advance during the initialization phase of the vehicle-side rule engine, or can be added dynamically at runtime as needed.
[0063] Step S108, establishing a data relationship graph of the aggregated data, external data, sensor data and static data based on the characteristics of the aggregated data, the characteristics of the external data, the characteristics of the sensor data and the characteristics of the static data;
[0064] Specifically, the real-time connection calculation of multi-source data streams has high requirements for computing efficiency and resource allocation. Traditional connection methods are difficult to meet the requirements of high efficiency and real-time. The present invention develops an intelligent connection algorithm for multi-source stream data (data after aggregation calculation, external data, sensor data and static data) based on graph theory, which optimizes the speed of data matching and reduces memory usage.
[0065] Support complex connection calculations between multiple data streams (such as aggregated data, external data, sensor data), as well as the connection between data streams and static data. Through efficient connection algorithms, ensure that data from different sources (i.e. data from different sources) can be quickly and effectively integrated to provide comprehensive data support for decision-making. By constructing a data relationship graph (step S108) and an optimization algorithm (step S110), the real-time connection and processing of a large amount of real-time data from various vehicle sensors, external systems, aggregated data, and static data is achieved. The intelligent driving system (the core of which is the vehicle-side rule engine) can obtain and analyze various data in a timely manner to provide support for decision-making.
[0066] Step S110, using the shortest path algorithm to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship diagram, and performing data processing according to the optimal processing path to obtain a processing result for final decision support.
[0067] Specifically, the shortest path algorithm in graph theory is applied to determine the optimal connection strategy (i.e., the optimal processing path) to reduce unnecessary data transmission and processing. Once the data relationship graph is constructed, the classic graph theory algorithm can be used to analyze the structure of the graph and find the optimal connection strategy. For example, the Dijkstra algorithm can be used to find the shortest path (i.e., the optimal processing path) of the processing path corresponding to the data processing rule, and the data can be processed according to the optimal processing path, so that the processing results can be quickly obtained for the final decision support.
[0068] In an embodiment of the present invention, a method for data processing by a vehicle-side rule engine is provided, which is applied to the vehicle-side rule engine, and the method includes: obtaining data processing rules configured by a user through a graphical interface or a programming interface, and obtaining external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors; performing parallel aggregation calculation processing on external data and sensor data within a preset time window using multi-threaded computing technology to obtain aggregated data; marking and classifying the aggregated data, external data, sensor data and static data obtained from the cloud to obtain characteristics of the aggregated data, characteristics of the external data, characteristics of the sensor data and characteristics of the static data; establishing a data relationship graph of the aggregated data, external data, sensor data and static data based on the characteristics of the aggregated data, characteristics of the external data, characteristics of the sensor data and characteristics of the static data; using the shortest path algorithm to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship graph, and performing data processing according to the optimal processing path to obtain a processing result for final decision support. From the above description, it can be seen that in the method of data processing by the vehicle-side rule engine of the present invention, the user can configure the data processing rules through a graphical interface or a programming interface. The configuration of the rules is more flexible, and it can also interact with the external system to obtain the external data of the external system. Then, the external data and sensor data within the preset time window are parallelly aggregated and calculated using multi-threaded computing technology. At the same time, a data relationship graph of the aggregated data, external data, sensor data and static data is established. Then, the shortest path algorithm is used to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship graph. Finally, data processing is performed according to the optimal processing path. In this way, the efficiency of data processing can be greatly improved, and efficient processing of real-time data streams can be realized. When processing data, the aggregated data, external data, sensor data and static data are comprehensively considered, which improves the accuracy of data processing and alleviates the technical problems of the existing vehicle-side rule engine, such as limited data processing capabilities, inflexible rule configuration, and limited interaction with external systems.
[0069] The above content briefly introduces the data processing method of the vehicle-side rule engine of the present invention, and the specific contents involved are described in detail below.
[0070] In an optional embodiment of the present invention, the external data and sensor data within the preset time window are processed by parallel aggregation calculation using multi-threaded computing technology, which specifically includes the following steps:
[0071] (1) Use hash functions or range partitioning methods to partition external data and sensor data to obtain multiple partition data;
[0072] Specifically, the input data stream (i.e., external data and sensor data) is divided into multiple partitions, and these partitions are distributed to different processing nodes. The task scheduler partitions the external data and sensor data through a hash function and a range partitioning method to ensure that the partitioned data is evenly distributed to each processing node. The above hash function can be used to partition the external data and sensor data by a certain field, and the above range partitioning method can be used to partition the external data and sensor data by time range.
[0073] (2) allocating multiple partitioned data to each processing node, so that each processing node uses multi-threaded computing technology to perform parallel aggregation computing on the corresponding partitioned data;
[0074] Specifically, a task scheduler is used to schedule and manage stream processing tasks (i.e., aggregate computing processing tasks). The task scheduler is responsible for allocating partitioned data to each available processing node, monitoring the execution status of aggregate computing processing tasks, and reallocating and scheduling tasks as needed.
[0075] (3) Obtain the execution status of the aggregate computing processing performed by each processing node, and schedule the aggregate computing processing tasks according to the execution status until all the aggregate computing processing tasks are completed to obtain the data after the aggregate computing.
[0076] Specifically, parallel computing technology is used on each processing node to improve processing efficiency and speed. At the same time, the execution status of stream processing tasks is managed to ensure state consistency and fault tolerance.
[0077] In an optional embodiment of the present invention, the aggregated calculated data, external data, sensor data, and static data obtained from the cloud are labeled and classified, specifically including the following steps:
[0078] (1) Obtain predefined metadata;
[0079] (2) The aggregated data, external data, sensor data, and static data are labeled and classified through metadata to obtain the characteristics of the aggregated data, the characteristics of the external data, the characteristics of the sensor data, and the characteristics of the static data.
[0080] In an optional embodiment of the present invention, a data relationship graph of aggregated data, external data, sensor data and static data is established based on the characteristics of aggregated data, external data, sensor data and static data, specifically including the following steps:
[0081] (1) Obtaining the connection relationship between predefined characteristics;
[0082] Specifically, real-time data streams (i.e., aggregated data, external data, sensor data) are connected and calculated with other stream data and static data. For example, real-time traffic data streams are compared and analyzed with static data of historical traffic patterns. The system (i.e., intelligent driving system) analyzes the association relationship between data sources during the initialization phase to obtain the connection relationship between pre-defined characteristics.
[0083] (2) The characteristics of the aggregated data, the characteristics of the external data, the characteristics of the sensor data, and the characteristics of the static data are connected according to the connection relationship to establish a data relationship graph of the aggregated data, external data, sensor data, and static data, wherein in the data relationship graph, nodes represent the aggregated data, external data, sensor data, and static data, and edges represent the connection relationship between the aggregated data, external data, sensor data, and static data.
[0084] Specifically, an efficient connection algorithm is used to ensure the rapid and effective integration of data from different sources. During implementation, the characteristics of the aggregated data, the characteristics of the external data, the characteristics of the sensor data, and the characteristics of the static data are connected according to the connection relationship to establish a data relationship graph of the aggregated data, external data, sensor data, and static data. The connection requirements of the data sources (i.e., the connection relationship) are represented as edges in the graph. The nodes represent the data sources, and the edges represent the potential connection requirements. The concepts and data structures of graph theory are used to construct the data relationship graph. Each data source (i.e., aggregated data, external data, sensor data, and static data) is a node, and the connection requirements between data sources are represented as edges in the graph. This can be achieved by analyzing the association relationship between data sources during the system initialization phase.
[0085] In addition, according to the changes in real-time data streams (aggregated data, external data, sensor data, and static data), the data relationship graph is adjusted in real time, and the connection strategy (i.e., the connection relationship between each feature) is optimized to adapt to the changing data needs. During the operation of the system, it is necessary to monitor the changes in the data source in real time and adjust the data relationship graph according to the changes.
[0086] The following is an example:
[0087] Sensor data (S1, S2, S3, S4): data collected by vehicle sensors in real time;
[0088] Historical data (static data, H1, H2): historical maintenance records and fault records stored in the cloud;
[0089] External data (E1, E2): such as real-time data provided by traffic information systems and meteorological information systems;
[0090] Data processing nodes (P1, P2, P3, determined according to data processing rules): nodes used to process and store data.
[0091] The relationship table corresponding to the data relationship diagram is as follows:
[0092] From To Weight(time / distance) S1 P1 2 S2 P1 4 S3 P2 1 S4 P2 3 P1 P3 1 P2 P3 5 H1 P1 2 H2 P2 3 E1 P1 4 E2 P2 2 P3 E1 3
[0093] The shortest path from S1 to P1: the transmission distance is 2.
[0094] The shortest path from S1 to P3: The transmission distance is 3 (via P1).
[0095] In graph theory, weight (i.e. time / distance) refers to an attribute of an edge that represents the connection cost between two nodes. For example, the transmission time from sensor S1 to processing node P1 can be obtained through multiple measurements. For example, if the transmission time is 2.1 seconds, 1.9 seconds, 2.0 seconds, 2.2 seconds, and 2.0 seconds, respectively, the average value is 2.04 seconds. The weight can be set to 2 seconds.
[0096] The vehicle is equipped with a variety of sensors that can monitor various operating parameters of the vehicle in real time, such as engine temperature, oil pressure, brake system status, etc. At the same time, the vehicle will regularly upload this data to the vehicle-side rule engine for analysis and processing.
[0097] Data Source:
[0098] Sensor data: including engine temperature, oil pressure, vehicle speed, brake system status, etc.
[0099] Historical maintenance records: records the vehicle’s past maintenance conditions, the time and reasons for parts replacement, and other information.
[0100] Manufacturer Recommendations: Includes the vehicle manufacturer's recommended maintenance schedule and servicing recommendations.
[0101] Connection strategy selection:
[0102] 1. Data integration (connection relationship):
[0103] Real-time sensor data is connected with historical maintenance records to analyze whether the current vehicle status has similar problems as in the past, so as to predict possible failures.
[0104] Sensor data is connected with manufacturer recommendations to check whether the current vehicle operating parameters meet the manufacturer's recommended standards to predict the next maintenance time node.
[0105] 2. Connection algorithm implementation:
[0106] Use graph theory-based algorithms, such as the shortest path algorithm, to optimize the paths for data processing and analysis, ensuring that data can be efficiently connected and integrated between different sources.
[0107] For example, by building a data relationship graph, the nodes can be different sensor data or maintenance records, and the edges represent the associations between the data. Using graph theory algorithms, the optimal connection path can be found to more effectively identify and predict possible vehicle problems.
[0108] 3. Data output:
[0109] The integrated data can be used for further analysis, such as predicting parts that need to be replaced, recommending maintenance plans, etc., or directly for dynamic decision support.
[0110] The output analysis results can be directly applied to the formulation of vehicle maintenance strategies, for example, reminding car owners to perform preventive maintenance to reduce possible future failures and repair costs.
[0111] In an optional embodiment of the present invention, the programming interface supports the use of SQL statements to configure data processing rules.
[0112] In an optional embodiment of the present invention, the vehicle-side rule engine supports developers to use go SDK or python SDK to develop custom plug-ins so as to integrate the developed plug-ins into the vehicle-side rule engine.
[0113] Specifically, the intelligent driving system supports the use of SQL statements to define complex data processing rules. It also supports developers to use go SDK or python SDK to develop custom plug-ins, such as image processing plug-ins and machine learning model plug-ins, to further expand system functions.
[0114] SQL and SDK support: Allows users to use SQL to define complex data processing rules, and provides SDK to support users in developing custom plug-ins.
[0115] Plug-in integration: The developed plug-ins can be easily integrated into the vehicle-side rule engine to expand its functionality, such as adding image processing or machine learning models.
[0116] In an optional embodiment of the present invention, the data processing rules support dynamic configuration of version control.
[0117] Specifically, traditional data processing rule configuration methods lack flexibility and version control, and are unable to support dynamic adjustment and optimization of rules in complex environments.
[0118] The processing method of the present invention:
[0119] The introduction of a dynamic rule configuration algorithm based on version control allows users to easily manage and roll back rule configurations.
[0120] Specific implementation method:
[0121] Rule version management: Create a version for each data processing rule change, including: adding, deleting, and modifying rules.
[0122] Difference analysis: Use text comparison algorithms to analyze the differences between data processing rule versions and provide a clear change log.
[0123] Rollback mechanism: allows users to choose to roll back to any historical version, and the system automatically adjusts to the data processing rule configuration of that historical version.
[0124] Performance feedback integration: Integrate performance (e.g., rule generation speed, response speed) feedback mechanism to automatically recommend data processing rule configurations for performance improvement.
[0125] When transmitting data, codec technology is used to ensure the security and efficiency of data during transmission. This technology supports various data formats, including but not limited to video, audio and sensor data, thus ensuring the wide applicability and flexibility of data processing.
[0126] Encoding: Encode the outgoing data to ensure the security and integrity of the data during transmission.
[0127] Decoding: Decoding the received data to ensure that the receiving end understands and processes the data correctly.
[0128] The present invention also integrates a DBC parser to handle the aggregation, parsing and filtering of CAN signals. This enables the vehicle to better interpret and utilize the data received from the CAN bus, providing more accurate input for driving decisions.
[0129] DBC parsing: The integrated DBC parser is used to parse the signals from the CAN bus.
[0130] Signal processing: Aggregate, parse and filter signals for further data analysis and decision-making.
[0131] The vehicle-side rule engine of the present invention integrates efficient data stream processing, dynamic rule configuration, extensive external system interaction and highly customizable technologies to improve the performance and adaptability of the vehicle-side rule engine, thereby better serving the needs of modern intelligent driving.
[0132] Effects of the present invention:
[0133] Performance improvement: By introducing stream processing technology and optimization algorithms (shortest path), the present invention can significantly improve the speed and efficiency of data processing, and achieve efficient processing and accurate analysis of real-time data streams.
[0134] Functional expansion: The introduction of functions such as dynamic data processing rule configuration and multi-stream connection calculation enables the system to handle complex data situations more flexibly and adapt to the ever-changing driving environment, thereby improving the adaptability and intelligence level of the intelligent driving system.
[0135] Cost reduction: By optimizing algorithms and processes, the present invention can effectively reduce the cost of data processing and decision support, reduce system resource consumption and manpower investment, and save operating costs for enterprises.
[0136] Improved efficiency: The use of dynamic time window adjustment algorithm and intelligent connection algorithm improves the accuracy and real-time performance of data processing, effectively shortens the time for decision-making, and improves the overall system efficiency.
[0137] Improved convenience.
[0138] It mainly includes the following technical points:
[0139] Dynamic rule configuration algorithm: The dynamic rule configuration algorithm based on version control allows users to modify and optimize rule configurations in real time to adapt to the ever-changing driving environment.
[0140] Multi-stream connection calculation algorithm: The multi-source stream data intelligent connection algorithm based on graph theory optimizes the connection speed and memory usage of data streams to ensure accurate integration and analysis of data.
[0141] Dynamic time window adjustment algorithm: Dynamically adjust the time window size of aggregation calculation according to the actual situation of data flow, improving the timeliness and accuracy of data aggregation.
[0142] Embodiment 2:
[0143] An embodiment of the present invention also provides a device for processing data by a vehicle-side rule engine. The device for processing data by a vehicle-side rule engine is mainly used to execute the method for processing data by a vehicle-side rule engine provided in the first embodiment of the present invention. The following is a specific introduction to the device for processing data by a vehicle-side rule engine provided in the embodiment of the present invention.
[0144] Figure 2 is a schematic diagram of a device for processing data by a vehicle-side rule engine according to an embodiment of the present invention, such as Figure 2 As shown, the device mainly includes: an acquisition unit 10, an aggregate calculation processing unit 20, a marking classification unit 30, an establishment unit 40, and a determination and data processing unit 50, wherein:
[0145] An acquisition unit, used to acquire data processing rules configured by a user through a graphical interface or a programming interface, and to acquire external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors;
[0146] An aggregate calculation processing unit, used to perform parallel aggregate calculation processing on external data and sensor data within a preset time window using multi-threaded computing technology to obtain aggregated calculated data;
[0147] A labeling and classification unit is used to label and classify the aggregated data, external data, sensor data, and static data obtained from the cloud, and obtain the characteristics of the aggregated data, the characteristics of the external data, the characteristics of the sensor data, and the characteristics of the static data;
[0148] An establishing unit, used to establish a data relationship graph of the aggregated data, the external data, the sensor data and the static data based on the characteristics of the aggregated data, the characteristics of the external data, the sensor data and the static data;
[0149] The determination and data processing unit is used to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship diagram using the shortest path algorithm, and perform data processing according to the optimal processing path to obtain a processing result for final decision support.
[0150] In an embodiment of the present invention, a device for data processing by a vehicle-side rule engine is provided, which is applied to the vehicle-side rule engine, and includes: obtaining data processing rules configured by a user through a graphical interface or a programming interface, and obtaining external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors; performing parallel aggregation calculation processing on external data and sensor data within a preset time window using multi-threaded computing technology to obtain aggregated data; marking and classifying the aggregated data, external data, sensor data and static data obtained from the cloud to obtain characteristics of the aggregated data, characteristics of the external data, characteristics of the sensor data and characteristics of the static data; establishing a data relationship graph of the aggregated data, external data, sensor data and static data based on the characteristics of the aggregated data, characteristics of the external data, characteristics of the sensor data and characteristics of the static data; using the shortest path algorithm to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship graph, and performing data processing according to the optimal processing path to obtain a processing result for final decision support. From the above description, it can be seen that in the device for data processing by the vehicle-side rule engine of the present invention, the user can configure the data processing rules through a graphical interface or a programming interface. The configuration of the rules is more flexible, and it can also interact with the external system to obtain the external data of the external system. Then, the external data and sensor data within the preset time window are parallelly aggregated and calculated using multi-threaded computing technology. At the same time, a data relationship graph of the aggregated data, external data, sensor data and static data is established. Then, the shortest path algorithm is used to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship graph. Finally, data processing is performed according to the optimal processing path. In this way, the efficiency of data processing can be greatly improved, and efficient processing of real-time data streams can be realized. When processing data, the aggregated data, external data, sensor data and static data are comprehensively considered, which improves the accuracy of data processing and alleviates the technical problems of the existing vehicle-side rule engine, such as limited data processing capabilities, inflexible rule configuration, and limited interaction with external systems.
[0151] Optionally, the aggregation computing processing unit is also used to: partition the external data and sensor data using a hash function or a range partitioning method to obtain multiple partitioned data; distribute the multiple partitioned data to each processing node so that each processing node performs parallel aggregation computing processing on the corresponding partitioned data using multi-threaded computing technology; obtain the execution status of each processing node performing the aggregation computing processing, and schedule the aggregation computing processing tasks according to the execution status until all the aggregation computing processing tasks are completed to obtain the data after aggregation computing.
[0152] Optionally, the labeling and classification unit is also used to: obtain predefined metadata; label and classify the aggregated data, external data, sensor data and static data through the metadata to obtain the characteristics of the aggregated data, the characteristics of the external data, the characteristics of the sensor data and the characteristics of the static data.
[0153] Optionally, the establishing unit is also used to: obtain the connection relationship between pre-defined characteristics; and establish a data relationship graph of the aggregated calculated data, external data, sensor data and static data according to the connection relationship, wherein the nodes in the data relationship graph represent the aggregated calculated data, external data, sensor data and static data, and the edges represent the connection relationship between the aggregated calculated data, external data, sensor data and static data.
[0154] Optionally, the programming interface supports configuring data processing rules using SQL statements.
[0155] Optionally, data processing rules support dynamic configuration of version control.
[0156] Optionally, the vehicle-side rule engine supports developers to develop custom plug-ins using go SDK or python SDK so that the developed plug-ins can be integrated into the vehicle-side rule engine.
[0157] The device provided in the embodiment of the present invention has the same implementation principle and technical effects as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.
[0158] like Figure 3 As shown, an electronic device 600 provided in an embodiment of the present application includes: a processor 601, a memory 602 and a bus, wherein the memory 602 stores machine-readable instructions executable by the processor 601. When the electronic device is running, the processor 601 communicates with the memory 602 through the bus, and the processor 601 executes the machine-readable instructions to perform the steps of the method for data processing by the above-mentioned vehicle-side rule engine.
[0159] Specifically, the above-mentioned memory 602 and processor 601 can be general-purpose memory and processor, which are not specifically limited here. When the processor 601 runs the computer program stored in the memory 602, it can execute the method of data processing by the above-mentioned vehicle-side rule engine.
[0160] The processor 601 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 601. The above processor 601 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module may be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 602, and the processor 601 reads the information in the memory 602 and completes the steps of the above method in combination with its hardware.
[0161] Corresponding to the above-mentioned method of data processing by the vehicle-side rule engine, an embodiment of the present application also provides a computer-readable storage medium, which stores machine-executable instructions. When the computer-executable instructions are called and executed by the processor, the computer-executable instructions prompt the processor to execute the steps of the above-mentioned method of data processing by the vehicle-side rule engine.
[0162] The device for data processing of the vehicle-side rule engine provided in the embodiment of the present application can be specific hardware on the device or software or firmware installed on the device. The implementation principle and technical effects of the device provided in the embodiment of the present application are the same as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference can be made to the corresponding contents in the aforementioned method embodiment. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can all refer to the corresponding processes in the aforementioned method embodiment, and will not be repeated here.
[0163] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.
[0164] For another example, the flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the device, method and computer program product according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.
[0165] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0166] In addition, each functional unit in the embodiments provided in the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0167] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or partly contribute to the prior art or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions for an electronic device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the vehicle marking method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program codes.
[0168] It should be noted that similar numbers and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. In addition, the terms "first", "second", "third", etc. are only used to distinguish the description and are not to be understood as indicating or implying relative importance.
[0169] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solution of the present application, rather than to limit it. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the aforementioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solution recorded in the aforementioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solution deviate from the scope of the technical solution of the embodiment of the present application. They should all be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.
Claims
1. A method for processing data by a vehicle-side rule engine, characterized in that: Applied to the vehicle-side rule engine, the method includes: Obtain data processing rules configured by the user through a graphical interface or programming interface, and obtain external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors; Performing parallel aggregation calculation processing on the external data and the sensor data within the preset time window using multi-threaded computing technology to obtain aggregated calculated data; Label and classify the aggregated data, the external data, the sensor data, and the static data obtained from the cloud to obtain characteristics of the aggregated data, the external data, the sensor data, and the static data; Establishing a data relationship graph of the aggregated data, the external data, the sensor data, and the static data based on the characteristics of the aggregated data, the characteristics of the external data, the sensor data, and the static data; The shortest path algorithm is used to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship diagram, and data processing is performed according to the optimal processing path to obtain a processing result for final decision support.
2. The method according to claim 1, characterized in that The external data and the sensor data within the preset time window are processed by parallel aggregation calculation using multi-threaded computing technology, including: Partitioning the external data and the sensor data using a hash function or a range partitioning method to obtain a plurality of partitioned data; Allocating the plurality of partitioned data to each processing node, so that each processing node performs parallel aggregation computing processing on the corresponding partitioned data using multi-thread computing technology; The execution status of the aggregate computing processing performed by each processing node is obtained, and the aggregate computing processing tasks are scheduled according to the execution status until all the aggregate computing processing tasks are completed to obtain the data after the aggregate computing.
3. The method according to claim 1, characterized in that The aggregated data, the external data, the sensor data, and the static data obtained from the cloud are labeled and classified, including: Get predefined metadata; The aggregated data, the external data, the sensor data and the static data are labeled and classified through the metadata to obtain the characteristics of the aggregated data, the characteristics of the external data, the sensor data and the static data.
4. The method according to claim 1, characterized in that A data relationship graph of the aggregated data, the external data, the sensor data, and the static data is established based on the characteristics of the aggregated data, the characteristics of the external data, the sensor data, and the static data, including: Obtaining predefined connection relationships between various features; The characteristics of the aggregated data, the characteristics of the external data, the characteristics of the sensor data and the characteristics of the static data are used according to the connection relationship to establish a data relationship graph of the aggregated data, the external data, the sensor data and the static data, wherein in the data relationship graph, nodes represent the aggregated data, the external data, the sensor data and the static data, and edges represent the connection relationship between the aggregated data, the external data, the sensor data and the static data.
5. The method according to claim 1, characterized in that The programming interface supports configuring the data processing rules using SQL statements.
6. The method according to claim 1, characterized in that The data processing rules support dynamic configuration of version control.
7. The method according to claim 1, characterized in that The vehicle-side rule engine supports developers to develop custom plug-ins using go SDK or python SDK so as to integrate the developed plug-ins into the vehicle-side rule engine.
8. A device for processing data by a vehicle-side rule engine, characterized in that: Applied to the vehicle-side rule engine, the device comprises: An acquisition unit, used to acquire data processing rules configured by a user through a graphical interface or a programming interface, and to acquire external data transmitted by an external system through a communication interface / API interface and sensor data collected by vehicle sensors; An aggregate calculation processing unit, used to perform parallel aggregate calculation processing on the external data and the sensor data within a preset time window using a multi-threaded computing technology to obtain aggregated calculated data; a marking and classification unit, used for marking and classifying the aggregated and calculated data, the external data, the sensor data, and the static data obtained from the cloud, to obtain the characteristics of the aggregated and calculated data, the characteristics of the external data, the sensor data, and the static data; an establishing unit, configured to establish a data relationship graph of the aggregated data, the external data, the sensor data, and the static data based on the characteristics of the aggregated data, the characteristics of the external data, the sensor data, and the static data; A determination and data processing unit is used to use the shortest path algorithm to determine the optimal processing path of the processing path corresponding to the data processing rule in the data relationship diagram, and perform data processing according to the optimal processing path to obtain a processing result for final decision support.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to execute the method according to any one of claims 1 to 7.
Citation Information
Cited By
Interaction processing method and device of vehicle terminal and electronic equipment
CN121117744A
