A vehicle data collection and filtering system and method

Abstract

This invention provides a vehicle data acquisition and filtering system and method, including a main chip (MCU), one end of which is electrically connected to a power module, and the other end of which is signal-connected to an on-board CAN bus module through several sets of CAN communication modules to receive on-board CAN network messages; a storage module connected to the main chip (MCU) to store the received on-board CAN network messages; and an Internet of Things (IoT) module connected to the main chip (MCU) to upload the network messages required by the user from the storage module to a server; the acquisition and uploading of CAN messages are separated, allowing the system to focus on acquiring message data while the vehicle is running, and to centrally transmit message data when the vehicle is idle; effectively controlling costs while meeting usage requirements.

Description

Technical Field

[0001] This invention belongs to the technical field of vehicle data collection and screening, specifically relating to a vehicle data collection and screening system and method. Background Technology

[0002] Currently, devices used for wireless vehicle data acquisition mainly fall into two categories. One type is dedicated testing equipment, which is fully functional and can collect physical signals from vehicles such as current, voltage, and vibration, as well as vehicle network packet data (including LIN, CAN, FlexRay, etc.). This type utilizes high-performance host computers, ultra-high-speed, high-capacity storage, 4G / 5G wireless communication modules, and dedicated servers. However, this equipment is expensive and can only be used during vehicle development, not for mass production. The other type is a data terminal (DT), which uploads data such as vehicle speed, voltage, and temperature to a server in real time. The upload cycle is greater than 1 second, and the data volume is relatively small, which can be adequately handled by real-time wireless data transmission. However, when a vehicle malfunctions and requires all vehicle data for a specific time period, this type of equipment cannot handle the real-time transmission of large data volumes. Summary of the Invention

[0003] To address the deficiencies and shortcomings of the existing technology, this invention provides a vehicle data acquisition and screening system and method.

[0004] To achieve the above objectives, the present invention provides the following technical solution:

[0005] A vehicle data collection and filtering system, characterized in that: the system includes

[0006] The main chip has one end electrically connected to the power module and the other end connected to the vehicle CAN bus module via several sets of CAN communication modules to receive vehicle CAN network messages.

[0007] A storage module, which is connected to the main chip to store received vehicle CAN network messages;

[0008] An Internet of Things (IoT) module is connected to the main chip to upload network packets required by the user from the storage module to the server.

[0009] Furthermore, the present invention also provides a data acquisition and filtering method for the system, characterized by comprising the following steps:

[0010] 1) After the vehicle is powered on, collect the on-board CAN network messages;

[0011] 2) Analyze the message information to obtain the transmission cycle of each message;

[0012] 3) Based on different message cycles, the screening factor D is divided into i categories;

[0013] 4) Set the initial value for each filtering factor D, and calculate and determine the amount of messages Q stored in the storage module per unit time based on all filtering factors;

[0014] 5) Determine the relationship between the number of packets Q stored in the storage module per unit time and the maximum number of packets Qmax that can be stored in the storage module per unit time; when Q>Qmax, reduce any of the filtering factors in type i from the initial value to the adjustment value.

[0015] 6) Repeat the judgment in step 5). If Q is still greater than Qmax, reduce the other screening factor in the i-th screening factor from the initial value to the adjusted value.

[0016] 7) Repeat steps 5)-6) above until the termination condition is met, at which point the calibration ends;

[0017] 8) Based on the current value of the filtering factor, store the message in the storage module in the corresponding manner;

[0018] 9) The main chip segments the messages in the storage module, and each segment is treated as a file in the storage module;

[0019] 10) The storage module transmits the required data to the user through the Internet of Things module.

[0020] As a further preferred embodiment of the present invention, in step 3), the classification basis is as follows:

[0021] ;

[0022] In a further preferred embodiment of the present invention, in step 4), the number of messages Q stored in the storage module per unit time and the filtering factor satisfy the following relationship:

[0023] ;

[0024] in:

[0025] Q represents the number of messages stored in the storage module per second;

[0026] Ti is the transmission period of the i-th type of message;

[0027] Di is the filtering factor for the i-th type of message;

[0028] i=1,2,3,4,5.

[0029] As a further preferred embodiment of the present invention, the initial value of the screening factor Di is 1, and the adjustment value is 0.5.

[0030] As a further preferred embodiment of the present invention, in step 5),

[0031] When Q < Qmax, all screening factors remain at their initial values unchanged, and the calibration ends;

[0032] When Q > Qmax, any one screening factor D in the i-th type of screening factors ,

[0037] is reduced to the adjusted value, and the initial values of the remaining screening factors remain unchanged;

[0033] In step 6) above, continue to determine the relationship between the message volume Q stored in the storage module per unit time and the maximum message volume Qmax that can be stored in the storage module per unit time;

[0034] When Q < Qmax, the remaining screening factors except the screening factor Di remain at their initial values unchanged, and the calibration ends;

[0035] When Q > Qmax, continue to reduce the initial value of another screening factor D i+1 to the adjusted value, and keep the initial values of the remaining screening factors except the screening factors Di and D i+1 unchanged;

[0036] As a further preferred embodiment of the present invention, in step 7), the calibration end condition is

[0037] A) The message volume Q stored in the storage module per unit time < the maximum message volume Qmax that can be stored in the storage module per unit time; or

[0038] B) When all screening factors are reduced from the initial values to the adjusted values.

[0039] As a further preferred embodiment of the present invention, in step 8), after the calibration ends, storing the messages in the corresponding manner in the storage module includes:

[0040] When Di is at the initial value, the corresponding message is completely stored in the storage module; <​​​​​​​​​​​​​1) This invention provides a vehicle data acquisition and filtering system and method. Fault analysis requires detailed data before and after a fault occurs, but there is no real-time requirement. Therefore, the acquisition and uploading of CAN messages are separated. When the vehicle is running, the system focuses on acquiring message data, and when the vehicle is idle, it centrally transmits message data.

[0046] 2) This invention provides a vehicle data acquisition and filtering system and method, which actively filters message data in a regular manner according to the CAN network load and stores the messages in segments to ensure that the stored message data meets the requirements of fault analysis under multiple CAN channels and high load.

[0047] 3) This invention provides a vehicle data acquisition and screening system and method, which adopts a 3-channel CAN bus module design to meet the data acquisition needs of most vehicles.

[0048] 4) This invention provides a vehicle data collection and screening system and method. The storage module uses a TF card to store data, which ensures the integrity of the data when a fault occurs.

[0049] 5) This invention provides a vehicle data collection and screening system and method, which separates data storage and data transmission, reducing the requirements for system hardware. The Internet of Things module uses an NB module and the storage module uses a small-capacity TF card, effectively controlling costs while meeting usage requirements.

[0050] 6) This invention provides a vehicle data collection and filtering system and method. The data filtering algorithm solves the problem of data loss caused by the large amount of data while meeting the usage requirements. Attached Figure Description

[0051] Figure 1 This is the structural logic diagram of the present invention.

[0052] Figure 2 This is a flowchart of the steps of the present invention. Detailed Implementation

[0053] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.

[0054] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0055] In the description of this invention, it should be noted that the terms "upper," "lower," "inner," "outer," "front end," "rear end," "both ends," "one end," and "the other end," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0056] In the description of this invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "installed," "equipped with," "connected," etc., should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be a connection within two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0057] [Example 1]

[0058] like Figure 1 The figure shown is a vehicle data collection and filtering system provided by the present invention, including...

[0059] The main chip MCU has one end electrically connected to the power module, which provides driving power to the MCU. The other end is connected to the vehicle CAN bus module via several CAN communication modules to receive vehicle CAN network messages. In this embodiment, three CAN communication modules are provided, as follows: Figure 1 The first to third communication modules shown, CAN1, CAN2, and CAN3, adopt a 3-channel CAN bus module design, which meets the data acquisition needs of most vehicles.

[0060] This embodiment also includes a storage module connected to the main chip MCU to store received vehicle CAN network messages; and an Internet of Things (IoT) module connected to the main chip MCU to upload network messages required by the user from the storage module to the server.

[0061] This embodiment reduces the requirements for system hardware by separating data storage and data transmission. The IoT module uses an NB module and the storage module uses a small-capacity TF card, effectively controlling costs while meeting usage requirements.

[0062] like Figure 2 As shown, the present invention also provides a data acquisition and filtering method for the system shown in Embodiment 1, comprising the following steps:

[0063] 1) After the vehicle is powered on, collect the in-vehicle CAN network messages;

[0064] 2) Analyze the message information to obtain the transmission period of each message;

[0065] 3) According to the different message periods, divide the screening factor D into i categories;

[0066] Preferably, the classification basis selected in this embodiment is as follows

[0067] ;

[0068] In this embodiment, the screening factor is divided into 5 categories. Those skilled in the art know that according to the actual data collection and screening needs, it can also be classified into more or fewer categories according to the different transmission period ranges of each message;

[0069] 4) Set the initial value of the screening factor Di, and calculate and determine the number of messages Q stored in the storage module per unit time according to all screening factors;

[0070] In this embodiment, the number of messages Q stored in the storage module per unit time and the screening factor satisfy the following relationship:

[0071] ;

[0072] Where:

[0073] Q is the number of messages stored in the storage module per second;

[0074] Ti is the transmission period of the i-th type of message;

[0075] Di is the screening factor of the i-th type of message;

[0076] i = 1, 2, 3, 4, 5.

[0077] For the convenience of calculation, the initial value of the screening factor Di in this embodiment is 1, and the reduced adjustment value is 0.5. For the convenience of calculation needs, the initial value and adjustment value of the screening factor Di can also be set to other values.

[0078] 5) Determine the relationship between the number of messages Q stored in the storage module per unit time and the maximum number of messages Qmax that can be stored in the storage module per unit time;

[0079] When Q < Qmax, the screening factor Di remains unchanged at the initial value, and the calibration ends;

[0080] When Q > Qmax, reduce the initial value of the first screening factor D1 in this embodiment to an adjusted value, and keep the initial values of the remaining screening factors unchanged; the first screening factor D1 can be any screening factor in the i-type screening factors.

[0081] 6) Continue to determine the relationship between the message volume Q stored in the storage module per unit time and the maximum message volume Qmax that can be stored in the storage module per unit time;

[0082] When Q < Qmax, keep the initial values of the remaining screening factors Di unchanged, and the calibration ends;

[0083] When Q > Qmax, continue to reduce the initial value of the second screening factor D2 to an adjusted value, and keep the initial values of the remaining screening factors unchanged; the second screening factor D2 can be another screening factor in the i-type screening factors to distinguish it from the first screening factor D1;

[0084] 7) Repeat the above judgment and corresponding adjustment, that is, repeat the above steps 5)-6), until the calibration ends when the end condition is met; in this embodiment, the end condition of calibration is

[0085] A) The message volume Q stored in the storage module per unit time < the maximum message volume Qmax that can be stored in the storage module per unit time; at this time, the message volume stored in the storage module per unit time has met the storage requirement of the maximum message volume that can be stored in the storage module per unit time; or

[0086] B) When all screening factors Di are reduced from the initial value to the adjusted value, at this time all screening factors have been completed from the initial value to the adjusted value.

[0087] 8) According to the current value of the screening factor, store the message in the storage module in a corresponding manner; that is, after calibration,

[0088] When Di is the initial value, the corresponding message is completely stored in the storage module;

[0089] When Di is the adjusted value, the corresponding message is stored in the storage module at intervals to avoid the message volume Q stored in the storage module per unit time exceeding the maximum message volume Qmax that can be stored in the storage module per unit time. At the same time, since the message period is relatively short and some messages are regularly discarded, it will not affect the fault analysis.

[0090] 9) The main chip segments the messages in the storage module, which can use the time period as the segmentation standard (for example, divide the messages into segments every 10 minutes), each segment of the message is a file in the storage module, and the standard time can be used as the file name;

[0091] 10) The storage module transmits the required data to the user through the IoT module. Specifically, when data for a certain period of time is needed, the user sends a command from the server to view the data list in the storage module. After selecting the data file, the user sends a data transfer command to the server, and the storage module then transmits the required data file to the user through the IoT module.

[0092] As a further preferred embodiment of the invention, the storage module, while transmitting the required data files to the user via the IoT module, stops receiving and storing vehicle CAN network messages. Since fault analysis requires detailed data before and after a fault occurs, but not real-time data, the acquisition and transmission of CAN messages are separated. The system focuses on acquiring message data while the vehicle is running, and transmits message data when the vehicle is idle. Separating data storage and data transmission reduces the hardware requirements of the system. The IoT module uses an NB module, and the storage module uses a small-capacity TF card, effectively controlling costs while meeting usage requirements.

[0093] Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A data acquisition and screening method for a vehicle data acquisition and screening system. The vehicle data acquisition and screening system includes: A main chip (MCU), one end of the main chip (MCU) is electrically connected to a power supply module, and the other end of the main chip (MCU) is signal-connected to a vehicle-mounted CAN bus module through a plurality of groups of CAN communication modules to receive vehicle-mounted CAN network messages; A storage module, the storage module is connected to the main chip (MCU) to store the received vehicle-mounted CAN network messages; An Internet of Things module, the Internet of Things module is connected to the main chip (MCU) to upload the network messages required by the user from the storage module to the server; It is characterized in that: the data acquisition and screening method includes the following steps: 1) After the vehicle is powered on, collect vehicle-mounted CAN network messages; 2) Analyze the message information to obtain the transmission period of each message; 3) According to different message periods, divide the screening factor D into i categories; 4) Set the initial value of each screening factor D, and calculate and determine the amount of messages Q stored in the storage module per unit time according to all screening factors; 5) Determine the relationship between the amount of messages Q stored in the storage module per unit time and the maximum amount of messages Qmax that can be stored in the storage module per unit time in turn; when Q > Qmax, reduce any one of the screening factors in the i categories from the initial value to the adjusted value; 6) Repeat the judgment in step 5). When Q > Qmax still holds, reduce another screening factor in the i categories from the initial value to the adjusted value; 7) Repeat the above steps 5)-6) until the calibration ends when the end condition is met; 8) According to the current value of the screening factor, store the messages in the storage module in a corresponding manner; 9) The main chip segments the messages in the storage module, and each segment of the message is used as a file in the storage module; 10) The storage module transmits the required data to the user through the Internet of Things module; In step 3), the classification basis is ； In step 4), the amount of messages Q stored in the storage module per unit time and the screening factor satisfy the following relationship: ； Where: Q is the amount of messages stored in the storage module per second; Ti is the transmission period of the i-th type of message; Di is the screening factor of the i-th type of message; i=1,2,3,4,5； In step 5), When Q < Qmax, all screening factors remain unchanged at the initial value, and the calibration ends; When Q > Qmax, any screening factor D from the i-th screening factor category will be selected. i The initial value is reduced to the adjusted value, while the initial values ​​of the other screening factors remain unchanged; In step 6), continue to determine the relationship between the amount of messages Q stored in the storage module per unit time and the maximum amount of messages Qmax that can be stored in the storage module per unit time; When Q < Qmax, the remaining screening factors except the screening factor Di remain unchanged at the initial value, and the calibration ends; When Q > Qmax, continue with another selection factor D. i+1 The initial value is reduced to the adjusted value, while maintaining the values ​​excluding screening factors Di and D. i+1 The initial values ​​of the remaining screening factors remain unchanged; In step 7), the calibration end condition is: [[ID=2...]]A) The amount of messages Q stored in the storage module per unit time < the maximum amount of messages Qmax that can be stored in the storage module per unit time; or B) When all screening factors are reduced from the initial value to the adjusted value; In step 8), after the calibration ends, storing the messages in the storage module in a corresponding manner includes: When Di is the initial value, the corresponding message is completely stored in the storage module; When Di is the adjusted value, the corresponding message is stored in the storage module at intervals; In step 10), when data for a certain time period is needed, a command is sent from the server to view the data list in the storage module. After selecting the data file, a data transmission command is sent to the server, and the storage module then transmits the required data file through the IoT module. While the storage module transmits the required data files through the IoT module, it stops receiving and storing messages from the vehicle's CAN network.

2. The method as described in claim 1, characterized in that: The initial value of the screening factor Di is 1, and the adjustment value is 0.5.

Images