Method for analyzing sensor data of a vehicle, vehicle, system, program product

Abstract

The present application relates to the field of vehicles and relates to a method (100) for analyzing and processing sensor data of a vehicle (10), comprising the following steps: S110, receiving a data analysis processing module for analyzing and processing sensor data of the vehicle (10) from a server (20) based on a predetermined condition; S120, analyzing and processing sensor data of the vehicle (10) by means of the data analysis processing module; and S130, generating and storing a data analysis processing result and / or sending the data analysis processing result to the server (20). In addition, the present application also relates to a vehicle, a system and a computer program product. Through the scheme of the present application, not only can the data analysis processing be performed at the full rate of the sensor in the vehicle, but also the data analysis processing can be simply and economically performed only for the vehicle-specific sensor data, the data analysis processing process is simplified, and the data analysis processing efficiency is improved.

Description

Technical Field

[0001] This invention relates to the field of vehicles, and more specifically to a method for analyzing and processing sensor data from a vehicle. Furthermore, this invention also relates to a vehicle, a system, and a computer program product. Background Technology

[0002] Modern vehicles are equipped with a large number of sensors capable of continuously measuring data. Storing and preserving complete signals requires significant internal storage space or continuous transmission of large amounts of data to the cloud. This makes evaluating signal patterns within vehicles difficult or even impossible.

[0003] Furthermore, in modern vehicles, analyses related to noise, vibration, or acoustic harshness (NVH) are complex, and the associated patterns often follow intricate mechanisms. Limited data storage or transmission within vehicles makes reliable analysis of the vehicle's relevant conditions difficult, even when internal sensors are available.

[0004] Therefore, there is still a need to improve existing technologies to address at least some of the aforementioned problems. Summary of the Invention

[0005] Based on this, the present invention proposes an efficient solution that not only overcomes the shortcomings of existing technologies but also enables the downloading of corresponding data analysis and processing modules from a backend server using OTA technology under predetermined conditions, and their deployment locally. This allows for real-time analysis and processing of vehicle status or specific patterns of sensor data, saving vehicle CPU computing power.

[0006] According to a first aspect of the present invention, a method for analyzing and processing sensor data of a vehicle is provided, wherein the method includes the following steps: S110 receives data analysis and processing module from server based on predetermined conditions for analyzing and processing vehicle sensor data; S120 uses the data analysis and processing module to analyze and process the sensor data of the vehicle; and S130 generates and stores the data analysis and processing results and / or sends the data analysis and processing results to the server.

[0007] The basic concept of this invention is that, under predetermined conditions, the vehicle receives a stored or generated data analysis and processing module from a backend server via OTA technology and deploys it locally within the vehicle. This allows the data analysis and processing module to analyze and process specific sensor data and evaluate specific signal patterns in real time, enabling local storage and subsequent analysis or sending the data to the backend server for further analysis. This approach performs data analysis and processing only on vehicle-specific sensor data, allowing data analysis and processing to be performed at the full sensor rate within the vehicle, simplifying the process, saving vehicle computing power, and improving data analysis and processing efficiency.

[0008] Advantageous configurations of the technical solution of the present invention can be obtained from the following optional embodiments.

[0009] In an optional embodiment of the method according to the present invention, the data analysis and processing module is configured to be associated with or generated based on the predetermined conditions.

[0010] In an optional embodiment of the method according to the present invention, the data pattern represented by the predetermined conditions is converted into the data analysis and processing module.

[0011] In an alternative embodiment of the method according to the invention, the predetermined conditions include a specific vehicle event type, a specific vehicle behavior, and a specific trigger signal.

[0012] In an optional embodiment of the method according to the present invention, the data analysis and processing module includes: AI data routines and / or filters and / or rule engines and / or configuration files.

[0013] In an alternative embodiment of the method according to the present invention, the server is configured as a vehicle-specific OTA server.

[0014] According to an optional embodiment of the method of the present invention, the data analysis and processing module is received from the server and / or the data analysis and processing results are sent to the server via a vehicle-specific wireless communication network.

[0015] In an alternative embodiment of the method according to the invention, the data analysis and processing module is transmitted in an encrypted manner and decrypted in the vehicle.

[0016] In one alternative embodiment of the method according to the invention, the method is performed during use by a vehicle user.

[0017] In one alternative embodiment of the method according to the invention, the method is performed inside the vehicle.

[0018] In an alternative embodiment of the method according to the invention, the sensor data is analyzed and processed at the full data rate of the vehicle's sensors.

[0019] In an optional embodiment of the method according to the invention, the data analysis and processing results are generated, stored, and / or transmitted in a compressed format and / or an encrypted format.

[0020] In an optional embodiment of the method according to the present invention, the data analysis and processing results include the number of triggers, the data sequence after triggering, and other evaluation results.

[0021] In an optional embodiment of the method according to the invention, the sensor data includes powertrain sensor data, chassis and safety sensor data, body and comfort sensor data, and driver assistance or autonomous driving sensor data.

[0022] According to a second aspect of the present invention, a vehicle is provided, the vehicle including a control device, wherein the control device includes a processor, a memory and a communication interface and is configured to be adapted to one of the methods described above.

[0023] According to a third aspect of the invention, a system is provided, the system comprising a server and a vehicle according to a second aspect, wherein the vehicle transmits data to the server via a vehicle-specific wireless communication network.

[0024] According to a fourth aspect of the present invention, a computer program product, such as a computer-readable program carrier, is provided, the computer program product including or storing computer program instructions, which, when executed by a processor, at least assist in implementing the steps of the method of one of the above embodiments.

[0025] Further features of the invention will become apparent from the claims, drawings, and description of the figures. Features and combinations of features mentioned in the foregoing description, as well as features and combinations of features mentioned in the following description of the figures and / or shown only in the figures, can be used not only in the corresponding specified combinations, but also in other combinations without departing from the scope of the invention. Therefore, the following are also considered to be covered and disclosed by the invention: those not explicitly shown in the figures and not explicitly interpreted, but rather derived from and produced by combinations of separate features derived from the interpreted content. The following combinations of features are also considered to be disclosed: those that do not possess all the features of the originally drafted independent claims. Furthermore, the following combinations of features are considered to be disclosed, especially those exceeding or deviating from the feature combinations defined in the reference relationships of the claims. Attached Figure Description

[0026] The principles, features, and advantages of the invention will be better understood below by referring to the accompanying drawings. In the drawings: Figure 1 A schematic diagram of an embodiment of a vehicle according to the present invention is shown; Figure 2 A schematic diagram showing one embodiment of a vehicle control device; Figure 3 A schematic diagram illustrating an embodiment of the system according to the present invention is shown; and Figure 4 A method for analyzing and processing sensor data of a vehicle according to the present invention is shown.

[0027] List of reference numerals 1 System 10 vehicles 11 Sensors 12 Control devices 20 servers 100 methods 121 processor 122 Memory 123 Communication Interface S110-S130 Method Steps. Detailed Implementation

[0028] To make the technical problems to be solved, the technical solutions, and the beneficial technical effects of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and several exemplary embodiments. It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of protection of this invention.

[0029] In this specification, for convenience, terms such as "middle," "upper," "lower," "front," "rear," "vertical," "horizontal," "top," "bottom," "inner," and "outer" are used to indicate orientation or positional relationships in conjunction with the accompanying drawings. This is solely for the purpose of facilitating the description and simplification, and does not imply that the device or element referred to has a specific orientation, or is constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation of this disclosure. The positional relationships of the constituent elements may be appropriately varied depending on the direction in which each constituent element is described. Therefore, the use of terms not limited to those described in the specification may be appropriately replaced as needed.

[0030] Figure 1 A schematic diagram of one embodiment of the vehicle 10 according to the present invention is shown.

[0031] Vehicle 10 is exemplarily configured as a passenger vehicle and includes sensors 11 and control devices 12. Sensors 11 exemplarily include: powertrain sensors related to the powertrain of vehicle 10, such as engine sensors and gear position sensors in the case of a gasoline vehicle, or motor temperature sensors, motor speed sensors, battery voltage sensors, battery temperature sensors, battery current sensors, etc., in the case of a new energy vehicle; sensors related to the chassis and safety, such as wheel speed sensors, yaw rate sensors, longitudinal / lateral acceleration sensors, tire pressure sensors, etc.; sensors related to the body and comfort, such as rain and light sensors, seat position sensors, temperature / humidity sensors, door / window / sunroof position sensors, etc.; and sensors related to driver assistance or autonomous driving, such as cameras, microphones, radar sensors, lidar sensors, ultrasonic sensors, lane positioning sensors, etc.

[0032] The control device 12 establishes a data connection with the sensor 11 via a vehicle communication bus, such as CAN bus, CAN FD, LIN bus, FlexRay, vehicle Ethernet, etc., and can acquire sensor data from the sensor 11 in real time.

[0033] For example, the control device 12 may be an onboard central processing unit (CPU-V) capable of analyzing and processing various sensor data from the sensors 11 of the vehicle 10. In other embodiments, the control device 12 may also be a domain controller or a vehicle-to-everything (V2X) controller (T-Box).

[0034] Figure 2 A schematic diagram of one embodiment of the control device 12 of the vehicle 10 is shown. The control device 12 includes a processor 121, a memory 122, and a communication interface 123.

[0035] The processor 121 may include or be integrated with a central processing unit (CPU), a graphics processing unit (GPU), a microcontroller (MCU), an image signal processor (ISP), a digital signal processor (DSP), etc., and may perform corresponding data analysis and processing on sensor data from different sensors.

[0036] Memory 122 may, by way of example, include: internal cache, such as cache integrated on the aforementioned processors; running memory, such as LPDDR; non-volatile memory, such as eMMC, NVMe SSD, NOR Flash; and dedicated memory, such as static random access memory (SRAM) and ECC memory. Sensor data transmitted via the vehicle bus can be cached in the internal cache and accessed and analyzed by processor 121. The analyzed sensor data and the analysis results can be stored in non-volatile memory. Furthermore, programs or code downloaded from an external server via OTA technology, for example, can also be stored in memory 122, such as in non-volatile memory.

[0037] The communication interface 123 exemplarily includes: an in-vehicle network interface, such as an interface suitable for CAN / CAN FD, LIN, FlexRay, in-vehicle Ethernet, etc.; a sensor-specific interface, such as a Gigabit Multimedia Serial Link (GMSL), a Camera Serial Interface (CSI), a Display Serial Interface (DSI), PCIe, etc.; and a wireless communication interface, such as an interface suitable for cellular mobile networks 4G / 5G / 6G, V2X, Wi-Fi, Bluetooth, GNSS, etc. Additionally, the communication interface 123 may also include external expansion interfaces and debugging interfaces. The control device 12 of the vehicle 10 can exchange data with external devices, such as an external server, and receive sensor data or send control commands to other actuators within the vehicle via the communication interface 123.

[0038] Figure 3 A schematic diagram of an embodiment of System 1 according to the present invention is shown.

[0039] like Figure 3 As shown, system 1 includes Figure 1 The vehicle 10 and server 20 are connected via a wireless communication network.

[0040] For example, server 20 is configured as a vehicle-specific OTA server. Vehicle 10 can receive corresponding upgrade content, such as software upgrade packages, from the OTA server.

[0041] For example, the wireless communication network is a wide-area wireless network, such as cellular mobile networks 4G / 5G / 6G, Wi-Fi, etc., especially a wireless communication network dedicated to vehicles.

[0042] Furthermore, VPN / encrypted channels can be established over the communication channels of wireless communication networks. Only a vehicle-specific server and the associated vehicle can encrypt and decrypt the transmitted data. This improves the security of data transmission and enhances the exclusivity of vehicle services.

[0043] Below, refer to Figure 4 And combined Figures 1 to 3 The present invention will be described in detail.

[0044] Figure 4 A method 100 for analyzing and processing sensor data of a vehicle 10 according to the present invention is shown. Method 100 is capable of being... Figure 2 The control device 12 shown executes and exemplarily includes steps S110 to S130.

[0045] In step S110, the vehicle 10 receives a data analysis and processing module from the server 20 based on predetermined conditions for analyzing and processing the sensor data of the vehicle 10.

[0046] In this invention, the "data analysis and processing module" should be understood as a medium used for data analysis and processing, and not as a hardware unit or device unit in a physical sense.

[0047] According to this embodiment, the data analysis and processing module may include AI data routines, filters and / or rule engines and / or configuration files.

[0048] AI data routines can be understood as a collection of software algorithms and logic used to process raw sensor data, including artificial intelligence algorithms. For example, AI data routines include predefined, reusable code logic and can perform specific data analysis processing only for particular sensor data.

[0049] For example, the predetermined conditions include specific vehicle event types, specific vehicle behaviors, and specific trigger signals. For instance, a specific vehicle event type could be a vehicle 10 speed exceeding 80 km / h, or a specific vehicle behavior could be an abnormal noise from the motor at a specific frequency.

[0050] Here, the data analysis and processing module is associated with the aforementioned predetermined conditions and is stored in advance in server 20. Alternatively, the data analysis and processing module generates data in real time in server 20 based on the predetermined conditions. Therefore, the data pattern represented by the predetermined conditions is transformed into the data analysis and processing module.

[0051] The control device 12 of the vehicle 10 receives the data analysis and processing module from the server 20 using OTA technology and stores it locally or in the memory 122 of the control device 12.

[0052] For example, the data analysis and processing module is transmitted in an encrypted manner and decrypted in vehicle 10. This improves the security of data transmission from the OTA server to the vehicle. Additionally, the integrity of the data analysis and processing module can be verified after decryption.

[0053] Next, in step S120, the sensor data of vehicle 10 is analyzed and processed using a data analysis and processing module. Here, the data analysis and processing module can be deployed in and operated by the control unit 12 of vehicle 10. The control unit 12 receives sensor data from the vehicle bus for specific sensors involved in the corresponding data pattern based on the data routines and / or filters of the data analysis and processing module.

[0054] Here, the control device 12 does not need to receive all sensor data from the vehicle bus, but only needs to "select" or, for example, filter out specific sensor data according to the settings in the data analysis and processing module. This not only greatly reduces the amount of data transmission on the vehicle bus, but also allows this to be done while the vehicle user is using the vehicle without affecting or consuming more bus resources or the computing power of the control device 12.

[0055] For example, filters include configurable filtering rules (such as JSON, Lua scripts, etc.).

[0056] Therefore, the control device 12 can analyze and process the sensor data at the full data rate of the sensor 11. In other words, the sensor can continuously transmit the raw sensor data to the control device 12 at the highest sampling rate or data output rate supported by its hardware design, without any data downsampling, sampling, or compression processing.

[0057] In step S130, the processor 121 of the control device 12 analyzes and processes the raw sensor data with the help of the data analysis and processing module, generates data analysis and processing results, and stores them in the memory 122 of the control device 12.

[0058] In addition, the data analysis and processing results can be sent to server 20 via a wireless communication network, such as the vehicle-specific wireless communication network described above, for further analysis and processing on the server side.

[0059] For example, the data analysis and processing results are generated and stored in vehicle 10 in a compressed and / or encrypted format. Additionally, the data analysis and processing results are sent to server 20 in a compressed and / or encrypted format. The data analysis and processing results are decompressed and / or decrypted on the server side. This further reduces the amount of data transmitted and stored, decreasing bandwidth usage and storage space usage in memory 122.

[0060] For example, the data analysis and processing results include the number of triggers, the data sequence after the trigger, and other evaluation results.

[0061] The solution of this invention enables the acquisition of a data analysis and processing module for specific data patterns from a server using OTA technology and its deployment on the vehicle. Based on this module, the vehicle samples, analyzes, and processes corresponding sensor data, generates relevant data analysis results, and, if necessary, sends these results back to the server for further analysis. This significantly reduces the computational power required by the vehicle's control system, improves data processing efficiency, and enables a more secure data transmission method.

[0062] The following section will further illustrate the solution of the present invention in conjunction with the inspection of vehicle NVH.

[0063] In vehicle 10, NVH (Noise, Vibration, and Harshness) directly affects the driving and riding comfort experience of vehicle users. Therefore, in order to monitor NVH in real time during vehicle 10 operation or during vehicle user use, it is necessary to collect and analyze NVH-related sensor data.

[0064] For example, when vehicle 10 exhibits a specific vehicle behavior, such as reaching a speed of 60 km / h, based on this specific vehicle behavior or predetermined conditions, vehicle 10 receives the data analysis and processing module for NVH events from server 20 via OTA technology and stores (deploys) it in memory 122. This data analysis and processing module includes, for example, AI data routines and filters. The AI ​​data routines include fixed processes or software routines for data acquisition, processing, and transmission. The filters include configurable filtering rules (such as JSON, Lua scripts, etc.) and filter data from sensors related to NVH events, such as noise microphones, vibration sensors, sensors for the body / chassis / motor / suspension, vehicle speed sensors, wheel speed sensors, torque sensors, temperature sensors, etc.

[0065] Then, the data analysis and processing module continuously collects the corresponding sensor data, which is then analyzed and processed by the processor 121 of the control device 12. Here, the sound pressure level and spectrum of the microphone data, the acceleration and order of the vibration sensor can be analyzed, the source of abnormal noise can be located, and the vibration transmission path can be analyzed, ultimately forming a data analysis and processing result, such as an NVH quality evaluation, which is then stored in the vehicle 10. Furthermore, the data analysis and processing result can be sent back to the server 20, providing reliable data for further analysis and processing of NVH events in the vehicle 10 on the server side.

[0066] The present invention also protects a computer program product, such as a computer-readable program carrier, which includes or stores computer program instructions that, when executed by processor 121, at least assist in implementing the steps of the method 100 described above.

[0067] Other advantages and alternative embodiments of the invention will be apparent to those skilled in the art. Therefore, the invention is not, in its broader sense, limited to the specific details, representative structures, and exemplary embodiments shown and described. Rather, those skilled in the art can make various modifications and substitutions without departing from the basic spirit and scope of the invention.

Claims

1. A method (100) for analyzing and processing sensor data of a vehicle (10), wherein, The method (100) includes the following steps: S110 receives data analysis and processing module from server (20) based on predetermined conditions for analyzing and processing sensor data of vehicle (10); S120 uses the data analysis and processing module to analyze and process the sensor data of the vehicle (10); and S130 generates and stores the data analysis and processing results and / or sends the data analysis and processing results to the server (20).

2. The method (100) according to claim 1, wherein, The data analysis and processing module is associated with or generates data based on the predetermined conditions; and / or The data pattern represented by the predetermined conditions is converted into the data analysis and processing module.

3. The method (100) according to claim 1 or 2, wherein, The predetermined conditions include specific vehicle event types, specific vehicle behaviors, and specific trigger signals; and / or The data analysis and processing module includes: AI data routines and / or filters and / or rule engines and / or configuration files.

4. The method (100) according to any one of claims 1 to 3, wherein, The server (20) is configured as a vehicle-specific OTA server; and / or Receive the data analysis and processing module from the server (20) and / or send the data analysis and processing results to the server (20) via a vehicle-specific wireless communication network; and / or The data analysis and processing module is transmitted in an encrypted manner and decrypted in the vehicle.

5. The method (100) according to any one of claims 1 to 4, wherein, The method (100) is performed during the vehicle user's use; and / or The method (100) is performed inside the vehicle (10); and / or The sensor data is analyzed and processed at the full data rate of the sensors (11) of the vehicle (10); and / or The data analysis and processing results are generated, stored, and / or transmitted in compressed and / or encrypted formats.

6. The method (100) according to claim 5, wherein, The data analysis and processing results include the number of triggers, the data sequence after triggering, and other evaluation results.

7. The method (100) according to any one of claims 1 to 6, wherein, The sensor data includes powertrain sensor data, chassis and safety sensor data, body and comfort sensor data, and driver assistance or autonomous driving sensor data.

8. A vehicle (10) comprising a control device (12), wherein, The control device (12) includes a processor (121), a memory (122) and a communication interface (123) and is configured to perform the method (100) according to any one of claims 1 to 7.

9. A system (1) comprising a server (20) and a vehicle (10) according to claim 8, wherein, The vehicle (10) transmits data to the server (20) via a vehicle-specific wireless communication network.

10. A computer program product, such as a computer-readable program carrier, the computer program product including or storing computer program instructions that, when executed by a processor (121), at least assist in implementing the steps of the method (100) according to any one of claims 1 to 7.

Images