Data utilization method for a driving assistance system in a vehicle
By introducing a central console and cloud server into the driving assistance system, the driver's warning and automatic braking information is recorded and analyzed, which solves the problem of the driver's uncertainty about the triggering cause, realizes function optimization and feedback mechanism, and improves driving safety and infrastructure quality.
Patent Information
- Application Number
- CN202011610307.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-12-30
- Publication Date
- 2025-09-23
- Estimated Expiration
- 2040-12-30
AI Technical Summary
In existing driver assistance systems, drivers cannot intuitively understand the reasons for triggering warnings or automatic braking, and the trigger logs of active safety functions are not effectively analyzed and utilized, resulting in driver confusion and insufficient function optimization.
By introducing a central console into the driver assistance system, recording and sending geographic location and event information to the cloud server, establishing a trigger log of interaction with the driver, providing functional guidance, and using cloud data to optimize navigation and infrastructure.
Drivers can understand why warnings or automatic braking were triggered, and the system receives feedback to improve function guidance, reduce false triggering, optimize safety functions, and provide subsequent driving assistance and infrastructure improvements.
Smart Images

Figure CN114763147B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to a data utilization method for a driving assistance system in a vehicle and also relates to a driving assistance system for executing the data utilization method. Background Art
[0002] Advanced Driver Assistance Systems (ADAS) are electronic systems that assist drivers with driving and parking functions. Through a secure human-machine interface, ADAS improves vehicle and road safety. ADAS systems use automated technologies, such as sensors and cameras, to detect nearby obstacles or driver errors and respond accordingly.
[0003] Most traffic accidents occur due to human factors (such as incorrect operation). Driving assistance systems are developed to automatically adapt and enhance vehicle systems to achieve safer driving. It has been proven that the automation of driving assistance systems can reduce road accidents by minimizing human factors. The active safety functions of driving assistance systems are designed to avoid accidents and collisions by providing technologies that warn the driver of problems, implement protective measures, and control the vehicle when necessary. Driving assistance systems can also implement active safety functions such as automatically turning on the headlights (for example, based on the average brightness outside the car and the current time), providing adaptive cruise control to avoid collisions, incorporating satellite navigation / traffic warnings, warning the driver of obstacles around the vehicle, assisting with lane departure and lane centering, and providing navigation assistance via smartphones.
[0004] In vehicles equipped with active safety features, drivers may frequently receive warnings or experience automatic braking. Sometimes, drivers may be confused by these warnings or automatic braking, unsure of what is happening in the vehicle. Vehicle or driver assistance system user manuals typically provide only a static description of the active safety features included in the driver assistance system, but fail to establish an intuitive connection or interaction with the warnings or automatic braking experienced by the driver. Furthermore, the triggering logs of the active safety features in existing driver assistance systems are neither well analyzed nor helpful to users during subsequent driving. The triggering location of the active safety features in the driver assistance system—that is, the vehicle's geographic location—is not effectively linked to the driver assistance system. In other words, the triggering of the active safety features itself is more or less an isolated behavior. Summary of the Invention
[0005] In response to the above problems, it is necessary to develop a data utilization method that can establish an intuitive connection between the warnings received or automatic braking experienced by people related to the vehicle and the active safety functions included in the driving assistance system, and interact with the person after the person receives the warning or experiences the automatic braking to inform the person of the triggering reason of the above warning or automatic braking (i.e., functional guidance), and obtain feedback from the person for the vehicle manufacturer to conduct data mining to improve the content or expression of the above functional guidance, and use the trigger log of the active safety function to continuously optimize the active safety function. In addition, it is also expected to develop a data utilization method that can use cloud data related to the trigger log of the active safety function to provide assistance to the person in the subsequent driving process, such as warning the person when navigating that the active safety function is easily triggered on a specific road. In addition, it is also expected to develop a driving assistance system that can use cloud data for access by road management departments and thereby improve infrastructure construction.
[0006] Thus, the present application discloses a data utilization method for a driving assistance system in a vehicle, wherein the driving assistance system includes: an active safety module; a positioning module configured to obtain geographic location information of the vehicle; a central console connected to the active safety module and the positioning module via a data interface and wirelessly connected to a cloud server disposed outside the vehicle, wherein the central console is configured to obtain event information related to function triggering of the active safety module and send the geographic location information and the event information to the cloud server, wherein the central console includes: a media storage for storing function guidance of the active safety module; a recording module for storing the event information; a display module, It is used to replay the event information and the function guidance; and a feedback module, which is used to obtain feedback on the function guidance and store the feedback in the recording module for data mining, and is characterized in that the data utilization method includes the following steps: recording the geographic location information of the vehicle when the function of the active safety module is triggered and generating event information corresponding to the triggered function; sending the geographic location information and the event information to the cloud server, wherein the geographic location information and the event information are suitable for being classified on the cloud server; notifying the event information to personnel related to the vehicle; replaying the event information and the function guidance and interacting with the personnel during the playback process; and obtaining feedback from the personnel.
[0007] According to an optional embodiment, the geographic location information and the event information are suitable for optimizing navigation services and / or improving infrastructure construction; and the geographic location information and the event information are suitable for being stored in an active safety database for retrieval to improve the active safety module and thereby reduce the frequency of false triggering of the functions of the active safety module.
[0008] According to an optional embodiment, the data utilization method includes the following steps: playing back the event information according to the needs of the personnel; the personnel include the driver of the vehicle; and sending the feedback to the cloud server; the feedback is suitable for being classified in the cloud server.
[0009] According to an optional embodiment, the step of notifying the person that the event information has been generated is only performed when the vehicle is in park.
[0010] According to an optional embodiment, the step of notifying the person that the event information has been generated includes: displaying a notification on the display module, and obtaining feedback from the person on the notification.
[0011] According to an optional embodiment, the step of playing back the event information according to the needs of the personnel includes: if the personnel chooses to play back the event information immediately, the event information is played back on the central console; and if the personnel chooses to play back the event information later, the event information is sent to a mobile smart device wirelessly connected to the driving assistance system for the personnel to view later.
[0012] According to an optional embodiment, the step of obtaining feedback from the personnel regarding the event information includes: obtaining the personnel's score for the functional guidance, and if the score is lower than a threshold, generating a correction mark to perform data mining during vehicle maintenance to improve the content or presentation of the functional guidance.
[0013] According to an optional embodiment, the event information includes: video images of the event information, motion data of the vehicle, and functional data of the active safety module; the motion data includes: the speed of the vehicle, the steering wheel angle of the vehicle, the steering angle of the vehicle, the brake pedal status of the vehicle, and the accelerator pedal status of the vehicle; and the functional data includes: the sensitivity level of the active safety module, the triggering time of the event, and the type of object that triggers the function of the active safety module.
[0014] According to an optional embodiment, the data utilization method includes the following steps: with the help of a data processing device connected to the driving assistance system by wire or wirelessly, generating a computer-generated image corresponding to the event information after recording the event information, wherein the computer-generated image includes the complete triggering process of the function of the active safety module and the object that triggers the function of the active safety module presented in a visual manner.
[0015] The present application also discloses a driving assistance system, which is arranged in a vehicle and includes: an active safety module; a positioning module, which is configured to obtain geographic location information of the vehicle; a central console, which is connected to the active safety module and the positioning module via a data interface and is wirelessly connected to a cloud server arranged outside the vehicle, wherein the central console is configured to obtain event information related to the function triggering of the active safety module and send the geographic location information and the event information to the cloud server, wherein the central console includes: a media storage, which is used to store the function guidance of the active safety module; a recording module, which is used to store the event information; a display module, which is used to play back the event information and the function guidance; and a feedback module, which is used to obtain feedback on the function guidance and store the feedback in the recording module for data mining, characterized in that the driving assistance system is configured to execute the above-mentioned data utilization method.
[0016] By means of the data utilization method of the present application and the driving assistance system for executing the data utilization method, warnings received or automatic braking experienced by personnel associated with the vehicle can establish an intuitive connection with the active safety functions included in the driving assistance system. After receiving a warning or experiencing automatic braking, the personnel can learn the triggering cause of the above-mentioned warning or automatic braking and obtain functional guidance. The driving assistance system can obtain feedback from the personnel for vehicle manufacturers to conduct data mining to improve the content or presentation of the above-mentioned functional guidance. The trigger log of the active safety function can be effectively utilized to continuously optimize the active safety function, and the cloud data related to the trigger log of the active safety function can be effectively utilized to provide assistance to the personnel in the subsequent driving process, and the road management department can access the cloud data related to the trigger log of the active safety function to improve infrastructure construction. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Embodiments of the present application will now be described in further detail with reference to the accompanying drawings, in which:
[0018] Figure 1 is a schematic diagram of a driving assistance system according to the present application;
[0019] Figure 2 is a flow chart of the data utilization method according to the present application; and
[0020] Figure 3 yes Figure 2 A flowchart of another embodiment of a data utilization method. DETAILED DESCRIPTION
[0021] The embodiments of the present invention described herein are defined as driver assistance systems and methods for utilizing data in driver assistance systems, which can be put into practice in the embodiments described below. However, these embodiments can be exemplified and implemented in many different forms and are not limited to the embodiments set forth herein. The present invention, this application, is not limited to the disclosed embodiments. Rather, these illustrative examples of the embodiments are provided so that this application will be thorough and complete.
[0022] Other objects and features will become apparent from the following detailed description considered in conjunction with the accompanying drawings. However, it should be understood that the drawings are designed for illustrative purposes only and are not intended to limit the embodiments disclosed herein. Furthermore, the drawings are not necessarily drawn to scale and, unless otherwise indicated, are intended only to conceptually illustrate the processes and structures described herein.
[0023] Figure 1 : is a schematic diagram of a driving assistance system according to the present application. The driving assistance system 1 is arranged in a vehicle (not shown). The driving assistance system 1 includes an active safety module 2, a central console 3 and a positioning module 5 arranged in the vehicle. The functions of the active safety module 2 include front collision warning, rear collision warning, brake lock warning, lane keeping warning and crossing warning, etc. The positioning module 5 can obtain the vehicle's geographic location information by means of a global positioning system (GPS), GLONASS, Galileo, Beidou navigation system or any other positioning system, or a combination of multiple different positioning systems. The central console 3 is connected to the active safety module 2 and the positioning module 5 via a data interface 6, and can include a media storage 31, a recording module 32, a display module 33, a feedback module 34 and a transmission module 35. The data interface 6 can include a CAN bus or a Flexray bus.
[0024] The CAN bus typically uses the CSMA / CA (Carrier Sense Multiple Access with Collision Avoidance) mechanism. Each node continuously monitors the bus and transmits data when the bus is idle. When multiple nodes transmit data simultaneously, each node first transmits its data ID. A lower ID indicates a higher priority, and a higher-priority ID overrides a lower-priority ID. A node automatically stops transmitting when its transmitted ID is overwritten. The highest-priority message begins transmission after the corresponding node obtains bus access. The disadvantage of this mechanism is the time delay: lower-priority packets require a longer wait before being sent. The CAN bus typically has a linear structure, with all nodes connected in parallel. If one node fails, the others continue to function normally. However, a short circuit at any point on the bus can disable the entire bus.
[0025] The Flexray bus utilizes both TDMA (Time Division Multiple Access) and FTDMA (Flexible Time Division Multiple Access) mechanisms. A Flexray bus communication cycle is divided into a static portion, a dynamic portion, and network idle time. The static portion uses the TDMA mechanism, evenly allocating time slots among all nodes. Each node can send messages only during its own time slot. Even if a node currently has no messages to send, that time slot remains reserved. The dynamic portion uses the FTDMA mechanism, polling each node in turn and skipping nodes if they have no messages to send. The static portion is used to transmit high-importance data that needs to be sent frequently, while the dynamic portion is used to transmit relatively unimportant data with uncertain frequency. Flexray offers a variety of topologies, including linear structures like the CAN bus or star structures. The central node is responsible for forwarding information. If a node other than the central node fails or a line fault occurs, the central node can disconnect from that node. However, if the central node fails, the entire bus becomes inoperative. Multiple central nodes in a star bus can be connected.
[0026] The media storage 31 is configured to store functional instructions for the active safety module 2. The recording module 32 is configured to store event information. The event information may include video images of the event, vehicle motion data, and functional data for the active safety module 2. The motion data may include the vehicle's speed, steering wheel angle, steering angle, brake pedal status, and accelerator pedal status. Functional data may include the sensitivity level of the active safety module 2, the triggering time of the event, and the type of object that triggered the function of the active safety module 2. The media storage 31 and the recording module 32 may include computer-readable media. The computer-readable media may include suitable memory devices such as EPROM (Erasable Programmable Programmable ROM), flash memory, EEPROM (Electrically Erasable Programmable ROM), and hard disk units. The display module 33 is configured to notify personnel associated with the vehicle and playback event information and functional instructions. It may include a display embedded in the vehicle dashboard or a heads-up display (HUD). Personnel associated with the vehicle may include the vehicle driver, the vehicle owner, and the vehicle manager. Notifications may be sent to the vehicle driver via the display module 33 or, for example, to the vehicle owner and the vehicle manager via a mobile network in the form of a short message. The feedback module 34 includes an input device such as a keyboard and a touchpad for obtaining the person's feedback on the event information. The transmission module 35 is configured to transmit the feedback, geographic location information, and event information to a cloud server 4 disposed outside the vehicle.
[0027] In the case where the cloud server 4 is located outside the vehicle, the wireless connection between the cloud server 4 and the driving assistance system 1 can be made according to any IEEE standard for wireless in-vehicle communication, such as a special operating mode of IEEE 802.11 for in-vehicle networks called Wireless Access in Vehicular Environments (WAVE). IEEE 802.11p is an extension of the 802.11 wireless LAN medium access layer (MAC) and physical layer (PHY) specifications. The wireless communication interface can include wireless communication technologies such as Wi-Fi, Ethernet, wireless local area network (WLAN), 3GPP LTE, and LTE-Advanced via a wireless communication network.
[0028] Figure 2 Flowchart of the data utilization method according to the present application. The data utilization method comprises the following steps:
[0029] 101: When a function of the active safety module 2 is triggered, the geographic location information of the vehicle is recorded and event information corresponding to the triggered function is generated, wherein the geographic location of the vehicle is obtained by means of the positioning module 5;
[0030] 103: Sending geographic location information and event information to the cloud server 4; and
[0031] 104: Classify the received information in the cloud server 4.
[0032] After the received geographic location information and event information have been categorized, the data utilization method further includes the following steps:
[0033] 105: Providing the classified geographic location information and event information to the navigation service provider to optimize the navigation service, thereby effectively utilizing the cloud data related to the triggering log of the active safety function to provide assistance to people related to the vehicle during subsequent driving;
[0034] 106: Providing classified geographic location information and event information to road management departments, so that road management departments can access cloud data related to the triggering logs of active safety functions to improve infrastructure construction; and
[0035] 107: The classified geographic location information and event information are stored in the active safety database for the vehicle manufacturer to use, so as to improve the active safety module 2 and reduce the frequency of false triggering of the functions of the active safety module 2. In this way, the triggering log of the active safety function can be effectively utilized to continuously optimize the active safety function.
[0036] Figure 3 yes Figure 2 A partial flow chart of another embodiment of the data utilization method. Figure 3In another embodiment of the data utilization method shown, after step 101 of recording the geographic location information of the vehicle and generating event information corresponding to the triggered function, the data utilization method further includes the following steps:
[0037] 111: After recording an event, a computer-generated image corresponding to the event is generated by means of a data processing device 7 connected to the driving assistance system 1 by wire or wirelessly. The computer-generated image includes a complete triggering process of the function of the active safety module 2 and an object that triggers the function of the active safety module 2 in a visual manner. The object may be a pedestrian, an animal, another vehicle, a building, etc.;
[0038] 102: Notify the personnel related to the vehicle that the event information has been generated;
[0039] 108: Play back event information according to the personnel's needs;
[0040] 109: Get the person's feedback on the event information;
[0041] 110: Sending feedback to the cloud server 4; and
[0042] 104: Classify the received information in the cloud server 4.
[0043] Optionally, the person associated with the vehicle includes the driver of the vehicle, and step 102 of notifying the person that event information has been generated is performed only when it is detected that the vehicle is in the parking gear (P). This is done to avoid sending a notification to the driver while the vehicle is driving and distracting the driver.
[0044] Step 108 of replaying the event information according to the person's request may include first displaying a notification on the display module 33 indicating that the active safety module 2 function has been triggered and the event information has been recorded, and then waiting for the person's feedback. If the person chooses to replay the event information immediately, the event information is replayed on the display module 33. If the person chooses to replay the event information later, the event information is sent to a mobile smart device wirelessly connected to the driving assistance system 1 for the person to view later.
[0045] Step 109 of obtaining feedback from the driver includes obtaining the driver's rating of the functional guidance. If the rating falls below a threshold, a correction flag is generated to notify the vehicle manufacturer during vehicle maintenance to conduct data mining to improve the content or presentation of the functional guidance. This allows the manufacturer to utilize big data algorithms to tailor the content or presentation of the functional guidance, drawing on the ratings of a large number of different drivers, to more closely reflect the driver's actual driving experience.
[0046] The data processing device 7 may be located in or outside the vehicle and may store software for generating computer-generated images corresponding to the recorded event. The data processing device 7 may be included in a single ASIC (Application Specific Integrated Circuit), or several processors and various digital hardware may be distributed across several separate components, either individually packaged or assembled into an SoC (System on a Chip).
[0047] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items. Furthermore, the terms "comprises" and "comprising" specify the presence of the recited features, actions, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, actions, integers, steps, operations, elements, components, and / or combinations thereof. The fact that certain measures are recited in mutually different dependent claims does not mean that a combination of these measures cannot be used to advantage.
Claims
1. A method for utilizing data of a driving assistance system (1) in a vehicle, the driving assistance system (1) comprising: Active safety module (2); A positioning module (5) configured to obtain geographic location information of the vehicle; A central console (3) is connected to the active safety module (2) and the positioning module (5) via a data interface (6) and is wirelessly connected to a cloud server (4) arranged outside the vehicle, wherein the central console (3) is configured to obtain event information related to the function triggering of the active safety module (2) and send the geographic location information and the event information to the cloud server (4), and interact with personnel related to the vehicle after the function of the active safety module (2) is triggered, wherein the interaction includes replaying the event information and functional guidance intended to inform the personnel why the function is triggered and how it works, wherein the central console (3) includes: a media storage (31) for storing the functional guidance of the active safety module (2) intended to inform personnel related to the vehicle why the active safety function is triggered and how it works; a recording module (32) for storing the event information; a display module (33) for replaying the event information and the functional guidance; and a feedback module (34) for obtaining feedback from the personnel in the form of a score on the functional guidance and storing the feedback in the recording module (32) for data mining to improve the function content or expression mode capable of guidance; and a transmission module (35) configured to transmit the feedback, the geographic location information and the event information to the cloud server (4), wherein the data utilization method comprises the following steps: recording the geographic location information of the vehicle when the function of the active safety module (2) is triggered and generating event information corresponding to the triggered function; sending the geographic location information and the event information to the cloud server (4), wherein the geographic location information and the event information are suitable for being classified in the cloud server (4); after the function of the active safety module (2) is triggered, interacting with the person, wherein the interaction includes replaying the event information and the function guidance intended to inform the person why the function is triggered and how it works; and obtaining feedback from the person in the form of a score on the function guidance, and generating a correction mark when the score is lower than a preset threshold, and sending the feedback and the correction mark to the cloud server (4), wherein the feedback and the correction mark are suitable for being classified in the cloud server (4) for performing data mining on the cloud server (4) to improve the content or expression mode of the function guidance.
2. The data utilization method according to claim 1, wherein: The geographic location information and the event information are suitable for optimizing navigation services and / or improving infrastructure construction; and the geographic location information and the event information are suitable for being stored in an active safety database for retrieval, so as to improve the active safety module (2) and thereby reduce the frequency of false triggering of the functions of the active safety module (2).
3. The data utilization method according to claim 1 or 2, wherein: The data utilization method includes the following steps: playing back the event information according to the needs of the personnel; the personnel include the driver of the vehicle.
4. The data utilization method according to claim 3, wherein: The step of notifying the person that the event information has been generated is performed only when the vehicle is in park (P).
5. The data utilization method according to claim 3, wherein: The step of notifying the personnel that the event information has been generated includes: displaying a notification on the display module (33), and obtaining feedback from the personnel on the notification.
6. The data utilization method according to claim 3, wherein: The step of replaying the event information according to the needs of the personnel includes: if the personnel chooses to replay the event information immediately, the event information is replayed on the central console (3); and if the personnel chooses to replay the event information later, the event information is sent to a mobile smart device wirelessly connected to the driving assistance system (1) for the personnel to view later.
7. The data utilization method according to claim 1 or 2, wherein: The event information includes: a video image of the event information, motion data of the vehicle, and functional data of the active safety module (2); the motion data includes: the speed of the vehicle, the steering wheel angle of the vehicle, the steering angle of the vehicle, the brake pedal status of the vehicle, and the accelerator pedal status of the vehicle; and the functional data includes: the sensitivity level of the active safety module (2), the triggering time of the event, and the type of object that triggers the function of the active safety module (2).
8. The data utilization method according to claim 1 or 2, wherein: The data utilization method comprises the following steps: after recording the event information, a computer-generated image corresponding to the event information is generated by means of a data processing device (7) connected to the driving assistance system (1) by wire or wirelessly, wherein the computer-generated image includes a complete triggering process of the function of the active safety module (2) and an object that triggers the function of the active safety module (2) presented in a visual manner.
9. A driving assistance system (1), arranged in a vehicle and comprising: An active safety module (2), a positioning module (5) configured to obtain geographic location information of the vehicle, a central console (3) connected to the active safety module (2) and the positioning module (5) via a data interface (6) and wirelessly connected to a cloud server (4) arranged outside the vehicle, wherein the central console (3) is configured to obtain event information related to function triggering of the active safety module (2) and transmit the geographic location information and the event information to the cloud server (4), wherein the central console (3) comprises: a media storage (31) for storing function guidance of the active safety module (2); a recording module (32) for storing the event information; a display module (33) for replaying the event information and the function guidance; a feedback module (34) for obtaining feedback of the function guidance and storing the feedback in the recording module (32) for data mining; and a transmission module (35) configured to transmit the feedback, the geographic location information and the event information to the cloud server (4), characterized in that the driving assistance system (1) is configured to perform the data utilization method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Vehicle motion state determining method and device, storage medium and vehicle
CN110562262A
Systems and Methods to Adjust Autonomous Vehicle Parameters in Response to Passenger Feedback
US20190047584A1