System and method for running vehicle functions
The system addresses user dissatisfaction with vehicle functions by detecting negative behavior and issuing targeted software updates, enhancing safety and satisfaction by optimizing vehicle functions based on real-time user feedback without compromising data privacy.
Patent Information
- Application Number
- PCT/EP2024/063793
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-25
- Filing Date
- 2024-05-17
- Publication Date
- 2024-11-28
AI Technical Summary
Modern vehicles' driving assistance functions are often deactivated by users due to personal preferences or situational factors, leading to potential safety risks in road traffic, as these functions are not universally adapted and can be overridden or deactivated, indicating user dissatisfaction.
A system that includes a driver monitoring module to detect negative driver behavior, a functional module to match software updates with detected issues, and a user interface module to notify users about updates that address their concerns, encouraging reactivation of vehicle functions without sharing sensitive data externally.
The system enhances user satisfaction and safety by optimizing vehicle functions based on real-time user feedback, ensuring that software updates address specific issues, thereby reducing deactivation of safety-enhancing features and improving the overall driving experience.
Smart Images

Figure EP2024063793_28112024_PF_FP_ABST
Abstract
Description
[0001] System and method for operating vehicle functions
[0002] The present disclosure relates to a system for operating vehicle functions, a vehicle having such a system, and a method for operating vehicle functions. In particular, the present disclosure relates to improving vehicle functions based on feedback and taking data protection requirements into account.
[0003] State of the art
[0004] Modern vehicles today feature a large number of vehicle functions designed to assist users in driving, for example, or to create a pleasant environment or driving experience. However, such vehicle functions are not adapted to all situations, countries, personal preferences, and user behavior. Therefore, it is often possible for the user to deactivate certain vehicle functions via a menu. However, deactivating driver assistance functions, for example, can have a negative impact on road safety, as driver assistance functions often offer greater safety than purely manual driving.
[0005] Disclosure of the invention
[0006] It is an object of the present disclosure to provide a system for operating vehicle functions, a vehicle with such a system, and a method for operating vehicle functions that enable vehicle functions to be improved in order to encourage a user to use the vehicle functions. In particular, it is an object of the present disclosure to provide a user with no further reason to deactivate vehicle functions, thus increasing road safety.
[0007] This object is achieved by the subject matter of the independent claims. Advantageous embodiments are specified in the subclaims.
[0008] According to an independent aspect of the present disclosure, a system for operating vehicle functions is provided. The system comprises a driver monitoring module configured to detect negative driver behavior related to a vehicle function; a function module configured to receive a software update for the vehicle function, wherein the software update includes change information related to changes in the vehicle function, wherein the function module is further configured to compare the change information with the detected negative driver behavior; and a user interface module configured to output at least one user notification related to the software update if the comparison reveals that the software update affects functionalities of the vehicle function that are related to the negative driver behavior.
[0009] According to the invention, negative driver behavior related to a vehicle function is detected without the driver's active involvement. This information can then be transmitted, for example, anonymously to a central unit so that developers of the vehicle function can take it into account when creating a software update. If a software update for the vehicle function is then installed in the vehicle, the vehicle checks whether the software update addresses the negative driver behavior or eliminates its causes. If this is the case, a corresponding user notification is issued to the user to prompt them to reactivate the vehicle function.The software update is tested for negative driver behavior in the vehicle, so that no data relevant to data protection, such as the user's identity and / or the vehicle's VIN, needs to be sent externally, for example to the developers.
[0010] Negative driver behavior preferably involves overriding the vehicle's function. In particular, some vehicle functions can be overridden by the driver, such as cruise control by pressing the accelerator pedal or lane departure warning by applying a steering torque. The frequency or number of overrides can be an indicator of the user's satisfaction with the vehicle's function.
[0011] Preferably, the negative driver behavior involves deactivating the vehicle function. In particular, some vehicle functions can be deactivated by the driver, for example, in a corresponding menu. The deactivation itself, and in particular the frequency or number of deactivation processes, can be an indication of how satisfied the user is with the vehicle function.
[0012] In some embodiments, the deactivation of the vehicle function can occur directly in the vehicle. In other embodiments, an app can be installed on a user's mobile device that enables activation and deactivation of vehicle functions. The mobile device can be connected to the vehicle, for example, via Bluetooth or another near-field technology to implement the functionalities of the embodiments of the present disclosure.
[0013] The term mobile device includes in particular smartphones, but also other mobile telephones or cell phones, personal digital assistants (PDAs), tablet PCs and all current and future electronic devices that are equipped with technology for loading and running apps.
[0014] Preferably, the negative driver behavior concerns the driver's gestures, facial expressions, and / or speech. The driver's gestures, facial expressions, and / or speech can be an indicator of the user's satisfaction with the vehicle's functionality.
[0015] Preferably, the driver monitoring module comprises at least one sensor configured to detect the driver and provide detection data. The at least one sensor may comprise at least one optical sensor and / or at least one acoustic sensor.
[0016] The at least one optical sensor can be, for example, a camera, in particular an interior camera. Optionally, the driver monitoring module can include at least one light source. In some embodiments, the light source can be an infrared light source, and the at least one optical sensor can be an infrared sensor, such as an infrared camera.
[0017] The at least one acoustic sensor can be a microphone, in particular an interior microphone.
[0018] The driver monitoring module is configured to evaluate the detection data provided by the at least one sensor, such as image data and / or audio data. By evaluating the detection data, negative driver behavior with regard to vehicle function can be detected and thus the driver's satisfaction with the vehicle function can be determined.
[0019] Preferably, the system, in particular the driver monitoring module or the function module, is configured to determine a degree of driver satisfaction with the vehicle function based on detected driver behavior. The degree of satisfaction can be determined, for example, based on a number (e.g., number of overvotes or deactivations) and / or a type (e.g., aggressive behavior) and / or a severity (e.g., excessive swearing) of the driver behavior. In some embodiments, a scale for the degree of satisfaction can be defined, for example, in the range between 0 and 10, where 10 indicates the highest and 0 the lowest satisfaction. In another embodiment, a classification can be made into a predetermined number of classes, such as "satisfied," "neutral," and "dissatisfied."
[0020] Preferably, the system further comprises a communications module configured to send information relating to the negative driver behavior to a central unit. The information may, for example, include or be the previously explained satisfaction measure.
[0021] The communication module can be configured for communication via a mobile network. In particular, communication between the communication module and the central unit can take place via the mobile network, such as an LTE network or 5G network.
[0022] In some embodiments, the central unit is a server or backend, for example, of a vehicle manufacturer. The central unit can provide the received information regarding negative driver behavior in an anonymized form, for example, to developers of the vehicle function so that the developers can consider this information when creating the software update for the vehicle function.
[0023] Preferably, the system further comprises a memory module configured to store vehicle-related data, wherein the communication module is further configured to send at least some of the vehicle-related data to the central unit. The vehicle-related data can relate to an operation of the vehicle and / or an operation of the vehicle function and / or a vehicle environment. The vehicle-related data can make it possible to reconstruct a driving situation at the time of the negative driver behavior. This makes it easier to derive solutions to prevent driver dissatisfaction with the vehicle function, e.g., in similar driving situations in the future.
[0024] In some embodiments, the communication module may be further configured to send at least a portion of the vehicle-related data from a predetermined period of time (e.g., x seconds or y minutes) around a time of the negative driver behavior of the vehicle function to the central unit.
[0025] In some embodiments, the memory module comprises or is a circular buffer.
[0026] Alternatively, the memory module can be connected to the ring buffer and receive and store the vehicle-related data from the predetermined period (e.g., x seconds or y minutes) around the time of the negative driver behavior. This can prevent relevant data from becoming unavailable later because it has been overwritten in the ring buffer over time.
[0027] The user interface module is configured to output at least one user notification regarding the software update if the comparison reveals that the software update affects functionalities of the vehicle function that are related to the negative driver behavior. The user interface module may comprise at least one output device and at least one input device. The user interface module may, for example, be a central information output and information input device of an infotainment system, such as a head unit or a pillar-to-pillar display. The user interface module is preferably permanently installed in the vehicle.
[0028] The at least one output device may comprise at least one display device and / or at least one loudspeaker. The at least one display device may comprise a display, in particular an LCD display, a plasma display, or an OLED display. Additionally or alternatively, the at least one display device may comprise a projection device configured to project information directly into the driver's field of vision, in particular onto a windshield.
[0029] The at least one input device may comprise a touch-sensitive input device, such as a touch pad, and / or a tactile input device, such as a switch (e.g. push switch and / or rotary switch) or other mechanically actuatable key elements.
[0030] Preferably, the user interface module comprises, or is, a touchscreen providing the at least one output device and the at least one input device.
[0031] Preferably, the vehicle function comprises a driver assistance function and / or a comfort function of the vehicle.
[0032] Examples of driver assistance functions include, but are not limited to, driver assistance functions for automated driving. Examples of comfort functions include, but are not limited to, interior lighting, an entertainment system, and automatic opening of vehicle doors and / or windows, for example.
[0033] In this document, the term "automated driving" refers to driving with automated longitudinal and / or lateral guidance. Automated driving can, for example, involve extended driving on the highway or limited-time driving while parking. The term "automated driving" encompasses automated driving with any degree of automation. Examples of levels of automation include assisted, partially automated, conditionally automated, highly automated, and fully automated driving (each with an increasing degree of automation). The five levels of automation mentioned above correspond to SAE Levels 1 to 5 of the SAE J3016 standard (SAE - Society of Automotive Engineering) as of April 30, 2021.
[0034] In assisted driving (SAE Level 1), the system provides longitudinal or lateral guidance in specific driving situations. In partially automated driving (SAE Level 2), the system assumes longitudinal and lateral guidance in specific driving situations, although the driver must continuously monitor the system, as with assisted driving. In conditionally automated driving (SAE Level 3), the system assumes longitudinal and lateral guidance in specific driving situations without the driver having to continuously monitor the system; however, the driver must be able to take over vehicle control within a certain time period when requested by the system. In highly automated driving (SAE Level 4), the system assumes vehicle control in specific driving situations even if the driver does not respond to a request to intervene, thus eliminating the driver as a fallback.In fully automated driving (SAE Level 5), the system can perform all aspects of the dynamic driving task under any road and environmental conditions that can also be mastered by a human driver.
[0035] Furthermore, the term "at least partially automated driving or maneuvering" is also understood in this document to include partially automated, conditionally automated, highly automated, and fully automated driving. In other words, the term "at least partially automated driving" refers to a level of automation up to and including SAE Level 2.
[0036] Preferably, the driver assistance function is an active lane change assistant configured for automated lateral and, optionally, automated longitudinal guidance of the vehicle. In some embodiments, the vehicle includes an actuating element for a turn signal, which can be configured to automatically perform the lane change when actuated or triggered by the driver. The actuating element can be a turn signal lever and have a multiple function, namely activating the turn signal and triggering the automatic overtaking maneuver.
[0037] According to a further independent aspect of the present disclosure, a vehicle, in particular a motor vehicle, is specified. The vehicle comprises the system for operating vehicle functions according to the embodiments of the present disclosure.
[0038] The term "vehicle" includes cars, trucks, buses, mobile homes, motorcycles, etc., used to transport people, goods, etc. In particular, the term includes motor vehicles used to transport people.
[0039] According to a further independent aspect of the present disclosure, a method for operating vehicle functions is provided. The method comprises monitoring a driver by a driver monitoring module to detect negative driver behavior related to a vehicle function; receiving, by a function module, a software update for the vehicle function, wherein the software update includes change information related to changes in the vehicle function; comparing, by the function module, the change information with the detected negative driver behavior; and outputting, by a user interface module, at least one user notification related to the software update if the comparison reveals that the software update affects functionalities of the vehicle function that are related to the negative driver behavior.
[0040] The method may implement the aspects of the system described in this document for operating vehicle functions.
[0041] According to a further independent aspect of the present disclosure, a software (SW) program is specified. The SW program can be configured to be executed on one or more processors and thereby to carry out the method described in this document for operating vehicle functions. According to a further independent aspect of the present disclosure, a storage medium is specified. The storage medium can comprise a SW program configured to be executed on one or more processors and thereby to carry out the method described in this document for operating vehicle functions.
[0042] According to a further independent aspect of the present disclosure, software with program code is provided. The software is configured to carry out the method for operating vehicle functions when the software runs on one or more software-controlled devices.
[0043] According to another independent aspect of the present disclosure, a system for operating vehicle functions is provided. The system includes one or more processors; and at least one memory connected to the one or more processors and containing instructions executable by the one or more processors to perform the method for operating vehicle functions described herein.
[0044] A processor or processor module is a programmable computing unit, i.e. a machine or an electronic circuit that controls other elements according to given instructions and thereby drives an algorithm (process).
[0045] Short description of the drawings
[0046] Embodiments of the disclosure are illustrated in the figures and are described in more detail below. They show:
[0047] Figure 1 schematically shows a system for operating vehicle functions according to embodiments of the present disclosure, Figure 2 schematically shows an output of a user notification relating to a software update according to embodiments of the present disclosure, and
[0048] Figure 3 is a flowchart of a method for operating vehicle functions according to embodiments of the present disclosure.
[0049] Embodiments of the disclosure
[0050] In the following, unless otherwise stated, the same reference symbols are used for identical and equivalent elements.
[0051] Figure 1 schematically shows a system 100 for operating vehicle functions according to embodiments of the present disclosure.
[0052] The system 100 comprises a driver monitoring module 110 configured to detect negative driver behavior related to a vehicle function; a function module 120 configured to receive a software update for the vehicle function, wherein the software update includes change information related to changes in the vehicle function, wherein the function module 120 is further configured to compare the change information with the detected negative driver behavior; and a user interface module 130 configured to output at least one user notification related to the software update if the comparison reveals that the software update affects functionalities of the vehicle function that are related to the negative driver behavior.
[0053] This allows System 100 to be continuously optimized based on real-world complaints. The user is part of the development and has a positive experience with the optimized System 100.
[0054] Preferably, the negative driver behavior involves overriding the vehicle function.
[0055] In particular, some vehicle functions can be overridden by the driver, such as cruise control by pressing the accelerator pedal or lane keeping assist by applying a steering torque. The frequency or number of overrides can be an indication of the user's satisfaction with the vehicle function.
[0056] Additionally or alternatively, negative driver behavior involves deactivating vehicle functions. In particular, some vehicle functions can be deactivated by the driver, for example, via a corresponding menu. The deactivation itself, and in particular the frequency or number of deactivation processes, can be an indication of the user's satisfaction with the vehicle function.
[0057] Additionally or alternatively, negative driver behavior may involve the driver's gestures, facial expressions, and / or speech. The driver's gestures, facial expressions, and / or speech can be an indicator of the user's satisfaction with the vehicle's functionality.
[0058] In some embodiments, the driver monitoring module 110 comprises at least one sensor configured to detect the driver and provide detection data. The at least one sensor may comprise at least one optical sensor and / or at least one acoustic sensor. The driver monitoring module 110 is configured to evaluate the detection data provided by the at least one sensor, such as image data and / or audio data. By evaluating the detection data, negative driver behavior with respect to the vehicle function can be detected, and thus the driver's satisfaction with the vehicle function can be determined.
[0059] Preferably, the system 100, in particular the driver monitoring module 110 or the function module 120, is configured to determine a degree of driver satisfaction with the vehicle function based on detected driver behavior. The degree of satisfaction can be determined, for example, based on a number (e.g., number of overvotes or deactivations) and / or a type (e.g., aggressive behavior) and / or a severity (e.g., excessive swearing) of the driver behavior. In some embodiments, a scale for the degree of satisfaction can be defined, for example, in the range between 0 and 10, where 10 indicates the highest and 0 the lowest satisfaction. In another embodiment, a classification can be made into a predetermined number of classes, such as "satisfied," "neutral," and "dissatisfied."Processing / clustering of the determined satisfaction measures of the respective vehicle function and the associated vehicle and environmental data can be carried out online or offline.
[0060] In some embodiments, system 100 further includes a communication module 140 configured to send information related to the negative driver behavior to a central unit 20. The information may, for example, include or be the previously discussed satisfaction measure.
[0061] The communication module 140 can be configured for communication via a mobile network. In particular, the communication between the communication module 140 and the central unit 20 can take place via the mobile network, such as an LTE network or 5G network.
[0062] In some embodiments, the central unit 20 is a server or backend, for example, of a vehicle manufacturer. The central unit 20 can provide the received information regarding the negative driver behavior in an anonymized form, for example, to developers of the vehicle function (EW) so that the developers can consider this information when creating the software update for the vehicle function.
[0063] The central unit 20 can also be configured to transmit the software update to the vehicle 10. This can be done, for example, via the mobile network, such as an LTE network or 5G network.
[0064] Preferably, the system 100 further comprises a memory module 150 configured to store vehicle-related data, wherein the communication module 140 is further configured to send at least some of the vehicle-related data to the central unit 20, in particular together with the satisfaction measure. The vehicle-related data can relate to an operation of the vehicle 10 and / or an operation of the vehicle function and / or a vehicle environment. The vehicle-related data can make it possible to reconstruct a driving situation at the time of the negative driver behavior. This makes it easier to derive solutions to prevent driver dissatisfaction with the vehicle function, for example, in similar driving situations in the future.
[0065] In some embodiments, the communication module 140 may be further configured to send at least a portion of the vehicle-related data from a predetermined period of time (e.g., x seconds or y minutes) around a time of the negative driver behavior of the vehicle function to the central unit 20.
[0066] In some embodiments, the memory module 150 comprises, or is, a ring buffer. Alternatively, the memory module 150 can be connected to the ring buffer and receive and store the vehicle-related data from the predetermined period (e.g., x seconds or y minutes) around the time of the negative driver behavior. This can prevent relevant data from becoming unavailable later because it has been overwritten in the ring buffer after some time.
[0067] Figure 2 schematically shows the output of a user notification regarding a software update according to embodiments of the present disclosure. The user notification can be output acoustically and / or visually. The example in Figure 2 shows a user interface module that outputs the user notification visually on a display 200 thereof.
[0068] The user interface module is configured to output at least one user notification regarding the software update if the comparison reveals that the software update affects functionalities of the vehicle function that are associated with the negative driver behavior. For example, a software update may be available via remote software upgrade that contains optimizations for function "Y" that the user has negatively rated. In a suitable environment (e.g., while driving on an empty highway with good weather and little strain on the driver), the user notification about the improved function may be communicated. In some embodiments, it may be possible for the user to directly reactivate the optimized function "Y" by voice, button, or other input option, as shown in the example in Figure 2.
[0069] Figure 3 shows a flowchart of a method 300 for operating vehicle functions according to embodiments of the present disclosure. Method 300 may be implemented by appropriate software executable by one or more processors (e.g., a CPU).
[0070] The method 300 comprises, in block 310, monitoring a driver by a driver monitoring module in order to detect negative driver behavior related to a vehicle function; in block 320, receiving, by a function module, a software update for the vehicle function, wherein the software update includes change information related to changes in the vehicle function; in block 330, comparing, by the function module, the change information with the detected negative driver behavior; and in block 340, outputting, by a user interface module, at least one user indication related to the software update if the comparison reveals that the software update concerns functionalities of the vehicle function that are related to the negative driver behavior.
[0071] In one example, the driver may be driving with longitudinal guidance activated, and the vehicle is braked for a very long time when a vehicle in front turns at a traffic light, even though the driver would already be accelerating again in this situation. In this situation, the driver can press the accelerator pedal and thus override the assistance system. The driver can also display a grim look and verbally comment on / criticize the inadequate system behavior. Overriding this, for example several times over time, is recognized as negative driver behavior, and facial expressions, gestures, and speech can also be evaluated. If the driver displays a grim look and swears, it can be inferred that there is greater dissatisfaction, and the satisfaction level for this function and driving situation can be assigned a corresponding value.Technical development now has access to the collected data and provides a software update that addresses the driver's dissatisfaction.
[0072] According to the invention, negative driver behavior related to a vehicle function is detected without the driver's active involvement. This information can then be transmitted, for example, anonymously to a central unit so that developers of the vehicle function can take it into account when creating a software update. If a software update for the vehicle function is then installed in the vehicle, the vehicle checks whether the software update addresses the negative driver behavior or eliminates its causes. If this is the case, a corresponding user notification is issued to the user to prompt them to reactivate the vehicle function.The software update is tested for negative driver behavior in the vehicle, so that no data relevant to data protection, such as the user's identity and / or the vehicle's VIN, needs to be sent externally, for example to the developers.
[0073] Although the invention has been illustrated and explained in detail by means of preferred embodiments, the invention is not limited by the disclosed examples, and other variations may be derived therefrom by those skilled in the art without departing from the scope of the invention. It is therefore clear that a multitude of possible variations exist. It is also clear that the embodiments mentioned by way of example are truly only examples and should not be construed as limiting the scope, possible applications, or configuration of the invention in any way.Rather, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete terms, whereby the person skilled in the art, with knowledge of the disclosed inventive concept, can make various changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without departing from the scope of protection defined by the claims and their legal equivalents, such as further explanations in the description.
Claims
Patent claims 1. A system (100) for operating vehicle functions, comprising: a driver monitoring module (110) configured to detect negative driver behavior related to a vehicle function; a function module (120) configured to receive a software update for the vehicle function, wherein the software update includes change information related to changes in the vehicle function, wherein the function module (120) is further configured to compare the change information with the detected negative driver behavior; and a user interface module (130) configured to output at least one user notification related to the software update if the comparison reveals that the software update affects functionalities of the vehicle function that are related to the negative driver behavior.
2. The system (100) of claim 1, wherein the negative driver behavior involves overriding the vehicle function.
3. The system (100) of claim 1 or 2, wherein the negative driver behavior involves deactivating the vehicle function.
4. System according to one of claims 1 to 3, wherein the negative driver behavior relates to gestures and / or facial expressions and / or speech of the driver.
5. System (100) according to one of claims 1 to 4, further comprising a communication module (140) configured to send information relating to the negative driver behavior to a central unit (20).
6. System (100) according to claim 5, further comprising a memory module (150) configured to store vehicle-related data, wherein the The communication module (140) is further configured to send at least some of the vehicle-related data to the central unit (20).
7. System (100) according to one of claims 1 to 6, wherein the vehicle function comprises a driver assistance function and / or a comfort function of the vehicle (10).
8. Vehicle (10), in particular a motor vehicle, comprising the system (100) according to one of claims 1 to 7.
9. A method (300) for operating vehicle functions, comprising: Monitoring (310) a driver by a driver monitoring module (110) to detect negative driver behavior related to a vehicle function; Receiving (320), by a function module (120), a software update for the vehicle function, wherein the software update comprises change information relating to changes in the vehicle function; Comparing (330), by the functional module (120), the change information with the detected negative driver behavior; and Outputting (340), by a user interface module (130), at least one user notification relating to the software update if the comparison shows that the software update affects functionalities of the vehicle function that are related to the negative driver behavior.
10. A storage medium comprising a software program configured to be executed on one or more processors and thereby to carry out the method (300) according to claim 9.
Citation Information
Patent Citations
Method and device for self-adaptively optimizing automatic driving system
EP4137897A1
