Method for guiding a vehicle

The method and system enable personalized confirmation of automated driving maneuvers using a combination of actions and machine learning, improving safety and reliability by ensuring clear driver intent recognition.

WO2026233749A1PCT designated stage Publication Date: 2026-11-12BAYERISCHE MOTOREN WERKE AG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2026/061831
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-05-06
Filing Date
2026-04-24
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Existing systems for confirming automated driving maneuvers at SAE Level 2+ are unintuitive and may require actions that drivers forget or find cumbersome, leading to potential misunderstandings and reduced safety.

Method used

A method and system that allows drivers to individually select and confirm automated driving maneuvers using a combination of gestures, voice inputs, or other actions, with a machine learning model to verify the confirmation against safety criteria, ensuring clear and reliable recognition.

Benefits of technology

Enhances safety and reliability by allowing personalized confirmation methods and reducing misinterpretation of driver inputs, ensuring that automated maneuvers are executed only when clearly intended by the driver, thus maintaining driver involvement and control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2026061831_12112026_PF_FP_ABST
    Figure EP2026061831_12112026_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a method for guiding a vehicle, comprising the steps of: specifying (S1) a response by the driver of the vehicle on a control unit (1) of the vehicle, by means of which the driver wants to confirm an offer by the vehicle to carry out an automatic driving manoeuvre; detecting (S2) a traffic situation in which the vehicle is currently located or will be located ahead by means of a detection unit (3) of the vehicle; determining (S3), depending on the traffic situation, a possible future automatic driving manoeuvre by means of an automatic driving control system (5) of the vehicle; offering (S4) the performance of the automatic driving manoeuvre to the driver of the vehicle; detecting (S5) the driver by means of a driver observation unit (7) and checking whether the driver performs the specified response; and if this specified response is identified: executing (S6) the previously offered automatic driving manoeuvre by means of the automatic driving control system (5) of the vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] 25-0760

[0002] 1

[0003] Individually defined confirmation of offered assisted driving maneuvers

[0004] The invention relates to a method for driving a vehicle, as well as a system for a vehicle for driving a vehicle.

[0005] Assisted driving at SAE Level 2+ requires explicit confirmation from the driver before an automated driving control system executes a maneuver. This serves safety purposes, ensuring that the driver remains responsible and retains full control of the vehicle. It also ensures the driver's involvement and ability to react, while still allowing them to independently execute individual maneuvers, thus relieving the driver, particularly on longer journeys. Ultimately, executing an automated driving maneuver is a safety-critical action by the vehicle, as such an automated driving control system operates with full authority over the vehicle's actuators, such as the steering, brakes, and drivetrain.

[0006] Such confirmation is particularly necessary for demanding maneuvers, such as entering a roundabout, turning, or similar actions. Confirmation of a proposed maneuver, which the vehicle's automatic driving control system can execute immediately beforehand, can be given in response to a question communicated by the vehicle, for example, as a voice prompt: "Do you want to turn?"

[0007] It is known from the prior art that a driver of a vehicle activates or confirms a driving function of the vehicle by means of an action.

[0008] In this context, DE 102017208506 A1 relates to a driving system with a plurality of different driving functions for automated driving with varying degrees of automation for a motor vehicle, wherein at least the function with the highest degree of automation is not constantly available, the driving system has a user interface which includes: a control element common to the majority of the driving functions for the driver to signal their wish to engage automated driving to the driving system, and the driving system is configured to detect driver activation of the common control element for automated driving, and, after detecting activation of the common control element, to determine from the plurality of driving functions the available driving function that offers the highest possible level of automation.

[0009] 2

[0010] exhibits a certain level of automation, and to activate the specific available driving function with the highest possible level of automation.

[0011] DE 102010063792 A1 further relates to a method for automatically selecting driver assistance functions in a motor vehicle, wherein the motor vehicle has a plurality of driver assistance functions and each of the driver assistance functions can assume either an activated or a deactivated state, comprising the steps: receiving driving situation information about a driving situation; and automatically selecting which subset of the plurality of driver assistance functions is to be operated in the activated state for the driving situation, depending on the driving situation information.

[0012] DE 102020003718 A1 also relates to a method for assigning input signals to vehicle functions, wherein an action of a person using the vehicle is detected via a sensor and converted into the input signal, after which a vehicle function is assigned to the input signal and executed, wherein the emotional reaction of the person to this vehicle function is detected via another sensor and evaluated in a control system, wherein, depending on a positive or negative evaluation of the emotional reaction, a probability distribution of the assignment of the input signal to the vehicle function is strengthened or weakened.

[0013] However, confirming a request to execute an automatic driving maneuver, which is offered, for example, in an SAE Level 2+, may be unintuitive and may be assigned to an input element in the vehicle that the driver does not currently remember or whose operation he finds cumbersome.

[0014] The object of the invention is to improve the confirmation of an offered automatic driving maneuver in a vehicle for the driver.

[0015] The invention is defined by the features of the independent claims. Advantageous further developments and embodiments are the subject of the dependent claims.

[0016] A first aspect of the invention relates to a method for driving a vehicle, comprising the steps of:

[0017] - Specifying a response by the driver of the vehicle at a control unit of the vehicle, with which he wishes to confirm an offer from the vehicle to carry out an automatic driving maneuver;

[0018] - Detection of a traffic situation in which the vehicle is currently or ahead is located, by a detection unit of the vehicle; 25-0760

[0019] 3

[0020] - Determining, depending on the traffic situation, a possible future automatic driving maneuver by the vehicle's automatic driving control system;

[0021] - Offering the driver of the vehicle the execution of the automatic driving maneuver;

[0022] - Detecting the driver using a driver monitoring unit and checking whether the driver is performing the specified response; and if this specified response is detected:

[0023] - Execution of the previously offered automatic driving maneuver by the vehicle's automatic driving control system.

[0024] This provides a method and a system for a vehicle to perform an automatic driving maneuver, which, based on a detected situation in which the vehicle is currently or in the future, determines the automatic driving maneuver and offers it to the driver, and executes it upon receiving corresponding confirmation from the driver of the vehicle.

[0025] The driver's confirmation is individually selectable. The driver specifies their own reaction, which indicates the corresponding confirmation. The driver can specify this reaction using the same sensor unit that also records the actual execution of the specified reaction during the journey. Upon receiving such a reaction, the control unit then activates the automatic driving control system to execute the offered automatic driving maneuver. Preferably, the driver executes the same reaction once as will later be used during the vehicle's journey and operation to provide confirmation to the vehicle.In an alternative embodiment, the specified reaction can also be defined in other ways, for example by selecting from a large number of proposed reactions without demonstrating it itself.

[0026] The predefined response can be a gesture, voice input, a facial expression such as a wink, the operation of a button or switch or a displayed element on a touchscreen, a tap on the steering wheel, the actuation of a drive pedal such as an accelerator or brake pedal, steering input, a shrug of the shoulders, a nod of the head, a hand or finger gesture such as giving a thumbs-up or thumbs-down, or similar actions. A combination of two or more of the aforementioned elements can also be defined as a predefined response. 25-0760

[0027] 4

[0028] In a further embodiment, the control unit only accepts and stores as predefined reactions those that comprise two different categories, for example a gesture and a speech output.

[0029] The advantage of this is that it allows for individualization in vehicle operation. In this respect, the vehicle learns to understand the driver's commands, unlike older vehicles where the driver is forced to learn fixed operating procedures.

[0030] According to an advantageous embodiment, the control unit checks the predetermined reaction against a predetermined safety criterion, and if the predetermined safety criterion is not met, the driver is prompted to adjust the originally predetermined reaction or to specify a new desired reaction.

[0031] The safety criterion specifically specifies the unambiguous detection and recognition of the specified response. It should be possible to recognize, with a minimum level of reliability, a driver's executed response to a corresponding offer of an automatic driving maneuver. Accordingly, the specified response should be as clearly identifiable as possible. Random hand movements and gestures or voice outputs should not be misinterpreted as a response indicating confirmation by the driver. Therefore, according to this embodiment, the control unit checks, even when a desired response is specified, whether it meets one or more of the relevant safety criteria.Such verification is preferably carried out by inference of a pre-trained machine learning model, in particular an artificial neural network, which checks learned features for the uniqueness of recognition.

[0032] According to another advantageous embodiment, the specified safety criterion stipulates that the reaction originates from two different action categories.

[0033] A combination of reaction elements from two different action categories significantly increases the safety and reliability of recognizing a predefined reaction, in order to minimize the possibility, as explained above, of random reaction elements being misinterpreted as conscious confirmation to execute a offered automatic driving maneuver. Examples of different action categories include gesture and facial expression, gesture and voice input, gesture and pedal input, voice input and pedal input, winking and head nodding, or 25-0760.

[0034] 5

[0035] other combinations. This advantageously highlights the robustness and reliability in recognizing an action performed during vehicle operation and assigning it to a previously defined reaction.

[0036] According to another advantageous embodiment, the specified safety criterion stipulates that actions from the two different action categories are performed simultaneously.

[0037] According to a further advantageous embodiment, the offer to perform the automatic driving maneuver has a semantic reference to the traffic situation and / or to the offered automatic driving maneuver, wherein the offered automatic driving maneuver is only executed if the driver's reaction has a corresponding reference to the traffic situation and / or to the offered automatic driving maneuver.

[0038] Accordingly, the vehicle's request for confirmation is linked to the specific current or upcoming traffic situation for which the automatic driving maneuver is offered. For example, the vehicle asks: "Do you want to take the first exit at the upcoming roundabout?" The corresponding automatic driving maneuver is then only executed if the driver's response to confirm the request has a semantic connection to this turning maneuver in the roundabout. For example, the automatic driving maneuver is only carried out if the driver refers to the roundabout and / or the first exit, particularly via voice input. This effectively prevents misunderstandings between the driver and the vehicle's offer to execute the automatic driving maneuver and ensures a consistent reference to the current or upcoming traffic situation.

[0039] According to a further advantageous embodiment, the specified reaction has an assignment to a traffic situation, wherein the offered automatic driving maneuver is only executed for such a traffic situation that corresponds to the traffic situation assigned to the reaction.

[0040] Accordingly, several responses are predefined for specific purposes, with each response assigned to its own automated driving maneuver or traffic situation. For example, a particular voice input with verbal reference to an automated driving maneuver or traffic situation can be uniquely assigned; a wink, a thumbs-up, or another action can also be assigned to a very frequent automated driving maneuver, while all 25-0760

[0041] 6

[0042] Other automatic driving maneuvers can be confirmed by voice input.

[0043] According to a further advantageous embodiment, the automatic driving control system only considers a reaction specified before the start of the journey for the execution of the automatic driving maneuver. "Before the start of the journey" means, in particular, that the reaction is specified while the vehicle is stationary.

[0044] According to a further advantageous embodiment, after driving through a traffic situation, the reaction is predetermined and can be used to confirm an offered automatic driving maneuver when driving through the same or a similar traffic situation again.

[0045] This allows the driver, after encountering a traffic situation where an automatic driving maneuver is possible, to specify a response that, in the future, when encountering the same or a similar traffic situation, can be used to confirm an offer of an automatic driving maneuver. For example, the driver could say the following sentence to the vehicle's control unit as a voice command: "In the future, use my thumbs-up gesture for roundabouts as confirmation."

[0046] According to another advantageous embodiment, after driving through a traffic situation, the driver of the vehicle is prompted to specify a modified or new reaction if the traffic situation and / or the reaction meets a predetermined condition.

[0047] The predefined condition checks, in particular, whether the executed reaction could be unambiguously assigned. If, depending on the implementation, there is a lack of reliability in recognizing the action as a predefined reaction, the control unit can recognize that the assignment is apparently uncertain, whereupon an improved predefined reaction with increased reliability is requested. For example, the vehicle might issue a voice message: "I'm not sure whether I should interpret your reaction as confirmation; would you like to define a different reaction?" However, the predefined condition can also be related to the traffic situation, for example, if a special situation is detected that might not be adequately covered by a previously predefined reaction. In this case, too, the driver of the vehicle is prompted to specify a modified and / or new reaction.

[0048] According to a further advantageous embodiment, the 25-0760

[0049] 7

[0050] The driver monitoring unit checks whether a driver's behavior can be reliably assigned to a stored response, and if it is determined that there is low reliability in the assignment, the driver of the vehicle is asked to adjust the specified response or to specify a new response.

[0051] Another aspect of the invention relates to a vehicle control system comprising a control unit designed to detect and store a response initiated by the driver of the vehicle, with which the driver wishes to confirm an offer from the vehicle to execute an automatic driving maneuver; a detection unit designed to detect a traffic situation in which the vehicle is currently or is in the future; and comprising an automatic driving control system designed to determine a possible future automatic driving maneuver; wherein the control unit is designed to offer the execution of the automatic driving maneuver to the driver of the vehicle; and comprising a driver monitoring unit designed to detect the driver and to check whether the driver executes the specified response;and wherein the control unit is designed to control the automatic driving control system to execute the previously offered automatic driving maneuvers when the specified response is detected.

[0052] Advantages and preferred further developments of the proposed system result from an analogous and substantive transfer of the above statements made in connection with the proposed procedure.

[0053] Further advantages, features and details will become apparent from the following description, in which - possibly with reference to the drawing - at least one embodiment is described in detail.

[0054] They show:

[0055] Fig. 1: A method for driving a vehicle according to an embodiment of the invention.

[0056] Fig. 2: A vehicle guidance system according to an embodiment of the invention.

[0057] Fig. 1 shows a method for controlling a vehicle. In this method, the following steps are performed: First, the driver of the vehicle specifies a reaction S1 at a control unit 1 of the vehicle. For the future, the driver uses this specification to determine which reaction will result from an offer25-0760.

[0058] 8

[0059] The assumption is that an automated driving maneuver is to be performed in the future. One purpose of this specification is therefore that, in the event of an offer from the vehicle to the driver regarding an upcoming automated driving maneuver, the offer is accepted by the driver through a predefined reaction, leading to the actual execution of the automated driving maneuver by the vehicle. The control unit 1 detects and stores this specification. A detection unit 3 in the vehicle records the current or anticipated traffic situation S2 during a journey.Furthermore, an automatic driving control system 5 of the vehicle determines S3 whether an automatic maneuver can be performed for a given traffic situation and, if so, issues an offer S4 to the driver to automatically execute such a maneuver, for example, via voice output, which may optionally be accompanied by a visual cue, such as in a head-up display. The vehicle also uses a driver monitoring unit 7, which may, for example, have already recorded the driver's intended response. During the journey, this unit is used S5 to monitor whether the driver is actually performing a response that corresponds to the intended response.For example, an interior camera is used for the driver observation unit 7 to visually detect gestures or other actions performed by the driver. The verification of the acquired data for the presence of the defined reaction or one of several defined reactions is carried out, in particular, by executing an artificial neural network that assesses the presence of a specific class of reactions, specifically by assigning probabilities to a finite set of predefined possible reactions. If this predefined reaction is detected, the vehicle's automatic driving control system 5 executes the previously offered automatic driving maneuver S6.

[0060] Fig. 2 schematically shows a vehicle control system. A control unit 1 of the vehicle is responsible for capturing and storing a response initiated by the driver to confirm an offer from the vehicle to perform an automatic driving maneuver. The control unit 1 applies a complex set of rules to verify whether the driver's input meets certain safety criteria. This ensures that the inputs are as clear and reliably recognizable as possible during subsequent vehicle operation and do not lead to unintended confirmation of the offer due to random actions by the driver. A detection unit 3, designed to capture the current or upcoming traffic situation of the vehicle, continuously uses data from an external camera of the vehicle.

[0061] 9

[0062] During its journey, the vehicle checks for predefined categories of traffic situations in order to evaluate them. These categories determine which driving maneuvers, corresponding to each traffic situation, can be executed automatically. These maneuvers occur without driver intervention, except for the driver's confirmation. Such automatic driving maneuvers can be executed, in particular, by the vehicle's automatic driving control system 5. This automatic driving control system 5 also selects and parameters the appropriate automatic driving maneuver based on the detected traffic situation. The control unit 1 is designed to offer the driver the execution of the automatic driving maneuver. The driver must confirm the offer within a predefined time period; otherwise, the automatic driving maneuver will not be executed.A driver monitoring unit 7, comprising in particular an interior camera and / or a voice recognition unit for receiving voice commands from the driver, assists the control unit 1 in detecting the driver and checking whether the specified response is being executed. Furthermore, the control unit 1 is configured to activate the automatic driving control system 5 to execute the previously offered automatic driving maneuvers when the specified response is detected.

[0063] Although the invention has been further illustrated and explained in detail by means of preferred embodiments, the invention is not limited by the disclosed examples, and other variations can be derived from them by a person skilled in the art without departing from the scope of protection of the invention. It is therefore clear that a multitude of possible variations exist. It is also clear that the embodiments mentioned as examples are truly only examples and are not to be understood in any way as limiting, for example, the scope of protection, the possible applications, or the configuration of the invention.Rather, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete terms, whereby the person skilled in the art, with knowledge of the disclosed inventive concept, can make various changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without leaving the scope of protection defined by the claims and their legal equivalents, such as further explanations in the description.

Claims

Patent claims 1. A method for driving a vehicle, comprising the steps of: - Specifying (S1) a response by the driver of the vehicle at a control unit (1) of the vehicle, with which he wishes to confirm an offer from the vehicle to carry out an automatic driving maneuver; - Detection (S2) of a traffic situation in which the vehicle is currently or is about to be located, by a detection unit (3) of the vehicle; - Determining (S3), depending on the traffic situation, a possible future automatic driving maneuver by an automatic driving control system (5) of the vehicle; - Offering (S4) the execution of the automatic driving maneuver to the driver of the vehicle; - Detection (S5) of the driver by a driver observation unit (7) and checking whether the driver performs the specified response; and if this specified response is detected: - Execution (S6) of the previously offered automatic driving maneuver by the vehicle's automatic driving control system (5).

2. Method according to claim 1 , wherein the control unit (1) checks the specified response against a specified safety criterion, and if the specified safety criterion is not met, the driver is prompted to adjust the originally specified response or to specify a new desired response.

3. Method according to claim 2, where the specified safety criterion stipulates that the reaction originates from two different action categories.

4. Method according to claim 3, where the specified safety criterion stipulates that actions from the two different action categories are carried out simultaneously.

5. Method according to any one of the preceding claims, where the offer to perform the automatic driving maneuver has a semantic reference to the traffic situation and / or to the offered automatic driving maneuver, and where the offered automatic driving maneuver is only executed if the driver's reaction has a corresponding reference to the traffic situation and / or to the offered automatic driving maneuver.

6. Method according to any one of the preceding claims, wherein the specified reaction has an assignment to a traffic situation, wherein the offered automatic driving maneuver is only executed for such a traffic situation that corresponds to the traffic situation assigned to the reaction.

7. Method according to any one of claims 1 to 6, where only one reaction specified before the start of the journey is taken into account by the automatic driving control system (5) for the execution of the automatic driving maneuver.

8. Method according to any one of claims 1 to 6, where, after driving through a traffic situation, the reaction is specified, and when driving through the same or a similar traffic situation again, it can be used to confirm an offered automatic driving maneuver.

9. Method according to claim 8, where the driver of the vehicle is asked to specify a reaction after driving through a traffic situation, if the traffic situation and / or the reaction meets a predetermined condition.

10. Method according to any one of the preceding claims, wherein the driver monitoring unit (7) checks whether a driver's behavior can be reliably assigned to a stored response and if it is found that there is low reliability in the assignment, the driver of the vehicle is requested to adjust the specified response or to specify a new response.