Driving intention recognition
By receiving sensors and driver input data, analyzing and generating control instructions, using AR displays and driving assistance systems to realize intuitive communication of driver intentions, solving the problem of driver expectations not being effectively conveyed, and improving the safety and comfort of autonomous driving.
Patent Information
- Application Number
- CN202210366130.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-04-09
- Filing Date
- 2022-04-08
- Publication Date
- 2025-08-05
- Estimated Expiration
- 2042-04-08
AI Technical Summary
In existing autonomous driving systems, driver expectations fail to communicate effectively, resulting in misunderstandings and unwanted vehicle controls.
The sensor data and driver control input are received through the input interface, the analysis unit determines the traffic situation and generates control instructions, and the output interface transmits the instructions to the vehicle unit, and uses the AR display and driving assistance system to realize intuitive communication of driver intentions and vehicle control.
Improves the recognizability and safety of driver intentions, allowing drivers to intuitively control the vehicle in some autonomous driving, and enhances road traffic safety and comfort.
Smart Images

Figure CN115246414B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a device for detecting a driver's intention for lane change assistance in an at least partially autonomously driven motor vehicle, a corresponding system, and a method and a computer program. Background Art
[0002] The increasing automation of driving functions allows for the selection of different modes. In highly automated driving, the driver simply issues strategic instructions such as "turn right," "turn left," and the vehicle comfortably and safely performs operational controls on its own. In conventional mode, the driver retains the operational driving responsibility as before. Switching between modes is possible depending on the driving situation, requirements, and / or driver preferences.
[0003] Publication DE 10 2014 220 758 A1 discloses a driving system for a vehicle comprising a computer unit that evaluates environmental and vehicle-related data using sensors and uses this data to perform automated driving. Driver expectations are introduced through driver interaction. These expectations are fulfilled by the automated driving system, to the extent possible based on an evaluation of the data conditions. The present invention is intended to supplement existing automated driving systems. However, a disadvantage is that the driver does not receive feedback regarding vehicle control consistent with their expectations. In particular, misunderstanding of the driver's expectations can lead to unintended vehicle control.
[0004] Publication WO 2007 / 050477 A1 relates to a user interface device for selecting an operating mode for automated driving in a motor vehicle. The user interface device includes a switching device for switching between different driving automation levels of the motor vehicle, a selection device for determining at least one driving parameter for configuring the driving automation level selected by means of the switching device, and a display device, cooperating with the selection device, for displaying the available selection options for at least one driving parameter when configuring the selected driving automation level. Thus, even when there are a large number of such levels and configuration options therefor, a simple and space-saving operating design with only two different input methods (i.e., switching between driving automation levels and configuration by means of the selection device) enables selection and configuration of one of the multiple driving automation levels of the motor vehicle. However, a disadvantage is that, in addition to the known operating elements of the motor vehicle, the switching device and the selection device must be provided in the motor vehicle. Furthermore, the vehicle driver must first learn the system in order to use the driving automation levels. Summary of the Invention
[0005] The present invention is based on the object of providing an improved possibility for detecting and, in particular, implementing a driver's intention or driver's desire in an at least partially autonomous vehicle. Preferably, the driver's desire should be intuitively conveyable and recognizable without error.
[0006] This object is achieved by a device for detecting a driver's intention for a lane change assistant in an at least partially automated motor vehicle, comprising:
[0007] an input interface for receiving sensor data containing information about a roadway section in the surroundings of the motor vehicle and control data containing information about control inputs of a motor vehicle driver;
[0008] an evaluation unit for determining a traffic situation in the surroundings of the motor vehicle based on sensor data and for generating control commands for controlling vehicle units of the motor vehicle based on control data;
[0009] - an output interface for transmitting control commands to a vehicle unit of the motor vehicle, wherein the control commands cause a control of the vehicle unit of the motor vehicle in the form of a driver assistance system based on control inputs of the driver and a display of instructions about the control of the motor vehicle in the form of a display of the vehicle unit, wherein the control inputs correspond at least partially to control inputs in the case of manual driving.
[0010] Furthermore, the above-mentioned object is achieved by a system for detecting a driver's intention for lane change assistance in an at least partially automated motor vehicle, comprising:
[0011] - a device as previously defined;
[0012] an AR display, in particular a head-up display, on the motor vehicle for outputting instructions and / or further instructions in response to control commands of the device, and
[0013] - for controlling a driver assistance system of a motor vehicle in response to control commands of the device.
[0014] Finally, the above-mentioned object is achieved by a method for detecting a driver's intention for lane change assistance in an at least partially automated motor vehicle, comprising the following steps:
[0015] - receiving sensor data containing information about a roadway section in the surroundings of the motor vehicle and control data containing information about control inputs of a driver of the motor vehicle;
[0016] - determining a traffic situation in the surroundings of the motor vehicle based on sensor data;
[0017] - generating control commands for controlling vehicle units of the motor vehicle based on the control data; and
[0018] - transmitting control commands to a vehicle unit of the motor vehicle, wherein the control commands cause a control of the vehicle unit of the motor vehicle in the form of a driver assistance system based on control inputs of the driver and a display of instructions about the control of the motor vehicle in the form of a display of the vehicle unit, wherein the control inputs correspond at least partially to control inputs in the case of manual driving.
[0019] The input interface makes it possible to create a cost-effective device that can preferably be used in conjunction with existing systems, modules, and units installed in a motor vehicle. The input interface can be designed to be wired and / or wireless and preferably supports one or more communication protocols. An analysis unit can determine favorable control options for the motor vehicle, wherein the driver's wishes are preferably met only when traffic conditions permit. By determining the traffic situation in the motor vehicle's surroundings, safe control of the motor vehicle by a driver assistance system is possible. In particular, the traffic situation can include the identification of drivable lanes. Safety in road traffic is improved. The output interface makes it possible to create a cost-effective device that can preferably be used in conjunction with existing output devices. Using an input interface for receiving data makes it possible to create a technically simple and cost-effective device that, in particular, does not need to include its own sensors. The device can therefore be integrated into existing navigation or infotainment systems. Components already installed in the motor vehicle can be used for display purposes using the output interface. It is also conceivable to add an AR display and / or use multiple AR displays in combination. By making the control inputs at least partially correspond to those used in manual driving, the driver can intuitively communicate their intentions, as if they were controlling the vehicle themselves. No driver training is required. Furthermore, by displaying instructions regarding vehicle control, the driver can monitor vehicle control simply, quickly, and safely. Obviously, the device is preferably used in vehicles with steer-by-wire technology, so that steering deflections (Lenkausschlag, or steering jerk) do not directly lead to lateral acceleration. In particular, it is preferred to assume indirect vehicle steering, which regulates lateral control purely electronically based on control signals from, for example, the steering wheel or other operating elements, such as a turn signal lever. Such equipment is used, for example, in highly automated vehicles, where operational driving tasks increasingly take a back seat and strategic driving commands are preferred instead. The approach described here allows for the retention of conventional operating elements, but optionally for more abstract, particularly strategic, driving commands, and also allows for intuitive switching between different automation levels within the same vehicle. The use of conventional operating elements (e.g. steering wheel and turn signal lever) makes it possible to switch between "operational control" (i.e. active control of the motor vehicle by the driver) and "strategic control" (i.e. control of the motor vehicle by a driver assistance system in response to the driver's instructions / desires) modes, preferably as desired, for example depending on the driver or the driving situation.
[0020] In a preferred embodiment of the present invention, the output interface is configured to transmit control commands to an AR display in the form of an AR-HUD and is preferably configured to be installed in a motor vehicle and is particularly preferably part of an onboard computer, infotainment, and / or navigation system. This allows the driver to select a configuration that is understandable to him or her. The system's acceptance, comfort, and comprehensibility can be improved and enhanced. The control commands for the AR-HUD enable improved visualization of information for the driver. In particular, the driver can direct his or her gaze toward the roadway without having to look at an additional display in the motor vehicle. Safety in road traffic is improved.
[0021] In another preferred embodiment of the present invention, the analysis unit determines a control command that causes a display of a guide for displaying the lane being traveled by the motor vehicle, preferably by positioning (i.e., localizing) the guide via augmented reality. This makes the actual state easily apparent to the driver. The positioning of the guide improves the driver's ability to identify the lane currently being traveled. This allows the driver to quickly assess the actual state, particularly in at least partially automated driving operations (in which the driver's attention can be reduced).
[0022] In another preferred embodiment of the present invention, the input interface is configured to receive control data from a steering wheel, turn signal lever, joystick, and / or confirmation switch, and this control includes turning and / or lane changing. This allows the driver's expectations to be met during at least partially automated driving using known operating inputs and operating elements. The driver can also control the vehicle during at least partially automated driving using standard operating inputs, thereby improving user experience and comfort. In particular, the first and second joysticks in steer-by-wire vehicles can be used, as is generally known in the prior art.
[0023] In another preferred embodiment of the present invention, the analysis unit determines a control command that, in response to the driver's control input, triggers a further prompt containing information about the control to be performed by the driver assistance system based on the control command, preferably by means of a display positioned in augmented reality. This allows the driver to quickly and efficiently monitor the control to be performed. Furthermore, comfort is improved because the driver determines the driving maneuver using the prompt, preferably positioned in the surrounding environment. The driver can direct their gaze toward the road in selected situations, thereby increasing safety in road traffic.
[0024] In another preferred embodiment of the present invention, the input interface is configured to receive control data, which includes the control to be executed by the driver assistance system according to the control instruction through the operation of a confirmation switch, wherein the control instruction causes the control to be executed after receipt of confirmation. As a result, the control to be executed can be determined in an improved manner. In particular, unnecessary calculations of control data can be counteracted by the receipt of confirmation. This confirmation can be achieved by the driver, for example, by pressing a confirmation switch or by a voice command. Obviously, the confirmation switch can then include switching logic and a microphone. Preferably, the calculation of control parameters for at least partially automated driving of the motor vehicle is not started until the control to be executed is confirmed. Obviously, the analysis unit can also initially only output control instructions for prompting and then determine further control instructions for the driver assistance system in response to the receipt of confirmation.
[0025] In another preferred embodiment of the present invention, the input interface is configured to receive control data in the form of abort data with information regarding the cancellation of a control to be executed according to the control command. The abort data particularly includes a driver's reversal of the steering wheel, a reversal of control via a joystick, a tactile input, and / or an acoustic input. This improves safety and comfort, as incorrect inputs can be quickly and intuitively corrected or aborted. After receiving the abort data, the analysis unit can determine a new control command, wherein the control to be executed according to the control command includes retaining and driving on the currently driven lane.
[0026] Further preferred embodiments of the present invention result from the remaining features mentioned in the present invention.
[0027] The various embodiments of the invention mentioned in this application can be advantageously combined with one another, unless they are implemented differently in individual cases.
[0028] Steer-by-wire is understood to be a system in vehicle technology in which a steering command is transmitted electrically from a sensor (especially a steering wheel) via a controller to an electromechanical actuator that implements the steering command. In such a system, there is no mechanical connection between the steering wheel and the steered wheels.
[0029] Automated driving (also known as autonomous driving or automated driving) is defined as the forward movement of vehicles and transportation systems without a driver. The degree of automation is often described in the following levels. Level 0: No automation. The driver steers, accelerates, and brakes independently. Level 1: The vehicle has independent assistance systems, such as an anti-lock braking system (ABS) or electronic stability program (ESP) that intervenes autonomously. Level 2: The automated system assumes some of these tasks (such as adaptive cruise control, lane change assistance, and automatic emergency braking). However, the driver retains control (autonomy) and responsibility for the vehicle. Level 3: The vehicle can accelerate, brake, and steer autonomously depending on the route (conditional automation). If necessary, the system requires the driver to take over monitoring (control). Level 4: The vehicle can operate completely autonomously in normal operation. However, the driver has the possibility to intervene and "overrule" the system. Level 5: The vehicle operates fully autonomously, without the possibility (and necessity) of driver intervention.
[0030] A heads-up display (HUD; literally: "head-up display") is a display system in which the user maintains their line of sight and, therefore, their head posture, as information is projected into their field of view. In addition to pilots, these users also include car drivers. In particular, augmented reality (also known in English as "Augmented Reality," or AR for short) can be combined with a HUD. AR here means a computer-assisted extension of the perception of reality. This information can respond to all human sensory modalities. However, augmented reality is often understood solely as a visual display of information, i.e., the supplementation of images or videos with additional computer-generated information or virtual objects by means of insertions (or fading in) / superimpositions.
[0031] Car-to-car communication (Car2Car, C2C) or vehicle-to-vehicle (V2V) refers to the exchange of information and data between motor vehicles to inform drivers of critical and dangerous situations at an early stage. Car2Car is a special case of Car2X (also known as Vehicle-to-Everything), which refers to the communication between a vehicle and its surroundings (excluding other traffic participants, especially infrastructure). BRIEF DESCRIPTION OF THE DRAWINGS
[0032] The present invention will be described below with reference to the accompanying drawings, in which:
[0033] Figure 1 A schematic illustration of a device for detecting a driver's intention for lane change assistance in an at least partially automated motor vehicle is shown;
[0034] Figure 2 A schematic diagram of a variant of the system according to the invention is shown;
[0035] Figure 3 A schematic illustration of another variant of the system according to the invention in a motor vehicle is shown;
[0036] Figures 4a to 4c A schematic illustration of the system output from the driver's perspective is shown;
[0037] Figures 5a to 5c An additional schematic illustration of the system output is shown from the driver's perspective;
[0038] Figure 6a and 6b An additional schematic illustration of the system output is shown from the driver's perspective;
[0039] Figure 7a and 7b An additional schematic illustration of the system output is shown from the driver's perspective;
[0040] Figures 8a to 8c shows an additional schematic representation of the system output from the driver's perspective; and
[0041] Figure 9 A schematic representation of the steps of the method according to the invention is shown. DETAILED DESCRIPTION
[0042] Figure 1 A schematic illustration of a device 10 for detecting a driver's intention for lane change assistance in an at least partially autonomous vehicle is shown. The device 10 comprises an input interface 12 , an evaluation unit 14 , and an output interface 16 .
[0043] Input interface 12 is configured to receive data, including sensor data containing information about lane sections in the vehicle's surroundings and control data containing information about control inputs by the vehicle driver. This data may include, for example, the vehicle's position and speed in its surroundings, recognized traffic signs, and / or navigation instructions, and may originate, for example, from a speedometer, a GPS receiver, a radar sensor, a laser sensor, or a lidar sensor, a camera, and / or a navigation system. For this purpose, input interface 12 is preferably connected to a vehicle-internal transmission network. Alternatively, input interface 12 may be configured for wireless communication or connected to a dedicated (e.g., wired) transmission network.
[0044] Analysis unit 14 is configured to receive data and generate control commands, wherein the control commands cause a vehicle unit of the motor vehicle, in the form of a driver assistance system, to be controlled based on control inputs by the driver and instructions regarding the control of the motor vehicle to be displayed on a display of the vehicle unit. The control inputs correspond, at least in sections, to the control inputs during manual driving. Analysis unit 14 determines the traffic situation in the surroundings of the motor vehicle based on the sensor data. Obviously, analysis unit 14 can also receive and use traffic situations already determined by a driver assistance system or other systems.
[0045] Output interface 16 is configured to transmit control commands to a vehicle unit of the motor vehicle, wherein the vehicle unit may include, in particular, a display and / or a driver assistance system. Output interface 16 may be configured for communication similarly to input interface 12. Obviously, input interface 12 and output interface 16 may also be configured in combination as a communication interface for sending and receiving.
[0046] Figure 2 A schematic illustration of a system 18 according to the invention is shown with a device 10 , an AR display 20 and a driver assistance system 22 .
[0047] As explained above, the device 10 receives data including sensor data and control data.
[0048] Based on this data, the device 10 generates control instructions for the AR display 20 and thus causes a prompt 26 regarding the control to be performed on the windshield 30 of the motor vehicle to be displayed. In the example shown, the AR display 20 comprises a head-up display, wherein the projection unit 24 is movably designed and can be moved, for example, by means of an actuator, so that the prompt 26 can be projected at a position in the driver's field of view of the windshield 30. In particular, the size, position, and shape of the prompt 26 can be varied. Thus, the prompt 26 can be displayed directly on the windshield 30 of the motor vehicle. In addition, a further prompt 28 can be displayed, which preferably marks the current actual position, that is, in particular, the roadway currently being traveled.
[0049] The sensor data may originate from sensors 32 including, for example, a speedometer, a GPS receiver, a radar sensor, a laser sensor or lidar sensor, a camera.
[0050] Control data may originate, in particular, from a steering wheel 34, a turn signal lever 36, a joystick 37, and / or a navigation system 38. Obviously, the manipulation of the turn signal lever 36, the joystick 37, and / or the steering wheel 34 can be detected via corresponding switches and sensors 32 (as is generally known in the prior art). If a driver-initiated control (e.g., a rotation of the steering wheel 34) is detected, the analysis unit 14 may transmit a control command to the driver assistance system 22, which may include, for example, the information "change lane to the left." The driver assistance system 22 may then calculate and execute the corresponding control for the vehicle.
[0051] Figure 3 A schematic illustration of a variant of the system 18 according to the present invention is shown in a motor vehicle 40. The system 18 according to the present invention comprises a device 10, an AR display 20, and a driver assistance system 22. In the example shown, the AR display 20 comprises a projection unit 24, which can project onto a windshield 30 (not shown in detail) of the motor vehicle 40.
[0052] As described above, device 10 receives data including sensor data and control data. In the example shown, sensor 32 comprises a front-facing camera. Obviously, additional sensors 32 are conceivable. In particular, sensor data fusion can be implemented to combine data from multiple sensors 32 to achieve higher data quality.
[0053] Device 10 analyzes the received data and determines a control instruction that causes prompt 26 and / or further prompt 28 to be displayed, wherein further prompt 28 can be used to convey a pending control of motor vehicle 40. For example, further prompt 28 can mark a lane, wherein the pending control includes a lane change. In particular, further prompt 28 can be adapted in response to the driver's control input, preferably in real time. For example, turning steering wheel 34 can directly cause further prompt 28 to be moved to another lane. Particularly preferably, the suggested driving maneuver (i.e., the pending control of motor vehicle 40) is confirmed by the driver and then executed by driver assistance system 22.
[0054] exist Figures 4a to 8c , an output 42 of system 18 is schematically shown from the driver's perspective. For reasons of clarity, only one prompt symbol is used for prompts 26, 28, and accordingly, only one prompt 26, 28 is shown. Of course, a parallel display of two prompts 26, 28 is also conceivable. Furthermore, a steering wheel 34 is shown as an exemplary input medium for generating control data.
[0055] exist Figure 4a , a situation is shown in which a motor vehicle 40 is traveling in the middle lane of a multi-lane road. The current lane is marked by means of a sign 26.
[0056] The driver has the possibility of marking the adjacent roadway by, for example, moving the steering wheel 34 or the turn signal lever 36 .
[0057] exist Figure 4b The left lane is marked in Figure 4c The right lane is marked.
[0058] The longitudinal and lateral maneuvers of vehicle 40 are monitored by its driver assistance system 22. Vehicle 40 uses its surroundings model to determine which vehicles are in its immediate surroundings. This surroundings model is kept up to date via the vehicle's own sensors and via V2X. Vehicle 40 can also optionally establish a cooperative agreement with surrounding vehicles via V2X. Based on this agreement, vehicle 40 can autonomously initiate a lane change.
[0059] exist Figure 5a A variant is shown in FIG. 4 , in which the driver has the possibility of confirming his selection by actuating a confirmation switch 44 via a key press.
[0060] If the driver confirms the control to be executed, such as Figure 5b As shown in , the steering wheel 34 can be released, so that the steering wheel 34 preferably returns to its initial position. Optionally, the driver can generate abort data to terminate the maneuver. This can be achieved, for example, by turning the steering wheel 34 in the opposite direction, but can also be achieved through other haptic or acoustic signals, such as spoken commands (e.g., "Stop!", "Back!", "No!"). Obviously, other input possibilities are conceivable. After the lane change maneuver is completed, the driver can optionally be informed of the successful lane change, for example, by means of acoustic, visual, and / or haptic signals.
[0061] exist Figure 5c 2 shows a situation in which a motor vehicle 40 has changed lanes and is traveling in the left lane of a multi-lane road. The currently traveling left lane is displayed by a prompt 26. Obviously, the prompt 26 is optional.
[0062] exist Figure 6a shows an initial situation in which the driver wishes to change lanes across multiple lanes. An alternative initial situation, for example, is a bus at a stop and immediately having to turn left. This requires crossing multiple lanes in a short distance. In the example shown, the driver selects the lane to which the motor vehicle 40 is to be maneuvered by moving the steering wheel 34. The device 10 marks this lane with a further indicator 28. Depending on the duration and / or intensity of the steering wheel movement, the driver can position the indicator on the desired lane.
[0063] exist Figure 6b 2 shows a situation in which a motor vehicle 40 has performed a lane change across multiple lanes and is traveling in the right lane of a multi-lane road. The currently traveling right lane is indicated by a prompt 26. The change across multiple lanes is performed similarly to the lane change described above.
[0064] exist Figure 7a The initial situation of driving, for example, in the left or middle lane is shown in FIG. The driver wants to leave the road at an exit or a fork. To do this, he marks the turning lane with the steering wheel 34 and thus informs the motor vehicle 40 of his intention to turn. This process is similar to the one already mentioned. Figure 6a and 6b Alternatively, the driver can also mark a roadside sign and thereby inform the motor vehicle 40 and in particular the system 18 which exit or fork he wants to take. "Marking" is understood to mean in particular the movement of the further indication 28 (as described above) by turning the steering wheel.
[0065] The driver marks a roadside sign by moving the steering wheel 34. The location and content of the sign are known to the vehicle 40 because this information is stored, for example, in a navigation or surroundings model, or received via V2X from another vehicle equipped with traffic sign recognition, or the vehicle 40 itself obtains this information by recognizing text on the sign. The vehicle 40, and in particular the system 18, can recognize the sign itself, obtain its information, and, via steering wheel input, the driver's intention. The system 18 preferably knows the road topology and / or road geometry, and therefore also the precise location of exits or forks. Obviously, the system 18 has access to navigation data for this purpose.
[0066] The motor vehicle 40 autonomously executes the necessary lane change towards the exit. Thus, the motor vehicle 40 undergoes the same state as described in the previous paragraph until the lane change is complete.
[0067] exist Figure 7b , a situation is shown in which a motor vehicle 40 has already changed lanes through a plurality of lanes and is traveling at an exit for leaving a motorway or a national highway. The exit currently being traveled is displayed by a prompt 26.
[0068] exist Figure 8a , for example, a starting situation is shown in FIG, when driving towards an intersection on a middle lane. The intersection has, for example, a plurality of directional lanes and, in the example shown, comprises a left-hand curve, two straight lanes, and two right-hand curves.
[0069] exist Figure 8bA situation is shown in Figure 3, in which the driver has marked the directional roadway or the turning lane he wants by the motion of steering wheel 34 (as described above). In the example shown, the left side of the two right turning lanes is marked.
[0070] The roadway topology of the intersection is known to the motor vehicle 40 and in particular to the system 18 because the information is stored, for example, in the navigation or in the surroundings model, or is received via V2X from another vehicle with lane recognition or is obtained by the system itself via lane recognition.
[0071] Obviously, information about the road topology and / or geometry can be received from a transmitting device at an intersection, such as a traffic light installation or the like.
[0072] The motor vehicle 40 autonomously performs the necessary lane change towards the intersection. Thus, the motor vehicle 40 undergoes the same state as described in the previous paragraph.
[0073] exist Figure 8c , the situation after the end of the merging maneuver performed autonomously by the motor vehicle 40 is shown. The motor vehicle 40 is traveling on the left of the two right turns. The currently traveling right turn is indicated by the indicator 26.
[0074] exist Figures 4a to 8c , a steering wheel 34 is shown as an example medium for generating control data. Obviously, the steering wheel 34 is used merely as an example of a known input medium to facilitate the description of the present invention, and this exemplary use of the steering wheel 34 is not to be construed as limiting. As already explained above, other input devices (such as one or two joysticks 37 or a turn signal lever 36) are also conceivable. Obviously, the confirmation switch 44 (if provided) is preferably located on the corresponding input medium.
[0075] exist Figure 9 Schematically depicted are the steps of a method according to the present invention for detecting a driver's intention for lane change assistance in an at least partially automated motor vehicle 40. The method can preferably be executed by the system 18 and / or the device 10 as described above.
[0076] In a first step S1 , sensor data containing information about a roadway section in the surroundings of motor vehicle 40 and control data containing information about control inputs by the driver of motor vehicle 40 are received.
[0077] In a second step S2 , the traffic situation in the surroundings of motor vehicle 40 is determined based on sensor data.
[0078] In a third step S3 , control commands are generated based on the control data for controlling vehicle units of motor vehicle 40 .
[0079] In a fourth step S4 , the control commands are finally transmitted to the vehicle units of motor vehicle 40 .
[0080] The control commands cause the control of a vehicle unit in the form of a driver assistance system 22 based on the driver's control inputs and the display of further instructions 28 of the vehicle unit regarding the control of the vehicle 40 in the form of a display. The control inputs correspond at least partially to the control inputs during manual driving.
[0081] The present invention has been described in detail. It goes without saying that the selected embodiments have been chosen merely as examples to facilitate a better understanding of the present invention. Those skilled in the art will appreciate that the use of multiple prompt symbols is also possible. In particular, the disclosed teachings offer the following advantages: Conventional operating elements, such as the steering wheel 34 , turn signal lever 36 , and / or head-up display, can be utilized for new driving functions and / or for inputting strategic driving commands. Furthermore, an intuitive operating concept for inputting strategic driving commands can be created.
[0082] Reference Signs List
[0083] 10 Devices
[0084] 12 Input Interfaces
[0085] 14 Analysis Units
[0086] 16 output interfaces
[0087] 18 systems
[0088] 20 Augmented Reality / AR Displays
[0089] 22 Driving Assistance Systems
[0090] 24 projection units
[0091] 26 Tips
[0092] 28 Additional Tips
[0093] 30 front windshield
[0094] 32 sensors
[0095] 34 steering wheel
[0096] 36 turn signal lever
[0097] 37 Joystick
[0098] 38 navigation system
[0099] 40 motor vehicles
[0100] 42 output
[0101] 44 confirmation switch
[0102] S1-S4 method steps.
Claims
1. A device (10) for detecting a driver's intention for lane change assistance in an at least partially automated motor vehicle (40), comprising: an input interface (12) for receiving sensor data containing information about a roadway segment in the surroundings of the motor vehicle (40) and control data containing information about control inputs of a driver of the motor vehicle (40); an analysis unit (14) for determining a traffic situation in the surroundings of the motor vehicle (40) based on the sensor data and for generating control commands based on control data for controlling vehicle units of the motor vehicle (40); and an output interface (16) for transmitting the control command to a vehicle unit of the motor vehicle (40); It is characterized by: The control command causes the motor vehicle (40) to be controlled by a vehicle unit in the form of a driver assistance system (22) based on the driver's control input and the display of instructions (26, 28) about the control of the motor vehicle (40) by the vehicle unit in the form of a display, wherein the control input corresponds at least partially to the control input in the case of manual driving.
2. The device (10) according to claim 1, characterized in that The output interface (16) is designed to transmit the control command to an AR display (20) in the form of an AR HUD.
3. The device (10) according to claim 2, characterized in that The output interface (16) is designed for installation in a motor vehicle (40).
4. The device (10) according to claim 3, characterized in that The output interface (16) is part of an onboard computer, infotainment and / or navigation system (38).
5. The device (10) according to any one of claims 1 to 4, characterized in that The analysis unit (14) determines a control command that causes a display of a guide (26) for displaying a roadway traveled by the motor vehicle (40).
6. The device (10) according to claim 5, characterized in that The control command causes the display of a prompt (26) for showing the roadway traveled by the motor vehicle (40) by means of the prompt (26) through augmented reality positioning.
7. The device (10) according to any one of claims 1 to 4, characterized in that The input interface (12) is configured to receive control data from a steering wheel (34), a turn signal lever (36), a joystick (37) and / or a confirmation switch (44), and the control includes turning and / or changing lanes.
8. The device (10) according to any one of claims 1 to 4, characterized in that The analysis unit (14) determines a control command which, in response to a control input by the driver, causes the display of a further prompt (28) with information about a control to be performed by means of the driver assistance system (22) according to the control command.
9. The device (10) according to claim 8, characterized in that The control command, in response to the driver's control input, causes the display of a further prompt (28) with information about the control to be performed by the driver assistance system (22) according to the control command by means of a further prompt (28) through augmented reality positioning.
10. The device (10) according to claim 8, characterized in that The input interface (12) is designed to receive control data, which includes a confirmation of a control to be executed by means of the driver assistance system (22) according to the control command via a confirmation switch (44), wherein the control command causes the control to be executed after receiving the confirmation.
11. The device (10) according to any one of claims 1 to 4, characterized in that The input interface (12) is designed to receive control data in the form of abort data with information about the cancellation of a control to be executed according to the control command.
12. The device (10) according to claim 11, characterized in that The abort data includes a reverse rotation of the driver's steering wheel (34), a reverse control by means of a joystick (37), a tactile input and / or an acoustic input.
13. A system (18) for detecting a driver's intention for lane change assistance in an at least partially automated motor vehicle (40), comprising: - a device (10) according to any one of claims 1 to 12; - an AR display (20) for outputting a prompt (26) and / or a further prompt (28) in response to a control instruction of the device (10), and - a driver assistance system (22) for controlling the motor vehicle (40) in response to control commands of the device (10).
14. The system (18) according to claim 13, characterized in that The AR display (20) is a head-up display on the motor vehicle (40).
15. A method for detecting a driver's intention for lane change assistance in an at least partially automated motor vehicle (40), comprising the steps of: - receiving (S1) sensor data containing information about a roadway segment in the surroundings of the motor vehicle (40) and control data containing information about control inputs of a driver of the motor vehicle (40); - determining (S2) a traffic situation in the surroundings of the motor vehicle (40) based on the sensor data; - generating (S3) control instructions based on control data of a vehicle unit for controlling the motor vehicle (40); and - transmitting (S4) the control command to a vehicle unit of the motor vehicle (40), It is characterized by: The control command causes the motor vehicle (40) to be controlled by a vehicle unit in the form of a driver assistance system (22) based on the driver's control input and the display of instructions (26, 28) about the control of the motor vehicle (40) by the vehicle unit in the form of a display, wherein the control input corresponds at least partially to the control input in the case of manual driving.
16. A computer program product comprising a computer program for executing all steps of the method according to claim 15 when the computer program is executed on a computer or a corresponding computing unit.
Citation Information
Patent Citations
Autonomous driving system for a vehicle or method for carrying out the operation
DE102014220758A1
Methods of hydrotreating a liquid stream to remove clogging compounds
WO2007050477A1
System for selecting driving maneuvers of a vehicle for automated driving
US20190033855A1
Display control method and display control device
WO2020230313A1