Device and method for identifying turning intention of vehicle driver
An interior camera system with processing units and sensors accurately determines a vehicle driver's turning intentions, addressing the challenge of incorrect signal activation and enhancing road safety.
Patent Information
- Application Number
- JP2024068164
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-02
- Filing Date
- 2024-04-19
- Publication Date
- 2024-11-15
AI Technical Summary
Existing technologies struggle to reliably identify a vehicle driver's turning intention, especially when navigation information is unavailable, leading to potential incorrect activation of driving direction indicators and safety risks.
An interior camera system integrated in the vehicle, combined with processing units and sensors, analyzes the driver's gaze and vehicle data to determine turning intentions through heat maps and odometry, ensuring accurate activation or deactivation of turn signals.
Enhances road safety by reliably identifying turning intentions, preventing incorrect signal activation and improving driver assistance systems.
Smart Images

Figure 2024160953000001_ABST
Abstract
Description
[Technical field]
[0001] In an apparatus and method for identifying a vehicle driver's intention to turn (right or left), at least one image sequence having images each having a depiction of an area of the interior of the vehicle is detected using a vehicle camera disposed in the interior of the vehicle, and image data corresponding to the images is generated which is then processed. [Background technology]
[0002] Patent Document 1 discloses a method for controlling the direction indicators of a motor vehicle when the driver does not operate the direction indicators, in which a recognition device recognizes that the driver intends to perform a driving maneuver to change lanes or turn, and when the driver's intention is recognized, the direction indicators are activated.
[0003] Patent document 2 discloses a method for controlling the functions of a vehicle, in which the traffic situation the vehicle is currently in is determined. Alternatively or additionally, actions of the driver of the vehicle and information about the given traffic situation are evaluated, and the driving direction indicators of the vehicle are set depending on the result of the evaluation.
[0004] Patent Document 3 discloses a system for activating a turn signal of a vehicle. When a navigation system determines that a vehicle is approaching a corner, a turn signal can be automatically activated in the corresponding direction.
[0005] Basically, it is desirable to reliably determine the turning intention of the vehicle driver even when the route is not known and / or no navigation information is provided. In particular, erroneous driving direction indications should be reliably avoided. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] DE 102016220518 [Patent Document 2] DE 102017206605 A1 [Patent Document 3] US Patent Application Publication No. 2012 / 0089300 Summary of the Invention [Problem to be solved by the invention]
[0007] Based on the known prior art, it is therefore an object of the present invention to provide a device and a method for determining the turning intention of a vehicle driver. [Means for solving the problem]
[0008] The problem is solved by a device having the features according to claim 1 and by a method having the features of the independent claims. Advantageous developments are set out in the respective dependent claims.
[0009] By means of a device having the features of claim 1 it is possible to easily and reliably determine whether there is an intention of the vehicle driver to turn. On this basis it is possible to check whether the direction indicators of the vehicle, i.e. the turn signals, are correctly set. Preferably, if no intention to turn is determined, an erroneously activated direction indicator can be deactivated. Alternatively or additionally, a command to activate the direction indicator can be issued to the vehicle driver and / or the direction indicator of the vehicle can be activated automatically. This makes it possible to increase safety in road traffic.
[0010] The interior camera may be an interior camera integrated in the vehicle's rearview mirror or in the gouging of the rearview mirror, an interior camera arranged in the ceiling area and / or on the A-pillar on the driver's side and / or on the passenger's side above the driver and / or passenger. This allows easy and reliable detection of the vehicle's occupants. Furthermore, it is advantageous if the field of view of the interior camera has a detection angle in the range of 100-150°, the interior camera being preferably a monocular camera and / or an RGB-IR camera. This allows, in particular, image processing to be performed by the processing unit on the basis of the captured IR images. Furthermore, there is a sufficiently large field of view of the interior camera to detect the vehicle driver and to determine on the basis of the image data of the interior camera whether there is an intention to turn based on the vehicle driver's actions.
[0011] It is advantageous if the processing unit is configured to check whether at least one turning possibility of the vehicle is present in the visual perception range of the vehicle driver and whether the turning possibility is in the determined focus range in order to determine the first result. This makes it possible to reliably determine whether the focus of the vehicle driver on a focus range related to the intention to turn is present, in particular whether a road or an approach is present in the focus range. The focus can be determined in particular by means of a heat map.
[0012] It is further advantageous if the processing unit is configured to determine possible turns of the vehicle in the visual perception range of the vehicle driver based on the surrounding information of the surroundings of the vehicle provided by the surroundings detection unit and to check the first result based on this, and if the processing unit is configured to modify the first result based on the result of the check. The surroundings detection unit may be a LIDAR unit, a radar unit and / or a front camera, in particular a stereo front camera. In this case, the surroundings detection unit detects in particular the range in front of the vehicle and the range to the sides in front of the vehicle and generates a preferably 3D image of the surroundings of the vehicle. This makes it possible to easily check whether a possible turn exists in the focus range.
[0013] It is also advantageous if the processing unit is configured to check whether a risk-free turn is possible based on odometry data of the vehicle in order to determine the second result. The odometry data of the vehicle includes, in particular, the steering angle, the speed and / or the acceleration (positive and negative acceleration). This makes it possible to easily check whether a turn possibility exists in the focus range.
[0014] It is also advantageous if the processing unit is configured to check whether the vehicle driver's intention to turn is possible based on the stored odometry data assigned to the vehicle driver and / or the vehicle and on the odometry data of the vehicle in order to determine the second result, whereby a more precise check can be made as to whether the vehicle driver's intention to turn is possible or possible based on the usual driving behavior of the vehicle.
[0015] It is also advantageous if the processing unit is configured to check whether there are traffic-related reasons for the odometry data of the vehicle in order to determine the third result. Such traffic-related reasons can be a vehicle traveling ahead, a pedestrian crossing the roadway, the reaction of the vehicle driver to a stop sign or a right-of-way traffic sign, a speed limit or a traffic signal installation with a yellow or red indication. This can ensure that other causes for the odometry data to be determined can be taken into account or excluded. This can further improve the determination of the turn intention.
[0016] It is furthermore advantageous if the processing unit is formed to determine a positive first result if the focus range is determined outside the vehicle. The processing unit can also be formed to determine a positive first result only if the focus range is not only outside the vehicle but in particular in the expected turning direction with respect to the center of gravity. Thereby, a non-directly relevant line of sight of the vehicle driver in a straight line direction can also remain outside the vehicle but not taken into account for the detection of the intention to turn when determining the first result. Furthermore, the processing unit can be formed to determine a positive second result if turning of the vehicle in the direction of the determined focus range is enabled or not excluded by the odometry data. The processing unit can also be formed to determine a positive third result if the determined odometry data has no other cause. The processing unit can confirm the intention to turn only if all three results are positive. Thereby, the intention of the vehicle driver to turn can be reliably determined.
[0017] It is also possible for the processing unit to be configured to determine, as a first result, the probability of the presence of a focus range due to an intention to turn external to the vehicle, to determine, as a second result, the probability of the vehicle turning in the direction of the identified focus range based on the odometry data, and to determine, as a third result, the probability whether the identified odometry data has other causes.
[0018] The processing unit can be configured to determine an overall probability based on at least three results and to confirm the intention to turn if the determined overall probability exceeds a preset and stored limit value. It is also advantageous if the three individual probabilities are each compared with a limit value and an overall result is determined based on the result of the comparison. In particular, a positive overall result can be determined if all individual probabilities exceed the respective limit value. Alternatively, the overall result can be an overall probability that is compared with a preset and stored limit value again to determine whether or not an intention to turn is present. All the above-mentioned limit values can be set in relation to the vehicle driver and can in particular be stored in the vehicle, in the vehicle key or in a cloud storage assigned to the vehicle driver.
[0019] Furthermore, the processing unit can be configured to output information to the vehicle driver via an output unit of the vehicle to operate the driving direction indicator, or to automatically activate the driving direction indicator after a predefined time if the vehicle driver does not cancel it, thereby enabling accurate driving direction indication of the vehicle to be activated, thereby increasing safety in road traffic.
[0020] Preferably, the processing unit is configured to detect the gaze direction of the vehicle driver over a preset time period of several seconds and to determine the focus range based on the gaze of the vehicle driver towards the outside of the vehicle in order to determine the first result. In particular, a heat map is created based on the gaze or the gaze direction and compared with at least one heat map of the vehicle driver determined in a traffic situation in which the vehicle driver has no intention of turning.
[0021] When determining the focus range or the heat map, the vehicle driver's line of sight directed to the interior of the vehicle, such as the instrument cluster, the instrument panel, the rearview mirror, and the exterior mirror, is not taken into account or is excluded, so that the focus range and the heat map can be accurately determined.
[0022] The processing unit can be configured to detect the head-eye-rotation of the vehicle driver over a preset time period of several seconds and to determine the focus range based on the detected head-eye-rotation in order to determine the first result. For example, an evaluation algorithm or an artificial neural network can be used for the head-eye-rotation and / or focus range determination. This facilitates reliable detection of turning intentions for different vehicle driver types.
[0023] The processing unit can also be configured to detect the odometry pattern over a preset period of several seconds and compare it with the stored odometry pattern for the vehicle driver and / or the vehicle to determine the second result, thereby making it possible to easily check whether the vehicle driver actually has the intention to turn.
[0024] It is advantageous if the processing unit is configured to determine possible turning directions (e.g. on the basis of map data or on the basis of video analysis) in order to determine the second result and to perform a plausibility check for the safe execution of a turning maneuver in the determined turning direction (e.g. using the determined curve radius and the vehicle speed). For this purpose, a necessary driving interval can be determined and it is possible to determine the determined driving interval with the current driving speed data and driving direction data for the plausibility check of the intention to turn. It is also possible to determine a necessary driving interval that is plausible for the safe execution of a turning maneuver in the determined turning direction and to check the possibility of performing the determined driving interval with the current driving speed data and driving direction data for the plausibility check of the intention to turn. In this way, it is possible to easily check whether the vehicle driver actually has the intention to turn.
[0025] It is advantageous if the processing unit is configured to check whether objects, such as vehicles, persons and / or stationary objects, on which the current driving speed data and driving direction data are based, are in the vehicle's driving trajectory and / or whether a collision or approach of the recognized object's trajectory with the vehicle's driving trajectory is predictable in order to determine the third result. If no collision or approach is predicted, the possibility of a turn intention is increased or an already determined turn intention can be confirmed. This also makes it possible to easily check whether the vehicle driver actually has the intention to turn.
[0026] An intention to turn within the meaning of this application may include an intention to turn or enter a road as well as an intention to change lanes or to turn.
[0027] A method having the features of an equivalent method claim has the same advantages as the claimed device. The method can be developed with the same features as above, but with the features of the dependent claims directed in particular to the device.
[0028] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. [Brief description of the drawings]
[0029] [Figure 1] FIG. 1 is a schematic perspective view of a driver's seat (cockpit) of a vehicle. [Diagram 2] FIG. 2 shows a schematic diagram of a first image of the interior of the vehicle taken by a camera. [Diagram 3] FIG. 2 is a diagram illustrating the determination of the line of sight direction of a vehicle driver of a vehicle. [Figure 4] 4 is a graph with a heatmap of the gaze direction of the vehicle driver according to FIG. 3; [Diagram 5] 1 is a graph having a heat map of a vehicle driver's accumulated gaze direction over a preset period of time during a no-turn-intent portion of a journey. [Figure 6] 11 is a graph with a heat map of the vehicle driver's accumulated gaze direction over a preset time period during another portion of the trip. [Figure 7] 7 is a graph with a heatmap with the difference between the heatmap according to FIG. 5 and the heatmap according to FIG. 6. [Figure 8] 8 is a graph with a heat map according to FIG. 7 with surrounding data overlaid to identify turn probability. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0030] In Fig. 1, a schematic perspective view of a cockpit 100 of a vehicle 102 is shown. A vehicle driver 104 is seated in a cockpit 106 of the vehicle 102. In addition, the cockpit 100 includes a central information display (CID) 108, a head-up display 110 and a graphical instrument cluster 112, which are arranged in a dashboard 114 of the vehicle 102. The display elements 108, 110, 112 each form a functional unit of an output unit of the vehicle 102, which is arranged to output information to the vehicle driver 104 and / or to another passenger 206 (see Fig. 2). At least one speaker 116 of an entertainment system of the vehicle 102 is also arranged in the cockpit 100. The speaker 116 also forms a functional unit of the output unit. The functional unit of the output unit is also used as a playback unit for audio and / or video playback.
[0031] The driver's seat 100 further comprises a steering wheel 118 with operating elements 120, a gear select switch (shift lever) 122, pedals 124 and an input unit 126 with rotary knob and push button functions and / or a touch input field (screen), also called an ERGO COMMANDER.
[0032] Located in the upper area of the windshield 128 of the vehicle 102 is a rearview mirror 132 and an interior camera 134 integrated into the rearview mirror 132. The interior camera 134 is configured to detect an image having a depiction of at least one area of the interior of the vehicle 102 and is integrated into the rearview mirror 132. In particular, the field of view of the interior camera 134 is directed toward the driver's seat 106 and the passenger seat 202 of the vehicle.
[0033] An exemplary image 200 captured by the interior camera 134 is shown in Fig. 2. The interior camera 134 is particularly configured to detect time-sequential images, particularly in the form of a video stream, generate image data corresponding to the image 200 and transmit said image data to a control unit 138, which serves as a processing unit.
[0034] The control unit 138 has a data output 140 and a data input 142, which are used to connect to other units of the vehicle 102, such as other cameras, sensors, input units, output units and control units of assistance systems.
[0035] The control unit 138 further comprises a communication module 144, which is adapted to establish a connection with a telecommunications network, in particular a mobile radio network.
[0036] Additionally, another camera in the interior of the vehicle 102 may be located on an A-pillar or above the vehicle driver 104. The interior camera 134 and / or another interior camera may be used to detect the direction of the vehicle driver 104's gaze while the vehicle 102 is in use.
[0037] In FIG. 2, an image 200 of the interior of the vehicle 102 taken by the interior camera 134 is shown in a schematic manner. The interior camera 134 has a field of view of 120°, purely by way of example. It is particularly advantageous if the camera 134 is an RGB-IR interior camera. In other embodiments, the interior camera 134 can also have a field of view in the range of 150° or more. The interior camera 134 is directed towards the driver's seat 106, the passenger seat 202 and the rear seat 204 of the vehicle. In the situation shown in FIG. 2, the vehicle driver 104 is seated in the driver's seat 106 and another passenger 206 is seated in the passenger seat 202. In this embodiment, the other passenger 206 is therefore a passenger seat passenger 206. In the image 200, the vehicle driver is wearing a smart watch 136 and the passenger seat passenger 206 is holding a tablet computer 208.
[0038] In Fig. 3, the determination of the gaze direction of a vehicle driver 104 of a vehicle 102 is shown in a schematic manner. For illustrative purposes, a scale of a horizontal rotation angle 302 and a scale of a vertical rotation angle 304 are shown. The rotation angles 302, 304 may be relative to the vehicle coordinate system of the vehicle 102. The gaze vector 300 of the vehicle driver 104 has a horizontal rotation angle 302 of -17.5° and a vertical rotation angle 304 of +2.5° in the driving situation shown in Fig. 3. To create the heat map, the coordinate system of the horizontal rotation angle 302 and the vertical rotation angle 304 is divided into gaze direction segments 306 of a size of 5° x 5°. The gaze vector 300 extends through the gaze direction segments 306.
[0039] FIG. 4 shows a graph with a heat map 310 of the gaze vector 300 detected on the basis of one image taken by the interior camera 134, i.e. the current gaze direction segment 306 of the driving situation according to FIG.
[0040] A gaze direction vector 300 having two components, a horizontal rotation angle 302 and a vertical rotation angle 304, is accumulated and detected over a predefined period of time ranging from 5 to 90 minutes during normal, i.e., driving segments without turning (right-left) maneuvers, lane-changing maneuvers or turning maneuvers. This identifies the individual "normal behavior" of the vehicle driver 104. This is illustrated in the graph shown in FIG. 5 with a heat map 320 of the accumulated gaze direction 300 of the vehicle driver 104 over a predefined period of 90 minutes during driving segments without turning. Such a heat map 320 is also called a long term heat map. The numbers in the heat map 320 and in the heat maps in the following figures indicate the presence of the gaze vector 300 in the corresponding gaze direction segment 306 in percentage. The heat maps 310, 320 and in the heat maps in the other figures are resolved in an angle step of 5°. In other embodiments, larger or smaller angle steps can be used.
[0041] In Fig. 6, a graph is shown with a heat map 330 of the accumulated gaze direction of the vehicle driver 104 for a pre-defined short time period ranging from 2 to 60 seconds, in particular 5 seconds, during another travel section, in which it should be checked whether the vehicle driver 104 currently has or does not have a turning intention. Thus, the heat map 330 is a temporary heat map 330 of the current travel situation. It is also called a short term heat map 330. During the other travel section, it should be checked whether the vehicle driver has a turning intention.
[0042] An intention to turn within the meaning of this application may include an intention to turn or enter a road as well as an intention to change lanes or to turn.
[0043] The short-term heatmap 330 is created similarly to the long-term heatmap 320 used as a reference, but without consideration of the vehicle driver's 104 line of sight to the center and side mirrors and other interior compartments of the vehicle. Here, for example, only horizontal rotation angle 302 segments are considered in the range of -15° to -25° and vertical rotation angles in the range of 0 to 5° during evaluation. In other embodiments, other range / gaze angle segments may not be detected or may not be considered during the creation of the heatmaps 310-330.
[0044] FIG. 7 shows a graph having a difference heatmap 340 identified based on the difference between the heatmap 330 of FIG. 6 and the heatmap 320 of FIG. 5 when the corresponding values in the heatmap 330 are greater than the values in the heatmap 320.
[0045] The difference heatmap 340 can be computed as follows: If the value of the image segment SEGST(H,V)>the value of the image segment SEGLT(H,V), then the value of the image segment SEGD(H,V)=SEGST(H,V)-SEGLT(H,V), otherwise the value of the image segment SEGD(H,V)=0; SEGST = value of the image segment at location H (horizontal) and V (vertical) of the short-term heatmap 330 SEGLT - the value of the image segment at location H (horizontal) and V (vertical) of the long-term heatmap 320 SEGD - the value of the image segment at location H (horizontal) and V (vertical) in the difference heatmap 340 It is.
[0046] The difference heat map 340 thus represents the focus area of the vehicle driver 104 related to the intention to turn. The image segments SEGD(H,V) of the difference heat map 340 can then be mapped to the surroundings in order to identify the most probable turning option. The mapping requires compensation for the intrinsic movement of the vehicle 102. For simple illustration, FIG. 8 shows a graph with the difference heat map 340 according to FIG. 7 with overlaid surrounding data for identifying turning possibilities in a snapshot. The overlay of the difference heat map 340 with the surroundings was performed by 2D map data 350. In other embodiments, 3D map data or 2D or 3D camera data of the front camera or surrounding information provided by other surrounding detection units (lidar, radar) of the vehicle 102 can also be used for the overlay.
[0047] All existing turn options in the visual range of the vehicle driver are identified based on map data and / or front camera data and / or sensor data of the surroundings detection unit. In the embodiment according to Fig. 8, a side road 352 and a side road 354 are identified as turn options. For each identified turn option 352, 354, a turn probability is respectively determined in relation to the segmentation and weighting of the focus points in the difference heat map 340. For example, the turn probability of the turn option onto the side road 354 is 10%, and the turn probability of the turn option onto the side road 352 is 75% as a first result.
[0048] The control unit 138 determines, based on odometry data of the vehicle 102, as a second result, a possibility of turning the vehicle 102 in the direction of the determined focus range.
[0049] Furthermore, the control unit 138 checks whether the odometry data that allows the turn has other causes based on the surrounding information provided by the surrounding detection unit, and identifies the result of the check as a third result.
[0050] Based on the three identified results, the control unit 138 ascertains (determines) whether the vehicle operator 104 has an intention to turn. Based on this, the vehicle 102's driving direction indicators (blinkers) can be automatically activated or a notification is output to the vehicle operator 104 to activate the driving direction indicators.
[0051] Furthermore, if the driving direction indicator is automatically activated in the traffic situation shown in Fig. 8 with two nearby turning options 352, 354 in the same direction, the activation time can be selected so that the setting of the driving direction indicator for turning onto the side road 352 is automatically performed at the earliest after passing by the vehicle on the side road 354. This can increase safety by avoiding dangerous situations. For example, if there is an intention to turn onto the side road 352 but the driving direction indicator is activated before the side road 354, the vehicle coming from the side road 354 may mistakenly recognize the intention of the host vehicle 102 to turn, which may lead to entering the road on which the host vehicle 102 is located.
[0052] The above mentioned processing steps, in particular the steps of processing the image data and creating the heatmap, are performed by the control unit 138 which serves as a processing unit.
[0053] In the embodiment described on the basis of Figures 1-8, at least the interior camera 134 and the control unit 138 form an apparatus for determining a turning intention of a vehicle driver 104 of a vehicle 102. The further elements and features shown in Figures 1-8 and mentioned in the above description may be part of the apparatus for determining a turning intention of a vehicle driver 104 of a vehicle 102. Similarly, method steps described on the basis of an apparatus may also be part of the claimed method. [Explanation of symbols]
[0054] 100 Driver's seat 102 vehicles 104 Vehicle Operator 106 Driver's seat 108 Central Information Display 110 Head-up display 112 Graphical Instrument Cluster 114 Dashboard 116 Speaker 118 Steering Wheel 120 Operational Elements 122 Gear select switch 124 Pedals 126 input units 128 Windshield 130 Mike 132 Rearview mirror 134 Interior Camera 136 Smart Watches 138 Control Unit 140 Data output section 142 Data Entry Section 144 Communication Interface 200 images 202 Passenger seat 204 Back seat 206 Passenger seat passenger 208 Tablet Computer 300 Line of Sight Vector 302 Horizontal rotation angle scale 304 Vertical rotation angle scale 310,320,330,340 Heatmap 350 Map Data 352,354 Side Street
Claims
1. an interior camera (134) of the vehicle (102) arranged in an interior of the vehicle (102) and configured to detect at least one image sequence having an image (200) each having a depiction of an area of the interior of the vehicle and to generate image data corresponding to the image (200); a processing unit (138) configured to process the image data; A device for identifying a driver's intention to turn, comprising: the processing unit (138) is configured to determine as a first result a focus range (340) of the vehicle driver (104) outside the vehicle (102) based on image data of the interior camera (134); the processing unit (138) is configured to determine, based on the odometry data of the vehicle (102), as a second result, a possibility of turning the vehicle (102) in the direction of the determined focus range (340); the processing unit (138) is configured to check, by a surroundings detection unit, whether the odometry data that allows a turn has another cause and to identify a result of the check as a third result; The processing unit (138) is configured to confirm the intention to turn based on the three identified outcomes. An apparatus comprising:
2. 2. The apparatus of claim 1, wherein the processing unit (138) is configured to check whether at least one turn possibility (352, 354) of the vehicle (102) is within a visual grasp of the vehicle operator (104) and whether the turn possibility is within the identified focus range (340) to identify the first result.
3. 3. The device according to claim 1 or 2, characterized in that the processing unit (138) is configured to identify possible turning directions (352, 354) of the vehicle (102) in a visual perception range of the vehicle driver (104) based on surrounding information of the surroundings of the vehicle (102) provided by the surroundings detection unit and to check a first result based thereon, and the processing unit (138) is configured to modify the first result based on a result of the check.
4. 4. The device according to claim 1, wherein the processing unit (138) is configured to check whether a risk-free turn is possible based on odometry data of the vehicle in order to determine the second result.
5. 5. The device according to claim 1, wherein the processing unit (138) is configured to check whether there may be a turning intention of the vehicle driver (104) based on stored odometry data assigned to the vehicle driver (104) and / or the vehicle (102) and on odometry data of the vehicle (102) in order to determine the second result.
6. 6. The apparatus according to claim 1, wherein the processing unit (138) is configured to check whether a traffic-related reason exists for the odometry data of the vehicle (102) to identify the third result.
7. the processing unit (138) is configured to identify the first result as positive if the focus area (340) outside the vehicle (102) is in a predetermined turning direction; the processing unit (138) is configured to determine the second result as positive if turning of the vehicle (102) in the direction of the determined focus range is permitted by the odometry data; the processing unit (138) is configured to determine the third outcome as positive if the determined odometry data does not have other causes; said processing unit (138) confirming the intention to turn only if all three results are positive; The device according to any one of claims 1 to 6, characterized in that
8. the processing unit (138) is configured to determine as a first result a probability of the presence of a focus area (340) due to an intent to turn external to the vehicle (102); the processing unit (138) is configured to determine, as a second result, a probability of the vehicle (102) turning in the direction of the determined focus range (340) based on the odometry data; the processing unit (138) is configured to determine an overall probability based on at least the three outcomes and to confirm the intention to turn if the determined overall probability exceeds a preset and stored limit value; The device according to any one of claims 1 to 7, characterized in that
9. 9. The device according to claim 1, wherein the processing unit (138) is configured to output information to the vehicle driver (104) via an output unit (110, 116, 118) of the vehicle (102) to operate a driving direction indicator, or, if not cancelled by the vehicle driver (104), the driving direction indicator is automatically activated after a preset time.
10. The apparatus according to any one of claims 1 to 9, characterized in that the processing unit (138) is configured to detect a gaze direction of the vehicle driver (104) over a preset period of several seconds to determine the first result, and to determine the focus range (340) and preferably a heat map (330, 340) of the gaze based on the gaze of the vehicle driver (104) directed towards the outside of the vehicle (102).
11. The device according to any one of claims 1 to 10, characterized in that the processing unit (138) is configured to detect a head-eye-rotation of the vehicle driver (104) over a preset time period of several seconds in order to determine the first result, and to determine the focus range (340), in particular a heat map (330, 340), based on the detected head-eye-rotation.
12. 12. The apparatus of claim 1, wherein the processing unit (138) is configured to detect an odometry pattern over a preset period of a number of seconds and compare it with stored odometry patterns for the vehicle driver (104) and / or the vehicle (102) to determine the second result.
13. 13. The device according to claim 1, wherein the processing unit (138) is configured to identify possible turning directions (352, 354) for identifying the second result, to identify a plausible required driving interval for the safe execution of a turning maneuver in the identified turning direction (352, 354), and to check the possibility of executing the identified driving interval with current driving speed data and driving direction data for checking the plausibility of the turning intention.
14. The device according to any one of claims 1 to 13, characterized in that the processing unit (138) is configured to check whether an object on which the current driving speed data and driving direction data are based is in the vehicle driving trajectory and / or whether a collision or approach of the recognized object's trajectory with the vehicle driving trajectory is predictable in order to identify the third result.
15. 1. A method for identifying a vehicle driver's intention to turn, comprising: using an interior camera (134) of the vehicle (102) arranged in the interior of the vehicle (102), at least one image sequence having images (200) each having a depiction of an area of the interior of the vehicle (102) and image data corresponding to said images (200) is generated; The image data is processed; A focus range (340) of the vehicle driver (104) outside the vehicle (102) is identified as a first result based on image data of the interior camera (134); determining, as a second result, a possibility of the vehicle (102) turning in the direction of the identified focus range (340) based on the odometry data of the vehicle (102); The surroundings detection unit checks whether the odometry data that allows the turn has another cause, and the result of the check is identified as a third result; The intention to turn is confirmed based on the three identified outcomes. A method comprising:
Citation Information
Patent Citations
Method for controlling a direction indicator of a motor vehicle, control device for the motor vehicle and motor vehicle
DE102016220518A1
Method and system for controlling a vehicle
DE102017206605A1
Navigation system activation of a vehicular directional signal
US20120089300A1
