Method for controlling a vehicle

Abstract

Method (100) for controlling a vehicle (50), wherein the method (100) comprises a determination (106) as to whether a traffic light (52) is located in the field of vision (51) of a driver of the vehicle, wherein, depending on the determination (106), information on a traffic light status with regard to the traffic light is displayed (107) in the field of vision of the driver, characterized in that the determination as to whether the traffic light is located in the field of vision of the driver of the vehicle is based on the information transmitted from the traffic light to the vehicle (101).

Description

[0001] The present invention relates to a method and a device for controlling a vehicle according to the independent claims.

[0002] Depending on the traffic situation and the arrangement of traffic lights at intersections, a driver may have to lean forward or sideways to observe a red light and determine when it will turn green. This creates uncertainty and an uncomfortable driving position for the driver. The current state of technology fails to provide an optimal solution to this problem.

[0003] US 10 152 886 B2, for example, describes a traffic sign warning system for a vehicle, which includes a camera, whereby a status of traffic signs can be displayed.

[0004] US 10 810 774 B2 describes an electronic device that can project an image onto the windshield of a vehicle. The system may include a camera to capture an object outside the vehicle.

[0005] DE 10 2014 003 781 A1 describes a driver assistance system for a motor vehicle designed as a traffic light assistant. When displaying information, an evaluation unit takes into account parameters dependent on the driving situation, such as the distance to a vehicle in front or the distance to a stop line at a traffic light.

[0006] DE 10 2021 200 090 A1 describes a method for generating driving assistance for a driver of a motor vehicle. The method comprises recording a vehicle environment using a vehicle camera of the motor vehicle and simultaneously recording a viewing direction of the driver of the motor vehicle using a driver observation camera, determining a focus area of ​​the driver in the recorded vehicle environment based on the recorded viewing direction, determining a driver's intention based on the determined focus area in the recorded vehicle environment, and generating driving assistance for the driver of the motor vehicle based on the determined driver's intention.

[0007] DE 10 2015 015 676 A1 describes a method for automatically displaying an image of the surroundings on a vehicle's display unit. A current image of the vehicle's surroundings is generated and a driver's observer position is determined. One method uses the driver's eye position, the position of a traffic light in the surroundings, and CAD data from a vehicle's windshield to determine whether the view of the traffic light is obscured. If the view is obscured, the image of the surroundings containing the traffic light is displayed on the display unit.

[0008] The present invention is based on the object of optimizing a method for controlling a vehicle in such a way that information about traffic lights in its surroundings is provided reliably and in a targeted and effective manner with minimal inconvenience for the driver.

[0009] The aforementioned problem is solved by a method for controlling a vehicle, wherein the method comprises determining whether a traffic light is within the field of vision of a driver of the vehicle. Depending on whether a traffic light is within the driver's field of vision, information about the traffic light status is displayed in the driver's field of vision. In other words, the information is specifically displayed in the driver's field of vision to supplement their perception. This occurs particularly when the traffic light is not within the driver's field of vision.

[0010] In particular, information is transmitted from the traffic light, preferably directly, to the vehicle. Each traffic light located within a defined vicinity of the vehicle can preferably regularly send information to all corresponding vehicles. According to the invention, the determination that a traffic light is within the field of vision of a driver of the vehicle is therefore not based on sensor data from the vehicle, but on direct information from the traffic light to the vehicle. In particular, the determination is not based on imaging-based traffic light detection, e.g., using a camera, lidar, or radar sensors. The information is transmitted from the traffic light to the vehicle, in particular, via Wi-Fi or mobile communications. One possible system is Car2X, where V2X, V2V, and V2I are synonyms. Alternatively, the information can be transmitted to the vehicle via a backend.In other words, this means that the traffic light sends the information to a backend, for example to a central evaluation unit, most preferably a cloud, via wireless communication, whereby this backend forwards information to, for example, all vehicles located in a previously defined environment of a corresponding traffic light.

[0011] Furthermore, the information can be transmitted to the vehicle from at least one other vehicle, preferably again via Car2X. The other vehicle can have received the information regarding the traffic light via its own sensors, directly from the traffic light, or via information received via a backend.

[0012] The method particularly comprises determining a driver's field of vision, wherein the field of vision is determined depending on the driver's current seating position. Furthermore, the driver's eye position can be determined as part of the field of vision determination. The driver's current position is thus taken into account when determining the field of vision, with the seating position and eye position most preferably being taken into account. For this purpose, a driver observation camera can be used, which can determine the driver's position, for example the seat height, and the eye alignment. Furthermore, an angle to the A-pillar of the vehicle can also be taken into account. Furthermore, the restriction of the field of vision based on the geometric specifications for the windshield can be taken into account. For example, the field of vision is blocked by the upper edge of the windshield.In particular, the driver's field of vision is determined regularly, so that a change in the driver's position is taken into account. The system can also detect a change in driver position and subsequently recalculate the field of vision.

[0013] The position of the traffic light in the vehicle's surroundings can be determined, for example, using a sensor on the vehicle. This could be a camera, a lidar, or a radar sensor. Overall, based on the field of view and the position of the traffic light, it can be determined whether the driver can see the traffic light.

[0014] The information is typically projected onto the vehicle's windshield. Alternatively, or additionally, the information can also be displayed on a screen inside the vehicle. This eliminates the need for the driver to assume an uncomfortable position to perceive, for example, a change in traffic light status, but can rely on the display inside the vehicle.

[0015] The traffic light status is preferably understood to mean the color the traffic light is currently displaying. Information about the traffic light status can primarily be displayed using the traffic light symbol under "Display of the current traffic light status." Furthermore, information about the remaining display time of a current traffic light status can be displayed. Furthermore, the time of a future status change of the traffic light status can be displayed. Information about the traffic light status and / or the remaining display time of a current traffic light status and / or the time of a future status change can be transmitted, in particular, from the traffic light directly and / or via a backend to the vehicle. Therefore, no detection of the traffic light status by corresponding sensors is necessary.This significantly increases the reliability of traffic light status information, as no sensors are required that can be affected by weather conditions or other optical challenges, such as glare.

[0016] Furthermore, information about a direction of travel can be displayed. For example, a traffic light that only controls the right-turn lane can be assigned the right direction of travel. The assigned direction of travel can be indicated, for example, via an arrow that can be assigned to a corresponding traffic light symbol.

[0017] Furthermore, information about the vehicle's target speed can be displayed to avoid a stop at the traffic light. This can also be displayed next to the corresponding traffic light symbol, for example. When determining the target speed, the traffic light status, the expected time of the status change, the vehicle's distance from the traffic light, and the vehicle's current speed can be taken into account.

[0018] In particular, information on the traffic light status and / or other information mentioned above for each traffic light within the driver's field of vision is displayed in the driver's field of vision. By displaying the information on the traffic light status and preferably the other information mentioned above, the driver's perception is expanded accordingly. In other words, the driver experiences a reality supplemented by essential information. This is primarily achieved via an augmented reality projection that preferably incorporates the traffic light virtually into the windshield. By displaying the information directly in the driver's field of vision, the driver is not distracted, as they do not have to avert their gaze to recognize traffic light information. Furthermore, energy efficiency is increased through anticipatory driving and optimal adjustment of speed to information about traffic lights in the vehicle's surroundings.Consequently, safety is increased because the driver is optimally supported in controlling the vehicle. The driver's stress level is also reduced because they can rely on the information displayed. Furthermore, ergonomics are improved by recognizing all relevant information without moving into an uncomfortable seating position. Overall, the vehicle's level of intelligence is increased because more information can be made available to the driver. No additional sensors are required to implement the process described above.

[0019] In a further aspect, the present invention relates to a device for controlling a vehicle, wherein the device is designed to determine whether a traffic light is within the field of vision of a driver of the vehicle and to display information about the traffic light status with regard to the traffic light in the surroundings of the vehicle depending on whether the traffic light is within the driver's field of vision. In particular, the device is designed to carry out a method described above.

[0020] They describe in a purely schematic representation: Fig. 1: a process diagram of a method for controlling a vehicle; Fig. 2: a device for controlling a vehicle; Fig. 3: a field of vision of a vehicle; and Fig. 4: a field of view from the driver's perspective with information about the traffic light status displayed.

[0021] In Fig. 1 shows a method 100 for controlling a vehicle.

[0022] First, information about the traffic light status can be transmitted from a traffic light to the vehicle 101 or from other vehicles to the vehicle 102.

[0023] The method 100 includes determining 103 the field of vision. For this purpose, the driver's seating position is determined 104 and the eye position is determined 105. The method includes determining 106 whether a traffic light is within the driver's field of vision. Information on the traffic light status of each traffic light within the field of vision is displayed 107 in the driver's field of vision.

[0024] Furthermore, information on the remaining display time of a current traffic light status can be displayed 108, information on a time of a future status change can be displayed 109, information on an assignment of the traffic light to a direction of travel can be displayed 110 and / or information on a target speed of the vehicle to avoid a stop time at the traffic light can be displayed 111. All information can be displayed as a projection on a windshield of the vehicle 112 or displayed on a screen of the vehicle 113.

[0025] Fig. 2 shows a device 10 for controlling a vehicle.

[0026] The device 10 primarily comprises a sensor 11 for environmental detection. The sensor 11 can be embodied, for example, as a camera or a LIDAR sensor. It is designed to detect the position of a camera. Furthermore, the device 10 comprises an interface 16 for receiving information from a traffic light, a backend, and / or other vehicles. Furthermore, the device 10 can have an interior sensor 12, for example, a driver observation camera, to determine the seat position and / or eye position of a driver and, based on this, to determine the driver's field of vision.

[0027] The device 10 can comprise an evaluation unit 13 designed to determine whether a traffic light is located in the vehicle's field of vision. Furthermore, all information received either from other vehicles, from the sensor for environmental detection, from the interior sensor and / or from the traffic light and / or a backend can be evaluated. Furthermore, a remaining display time, a time of a future status change, an assignment of the traffic light to a direction of travel and / or a target speed of the vehicle to avoid a stop time at the traffic light can be determined. The device 10 can comprise a control unit 14 designed to display correspondingly determined information, preferably by means of a display unit 15, which can be designed, for example, as a windshield and / or screen.

[0028] Fig. Figure 3 shows a field of view 51 of a vehicle 50. The field of view 51 results from the driver's eye level and his seating position. Furthermore, the field of view 51 can be limited by the geometric constraints of the windshield of the vehicle 50. Schematically, Fig. 3 shows a traffic light 52 located within the field of vision 51 and a traffic light 52 located outside the field of vision 51. To see the traffic light 52 located outside the field of vision 51, the driver would have to lean forward significantly. Therefore, in the exemplary variant shown, the traffic light 52 is only displayed on the display unit 15 of the vehicle 50 when the traffic light 52 is located outside the driver's field of vision 51.

[0029] In Fig. Figure 4 shows how information about the traffic light status and other information is provided to the driver of a vehicle. Fig.4 depicts a field of view from the driver's perspective through a vehicle windshield. It is clearly visible that a traffic light 52 is not located in the driver's field of view 51, so that information about the traffic light status 53 of the traffic light 52 is displayed at the upper end of the field of view, namely as a traffic light symbol under the traffic light status display, in which the red light of the traffic light is displayed as a color indication 54. In addition, information about the waiting time until a status change to green occurs is also displayed. List of reference symbols 100 methods for controlling a vehicle 101 Transmission of traffic light status information from the traffic light to the vehicle 102 Transmission of traffic light status information from other vehicles to the vehicle 103 Determining the field of view 104 Determining the driver's seating position 105 Determining the driver's eye position 106 Determination of whether a traffic light is within the field of vision of a driver of the vehicle 107 Display of traffic light status information regarding the traffic light in the driver's field of vision depending on whether a traffic light is in the driver's field of vision 108 Displaying information about the remaining display time of a current traffic light status 109 Displaying information at a time of a future status change 110 Displaying information about the assignment of traffic lights to a direction of travel 111 Display of information on a target speed of the vehicle to avoid a stop time at the traffic light 112 Fade in as a projection in a windshield of the vehicle 113 Display on a vehicle screen 10 Device for controlling a vehicle 11 Environment detection sensor 12 Interior sensor 13 Evaluation unit 14 Control unit 15 Fade-in unit 16 Interface 50 vehicles 51 field of view 52 traffic lights 53 Information on traffic light status 54 Color information

Claims

[1] Method (100) for controlling a vehicle (50), wherein the method (100) comprises a determination (106) as to whether a traffic light (52) is in the field of vision (51) of a driver of the vehicle, wherein, depending on the determination (106), information on a traffic light status with regard to the traffic light is displayed (107) in the driver's field of vision, characterized by that the determination of whether the traffic light is in the field of vision of the driver of the vehicle is based on the information transmitted from the traffic light to the vehicle (101). [2] Method (100) according to claim 1, characterized by that the information is transmitted to the vehicle via a backend. [3] Method (100) according to claim 1, characterized by that the information is transmitted directly to the vehicle. [4] Method (100) according to claim 1, characterized by that the information is transmitted by at least one other vehicle (102). [5] Method (100) according to one of the preceding claims, characterized by that a field of vision of the driver is determined (103), wherein the field of vision is determined depending on the current seating position of the driver. [6] Method (100) according to claim 5, characterized by that the driver’s eye position is determined (105). [7] Method (100) according to one of the preceding claims, characterized by that the information is projected onto a windscreen of the vehicle (112). [8] Method (100) according to one of the preceding claims, characterized by that the information is displayed on a screen in the vehicle (113). [9] Method (100) according to one of claims 7 or 8, characterized by that the information is displayed as a traffic light symbol showing the current traffic light status. [10] Method (100) according to one of the preceding claims, characterized bythat information on the remaining display time of a current traffic light status is displayed (108). [11] Method (100) according to one of the preceding claims, characterized by that information is displayed at the time of a future status change (109). [12] Method (100) according to one of the preceding claims, characterized by that information about the assignment of the traffic light to a direction of travel is displayed (110). [13] Method (100) according to one of the preceding claims, characterized by that information on a target speed of the vehicle is displayed to avoid a stop time at the traffic lights (111). [14] Device (10) for controlling a vehicle (50), wherein the device (10) is designed to determine whether a traffic light (52) is in the field of vision (51) of a driver of the vehicle and to display information on the traffic light status with regard to the traffic light in the field of vision of the driver depending on the determination, characterized by that the determination of whether the traffic light is in the field of vision of the driver of the vehicle is based on the information transmitted from the traffic light to the vehicle.

Images