Driving Support Devices

By integrating viewpoint position estimation, sun curtain angle sensing, viewpoint angle calculation and viewpoint range calculation units in the driver assistant device, combined with a variety of sensors, the viewpoint range between the driver's viewpoint and the height of the traffic light is solved, and the problem of neglecting internal environmental impact in the prior art is ensured to ensure the visibility of traffic lights.

JP7673699B2Active Publication Date: 2025-05-09TOYOTA JIDOSHA KK
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022108985
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-07-06
Publication Date
2025-05-09
Estimated Expiration
2042-07-06

AI Technical Summary

Technical Problem

When ensuring that traffic lights are visible to vehicle drivers, the prior art ignores the impact of the internal environment on the driver's perspective, resulting in insufficient visibility of traffic lights.

Method used

By introducing a viewpoint position estimation unit, a sun curtain angle sensing unit, a viewpoint angle calculation unit and a viewpoint range of sight calculation unit in the driver assistant device, combined with the driver surveillance camera, a sun curtain angle sensor and a front sensor, the viewpoint distance between the driver's viewpoint and the height of the traffic light is calculated to ensure the visibility of the traffic light.

Benefits of technology

The visual distance to the traffic light is calculated based on the driver's internal perspective environment, thereby ensuring the visibility of the traffic lights, and solving the problem of neglecting the internal environmental impact in the prior art.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007673699000001
    Figure 0007673699000001
  • Figure 0007673699000002
    Figure 0007673699000002
  • Figure 0007673699000003
    Figure 0007673699000003
Patent Text Reader

Abstract

To provide a driving support device capable of calculating a visual recognition distance between an own vehicle and a traffic light in order to secure visibility of the traffic light.SOLUTION: A driving support device 1 includes: a viewpoint position estimation section 11 for estimating a viewpoint position of a driver based on a photographed image of a driver monitor camera 2 or a seat position of a driver's seat; an angle estimation section 12 for estimating a sun visor angle based on a detection result of an angle sensor 3 of the sun visor 23 for a driver; a viewing angle calculation section 13 for calculating a viewing angle V of the driver with respect to an upper front part of an own vehicle 20 based on the viewpoint position and the sun visor angle; and a visual recognition distance calculation section 14 for calculating a visual recognition distance which is the distance between the own vehicle 20 and a traffic light 30 and which enables the driver to visually recognize the traffic light 30 based on the viewing angle V and a height H of the traffic light 30.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a driving assistance device. [Background technology]

[0002] Conventionally, a known technical document related to a driving support device is Patent No. 4483764. Patent No. 4483764 discloses a technology for ensuring the visibility of traffic signals, which encourages the driver to maintain a required distance when the distance between vehicles detected by a vehicle distance detection device is less than the required distance required for the driver to keep the traffic signal within the driver's field of vision. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 4483764 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above-mentioned conventional technologies, visibility is ensured based only on the environment outside the vehicle, and there is insufficient consideration given to the environment inside the vehicle, which affects the driver's viewing angle, so there are cases in which visibility of traffic signals is insufficient.

[0005] An object of the present disclosure is to provide a driving assistance device capable of calculating a visibility distance between a vehicle and a traffic light to ensure visibility of the traffic light. [Means for solving the problem]

[0006] The driving assistance device disclosed herein is a driving assistance device for ensuring visibility of traffic lights by the driver based on the height of the traffic lights in front of the vehicle, and includes a viewpoint position estimation unit that estimates the driver's viewpoint position based on an image captured by a driver monitor camera or the seat position of the driver's seat, an angle estimation unit that estimates the sun visor angle based on the detection results of an angle sensor of the driver's sun visor, a visual angle calculation unit that calculates the driver's visual angle relative to the upper front of the vehicle based on the visual angle and the sun visor angle, and a visibility distance calculation unit that calculates the distance between the vehicle and the traffic light, which is the visibility distance for the driver to see the traffic light, based on the visual angle and the height of the traffic light. Effect of the Invention

[0007] According to the present disclosure, it is possible to provide a driving assistance device capable of calculating the visibility distance between a vehicle and a traffic light to ensure visibility of the traffic light. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a driving assistance device according to an embodiment; [Diagram 2] 1A is a diagram for explaining a visibility distance between a vehicle and a traffic light to ensure visibility of the traffic light, and FIG. 1B is a diagram showing a case where a preceding vehicle is present between the vehicle and the traffic light. [Diagram 3] 4 is a flowchart showing driving assistance control. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0010] 1, the driving assistance device 1 includes a driver monitor camera 2, a driver sun visor angle sensor 3, a seat position sensor 4, a traffic light information receiver 5, a forward sensor 6, a drive actuator 7, a brake actuator 8, an HMI [Human Machine Interface] 9, and an ECU [Electronic Control Unit] 10. The driving assistance device 1 is mounted on a host vehicle such as a passenger car. The driving assistance device 1 performs driving assistance to ensure visibility of the traffic light by the driver based on the height of the traffic light ahead of the host vehicle.

[0011] The driver monitor camera 2 is a camera for capturing an image of the driver. The driver monitor camera 2 is provided, for example, on a cover of a steering column in front of the driver, and captures an image of the driver's head including the face. The driver monitor camera 2 transmits information on the captured image of the driver to the ECU 10.

[0012] The angle sensor 3 is provided on a rotation shaft of a sun visor for the driver. The sun visor is disposed inside the body of the vehicle, above and in front of the driver's seat. The sun visor can rotate around an axis parallel to the left-right direction of the vehicle 20, for example. The angle sensor 3 detects the rotation angle of the rotation shaft as the sun visor angle. The angle sensor 3 transmits information on the sun visor angle to the ECU 10.

[0013] The seat position sensor 4 detects the seat position of the driver's seat. The seat position of the driver's seat includes, for example, the height of the seat surface and the angle of the backrest. The seat position sensor 4 transmits information on the seat position of the driver's seat to the ECU 10.

[0014] The traffic light information receiving unit 5 performs road-to-vehicle communication between the vehicle and a roadside transmitter and receiver (e.g., an optical beacon) installed on the road. The traffic light information receiving unit 5 acquires various types of traffic information from TSPS (Traffic Signal Prediction Systems) and the like through road-to-vehicle communication with the roadside transmitter and receiver. The traffic light information receiving unit 5 acquires display cycle information of traffic lights located on the path of the vehicle. The traffic light display cycle information is information regarding the timing at which a traffic light changes from green to yellow to red.

[0015] The traffic light information receiving unit 5 may obtain information regarding the height of traffic lights located on the path of the vehicle through road-to-vehicle communication. The height of the traffic lights may be obtained by a forward sensor 6 described below. The height of the traffic lights may be obtained from map information when the vehicle's position is recognized. The height of the traffic lights may be a fixed value. The traffic light information receiving unit 5 transmits various pieces of traffic light information obtained through road-to-vehicle communication to the ECU 10.

[0016] The forward sensor 6 is a detection device that includes at least one of a camera and a radar sensor and detects the situation ahead of the vehicle. The camera is an imaging device that captures an image ahead of the vehicle. The camera transmits information about the captured image to the ECU 10. Objects ahead of the vehicle are detected by image recognition processing of the image captured by the camera. The radar sensor detects objects ahead of the vehicle using radio waves (e.g., millimeter waves) or light. The radar sensor detects objects by transmitting radio waves or light ahead of the vehicle and receiving the radio waves or light reflected by the object. The radar sensor transmits information about the detected object to the ECU 10.

[0017] The drive actuator 7 controls the drive force of the power source of the vehicle in response to a control signal from the ECU 10. The brake actuator 8 controls the braking force of the brake system of the vehicle in response to a control signal from the ECU 10. The HMI 9 is an interface for inputting and outputting information between the driving support device 1 and the driver. The HMI 9 includes, for example, a display, a speaker, and the like. The HMI 9 outputs images on the display and sounds from the speaker in response to a control signal from the ECU 10.

[0018] The ECU 10 is an electronic control unit having a CPU (Central Processing Unit) and a storage unit such as a ROM (Read Only Memory) or a RAM (Random Access Memory). The ECU 10 realizes various functions by, for example, executing programs stored in the storage unit by the CPU.

[0019] The following describes the functional configuration of the ECU 10. The ECU 10 includes a viewpoint position estimation unit 11, an angle estimation unit 12, a visual angle calculation unit 13, a visible distance calculation unit 14, a vehicle height estimation unit 15, a distance setting unit 16, and an execution unit 17.

[0020] The viewpoint position estimation unit 11 estimates the viewpoint position of the driver based on the captured image of the driver monitor camera 2. The viewpoint position estimation unit 11 estimates the viewpoint position of the driver by a known image processing method such as edge extraction, noise removal, pattern matching, deep learning, etc. Here, FIG. 2(a) is a diagram for explaining the visibility distance between the vehicle and a traffic light to ensure the visibility of the traffic light. As shown in FIG. 2(a), the driver's viewpoint position 22 is located inside the vehicle body 21 of the vehicle 20. The driver's viewpoint position 22 is the position of the driver's eyes in the vertical direction and in the front-rear direction of the vehicle 20.

[0021] The angle estimation unit 12 estimates the sun visor angle based on the detection result of the angle sensor 3. The sun visor angle is, for example, the angle that the surface of the sun visor 23 facing the driver makes with respect to the horizontal plane.

[0022] The visual angle calculation unit 13 calculates the visual angle V of the driver relative to the upper front of the vehicle 20 based on the driver's viewpoint position 22 and the sun visor angle. The visual angle calculation unit 13 calculates the bottom end position (position in the vertical direction and position in the front-rear direction) of the sun visor 23 based on pre-stored information on the mounting position of the sun visor 23, pre-stored information on the shape of the sun visor 23 (including size information), and the sun visor angle. The visual angle calculation unit 13 calculates the visual angle V of the driver based on the driver's viewpoint position 22 and the bottom end position of the sun visor 23. The visual angle V is, for example, an angle formed by a straight line passing through the driver's viewpoint position 22 and the bottom end position of the sun visor 23 in a side view of the vehicle 20 with respect to the front-rear direction.

[0023] The visible distance calculation unit 14 calculates the visible distance for the driver to visually recognize the traffic light 30 based on the viewing angle V and the height H of the traffic light 30. When there is no preceding vehicle ahead of the host vehicle 20, the visible distance calculation unit 14 calculates, as the visible distance, the horizontal distance D1 between the host vehicle 20 and the traffic light 30 when the traffic light 30 is located on a straight line passing through the driver's viewpoint position 22 and the lower end position of the sun visor 23.

[0024] Next, calculation of the visibility distance when a preceding vehicle is present between the host vehicle 20 and the traffic light 30 will be described. Fig. 2(b) is a diagram showing a case where a preceding vehicle is present between the host vehicle 20 and the traffic light 30. As shown in Fig. 2(b), a preceding vehicle 40 is present in front of the host vehicle 20 and before the traffic light 30. The vehicle height estimation unit 15 estimates the vehicle height of the preceding vehicle 40 based on the detection result of the forward sensor 6.

[0025] The visible distance calculation unit 14 calculates the horizontal distance D2 between the host vehicle 20 and the traffic light 30 at which the driver can see the traffic light 30, as the visible distance, based on the visual angle V, the height H of the preceding vehicle 40, the vehicle height of the preceding vehicle 40, and the distance between the host vehicle 20 and the preceding vehicle 40. The visible distance at which the driver can see the traffic light 30 is obtained, for example, geometrically. In the situation shown in FIG. 2(b), the horizontal distance D2 is greater than the horizontal distance D1. When there is a possibility that the preceding vehicle 40 may obstruct the driver's view of the traffic light 30, the visible distance calculation unit 14 may calculate a relatively large visible distance with a margin of error.

[0026] The distance setting unit 16 sets a target distance to the traffic light 30 of the vehicle 20. The distance setting unit 16 determines whether the visibility distance is greater than a preset distance. The preset distance is, for example, a distance preset by the driver. If the visibility distance is greater than the preset distance, the distance setting unit 16 sets the visibility distance as the target distance. If the visibility distance is equal to or less than the preset distance, the distance setting unit 16 sets the preset distance as the target distance.

[0027] The execution unit 17 executes driving assistance. When the visibility distance is set as the target distance, the execution unit 17 causes the HMI 9 to output that the visibility distance (target distance) is greater than the preset distance. This makes it possible to suppress inadvertent accelerator operation by the driver. The execution unit 17 controls the drive actuator 7 or the brake actuator 8 to control the host vehicle 20 so that the horizontal distance between the host vehicle 20 and the traffic light 30 becomes the target distance. When the traffic light 30 is displaying red, the execution unit 17 stops the host vehicle 20 at the target position. When the traffic light 30 is displaying green, the execution unit 17 does not need to execute driving assistance.

[0028] Next, the processing of the ECU 10 will be described. As shown in Fig. 3, the ECU 10 estimates the driver's viewpoint position and the sun visor angle in step S1. The ECU 10 calculates the driver's visual angle V in step S2. The ECU 10 calculates the visibility distance in step S3. The ECU 10 determines whether the visibility distance is greater than a preset distance in step S4. If the ECU 10 determines that the visibility distance is greater than the preset distance (step S4: YES), the ECU 10 proceeds to step S5. The ECU 10 sets the visibility distance as a target distance in step S5.

[0029] In step S6, the ECU 10 notifies the HMI 9 that the visible distance (target distance) is greater than a preset distance. In step S7, the ECU 10 controls the host vehicle 20 so that the distance between the host vehicle 20 and the traffic light 30 becomes the target distance.

[0030] When the ECU 10 determines that the visible distance is equal to or shorter than the preset distance (step S4: NO), the ECU 10 proceeds to step S8. In step S8, the ECU 10 sets the preset distance as a target distance. After step S8, the ECU 10 proceeds to step S7.

[0031] As described above, in the driving support device 1, the viewpoint position estimation unit 11 estimates the viewpoint position of the driver based on the captured image of the driver monitor camera 2, and the angle estimation unit 12 estimates the sun visor angle based on the detection result of the angle sensor 3 of the sun visor 23 for the driver. Then, the visual angle calculation unit 13 calculates the visual angle V of the driver with respect to the upper front of the vehicle 20 based on the viewpoint position and the sun visor angle. As a result, the visual angle calculation unit 13 can accurately calculate the visual angle V of the driver based on the in-vehicle environment (sun visor angle) that affects the visual angle V of the driver compared to a case where the sun visor angle is not considered. The visual angle calculation unit 13 can calculate the visual angle V of the driver even if the sun visor angle changes, for example. Therefore, the visual distance calculation unit 14 can accurately calculate the visual distance for the driver to view the traffic light 30 based on the accurate visual angle V and the height H of the traffic light 30 compared to a case where the sun visor angle is not considered. Therefore, according to the driving assistance device 1, the visibility distance for ensuring the visibility of the traffic light 30 can be calculated.

[0032] Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments. The present disclosure can be implemented in various forms including the above-described embodiments and various modifications and improvements based on the knowledge of those skilled in the art.

[0033] The viewpoint position estimation unit 11 may estimate the viewpoint position of the driver based on the seat position of the driver's seat. In this case, the viewpoint position estimation unit 11 assumes that the driver's seat height is a predetermined value and estimates the viewpoint position of the driver based on the height of the seat surface of the driver's seat and the angle of the backrest, etc. The viewpoint position estimation unit 11 may estimate the viewpoint position of the driver based on at least one of the captured image of the driver monitor camera 2 and the seat position of the driver's seat.

[0034] When the sun visor 23 is imaged by the driver monitor camera 2, the angle estimation unit 12 may estimate the sun visor angle based on the image captured by the driver monitor camera 2. The angle estimation unit 12 may estimate the sun visor angle by a known image processing method such as edge extraction, noise removal, pattern matching, deep learning, etc. The driving assistance device 1 does not need to include the vehicle height estimation unit 15.

[0035] When there is no preceding vehicle ahead of the host vehicle 20 and the visibility distance is greater than the distance between the stop line and the traffic light 30, the execution unit 17 may stop the host vehicle 20 at a position a predetermined distance away from the stop line (a position not beyond the stop line). Even in this case, the execution unit 17 may output to the HMI 9 that the visibility distance is greater than the distance between the stop line and the traffic light 30. When there is a preceding vehicle 40 ahead of the host vehicle 20, the execution unit 17 may control the inter-vehicle distance between the host vehicle 20 and the preceding vehicle 40 so that the distance between the host vehicle 20 and the traffic light 30 becomes a target distance. The execution unit 17 may have a configuration that does not control the vehicle speed of the host vehicle 20 and only has a function of providing the driver with information regarding the visibility distance. The driving assistance device 1 may not include the execution unit 17. The driving assistance device 1 may simply transmit information regarding the visibility distance to a user terminal (including a wearable device) of the driver. [Explanation of symbols]

[0036] 1...driving assistance device, 2...driver monitor camera, 3...angle sensor, 11...viewpoint position estimation unit, 12...angle estimation unit, 13...visual angle calculation unit, 14...visible distance calculation unit, 20...own vehicle, 22...viewpoint position, 23...sun visor, 30...traffic light, V...visual angle.

Claims

[Claim 1] A driving assistance device for ensuring visibility of a traffic signal by a driver based on a height of the traffic signal ahead of a vehicle, comprising: a viewpoint position estimation unit that estimates a viewpoint position of the driver based on an image captured by a driver monitor camera or a seat position of the driver's seat; an angle estimation unit that estimates a sun visor angle based on a detection result of an angle sensor of the driver's sun visor; a visual angle calculation unit that calculates a visual angle of the driver with respect to an upper front direction of the vehicle based on the viewpoint position and the sun visor angle; a visibility distance calculation unit that calculates a visibility distance between the vehicle and the traffic light, which is the distance required for the driver to see the traffic light, based on the viewing angle and the height of the traffic light.

Citation Information

Patent Citations

  • Drive assisting device and computer program

    JP2009006893A

  • Lane change support device and lane change support method

    JP2018005827A

  • Vehicle control method and vehicle control device

    JP2021068317A

  • Driver assistance systems and programs

    JP4483764B2

  • Method and apparatus for controlling driving of vehicle

    US20190049964A1