Driving assistance device and driving assistance system
The driving support device enhances road recognition by integrating road information, brightness, and gaze direction analysis to provide effective support irradiation, addressing limitations in conventional systems and improving driver visibility and safety.
Patent Information
- Application Number
- PCT/JP2023/019877
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-29
- Publication Date
- 2024-12-05
AI Technical Summary
Conventional driving support systems using headlight illumination direction control based on road shape information are limited in allowing drivers to correctly recognize the road ahead, especially under varying conditions such as darkness or complex road features, leading to potential misrecognition of road shapes.
A driving support device comprising a road information acquisition unit, brightness judgment unit, gaze estimation unit, and recognition estimation unit that work together to assess the driver's ability to recognize the road shape and provide assistance through controlled support irradiation to enhance visibility, using a combination of road shape information, brightness determination, and driver gaze direction analysis.
Enables accurate recognition of the road shape ahead by the driver, even in challenging conditions like darkness, by providing targeted support irradiation to correct misperceptions and improve driving safety.
Smart Images

Figure JP2023019877_05122024_PF_FP_ABST
Abstract
Description
Driving assistance device and driving assistance system
[0001] The present disclosure relates to a driving assistance device and a driving assistance system that allow a driver to recognize the shape of the road ahead.
[0002] A technology has been disclosed that, while driving with the headlights on, acquires road shape information on the road the vehicle is traveling on, and swivels the headlights in the direction of the curve if there is a curve ahead of the vehicle, thereby improving the driver's visibility of the curve ahead (see, for example, Patent Document 1).
[0003] Japanese Patent Application Laid-Open No. 2005-59839
[0004] However, conventional control of the headlight lighting direction using road shape information has limitations in enabling the driver to correctly recognize the road shape ahead. Specifically, depending on the road conditions ahead, such as the road shape ahead, the arrangement of features on the road ahead, or the contrast between the road ahead and the area outside the road, the driver may not be able to fully recognize the road shape, and there is room for improvement in driving assistance using such technologies.
[0005] The present disclosure has been made to solve such problems, and aims to provide a driving assistance device and a driving assistance system that enable the driver to correctly recognize the shape of the road ahead.
[0006] In order to solve the above problems, the driving assistance device according to the present disclosure includes a road information acquisition unit that acquires road information including road shape information of the road on which the host vehicle is traveling, a light and shade judgment unit that judges the light and shade conditions ahead of the host vehicle, a gaze estimation unit that estimates the driver's gaze direction based on the line of sight information of the driver of the host vehicle, a recognition estimation unit that estimates whether the driver is aware of the road shape ahead of the host vehicle based on the road shape information acquired by the road information acquisition unit, the light and shade conditions judged by the light and shade judgment unit, and the gaze direction estimated by the gaze estimation unit, and an assistance control unit that performs control to execute predetermined driving assistance when the recognition estimation unit estimates that the driver is not aware of the road shape.
[0007] According to the present disclosure, it is possible to allow the driver to correctly recognize the shape of the road ahead.
[0008] The objects, features, aspects, and advantages of the present disclosure will become more apparent from the following detailed description and the accompanying drawings.
[0009] 1 is a block diagram showing an example of a configuration of a vehicle system including a driving assistance device according to embodiment 1. FIG. 2 is a flowchart showing an example of an operation of the driving assistance device according to embodiment 1. FIG. 3 is a diagram for explaining misrecognition of a road shape according to embodiment 1. FIG. 4 is a diagram for explaining misrecognition of a road shape according to embodiment 1. FIG. 5 is a diagram showing an example of assistance illumination according to embodiment 1. FIG. 6 is a diagram showing an example of assistance illumination according to embodiment 1. FIG. 7 is a diagram showing an example of assistance illumination according to embodiment 1. FIG. 8 is a diagram showing an example of assistance illumination according to embodiment 1. FIG. 9 is a diagram for explaining calculation of a degree of recognition according to modification 2 of embodiment 1. FIG. 10 is a block diagram showing an example of a configuration of a vehicle system including a driving assistance device according to modification 4 of embodiment 1. FIG. 11 is a block diagram showing an example of a configuration of a vehicle system including a driving assistance device according to modification 5 of embodiment 1. FIG. 12 is a block diagram showing an example of a configuration of a vehicle system including a driving assistance device according to modification 6 of embodiment 1. FIG. 13 is a block diagram showing an example of a configuration of a vehicle system including a driving assistance device according to embodiment 2. FIG. 14 is a flowchart showing an example of an operation of the driving assistance device according to embodiment 2. FIG. 15 is a diagram for explaining misrecognition of a road shape according to embodiment 2. FIG. 16 is a block diagram showing an example of a configuration of a driving assistance system according to embodiment 3. FIG. 17 is a block diagram showing an example of a configuration of a vehicle system including a driving assistance device according to embodiment 3. Fig. 10 is a flowchart showing an example of an operation of a server according to embodiment 3. Fig. 11 is a flowchart showing an example of an operation of a server according to embodiment 3. Fig. 12 is a block diagram showing an example of a hardware configuration of a driving assistance device according to embodiments 1 to 3. Fig. 13 is a block diagram showing an example of a hardware configuration of a driving assistance device according to embodiments 1 to 3.
[0010] <First Embodiment> <Configuration> Fig. 1 is a block diagram showing an example of the configuration of a vehicle system 1 including a driving assistance device 2 according to the first embodiment. As shown in Fig. 1, the vehicle system 1 includes the driving assistance device 2, a normal-accuracy locator 3, a DMS (Driver Monitoring System) 4, and a lighting device 5. In the following, the vehicle system 1 will be described as being provided in the vehicle itself.
[0011] The driving assistance device 2 includes a road information acquisition unit 6 , a light / dark determination unit 7 , a gaze estimation unit 8 , a recognition estimation unit 9 , and an assistance control unit 10 .
[0012] The road information acquisition unit 6 acquires road information including road shape information of the road on which the host vehicle is traveling from the normal-accuracy locator 3. Specifically, the road information acquisition unit 6 acquires road information including road shape information of the road ahead of the host vehicle.
[0013] The light / dark determination unit 7 determines the light / dark state ahead of the host vehicle. Specifically, the light / dark determination unit 7 determines that the area ahead of the host vehicle is dark when the headlights included in the lighting device 5 are on, and determines that the area ahead of the host vehicle is bright when the headlights are off. At this time, the light / dark determination unit 7 acquires information indicating the on / off state of the headlights from the lighting device 5. Note that the light / dark determination unit 7 may also determine the light / dark state around the host vehicle based on information acquired from an illuminance meter (not shown) or the like, and estimate the light / dark state ahead of the host vehicle based on the determined light / dark state.
[0014] The gaze estimation unit 8 estimates the gaze direction of the driver of the host vehicle based on the line-of-sight information of the driver acquired from the DMS 4. The gaze direction includes a gaze position and a gaze area.
[0015] The recognition estimation unit 9 estimates whether the driver correctly recognizes the road shape ahead of the vehicle based on the road shape information acquired by the road information acquisition unit 6, the light and dark state determined by the light and dark judgment unit 7, and the gaze direction estimated by the gaze estimation unit 8.
[0016] When the recognition estimation unit 9 estimates that the driver does not correctly recognize the road shape ahead of the vehicle, the assistance control unit 10 controls the assistance illumination device to execute driving assistance for allowing the driver to recognize the road shape. The assistance illumination device is included in the lighting device 5.
[0017] The normal-accuracy locator 3 includes a normal-accuracy map database (DB) 11, a positioning unit 12, and an information transmission unit 13, and detects the host vehicle's position on the road on which the host vehicle is traveling (host vehicle position on a road-by-road basis), and transmits road information including road shape information ahead of the host vehicle (road shape information on a road-by-road basis) to the driving assistance device 2. Note that the term "normal accuracy" is used to distinguish it from a high-accuracy locator (not shown) that detects the host vehicle's position on a lane-by-lane basis, which will be described later.
[0018] The normal-accuracy map DB 11 is a storage medium such as a memory or a hard disk drive (HDD), and stores road information including road shape information for each road. The positioning unit 12 measures the vehicle's position. The positioning unit 12 may be configured to improve position accuracy using map matching, a vehicle speed sensor, an acceleration sensor, or the like. The information transmission unit 13 acquires road information including road shape information ahead of the vehicle from the normal-accuracy map DB 11 based on the vehicle's position measured by the positioning unit 12, and transmits the acquired road information to the driving assistance device 2. At this time, the information transmission unit 13 may transmit information about the vehicle's position to the driving assistance device 2.
[0019] The DMS 4 detects the gaze direction of the driver of the vehicle and transmits the gaze direction as gaze information to the driving assistance device 2. Note that the DMS 4 is not limited to the DMS 4 as long as it has a function of detecting the gaze direction of the driver. For example, instead of the DMS 4, the vehicle system 1 may be configured to include an OMS (Occupant Monitoring System) having a function of detecting the gaze direction of the driver.
[0020] The lighting device 5 includes a headlamp and a support illumination device. The support illumination device is used when performing support illumination, which will be described later.
[0021] <Operation> Fig. 2 is a flowchart showing an example of the operation of the driving assistance device 2 according to embodiment 1. When the host vehicle starts traveling, the operation in Fig. 2 starts.
[0022] In step S101 , the road information acquisition unit 6 acquires road information including road shape information ahead of the vehicle from the normal-accuracy locator 3 .
[0023] In step S102, the gaze estimation unit 8 acquires the driver's gaze information from the DMS 4 and estimates the gaze direction based on the time series pattern of the gaze direction. Note that the gaze estimation unit 8 may acquire information about the driver's face direction from the DMS 4 and estimate the gaze direction based on the face direction.
[0024] In step S103, the light / dark state determination unit 7 acquires information indicating the on / off state of the headlights from the lighting device 5, and determines that the area ahead of the host vehicle is dark if the headlights are on, and determines that the area ahead of the host vehicle is bright if the headlights are off. Note that the determination of the light / dark state ahead of the host vehicle may use any information other than information indicating the on / off state of the headlights. For example, the light / dark state determination unit 7 may determine the light / dark state ahead of the host vehicle using information indicating the on / off state of the parking lamps, information indicating the on / off state of the fog lamps, illuminance information acquired from an illuminance meter, illuminance information or overall image light / dark information acquired from an image capture device that captures an image ahead of the host vehicle, etc.
[0025] In step S104, the recognition / estimation unit 9 determines whether the driver is misperceiving the road shape ahead of the vehicle. Specifically, when it is dark ahead of the vehicle, the recognition / estimation unit 9 estimates that the driver is not correctly perceiving the road shape (i.e., that the driver is misperceiving the road shape) when the driver's gaze direction is a predetermined distance or more from the direction indicating the road position ahead of the vehicle, and estimates that the driver is correctly perceiving the road shape when the driver's gaze direction is less than the predetermined distance from the direction indicating the road position ahead of the vehicle. If the driver is misperceiving the road shape ahead of the vehicle, the process proceeds to step S105. On the other hand, if the driver is not misperceiving the road shape ahead of the vehicle, the process proceeds to step S106. Note that, instead of the difference between the driver's gaze direction and the direction indicating the road position ahead of the vehicle, it may be possible to estimate whether the driver is correctly perceiving the road shape based on the difference in distance between the driver's gaze position and the road position ahead of the vehicle.
[0026] It is considered good for the driver to visually recognize the position where the vehicle will arrive in two seconds. Therefore, it is desirable for the recognition estimation unit 9 to further use the speed information of the vehicle acquired from a speed sensor (not shown) to estimate whether the driver correctly recognizes the road shape based on whether the driver is looking at the position or area where the driver will arrive in two seconds. Note that, since some drivers may visually recognize a position a little further away, the visual recognition area may not be limited to a position two seconds ahead, but may be, for example, two to three seconds ahead. Such a driver's visual recognition area may be obtained by learning the individual characteristics of each driver.
[0027] FIG. 3 is a diagram showing an example of a situation in which a driver misperceives the shape of a road. In FIG. 3, the road on which the vehicle 14 is traveling travels goes straight and then curves to the right from point A to point B. In a dark environment in front of the vehicle, such as at night or during rainy weather, a situation may arise in which the driver mistakenly perceives the road as going straight from point A to point C, rather than the road curving to the right from point A to point B. In the present disclosure, a road that does not actually exist but that the driver mistakenly perceives as existing is referred to as a "phantom road." In FIG. 3, the road going straight from point A to point C corresponds to a phantom road.
[0028] Misidentification of road shape is likely to occur at points where the road shape changes. Specifically, misidentification of road shape is likely to occur at points where the curvature of the road changes, such as when going from straight to curved or when going from curved to straight, or at points where the traveling direction changes significantly on a polygonal road shape. A phantom road is a direction in which the curvature does not change or the traveling direction does not change. The recognition and estimation unit 9 estimates the shape of the phantom road based on the road shape information acquired by the road information acquisition unit 6.
[0029] The driver's line of sight differs between a situation where the driver is not looking at the road's traveling direction due to looking aside or the like and a situation where the driver misperceives the road shape. When the driver is not looking at the road's traveling direction due to looking aside or the like, the driver's line of sight is unrelated to the direction in which the driver misperceives the road shape. On the other hand, when the driver misperceives the road shape, the driver's line of sight will be in a direction that will cause the driver to misperceive the road shape.
[0030] There are various possible methods for estimating whether the driver correctly recognizes the road shape. For example, as shown in FIG. 4, if the percentage of the driver's gaze direction looking at the vicinity of point B, which is in the direction of the correct road, is Rr, and the percentage of the driver's gaze direction looking at the vicinity of point C, which is in the direction of the phantom road, is Re, then it is possible to estimate whether the driver correctly recognizes the road shape using either of the following logics 1 and 2. Here, "percentage Rr" refers to the percentage of time the driver spends looking at a predetermined range including point B (within the circle including point B in FIG. 4) during a certain period of time. The same applies to percentage Re. Points B and C shown in FIG. 4 correspond to points B and C shown in FIG. 3.
[0031] Logic 1 is a logic that estimates that the driver correctly recognizes the road shape when the percentage Rr at which the driver sees the correct road is equal to or greater than a predetermined value RrTH1 (see the following condition (1)). In the following condition (1), for example, RrTH1 is 50%. Rr≧RrTH1 (1)
[0032] Logic 2 is a logic that estimates the driver's perception of the road shape correctly using both the percentage Rr that the driver sees the correct road and the percentage Re that the driver sees the phantom road. For example, if the percentage Rr is equal to or greater than a predetermined value RrTH2 and the percentage Re is less than a predetermined value ReTH2 (see the following condition (2)), it is estimated that the driver correctly recognizes the road shape. In the following condition (2), for example, RrTH2 is 50% and ReTH2 is 20%. Rr≧RrTH2 AND Re<ReTH2 ... (2)
[0033] Returning to the description of FIG. 2 , in step S105, the assistance control unit 10 executes predetermined driving assistance. In the first embodiment, the assistance control unit 10 controls the assistance illumination device included in the lighting device 5 to perform assistance illumination to allow the driver to recognize the road shape ahead of the vehicle. The position at which the assistance illumination device emits assistance illumination is not particularly limited, as long as it is a position at which the driver can easily recognize the assistance illumination. For example, the assistance control unit 10 may emit assistance illumination centered on a position that the driver should view. Here, the position that the driver should view is, for example, a position at which the vehicle will arrive in two seconds.
[0034] 5 to 8 are diagrams showing an example of support illumination performed by the support illumination device under the control of the support control unit 10. Note that in Figs. 5 to 8, illumination by headlights is not shown to make the support illumination easier to understand.
[0035] The assist illumination can be expressed in various ways, such as a figure, a linear figure following the road shape, a symbol or arrow indicating a curve, a figure simulating a road facility such as a pole or a guardrail, text such as "right curve," or an animation such as blinking or moving. In addition to these, the assist illumination may be a figure indicating that no road exists in the direction of the misidentified road shape, or visual guidance that uses a base point near the current driver's visual position as the base point and guides the driver's visual line from the base point toward the correct road.
[0036] Fig. 5 shows dashed line support illumination that follows the road shape. Fig. 6 shows solid line support illumination with a longer illumination range, which is an illumination mode with higher recognition than Fig. 5. Fig. 7 shows support illumination for an arrow indicating a right curve. Fig. 8 shows animated support illumination that simulates blinking LEDs embedded in the road.
[0037] In step S106, the driving assistance device 2 determines whether the driving of the host vehicle has ended. If the driving of the host vehicle has ended, the operation in Fig. 2 ends. On the other hand, if the driving of the host vehicle has not ended, the process returns to step S101.
[0038] <Effects> According to the first embodiment, when driving in a dark environment such as at night, it is possible to estimate a situation in which the driver is unable to recognize the shape of the road ahead, and to allow the driver to correctly recognize the shape of the road ahead.
[0039] <Modification 1> In the first embodiment, a case where assist illumination is executed as driving assistance has been described, but driving assistance is not limited to assist illumination.
[0040] For example, the assistance control unit 10 may instruct a notification device (not shown) to notify the driver of the correct road shape, such as "Right curve."
[0041] The assistance control unit 10 may instruct the HUD (Head Up Display) to superimpose a display object indicating a right curve or a display object corresponding to the shape of the assistance illumination shown in Figures 5 to 8 on the road ahead of the vehicle.
[0042] When the road ahead of the vehicle curves to the right, the assistance control unit 10 may instruct the EPS (Electric Power Steering) to generate a force that moves the steering wheel in a direction that follows the curve to the right.
[0043] If the vehicle is likely to go off to the outside (left side of the curve) on a right-hand curve, the assistance control unit 10 may instruct the vehicle control device to automatically slow down or to automatically move the vehicle to the right side within the lane.
[0044] <Modification 2> In the first embodiment, the recognition estimation unit 9 performs a binary determination of whether or not the driver recognizes the road shape ahead, but the recognition degree Recog may be calculated using multiple levels or a continuous value. That is, the recognition estimation unit 9 calculates the recognition degree indicating the degree to which the driver correctly recognizes the road shape ahead of the vehicle based on road shape information, lighting conditions, and gaze direction. The assistance control unit 10 then performs control to execute driving assistance based on the recognition degree.
[0045] As an example corresponding to Logic 1 described in the first embodiment, the recognizability may be calculated so that the greater the proportion of times the driver looks in the correct road direction, the closer the recognizability approaches 1. The recognizability can be calculated, for example, from the relationship shown in Fig. 9. In Fig. 9, the proportion Rr indicates the proportion of times the driver looks in the correct road direction. The recognizability f(Rr) corresponds to the recognizability Recog.
[0046] As an example corresponding to Logic 2 described in the first embodiment, the degree of recognition may be corrected using the proportion of the phantom road seen. For example, the degree of recognition Recog may be calculated according to the following equation (3) on the condition that Re<ReTH2. In the following equation (3), if Recog<0, Recog=0. Note that ReTH2 is, for example, 20%. The correction value Hosei(Re) can be found, for example, by referring to FIG. 10. Recog=g(Rr, Re)=f(Rr)-Hosei(Re) (3)
[0047] It is desirable that the assistance control unit 10 instructs the assistance illumination device to perform assistance illumination that is more conspicuous (assist illumination that is easily recognized by the driver) as the degree of recognition decreases. For example, when the degree of recognition is lower than a predetermined value, assistance illumination as shown in Fig. 5 may be performed, and when the degree of recognition is further decreased, assistance illumination as shown in Fig. 6 may be performed, and when the degree of recognition is still lower, assistance illumination as shown in Fig. 8 may be performed.
[0048] <Variation 3> In Variation 2, a case has been described in which assistance illumination is performed that is more noticeable the lower the level of recognition, but it is also possible to increase the number of items related to driving assistance (types of assistance to allow the driver to recognize the shape of the road ahead of the vehicle) the lower the level of recognition.
[0049] For example, the assistance control unit 10 may perform control such that when the degree of recognition is lower than a predetermined value, only assistance illumination is performed as shown in Fig. 5, and when the degree of recognition is further lower, audio notification assistance is also used, and when the degree of recognition is still lower, steering operation assistance or deceleration control assistance is also used. Also, gaze guidance or a display object may be displayed on the HUD.
[0050] <Modification 4> Fig. 11 is a block diagram showing an example of the configuration of vehicle system 1 including driving assistance device 15 according to Modification 4. As shown in Fig. 11, driving assistance device 15 is characterized by including gaze distribution learning unit 16. The other configuration is similar to that of vehicle system 1 (see Fig. 1) described in embodiment 1, and therefore detailed description thereof will be omitted here.
[0051] The gaze distribution learning unit 16 learns the gaze distribution of the driver with respect to the road shape ahead of the vehicle in a bright environment around the vehicle, based on the road information acquired by the road information acquisition unit 6 and the driver's gaze direction estimated by the gaze estimation unit 8. Here, the bright environment may be daytime, an environment in which the road surface illuminance due to road lighting is equal to or greater than a predetermined value, or an environment in which the headlights are off.
[0052] The recognition estimation unit 9 estimates whether the driver correctly recognizes the road shape ahead of the vehicle based on the gaze direction estimated by the gaze estimation unit 8, the gaze distribution learned by the gaze distribution learning unit 16, and the road shape information acquired by the road information acquisition unit 6. Specifically, the recognition estimation unit 9 acquires, from the gaze distribution learning unit 16, the driver's gaze distribution on a road shape (similar road shape) similar to the road shape indicated by the road shape information acquired by the road information acquisition unit 6, and may employ logic that makes it easy to determine that the driver does not correctly recognize the road shape ahead, or logic that lowers the degree of recognition, when the degree of difference between the driver's gaze direction estimated by the gaze estimation unit 8 and the driver's gaze distribution on the similar road shape is equal to or greater than a predetermined value. The similar road shape may be selected based on any criteria. For example, the similar road shape may be a road, among the road shapes learned by the gaze distribution learning unit 16, whose road curvature is within a predetermined range of the road shape indicated by the road shape information acquired by the road information acquisition unit 6.
[0053] <Modification 5> Fig. 12 is a block diagram showing an example of the configuration of vehicle system 1 including driving assistance device 17 according to Modification 5. As shown in Fig. 12, driving assistance device 17 is characterized by including a driver information acquisition unit 18. The other configuration is the same as that of vehicle system 1 (see Fig. 1) described in embodiment 1, and therefore detailed description thereof will be omitted here.
[0054] The driver information acquisition unit 18 acquires driver information including at least one of the driver's facial expression and gesture from the DMS 4. The driver information acquisition unit 18 also acquires the driver's line of sight information from the DMS 4 as the driver information.
[0055] The gaze estimation unit 8 estimates the gaze direction of the driver based on the line of sight information acquired by the driver information acquisition unit 18 in the same manner as in the first embodiment.
[0056] The recognition estimation unit 9 estimates whether the driver correctly recognizes the shape of the road ahead of the vehicle based on the driver information acquired by the driver information acquisition unit 18. For example, the recognition estimation unit 9 may add logic to the logic for determining the recognition level such that the recognition level is lowered when the driver makes a gesture such as looking around busily, squinting their eyes to focus, or tilting their head.
[0057] <Modification 6> Fig. 13 is a block diagram showing an example of the configuration of a vehicle system 1 including a driving assistance device 19 according to Modification 6. As shown in Fig. 13, the driving assistance device 19 is characterized by including a driving environment information acquisition unit 20 and a risk determination unit 21. The vehicle system 1 also includes a periphery detection device 22 and a notification device 23. The other configurations are the same as those of the vehicle system 1 described in the first embodiment (see Fig. 1), and therefore detailed description thereof will be omitted here.
[0058] The driving environment information acquisition unit 20 acquires driving environment information from the surroundings detection device 22, including information about the road ahead of the vehicle and dangerous objects, which are moving bodies or features, present around the road.
[0059] The risk judgment unit 21 judges that there is a risk of the vehicle colliding with a dangerous object based on the driving environment information acquired by the driving environment information acquisition unit 20, the road shape information acquired by the road information acquisition unit 6, and the gaze direction estimated by the gaze estimation unit 8, if there is a possibility that the vehicle will collide with a dangerous object and the driver is not visually recognizing the dangerous object.
[0060] For example, the risk assessment unit 21 may determine the movement of obstacles or other vehicles on the road based on information about the road ahead of the host vehicle included in the driving environment information acquired by the driving environment information acquisition unit 20, and estimate the possibility of the host vehicle colliding with a dangerous object (obstacle, other vehicle). The risk assessment unit 21 may also determine the risk based on whether a trajectory that the host vehicle may travel in the future matches an obstacle or other vehicle, the time to reach the obstacle or other vehicle, or the time to avoid the obstacle or other vehicle. Furthermore, the risk assessment unit 21 may determine the risk that the host vehicle will not be able to turn a curve based on road shape information acquired by the road information acquisition unit 6.
[0061] The assistance control unit 10 controls the driving assistance so that the mode of driving assistance that warns the driver of a hazardous object when there is a risk and the mode of driving assistance that makes the driver recognize the shape of the road ahead of the vehicle are executed differently. This makes it possible to execute appropriate driving assistance according to various situations. Examples of driving assistance that warns the driver of a hazardous object include displaying line-of-sight guidance to the hazardous object on the HUD, guiding the driver's line of sight to the hazardous object by illuminating the line-of-sight guidance to the hazardous object, and an audio notification of the direction in which the hazardous object is located.
[0062] <Variation 7> In the first embodiment, a configuration (see FIG. 1) has been described in which a normal-accuracy locator 3 is provided with a normal-accuracy map DB 11 that stores road information including road shape information on a road-by-road basis. However, a configuration may also be adopted in which a high-accuracy locator is provided with a high-accuracy map DB that stores road information including road shape information on a lane-by-lane basis. That is, the vehicle system 1 shown in FIG. 1 may be configured to include a high-accuracy locator instead of the normal-accuracy locator 3. Note that the vehicle systems 1 shown in FIGS. 11, 12, 13, 14, and 18 (details of the vehicle systems 1 shown in FIGS. 14 and 18 will be described later) may also be configured to include a high-accuracy locator instead of the normal-accuracy locator 3.
[0063] The road information acquisition unit 6 acquires road information including the lane in which the host vehicle is traveling and road shape information for each lane from the high-precision locator. The recognition and estimation unit 9 estimates misrecognition of the road shape according to the lane in which the host vehicle is traveling. This makes it possible to provide driving assistance according to the lane in which the host vehicle is traveling. Appropriate driving assistance can be provided even when the curvature of the road shape differs for each lane, or the positional relationship between the host vehicle and surrounding features differs for each lane, resulting in different locations or areas where road shape misrecognition occurs.
[0064] <Modification 8> In the vehicle system 1 shown in Fig. 1 , the driving assistance device 2 may be configured to include some or all of the normal-accuracy locator 3, the DMS 4, and the lighting device 5. The same applies to the vehicle systems 1 shown in Figs. 11, 12, 13, 14, and 18 (the details of the vehicle systems 1 shown in Figs. 14 and 18 will be described later).
[0065] <Embodiment 2> Fig. 14 is a block diagram showing an example of the configuration of a vehicle system 1 including a driving assistance device 24 according to Embodiment 2. As shown in Fig. 14, the driving assistance device 24 is characterized by including a driving environment information acquisition unit 25. The vehicle system 1 also includes a periphery detection device 26. The other configurations are similar to those of the vehicle system 1 described in Embodiment 1 (see Fig. 1), and therefore detailed description thereof will be omitted here. The driving assistance device 24 according to Embodiment 2 acquires information about the driving environment ahead of the vehicle from the periphery detection device 26, and estimates, based on the information, whether the driving environment is such that the driver is likely to misinterpret the road shape.
[0066] The driving environment information acquisition unit 25 acquires driving environment information relating to structures or features ahead of the vehicle from the surroundings detection device 26. Specifically, the driving environment information acquisition unit 25 acquires driving environment information including at least one of the contrast of the road ahead of the vehicle, the presence of an obstruction that obstructs visibility of the road ahead of the vehicle, a change in gradient of the road ahead of the vehicle, and visibility of the road ahead of the vehicle.
[0067] The surroundings detection device 26 is configured with a LiDAR (Light Detection and Ranging) or an image processing device, and detects features present around the vehicle.
[0068] The recognition estimation unit 9 estimates whether the driver correctly recognizes the road shape ahead of the vehicle based on the driving environment information acquired by the driving environment information acquisition unit 25. Specifically, the recognition estimation unit 9 adds the driving environment information to the logics 1 and 2 described in the first embodiment, and estimates whether the driver correctly recognizes the road shape ahead of the vehicle.
[0069] <Operation> Figure 15 is a flowchart showing an example of the operation of driving assistance device 24 according to embodiment 2. Note that steps S201 to S203, step S206, and step S207 in Figure 15 are similar to steps S101 to S103, step S105, and step S106 in Figure 2, and therefore will not be described here. Steps S204 and S205 will be described below.
[0070] In step S204, the driving environment information acquisition unit 25 acquires driving environment information relating to structures or features ahead of the vehicle from the periphery detection device 26. Note that if the driving environment information can be acquired from the normal-accuracy locator 3, the driving assistance device 24 does not need to include the driving environment information acquisition unit 25, and the vehicle system 1 does not need to include the periphery detection device 26.
[0071] In step S205, the recognition / estimation unit 9 determines whether the driver is misperceiving the road shape ahead of the vehicle. Specifically, the recognition / estimation unit 9 adds the driving environment information to the logic described in step S4 of FIG. 2.
[0072] Here, situations (situations 1 to 3) where road misidentification is likely to occur will be described with reference to FIG.
[0073] Situation 1 is a situation where there is a feature that blocks the view in the correct direction of the road (the direction of point B). When there is a feature that blocks the view in the correct direction of the road, the probability that the driver will misrecognize the road shape increases. Figure 16 shows a situation where the driver of the vehicle 14 cannot see part of the road ahead to the right (the direction of point B) due to the influence of the slope of mountain 27.
[0074] Situation 2 is a situation in which a structure that is likely to be found near the road is located in the direction of the phantom road (the direction of point C). When a structure that is likely to be found near the road is located in the direction of the phantom road (the direction of point C), the probability that the driver will misinterpret the road shape increases. Figure 16 shows a situation in which a house 28 is located near the phantom road. In particular, when the house 28 is lit and the area near point B is dark, the driver is likely to misinterpret the road shape. In addition, the positional relationship or contrast between the road surface and features outside the road surface may also create a situation in which the driver is likely to misinterpret the road shape.
[0075] Phase 3 is a phase where there is a point where the road gradient changes. On the road beyond the point where the road gradient changes, especially the point where the gradient becomes steeper in the downward direction, the headlight luminous flux becomes sparser compared to points where the gradient does not change. Therefore, the road surface becomes darker on the road ahead, making it easier for the driver to misinterpret the road shape. In Figure 16, if point A is an inflection point (a point where the road gradient changes), and the gradient of the road beyond point A (the road heading toward point B) changes downward, the driver will be even more likely to misinterpret the road shape.
[0076] In step S205, when the recognition estimation unit 9 detects a situation such as the above-mentioned situations 1 to 3, it adopts logic obtained by modifying the logic (logic 1 and 2) described in embodiment 1. For example, when the recognition estimation unit 9 detects situations 1 to 3, it applies corrections to ConTH1, ConTH2, and ConTH3 corresponding to each of situations 1 to 3 to the logic described in embodiment 1.
[0077] For example, the recognition estimation unit 9 modifies Logic 1 described in the first embodiment to estimate that the driver correctly recognizes the road shape when the percentage Rr of the driver looking in the correct direction of the road satisfies the following condition (4): In the following condition (4), ConTH1, ConTH2, and ConTH3 are, for example, 5%. Rr≧RrTH3+ConTH1+ConTH2+ConTH3 (4)
[0078] ConTH1 may be increased as the degree of obstruction to the view in the direction of the correct road increases, ConTH2 may be increased as the number of buildings that tend to be located around the phantom road increases, and ConTH3 may be increased as the gradient of the road increases.
[0079] Although the above description has been made on the case where Logic 1 described in the first embodiment is corrected, the same applies to the case where Logic 2 described in the first embodiment is corrected.
[0080] <Effects> According to the second embodiment, it is possible to estimate the misidentification of road shapes more accurately than in the first embodiment.
[0081] <Modification 1> In the second embodiment, the corrections in the first to third aspects are used when estimating whether or not the driver has misperceived the road shape, but the present invention is not limited to this.
[0082] The recognition estimation unit 9 may use the corrections of the first to third stages when calculating the recognition degree described in the second modification of the first embodiment.
[0083] <Modification 2> In the second embodiment, the case where all of the situations 1 to 3 are taken into consideration when estimating whether or not the driver has misperceived the road shape has been described, but the present invention is not limited to this.
[0084] The recognition estimation unit 9 may use Logic 1 or Logic 2 described in the first embodiment to estimate whether the driver has misperceived the road shape, and may make the mode of assistance illumination more noticeable as in Variation 2 of the first embodiment in response to the addition of various situations including Situations 1 to 3 described in the second embodiment, or may increase the number of items related to driving assistance as in Variation 3 of the first embodiment in response to the addition of various situations including Situations 1 to 3 described in the second embodiment.
[0085] <Modification 3> The driving assistance device 24 according to the second embodiment (see FIG. 14) may include the driver information acquisition unit 18 shown in FIG. 12, and may be configured so that the driver information acquisition unit 18 acquires driver information including the driver's visual acuity. The driver's visual acuity may be information set by the driver, or may be information that is automatically estimated.
[0086] The situation where a driver with poor eyesight is driving the vehicle (Phase 4) may be handled as a logic that is likely to cause misperception of the road shape, thereby providing appropriate support for drivers with poor eyesight due to aging or drivers with cataracts.
[0087] <Third Embodiment> <Configuration of Driving Assistance System> Fig. 17 is a block diagram showing an example of the configuration of a driving assistance system according to the third embodiment. As shown in Fig. 17, the driving assistance system is made up of a server 29, a probe vehicle group 30, and a distribution destination vehicle group 31. The probe vehicle group 30 is made up of probe vehicles 37 and 38, but may be made up of three or more probe vehicles. The distribution destination vehicle group 31 is made up of distribution destination vehicles 39 and 40, but may be made up of three or more distribution destination vehicles.
[0088] In addition, the driving assistance system may be constructed by appropriately distributing and arranging each function or component of the server 29 and each function or component of the driving assistance device 41 (see Figure 18) in an in-vehicle device, a PND (Portable Navigation Device) that can be mounted in a vehicle, and a server provided outside the vehicle.
[0089] 18 is a block diagram showing an example of the configuration of a vehicle system 1 including a driving assistance device 41. The vehicle system 1 is mounted on probe vehicles 37 and 38 that make up a probe vehicle group 30. The following describes the case where the vehicle system 1 is mounted on probe vehicle 37, but the same applies to other probe vehicles including probe vehicle 38.
[0090] The driving assistance device 41 includes a probe information transmission unit 42 instead of the assistance control unit 10 (see FIG. 1 ) included in the driving assistance device 2. The other configurations are the same as those of the driving assistance device 2, so detailed description thereof will be omitted here. Note that the driving assistance device 41 may also be configured to include the assistance control unit 10.
[0091] At a predetermined timing, the probe information transmitting unit 42 distributes to the server 29 as probe information the position information of the probe vehicle 37, the direction in which the probe vehicle 37 is traveling, and the result of estimating whether or not the driver has misinterpreted the road shape.
[0092] <Configuration of Server> As shown in FIG. 17, the server 29 includes a probe information acquisition unit 32, a probe information storage unit 33, an update unit 34, a road shape misidentification map DB 35, and an information distribution unit 36.
[0093] The probe information acquisition unit 32 acquires probe information from each of the probe vehicles 37 and 38 .
[0094] The probe information storage unit 33 temporarily stores the probe information acquired by the probe information acquisition unit 32 .
[0095] The road shape misrecognition map DB 35 stores the position where the driver misrecognized the road shape as road shape misrecognition information. At this time, the road shape misrecognition map DB 35 may store the position where the driver misrecognized the road shape as an attribute value of the road link.
[0096] The update unit 34 updates the road shape misrecognition information stored in the road shape misrecognition map DB based on the probe information temporarily stored in the probe information storage unit 33 at a predetermined update timing.
[0097] In response to a request for distribution from a destination vehicle, including the destination vehicles 39 and 40, the information distribution unit 36 distributes the road shape misidentification information stored in the road shape misidentification map DB 35 to the destination vehicle. The road shape misidentification information distributed at this time is information corresponding to the location information of the destination vehicle.
[0098] <Configuration of Delivery Destination Vehicle> Although the delivery destination vehicle 39 will be described below, the same applies to other delivery destination vehicles including the delivery destination vehicle 40.
[0099] The destination vehicle 39 transmits a delivery request including the position information of the destination vehicle 39 to the server 29. Then, the destination vehicle 39 receives from the server 29 road shape misidentification information corresponding to the position information of the destination vehicle 39, and performs driving assistance (for example, the driving assistance described in the first embodiment) based on the road shape misidentification information.
[0100] <Operation of Server> In the third embodiment, the server 29 is described as operating in a multi-processing manner in which the three processes shown in FIGS. 19, 20, and 21 are running, but any program configuration may be used as long as it can realize each function.
[0101] 19 is a flowchart showing the operation of acquiring probe information from a probe vehicle. The following describes the case where probe information is acquired from the probe vehicle 37, but the same applies to other probe vehicles including the probe vehicle 38.
[0102] In step S301 , the probe information acquisition unit 32 acquires probe information from the probe vehicle 37 .
[0103] In step S302 , the probe information acquisition unit 32 stores the acquired probe information in the probe information storage unit 33 .
[0104] FIG. 20 is a flowchart showing the operation of updating the road shape misrecognition information.
[0105] In step S401, the update unit 34 determines whether it is time to update the road shape misrecognition information. The update unit 34 waits until the update timing arrives, and when the update timing arrives, the process proceeds to step S402. The update timing may be set according to any rule, such as when a predetermined amount of probe information or more has been collected, or at regular intervals (e.g., once a month).
[0106] In step S402, the update unit 34 updates the road shape misidentification information stored in the road shape misidentification map DB 35 based on the probe information temporarily stored in the probe information storage unit 33. For example, when the probe information stored in the probe information storage unit 33 contains information on a road shape misidentification that is not stored in the road shape misidentification map DB 35, the update unit 34 stores the information on the road shape misidentification included in the probe information in the road shape misidentification map DB 35. Here, the information on the road shape misidentification includes the position where the driver of the probe vehicle misidentified the road shape.
[0107] If the reliability of the probe information transmitted from the probe vehicle based on the profile of the probe vehicle is low, the update unit 34 may not adopt the probe information. Furthermore, if there is probe information containing information about misidentification of road shape at the same position for multiple probe vehicles, a highly reliable attribute value may be assigned to the road shape misidentification information.
[0108] In step S403 , the update unit 34 deletes the probe information stored in the probe information storage unit 33 .
[0109] 21 is a flowchart showing the operation of distributing road shape misidentification information to a destination vehicle. The following describes the case where road shape misidentification information is distributed to a destination vehicle 39, but the same applies to other destination vehicles including a destination vehicle 40.
[0110] In step S501, the information distribution unit 36 determines whether or not a distribution request has been received from the distribution destination vehicle 39. The information distribution unit 36 waits until a distribution request is received, and when a distribution request is received, the process proceeds to step S502. The distribution request received from the distribution destination vehicle 39 includes the location information of the distribution destination vehicle 39.
[0111] In step S502, the information distribution unit 36 acquires road shape misrecognition information corresponding to the location information included in the distribution request from the road shape misrecognition map DB 35, and distributes the road shape misrecognition information to the distribution destination vehicle 39. The road shape misrecognition information corresponding to the location information included in the distribution request may include road shape misrecognition information within a predetermined range from the location information.
[0112] In the operation of FIG. 21, the driving route information may be received from the destination vehicle together with the delivery request, and road shape misrecognition information along the driving route may be delivered to the destination vehicle.
[0113] <Variation 1> The road shape misidentification information that the server 29 distributes to the destination vehicle may be assigned a reliability. The destination vehicle may notify the server of information indicating whether the road shape misidentification information distributed from the server 29 was useful (validity information indicating whether the road shape misidentification information is valid or invalid). The update unit 34 may increase the reliability associated with road shape misidentification information that the destination vehicle has evaluated as useful, and may decrease the reliability associated with road shape misidentification information that the destination vehicle has evaluated as not useful. The update unit 34 then stores the revised reliability in the road shape misidentification map DB 35 in association with the road shape misidentification information.
[0114] <Modification 2> The probe information may include information about the situation described in the second embodiment. The information about the situation may be stored in the road shape misidentification map DB 35 as an attribute of the road shape misidentification information. The information about the situation may also be included in the driving environment information. This allows the destination vehicle to notify the driver whether or not a situation corresponding to the information about the situation actually occurs, thereby enabling the driver to confirm the authenticity of the road shape misidentification information.
[0115] The server 29 may also distribute road shape misidentification information, which has visual acuity information as an attribute, to the destination vehicle. In this case, the probe information includes the visual acuity information of the driver of the probe vehicle. The road shape misidentification map DB 35 stores the road shape misidentification information, which has visual acuity information as an attribute. The update unit 34 updates the road shape misidentification information, which has visual acuity information as an attribute. This makes it possible to provide information and perform driving assistance according to the visual acuity of the driver of the destination vehicle. For example, the road shape misidentification information may include visual acuity information of the driver at the location where the road shape misidentification occurred, and by comparing the visual acuity information with the visual acuity of the driver of the destination vehicle, it is possible to estimate whether the driver of the destination vehicle has misidentified the road shape. This makes it possible to perform appropriate driving assistance according to the visual acuity of the driver of the destination vehicle.
[0116] <Variation 3> The probe vehicle may be a vehicle equipped with the high-precision locator described in Variation 7 of Embodiment 1. In this case, the probe information includes road shape misrecognition information for each lane. The road shape misrecognition map DB 35 stores the road shape misrecognition information for each lane. The information distribution unit 36 distributes the road shape misrecognition information for each lane to the destination vehicle. This enables the destination vehicle to perform driving assistance according to the lane in which it is traveling.
[0117] <Hardware Configuration> The functions of the road information acquisition unit 6, the light / dark determination unit 7, the gaze estimation unit 8, the recognition estimation unit 9, and the assistance control unit 10 in the driving assistance device 2 described in the first embodiment are realized by processing circuits. That is, the driving assistance device 2 includes a processing circuit for acquiring road information including road shape information of the road on which the host vehicle is traveling, determining the light / dark state ahead of the host vehicle, estimating the gaze direction of the driver of the host vehicle, estimating whether the driver recognizes the road shape ahead of the host vehicle, and performing control to execute predetermined driving assistance when the recognition estimation unit 9 estimates that the driver does not recognize the road shape. The processing circuit may be dedicated hardware or may be a processor (also referred to as a CPU, central processing unit, processing device, arithmetic unit, microprocessor, microcomputer, or DSP (Digital Signal Processor)) that executes a program stored in a memory.
[0118] 22 , the processing circuit 101 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof. The functions of the road information acquisition unit 6, the light / dark determination unit 7, the gaze estimation unit 8, the recognition / estimation unit 9, and the assistance control unit 10 may be realized individually by the processing circuit 101, or all of the functions may be realized together by a single processing circuit 101.
[0119] When the processing circuit 101 is the processor 102 shown in FIG. 23 , the functions of the road information acquisition unit 6, the light / dark judgment unit 7, the gaze estimation unit 8, the recognition / estimation unit 9, and the assistance control unit 10 are realized by software, firmware, or a combination of software and firmware. The software or firmware is written as a program and stored in the memory 103. The processor 102 realizes each function by reading and executing the program recorded in the memory 103. That is, the driving assistance device 2 includes the memory 103 for storing a program that results in the execution of the following steps: acquiring road information including road shape information of the road on which the host vehicle is traveling; determining the light / dark state ahead of the host vehicle; estimating the gaze direction of the driver of the host vehicle; estimating whether the driver recognizes the road shape ahead of the host vehicle; and, if the recognition / estimation unit 9 estimates that the driver does not recognize the road shape, performing control to execute a predetermined driving assistance. It can also be said that these programs cause a computer to execute the procedures or methods of the road information acquisition unit 6, the light / dark judgment unit 7, the gaze estimation unit 8, the recognition estimation unit 9, and the assistance control unit 10. Here, the memory may be, for example, a non-volatile or volatile semiconductor memory such as a random access memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM), a magnetic disk, a flexible disk, an optical disk, a compact disk, a digital versatile disk (DVD), or any other storage medium that will be used in the future.
[0120] In addition, with regard to each function of the road information acquisition unit 6, light / dark judgment unit 7, gaze estimation unit 8, recognition estimation unit 9, and assistance control unit 10, some functions may be realized by dedicated hardware, and other functions may be realized by software or firmware.
[0121] Thus, the processing circuitry can implement each of the above-described functions through hardware, software, firmware, or a combination thereof.
[0122] Although the above has described the driving assistance device 2 shown in Figure 1, the same applies to the driving assistance device 15 shown in Figure 11, the driving assistance device 17 shown in Figure 12, the driving assistance device 19 shown in Figure 13, the driving assistance device 24 shown in Figure 14, the server 29 shown in Figure 17, and the driving assistance device 41 shown in Figure 18.
[0123] Within the scope of the present disclosure, the embodiments can be freely combined, modified, or omitted as appropriate.
[0124] Although the present disclosure has been described in detail, the above description is illustrative in all respects and is not restrictive. It is understood that countless variations not illustrated can be envisioned.
[0125] 1 Vehicle system, 2 Driving assistance device, 3 Normal accuracy locator, 4 DMS, 5 Lighting device, 6 Road information acquisition unit, 7 Light / dark judgment unit, 8 Gaze estimation unit, 9 Recognition estimation unit, 10 Assistance control unit, 11 Normal accuracy map DB, 12 Positioning unit, 13 Information transmission unit, 14 Own vehicle, 15 Driving assistance device, 16 Gaze distribution learning unit, 17 Driving assistance device, 18 Driver information acquisition unit, 19 Driving assistance device, 20 Driving environment information acquisition unit, 21 Risk judgment unit, 22 Surroundings detection device, 23 Notification device, 24 Driving assistance device, 25 Driving environment information acquisition unit, 26 Surroundings detection device, 27 Mountain, 28 House, 29 Server, 30 Probe vehicle group, 31 Distribution destination vehicle group, 32 Probe information acquisition unit, 33 Probe information storage unit, 34 Update unit, 35 Road shape misidentification map DB, 36 Information distribution unit, 37 probe vehicle, 38 probe vehicle, 39 distribution destination vehicle, 40 distribution destination vehicle, 41 driving assistance device, 42 probe information transmission unit, 101 processing circuit, 102 processor, 103 memory.
Claims
1. A driving assistance device comprising: a road information acquisition unit that acquires road information including road shape information of a road on which a host vehicle is traveling; a light and dark judgment unit that judges the light and dark conditions ahead of the host vehicle; a gaze estimation unit that estimates the gaze direction of the driver of the host vehicle based on line of sight information of the driver; a recognition estimation unit that estimates whether the driver recognizes the road shape ahead of the host vehicle based on the road shape information acquired by the road information acquisition unit, the light and dark conditions judged by the light and dark judgment unit, and the gaze direction estimated by the gaze estimation unit; and an assistance control unit that performs control to execute predetermined driving assistance when the recognition estimation unit estimates that the driver does not recognize the road shape.
2. A driving assistance device as described in claim 1, wherein the recognition estimation unit estimates whether the driver correctly recognizes the shape of the road ahead of the vehicle based on the state in which the driver is gazing at the road ahead of the vehicle.
3. The driving assistance device of claim 2, wherein the recognition and estimation unit estimates the shape of a phantom road, which is a road that does not actually exist but which the driver mistakenly believes to exist, and estimates whether the driver correctly recognizes the shape of the road ahead of the vehicle based on the state in which the driver is gazing at the phantom road.
4. A driving assistance device as described in claim 3, wherein the recognition and estimation unit estimates the shape of the phantom road based on the road shape information acquired by the road information acquisition unit.
5. A driving assistance device as described in claim 1, further comprising a driving environment information acquisition unit that acquires driving environment information including at least one of the contrast of the road ahead of the vehicle, the presence of an obstruction that impedes visibility of the road ahead of the vehicle, changes in gradient of the road ahead of the vehicle, and visibility of the road ahead of the vehicle, wherein the recognition estimation unit estimates whether the driver correctly recognizes the road shape ahead of the vehicle based on the driving environment information acquired by the driving environment information acquisition unit.
6. A driving assistance device as described in claim 1, wherein the light / darkness determination unit determines that it is dark ahead of the host vehicle when at least one of a headlight, a parking lamp, and a fog lamp provided on the host vehicle is on.
7. A driving assistance device as described in claim 1, further comprising a gaze distribution learning unit that learns the gaze distribution of the driver with respect to the road shape ahead of the vehicle when the area around the vehicle is bright, and the recognition estimation unit estimates whether the driver correctly recognizes the road shape ahead of the vehicle based on the gaze direction estimated by the gaze estimation unit, the gaze distribution learned by the gaze distribution learning unit, and road shape information acquired by the road information acquisition unit.
8. A driving assistance device as described in claim 1, further comprising a driver information acquisition unit that acquires driver information including at least one of the driver's facial expressions and gestures, and the recognition estimation unit estimates whether the driver correctly recognizes the road shape ahead of the vehicle based on the driver information acquired by the driver information acquisition unit.
9. The driving assistance device according to claim 8, wherein the driver information includes the driver's visual acuity.
10. The driving assistance device according to claim 1, wherein the assistance control unit instructs the assistance illumination device to perform assistance illumination as the driving assistance, the assistance illumination enabling the driver to recognize the road shape ahead of the vehicle.
11. The driving assistance device according to claim 1, wherein the assistance control unit instructs a HUD (Head Up Display) to execute, as the driving assistance, displaying a display object superimposed on the road shape ahead of the vehicle.
12. The driving assistance device according to claim 1, wherein the assistance control unit instructs an EPS (Electric Power Steering) to generate stress to move the steering wheel in a direction that follows the shape of the road ahead of the vehicle as the driving assistance.
13. The driving assistance device of claim 1, wherein the recognition estimation unit calculates a degree of recognition indicating the degree to which the driver correctly recognizes the road shape ahead of the vehicle based on the road shape information, the light and dark state, and the gaze direction, and the assistance control unit controls the execution of the driving assistance based on the degree of recognition calculated by the recognition estimation unit.
14. The driving assistance device according to claim 13, wherein the assistance control unit instructs the assistance illumination device to perform, as the driving assistance, assistance illumination that allows the driver to recognize the road shape ahead of the vehicle in a manner that is easier for the driver to recognize as the degree of recognition becomes lower.
15. A driving assistance device as described in claim 13, wherein the assistance control unit performs control to execute the driving assistance by increasing the number of assistance types for allowing the driver to recognize the road shape ahead of the vehicle as the recognition degree becomes smaller.
16. A driving assistance device as described in claim 1, further comprising: a driving environment information acquisition unit that acquires driving environment information including a road ahead of the vehicle and dangerous objects which are moving bodies or land objects existing around the road; and a risk judgment unit that judges that there is a risk when the vehicle is likely to collide with the dangerous object and the driver does not visually recognize the dangerous object based on the driving environment information acquired by the driving environment information acquisition unit, the road shape information acquired by the road information acquisition unit, and the gaze direction estimated by the gaze estimation unit, wherein the assistance control unit controls so that the driving assistance mode that calls attention to the dangerous object when there is a risk is executed differently from the driving assistance mode that makes the driver recognize the road shape ahead of the vehicle.
17. A road information acquisition unit that acquires road information including road shape information of a road on which at least one vehicle is traveling; a light and dark judgment unit that judges a light and dark state ahead of the vehicle; a gaze estimation unit that estimates a gaze direction of the driver of the vehicle based on line-of-sight information of the driver; a recognition estimation unit that estimates whether the driver recognizes the road shape ahead of the vehicle based on the road shape information acquired by the road information acquisition unit, the light and dark state judged by the light and dark judgment unit, and the gaze direction estimated by the gaze estimation unit; a probe information storage unit that temporarily stores an estimation result of the recognition estimation unit as probe information; a road shape misrecognition map database that stores a position where the driver misrecognizes the road shape as road shape misrecognition information; and an update unit that updates the road shape misrecognition information stored in the road shape misrecognition map database based on the probe information temporarily stored in the probe information storage unit at a predetermined timing. an information distribution unit that distributes the road shape misrecognition information stored in the road shape misrecognition map database to a distribution destination in response to a distribution request obtained from the distribution destination.
18. A driving assistance system according to claim 17, wherein the information distribution unit acquires driving route information from the distribution destination, and distributes the road shape misrecognition information corresponding to the driving route information to the distribution destination.
19. The driving assistance system described in claim 17, wherein the update unit associates the reliability calculated based on a predetermined rule with the road shape misidentification information and stores it in the road shape misidentification map database; the information distribution unit distributes the road shape misidentification information associated with the reliability to the distribution destination in response to the distribution request and receives validity information from the distribution destination indicating that the road shape misidentification information is valid or invalid; and the update unit associates the reliability calculated taking into account the validity information at the timing with the road shape misidentification information and stores it in the road shape misidentification map database.
20. The driving assistance system described in claim 17, wherein the probe information includes visual acuity information of the driver, the road shape misidentification map database stores the road shape misidentification information having the visual acuity information as an attribute, the update unit updates the road shape misidentification information having the visual acuity information as an attribute, and the distribution unit distributes the road shape misidentification information having the visual acuity information as an attribute to the distribution destination.
Citation Information
Patent Citations
Lighting body controller for vehicle
JP2010105580A
Light distribution control device, light distribution control method, and light distribution control program
JP6929481B1
