Determination method and determination device
The method calculates forward gaze point distance to determine driver leeway, addressing the inability of existing technologies to assess vertical gaze changes, enabling effective driving support and notification.
Patent Information
- Application Number
- JP2023086921
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-26
- Publication Date
- 2024-12-06
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing technologies fail to determine how much leeway a driver has for driving operations based on the position of their gaze point, which changes as their line of sight moves vertically.
A determination method and device that calculates the forward gaze point distance to determine the driver's leeway by identifying the gaze point position and using a predetermined distance threshold for absolute evaluation.
Enables accurate determination of the driver's leeway based on the vertical movement of their gaze, allowing for appropriate driving support and notification based on the driver's gaze point distance.
Smart Images

Figure 2024170013000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a determination method and a determination device. [Background technology]
[0002] A technology is known that measures the percentage of the driver's gaze fixed in each area that divides the vehicle's windshield equally in the width direction of the vehicle, calculates the amount of change in the gaze fixation percentage compared to the normal gaze fixation percentage, and if the amount of change is greater than a predetermined value, judges the driver's psychological state as being stressed. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-165137 A Summary of the Invention [Problem to be solved by the invention]
[0004] The behavior of the driver's gaze, which indicates a change in the driver's psychological state, includes the behavior of the gaze moving in the vertical direction. However, since the technology described in Patent Document 1 is a technology that recognizes the movement of the gaze between areas divided in the horizontal direction as the behavior of the gaze, there is a problem that it is not possible to determine how much room the driver has depending on the position of the driver's gaze point that changes due to the gaze moving in the vertical direction, for example, when the gaze moves in the vertical direction within the same area and the position of the gaze point that the driver is watching changes.
[0005] The problem that the present invention aims to solve is to provide a judgment method and judgment device that can judge how much leeway a driver has in driving operations based on the position of the driver's gaze point, which changes as the line of sight moves up and down. [Means for solving the problem]
[0006] The present invention solves the above problem by identifying the position of the gaze point at which the driver is gazing ahead based on the vehicle driver's line of sight information, calculating the forward gaze point distance to the position of the gaze point, and determining that the greater the calculated forward gaze point distance, the more leeway the driver has in terms of driving operations. Effect of the Invention
[0007] According to the present invention, it is possible to determine how much room the driver has for driving operation, based on the position of the driver's gaze point which changes as the line of sight moves in the vertical direction. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a block diagram showing a configuration of a driving support system including a determination device according to this embodiment. [Diagram 2] FIG. 2 is a diagram showing the relationship between the movement of the driver's line of sight in the vertical direction and the position of the forward gaze point. [Figure 3A] FIG. 3A is a diagram showing the relationship between the line of sight projection onto the windshield of a vehicle and the forward gaze point distance. [Figure 3B] FIG. 3B is a diagram showing the relationship between the line of sight projection onto the windshield of the vehicle and the forward gaze point distance. [Figure 4A] FIG. 4A is a diagram showing the behavior of the driver's line of sight in the up and down direction and the result of the determination as to whether the driver has room to maneuver. [Figure 4B] FIG. 4B is a diagram showing the behavior of the driver's line of sight in the up and down direction and the result of the determination as to whether the driver has room to maneuver. [Figure 5A] FIG. 5A is a diagram showing a forward gaze point when a vehicle is turning. [Figure 5B] FIG. 5B is a diagram showing the forward gaze point when the vehicle is turning. [Figure 6] FIG. 6 is a flowchart for explaining the processing procedure of the determination method according to this embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In this embodiment, a determination device according to an embodiment of the present invention will be described as being applied to a driving assistance system.
[0010] FIG. 1 is a diagram showing a block configuration of a driving assistance system including a determination device according to this embodiment. The driving assistance system 1 includes a determination device 100, a vehicle controller 200, and an output device 300. Each device is mounted on a vehicle and is connected to the vehicle via a CAN (Controller Area Network) or other in-vehicle LAN for mutual information exchange. The driving assistance system 1 controls the driving of the vehicle to execute control to support the driving of the vehicle. The driving assistance system 1 can be applied not only to the driving of a vehicle by autonomous driving control, but also to the case of supporting the driving of the vehicle by manual driving by a driver. When applied to the autonomous driving control of a vehicle, the driving assistance system 1 can be applied to the case of autonomously controlling both speed control and steering control, as well as the case of autonomously controlling one of speed control and steering control and manually controlling the other.
[0011] The determination device 100 according to this embodiment will be described below. The determination device 100 determines how much leeway the driver of the vehicle has in driving the vehicle. Having leeway means that the driver is driving with a sense of security in driving the vehicle. When the driver has leeway, the driver can drive with more of the situation farther away from the driver (situations further back) in view. On the other hand, not having leeway means that the driver is driving with a sense of anxiety in driving the vehicle. When the driver has no leeway, the driver can only drive with the situation closer to the driver (situations closer to the driver) in view. For example, when the driver is a beginner driver or when the driver is driving in a difficult driving situation such as a snowy road, the driver has no leeway and starts to see places closer to the driver.
[0012] 1, the determination device 100 of the present embodiment includes a gaze information acquisition device 2, a forward gaze point calculation device 3, a vehicle information acquisition device 4, and a processor 10. The gaze information acquisition device 2 is an example of a "gaze information acquisition unit" described in the claims. That is, in the present embodiment, the gaze information acquisition device 2 includes a gaze information acquisition function. Note that the gaze information acquisition function is not limited to being included in the gaze information acquisition device 2.
[0013] The gaze information acquisition device 2 is a device that acquires gaze information of a driver of a vehicle. The gaze information acquisition device 2 sequentially measures the movement of the driver's pupils and tracks the gaze of the driver. For example, the gaze information acquisition device 2 includes a camera that captures an image of the driver's face. The gaze information acquisition device 2 recognizes the gaze of the driver by capturing an image of the driver's face with the camera and performing gaze recognition processing on the captured image of the driver's face. The gaze information acquisition device 2 may also recognize the gaze of the driver using a corneal reflex method by emitting a light source toward the driver.
[0014] The forward gaze point calculation device 3 is a device that calculates the forward gaze point distance. The forward gaze point distance is the distance to the position of the gaze point that the driver gazes at in front. For example, the forward gaze point distance is the distance from the position of the vehicle to the position of the gaze point. The position of the vehicle is the position of the driver's viewpoint on the windshield of the vehicle. The position of the vehicle may be the position of the driver of the vehicle. The forward gaze point calculation device 3 includes, as functional blocks, a gaze point identification unit 31 and a gaze point distance calculation unit 32. The gaze point identification unit 31 identifies the position of the gaze point based on the driver's gaze information. For example, the gaze point identification unit 31 identifies the position on the extension line of the gaze direction as the position of the gaze point based on the driver's gaze information. The position of the gaze point is a position on the road in front of the driver.
[0015] Here, the relationship between the driver's line of sight and the position of the driver's gaze point will be described with reference to FIG. 2. FIG. 2 is a diagram showing the relationship between the movement of the driver's line of sight in the vertical direction and the position of the forward gaze point. In FIG. 2, the line of sight extends from the position of the driver D's eyes. The line of sight L1 is the line of sight when the driver D is looking at the near side in the traveling direction of the vehicle. The gaze point P1 is the gaze point when the driver D is looking at the near side in the traveling direction of the vehicle. The line of sight L2 is the line of sight when the driver D is looking at the far side in the traveling direction of the vehicle. The gaze point P2 is the gaze point when the driver D is looking at the far side in the traveling direction of the vehicle. The more the line of sight of the driver D is upward (direction DL), the more the gaze point of the driver D is located in the direction farther back in the traveling direction of the vehicle (direction DP). In other words, the position of the gaze point moves as the driver's line of sight moves up and down.
[0016] The gaze point distance calculation unit 32 calculates the forward gaze point distance to the driver's gaze point by performing a geometric calculation based on the driver's gaze information. Here, a method of calculating the forward gaze point distance will be described with reference to FIG. 3. FIGS. 3A and 3B are diagrams showing the relationship between the gaze projection onto the windshield of the vehicle and the forward gaze point distance. In FIG. 3B, the left-right direction (vehicle width direction) of the vehicle is the Y-axis direction, and the height direction of the vehicle (perpendicular to the vehicle width direction) is the Z-axis direction. Also, the tangent point between the lower window frame of the windshield and the left window frame on the YZ plane is the origin. When the driver's gaze moves upward, the position of the driver's gaze point becomes a position farther from the driver. That is, the forward gaze point distance changes depending on the vertical movement of the driver's gaze. In FIG. 3A, the driver's gaze point P is in the direction of the gaze L extending forward from the driver's head Pd. The intersection point Ps of the gaze L and a straight line extending perpendicular to the ground from the position of the lowest part Pf of the vehicle's windshield is the intersection point of the gaze L. If the height of the driver's head Pd is h d , the height of the bottom of the windshield Pf is h g The forward gaze point distance Peye,x can be calculated using the following equation (1), where z is the height of the line of sight intersection Ps in the vertical direction (Z-axis direction) based on the height of the lower window frame Pf of the windshield.
number
[0017] In general, when the driver's line of sight moves upward, the forward gaze point distance becomes larger. Conversely, when the driver's line of sight moves downward, the forward gaze point distance becomes smaller. In this embodiment, when the line of sight information acquisition device 2 recognizes the line of sight by emitting a light source toward the driver, the line of sight information acquisition device 2 may calculate the gaze point based on the intensity of light reflected from the driver's eyeball.
[0018] The vehicle information acquisition device 4 acquires vehicle information related to the state of the vehicle. The state of the vehicle includes the speed and lateral acceleration of the host vehicle. These may be acquired from the vehicle controller 200 or from each sensor (not shown) of the vehicle.
[0019] The processor 10 is a computer including a ROM 12 in which a program for executing vehicle driving control is stored, a CPU 11 as an operating circuit that functions as a determination device 100 by executing the program stored in the ROM 12, and a RAM 13 that functions as an accessible storage device. The processor 10 exchanges information with the gaze information acquisition device 2, the forward gaze point calculation device 3, the vehicle information acquisition device 4, the vehicle controller 200, and the output device 300. The processor 10 includes a determination unit 110 and a control instruction unit 111 as functional blocks. The processor 10 of this embodiment executes each function by cooperation between the software for implementing each of the above functions or executing each process and the above hardware. Note that these functional blocks are provided in the processor 10, but are not limited thereto and may be provided in other devices.
[0020] The determination unit 110 acquires the forward gaze point distance from the forward gaze point calculation device 3, and determines how much leeway the driver has for driving operation according to the forward gaze point distance. In this determination, the greater the forward gaze point distance, the greater the leeway the driver is determined to have. For example, when the forward gaze point distance is equal to or greater than a predetermined distance threshold, the determination unit 110 determines that the driver has leeway. Also, when the forward gaze point distance is less than a predetermined distance threshold, the determination unit 110 determines that the driver does not have leeway. When the driver's gaze is downward, the forward gaze point distance is small, and when the driver's gaze is upward, the forward gaze point distance is large. Therefore, a small forward gaze point distance means that the driver's gaze is directed downward and the driver is looking at the near side in the traveling direction of the vehicle, and it is considered that the driver has no leeway. On the other hand, a large forward gaze point distance means that the driver's gaze is directed upward and the driver is looking at the far side in the traveling direction of the vehicle, and it is considered that the driver has leeway.
[0021] As described above, in this embodiment, by performing a judgment process based on the magnitude relationship between the forward gaze point distance and a predetermined distance threshold, it is possible to judge how much leeway the driver has depending on the position of the driver's gaze point. In particular, in the conventional technology, the degree of leeway the driver has is judged by a relative comparison with the behavior of the driver's line of sight in a normal state, but in this embodiment, by using a predetermined distance threshold for comparing the magnitude relationship with the forward gaze point distance, it is possible to judge how much leeway the driver has by an absolute evaluation based on the predetermined distance threshold.
[0022] 4A and 4B are diagrams showing the behavior of the driver's gaze in the up-down direction and the result of the determination of whether the driver has room to maneuver. FIG. 4A shows the position of the driver's gaze point P when the driver is looking at the near side in the traveling direction of the vehicle and the forward gaze point distance is small. In this case, the determination unit 110 determines that the driver does not have room to maneuver. FIG. 4B shows the position of the driver's gaze point P when the driver is looking at the far side in the traveling direction of the vehicle and the forward gaze point distance is large. In this case, the determination unit 110 determines that the driver has room to maneuver.
[0023] The threshold of the forward gaze point distance is set according to the vehicle speed and / or lateral acceleration of the vehicle. The determination unit 110 acquires the vehicle speed from the vehicle information acquisition device 4 and sets the predetermined distance threshold based on the vehicle speed. For example, the predetermined distance threshold is set so that the predetermined distance threshold becomes larger as the vehicle speed increases. In general, the position at which the driver should gaze in front of the vehicle differs according to the vehicle speed. When the vehicle speed is high, the driver needs to gaze further in the traveling direction of the vehicle, that is, further away, than when the vehicle speed is low. For example, the predetermined distance threshold is the distance to a point that the vehicle will reach after a predetermined time when the vehicle travels at the acquired vehicle speed. By setting the forward gaze point distance according to the vehicle speed, the determination unit 110 can make different determinations when the vehicle speed is low and when the vehicle speed is high, even if the forward gaze point distance is the same.
[0024] In addition, the determination unit 110 acquires the lateral acceleration of the vehicle from the vehicle information acquisition device 4, and sets a predetermined distance threshold based on the lateral acceleration of the vehicle. For example, the predetermined distance threshold is set so that the predetermined distance threshold is smaller as the lateral acceleration of the vehicle increases. In general, when the vehicle is turning, the position that the driver should look at in front of the vehicle varies depending on the turning state. When the vehicle speed is the same, the vehicle travels on a road surface with a smaller turning radius as the lateral acceleration increases, and travels on a road surface with a larger turning radius as the lateral acceleration decreases. At this time, when the vehicle travels with a smaller lateral acceleration and a larger turning radius, the driver needs to look further in the traveling direction of the vehicle, that is, further away, than when the vehicle travels with a larger lateral acceleration and a smaller turning radius. By setting the predetermined distance threshold according to the lateral acceleration, it becomes possible to make a determination according to the turning state.
[0025] In the present embodiment, the predetermined distance threshold may be set using either the vehicle or the lateral acceleration, or the predetermined distance threshold may be set using both the vehicle and the lateral acceleration. For example, the determination unit 110 calculates the change in the vehicle speed and the change in the lateral acceleration of the vehicle, compares the change in the vehicle speed and the change in the lateral acceleration, and sets the predetermined distance threshold using the information of the larger change. In addition, when the lateral acceleration is the same, the determination unit 110 sets the predetermined distance threshold so that the predetermined distance threshold becomes larger as the vehicle speed of the vehicle increases. In addition, when the vehicle speed is the same, the determination unit 110 sets the predetermined distance threshold so that the predetermined distance threshold becomes smaller as the lateral acceleration of the vehicle increases. As a result, even if the vehicle speed is the same and the forward gaze point distance is the same, the determination unit 110 can make different determinations when the lateral acceleration of the vehicle is low and when the lateral acceleration of the vehicle is high. In addition, even if the lateral acceleration is the same and the forward gaze point distance is the same, the determination unit 110 can make different determinations when the vehicle speed of the vehicle is low and when the vehicle speed of the vehicle is high.
[0026] 5A and 5B are diagrams showing the forward gaze point when the vehicle is turning. The position of the forward gaze point when turning will be described using FIG. 5A and FIG. 5B. In FIG. 5A, the vehicle V1 turns with a turning radius r, and in FIG. 5B, the vehicle V1 turns with a turning radius R. The turning radius r is a value smaller than the turning radius R. That is, the lateral acceleration of the vehicle V1 in FIG. 5A is larger than the lateral acceleration of the vehicle V1 in FIG. 5B. The vehicle speed of the vehicle V1 in FIG. 5A and FIG. 5B is the same at the vehicle speed V. When turning, the position at which the driver of the vehicle V1 should look changes depending on the turning state (vehicle speed and lateral acceleration) of the vehicle V1, so the determination unit 110 sets a predetermined distance threshold value depending on the turning state of the vehicle V1. In FIG. 5A and FIG. 5B, the position at which the driver should look is shown as position P. When the lateral acceleration is the same, the turning radius becomes larger as the vehicle speed becomes higher. On the other hand, when the vehicle speed is the same, the higher the lateral acceleration, the smaller the turning radius. The larger the turning radius of the corner on which the vehicle is traveling, the farther the end of the corner is, and the farther the position where the driver should look is, so the determination unit 110 needs to set the predetermined distance threshold to a large value. The predetermined distance threshold in FIG. 5B is larger than the predetermined distance threshold in FIG. 5A. Note that this embodiment is not limited to the case where the vehicle is turning, but is also applicable to the case where the vehicle is traveling straight.
[0027] In the present embodiment, the determination of how much leeway the driver has is not limited to using a classification of whether the driver has leeway or not, but may use three or more classifications. For example, the determination unit 110 may use the leeway degree to determine how much leeway the driver has for driving operations. The leeway degree is previously set into three or more graded classifications according to the forward gaze point distance. The classification of the leeway degree is a classification indicating that the driver has more leeway as the forward gaze point distance increases. For example, the leeway degree is set into three classifications, "leeway," "normal," and "no leeway," in order of the forward gaze point distance. The classification may be divided into four or more graded classifications. The determination unit 110 compares the forward gaze point distance with a plurality of predetermined distance thresholds set in stages for each classification, and determines the leeway degree according to the comparison result. When there are three classifications, two predetermined distance thresholds are set to divide the classifications. The determination unit 110 determines the classification corresponding to the forward gaze point distance as the leeway degree. The leeway degree is not limited to being set into graded classifications, but may be a continuous value.
[0028] The control instruction unit 111 executes at least one of the driving assistance control of the vehicle and a notification to the driver according to the result of the judgment made by the judgment unit 110. Specifically, the control instruction unit 111 calculates a braking force for executing braking control and a driving force for executing driving control in the driving assistance control according to the result of the judgment. For example, when the control instruction unit 111 judges that the driver does not have sufficient margin, the control instruction unit 111 calculates a braking force higher than when the driver has sufficient margin. The control instruction unit 111 generates a control instruction for executing the braking control with the calculated braking force and outputs it to the vehicle controller 200. When the control instruction unit 111 judges that the driver does not have sufficient margin, the control instruction unit 111 calculates a driving force lower than when the driver has sufficient margin. The control instruction unit 111 generates a control instruction for executing the driving control with the calculated driving force and outputs it to the vehicle controller 200. When the control instruction unit 111 judges that the driver does not have sufficient margin, the control instruction unit 111 may calculate the braking force or the driving force based on the margin. For example, the braking force may be calculated to be higher or the driving force may be calculated to be lower as the degree of tolerance indicates that the driver has more tolerance.
[0029] In addition, the control instruction unit 111 may change the assistance level related to the driving assistance control according to the result of the judgment, and execute the driving assistance control according to the changed assistance level. For example, when the control instruction unit 111 judges that the driver does not have sufficient margin, the control instruction unit 111 changes the assistance level to a higher level than when the control unit 111 judges that the driver has sufficient margin. The control instruction unit 111 generates a control instruction for executing the driving assistance control at the changed assistance level, and outputs it to the vehicle controller 200. The assistance level defines the extent to which the driving assistance system 1 intervenes in the control of the driving operation of the vehicle, in other words, the extent to which the manual operation of the driver intervenes. The driving assistance system 1 realizes the assistance of the driving operation defined by each assistance level when autonomously controlling the driving of the vehicle by combining the autonomous control of the driving speed using the autonomous speed control function and the autonomous control of the steering operation using the autonomous steering control function.
[0030] The assistance level in this embodiment can be set, for example, based on the driving automation level defined in SAE J3016: SEP2016, Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles published by the Society of Automotive Engineers (SAE).
[0031] The control instruction unit 111 may also execute a notification to the driver. For example, when the control instruction unit 111 determines that the driver does not have sufficient time, the control instruction unit 111 outputs a control instruction to the output device 300 to control the output device 300 to output image information and audio information indicating that the driver does not have sufficient time to maneuver.
[0032] The vehicle controller 200 is an in-vehicle computer such as an electronic control unit (ECU), and electronically controls a drive mechanism that governs the operation of the vehicle. The vehicle controller 200 controls a drive device, a braking device, and a steering device included in the drive mechanism to run the vehicle.
[0033] The drive mechanism includes an electric motor and / or an internal combustion engine as a driving source for driving the vehicle, a power transmission device including a drive shaft and an automatic transmission that transmits the output from these driving sources to the drive wheels, a drive device that controls the power transmission device, and a braking device that brakes the wheels. The vehicle controller 200 generates control signals for each of these drive mechanisms and causes them to execute driving control including acceleration and deceleration of the vehicle. By sending control information to the drive mechanism, driving control including acceleration and deceleration of the vehicle can be automatically performed.
[0034] For example, the vehicle controller 200 controls the steering device so that the vehicle travels while maintaining a predetermined lateral position with respect to the travel path (trajectory). The travel path in this specification is a path corresponding to the trajectory on which the host vehicle travels, and can be identified by road, uphill / downhill of the road, and lane of the road. The steering device includes a steering actuator. The steering actuator includes a motor attached to a steering column shaft, etc. The steering device executes steering control of the vehicle based on a control signal obtained from the vehicle controller 200 or an input signal by the driver's steering operation.
[0035] The output device 300 is a device for outputting information and providing the information to the driver. The output device 300 may be a device mounted on a vehicle, or may be a device mounted on a portable terminal such as a mobile phone or a tablet terminal used by the driver. For example, the output device 300 is a device for displaying image information, and is configured by a liquid crystal display, a projector, or the like. The output device 300 may also be a device for outputting audio information. For example, the output device 300 is configured by a speaker.
[0036] In this embodiment, when it is determined by the judgment unit 110 that the driver does not have enough leeway, the output device 300 notifies the driver of image information and / or audio information including the fact that the driver does not have enough leeway.
[0037] Here, the processing procedure of the determination method according to this embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart for explaining the processing procedure of the determination method according to this embodiment. In this embodiment, for example, the determination device 100 starts the control flow from step S200 while the vehicle is traveling.
[0038] In step S200, the determination device 100 acquires the driver's gaze information using the gaze information acquisition device 2. In step S201, the determination device 100 calculates the forward gaze point distance to the driver's gaze point using the forward gaze point calculation device 3 based on the acquired driver's gaze information. In step S202, the determination device 100 acquires vehicle information including the vehicle speed and lateral acceleration of the vehicle using the vehicle information acquisition device 4. In step S203, the determination device 100 sets a predetermined distance threshold based on the vehicle speed and lateral acceleration of the vehicle. For example, the higher the vehicle speed, the larger the predetermined distance threshold is set by the determination device 100. In addition, the higher the lateral acceleration, the smaller the predetermined distance threshold is set by the determination device 100. Since the higher the vehicle speed, the greater the distance traveled in the same time, and therefore the higher the vehicle speed, the greater the driver should gaze at a position further ahead, the higher the predetermined distance threshold is calculated based on the vehicle speed. In addition, when the vehicle is turning, if the lateral acceleration is the same, the turning radius is larger as the vehicle speed is higher. On the other hand, when the vehicle speed is the same, the higher the lateral acceleration, the smaller the turning radius. The larger the turning radius of the corner in which the vehicle is traveling, the farther the end of the corner is, so the position where the driver should look is farther away. Therefore, the predetermined distance threshold is set to a large value.
[0039] In step S204, the determination device 100 compares the forward gaze point distance calculated in step S201 with the predetermined distance threshold set in step S203, and determines whether the forward gaze point distance is greater than the predetermined distance threshold. If it is determined that the forward gaze point distance is greater than the predetermined distance threshold, the determination device 100 proceeds to step S205. If it is determined that the forward gaze point distance is not greater than the predetermined distance threshold, the determination device 100 proceeds to step S206. In step S205, the determination device 100 determines that the driver has leeway. This is because the driver is looking at a distant position in front and is in a psychological state in which he or she can process a lot of forward visibility information, so it is considered that the driver has leeway for driving operations. In step S206, the determination device 100 determines that the driver does not have leeway for driving operations. This is because the driver is looking at a close position in front and is in a psychological state in which he or she does not have leeway for processing a lot of forward visibility information, so it is considered that the driver does not have leeway for driving operations.
[0040] In step S207, when the determination device 100 determines that the driver does not have sufficient margin, the determination device 100 notifies the driver of image information and / or audio information indicating the result of the determination in step S205 or S206 via the output device 300. In step S208, the determination device 100 determines the braking force of the braking device or the driving force of the driving device based on the result of the determination in step S205 or S206. Note that in step S207, when the result of the determination determines that the driver does not have sufficient margin, the output device 300 may notify the driver of image information and / or audio information indicating that the driver does not have sufficient margin, and when the result of the determination determines that the driver has sufficient margin, the output device 300 may not notify the driver.
[0041] As described above, in this embodiment, the determination method and the determination device acquire the gaze information of the driver of the vehicle, identify the position of the gaze point that the driver gazes at in front based on the gaze information, calculate the forward gaze point distance to the gaze point position, and determine that the driver has more leeway in driving the vehicle as the calculated forward gaze point distance increases. This makes it possible to estimate how much leeway the driver has in driving the vehicle, depending on the position of the driver's gaze point that changes as the gaze moves up and down.
[0042] In the present embodiment, the determination method and the determination device determine that the driver has leeway when the forward gaze point distance is equal to or greater than a predetermined distance threshold, and determine that the driver does not have leeway when the forward gaze point distance is less than the predetermined distance threshold. This makes it possible to determine whether the driver has leeway or not according to the behavior of the driver's line of sight moving in the vertical direction.
[0043] In the present embodiment, the determination method and the determination device acquire the vehicle speed and set the predetermined distance threshold so that the predetermined distance threshold becomes larger as the vehicle speed increases. This allows different determinations to be made when the vehicle speed is low and when the vehicle speed is high, even if the forward gaze point distance is the same.
[0044] In the present embodiment, the determination method and the determination device acquire the lateral acceleration of the vehicle, and set the predetermined distance threshold so that the predetermined distance threshold decreases as the lateral acceleration of the vehicle increases. This allows different determinations to be made when the lateral acceleration is low and when the lateral acceleration is high, even if the forward gaze point distance is the same.
[0045] In the present embodiment, the determination method and device compare the forward gaze point distance with a plurality of predetermined distance thresholds set in stages for each category, determine the degree of freedom depending on the comparison result, and the degree of freedom indicating how much freedom the driver who is to be determined has for driving operation is preset into three or more stages according to the forward gaze point distance. This makes it possible to determine how much freedom the driver has in stages depending on the behavior of the driver's line of sight moving in the vertical direction.
[0046] In the present embodiment, the determination method and the determination device execute at least one of driving assistance control of the vehicle and a notification to the driver according to the result of the determination, thereby enabling the driver to recognize his / her own margin of safety or improving the vehicle dynamics performance according to the driver's margin of safety.
[0047] The above-described embodiments are described to facilitate understanding of the present invention, and are not described to limit the present invention. Therefore, each element disclosed in the above embodiments is intended to include all design modifications and equivalents that fall within the technical scope of the present invention. [Explanation of symbols]
[0048] 1. Driving assistance systems 2… Gaze information acquisition device 3…Forward gaze point calculation device 31...Point of interest identification part 32...Gaze point distance calculation unit 4…Vehicle information acquisition device 100…Judgment device 10…Processor 11...CPU 12...ROM 13…RAM 110…Judgment section 111...Control instruction section 200…Vehicle controller 300…Output device
Claims
1. A determination method executed by a determination device, comprising: The determination device includes: Acquires gaze information of the vehicle driver, Identifying a position of a gaze point at which the driver is gazing ahead based on the line of sight information; Calculating a forward gaze point distance to the position of the gaze point; The method determines that the driver has more leeway in driving operations as the calculated forward gaze point distance increases.
2. The method of claim 1, The determination device includes: When the forward gaze point distance is equal to or greater than a predetermined distance threshold, it is determined that the driver has sufficient margin of safety; The method for determining that the driver is under-reliable when the forward gaze point distance is less than the predetermined distance threshold.
3. The method of claim 2, The determination device includes: Acquire a vehicle speed of the vehicle; The method for determining whether or not the predetermined distance threshold is set is such that the predetermined distance threshold becomes larger as the vehicle speed increases.
4. The method according to claim 2 or 3, The determination device includes: obtaining a lateral acceleration of the vehicle; The method for determining whether or not the predetermined distance threshold is set so as to decrease as the lateral acceleration of the vehicle increases.
5. The method of claim 1, The degree of margin indicating how much margin the driver has for the driving operation is preset into three or more graded categories according to the forward gaze point distance, The determination device includes: comparing the forward gaze point distance with a plurality of predetermined distance thresholds that are set stepwise for each of the sections; A method for determining the margin according to a result of the comparison.
6. The method according to claim 1 or 2, The determination device includes: A determination method for performing at least one of driving assistance control of the vehicle and notifying the driver depending on a result of the determination.
7. A gaze information acquisition unit that acquires gaze information of a driver of a vehicle; a gaze point identification unit that identifies a position of a gaze point at which the driver is gazing ahead based on the line of sight information; a gaze point distance calculation unit that calculates a forward gaze point distance to the position of the gaze point; The determination device determines that the driver has more leeway in driving operations as the calculated forward gaze point distance increases.
Citation Information
Patent Citations
Driver psychology determination device
JP2017165137A
