Vehicle driving assistance systems

Abstract

To provide a driving support device for keeping and improving a driving ability of a driver.SOLUTION: A driving support device includes: a safety driving evaluation section 500 for evaluating driving based on various pieces of information; and a safety driving behavior feedback section 700 for providing information to a driver based on a safety driving evaluation result evaluated by the safety driving evaluation section 500. The safety driving behavior feedback section 700 causes positive information for the driver to be notified of when the safety driving evaluation section 500 determines that desired driving has been performed, and notifies the driver of driving clue information when the safety driving evaluation section 500 determines that the desired driving has not been performed. Thus, a driving ability of the driver is kept and improved.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a vehicle driving support device that encourages a vehicle driver to drive safely.

Background Art

[0002] Conventionally, there has been proposed a device (hereinafter referred to as "conventional device") that encourages a driver to perform safe driving actions by continuously performing a danger avoidance action presentation process that presents danger avoidance actions to be taken by the driver by a vehicle driving support device. (For example, see Patent Document 1).

[0003] Also, there has been proposed a device that creates a driving evaluation report for each driver based on data in which the driving situation of a vehicle driver is recorded. (For example, see Patent Document 2). By providing information to the driver by these devices, it can be expected to improve the awareness of safe driving.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] By the way, there is known a psychological phenomenon (Pygmalion effect) in which when generally expected by a human, the ability improves in an attempt to meet the expectation.

[0006] The driving support by the conventional device unidirectionally provides information, gives driving operation instructions, and evaluates the driving behavior of the driver. However, even if driving operation instructions or driving behavior evaluations are unidirectionally conveyed to the driver, it is difficult to make the driver feel expected.

Means for Solving the Problems

[0007] The inventor of this invention focused on the Pygmalion effect and believed that by making the driver feel that safe driving is expected while the vehicle is in motion, more effective driving assistance could be provided.

[0008] This invention, which embodies this concept, includes a safe driving evaluation unit that evaluates driving based on various information, and based on the safe driving evaluation results evaluated by the safe driving evaluation unit, driver This is a driver assistance device for a vehicle that includes a safe driving behavior feedback unit that provides information to the driver. The safe driving behavior feedback unit is configured to provide positive information to the driver if the safe driving evaluation unit determines that the driver has performed the expected driving, and to provide driving cue information to the driver if the safe driving evaluation unit determines that the driver has not performed the expected driving.

[0009] According to the present invention, if the safe driving evaluation unit determines that the driver has performed the expected driving, positive information is displayed to the driver. Positive information may include, for example, a smile. On the other hand, if the unit determines that the driver has not performed the expected driving, driving cue information is displayed to the driver. By providing cue information rather than giving operational instructions, the driver can think for themselves and take safe driving actions.

[0010] The present invention further provides that the past safe driving evaluation results evaluated by the safe driving evaluation unit To the driver Driving clues It is configured to provide notifications.

[0011] This configuration allows drivers to recall information based on past safe driving evaluation results, enabling them to think for themselves and take safe driving actions.

[0012] The present invention further relates to an avatar used in the safe driving behavior feedback unit. The driver It can be configured to include an avatar selection section.

[0013] With this configuration, the avatar selection unit selects and displays an anthropomorphic image (hereinafter referred to as "avatar") that is suitable for intuitively conveying emotions and other information to the driver based on past safe driving evaluation results, thereby intuitively communicating expectations to the driver.

[0014] The present invention further includes a driver information acquisition unit that acquires visual and auditory information about the driver, and after the information is notified by the safe driving behavior feedback unit, the safe driving behavior feedback unit, based on the information acquired by the driver information acquisition unit, Change the information that is reported. , Information Change Department The system can also be configured to include a driver satisfaction estimation unit that evaluates whether or not the driver is satisfied with the feedback based on the driver's facial expression in the safe driving behavior feedback unit.

[0015] In this configuration, for example, the driver satisfaction level estimation unit estimates whether the driver is satisfied with the information provided by the safe driving behavior feedback unit, which includes the facial expressions of the displayed avatar and driving cue information, based on information acquired by the driver information acquisition unit, such as the driver's facial expressions and gestures such as nodding and tilting their head. If the driver is not satisfied, the driver satisfaction level estimation unit changes the driving cue information to provide better cue information. The information to be reported is changed by the information change unit. Therefore, it is highly satisfactory for drivers. information By providing this, it is possible to more effectively guide drivers to think for themselves and take safe driving actions. [Effects of the Invention]

[0016] As explained above, according to the present invention, by making the driver feel that safe driving is expected while the vehicle is in motion, more effective driving assistance can be provided. [Brief explanation of the drawing]

[0017] [Figure 1]This is a diagram showing the overall configuration of the driver assistance device according to an embodiment of the present invention. [Figure 2] This is a diagram showing the interior of a vehicle equipped with the driver assistance device according to an embodiment of the present invention. [Figure 3] This is a diagram showing the driver assistance process according to an embodiment of the present invention. [Figure 4] This is a flowchart showing the processing performed by the driver assistance device according to an embodiment of the present invention. [Figure 5] This is a diagram showing an example of an image displayed on the center display of a vehicle according to an embodiment of the present invention. [Figure 6] This is a diagram showing an example of an avatar displayed on the center display according to an embodiment of the present invention. [Figure 7] This is a diagram showing an example of the expression of an avatar according to an embodiment of the present invention.

Embodiments for Carrying Out the Invention

[0018] Hereinafter, embodiments of the driver assistance device for a vehicle of the present invention will be described with reference to the drawings. <System Configuration> First, the system configuration of a vehicle equipped with the driver assistance device according to an embodiment of the present invention will be described with reference to FIG. 1. First, in FIG. 1, reference numeral 1 indicates a vehicle equipped with the driver assistance device according to the present embodiment.

[0019] Vehicle 1 is also equipped with a steering device (steering wheel 6) for steering the vehicle 1, a steering angle sensor 8 for detecting the rotation angle of the steering column connected to the steering wheel 6 in the steering device, a steering torque sensor 9 for detecting the steering torque acting on the column shaft connecting the steering wheel 6 and the front wheels, an accelerator pedal position sensor 11 for detecting the amount of accelerator pedal depression corresponding to the opening of the accelerator pedal, a brake pedal depression sensor 12 for detecting the amount of brake pedal depression, a vehicle speed sensor 14 for detecting vehicle speed, and an acceleration sensor 15 for detecting acceleration. Each of these sensors outputs its detected value to the controller 100. This controller 100 is composed of, for example, an ECU (Electronic Control Unit).

[0020] Furthermore, the in-vehicle camera 20, the exterior camera 21, the radar 22, and the vehicle speed sensor 14, acceleration sensor 15, yaw rate sensor 16, steering angle sensor 8, steering torque sensor 9, accelerator pedal position sensor 11, brake pedal depression sensor 12 for detecting the behavior of the vehicle 1 and the driving operations of the occupants, as well as the positioning system 30 for detecting the position of the vehicle 1 and the navigation system 31, each output their detected values ​​to the controller 100. The controller 100 outputs control signals to the center display 41 and the speaker 42. The controller 100 consists of a computer equipped with one or more processors (typically CPUs), memory (ROM, RAM, etc.) for storing various programs, and input / output devices.

[0021] As shown in Figure 2, a center display 41 is provided inside the cabin. The center display 41 is located in front of the driver's and passenger's seats and approximately in the center in the vehicle width direction, and is constructed using an LCD (liquid crystal display).

[0022] An in-vehicle camera 20 is positioned in the upper right corner of the center display 41. The in-vehicle camera 20 photographs the interior of the vehicle, particularly the driver, and outputs the image data to the controller 100. Based on the image data received from the in-vehicle camera 20, the controller 100 analyzes the driver's level of satisfaction and determines whether or not the driver is satisfied. For example, the controller 100 determines that the driver is satisfied if the analyzed driver's facial expression is smiling.

[0023] An interior microphone 50 is positioned on the instrument panel in front of the steering wheel 6. The interior microphone 50 records the sounds inside the cabin and outputs the audio data to the controller 100. Based on the audio data received from the interior microphone 50, the controller 100 analyzes the driver's level of satisfaction and determines whether or not the driver is satisfied.

[0024] The external camera 21 captures images of the area around the vehicle 1 and outputs the image data to the controller 100. The controller 100 identifies the driving scene based on the image data received from the external camera 21.

[0025] The center display 41 and speaker 42 are controlled by the controller 100. As will be described in detail later, for example, the avatar and clue information are displayed on the center display 41.

[0026] The following describes the process that the controller 100 executes based on the program stored in its ROM. As shown in Figure 2, the program is divided into a safe driving evaluation unit 500 and a support acceptance status evaluation unit 600, which receive output signals from various sensors as inputs, and a safe driving behavior feedback unit 700, which receives the output from the safe driving evaluation unit 500 and the output from the support acceptance status evaluation unit 600 as inputs.

[0027] The safe driving evaluation unit 500 consists of an information integration unit 501, a judgment logic 502, and a matching unit 503. The information integration unit 501 integrates signals input from multiple sensors and outputs them to the matching unit 503. The matching unit 503 processes the information input from the information integration unit 501 using the judgment logic 502 and outputs it to the safe driving behavior feedback unit 700. The judgment logic 502 consists of a basic logic 5021 and additional logic 5022 for each selected avatar. The basic logic 5021 is a judgment logic for expecting safe driving without accidents. The additional logic 5022 is a judgment logic that can be selected by the driver, as described later. For example, if the driver selects an avatar representing family or friends from among the selectable avatars described later, the logic will output a judgment that tends to expect a smooth ride, and if the driver selects an avatar representing a professional such as a driving school instructor, the logic will output a judgment that tends to expect obedience to traffic rules.

[0028] The support acceptance assessment unit 600 consists of an information integration unit 601, a judgment logic unit 602, and a matching unit 603. The information integration unit 601 integrates and processes the signals input from the in-vehicle camera 20 and the in-room microphone 50 and outputs them to the matching unit 603. The matching unit 603 processes the information input from the information integration unit 601 using the judgment logic unit 602 and outputs it to the safe driving behavior feedback unit 700. The judgment logic unit 602 consists of a basic logic unit 6021 based on seven universally recognized facial expressions and an additional logic unit 6022 that reflects regional characteristics. For example, in Japan, the additional logic determines that a nodding gesture indicates understanding.

[0029] The safe driving behavior feedback unit 700 consists of an information integration unit 701, a selection logic unit 702, and a presentation information selection unit 703. The information integration unit 701 integrates signals input from the safe driving evaluation unit 500 and the support acceptance status evaluation unit 600. The selection logic unit 702 is configured to select presentation information for the center display 41 and speaker 42 from the information stored in the ROM of the controller 100 based on the information input from the information integration unit 701. The safe driving behavior feedback unit 700 selects presentation information such that, if the safe driving evaluation unit 500 determines that the driver is driving safely, the avatar's expression displayed on the center display 41 changes to a smile and the speaker 41 outputs a positive notification sound. On the other hand, if the safe driving evaluation unit 500 determines that the driver is not driving safely, the safe driving behavior feedback unit 700 selects presentation information such that safe driving cues are displayed on the center display 41. Furthermore, if the acceptance status evaluation unit 600 determines that the driver is not satisfied with the presented information, the safe driving behavior feedback unit 700 will change the cue information.

[0030] The following describes the judgment logic 502 of the safe driving evaluation unit 500. The matching unit 503 of the safe driving evaluation unit 500 uses the judgment logic 502 to determine whether or not the driver is driving safely based on the input from various sensors. The judgment logic 502 is configured so that the matching unit 503 performs the following processing. For example, if, based on the location information and time from the positioning system 30 output from the information integration unit 501, it is predicted that the time and place will be crowded with pedestrians, then it is determined that the driver is driving safely if the vehicle speed is below a predetermined value. In another example, based on the location information and time from the positioning system 30, it is determined that the driver is driving safely if the headlights are turned on early. In addition, based on the information from the external camera 21, it is determined that the driver is driving safely if the brakes are applied when the traffic light turns yellow. On the other hand, sudden braking is determined not to be safe driving. To give another example, driving where the steering wheel is turned quickly and the yaw rate overshoots is determined not to be safe driving.

[0031] The judgment logic 602 of the acceptance status evaluation unit 600 is described below. The matching unit 603 of the acceptance status evaluation unit 600 uses the judgment logic 602 to determine whether or not the driver is experiencing positive emotions based on image data from the in-car camera 20 and audio data from the in-room microphone 50, which are input through the information integration unit 601. The judgment logic 602 is configured so that the matching unit 603 performs the following processing. For example, if it is determined that the corners of the driver's mouth are turned up based on the image data from the in-car camera 20, it is determined that the driver is satisfied. In another example, if it is determined that the driver is nodding their head up and down based on the image data from the in-car camera 20, it is determined that the driver is satisfied. On the other hand, if it is determined that the driver is shaking their head from side to side based on the image data from the in-car camera 20, it is determined that the driver is not satisfied. In yet another example, if it is determined that the driver is uttering positive words such as "yes," "uh-huh," or "OK" based on the audio data from the in-room microphone 50, it is determined that the driver is satisfied. On the other hand, if the system determines, based on audio data from the indoor microphone 50, that the driver is uttering negative words such as "Why?", "Uh," or "No," then it is determined that the driver is not convinced.

[0032] The following describes the selection logic 702 of the safe driving behavior feedback unit 700. The information presentation selection unit 703 of the safe driving behavior feedback unit 700 selects information to be presented using the center display 41 and speaker 42 from the information stored in the controller 100's ROM, based on information from the safe driving evaluation unit 500 and the acceptance status evaluation unit 600, which are input through the information integration unit 601. First, the information selection by the information presentation selection unit 703 based on the judgment result of the safe driving evaluation unit 500 will be explained. For example, if the safe driving evaluation unit 500 determines that the driver is driving safely, it selects image data of a smiling avatar to be displayed on the center display 41. It also selects audio data of a major key melody that is said to have a "cheerful" character to be output from the speaker 42. On the other hand, if the safe driving evaluation unit 500 determines that the driver is not driving safely, it selects information to help the driver drive safely to be displayed on the center display 41. For example, if it is determined that the front lights have not been turned on early based on the location information and time from the positioning system 30, the information "It will soon get dark." is selected to be displayed on the center display 41.

[0033] Next, we will explain the information selection by the information selection unit 703 based on the judgment result of the acceptance status evaluation unit 600. If the acceptance status evaluation unit 600 determines that the driver is not satisfied with the information "It will soon get dark" which was selected and displayed on the center display 41 based on the safe driving evaluation unit 500's judgment that the driver is not driving safely, then it will select image information showing the nighttime front lights being turned on instead of the information "It will soon get dark".

[0034] After the display on the center display 41 changes, the acceptance status evaluation unit 600 re-determines whether or not the driver is satisfied. If the acceptance status evaluation unit 600 determines that the driver is not satisfied with the image of the nighttime headlights illuminated displayed on the center display 41, the information presentation selection unit 703 selects different cue information than the image of the nighttime headlights illuminated. On the other hand, if the acceptance status evaluation unit 600 determines that the driver is satisfied, the information presentation selection unit 703 increases the priority of that cue information.

[0035] The operation of the driver assistance device of this embodiment will be described below.

[0036] The expected behavior determination unit, which is part of the judgment logic 502 of the safe driving evaluation unit 500, acquires information about the vehicle's surroundings (Step 1 in Figure 3). Next, it determines the expected driving behavior based on the information about the vehicle's surroundings (Step 2 in Figure 3). For example, if the information about the vehicle's surroundings is bad weather, the expected behavior is to turn on the headlights and reduce the vehicle's speed. Before arriving at a location that is not predetermined as a point where the expected behavior should be performed, clue information about the expected behavior is displayed on the center display 41. In this case, for example, "It is raining near your destination" is displayed on the display 41.

[0037] The avatar selection unit, which is part of the selection logic 702 of the safe driving behavior feedback unit 700, determines a recommended avatar based on past expected behavior and past driving behavior (Step 3 in Figure 3). For example, if it is determined that the headlights were not on during past bad weather, an image of the view during bad weather is displayed on the center display 41, and by displaying phrases used in driving schools, the driver is prompted to recall what they learned in driving school and to select an avatar of a driving school instructor (Figure 6(b)). Thus, the driver can be made aware of the importance of spontaneously performing safe driving behavior. On the other hand, if the headlights were on during past bad weather, but the driver performed normal steering operations despite the road surface being wet, causing the vehicle's behavior to become unstable, an image of a vehicle slipping during bad weather is displayed on the center display 41, prompting the driver to select an avatar of an infant (Figure 6(a)). On the other hand, if there is no past driving behavior corresponding to the current expected behavior, the driver is prompted to arbitrarily select an avatar.

[0038] The safe driving evaluation unit 500 displays cue information on the center display 41 based on the selected avatar (step 4 in Figure 3). For example, if the avatar of a driving school instructor is selected, an image prompting the driver to maintain a distance of 2 seconds or more from the vehicle in front is displayed on the center display 41.

[0039] The safe driving evaluation unit 500 acquires the driver's driving operations from various sensors mounted on the vehicle (Step 5 in Figure 3).

[0040] The safe driving evaluation unit 500 determines whether the driver performed safe driving actions by comparing the pre-determined expected actions with the actual driving operations (step 6 in Figure 3). If the driver is driving as expected (YES in step 7), the safe driving behavior feedback unit 701 changes from a normal avatar (Figure 7(a)) to a smiling avatar (Figure 7(b)) (step 8 in Figure 3). Seeing the avatar displayed on the display 41 turn into a smile, the driver can understand that they have performed the expected actions. In other words, the system communicates what is expected of the driver and that those expectations have been met, making it possible to continuously encourage the performance of safe driving actions based on human psychological phenomena. On the other hand, if the safe driving evaluation unit 500 determines that the driver is not driving as expected (NO in step 7), the safe driving behavior feedback unit 701 changes the additional cue information displayed on the center display 41 (step 9 in Figure 3).

[0041] The matching unit 603 of the acceptance status evaluation unit 600 acquires the driver's facial expressions and gestures, which are input through the information integration unit 601 (step 10 in Figure 3).

[0042] The matching unit 603 of the acceptance status evaluation unit 600 determines whether the driver is convinced based on the driver's facial expression and gestures (step 11 in Figure 3). For example, if the driver nods their head, the matching unit 603 determines that the driver is convinced (YES in step 12). As a result, the information presented by the safe driving behavior feedback unit 700 is not changed. On the other hand, if it is determined that the driver is not convinced (NO in step 12), the cue information is changed in the safe driving behavior feedback unit 700 (step 9 in Figure 3). For example, if the driver tilts their head when an image prompting the driver to maintain a distance of 2 seconds or more from the vehicle in front is displayed on the center display 41, the matching unit 603 determines that the driver is not convinced and displays an image of a short following distance and collision.

Claims

1. A driver assistance device for a vehicle comprising a safe driving evaluation unit that evaluates driving based on various information, and a safe driving behavior feedback unit that provides information to the driver based on the safe driving evaluation results evaluated by the safe driving evaluation unit, wherein the safe driving behavior feedback unit provides positive information to the driver when the safe driving evaluation unit determines that the driver has performed driving as expected, and provides the driver with driving cue information based on past safe driving evaluation results evaluated by the safe driving evaluation unit when the safe driving evaluation unit determines that the driver has not performed driving as expected, and the cue information is characterized in that it is information that does not specifically indicate driving operation instructions.

2. The driver assistance device for a vehicle according to claim 1, further comprising an avatar selection unit for the driver to select an avatar to be used in the safe driving behavior feedback unit.

3. The driver assistance device for a vehicle according to claim 1 or 2, further comprising: a driver information acquisition unit that acquires visual and auditory information relating to the driver; a driver satisfaction estimation unit that evaluates whether or not the driver is satisfied with the information provided by the safe driving behavior feedback unit based on the information acquired by the driver information acquisition unit; and a notification information modification unit that modifies the information provided by the safe driving behavior feedback unit after the information is provided by the safe driving behavior feedback unit, based on the evaluation result of the driver satisfaction estimation unit.

Images