Driving diagnosis result feedback device

Abstract

To enable a driver to reflect driving with a diagnosis result in real time by accurately feeding the diagnosis result back to the driver in an automobile.SOLUTION: A driving diagnosis result feedback device comprises: score evaluation means which acquires scores regarding a plurality of evaluation items relating to driving of a vehicle; score display means which displays the acquired scores of the plurality of evaluation items on a display section facing toward a driver; sight line grasping means which grasps a sight line of the driver; attention score estimation means which estimates an attention score to which the driver pays attention among the scores of the plurality of evaluation items displayed on the display section; and attention score enlargement means which enlarges and displays the attention score in the plurality of scores displayed on the display section.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a function for providing feedback to the driver on the results of driving diagnosis. [Background technology]

[0002] In recent years, automobiles have begun to be equipped with functions that analyze information on driving operations and driver reactions to evaluate driving skills, energy efficiency, etc. As information to be used for such functions, various methods are being considered for understanding what the driver is paying attention to and what they are aware of.

[0003] Patent document 1 proposes a recognition device that records advice data to assist a user in driving (e.g., claim 11), presents this advice data, recognizes the user's reaction to it from the user's facial and eye movements, and provides appropriate advice based on that reaction.

[0004] Furthermore, although the purpose is different, Patent Document 2 proposes an in-vehicle lighting device that estimates the gaze point of the occupant's line of sight, identifies the device at the gaze point, and increases the brightness of the lighting section of the identified device while the gaze is being focused on. Since lighting brightness of various devices can be too bright at a constant brightness, this technology is designed to grasp the driver's line of sight and adjust the brightness to the required level when necessary. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-269588 [Patent Document 2] Japanese Patent Application Laid-Open No. 2010-12995 Summary of the Invention [Problem to be solved by the invention]

[0006] However, even if this information is collected and evaluation results such as driving diagnosis are obtained, in most vehicles the evaluation results are actually used by simply displaying the scores and evaluation values ​​on indicators or displays, etc. This means that the diagnostic results and advice that drivers want cannot be fed back to them at the appropriate time, and the recognition and diagnostic results are not being fully utilized.

[0007] Therefore, an object of the present invention is to provide accurate feedback of diagnostic results to a driver in an automobile so that the driver can reflect the diagnostic results in his driving in real time. [Means for solving the problem]

[0008] This invention is score evaluation means for acquiring scores for a plurality of evaluation items regarding vehicle driving; score display means for displaying the acquired scores for the plurality of evaluation items on a display unit facing the driver; A line of sight grasping means for grasping the line of sight of the driver; an attention score estimation means for estimating an attention score that the driver is paying attention to from among the scores of the plurality of evaluation items displayed on the display unit using the line of sight; a notable score enlargement means for enlarging and displaying a notable score among the plurality of scores displayed on the display unit; The above-mentioned problem has been solved by the first solving means, which is a driving diagnosis result feedback device having the above.

[0009] Further, the driving diagnosis result feedback device according to the present invention includes, in the first solving means, A second solution may be adopted in which the targets of the plurality of evaluation items include accelerator operation, steering operation, and brake operation.

[0010] Furthermore, the driving diagnosis result feedback device of the present invention can employ a third solution means in the first or second solution means, which executes a voice advice means for notifying the driver by voice when the score of the evaluation item that is the focus score decreases.

[0011] Furthermore, the driving diagnosis result feedback device according to the present invention, in any one of the first to third solving means, When the attention score is enlarged and displayed, A fourth solution can be adopted in which the plurality of scores other than the attention score are displayed so as to sandwich the attention score. [Effects of the Invention]

[0012] The driving diagnosis result feedback device of the present invention enlarges the display of important scores, including those on which the driver is paying attention, in real time on the display unit, making it easier for the driver to grasp the numerical score. This makes it possible to quickly and clearly communicate to the driver the scores on those items on which the driver is particularly concerned about skill or the situation, compared to conventional methods that simply display the scoring results. This allows the driver to receive feedback without missing the scores on the items on which they are concerned, and to drive with greater awareness of those scores. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram showing an example of the situation inside a vehicle in which the driving diagnosis result feedback device according to the present invention is implemented. [Figure 2] FIG. 1 is a functional block diagram of a driving diagnosis result feedback device according to the present invention. [Figure 3] Example of the default display showing the scores for three evaluation items [Figure 4] Example of the display showing the enlarged score [Figure 5] FIG. 1 is an example of an implementation flow of the driving diagnosis result feedback device according to the present invention. [Figure 6] Continuation of the flow in Figure 5 DETAILED DESCRIPTION OF THE INVENTION

[0014] An embodiment of the driving diagnosis result feedback device 11 according to the present invention will be described below with reference to the functional block diagram shown in FIG.

[0015] A driving diagnosis result feedback device 11 according to the present invention is mounted on a vehicle 10. The vehicle 10 may be a gasoline-powered vehicle or an electric vehicle, and is not particularly limited as long as it is a vehicle driven on a road by a driver. The electric vehicle may be not only an electric vehicle that runs only on an external power supply, but also a hybrid vehicle having an engine and a fuel cell. In the case of a hybrid vehicle, it may be a plug-in hybrid vehicle (PHEV) that is not only charged by power generated by the engine, but also has an external charger that allows it to be charged with power from an external source, or an external power supply that allows it to supply power to the outside.

[0016] The vehicle 10 has a control unit 21 that realizes functions by executing stored programs and realizes each of the means described below as functions using dedicated circuits. There is no need to provide a separate dedicated control unit 21 just for the present invention, and it is easy to introduce the control unit 21 by installing and executing a program that realizes each of the means constituting the present invention as an additional function in an ECU (Electronic Control Unit) that is installed in the vehicle 10 for driving control, etc.

[0017] The control unit 21 may have a necessary storage unit together with the calculation device, and may store data and programs and use them for calculations as appropriate.

[0018] The vehicle 10 has a display unit 25 capable of displaying information including driving diagnosis results in a position visible to the driver D, and the display unit 25 has a display screen that can enlarge or reduce the display content in response to instructions from the control unit 21. Examples of such a display screen include liquid crystal, organic electroluminescence (EL), electronic ink, and projector. Among these, liquid crystal with a backlight and light-emitting organic electroluminescence (EL) are preferably used to make the display easily visible at night or in tunnels.

[0019] The display unit 25 does not need to be dedicated to use with the driving diagnosis result feedback device 11, but may also be used as a display device for displaying other information in the vehicle .

[0020] The vehicle 10 has a camera 26 with a lens disposed at a position where the line of sight of the driver D can be recognized. The image captured by the camera 26 is used to execute line of sight recognition means 43, which will be described later, for determining the line of sight of the driver D.

[0021] The vehicle 10 preferably has a speaker 27 capable of outputting audio so that it can be heard by the driver D inside the vehicle. Audio feedback can be provided by audio advice means 37, which will be described later.

[0022] The vehicle 10 preferably has a vehicle speed sensor 34 that can measure the vehicle speed and output the measured data. The control unit 21 can use the output speed data for the score evaluation means 41, which will be described later. The vehicle speed sensor 34 does not need to be dedicated to the driving diagnosis result feedback device 11, and the vehicle speed sensor used in the speedometer of the vehicle 10 may be used instead.

[0023] The vehicle 10 preferably has an acceleration sensor 35 that can measure the acceleration of the vehicle 10 itself and output the measured acceleration data. The control unit 21 can use the output acceleration data in the score evaluation means 41, which will be described later.

[0024] It is preferable that the vehicle 10 stores as data an operation history of the vehicle 10 itself. Specifically, the operation of the vehicle 10 involves the accelerator 31, the steering 32, and the brake 33, which are directly related to the operation of the vehicle 10.

[0025] The vehicle 10 may further have other sensors, such as a vehicle distance sensor 36 that acquires the distance between the vehicle and the vehicle ahead. The values ​​of these sensors may be used in the score evaluation means 41, which will be described later.

[0026] The driving diagnosis result feedback device 11 according to the present invention includes a score evaluation means 41 that acquires scores serving as evaluation values ​​for a plurality of evaluation items regarding vehicle driving. A specific embodiment of the present invention is that the control unit 21 itself executes a predetermined program to calculate the score using the operation history and driving data obtained by a CAN sensor, such as vehicle speed, acceleration, and following distance (hereinafter, the operation history and driving data are collectively referred to as the "driving data group"). Another embodiment, not shown, is to transmit the driving data group to an external server via a mobile communication network, receive the score calculated by the external server, and acquire the score. When a mobile communication network is used, the vehicle 10 needs to have a communication unit (not shown) capable of inputting and outputting data, including a communication antenna that enables communication from the control unit 21 to the mobile communication network.

[0027] The score evaluation means 41 acquires scores for multiple evaluation items. Examples of evaluation items include values ​​obtained by evaluating direct operations, such as accelerator operation related to operation of the accelerator 31, steering operation related to operation of the steering wheel 32, and braking operation related to operation of the brakes 33, using a predetermined algorithm that takes into account factors such as smoothness, minimal impact, and efficiency. Also available is a comprehensive evaluation that combines the values ​​of these accelerator, steering, and brake operations. For example, these operations can be combined with an acceleration sensor to determine condition values ​​such as the magnitude of acceleration, the magnitude of jerk (jerk), and the number of jerk reversals. If the acceleration or other factors applied by the operated part exceed the condition values, the operation can be deducted. Furthermore, evaluations based on individual data or comprehensive evaluations can be combined, such as statistical values ​​such as the average and minimum values ​​of the direct inter-vehicle distance obtained from an inter-vehicle distance sensor, a composite evaluation value of safe driving using not only inter-vehicle distance but also braking operation and acceleration, and an eco-driving level that indicates the ratio of mileage to fuel and power consumption.

[0028] The driving diagnosis result feedback device 11 according to the present invention has score display means 42 that displays multiple scores acquired by score evaluation means 41 on a display unit 25 facing driver D. Fig. 2 shows the display unit 25, driver D, and camera 26 displayed by this score display means 42. Fig. 3 shows an example of a display in which multiple scores are displayed on the display unit 25. In Fig. 3, accelerator operation score 51 is displayed on the left, steering operation score 52 in the center, braking operation score 53 on the right, and overall driving score 54 at the bottom, all of which are shown as integer values ​​with 100 being the perfect score. The display form in Fig. 3 is the default state, and this display form can be changed by attention score enlargement means 45, as will be described later.

[0029] The driving diagnosis result feedback device 11 according to the present invention has a line of sight grasping means 43 that grasps the line of sight of the driver D from an image including the driver D acquired from the camera 26. For this reason, the camera 26 needs to continue acquiring video data with a resolution that allows the direction of the driver D's eyes to be grasped. The line of sight grasping means 43 needs to make a judgment in real time, and may be executed by the control unit 21, the camera 26, or a computing device separately attached to the control unit 21. The accuracy of grasping this line of sight needs to be such that it can be grasped which score display area of ​​the display unit 25 the driver D's line of sight is directed at.

[0030] The driving diagnosis result feedback device 11 according to the present invention has an attention score estimation means 44 that uses gaze data grasped by the gaze grasping means 43 to estimate the attention score that the driver D is paying attention to from among the multiple scores displayed on the display unit 25. Here, attention is preferably estimated based on factors that are thought to reflect the awareness of the driver D, such as not just a momentary gaze, but repeated gaze or gaze that continues for a predetermined period of time. This estimation may be determined by the control unit 21 according to a predetermined algorithm.

[0031] The driving diagnosis result feedback device 11 according to the present invention includes an attention score enlargement means 45 for enlarging and displaying the attention score estimated by the attention score estimation means 44 among the multiple scores displayed on the display unit 25. Enlarging the attention score may involve operations such as enlarging the font of the score value displayed on the display unit, enlarging the size or diameter of the frame surrounding the score, or enlarging the thickness of the frame itself. A combination of these enlargement methods may also be used. FIG. 4 shows an example of an enlarged attention score displayed on the display unit 25. When the central steering operation score 52 is estimated as the attention score, the control unit 21 changes the screen output of the display unit 25 to enlarge the diameter of the frame surrounding the original display area of ​​the steering operation score 52, as shown in the steering operation score 52a, and enlarges and bolds the displayed font to make the attention score easier for the driver D to grasp. This enlargement operation should be reflected as quickly as possible from the estimation of the attention score, so that the attention score can be enlarged with a reaction speed close to real time for the driver D.

[0032] When executing the attention score enlargement means 45, it is desirable to reduce the display area or display size of non-attention scores or temporarily turn off their display in parallel with enlarging the attention score, so that the attention score can be more easily grasped. Furthermore, regardless of the default display position, placing the enlarged attention score in the center and displaying multiple scores other than the attention score on either side of the attention score makes it easier to attract attention to the attention score. In the example of FIG. 4, the accelerator operation score 51a and the brake operation score 53a are not attention scores, so they are displayed in a reduced size, and the overall evaluation score 54a is temporarily hidden. This makes it easier to secure a screen area for enlarging and displaying the attention scores. In this example, the steering operation score 52a is centered by default, but the accelerator operation score 51a and the brake operation score 53a are displayed on either side of the steering operation score 52a, which is the attention score.

[0033] The magnification ratio in the attention score magnification means 45 may be changed depending on the evaluation of the attention score, or may be fixed at a default value. For example, the display area for the attention score may be doubled and the display area for the non-attention score may be halved.

[0034] The enlargement operation by the attention score enlargement means 45 is not fixed as it is, but after the enlargement operation is performed once, each time the attention score estimation means 44 changes the attention score, the new attention score is enlarged and the original attention score that has become a non-attention score is reduced.

[0035] Furthermore, the driving diagnosis result feedback device 11 according to the present invention may execute a score monitoring means 46 that monitors acquired scores, and may also execute a voice advice means 47 that provides a voice notification when the value of the currently focused score falls below a predetermined range. By promptly and without missing a beat, the driver D is notified by voice when the focused score falls. This allows the driver D to quickly recognize that he or she has performed a poor operation, enabling highly real-time feedback. This allows the driver D to immediately reflect this awareness in his or her driving, contributing to safer and more energy-efficient driving. For example, if the magnitude of the jerk generated when the steering wheel is turned back exceeds a condition value and the steering operation score falls, a voice such as "Please turn the steering wheel back a little more slowly" may be played from the speaker 27. This voice may be a playback of pre-recorded data, or text containing the necessary information may be generated by the control unit 21 and read aloud using voice playback software.

[0036] An example of a decision flow of the driving diagnosis result feedback device 11 according to the present invention will be described with reference to Figs. 5 and 6. When driving begins (S101), driving operations are performed using the accelerator, steering, and brake (S102). The control unit 21 executes the score evaluation means 41 to obtain a score diagnosed for driving using driving data and the like obtained from the driving operations (S103). Here, an example is shown in which the control unit 21 calculates the score using an installed program. The control unit 21 executes the score display means 42 to display the obtained score on the display unit 25 (S104).

[0037] The following flow will be explained assuming that the scores for multiple evaluation items displayed on display unit 25 are arranged in a row, such as accelerator operation score 51, steering operation score 52, and brake operation score 53, as shown in Fig. 3. Control unit 21 acquires video data from camera 26 in real time, and executes gaze detection means 43 that performs image analysis of this video data to determine the direction of driver D's gaze. In this embodiment, gaze detection means 43 is not executed periodically at some timing, but is executed continuously at regular intervals. Here, it is assumed that it is executed every second.

[0038] When the scores of multiple evaluation items are displayed on the display unit 25 by the score display means 42, the area to which the gaze is directed is measured by the gaze grasping means 43. This measurement is carried out for 10 seconds (S111), and it is determined which evaluation item score the subject is gazing at in the score display area, and the time spent gazing at the score of each evaluation item is counted.

[0039] Using this gaze time, attention score estimation means 44 is executed to estimate the attention score of the driver among the multiple evaluation items. In FIG. 5, accelerator operation score 51, steering operation score 52, and brake operation score 53 are abbreviated as "accelerator score," "steer score," and "brake score," respectively. Then, the gaze time of the scores of each evaluation item is compared (S112 to S114), and the score of the longest gaze is set as the instantaneous attention score (S115 to S117). This setting of the instantaneous attention score is repeated five times (S118→NO).

[0040] After repeating this process five times (S118→YES), the minimum score (Min score) for each of the three evaluation items during that time is recorded (S119). In other words, the minimum score is the smallest score, which is the value at which the evaluation of the subject is at its worst.

[0041] In the processing up to this point, if there is an evaluation item that has been set in the instantaneous attention score three or more times out of five (S121 → YES), that item is estimated to be the attention score (S122). This is because it is clear that driver D is particularly paying attention to that evaluation item. On the other hand, if there is no evaluation item that has been set in the instantaneous attention score three or more times out of five (S121 → NO), the evaluation item with the smallest minimum value among the three evaluation items is estimated to be the attention score (S123). In this case, it is not possible to narrow down the evaluation items that driver D is paying attention to, but it means that he is paying attention to all of them, and the one with the smallest score among them has at least a certain amount of attention to it, and on top of that, it indicates a low value that should be noticed, so it is considered to be suitable for being estimated to be the attention score. This completes the attention score estimation by the attention score estimation means 44 for the time being (S124).

[0042] Next, the flow moves to the flow of FIG. 6. In parallel with the estimation of the attention score, the driver D continues to perform driving operations (S131), and the score evaluation means 41 for each evaluation item and the score display means 42 for displaying the scores on the display unit 25 continue to be executed (S132). After the estimation of the attention score is completed, the control unit 21 executes the attention score enlargement means 45 for enlarging and displaying the attention score among the evaluation items displayed on the display unit 25 (S133). This allows the driver D to more reliably grasp the attention score. This makes it easier to grasp if the driver D has repeatedly focused on the attention score as an instantaneous attention score. Furthermore, if the driver D focused on multiple evaluation items, by enlarging the lowest score to make it easier to grasp, the driver D can easily recognize a deterioration in that score, and the driver D can quickly reflect that score in his driving.

[0043] In addition, while driving, the score monitoring means 46 continues to run. Using this, feedback is given to the driver D by the voice advice means 47. After the noteworthy score is estimated, if a situation occurs in which the score of an evaluation item corresponding to the noteworthy score is deducted (S141), the control unit 21 creates a comment as advice to the driver D according to the deducted evaluation item and the operation that caused the deducted point (S142). Once the comment is created, the control unit 21 plays a voice reading out the comment from the speaker 27 to alert the driver D to the operation (S143). This allows the driver D to be promptly informed that an operation that will result in a deducted point has been performed for a noteworthy score that the driver D is paying attention to or needs to pay attention to, and the driver D can hear the voice and take prompt action to improve his driving. It is preferable that the voice advice means 47 be able to interrupt and execute in parallel with other flows.

[0044] On the other hand, it is preferable that the attention score once estimated should not be fixed, but be changeable as needed depending on the driving situation. First, when the control unit 21 of the vehicle 10 receives a signal indicating that the driver D has operated an operation button (not shown) or the like to cancel the attention score (S151→NO), the control unit 21 resets the estimated attention score and performs gaze tracking using the gaze tracking means 43 and re-estimates the attention score (S152, S111~). This is to enable the driver D to reflect his or her intention to consciously switch the attention score if he or she wishes to do so. Note that, since the attention score is temporarily canceled at this time, the attention score enlargement means 45 no longer enlarges the display, and the display on the display unit 25 should be returned to the default display state as shown in FIG. 3 until the attention score is re-estimated. After that, when the attention score is estimated, the new attention score is enlarged again.

[0045] Next (S151 → YES), if the evaluation item that is the attention score has improved by 10 points or more from the stored minimum value (S153 → NO), it is considered that the driving condition of driver D has sufficiently improved for that evaluation item, it is determined that the element that should be noted for that item has been resolved, and it is desirable to re-estimate the attention score. In this case, too, the gaze tracking means 43 tracks the gaze and re-estimates the attention score (S152, S111~).

[0046] Even if the evaluation item for which the attention score is set does not show an improvement of 10 points or more from the minimum value (S153 → YES), driver D's attention may have shifted to another evaluation item. To respond to such changes in attention, the gaze tracking means 43 measures the evaluation item for which the gaze is being tracked for 5 seconds (S154) and determines whether the time spent looking at an item other than the current attention score lasted for 3 seconds or more out of 5 seconds (S155). If the time spent looking at the current attention score did not last 3 seconds or more out of 5 seconds, it means that driver D continues to pay attention to the evaluation item for which the current attention score is set, and the evaluation item is maintained as the attention score and processing continues (S155 → NO, S131). On the other hand, if driver D has been gazing at an evaluation item other than the current attention score for 3 seconds or more out of 5 seconds (S155 → YES), it is determined that the driver D has shifted his / her attention to that evaluation item, and the attention score is switched to that evaluation item (S156), and monitoring and score evaluation for the rest of the driving are continued. In this case, the control unit 21 causes the noted score enlarging means 45 to enlarge and display the new noted score (S133). [Explanation of symbols]

[0047] 10 vehicles 11. Driving diagnosis result feedback device 21 Control section 25 Display section 26 Camera 27 speakers 31 Axel 32 Steering 33 Brake 34 Vehicle speed sensor 35 Accelerometer 36 Vehicle distance sensor 37 Audio advice means 41 Score Evaluation Instrument 42 Score display means 43 Line of sight grasping means 44 Attention score estimation method 45 Featured Score Expansion Methods 46 Score Monitoring Tools 47 Audio advice means 51 Acceleration Score 51a Accelerator operation score 52 Steering Score 52a Steering operation score 53 Brake operation score 53a Brake operation score 54 Overall Driving Score 54a Overall score D. Driver

Claims

1. score evaluation means for acquiring scores for a plurality of evaluation items regarding vehicle driving; score display means for displaying the acquired scores for the plurality of evaluation items on a display unit facing the driver; A line of sight grasping means for grasping the line of sight of the driver; an attention score estimation means for estimating an attention score that the driver is paying attention to from among the scores of the plurality of evaluation items displayed on the display unit using the line of sight; a notable score enlargement means for enlarging and displaying a notable score among the plurality of scores displayed on the display unit; A driving diagnosis result feedback device having the same.

2. 2. The driving diagnosis result feedback device according to claim 1, wherein the plurality of evaluation items include accelerator operation, steering operation, and braking operation.

3. 2. The driving diagnosis result feedback device according to claim 1, further comprising: a voice advice unit that, when the score of the evaluation item that is the attention score has decreased, notifies the driver of the decrease by voice.

4. When the attention score is enlarged and displayed, The driving diagnosis result feedback device according to claim 1 , wherein the plurality of scores other than the focus score are displayed so as to sandwich the focus score.

Images