Information providing device

Abstract

To provide content that serves as useful information for drivers. [Solution] The information providing device 200 includes: an analysis unit 163 that analyzes the driver's driving behavior based on the vehicle's behavior detected by the detection unit 12, the surrounding conditions recognized by the recognition unit 16, and the driver's state estimated by the driver state estimation unit 161; a determination unit 164 that determines whether the driving behavior analyzed by the analysis unit 163 corresponds to a first specific event in which the driver performed a predetermined operation on the driving controls to avoid a danger that the driver had anticipated, or to a second specific event in which the driver performed a predetermined operation on the driving controls to avoid a danger without anticipating it; a selection unit 165 that, if it is determined to be a second specific event, selects a second content corresponding to the driving behavior analyzed by the analysis unit 163, and if it is determined to be a first specific event, selects a first content corresponding to the cause of the predetermined operation; and a provision unit 166 that provides the first or second content selected by the selection unit 165 to the driver.

Description

Technical Field

[0001] The present invention relates to an information providing device that provides content related to a driver's driving behavior.

Background Art

[0002] As this type of technology, when plotting event information related to near misses on a map, if similar cases occur at the same location, a technology that does not plot similar event information at that location is known (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] If, as in the conventional technology, simply no information on similar events is provided, useful information for the driver will not be provided. Providing useful information to the driver is expected to greatly contribute to traffic safety.

Means for Solving the Problems

[0005] An information providing device according to one aspect of the present invention includes: a detection unit for detecting the behavior of a vehicle; a recognition unit for recognizing the surroundings of the vehicle; a driver state estimation unit for estimating the state of the vehicle's driver; an analysis unit for analyzing the driver's driving behavior based on the vehicle's behavior detected by the detection unit, the surrounding conditions recognized by the recognition unit, and the driver's state estimated by the driver state estimation unit; a determination unit for determining whether the driving behavior analyzed by the analysis unit corresponds to a first specific event in which the driver performed a predetermined operation on the driving controls to avoid a predicted danger, or to a second specific event in which the driver performed a predetermined operation on the driving controls to avoid a danger without prediction; a selection unit for selecting a second content corresponding to the driving behavior analyzed by the analysis unit if the determination unit determines that it corresponds to a second specific event, and for selecting a first content corresponding to the cause of the predetermined operation if the determination unit determines that it corresponds to a first specific event; and a providing unit for providing the first or second content selected by the selection unit to the driver. [Effects of the Invention]

[0006] According to the present invention, since different content is provided based on an analysis that includes the driver's condition, it becomes possible to provide content that is useful information to the driver. [Brief explanation of the drawing]

[0007] [Figure 1A] A schematic diagram showing an example of an information provision device. [Figure 1B] A schematic diagram showing an example of a vehicle equipped with an IVI system. [Figure 2A] A block diagram illustrating the main components of an in-vehicle device. [Figure 2B] A block diagram illustrating the main components of the vehicle sensor group and in-vehicle camera. [Figure 2C] A block diagram illustrating the main components of the input and output devices. [Figure 3] A flowchart illustrating the flow of information provision processing by a program. [Modes for carrying out the invention]

[0008] <Overview> The information-providing device according to the invention provides vehicle drivers with content information to help them drive safely through various dangerous situations they encounter in traffic. The content information includes, for example, various examples that combine driving time, day of the week, weather conditions, etc., in places such as intersections, residential areas, urban areas, and parking lots, introducing situations where accidents are likely to occur and serving as educational material to encourage drivers to take driving actions to avoid danger. It includes video content and / or audio content.

[0009] In this embodiment, an information provision device is exemplified as one of the functions of the IVI (In-Vehicle Infotainment) system installed in the vehicle. Based on detection information from sensors installed in the vehicle, the information provision device detects that a driving action aimed at avoiding danger has been taken in the moving vehicle, analyzes that driving action, and provides the driver with different content information based on the analysis results. The analysis results obtained by the information provision device may be sent to an external device via a public communication network as driver-specific information and managed by the external device. Such an information provision system, including the information provision device, public communication network, and external device, will be described in more detail with reference to the drawings.

[0010] <Example of an information provision system configuration> Figure 1A is a schematic diagram showing an example of the information provision system 500. In this embodiment, the information provision system 500 is exemplified by a system including a vehicle 100A driven by driver P1A, a vehicle 100B driven by driver P1B, a public communication network 300, and a server device 400. In each vehicle 100A and 100B, the driving behavior is evaluated by the respective information provision device.

[0011] <Vehicle Interior Configuration> Figure 1B is a schematic diagram showing an example of a vehicle 100A equipped with an IVI system that includes an information provision function as one of its features. Vehicles 100A and 100B are assumed to have the same configuration. Therefore, in the following explanation, vehicles 100A and 100B will be referred to as vehicle 100, drivers P1A and P1B will be referred to as driver P1, and passengers P2A and P2B will be referred to as passenger P2. The IVI system includes an in-vehicle device 14, a group of vehicle sensors 12, a display unit 51, a projection unit 52, and audio playback units 53A to 53D that constitute the output device 50, operation detection units 11A and 11B, and microphones 111A and 111B that constitute the input device 11, a front seat camera 131 and a rear seat camera 132 that constitute the in-vehicle camera 13, a terminal 2A used by the driver P1 in the front seat of the vehicle, and a terminal 2B used by the passenger P2 in the rear seat of the vehicle. Figure 1B illustrates the case where the driver P1 and passenger P2 are seated in the vehicle.

[0012] The in-vehicle device 14 and terminals 2A and 2B are configured to enable, for example, UWB (Ultra-Wide Band) wireless communication. UWB wireless communication is a communication method that enables high-precision positioning by utilizing an ultra-wideband frequency bandwidth. In this embodiment, the positions of terminals 2A and 2B inside the vehicle can be detected with high precision. The in-vehicle device 14, the output device 50, the input device 11, the vehicle sensor group 12, and the in-vehicle camera 13 are configured to communicate via wired communication using CAN (Controller Area Network) or the like.

[0013] Terminals 2A and 2B consist, for example, of smartphones used by the driver P1 and passenger P2, respectively. Terminals 2A and 2B may be held in holders (not shown) installed on the seats in which each person sits. Although two terminals 2A and 2B are illustrated as the terminals used by the driver P1 and the passenger P2, the actual number of terminals varies depending on the number of passengers. When there are four passengers, four terminals may be used. Also, the number of cameras constituting the in-vehicle camera 13, the number of operation detection units and microphones constituting the input device 11, and the number of display units, projection units, and audio playback units constituting the output device 50 may be appropriately changed according to the number of passengers.

[0014] When the IVI system projects or displays an operation menu screen (not shown) on the output device 50 (projection unit 52, display unit 51) and a button corresponding to the danger prediction training is touch-operated among a plurality of menu buttons (which may be called icons) displayed on the output device 50, or when a voice corresponding to the danger prediction training is input from the microphones 111A and 111B constituting the input device 11, the in-vehicle device 14 starts operating as the information providing device 200.

[0015] Hereinafter, the functions of the in-vehicle device 14 as the information providing device 200 will be mainly described. FIGS. 2A to 2C are diagrams for explaining the configuration examples of the respective parts in FIG. 1B. <In-vehicle device> FIG. 2A is a block diagram exemplifying the main configuration of the in-vehicle device 14. The in-vehicle device 14 includes a control unit 16 that substantially functions as the MPU (Micro Processing Unit) of the IVI system, and by reading and executing a predetermined program stored in a storage unit (not shown) in the control unit 16, various information processes, control processes, etc. required in the in-vehicle device 14 are performed.

[0016] In FIG. 2A, the in-vehicle device 14 includes a control unit 16, a content storage unit 170, and a first communication unit 180. When starting to operate as the information providing device 200, the control unit 16 reads and executes an application (application program) for the information providing device 200 stored in the storage unit in the control unit 16, thereby performing various information processes, control processes, etc. required as the information providing device 200. The control unit 16 includes, as functional components for content information provision, a driver state estimation unit 161, a predetermined operation detection unit 162, an analysis unit 163, a selection unit 165, a provision unit 166, an output unit 168, and an input unit 169.

[0017] In the embodiment, as an example, when the driver P1 and the passenger P2 board the vehicle 100, the in-vehicle device 14 addresses the driver P1 and the passenger P2 via the voice reproduction units 53A to 53D that constitute the output device 50, and collects the voices (for example, stating their own names) in response from the driver P1 and the passenger P2 with the microphones 111A and 111B that constitute the input device 11, and may photograph the driver P1 and the passenger P2 with the front seat camera 131 and the rear seat camera 132 that constitute the in-vehicle camera 13. The in-vehicle device 14 can identify the faces, names, and voices of all the passengers in the vehicle interior by associating (which may also be referred to as correlating) the faces of the driver P1 and the passenger P2, the names of the driver P1 and the passenger P2, and the frequency components of the voices uttered by the driver P1 and the passenger P2. The in-vehicle device 14 manages the information on the driving behavior acquired as the information providing device 200 as the driving information of the driver P1 sitting in the driver's seat.

[0018] (Driver State Estimation Unit) The driver state estimation unit 161 estimates, for example, the state of the driver P1 during driving based on the image of the driver P1 acquired by the in-vehicle camera 13. The reason for estimating the state of the driver P1 is to catch a state that may lead to an accident. That is, it is estimated that the driver P1 is in a "nervous" or "startled" state, a so-called near-miss state. In addition to, or instead of, images acquired by the in-vehicle camera 13, the driver P1's condition while driving may be estimated using biometric information (e.g., heart rate, blood pressure, body temperature, sweating, etc.) acquired by a biosensor (vital sensor) provided in the terminal 2A used by the driver P1. The biosensor may be configured to combine the terminal 2A with other devices (not shown), such as a smartwatch, and to share functions between the other devices and the terminal 2A.

[0019] (Predetermined operation detection unit) The predetermined operation detection unit 162 detects so-called sudden braking operations and sudden steering operations as predetermined operations on the driver controls, based on, for example, the behavior of the vehicle 100 detected by the vehicle sensor group 12 acting as a detection unit, the amount of operation on the brake pedal as a driver control detected by the vehicle sensor group 12, and the amount of operation on the steering wheel as a driver control detected by the vehicle sensor group 12.

[0020] (Analysis Department) The analysis unit 163 analyzes the driving behavior of driver P1 based on the behavior of vehicle 100 detected by vehicle sensor group 12, the surrounding conditions of vehicle 100 recognized by the control unit 16 as a recognition unit based on the detection data from vehicle sensor group 12, and the state of driver P1 estimated by driver state estimation unit 161. For example, the combination of the behavior of vehicle 100 and the surrounding conditions of vehicle 100 is divided into a predetermined number of patterns that show the relationship between the behavior of vehicle 100 and the surrounding conditions of vehicle 100 (for example, driving scenes such as intersections, residential areas, urban areas, and parking lots, with diverse driving scenes that incorporate the time of day, day of the week, weather conditions, etc.), and the relationship between the driving actions performed in each pattern, the results of those driving actions (presence or absence of sudden deceleration, presence or absence of sudden steering, magnitude of acceleration, etc.), and the presence or absence of near misses is analyzed.

[0021] (Judgment Department) The determination unit 164 determines whether the driving behavior analyzed by the analysis unit 163 corresponds to a first specific event or a second specific event. For example, from the driving behavior of driver P1, it determines that the predetermined operation not caused by driver P1's cognitive or judgment error is a first specific event, and that the predetermined operation caused by driver P1's cognitive or judgment error is a second specific event. To explain in more detail, the determination unit 164 determines that a first specific event is not merely a near-miss experience (which could also be called a dangerous scene), but rather a dangerous situation that the driver P1 had anticipated actually occurred, and the driver P1 performed the aforementioned predetermined operation on the control panel to avoid that dangerous situation. On the other hand, the determination unit 164 determines that a second specific event is when a dangerous situation occurs without any prediction by the driver P1, and the driver P1 performed the aforementioned predetermined operation on the control panel to avoid that dangerous situation. Specifically, if the vehicle had already decelerated or stopped accelerating before the aforementioned prescribed operation on the control panel, it is not attributable to a cognitive or judgment error by the driver P1, and is therefore judged to be a first specific event. Conversely, if the vehicle had not decelerated or was continuing to accelerate before the aforementioned prescribed operation on the control panel, it is attributable to a cognitive or judgment error by the driver P1, and is therefore judged to be a second specific event.

[0022] (Selection section) The selection unit 165 selects content from a group of pre-prepared content items according to the analysis results of the analysis unit 163. In other words, if the driving behavior analyzed by the analysis unit 163 corresponds to a first specific event, or to put it another way, if a sudden braking or steering operation is performed that is not caused by a cognitive or judgment error on the part of driver P1, the selection unit 165 extracts the driving behavior that should be learned (or trained) from the driving behavior analyzed by the analysis unit 163, and selects the extracted driving behavior as the first content from among several pre-prepared contents to be learned as a driving behavior aimed at avoiding danger. To explain in more detail, the first content is content that is generated using a driving scene (including dangerous scenes) different from the driving scene when the predetermined operation detection unit 162 determined to be a predetermined operation, and which shares the same factors as the predetermined operation. The commonality of the factors as predetermined operations means that the factors are either internal or external. Internal factors are those of the driver P1 themselves, such as distraction, inexperience, or overconfidence. External factors are factors other than those of the driver P1, such as the actions of other traffic participants (suddenly running out, cutting in, aggressive driving, etc.) or the traffic environment (condition of the vehicle 100, weather, road conditions).

[0023] Furthermore, if the driving behavior analyzed by the analysis unit 163 corresponds to a second specific event, in other words, if a sudden braking or steering operation is performed due to a cognitive or judgment error by the driver P1, the selection unit 165 extracts driving behaviors that should be learned (or trained) from the driving behavior analyzed by the analysis unit 163, and selects content from among several pre-prepared contents as second content to allow the driver to learn the extracted driving behaviors as driving behaviors aimed at avoiding danger. The second content refers to content generated using a dangerous scene similar to the dangerous scene when the predetermined operation detection unit 162 determines that it corresponds to a predetermined operation.

[0024] (Providing Department) The supply unit 166 provides the content selected by the selection unit 165 to the driver P1. The content provided to the driver P1 can be viewed by the driver P1 inside the vehicle.

[0025] The content provided may be video content (videos, still images, text displays, icon displays, graphic displays, etc.) or audio content. Audio content includes both voice content and music content.

[0026] (Output section) The output unit 168 outputs a video signal to the output device 50 when it plays video content in response to an instruction from the driver P1. As a result, the video based on the video signal output from the output unit 168 is displayed on the display unit that makes up the output device 50. Furthermore, when the output unit 168 plays audio content in response to an instruction from the driver P1, it outputs a playback signal to the output device 50. As a result, the audio based on the playback signal output from the output unit 168 is played back by the speakers and other components of the output device 50.

[0027] (Input section) The input unit 169 receives the voices of the driver P1 and the passenger P2. More specifically, it receives the voice signal of the driver P1, which is picked up by microphone 111A, and the voice signal of the passenger P2, which is picked up by microphone 111B.

[0028] (Content storage unit) The content storage unit 170 stores information about the content to be given to the driver P1. The content information includes information about multiple first content items that have been pre-generated using multiple dangerous scenes as themes, and information about multiple second content items. When driver P1 receives content, they can view only the provided content from among the content stored in the content storage unit 170. The provisioning unit 166 typically selects content to provide to the driver P1 from the content stored in the content storage unit 170. However, to enhance the variety of content, for example, the driver P1 may be provided with content not only stored in the content storage unit 170, but also content acquired from external devices such as a server device 400 via the public communication network 300.

[0029] (First Communications Department) The first communication unit 180 includes a short-range wireless communication module (not shown) that performs wireless communication with terminals 2A and 2B, and a wired communication module (not shown) that performs wired communication using CAN or the like. The short-range wireless communication module may employ the UWB wireless communication method described above.

[0030] Figure 2B is a block diagram illustrating the main components of the vehicle sensor group 12 and the in-vehicle camera 13 of the vehicle 100. <Vehicle sensor group> The vehicle sensor group 12 includes a vehicle speed sensor 121, a positioning sensor 122, a camera 123, a lidar 124, and an acceleration sensor 125. An operation detection sensor (not shown) that detects operations on various driving controls may also be included in the vehicle sensor group 12.

[0031] (Vehicle speed sensor) The vehicle speed sensor 121 detects the vehicle speed of the vehicle 100 and outputs the vehicle speed information to the on-board device 14.

[0032] (Positioning sensor) The positioning sensor 122 detects the current position of the vehicle 100 based on positioning signals from GPS (Global Positioning System) satellites, quasi-zenith satellites, etc. The positioning sensor 122 outputs a signal indicating the current position as position information to the in-vehicle device 14.

[0033] (camera) Camera 123 photographs the area around vehicle 100. Camera 123 outputs the subject image data as image information to the in-vehicle device 14. Camera 123 can capture both still images and videos.

[0034] (Rider) The LiDAR (Light Detection and Ranging) 124 performs scans by changing the irradiation angle of the laser beam it emits, and detects objects and measures the distance to objects based on the positional information of each detection point. The measurement data is output to the in-vehicle device 14.

[0035] (Accelerometer) The acceleration sensor 125 detects the acceleration of the vehicle 100 and outputs the acceleration information to the on-board device 14.

[0036] <In-car camera> The in-vehicle camera 13 includes a front seat camera 131 and a rear seat camera 132. The front seat camera 131 captures the upper body of the driver P1 sitting in the front seat and outputs the subject image data as image information to the in-vehicle device 14. The rear seat camera 132 captures the upper body of the passenger P2 sitting in the rear seat and outputs the subject image data as image information to the in-vehicle device 14.

[0037] Figure 2C is a block diagram illustrating the main components of the input device 11 and output device 50 of the on-board device 14 of the vehicle 100. <Input device> The input device 11 includes operation detection units 11A and 11B, and microphones 111A and 111B. (Operation detection unit) The operation detection unit 11A is operated by the driver P1 in the front seat and outputs an operation signal to the in-vehicle device 14. The operation detection unit 11A may be configured as a pointing device that works in conjunction with the projected image projected by the projection unit 52, which will be described later. The operation detection unit 11B is provided on the display surface of the display unit 51. The operation detection unit 11B is operated by the passenger P2 in the rear seat and outputs an operation signal indicating the touch position to the in-vehicle device 14.

[0038] (microphone) Microphone 111A collects the voice of the driver P1 in the front seat and outputs the audio signal to the in-vehicle device 14. Microphone 111B collects the voice of the passenger P2 in the rear seat and outputs the audio signal to the in-vehicle device 14.

[0039] <Output device> The output device 50 includes a display unit 51, a projection unit 52, and an audio playback unit 53. The output device 50 is used, for example, to display an operation menu screen or to play content. (Display) The display unit 51 has a screen such as a liquid crystal display and displays image information based on display signals output from the in-vehicle device 14. The image information includes operation menu screens, images of video content, etc.

[0040] (projection section) The projection unit 52 is composed of a head-up display (HUD) that projects onto, for example, the windshield, and projects image information based on a projection signal output from the in-vehicle device 14. The image information includes operation menu screens, images of video content, etc.

[0041] (Audio playback unit) The audio playback units 53A to 53D are configured as speakers that output audio and other sounds, and play audio content based on the playback signal output from the in-vehicle device 14. An audio output unit that outputs the content playback signal to headphones (not shown) may also be provided.

[0042] <Explanation of the flowchart> Figure 3 is a flowchart illustrating an example of information provision processing by a program executed by the MPU (control unit 16) of the in-vehicle device 14. When, for example, the "Hazard Prediction Training" button is pressed on the operation menu screen (not shown), the control unit 16 of the in-vehicle device 14 executes a program that enables the IVI system to function as an information provision device 200.

[0043] In step S10 of Figure 3, the control unit 16 detects the behavior of the vehicle 100 using the vehicle sensor group 12 and proceeds to step S20.

[0044] In step S20, the control unit 16 recognizes the surroundings of the vehicle 100 based on the detection data from the vehicle sensor group 12 and proceeds to step S30.

[0045] In step S30, the control unit 16 estimates the state of the driver P1 while driving and proceeds to step S40. As mentioned above, the reason for estimating the state of the driver P1 is to capture situations that could easily lead to an accident, so-called near-miss situations.

[0046] In step S40, the control unit 16 analyzes the driving behavior of driver P1 based on the behavior of the vehicle 100, the surrounding conditions, and the estimated state of driver P1, and proceeds to step S50.

[0047] In step S50, the control unit 16 determines whether a predetermined operation has been performed. Specifically, the predetermined operations on the driver control are so-called sudden braking operations and sudden steering operations. If the predetermined operation is performed, the control unit 16 affirms step S50 and proceeds to step S60; if the predetermined operation is not performed, it denies step S50 and proceeds to step S110.

[0048] In step S60, the control unit 16 uses the determination unit 164 to determine whether the driving behavior analyzed by the analysis unit 163 corresponds to a first specific event or a second specific event. If the determination unit 164 determines that the predetermined operation is not caused by a cognitive or judgment error of the driver P1 (i.e., it corresponds to a first specific event), the process proceeds from step S60 to step S70. If the determination unit 164 determines that the predetermined operation is caused by a cognitive or judgment error of the driver P1 (i.e., it corresponds to a second specific event), the process proceeds from step S60 to step S80.

[0049] In step S70, the control unit 16 uses the selection unit 165 to select a first content from among multiple contents pre-stored in the content storage unit 170, and proceeds to step S90.

[0050] In step S80, the control unit 16 uses the selection unit 165 to select a second content from among the multiple contents pre-stored in the content storage unit 170, and proceeds to step S90.

[0051] In step S90, the control unit 16 provides the content selected by the selection unit 165 to the driver P1 via the providing unit 166 and proceeds to step S100. In this embodiment, providing the selected content to the driver P1 is referred to as making it viewable by the driver P1.

[0052] In step S100, the control unit 16 updates the driving information for driver P1 and proceeds to step S110. The control unit 16 records driving information for each driver, such as when and where driver P1 of vehicle 100 drove, what kind of driving actions were taken, whether there were any dangerous situations, and what content was provided, in a memory unit (not shown) within the control unit 16. In step S100, an update record is made to add the latest driving information to this driver-specific driving information.

[0053] In step S110, the control unit 16 determines whether or not the operation has ended. If a predetermined termination operation is performed, the control unit 16 affirms step S110 and terminates the process shown in Figure 3. If no termination operation is performed, the control unit 16 negates step S110 and returns to step S10. If it returns to step S10, the control unit 16 repeats the process described above.

[0054] According to the embodiments described above, the following effects and advantages are achieved. (1) The information providing device 200 includes a vehicle sensor group 12 as a detection unit for detecting the behavior of the vehicle 100, a control unit 16 as a recognition unit for recognizing the surroundings of the vehicle 100, a driver state estimation unit 161 for estimating the state of the driver P1 of the vehicle 100, an analysis unit 163 for analyzing the driving behavior of driver P1 based on the behavior of the vehicle 100 detected by the vehicle sensor group 12, the surrounding conditions recognized by the control unit 16, and the state of driver P1 estimated by the driver state estimation unit 161, and the driving behavior analyzed by the analysis unit 163 when driver P1 performs a predetermined operation on the driving controls to avoid the danger that he had anticipated. The system includes: a determination unit 164 that determines whether the event falls under one specific event, or a second specific event in which driver P1 performs a predetermined operation on the driving controls to avoid danger without prediction; a selection unit 165 that, if the determination unit 164 determines that the event falls under the second specific event, selects a second content corresponding to the driving behavior analyzed by the analysis unit 163, and if the determination unit 164 determines that the event falls under the first specific event, selects a first content corresponding to the cause of the predetermined operation; and a provision unit 166 that provides the first or second content selected by the selection unit 165 to driver P1. With this configuration, different content is provided based on the analysis results, including the driver P1's condition, making it possible to provide content that serves as useful information for driver P1. For example, driver P1's awareness differs significantly depending on whether the driving behavior falls under a first specific event (such as sudden braking) that is not attributable to driver P1's cognitive and judgment errors, or a second specific event (such as sudden braking) that is attributable to driver P1's cognitive and judgment errors. Therefore, if hazard prediction training content is selected without distinguishing between the two, the training will be less effective for driver P1 whose driving behavior falls under the first specific event (such as sudden braking) (in other words, whose perception and judgment were appropriate). In this embodiment, by selecting a different first content for a driver P1 with appropriate perception and judgment than the content for a driver with perception and judgment errors, it is possible to prevent duplication of the content provided, enhance the effectiveness of the training provided, and improve the driver P1's receptiveness to hazard prediction training.

[0055] (2) In the information providing device 200 described in (1) above, the analysis unit 163 and the determination unit 164 start analysis and determination, respectively, when a predetermined operation on the driver control of the vehicle 100 is detected. For example, since the system starts upon detection of a predetermined operation such as sudden braking or sudden steering, it is easier to gain the driver P1's understanding and acceptance compared to starting the system without being limited to predetermined operations, and it is also possible to enhance the effectiveness of the training provided through the content.

[0056] (3) In the information providing device 200 described in (1) above, the selection unit 165 determines that the first specific event applies, extracts items to be trained from the driving behavior analyzed by the analysis unit 163, and selects as the first content content content that is generated using a driving scene different from the driving scene at the time the first specific event was determined to apply, and in which the factors of the predetermined operation are common. The first content is selected by deliberately avoiding using dangerous scenarios similar to those actually experienced by driver P1, and instead using dangerous scenarios different from those experienced, while sharing common factors for the prescribed operation (for example, blind spots at intersections and blind spots in parking lots). The first content is expected to evoke similar near-miss experiences in driver P1, leading to changes in future driving behavior.

[0057] (4) In the information providing device 200 described in (3) above, the selection unit 165 determines whether the predetermined operation is due to an internal or external factor when selecting the first content, and selects as the first content the content in which the cause of the predetermined operation is common from among a plurality of pre-prepared contents. With this configuration, by dividing the predetermined operation into internal and external factors, and further categorizing and classifying these factors, it becomes possible to provide more suitable content to driver P1.

[0058] (5) In the information providing device 200 described in (1) above, the analysis unit 163 extracts near-miss experiences from the driving behavior of driver P1, and the determination unit 164 determines that among the near-miss experiences, sudden operations on the driving controls that are not caused by cognitive and judgment errors are the first specific events. With this configuration, it becomes possible to distinguish between sudden maneuvers to avoid danger that are actions based on appropriate perception and judgment (first specific event) and spontaneous actions resulting from errors in perception and judgment (second specific event), thereby providing appropriate content to driver P1.

[0059] (6) In the information providing device 200 described in (2) above, the driver state estimation unit 161 estimates the state of driver P1 based on information acquired by at least the in-vehicle camera 13, and the analysis unit 163 analyzes the driving behavior of driver P1 based on the changes in the state of driver P1 estimated by the driver state estimation unit 161 before and after sudden operation of the driving controls. By estimating changes in the driver P1's state due to tension or surprise while driving, based on image information from the in-vehicle camera 13, near-miss situations can be accurately estimated. Alternatively, changes in the driver P1's state may be estimated based on the driver P1's voice recorded at the time of operations such as sudden braking.

[0060] The above embodiment can be modified into various forms. Modifications will be described below. (Variation 1) In the embodiment described above, an example was explained in which a hazard prediction training content is provided to the driver P1 by an information provision device 200 for each vehicle 100. However, a portion of the information provision processing that was performed for each vehicle 100 may be assigned to the server device 400 shown in Figure 1A, which is connected to the vehicle 100 via a public communication network 300. For example, by accessing the server device 400 from the vehicle 100 to select content, it becomes possible to reduce the storage capacity of the content storage unit 170 in each vehicle 100. Furthermore, information sharing between each vehicle 100 will also be possible. For example, by sharing information about dangerous situations between vehicle 100A and vehicle 100B, both drivers P1A and P1B can be reminded of similar near-miss experiences, which is expected to lead to changes in the future driving behavior of drivers P1A and P1B.

[0061] (Modification 2) The above description illustrates an example in which the driver P1 of vehicle 100, who has received hazard prediction training content, views the content via the output device 50 of vehicle 100. Alternatively, the in-vehicle device 14 may be configured to transmit the content to a terminal 2A used by driver P1 via the first communication unit 180, and driver P1 may view the content played on terminal 2A. According to Modification 2, driver P1 can view the content from terminal 2A after getting out of vehicle 100 as a way to review their own driving.

[0062] The above description is merely an example, and the present invention is not limited by the embodiments and modifications described above, as long as the features of the present invention are not impaired. It is also possible to arbitrarily combine one or more of the above embodiments and modifications, and to combine modifications with each other. [Explanation of Symbols]

[0063] 2A,2B Terminal, 11 Input device, 11A,11B Operation detection unit, 12 Vehicle sensor group, 13 In-vehicle camera, 14 In-vehicle device, 16 Control unit, 50 Output device, 51 Display unit, 52 Projection unit, 53A~53D Audio playback unit, 100,100A,100B Vehicle, 111A,111B Microphone, 121 Vehicle speed sensor, 122 Positioning sensor, 123 Camera, 124 Lidar, 125 Acceleration sensor, 131 Front seat camera, 132 Rear seat camera, 161 Driver state estimation unit, 162 Predetermined operation detection unit, 163 Analysis unit, 164 Judgment unit, 165 Selection unit, 166 Provision unit, 168 Output unit, 169 Input unit, 170 Content storage unit, 180 First communication unit, 200 Information provision equipment, 300 public communication networks, 400 server equipment, 500 information provision systems

Claims

1. A detection unit that detects the vehicle's behavior, A recognition unit that recognizes the surroundings of the vehicle, A driver state estimation unit that estimates the state of the driver of the vehicle, An analysis unit analyzes the driver's driving behavior based on the vehicle's behavior detected by the detection unit, the surrounding conditions recognized by the recognition unit, and the driver's state estimated by the driver state estimation unit. A determination unit determines whether the driving behavior analyzed by the analysis unit corresponds to a first specific event in which the driver performed a predetermined operation on the driving controls to avoid a danger that the driver had anticipated, or to a second specific event in which the driver performed the predetermined operation on the driving controls to avoid the danger without having anticipated it, If the determination unit determines that the event falls under the second specific event, the analysis unit selects a second content corresponding to the driving behavior analyzed by the analysis unit. If the determination unit determines that the event corresponds to the first specific event, the selection unit selects a first content corresponding to the cause of the predetermined operation, A providing unit that provides the driver with the first content or second content selected by the selection unit, An information providing device characterized by being equipped with the following features.

2. In the information providing device described in claim 1, When the predetermined operation on the vehicle's control panel is detected, the analysis unit and the determination unit respectively begin the analysis and determination. An information-providing device characterized by the following features.

3. In the information providing device described in claim 1, If the selection unit determines that the first specific event applies, it extracts items to be trained from the driving behavior analyzed by the analysis unit, and selects as the first content content content that is generated using a driving scene different from the driving scene at the time the first specific event was determined to apply, and in which the factors of the predetermined operation are common. An information-providing device characterized by the following features.

4. In the information providing device according to claim 3, When selecting the first content, the selection unit determines whether the predetermined operation is due to an internal or external factor, and selects as the first content from among a plurality of pre-prepared contents the content for which the factors of the predetermined operation are common. An information-providing device characterized by the following features.

5. In the information providing device described in claim 1, The analysis unit extracts near-miss experiences from the driver's driving behavior, The determination unit determines that, among the near-miss experiences, sudden operation of the driving control that is not caused by cognitive or judgment errors is the first specific event. An information-providing device characterized by the following features.

6. In the information providing device according to claim 2, The driver state estimation unit estimates the driver's state based on information acquired by at least a camera or vital sensor, The analysis unit analyzes the driver's driving behavior based on the changes in the driver's state estimated by the driver state estimation unit before and after a sudden operation on the driving control. An information-providing device characterized by the following features.

Images