Driving judgment system, driving judgment method, and program

Abstract

The cause of dangerous driving sensed using sensor information of a vehicle can be estimated. This driving determination system comprises: a sensing unit that senses dangerous driving of the vehicle on the basis of sensor information of the vehicle; a detection unit that, on the basis of image information acquired by photographing the interior or exterior of the vehicle, detects a traveling situation relating to the traveling of the vehicle when the dangerous driving has been sensed; and a determination unit that determines whether the sensed dangerous driving is unavoidable according to the detected traveling situation.

Description

[Technical field]

[0001] The present disclosure relates to a driving determination system that determines driving of a vehicle. [Background technology]

[0002] There is a driving evaluation system that judges sudden acceleration and deceleration of the vehicle from the acceleration sensor of the drive recorder and evaluates the driver's driving from the number of such occurrences. Patent Document 1 discloses a system that estimates road conditions from the driving operation status of the vehicle and judges dangerous driving. Patent Document 2 discloses a system that uses the difference between a normative model and the driver's driving operation as an evaluation value and encourages drivers who are below a certain evaluation value to act in a way that brings them closer to the normative model. Patent Document 3 discloses a system that evaluates safe driving by comparing the driving content with other drivers at the same location. Such driving evaluation is provided to the manager who manages the drivers and may be adopted as a performance evaluation for each driver. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2001-074764 A [Patent Document 2] JP 2020-129289 A [Patent Document 3] JP 2016-062470 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, when the vehicle is judged to have suddenly decelerated, it may be that the driver suddenly decelerated the vehicle to avoid a danger such as a pedestrian or an animal jumping out. If such danger avoidance driving is evaluated as dangerous driving, the driver's motivation will decrease.

[0005] One of the objectives of the present disclosure is to provide a driving judgment system etc. that can estimate the causes of dangerous driving detected from sensor information of a vehicle. [Means for solving the problem]

[0006] One aspect of the driving judgment system disclosed herein includes a detection unit that detects dangerous driving of a vehicle based on sensor information of the vehicle, a detection unit that detects driving conditions related to the driving of the vehicle when the dangerous driving is detected based on image information captured inside or outside the vehicle, and a judgment unit that judges whether the detected dangerous driving is unavoidable depending on the detected driving conditions.

[0007] One aspect of the driving judgment method disclosed herein detects dangerous driving of a vehicle based on sensor information of the vehicle, detects driving conditions related to the vehicle's driving at the time the dangerous driving was detected based on image information captured inside or outside the vehicle, and judges whether the detected dangerous driving is unavoidable depending on the detected driving conditions.

[0008] The present disclosure program One aspect of the present invention is to have a computer detect dangerous driving of a vehicle based on sensor information of the vehicle, detect driving conditions related to the driving of the vehicle at the time the dangerous driving was detected based on image information captured inside or outside the vehicle, and determine whether the detected dangerous driving is unavoidable depending on the detected driving conditions. Effect of the Invention

[0009] According to the present disclosure, it is possible to estimate the causes of dangerous driving detected from vehicle sensor information. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram showing an overview of a driving determination system according to a first embodiment. [Diagram 2] 1 is a diagram illustrating an example of a configuration of a driving determination system according to a first embodiment. [Diagram 3] FIG. 11 is a diagram showing an example of a driving situation based on image information. [Figure 4] FIG. 4 is a diagram showing an example of a driving situation based on sound image information. [Diagram 5] 11A and 11B are diagrams showing examples of factors of dangerous driving estimated from driving conditions based on image information and a judgment example. [Figure 6] 11A and 11B are diagrams illustrating examples of causes of dangerous driving estimated from driving conditions based on sound information and a judgment example. [Figure 7] 1A and 1B are diagrams illustrating examples of driving conditions and good driving judgment based on image information or audio information. [Figure 8] FIG. 4 is a diagram showing an example of driving information. [Figure 9] FIG. 11 is a diagram showing an example of evaluation information indicating an evaluation of a driver's driving. [Figure 10] FIG. 13 is a diagram showing an example of a display in which unnecessary and dangerous driving is superimposed on map information. [Figure 11] FIG. 13 is a diagram showing display information for identifying unnecessary and dangerous driving and unavoidable driving. [Figure 12] FIG. 13 is a diagram showing an example in which unnecessary and dangerous driving and unavoidable driving are superimposed on map information. [Figure 13] 4 is a flowchart showing an example of the operation of the driving determination system according to the first embodiment. [Figure 14] FIG. 11 is a block diagram showing an example of the configuration of a driving determination system according to a second embodiment. [Figure 15] 10 is a flowchart showing an example of the operation of a driving determination system according to a second embodiment. [Figure 16] FIG. 2 is a block diagram showing the hardware configuration of a computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] [First embodiment] A driving judgment system according to a first embodiment will be described with reference to the drawings. Fig. 1 is a diagram showing an overview of the driving judgment system according to the first embodiment. A driving judgment system 10 shown in Fig. 1 is connected to a vehicle system 20 via a network 30 so as to be able to communicate with each other.

[0012] (Vehicle Systems) The vehicle system 20 shown in FIG. 1 is provided in a vehicle such as an automobile, collects sensor information from sensors 21 installed in the vehicle, and transmits the information to the driving judgment system 10. The vehicle system 20 transmits the sensor information in association with a vehicle identifier that identifies the vehicle. The vehicle system 20 is, for example, a computer that executes functions by software. The vehicle system 20 may also store the collected sensor information in a recording medium, and the driving judgment system 10 may read out the sensor information from the recording medium or a device equipped with the recording medium. Note that the vehicle may include, in addition to an automobile (four-wheeled motor vehicle), a motorcycle (including three-wheeled motor vehicle), a bicycle, etc.

[0013] The sensor information is, for example, information that represents the state and behavior of the vehicle, and information that represents the driving operation by the driver of the vehicle. The sensor information includes image information captured inside and outside the vehicle, or sound information captured inside and outside the vehicle. The sensor information may include information about the external environment in which the vehicle is traveling. The sensor information of the external environment is, for example, the temperature, humidity, illuminance, etc. when the vehicle is traveling. Details of the external environment will be described later. The image information and sound information include the driving conditions outside the vehicle. The driving conditions will be described later. Furthermore, the image information includes the driver and passengers inside the vehicle. The sound information includes sounds inside the vehicle or the voices of the driver and passengers. The above-mentioned sensor information is merely an example and is not limited to these.

[0014] The sensor 21 may be, for example, a speed sensor that measures the vehicle's traveling position and the vehicle's speed, an acceleration sensor that measures the vehicle's acceleration, or a steering sensor that measures the vehicle's steering operation. Alternatively, the sensor 21 may be an image sensor that captures images of the inside and outside of the vehicle, or an acoustic sensor or microphone that collects sounds of the inside and outside of the vehicle. The above-mentioned sensor 21 is merely an example and is not limited to these.

[0015] (Driving Judgment System) Fig. 2 is a diagram showing an example of the configuration of the driving judgment system according to the first embodiment. The driving judgment system 10 shown in Fig. 2 includes a detection unit 101, a detection unit 102, a judgment unit 103, a driving information generation unit 104, a driving evaluation unit 105, an output unit 106, and a communication unit (not shown).

[0016] The detection unit 101 detects dangerous driving of the vehicle based on sensor information of the vehicle. Dangerous driving means, for example, driving that may be dangerous to traffic. Elements of dangerous driving include, for example, sudden deceleration, sudden acceleration, sudden steering, sudden braking, sudden start, running over bumps, and meandering driving. Elements of dangerous driving are examples and are not limited to these.

[0017] The detection unit 101 detects dangerous driving caused by sudden deceleration, sudden acceleration, sudden start, or sudden braking of the vehicle from the magnitude of the acceleration in the forward / rearward direction of the vehicle. Alternatively, the detection unit 101 detects dangerous driving caused by sudden steering or meandering of the vehicle from the magnitude of the acceleration in the left / right direction of the vehicle. Note that the detection of dangerous driving is not limited to acceleration, and dangerous driving may be detected based on sensor information from an accelerator pedal sensor and a steering sensor. The detection of dangerous driving is an example and is not limited to these.

[0018] The detection unit 101 may detect gentle driving of the vehicle based on the sensor information of the vehicle in addition to detecting dangerous driving of the vehicle. For example, gentle driving may be detected as gentle acceleration, deceleration, starting, stopping, or handling.

[0019] The detection unit 102 detects the driving conditions of the vehicle when dangerous driving is detected based on image information obtained by photographing the inside or outside of the vehicle. Fig. 3 is a diagram showing an example of the driving conditions based on the image information. The driving conditions based on the image information shown in Fig. 3 include information on the external environment, information on road conditions, or information on driving operation conditions.

[0020] The external environment based on the image information is, for example, weather such as sunny, rainy, snowy, foggy, windy, or thunder. For example, the detection unit 102 detects the presence or absence of rainfall or snowfall, visibility, and the like while the vehicle is traveling from the captured image data outside the vehicle using machine learning as a method for detecting the external environment. Alternatively, without using machine learning, the detection unit 102 may detect rainfall, snowfall, and the like using image processing with reference to the brightness or color difference of the captured image data. The external environment or the detection method of the external environment is merely an example and is not limited to these.

[0021] The road conditions based on the image information include road surface conditions, lane conditions, congestion, or obstacles. Road surface conditions include road step, road surface condition, or pavement type. Lane conditions include road width, width increase / decrease, number of lanes, increase / decrease in number of lanes, driving lane position, intersection, branching point, merging point, etc. Congestion conditions include following distance. Driving obstacles include parked vehicles, fallen objects, people or animals jumping out, aggressive vehicles, emergency vehicles, etc. The road conditions are examples and are not limited to these.

[0022] The driving operation status based on the image information includes accelerator operation, brake operation, steering operation, switch operation, the driver's line of sight, drowsiness, driving posture, etc. The detection unit 102 detects, for example, the steering angle, the presence or absence of switch operation, the driver's drowsiness, etc. from the camera image by video analysis. The driving operation status is an example and is not limited to these.

[0023] For example, the detection unit 102 detects whether there is a fallen object on the lane on which the vehicle is traveling based on image information as the vehicle's traveling conditions (road conditions) when dangerous driving is detected due to a sudden deceleration of the vehicle. Alternatively, the detection unit 102 may detect, from image information, the display or blinking of a traffic light in the vehicle's traveling direction as the external environment of the traveling conditions when the vehicle suddenly accelerates.

[0024] The detection unit 102 may detect the driving conditions related to the driving of the vehicle when dangerous driving is detected based on sound information obtained by photographing the inside or outside of the vehicle. FIG. 4 is a diagram showing an example of the driving conditions based on the sound image information. The driving conditions based on the sound information shown in FIG. 4 include, for example, information on the external environment, information on the road conditions, or information on the driving operation conditions. The external environment based on the sound information is, for example, weather such as rain, snow, wind, hail, or thunder. For example, the detection unit 102 detects the presence or absence of rain, snow, wind, hail, or thunder when the vehicle is traveling from the sound data outside the vehicle using machine learning as a method for detecting the external environment. The amount of precipitation and the strength of the wind speed may be detected based on the sound of rain and wind. Alternatively, a method other than machine learning may be used, and the detection unit 102 may detect rainfall, snowfall, etc. by referring to the frequency of the sound data, the difference in sound pressure, etc. The method for detecting the external environment or the external environment is an example and is not limited to these.

[0025] The road conditions based on the sound information include road surface conditions and lane conditions. The road surface conditions include road step and road surface condition. The lane conditions are tunnels (reverberation), audio signals (guiding sounds), and railroad crossings (warning sounds). The road conditions are examples and are not limited to these.

[0026] The driving operation status based on the sound information includes the driver's voice, the passenger's voice, the driving speed (wind noise, road noise), switch operation (blinking sound of turn signals, windshield wiper operation sound), horn, etc. The driving operation status is merely an example and is not limited to these.

[0027] For example, the detection unit 102 detects that a melody of an audio traffic signal for guiding pedestrians is being played as the vehicle driving condition (external environment) when dangerous driving is detected due to sudden deceleration of the vehicle.

[0028] The determination unit 103 determines whether the detected dangerous driving is unavoidable depending on the detected driving conditions. In detail, the determination unit 103 estimates whether the cause of the dangerous driving is the driver of the vehicle or something other than the driver of the vehicle in the detected driving conditions (external environment, road conditions, driving operation conditions).

[0029] 5 is a diagram showing an example of the cause of dangerous driving estimated from the driving situation based on image information and the judgment. For example, if the detected dangerous driving is sudden deceleration and the information on the driving situation (driving operation situation) includes the driver falling asleep, the judgment unit 103 judges that the cause of the dangerous driving is the driver. Alternatively, in another case, if the detected dangerous driving is sudden deceleration and the information on the driving situation (road situation) includes a fallen object on the road, the judgment unit 103 judges that the cause of the dangerous driving is something other than the driver (the fallen object in this case).

[0030] If the cause of the detected dangerous driving is due to something other than the driver, the judgment unit 103 judges the detected dangerous driving to be unavoidable driving, and if the cause of the detected dangerous driving is due to the driver of the vehicle, it judges it to be unnecessary dangerous driving.

[0031] 6 is a diagram showing an example of the cause of dangerous driving estimated from the driving situation based on sound information and the judgment. For example, if the detected dangerous driving is sudden deceleration and the information on the driving situation (road situation) includes the sound of a pedestrian crossing sound signal, the judgment unit 103 judges that the cause of the dangerous driving is the driver. Alternatively, in another case, if the detected dangerous driving is sudden steering and the information on the driving situation (external environment) includes the sound of strong winds outside the vehicle, the judgment unit 103 judges that the cause of the dangerous driving is something other than the driver (the vehicle being blown away by the wind).

[0032] Alternatively, the determination unit 103 may determine whether the detected driving is good driving according to the driving conditions detected based on image information or sound information. Good driving is, for example, gentle driving, careful driving, driving that obeys the legal speed limit, driving that is considerate of surrounding drivers, or driving that is considerate of the environment. FIG. 7 is a diagram showing an example of the driving conditions based on image information or sound information and the determination of good driving. For example, if the detected driving is gentle deceleration and the information on the driving conditions (road conditions) includes an image of letting a vehicle waiting to turn right go first, the determination unit 103 determines that the detected driving is good driving. Note that the definition of good driving and the determination of good driving are examples and are not limited to these.

[0033] The driving information generating unit 104 generates driving information. The driving information includes information on the detected dangerous driving. FIG. 8 is a diagram showing an example of driving information generated by the driving information generating unit 104 and stored in a memory (for example, a RAM (Random Access Memory) 93 or a storage device 95 in FIG. 16 described later). The driving information shown in FIG. 8 has items of a driving information identifier, a driver identifier, a vehicle identifier, a date and time, location information, a type of dangerous driving, a dangerous driving level, a cause, and a judgment. The driving information identifier is, for example, assigned in chronological order when the driving information generating unit 104 detects dangerous driving. The link between the driver identifier and the vehicle identifier may be obtained, for example, from the vehicle system 20 or the reservation information of the vehicle stored in another device. In addition, the driving information generating unit 104 obtains information related to the dangerous driving detected by the detection unit 101 that is related to the vehicle identifier (date and time of occurrence of the dangerous driving, location information indicating the location where the dangerous driving occurred, and the type of dangerous driving) from the detection unit 101 or a storage unit (not shown).

[0034] The driving information generating unit 104 assigns a dangerous driving level to the type of dangerous driving in the generated driving information. For example, the level of dangerous driving may be set according to the magnitude of acceleration of sudden deceleration. The method of assigning the dangerous driving level is an example and is not limited thereto.

[0035] Furthermore, the driving information generating unit 104 may update the driving information according to the additional judgment result by the judgment unit 103. When the judgment unit 103 judges the dangerous driving to be unavoidable driving, the driving information generating unit 104 registers "unavoidable driving" in the judgment item of the driving information, and when the judgment unit 103 judges the dangerous driving to be unnecessary dangerous driving, the driving information generating unit 104 registers "unnecessary dangerous driving". Furthermore, the driving information generating unit 104 may register the items that became the factors of the judgment in the judgment factor item of the driving information based on the judgment result. The driving information generating unit 104 stores the generated driving information in a storage unit (not shown). Note that the driving information generating unit 104 may have an administrator setting function that accepts changes to the driving information by the administrator so that the administrator can change the status of the driving information between "unnecessary dangerous driving" and "unavoidable driving".

[0036] The driving evaluation unit 105 calculates an evaluation value for driving based on dangerous driving. For example, the driving evaluation unit 105 sets an initial value of the evaluation value to 100, and subtracts points from the evaluation value every time the detection unit 101 detects dangerous driving. The initial value may be a value other than 100. The value of the points subtracted due to dangerous driving may be a fixed value, or may be a value according to the level of dangerous driving. For example, the level of the points subtracted may be set based on the level of dangerous driving.

[0037] Fig. 9 is a diagram showing an example of evaluation information showing an evaluation of a driver's driving. The evaluation information shown in Fig. 9 includes items such as a driver identifier, an evaluation value, the number of dangerous driving incidents, and the number of good driving incidents. For example, the evaluation value is calculated using the following calculation formula.

[0038] Evaluation value = 100 - number of dangerous driving times * k1 + number of good driving times * k2 [coefficients k1 = 4, k2 = 2] With this calculation formula, the evaluation value of M1 shown in Fig. 9 is "58," and the evaluation value of M2 is "88." The calculation formula and its coefficients are merely examples, and the present invention is not limited to these.

[0039] As another example of the evaluation method, the driving evaluation unit 105 may calculate an evaluation score for each driver by dividing it into elements of dangerous driving (sudden acceleration, sudden deceleration, etc.), and calculate a total score based on the average or total of the evaluation scores for each element. The driving evaluation unit 105 may also add points for good driving or unavoidable driving as a separate score (two axes) in addition to the points deducted due to dangerous driving. Furthermore, the driving evaluation unit 105 may calculate two scores, the remaining points deducted from the initial value (e.g., 100) due to dangerous driving, and the added points score, together as one score.

[0040] The driver identifier may be, for example, an employee number, a member number, or a personal number. The items of the evaluation information may include the driver's name. Also, the number of dangerous driving incidents and the number of good driving incidents may not be included. The items of the evaluation information are merely examples and are not limited to these.

[0041] The driving evaluation unit 105 may add points based on good driving, in addition to deducting points based on dangerous driving. For example, the driving evaluation unit 105 may add points to the evaluation value according to the number of times the determination unit 103 has determined the driving to be good, as shown in Fig. 7. By evaluating the driving not only by deducting points but also by adding points, the motivation of the driver is improved, which leads to contributions to safe driving.

[0042] The driving evaluation unit 105 stores the evaluation information in a storage unit (not shown) for each day and resets the evaluation value to an initial value. The evaluation information may be stored for a period other than one day. The evaluation value may be reset separately from the storage of the evaluation information.

[0043] The output unit 106 generates information to be displayed on a display (not shown) and controls the display of the information on the display. The output unit 106 controls the display of information on unnecessary dangerous driving or unavoidable driving based on the driving information or the evaluation information. For example, the output unit 106 displays the type of dangerous driving and the location where it occurred superimposed on map information based on the driving information.

[0044] FIG. 10 is a diagram showing a display example in which unnecessary dangerous driving is superimposed on map information. The display example of FIG. 10 is a display screen for an administrator who manages drivers. A screen display 1010 includes map information 1020, a level selection 1030, and a display selection 1040. In the map information 1020, type icons of dangerous driving of a vehicle (icon of sudden deceleration, icon of sudden steering, icon of sudden acceleration) and the respective occurrence positions are superimposed on the map. For example, the position of the icon of sudden deceleration in FIG. 10 corresponds to the dangerous driving of the driving information identifier D1 of the position information XXX1 in FIG. 8. Note that, by selecting the type icon with the mouse 1050, a selection link 1060 for displaying a video, a dangerous driving level, and a judgment factor related to dangerous driving is displayed. For example, by clicking "Dangerous driving level" in the selection link 1060 with the mouse 1050, the value of the dangerous driving level recorded in the driving information is displayed.

[0045] Level selection 1030 is a check box for selecting the dangerous driving level of dangerous driving. When a dangerous driving level in level selection 1030 is checked, output unit 106 refers to the driving information shown in FIG. 8, selects the dangerous driving corresponding to the checked dangerous driving level, and output unit 106 superimposes and outputs information on dangerous driving of the selected dangerous driving level (a type icon and details of unnecessary dangerous driving). Dangerous driving levels can be selected in duplicate, and unnecessary dangerous driving of all dangerous driving levels is output by selecting all. Note that the threshold value of the dangerous driving level to be displayed and the number of levels can be set arbitrarily.

[0046] Display selection 1040 is a checkbox for selecting and displaying unnecessary dangerous driving and unavoidable driving on the map. Both can be displayed by selecting both. By combining level selection 1030 and display selection 1040, for example, a dangerous driving level of "8" and "unavoidable driving" are output. Note that the display selection is not limited to the dangerous driving level and the like. For example, other items of driving information such as a driver identifier, a vehicle identifier, a date and time, and an area (range based on location information) may be used. Furthermore, a search input field for searching driving information may be provided.

[0047] Fig. 11 is a diagram showing type icons of unnecessary dangerous driving and unavoidable driving. A dangerous driving icon 2010 shown in Fig. 11 indicates sudden deceleration, sudden steering, and sudden acceleration. Moreover, an unavoidable driving icon 2020 indicates sudden deceleration, sudden steering, and sudden acceleration. Note that, for example, when a detected dangerous driving is later determined to be unavoidable driving, the type icon superimposed on the map is changed.

[0048] Fig. 12 is a diagram showing an example of displaying unnecessary dangerous driving and unavoidable driving as driving information superimposed on map information. When "unavoidable driving" is selected in the display selection 1040 on the display screen shown in the display example of Fig. 10, the output unit 106 displays icons of types of unavoidable driving (sudden deceleration, sudden steering, sudden acceleration) superimposed on the map of the respective occurrence positions, as shown in Fig. 12. In addition, in the unavoidable driving icon, selection links for displaying videos, dangerous driving levels, and judgment factors are displayed by selecting with the mouse.

[0049] (operation) Next, a description will be given of the operation of the driving determination system 10 according to the first embodiment. Fig. 13 is a flowchart showing an example of the operation of the driving determination system according to the first embodiment.

[0050] The driving determination system 10 receives vehicle sensor information transmitted by the vehicle system 20.

[0051] The detection unit 101 detects dangerous driving of a vehicle based on sensor information of the vehicle (step S101). Elements of dangerous driving include, for example, sudden deceleration, sudden acceleration, sudden steering, sudden braking, sudden starting, running over bumps, or meandering.

[0052] The detection unit 102 detects the driving conditions of the vehicle when dangerous driving is detected based on image information obtained by capturing an image of the inside or outside of the vehicle (step S102). The driving conditions based on the image information include information on the external environment, information on road conditions, or information on driving operation conditions. The detection unit 102 may detect the driving conditions of the vehicle when dangerous driving is detected based on sound information obtained by capturing an image of the inside or outside of the vehicle.

[0053] The determination unit 103 determines whether the detected dangerous driving is unavoidable according to the detected driving conditions. The determination unit 103 estimates whether the cause of the dangerous driving is the driver of the vehicle or something other than the driver of the vehicle in the detected driving conditions (external environment, road conditions, driving operation conditions) (step S103). If the cause of the detected dangerous driving is the driver of the vehicle (Yes in step S104), the determination unit 103 determines that the dangerous driving is unnecessary (step S105). On the other hand, if the cause of the detected dangerous driving is something other than the driver (No in step S104), the determination unit 103 determines that the dangerous driving is unavoidable (step S106).

[0054] Furthermore, the determination unit 103 may determine whether the detected driving is good driving depending on the driving conditions detected based on image information or sound information. For example, when the detected driving is gentle deceleration and the information on the driving conditions (road conditions) includes an image of letting a vehicle waiting to turn right go ahead, the determination unit 103 determines that the detected driving is good driving.

[0055] The driving information generating unit 104 generates driving information (step S107). The driving information includes items such as a driving information identifier, a driver identifier, a vehicle identifier, a date and time, location information, a type of dangerous driving, a dangerous driving level, a cause, and a judgment. The driving information generating unit 104 acquires information related to the dangerous driving detected by the detection unit 101, which is related to the vehicle identifier (date and time of dangerous driving, vehicle location information, type of dangerous driving), from the detection unit 101 or a storage unit (not shown).

[0056] The driving information generating unit 104 assigns a dangerous driving level to each type of dangerous driving in the generated driving information.

[0057] Furthermore, the driving information generating unit 104 may update the driving information according to the additional determination result by the determining unit 103. When the determining unit 103 determines that dangerous driving is unavoidable driving, the driving information generating unit 104 registers "unavoidable driving" in the determination item of the driving information, and when the determining unit 103 determines that dangerous driving is unnecessary, the driving information generating unit 104 registers "unnecessary dangerous driving". Furthermore, the driving information generating unit 104 may register the items that became the factors of the determination in the determination factor item of the driving information based on the determination result. Note that the administrator can also change the status of "unnecessary dangerous driving" and "unavoidable driving" of the driving information generated using the administrator setting function of the driving information generating unit 104 between each other.

[0058] The driving evaluation unit 105 calculates an evaluation value for driving based on the dangerous driving (step S108). For example, the driving evaluation unit 105 sets an initial value of the evaluation value to 100, and subtracts points from the evaluation value every time the detection unit 101 detects dangerous driving. The initial value may be a value other than 100. The value of the points subtracted due to dangerous driving may be a fixed value, or may be a value according to the level of dangerous driving. For example, the level of the points subtracted may be set based on the level of dangerous driving.

[0059] The driving evaluation unit 105 may add points based on good driving in addition to deducting points based on dangerous driving. For example, the driving evaluation unit 105 may add points to the evaluation value according to the number of drivings that the judgment unit 103 judges to be good driving. Alternatively, the driving evaluation unit 105 may calculate an evaluation value for each driver by dividing it into unnecessary dangerous driving elements (sudden acceleration, sudden deceleration, etc.), and calculate a total score based on the average or total of the evaluation values ​​for each element. In addition, the driving evaluation unit 105 may add points for good driving as a separate score (two axes) in addition to the deducted points due to unnecessary dangerous driving. Furthermore, the driving evaluation unit 105 may calculate two scores, the remaining owned score deducted from the initial value (for example, 100) due to unnecessary dangerous driving and the added score, as one score.

[0060] The output unit 106 displays and outputs information related to dangerous driving or unavoidable driving based on the driving information or the evaluation information. For example, the output unit 106 displays the type of dangerous driving and the occurrence location superimposed on the map information based on the driving information (step S109). For example, the output unit 106 displays, on the map information 1020, icons of types of dangerous driving of the vehicle (sudden deceleration, sudden steering, sudden acceleration) and the respective occurrence locations superimposed on the map.

[0061] When the determination unit 103 estimates that the cause of the detected dangerous driving is something other than the driver, the output unit 106 may notify the manager that the detected dangerous driving may be different. An example of the notification is to display "This sudden deceleration may not be dangerous driving."

[0062] (Modification of the first embodiment) The driving judgment system 10 may be installed in a vehicle. For example, the configuration of the driving judgment system 10 may be installed in a drive recorder or a driving assistance system of the vehicle, or in the vehicle system 20 or an app of a smartphone used by the driver.

[0063] (Effects of the First Embodiment) According to the first embodiment, the driving judgment system 10 can estimate the cause of dangerous driving detected from the sensor information of the vehicle. This is because the detection unit 102 detects the driving conditions related to the driving of the vehicle when dangerous driving is detected based on image information obtained by photographing the inside or outside of the vehicle. Then, from the estimation result, the judgment unit 103 can judge whether the detected dangerous driving is unavoidable depending on the detected driving conditions.

[0064] [Second embodiment] A driving judgment system according to a second embodiment will be described with reference to the drawings. The driving judgment system according to the second embodiment is communicably connected to a vehicle system 20 via a network 30, similar to the driving judgment system 10 according to the first embodiment.

[0065] Fig. 14 is a block diagram showing an example of the configuration of a driving judgment system according to the second embodiment. The driving judgment system 11 shown in Fig. 14 includes a detection unit 101, a detection unit 102, a judgment unit 103, and a communication unit (not shown). The driving judgment system 11 is, for example, a computer that executes the functions of the detection unit 101, the detection unit 102, and the judgment unit 103 by software.

[0066] The driving judgment system 11 according to the second embodiment has a configuration in which the driving information generation unit 104, the driving evaluation unit 105, and the output unit 106 are omitted from the configuration of the driving judgment system 10 according to the first embodiment. Therefore, detailed explanations of the configurations of the detection unit 101, the detection unit 102, and the judgment unit 103 will be omitted.

[0067] The driving determination system 11 receives vehicle sensor information transmitted by the vehicle system 20. The sensor information includes image information photographed inside and outside the vehicle, or sound information collected inside and outside the vehicle.

[0068] The detection unit 101 detects dangerous driving of the vehicle based on sensor information of the vehicle. Elements of dangerous driving include, for example, sudden deceleration, sudden acceleration, sudden steering, sudden braking, sudden start, running over bumps, and meandering driving. Elements of dangerous driving are examples and are not limited to these.

[0069] The detection unit 102 detects the driving conditions related to the driving of the vehicle when dangerous driving is detected, based on image information obtained by photographing the inside or outside of the vehicle. The driving conditions based on the image information include information on the external environment, information on road conditions, or information on driving operation conditions. The external environment based on the image information is, for example, weather such as sunny, rainy, snowy, foggy, windy, or thunder. The road conditions based on the image information include, for example, road surface conditions, lane conditions, congestion conditions, or driving obstacles. The driving operation conditions based on the image information include accelerator operation, brake operation, steering operation, switch operation, the driver's line of sight, drowsiness, etc.

[0070] The detection unit 102 may detect the driving conditions related to the driving of the vehicle when dangerous driving is detected based on sound information obtained by photographing the inside or outside of the vehicle. The driving conditions based on the sound information include, for example, information on the external environment, information on the road conditions, or information on the driving operation conditions. The external environment based on the sound information is, for example, weather such as rain, snow, wind, hail, or thunder. The road conditions based on the sound information include road surface conditions and lane conditions. The road surface conditions include road step and road surface condition. The lane conditions are a tunnel (reverberation sound), an acoustic signal (guiding sound), and a railroad crossing (warning sound). The road conditions are examples and are not limited to these.

[0071] The driving operation status based on the sound information includes the driver's voice, the passenger's voice, the driving speed (wind noise, road noise), switch operation (blinking sound of turn signals, windshield wiper operation sound), horn, etc. The driving operation status is merely an example and is not limited to these.

[0072] The determination unit 103 determines whether the detected dangerous driving is unavoidable depending on the detected driving conditions. In detail, the determination unit 103 estimates whether the cause of the dangerous driving is the driver of the vehicle or something other than the driver of the vehicle in the detected driving conditions (external environment, road conditions, driving operation conditions).

[0073] For example, if the detected dangerous driving is sudden deceleration and the information on the driving conditions (driving operation conditions) includes the driver falling asleep, the determination unit 103 presumes that the driver is responsible for the dangerous driving.

[0074] If the cause of the detected dangerous driving is due to something other than the driver, the judgment unit 103 judges the dangerous driving to be unavoidable, and if the cause of the detected dangerous driving is due to the driver of the vehicle, it judges the driving to be dangerous.

[0075] For example, if the detected reckless driving is sudden deceleration and the information on the driving conditions (road conditions) includes the sound of a pedestrian crossing audio signal, the determination unit 103 estimates that the driver is responsible for the reckless driving.

[0076] Alternatively, the determination unit 103 may determine whether the detected driving is good driving depending on the driving conditions detected based on image information or sound information for the detected driving. For example, when the detected driving is gentle deceleration and the information on the driving conditions (road conditions) includes an image of letting a vehicle waiting to turn right go first, the determination unit 103 determines that the detected driving is good driving.

[0077] 15 is a flowchart showing an example of the operation of the driving determination system according to the second embodiment. The driving determination system 11 receives sensor information of the vehicle transmitted by the vehicle system 20. The sensor information includes image information photographed inside and outside the vehicle, or sound information collected inside and outside the vehicle.

[0078] The detection unit 101 detects dangerous driving of the vehicle based on sensor information of the vehicle (step S111). Elements of dangerous driving include, for example, sudden deceleration, sudden acceleration, sudden steering, sudden braking, sudden starting, running over bumps, or meandering.

[0079] The detection unit 102 detects the driving conditions of the vehicle when dangerous driving is detected based on image information obtained by capturing an image of the inside or outside of the vehicle (step S112). The driving conditions based on the image information include information on the external environment, information on road conditions, or information on driving operation conditions. The detection unit 102 may detect the driving conditions of the vehicle when dangerous driving is detected based on sound information obtained by capturing an image of the inside or outside of the vehicle.

[0080] The determination unit 103 determines whether the detected dangerous driving is unavoidable according to the detected driving conditions (external environment, road conditions, driving operation conditions) (step S113). The determination unit 103 estimates whether the cause of the dangerous driving is the driver of the vehicle or something other than the driver of the vehicle in the detected driving conditions (external environment, road conditions, driving operation conditions). If the cause of the detected dangerous driving is something other than the driver, the determination unit 103 determines the dangerous driving as unavoidable driving, and if the cause of the detected dangerous driving is the driver of the vehicle, the determination unit 103 determines the dangerous driving as dangerous driving.

[0081] Alternatively, the determination unit 103 may determine whether the detected driving is good driving depending on the driving conditions detected based on image information or sound information for the detected driving. For example, when the detected driving is gentle deceleration and the information on the driving conditions (road conditions) includes an image of letting a vehicle waiting to turn right go first, the determination unit 103 determines that the detected driving is good driving.

[0082] (Modification of the second embodiment) The driving judgment system 11 of the second embodiment may be mounted on the vehicle system 20 and transmit the judgment result. The transmission destination of the judgment result may be the driving judgment system 10 of the first embodiment, or may be another driving judgment system in which the detection unit 101, the detection unit 102, and the judgment unit 103 are removed from the driving judgment system 10 and the driving information generation unit 104 is provided with a driving evaluation unit 105.

[0083] (Effects of the second embodiment) According to the second embodiment, the driving judgment system 11 can estimate the cause of dangerous driving detected by the sensor information of the vehicle. This is because the detection unit 102 detects the driving conditions related to the driving of the vehicle when dangerous driving is detected based on image information obtained by photographing the inside or outside of the vehicle. Then, from the estimation result, the judgment unit 103 can judge whether the detected dangerous driving is unavoidable depending on the detected driving conditions.

[0084] (Hardware configuration) FIG. 16 is a diagram showing an example of a hardware configuration of a computer. The driving judgment system 10 is realized by executing a program (software program, computer program) in a CPU 91 of a computer 90 shown in FIG. 16. The functions of the configurations of the driving judgment systems 10 and 11 are realized by executing the program. Some of the configurations of the driving judgment systems 10 and 11 may be configured in an external device (not shown) and provided to the driving judgment systems 10 and 11 from the external device via a network. The configuration of the driving judgment system 10 may be realized by a CPU (Central Processing Unit) 91 reading a program 94 from a ROM (Read Only Memory) 92 or a storage device 95, and executing the read program 94 using the CPU 91 and a RAM (Random Access Memory) 93. The present disclosure described using the above-mentioned embodiment as an example can be considered to be configured by a code representing a computer program or a computer-readable storage medium in which the code representing the computer program is stored. The computer-readable storage medium is, for example, a storage device 95, a removable magnetic disk medium not shown, an optical disk medium, or a memory card. The configuration of each embodiment may be a dedicated hardware such as an integrated circuit. The driving determination systems 10 and 11 may be realized by cloud computing.

[0085] The present disclosure is not limited to the above-described embodiments, and various modifications are possible. The technical scope of the present disclosure also includes embodiments obtained by appropriately combining the configurations, operations, and processes disclosed in different embodiments.

[0086] The present disclosure is not limited to the above-described embodiment. That is, the present disclosure can be applied in various aspects that can be understood by a person skilled in the art within the scope of the present disclosure. [Explanation of symbols]

[0087] 10, 11 Driving Judgment System 20 Vehicle Systems 21 Sensors 101 Detection unit 102 Detection unit 103 Judgment section 104 Driving information generation unit 105 Driving Evaluation Department 106 Output section

Claims

1. A detection means for detecting dangerous driving of the vehicle based on sensor information of the vehicle; A detection means for detecting a driving condition of the vehicle when the dangerous driving is detected based on image information obtained by photographing the inside or outside of the vehicle; A determination means for determining whether the detected dangerous driving is unavoidable according to the detected driving conditions, and further determining whether the detected dangerous driving is good driving based on a second driving condition detected based on image information obtained by photographing the inside or outside of the vehicle; a driving evaluation means for calculating an evaluation value regarding the driving of the vehicle based on the dangerous driving, and adding points to the evaluation value based on the good driving.

2. The driving determination system according to claim 1 , wherein the driving conditions are an external environment in which the vehicle is traveling, a road condition on which the vehicle is traveling, or a driving operation condition related to a driving operation of the vehicle.

3. 3. The driving judgment system according to claim 1, wherein the judgment means estimates whether a cause of the detected dangerous driving is due to a driver of the vehicle or due to a factor other than the driver of the vehicle, depending on the driving situation.

4. 4. The driving determination system according to claim 3, wherein the determination means determines the dangerous driving to be unavoidable driving when a cause of the detected dangerous driving is other than that of the driver.

5. 5. The driving judgment system according to claim 1, wherein the judgment means judges the detected dangerous driving to be unnecessary dangerous driving when a cause of the dangerous driving is a driver of the vehicle.

6. The driving judgment system according to claim 1 , further comprising a driving information generating means for generating driving information including information related to the detected dangerous driving.

7. The driving determination system according to claim 6 , wherein the driving information includes a date and time of the dangerous driving, a location where the dangerous driving occurred, and a type of the dangerous driving.

8. A detection means for detecting dangerous driving of the vehicle based on sensor information of the vehicle; A detection means for detecting a driving condition related to the driving of the vehicle when the dangerous driving is detected based on sound information that records sounds inside or outside the vehicle; A determination means for determining whether the detected dangerous driving is unavoidable according to the detected driving conditions, and further determining whether the detected dangerous driving is good driving based on a second driving condition detected based on image information obtained by photographing the inside or outside of the vehicle; a driving evaluation means for calculating an evaluation value regarding the driving of the vehicle based on the dangerous driving, and adding points to the evaluation value based on the good driving.

9. Detecting dangerous driving of the vehicle based on sensor information of the vehicle; Detecting a driving situation regarding the driving of the vehicle when the dangerous driving is detected based on image information obtained by photographing the inside or outside of the vehicle; According to the detected driving conditions, it is determined whether the detected dangerous driving is unavoidable driving, and further, it is determined whether the detected dangerous driving is good driving based on a second driving condition detected based on image information obtained by photographing the inside or outside of the vehicle; The driving judgment method includes calculating an evaluation value regarding the driving of the vehicle based on the dangerous driving, and adding points to the evaluation value based on the good driving.

10. Detecting dangerous driving of the vehicle based on sensor information of the vehicle; Detecting a driving situation regarding the driving of the vehicle when the dangerous driving is detected based on image information obtained by photographing the inside or outside of the vehicle; According to the detected driving conditions, it is determined whether the detected dangerous driving is unavoidable driving, and further, it is determined whether the detected dangerous driving is good driving based on a second driving condition detected based on image information obtained by photographing the inside or outside of the vehicle; A program that causes a computer to calculate an evaluation value regarding the driving of the vehicle based on the dangerous driving, and to add points to the evaluation value based on the good driving.

Images