Driving diagnostic device

Abstract

To provide a driving diagnostic device capable of performing driving diagnosis for safety confirmation of a temporary stop scene by improving real time performance.SOLUTION: A control unit extracts a temporary stop scene from image information and vehicle information for predetermined diagnosis time (for example, 10 [sec] or the like) longer than first time for each predetermined first time (for example, 1 [sec] or the like), and performs driving diagnosis for safety confirmation.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an operation diagnosis device.

Background Art

[0002] Patent Document 1 proposes an operation evaluation system that determines whether a safe driving action related to a specific driving action such as a temporary stop or a safety check is performed in an in-vehicle device, and gives a warning or other attention call to the driver in real time.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technology described in Patent Document 1, although it is described that attention is called in real time, it is necessary to download the temporary stop intersection information, and there is room for improvement in order to improve the real-time performance and perform an operation diagnosis of safety confirmation in a temporary stop scene.

[0005] The present invention has been made in consideration of the above facts, and an object thereof is to provide an operation diagnosis device capable of improving real-time performance and performing an operation diagnosis of safety confirmation in a temporary stop scene.

Means for Solving the Problems

[0006] The operation diagnosis device according to the first aspect includes an acquisition unit that acquires each of a detection result of vehicle information and a captured image of a driver, and a diagnosis unit that extracts a temporary stop scene from the acquisition results of the acquisition unit for a predetermined diagnosis time longer than the first time every predetermined first time, and performs an operation diagnosis regarding safety confirmation. The diagnostic unit performs the driving diagnosis within the diagnostic time, from the time the vehicle information meets a predetermined start condition until the time the predetermined end condition is met. .

[0007] According to the first embodiment, at predetermined intervals of one hour, a stoppage scene is extracted from the acquisition results of the acquisition unit for a predetermined diagnostic time longer than the first hour, and a driving diagnosis is performed. This improves real-time performance and enables driving diagnosis to confirm the safety of stoppage scenes.

[0009] Also By performing a driving diagnosis from the start condition to the end condition, it becomes possible to detect a pause scene and then perform the driving diagnosis.

[0010] The 2 The operation diagnostic device relating to the mode is the first mode To In the aforementioned driving diagnostic device, the diagnostic unit calculates predetermined key performance indicators for conducting a driving diagnosis regarding safety confirmation of a temporary stop scene from the acquisition results of the acquisition unit, and performs the driving diagnosis using the calculated key performance indicators.

[0011] The 2 Depending on the configuration, it becomes possible to perform driving diagnostics regarding stopping driving scenarios by calculating key performance indicators.

[0012] The 3 The operational diagnostic device relating to the embodiment is the 2 In the driving diagnostic device according to the embodiment, the diagnostic unit is The direction of the direction indicator signal at the start of the safety check, the maximum and minimum driver head swing angles for the period from the start of the safety check to two hours prior to the start of the safety check, the duration for which the head swing angle in the period from the start of the safety check to two hours prior to the start of the safety check is greater than a predetermined angle, and the duration for which the head swing angle in the period from the start of the safety check to two hours prior to the start of the safety check is within a predetermined angle range are calculated as key performance indicators.

[0013] The 3 Depending on the method, these key performance indicators can be used to identify driving situations that require a stop.

[0014] The 4 The operation diagnostic device relating to the embodiments is as follows: 1st Embodiment to 2nd Embodiment3 In the driving diagnosis device according to any one of the aspects, there is further provided a notification unit that notifies the diagnosis result of the diagnosis unit, and the overlapping diagnosis results are preferentially notified in the order of the previous diagnosis results.

[0015] First 4 According to the aspect, since the overlapping diagnosis results are preferentially notified in the order of the previous diagnosis results, the driving diagnosis results can be notified by excluding the overlapping diagnosis results.

Advantages of the Invention

[0016] As described above, according to the present invention, it is possible to provide a driving diagnosis device capable of improving real-time performance and performing driving diagnosis for safety confirmation in a temporary stop scene.

Brief Description of the Drawings

[0017] [Figure 1] It is a diagram showing a schematic configuration of a driving diagnosis device according to this embodiment. [Figure 2] It is a block diagram showing a schematic configuration of a control unit. [Figure 3] It is a diagram for explaining conventional driving diagnosis and driving diagnosis of this embodiment. [Figure 4] It is a flowchart showing an example of a processing flow performed by a control unit of a driving diagnosis device according to this embodiment.

Embodiments for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing a schematic configuration of a driving diagnosis device according to this embodiment.

[0019] The driving diagnosis device 10 according to this embodiment is mounted on a vehicle 12 and performs driving diagnosis of a driver who drives the vehicle 12. In this embodiment, an example of performing driving diagnosis regarding safety confirmation in a temporary stop scene will be described, but driving diagnosis for other safety confirmations such as lane change, right and left turns, and reverse may also be performed.

[0020] The driving diagnostic device 10 is designed to be connectable to a server 14, such as a cloud server, via a communication network 16. The diagnostic results of the driving diagnostic device 10 may be sent to the server 14, which then manages the driving diagnostic results for each vehicle.

[0021] The driving diagnostic device 10 includes a control unit 20 as an example of an acquisition unit and a diagnostic unit, a vehicle information detection unit 22, an imaging unit 24, a communication unit 26, and a display unit 28 as an example of a notification unit.

[0022] The vehicle information detection unit 22 detects vehicle information related to the vehicle 12. In this embodiment, vehicle speed information, accelerator pedal position, direction indicator signals, and vehicle 12 position information are acquired as examples of vehicle information, but other vehicle information may also be detected. For example, vehicle information such as acceleration, distance to obstacles around the vehicle, and route may be detected. Specifically, the vehicle information detection unit 22 can be fitted with multiple types of sensors and devices that acquire information representing the conditions of the surrounding environment of the vehicle 12. Examples of sensors and devices include sensors mounted on the vehicle 12 such as a vehicle speed sensor, steering angle sensor, and acceleration sensor, as well as a GNSS (Global Navigation Satellite System) device, an in-vehicle communication device, a navigation system, and a radar device. The GNSS device receives GNSS signals containing time information from multiple GNSS satellites to determine the position of the vehicle 12. The accuracy of positioning improves as the number of receivable GNSS signals increases. The in-vehicle communication device is a communication device that performs at least one of vehicle-to-vehicle communication with other vehicles 12 and vehicle-to-infrastructure communication with roadside units via a communication unit 26. The navigation system includes a map information storage unit that stores map information and performs processing to display the position of the vehicle 12 on a map and guide the vehicle to a destination based on position information obtained from the GNSS device and the map information stored in the map information storage unit. The radar device includes multiple radars with different detection ranges that detect objects such as pedestrians and other vehicles 12 that are present around the vehicle 12 and acquire the relative position and relative speed of the detected objects and the vehicle 12. The radar device also incorporates a processing unit that processes the detection results of surrounding objects. Based on changes in the relative position and relative speed of individual objects included in the most recent multiple detection results, the processing unit excludes noise and roadside objects such as guardrails from the monitoring targets and tracks and monitors pedestrians and other vehicles 12 as monitored objects. The radar device then outputs information such as the relative position and relative speed of each monitored object.

[0023] In this embodiment, the imaging unit 24 is mounted inside the vehicle and captures images of the driver, generating image data representing the captured moving images. The imaging unit 24 may also be equipped with an infrared sensor that detects characteristic features of the driver, such as their eyes and face, using infrared light. The imaging unit 24 may also capture images of at least one area around the vehicle 12, including the front, side, and rear.

[0024] The communication unit 26 establishes communication with the server 14 via the communication network 16 and transmits and receives various types of information, such as image information obtained by the imaging unit 24 and vehicle information detected by the vehicle information detection unit 22.

[0025] The display unit 28 provides various information to the occupants by displaying information. In this embodiment, the results of the driving diagnosis are notified by displaying the results of the driving diagnosis. The display unit 28 may also notify the driving diagnosis results by outputting audio.

[0026] As shown in Figure 2, the control unit 20 is composed of a general-purpose microcomputer including a CPU (Central Processing Unit) 20A, ROM (Read Only Memory) 20B, RAM (Random Access Memory) 20C, storage 20D, interface (I / F) 20E, and bus 20F. The control unit 20 also performs driving diagnostics based on image information representing the image captured by the imaging unit 24 and vehicle information detected by the vehicle information detection unit 22 at the time of image capture, by executing a program stored in the ROM 20B.

[0027] Incidentally, in conventional driving diagnostics, as shown in the upper part of Figure 3, driving diagnostics were performed and reports were created at predetermined intervals, such as 10 minutes. Therefore, it was not possible to provide feedback to the driver at the moment of sudden braking, and even when feedback was given, the driver may not remember or understand what went wrong.

[0028] Therefore, the driving diagnostic device 10 according to this embodiment performs driving diagnostics in real time and provides feedback to the driver.

[0029] To perform real-time diagnosis, as shown in the lower part of Figure 3, the driving diagnosis is performed by overlapping data from a predetermined time period, such as the past 10 seconds, with a delay of a predetermined time, such as 1 second. That is, every predetermined first hour (for example, 1 second), the control unit 20 extracts temporary stop scenes from image information and vehicle information for a predetermined diagnosis time period longer than the first hour (for example, 10 seconds), and performs a driving diagnosis regarding safety checks. Note that since the diagnosis may be performed twice due to overlapping, the earlier diagnosis result is output first in case of overlapping results.

[0030] In this embodiment, a driving diagnosis is performed to confirm safety during a temporary stop. The details of the driving diagnosis for safety confirmation will be explained with specific examples.

[0031] The extraction of driving scenes involves extracting driving scenes within the diagnostic time, from the point when the vehicle information meets a predetermined start condition until it meets a predetermined end condition. For example, the start condition for a driving scene is set to 0.5 seconds before the point when the vehicle speed is > 0 [km / h] and the accelerator pedal opening is > 0 [%], and the end condition is set to 4 [sec] after the start, to extract a driving scene of a temporary stop.

[0032] As an example of the criteria for extracting driving scenes, scenes will be excluded if the maximum accelerator opening is <15%, the maximum speed is <10 km / h, the minimum speed is >10 km / h, and the turn signals are off.

[0033] As an example of calculating Key Performance Indicators (KPIs), the following will be calculated: the direction of the turn signal at the start of the scene; the maximum swivel angle [deg] for the period from the start of the scene to a predetermined second time (e.g., 5 seconds) prior; the minimum swivel angle [deg] for the period from the start of the scene to a predetermined second time (e.g., 5 seconds) prior; the continuous duration during which the swivel angle for the period from the start of the scene to a predetermined second time (e.g., 5 seconds) is greater than a predetermined angle (e.g., 30 degrees); and the continuous duration during which the swivel angle for the period from the start of the scene to a predetermined second time (e.g., 5 seconds) is within a predetermined angle range (e.g., greater than -128 degrees and less than -30 degrees). Note that an error message will be output if the angle is -128 degrees.

[0034] Then, using the calculated KPIs, a driving diagnosis is performed and feedback is given to the driver in real time. For example, based on the maximum swing angle, minimum swing angle, and the duration of the angle exceeding the threshold, the scores for each (1. to 4.) are determined as shown below, and a driving diagnosis is performed based on the determined scores and feedback is given to the driver. 1. When the maximum swivel angle is <40 degrees, the score is 1 point; otherwise, the score is 100 points. 2. When the minimum swivel angle is > -40 degrees, the score is 1 point; otherwise, the score is 100 points. 3. When the head swing angle > 30 degrees and the continuous duration < 0.6 seconds, the score is 1 point; otherwise, the score is 100 points. 4. When the oscillation angle is <-30 degrees and the continuous duration is <0.6 seconds, the score is 1 point; otherwise, the score is 100 points.

[0035] For example, if the turn signal is to the right at the start of the scene, and score 1 is 1 point, the message "Insufficient checking of the left direction" will be displayed on the display unit 28. If the score for 2. is 1 point, other than as described above, the message "Insufficient checking to the right" will be displayed on the display unit 28. If the score for 3. is 1 point, other than as described above, the message "Check carefully to the left" will be displayed on the display unit 28. If the score for 4. is 1 point, other than as described above, the message "Check carefully to the right" will be displayed on the display unit 28. If all other scores are 100%, the message "This is a very safe start" will be displayed.

[0036] Additionally, if the turn signal is to the left at the start of the scene, and score 2 is 1, the message "Insufficient check of the right direction" will be displayed on the display unit 28. If, for any other reason, score 1 is 1 point, the message "Insufficient checking to the left" will be displayed on display unit 28. If the score for 4. is 1 point, other than as described above, the message "Check carefully to the right" will be displayed on the display unit 28. If the score for 3. is 1 point, other than as described above, the message "Check carefully to the left" will be displayed on the display unit 28. If all other scores are 100%, the message "This is a very safe start" will be displayed on the display unit 28.

[0037] Next, we will describe the specific processes performed by the operation diagnostic device 10 according to this embodiment, which is configured as described above. Figure 4 is a flowchart showing an example of the processing flow performed by the control unit 20 of the operation diagnostic device 10 according to this embodiment. Note that the processing in Figure 4 starts, for example, every 1 [sec].

[0038] In step 100, the CPU 20A acquires vehicle information and captured images and proceeds to step 102. In this embodiment, 10 seconds of vehicle information and captured images are acquired from the detection results of the vehicle information detection unit 22 and the captured images taken by the shooting unit 24. Step 100 corresponds to an example of the acquisition unit, and the processing from step 102 to 106 is an example of the diagnostic unit.

[0039] In step 102, the CPU 20A extracts a driving scene and proceeds to step 104. That is, it extracts a driving scene from the vehicle information and captured image acquisition results according to the conditions described above. For example, a driving scene with a pause is extracted, with the start condition being 0.5 seconds before the point when the vehicle speed > 0 [km / h] and the accelerator opening > 0 [%], and the end condition being 4 seconds after the start.

[0040] In step 104, CPU 20A performs KPI calculations for the extracted driving scenes and proceeds to step 106. Specifically, the key performance indicators (KPIs) are determined as follows: the direction of the turn signal at the start of the scene; the maximum swivel angle [deg] for the period from the start of the scene to a predetermined time (e.g., 5 seconds) prior; the minimum swivel angle [deg] for the period from the start of the scene to a predetermined time (e.g., 5 seconds) prior; the continuous duration during which the swivel angle is greater than a predetermined angle (e.g., 30 degrees) for the period from the start of the scene to a predetermined time (e.g., 5 seconds) prior; and the continuous duration during which the swivel angle is within a predetermined angle range (e.g., greater than -128 degrees and less than -30 degrees) for the period from the start of the scene to a predetermined time (e.g., 5 seconds) prior.

[0041] In step 106, CPU 20A makes a safety check and proceeds to step 108. That is, it makes a safety check based on the KPI calculation results. For example, based on the maximum swing angle, minimum swing angle, and the duration of the angle exceeding the threshold, it determines the score for each score (1. to 4.) as described above, and performs an operational diagnosis based on the determined score.

[0042] In step 108, CPU 20A determines whether or not there is insufficient safety check. If the determination is negative, the process proceeds to step 110; if it is positive, the process proceeds to step 112.

[0043] In step 110, the CPU 20A terminates the series of processes by notifying that safe driving is occurring. For example, it displays a message indicating safe driving on the display unit 28.

[0044] On the other hand, in step 112, the CPU 20A notifies that safety checks have been insufficient and terminates the series of processes. For example, it displays a message indicating that safety checks have been insufficient on the display unit 28.

[0045] Thus, in the driving diagnostic device 10 according to this embodiment, the control unit 20 extracts temporary stop scenes from image information and vehicle information for a predetermined diagnostic time longer than the first hour (for example, 10 seconds) at predetermined first hour intervals (for example, 1 second), and performs a driving diagnosis for safety checks, thereby enabling driving diagnosis in a short time. This makes it possible to perform driving diagnosis in real time and provide feedback to the driver.

[0046] In the above embodiment, an example was described in which a driving diagnosis is performed using a driving diagnosis device 10 mounted on the vehicle 12, but this is not the only example. For example, the in-vehicle device may be made able to communicate with an information processing terminal such as a smartphone, and the functions of the control unit 20 may be provided on the information processing terminal. Alternatively, vehicle information and captured images may be sent to the server 14 to perform a driving diagnosis, and the diagnosis results may be sent to the control unit 20 and displayed on the display unit 28.

[0047] Furthermore, although the processing performed by the control unit 20 in each of the above embodiments has been described as software processing performed by executing a program, it is not limited to this. For example, it may be processing performed by hardware such as a GPU (Graphics Processing Unit), ASIC (Application Specific Integrated Circuit), and FPGA (Field-Programmable Gate Array). Alternatively, it may be processing that combines both software and hardware. In the case of software processing, the program may be stored on various storage media and distributed.

[0048] Furthermore, the present invention is not limited to the above, and it is of course possible to implement it in various modified forms without departing from its spirit. [Explanation of symbols]

[0049] 10. Operational diagnostic device 20 Control Unit (Acquisition Unit and Diagnostic Unit) 22 Vehicle Information Detection Unit 24 Photography Department 28 Display section

Claims

1. An acquisition unit that acquires vehicle information detection results and images of the driver, A diagnostic unit that, at predetermined intervals of one hour, extracts temporary stop scenes from the acquisition results of the acquisition unit for a predetermined diagnostic time longer than the first hour, and performs a driving diagnosis for safety checks, Equipped with, The diagnostic unit is a driving diagnostic device that performs the driving diagnosis within the diagnostic time, from the time the vehicle information meets a predetermined start condition until the time the vehicle information meets a predetermined end condition.

2. The driving diagnostic device according to claim 1, wherein the diagnostic unit calculates predetermined key performance indicators for performing a driving diagnosis regarding safety confirmation of a temporary stop scene from the acquisition results of the acquisition unit, and performs the driving diagnosis using the calculated key performance indicators.

3. The driving diagnostic device according to claim 2, wherein the diagnostic unit calculates the direction of the direction indicator signal at the start of the safety check, the maximum and minimum driver head swing angles for the period from the start of the safety check to a predetermined second hour prior, the duration for which the head swing angle for the period from the start of the safety check to the second hour prior is greater than a predetermined angle, and the duration for which the head swing angle for the period from the start of the safety check to the second hour prior is within a predetermined angle range, as the key performance evaluation indicators.

4. The driving diagnostic device according to claim 1, further comprising a notification unit that notifies the diagnostic results of the diagnostic unit, and in the case of overlapping diagnostic results, the notification unit that prioritizes the notification of the earlier diagnostic result.

Images