Information processing device

Abstract

To provide an information processing device capable of allowing a driver to be informed of an evaluation result of deceleration operation while the driver drives a vehicle.SOLUTION: An acquisition section 40 acquires a vehicle speed, an acceleration opening, forward and backward acceleration, and either a brake oil pressure or a stop lamp signal. An extraction section 42 extracts an operation scene during a period when the vehicle speed, the acceleration opening, and either the brake oil pressure or the stop lamp signal acquired by the acquisition section 40 meet predetermined extraction conditions. An evaluation section 44 evaluates deceleration operation of a driver of a vehicle on the basis of the vehicle speed and the forward and backward acceleration in the operation scene extracted by the extraction section 42. A control section 46 controls in a manner that causes a display section 28 to notify the driver of an evaluation result of the deceleration operation by the evaluation section 44 while the driver drives the vehicle 12.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information processing device that diagnoses the driving of a driver who drives a vehicle.

Background Art

[0002] Patent Document 1 discloses a technique that can provide a diagnostic result according to a driver's driving skill and can effectively utilize the diagnostic result. Specifically, Patent Document 1 is characterized by determining the proficiency level of a driver's driving skill and increasing the number of diagnostic items to be displayed as the proficiency level of the driving skill is higher. When increasing the number of diagnostic items to be displayed, for example, the diagnostic items with poor diagnostic results among the diagnostic items that have not been displayed are added in order, or the diagnostic items with high relevance to the provided diagnostic items among the diagnostic items that have not been displayed are added in order. A driving skill diagnostic device is disclosed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Just presenting the driving diagnosis result to the driver after driving does not allow the driver to sufficiently understand whether their driving is good or bad.

[0005] The present invention has been made in consideration of the above facts, and an object thereof is to provide an information processing device capable of allowing a driver to grasp an evaluation result of a deceleration operation during driving of a vehicle.

Means for Solving the Problems

[0006] [[ID=4⑤]] The information processing device according to the first embodiment includes an acquisition unit that acquires vehicle speed, accelerator opening, longitudinal acceleration, and brake hydraulic pressure or stop lamp signals from a vehicle, and an extraction unit that extracts driving scenes during a period in which the vehicle speed, accelerator opening, and brake hydraulic pressure or stop lamp signals acquired by the acquisition unit satisfy predetermined extraction conditions. The camera crew, who film the driver, At least one of the vehicle speed and longitudinal acceleration in the driving scene extracted by the extraction unit The captured image taken by the imaging unit when the vehicle speed, accelerator opening, longitudinal acceleration, and brake hydraulic pressure or stop lamp signal are detected, The system includes an evaluation unit that evaluates the deceleration operation of the vehicle driver based on the evaluation, and a control unit that controls the evaluation of the deceleration operation by the evaluation unit to be notified from a notification unit while the vehicle is in operation.

[0007] According to the first embodiment, vehicle speed, accelerator opening, longitudinal acceleration, and brake hydraulic pressure or stop lamp signal are acquired from the vehicle by the acquisition unit.

[0008] The extraction unit extracts driving scenes during periods when the vehicle speed, accelerator opening, and brake hydraulic pressure or stop lamp signal acquired by the acquisition unit meet predetermined extraction conditions. In the filming department, the driver is filmed.

[0009] The evaluation unit uses at least one of the vehicle speed and longitudinal acceleration in the driving scene extracted by the extraction unit. The captured image taken by the imaging unit when the vehicle speed, accelerator opening, longitudinal acceleration, and brake hydraulic pressure or stop lamp signal are detected, Based on this, the vehicle driver's deceleration maneuvers are evaluated.

[0010] The control unit then controls the system to notify the driver of the evaluation of the deceleration operation performed by the evaluation unit from the notification unit while the vehicle is in operation. As a result, the driver is notified of the evaluation of their deceleration operation while the vehicle is in operation, allowing the driver to be aware of the evaluation of their deceleration operation while the vehicle is running.

[0011] The information processing device according to the second embodiment is an information processing device according to the first embodiment in which the control unit notifies the driver's driving evaluation, including the evaluation of the deceleration operation, from the notification unit at predetermined notification timings, and when the evaluation unit has performed the evaluation of the deceleration operation, the notification unit notifies the evaluation of the deceleration operation at the next notification timing.

[0012] According to the second embodiment, the driver can be made aware of the evaluation of the deceleration operation at an early stage while the vehicle is in operation.

[0013] The information processing device according to the third embodiment is an information processing device according to the first or second embodiment, in which the evaluation unit excludes the driving scene extracted by the extraction unit from the driving scene extracted by the extraction unit if the driving scene extracted by the extraction unit satisfies predetermined exclusion conditions for longitudinal acceleration.

[0014] According to the third embodiment, driving scenes that do not need to be evaluated can be excluded, thereby improving the accuracy of the evaluation of deceleration operations.

[0015] The information processing device according to the fourth embodiment is an information processing device according to any one of the first to third embodiments, in which the evaluation unit integrates the driving scenes extracted by the extraction unit and evaluates the deceleration operation if there are similar driving scenes before and after a predetermined time interval of the driving scene extracted by the extraction unit.

[0016] According to the fourth embodiment, it is possible to suppress the notification of similar deceleration operations being reported consecutively from the notification unit in a short period of time.

[0017] The information processing device according to the fifth embodiment is an information processing device according to any one of the first to fourth embodiments, wherein the evaluation unit evaluates the deceleration operation while the vehicle is in motion using the first evaluation criterion among the multiple evaluation criteria for the deceleration operation, and evaluates the deceleration operation when the vehicle is stopped using the second evaluation criterion.

[0018] According to the fifth embodiment, the driver can be made aware of the evaluation of deceleration operations while driving the vehicle or deceleration operations when stopping the vehicle. [Effects of the Invention]

[0019] As described above, the present invention provides an information processing device that allows the driver to understand the evaluation results of deceleration operations while driving a vehicle.

Brief Description of the Drawings

[0020] [Figure 1] It is a diagram showing the schematic configuration of the operation diagnosis device according to the present embodiment. [Figure 2] It is a diagram showing an example of a display unit and an arrangement example of the display unit. [Figure 3] It is a block diagram showing the configuration of the diagnosis control unit of the operation diagnosis device according to the present embodiment. [Figure 4] It is a functional block diagram showing the functional configuration of the diagnosis control unit of the operation diagnosis device according to the present embodiment. [Figure 5] It is a diagram for explaining the conventional operation diagnosis and the operation diagnosis of the present embodiment. [Figure 6] It is a flowchart showing an example of the flow of processing performed by the diagnosis control unit of the operation diagnosis device according to the present embodiment.

Modes for Carrying Out the Invention

[0025] The vehicle information detection unit 22 detects vehicle information related to the vehicle 12. In this embodiment, vehicle speed, accelerator opening, longitudinal acceleration, brake hydraulic pressure, or stop lamp signal are acquired as examples of vehicle information, but other vehicle information may also be detected. For example, vehicle information such as steering angle, yaw rate, vehicle 12 position information, distance to obstacles around the vehicle, and route may be detected. Specifically, the vehicle information detection unit 22 can be fitted with multiple types of sensors and devices that acquire information representing the conditions of the environment surrounding the vehicle 12. Examples of sensors and devices include sensors mounted on the vehicle 12 such as a vehicle speed sensor, accelerator opening sensor, steering angle sensor, yaw rate sensor, and acceleration sensor, as well as switches or sensors that detect direction indicator signals, stop lamp signals, brake hydraulic pressure, etc., GNSS (Global Navigation Satellite System) devices, in-vehicle communication devices, navigation systems, and radar devices. The GNSS device receives GNSS signals including time information from multiple GNSS satellites to determine the position of the vehicle 12. The accuracy of positioning improves as the number of receivable GNSS signals increases. The in-vehicle communication device is a communication device that performs at least one of vehicle-to-vehicle communication with other vehicles 12 and vehicle-to-infrastructure communication with roadside units via a communication unit 26. The navigation system includes a map information storage unit that stores map information and performs processing to display the position of the vehicle 12 on a map and to guide the vehicle to a destination based on position information obtained from the GNSS device and map information stored in the map information storage unit. The radar device includes multiple radars with different detection ranges that detect objects such as pedestrians and other vehicles 12 that are present around the vehicle 12 and acquire the relative position and relative speed of the detected objects and the vehicle 12. The radar device also incorporates a processing unit that processes the detection results of surrounding objects. Based on changes in the relative position and relative speed of individual objects included in the most recent multiple detection results, the processing unit excludes noise and roadside objects such as guardrails from the monitoring targets and tracks and monitors pedestrians and other vehicles 12 as monitored objects. The radar device then outputs information such as the relative position and relative speed of each monitored object.

[0026] In this embodiment, the imaging unit 24 is mounted inside the vehicle and captures images of the driver, generating image data representing the captured video. The imaging unit 24 may also employ an infrared sensor that detects characteristic features of the driver, such as their eyes and face, using infrared light. The imaging unit 24 may also capture images of at least one area around the vehicle 12, including the front, side, and rear. Furthermore, in this embodiment, the imaging unit 24 may be omitted.

[0027] The communication unit 26 establishes communication with the server 14 via the communication network 16 and transmits and receives various types of information, such as image information obtained by the imaging unit 24 and vehicle information detected by the vehicle information detection unit 22.

[0028] The display unit 28 provides various information to the occupants by displaying information. In this embodiment, the results of the driving diagnosis are notified by displaying the results, and the results of the driving diagnosis are also notified by voice output. For example, as shown in Figure 2, the display unit 28 can be a multimedia display 32 located in the center of the instrument panel 30, or a meter display 36 located on the instrument panel 30 opposite the steering wheel 34. Figure 2 shows an example of the display unit 28 and an example of its arrangement.

[0029] As shown in Figure 3, the diagnostic control unit 20 is composed of a general-purpose microcomputer including a CPU (Central Processing Unit) 20A, ROM (Read Only Memory) 20B, RAM (Random Access Memory) 20C, storage 20D, interface (I / F) 20E, and bus 20F. Figure 3 is a block diagram showing the configuration of the diagnostic control unit 20 of the driving diagnostic device 10 according to this embodiment.

[0030] Furthermore, the diagnostic control unit 20 evaluates the driver's deceleration operation based on the vehicle information detected by the vehicle information detection unit 22 and the captured images taken by the imaging unit 24 when the vehicle information is detected, by having the CPU 20A execute a program stored in the ROM 20B.

[0031] Specifically, the diagnostic control unit 20 has the functions of an acquisition unit 40, an extraction unit 42, an evaluation unit 44, and a control unit 46, as shown in Figure 4, by having the CPU 20A execute a program stored in the ROM 20B. Figure 4 is a functional block diagram showing the functional configuration of the diagnostic control unit 20 of the driving diagnostic device 10 according to this embodiment.

[0032] The acquisition unit 40 acquires vehicle information detected by the vehicle information detection unit 22. In this embodiment, the acquisition unit 40 acquires vehicle speed, accelerator pedal position, longitudinal acceleration, and brake hydraulic pressure or stop lamp signal.

[0033] The extraction unit 42 extracts driving scenes during periods when the vehicle speed, accelerator opening, and brake hydraulic pressure or stop lamp signal acquired by the acquisition unit 40 meet predetermined extraction conditions. In this embodiment, although the details will be described later, driving scenes of the driver's deceleration operations are extracted.

[0034] The evaluation unit 44 evaluates the vehicle driver's deceleration operation based on the vehicle speed and longitudinal acceleration in the driving scene extracted by the extraction unit 42. For example, the evaluation unit 44 calculates predetermined key performance indicators (KPIs) and diagnoses the deceleration operation based on the calculated KPIs. Since vehicle speed can be calculated from longitudinal acceleration, and longitudinal acceleration can be calculated from vehicle speed, the evaluation unit 44 may evaluate the vehicle driver's deceleration operation based on at least one of the vehicle speed and longitudinal acceleration in the driving scene extracted by the extraction unit 42. Further details of the KPIs will be described later.

[0035] The control unit 46 controls the display unit 28 to notify the vehicle 12 of the evaluation of the deceleration operation by the evaluation unit 44 while the vehicle 12 is in operation. For example, it controls the display unit 28 to display the evaluation result of the deceleration operation and also notifies the evaluation result by voice.

[0036] Next, we will explain the details of the driving diagnostics used to evaluate the driver's deceleration operations mentioned above, using specific examples.

[0037] As signals necessary for diagnosing the deceleration operation, the acquisition unit 40 acquires vehicle speed, longitudinal acceleration, accelerator pedal position, brake hydraulic pressure or stop lamp signal, and GPS timestamp.

[0038] The extraction unit 42 extracts driving scenes of deceleration operations, for example, using the following conditions to start a driving scene: vehicle speed is greater than 0.5 km / h, accelerator opening is less than 5%, brake hydraulic pressure is 0.03 MPa, or the stop lamp signal is on. Conversely, the release of the start conditions is used as the end condition for extracting driving scenes.

[0039] The evaluation unit 44 then calculates the minimum longitudinal acceleration, minimum vehicle speed, and the difference between the maximum and minimum vehicle speeds as the KPI calculations described above, and evaluates the driver's deceleration operation based on the calculation results. For example, it determines a score for the driver's deceleration operation based on the calculated KPIs, and if the score is above a predetermined score, it is considered a good operation, and if the score is below a predetermined score, it is considered a bad operation.

[0040] In this embodiment, multiple evaluation criteria for deceleration operations are provided. The evaluation unit 44 uses the first evaluation criterion to evaluate the deceleration operation while the vehicle 12 is in motion, and uses the second evaluation criterion to evaluate the deceleration operation when the vehicle 12 is stopped.

[0041] Specifically, as an example of the first evaluation criterion, if the vehicle is stopping or decelerating, and the difference between the maximum and minimum vehicle speeds is greater than 10 [km / h], then the minimum vehicle speed must be less than 0.5 [km / h] and the minimum longitudinal acceleration must be -1.2 [m / s]. 2 If the value is greater than 10, the score is 100. Also, when stopping and decelerating, and the difference between the maximum and minimum vehicle speeds is greater than 10 [km / h], the minimum vehicle speed is less than 0.5 [km / h] and the minimum longitudinal acceleration is -3 [m / s]. 2 The following cases will be evaluated as 1 point, and all other cases will be evaluated as 50 points.

[0042] Furthermore, as an example of the second evaluation criterion, if there is intermediate deceleration and the difference between the maximum and minimum vehicle speeds is greater than 10 [km / h], then the minimum vehicle speed must be 0.5 [km / h] or higher, and the minimum longitudinal acceleration must be -3 [m / s]. 2 The following cases will be awarded 1 point, all other cases 50 points, and there will be no 100-point adjustments.

[0043] Furthermore, when the difference between the maximum and minimum vehicle speed is 10 km / h or less, the minimum longitudinal acceleration is -3 m / s². 2 The following cases will be evaluated as 1 point, all other cases as 50 points, and there will be no 100-point evaluation.

[0044] Here, when evaluating the deceleration operation, the evaluation unit 44 considers the average deceleration to be 0.5 [m / s] as an example of an exclusion condition. 2 If the value is less than [ ], it will not be considered a deceleration operation and will be excluded. This allows us to exclude driving scenes that do not need to be evaluated, thereby improving the accuracy of the deceleration operation evaluation.

[0045] Furthermore, the evaluation unit 44 considers if there is another intermediate deceleration within 3 seconds before or after an intermediate deceleration, and if there is another stopping deceleration within 3 seconds after an intermediate deceleration, as a single operation and integrates the driving scenes for evaluation. In other words, if there are similar driving scenes within a predetermined time frame before or after the driving scene extracted by the extraction unit 42, the evaluation unit 44 integrates these driving scenes and evaluates the deceleration operation. This prevents the display unit 28 from continuously notifying evaluations of similar deceleration operations in a short period of time.

[0046] Incidentally, in conventional driving diagnostics, as shown in the upper part of Figure 5, driving diagnostics were performed and reports were created at predetermined intervals, such as 10 minutes. Therefore, when a safety check was actually insufficient, feedback could not be given to the driver, and even if feedback was given, the driver may not remember or may not understand what went wrong.

[0047] Therefore, the driving diagnostic device 10 according to this embodiment performs driving diagnostics in real time and provides feedback to the driver.

[0048] To perform real-time diagnosis, as shown in the lower part of Figure 5, the driving diagnosis is performed by overlapping data from a predetermined time period, such as the past 10 seconds, with a delay of a predetermined time, such as 1 second. In other words, every predetermined first hour (for example, 1 second), the diagnostic control unit 20 extracts driving scenes of lane changes and right / left turns from captured images and vehicle information for a predetermined diagnostic time period longer than the first hour (for example, 10 seconds), and performs a driving diagnosis regarding safety checks. Note that since the diagnosis may be performed twice due to overlapping, the earlier diagnosis result is output first in case of overlapping results.

[0049] Next, we will describe the specific processes performed by the operation diagnostic device 10 according to this embodiment, which is configured as described above. Figure 6 is a flowchart showing an example of the flow of processes performed by the diagnostic control unit 20 of the operation diagnostic device 10 according to this embodiment. Note that the processes in Figure 6 start, for example, every 1 [sec] as the first time period.

[0050] In step 100, the CPU 20A acquires vehicle information and proceeds to step 102. That is, the acquisition unit 40 acquires the vehicle information detected by the vehicle information detection unit 22. In this embodiment, the acquisition unit 40 acquires vehicle speed, accelerator opening, longitudinal acceleration, and brake hydraulic pressure or stop lamp signal.

[0051] In step 102, the CPU 20A extracts driving scenes and proceeds to step 104. Specifically, the extraction unit 42 extracts driving scenes for a period in which the vehicle speed, accelerator opening, and brake hydraulic pressure or stop lamp signal acquired by the acquisition unit 40 satisfy predetermined extraction conditions.

[0052] In step 104, the CPU 20A performs KPI calculations and proceeds to step 106. Specifically, the evaluation unit 44 calculates, for example, the minimum longitudinal acceleration, minimum vehicle speed, and the difference between the maximum and minimum vehicle speeds as KPIs.

[0053] In step 106, the CPU 20A evaluates the deceleration operation and proceeds to step 108. That is, the evaluation unit 44 evaluates whether the deceleration operation is a good operation or a bad operation based on the calculated KPI. For example, it determines a score for the driver's deceleration operation based on the calculated KPI, and if the score is above a predetermined score, it is considered a good operation, and if the score is below the predetermined score, it is considered a bad operation.

[0054] In step 108, the CPU 20A determines whether the evaluation result of the deceleration operation is a good operation or not. If the determination is affirmative, the process proceeds to step 110; if the evaluation result is a bad operation and the determination is denied, the process proceeds to step 112.

[0055] In step 110, the CPU 20A notifies the driver of a good operation and terminates the series of processes. That is, the control unit 46 controls the vehicle 12 to notify the driver of the deceleration operation diagnosis result by displaying on the display unit 28 that the deceleration operation was a good operation as evaluated by the evaluation unit 44. For example, at least one of a message and an icon image representing a good operation is displayed on the display unit 28, and an audio output is also output.

[0056] On the other hand, in step 112, the CPU 20A notifies the driver of a bad operation and terminates the series of processes. That is, the control unit 46 controls the system to notify the driver of the diagnosis result of the deceleration operation by displaying on the display unit 28 that the deceleration operation was a bad operation according to the evaluation of the evaluation unit 44 while the vehicle 12 is in operation. For example, at least one of a message and an icon image representing a bad operation is displayed on the display unit 28, and an audio output is also output.

[0057] By performing this process, the evaluation of the deceleration operation is notified during driving, making it possible to inform the driver of the evaluation results of the deceleration operation while the vehicle is in motion.

[0058] Furthermore, by performing driving diagnostics with predetermined time intervals and accumulating data for predetermined time periods, it is possible to evaluate the driver's deceleration operations in real time and inform the driver.

[0059] In the above embodiment, the driver's deceleration operation is used for driving diagnosis, but the driving scenes are not limited to these. For example, safety checks and driving diagnosis of accelerator operation may be performed for each driving scene, such as when reversing, stopping, turning left or right, and changing lanes. Also, when driving diagnosis is performed for multiple driving scenes, driving evaluations may be performed at the same time. In this case, the control unit 46 may notify the driver's driving evaluation, including the evaluation of deceleration operation, from the display unit 28 at predetermined intervals, and if the evaluation unit 44 has evaluated the deceleration operation, it may be controlled to notify the evaluation of the deceleration operation from the display unit 28 at the next notification timing. For example, if the driving evaluation includes both a driving evaluation of deceleration operation and a driving evaluation of accelerator operation within a certain diagnosis time (e.g., 10 [sec]), the driving evaluation that takes priority according to a predetermined priority (e.g., the driving evaluation of deceleration operation) is notified at the notification timing when the diagnosis time has elapsed. This allows the driver to grasp the driving evaluation, such as deceleration operation, at an early stage while driving the vehicle.

[0060] Furthermore, although the above embodiment describes an example in which driving diagnostics are performed using a driving diagnostic device 10 mounted on the vehicle 12, it is not limited to this. For example, the in-vehicle device may be made able to communicate with an information processing terminal such as a smartphone, and the functions of the diagnostic control unit 20 may be provided on the information processing terminal. Alternatively, vehicle information and captured images may be sent to the server 14 to perform driving diagnostics, and the diagnostic results may be sent to the diagnostic control unit 20 and displayed on the display unit 28.

[0061] Furthermore, although the processing performed by the diagnostic control unit 20 in each of the above embodiments has been described as software processing performed by executing a program, it is not limited to this. For example, it may be processing performed by hardware such as a GPU (Graphics Processing Unit), ASIC (Application Specific Integrated Circuit), and FPGA (Field-Programmable Gate Array). Alternatively, it may be processing that combines both software and hardware. In the case of software processing, the program may be stored on various storage media and distributed.

[0062] Furthermore, the present invention is not limited to the above, and it is of course possible to implement it in various modified forms without departing from its spirit. [Explanation of symbols]

[0063] 10. Operational diagnostic device (information processing device) 12 vehicles 20 Diagnostic Control Unit 22 Vehicle Information Detection Unit 24 Photography Department 28 Display Unit (Notification Unit) 32-inch multimedia displays 36 Meter Display 40 Acquisition Department 42 Extraction part 44 Evaluation Department 46 Control Unit

Claims

1. An acquisition unit that acquires vehicle speed, accelerator opening, longitudinal acceleration, and brake hydraulic pressure or stop lamp signals from the vehicle, An extraction unit extracts driving scenes during a period in which the vehicle speed, accelerator opening, and brake hydraulic pressure or stop lamp signal acquired by the acquisition unit satisfy predetermined extraction conditions. The camera crew, who film the driver, An evaluation unit evaluates the deceleration operation of the vehicle driver based on at least one of the vehicle speed and longitudinal acceleration in the driving scene extracted by the extraction unit, and the captured image taken by the imaging unit when the vehicle speed, accelerator opening, longitudinal acceleration, and brake hydraulic pressure or stop lamp signal are detected. A control unit that controls the evaluation of the deceleration operation by the evaluation unit to be notified from the notification unit while the vehicle is in operation, Equipped with an information processing device.

2. The information processing apparatus according to claim 1, wherein the control unit provides a notification from the notification unit at predetermined intervals to provide an evaluation of the driver's operation, including an evaluation of the deceleration operation, and when the evaluation unit has performed an evaluation of the deceleration operation, the notification unit provides a notification of the evaluation of the deceleration operation at the next notification timing.

3. The information processing apparatus according to claim 1, wherein the evaluation unit excludes the driving scene extracted by the extraction unit from the driving scene extracted by the extraction unit if the driving scene satisfies predetermined exclusion conditions for longitudinal acceleration.

4. The information processing apparatus according to claim 1, wherein the evaluation unit, if there are similar driving scenes before and after a predetermined time interval of the driving scene extracted by the extraction unit, integrates these driving scenes to evaluate the deceleration operation.

5. The information processing device according to claim 1, wherein the evaluation unit evaluates the deceleration operation while the vehicle is in motion using a first evaluation criterion from among a plurality of evaluation criteria for the deceleration operation, and evaluates the deceleration operation when the vehicle is stopped using a second evaluation criterion.

Images