Information processing device

The information processing device addresses the lack of real-time driving safety feedback by acquiring and evaluating vehicle data and driver images to provide continuous, on-board safety confirmation evaluations.

JP2024166997AActive Publication Date: 2024-11-29TOYOTA JIDOSHA KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023083492
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-19
Publication Date
2024-11-29
Estimated Expiration
2043-05-19

AI Technical Summary

Technical Problem

Existing systems fail to provide drivers with a comprehensive understanding of their driving safety during vehicle operation, as simple post-driving diagnosis does not effectively convey the quality of their driving.

Method used

An information processing device that acquires vehicle speed, steering angle, yaw rate, and driver images, extracts relevant driving scenes, evaluates safety confirmation based on these parameters, and provides real-time feedback through notifications during driving.

Benefits of technology

Enables drivers to grasp their safety confirmation evaluation in real-time, improving understanding and awareness of their driving safety through continuous, on-board evaluation and feedback.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024166997000001_ABST
    Figure 2024166997000001_ABST
Patent Text Reader

Abstract

To provide an information processing device capable of allowing a driver to be informed of an evaluation result of safety confirmation conducted by the driver while the same drives a vehicle.SOLUTION: An acquisition section 40 acquires a vehicle speed, a steering angle, a yaw rate, a direction indication signal, and an imaging result of an imaging section 24. An extraction section 42 extracts an operation scene during a period when the vehicle speed, the steering angle, the yaw rate and the direction indication signal meet predetermined extraction conditions. An evaluation section 44 evaluates safety confirmation conducted by a driver a predetermined period before and after a commencement time of the operation scene extracted by the extraction section 42 on the basis of a captured image acquired by the acquisition section 40. A control section 46 controls in a manner that causes a display section 28 to notify the driver of an evaluation result of the safety confirmation by the evaluation section 44 while the driver drives a vehicle 12.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device that diagnoses the driving of a driver who drives a vehicle. [Background technology]

[0002] Patent Document 1 discloses a technology that can provide diagnostic results according to the driver's driving skills and can effectively use the diagnostic results. In detail, Patent Document 1 discloses a driving skill diagnostic device that determines the proficiency of the driver's driving skills, and increases the number of diagnostic items for which diagnostic results are displayed as the proficiency of the driver's driving skills increases, and when increasing the number of diagnostic items for which diagnostic results are displayed, for example, adds diagnostic items that have not been displayed in order of poor diagnostic results, or adds diagnostic items that have not been displayed in order of high relevance to the diagnostic items that have been provided. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-031050 A Summary of the Invention [Problem to be solved by the invention]

[0004] Simply presenting the driver with the driving diagnosis results after driving does not allow the driver to fully understand whether his or her driving was good or bad.

[0005] The present invention has been made in consideration of the above circumstances, and has an object to provide an information processing device that allows a driver to grasp the evaluation result of a safety check while driving a vehicle. [Means for solving the problem]

[0006] The information processing device of the first aspect includes an acquisition unit that acquires vehicle speed, steering angle, yaw rate, and captured images of the driver of the vehicle from a vehicle, an extraction unit that extracts driving scenes during a period in which the vehicle speed, steering angle, and yaw rate acquired by the acquisition unit satisfy predetermined extraction conditions, an evaluation unit that evaluates the driver's safety confirmation based on the captured images acquired by the acquisition unit a predetermined time before and after the start of the driving scene extracted by the extraction unit, and a control unit that controls an alarm unit to notify the evaluation of the safety confirmation by the evaluation unit while the vehicle is being driven.

[0007] According to the first aspect, the acquisition unit acquires the vehicle speed, the steering angle, the yaw rate, and a captured image of the driver of the vehicle from the vehicle.

[0008] The extraction unit extracts driving scenes during a period in which the vehicle speed, the steering angle, and the yaw rate acquired by the acquisition unit satisfy a predetermined extraction condition.

[0009] The evaluation unit evaluates the driver's safety confirmation based on the captured images acquired by the acquisition unit at a predetermined time before and after the start of the driving scene extracted by the extraction unit.

[0010] The control unit controls the notification unit to notify the driver of the evaluation of the safety confirmation performed by the evaluation unit while the vehicle is being driven, thereby allowing the driver to know the evaluation result of the safety confirmation while the vehicle is being driven.

[0011] In the information processing device of the second aspect, in the information processing device of the first aspect, the control unit controls the notification unit to notify the driver's driving evaluation, including the evaluation of the safety check, at a notification timing at a predetermined interval, and when the evaluation unit has evaluated the safety check, controls the notification unit to notify the evaluation of the safety check at the next notification timing.

[0012] According to the second aspect, the driver can be made to understand the evaluation of the safety confirmation at an early stage while driving the vehicle.

[0013] An information processing device according to a third aspect is an information processing device according to the first or second aspect, wherein the evaluation unit detects driver behavior based on the captured image, including at least one of whether or not the driver checks the rearview mirror of the vehicle, whether or not the driver checks the right side mirror of the vehicle, whether or not the driver checks the left side mirror of the vehicle, and whether or not the driver turns his head, and evaluates the driver's safety confirmation from the detected behavior.

[0014] According to the third aspect, the safety confirmation can be evaluated based on the safety confirmation action of the driver.

[0015] An information processing device according to a fourth aspect is an information processing device according to any one of the first to third aspects, wherein the acquisition unit further acquires a turn indication signal from the vehicle, and the extraction unit extracts the driving scene in which the vehicle speed, the steering angle, the yaw rate, and the turn indication signal acquired by the acquisition unit satisfy the extraction condition.

[0016] According to the fourth aspect, driving scenes to be evaluated for safety confirmation can be carefully selected.

[0017] An information processing device according to a fifth aspect is an information processing device according to any one of the first to fourth aspects, wherein, when the driver's behavior detected from the captured image acquired by the acquisition unit includes predetermined error information, the evaluation unit prohibits evaluation of the driver's safety confirmation around the predetermined time before and after the start of the driving scene that is the subject of the error information.

[0018] According to the fifth aspect, the evaluation accuracy of safety confirmation can be improved. Effect of the Invention

[0019] As described above, according to the present invention, it is possible to provide an information processing device that allows a driver to know the evaluation result of a safety check while driving a vehicle. [Brief description of the drawings]

[0020] [Figure 1] 1 is a diagram showing a schematic configuration of a driving diagnosis device according to an embodiment of the present invention; [Diagram 2] 3A and 3B are diagrams illustrating an example of a display unit and an example of the arrangement of the display unit. [Diagram 3] 2 is a block diagram showing a configuration of a diagnosis control unit of the driving diagnosis device according to the present embodiment. FIG. [Figure 4] 2 is a functional block diagram showing a functional configuration of a diagnosis control unit of the driving diagnosis device according to the present embodiment. FIG. [Diagram 5] 1 is a diagram for explaining a conventional driving diagnosis and a driving diagnosis according to an embodiment of the present invention; [Figure 6] 5 is a flowchart showing an example of a flow of processing performed by a diagnosis control unit of the driving diagnosis device according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] An example of an embodiment of the present invention will be described in detail below with reference to the drawings. Fig. 1 is a diagram showing a schematic configuration of a driving diagnosis device according to this embodiment. In this embodiment, a driving diagnosis device that is mounted on a vehicle 12 and evaluates the driver's safety confirmation will be described as an example of an information processing device.

[0022] A driving diagnosis device 10 according to this embodiment is mounted on a vehicle 12 and performs driving diagnosis on a driver who drives the vehicle 12. In this embodiment, an example of performing driving diagnosis to evaluate safety checks for lane changes and right and left turns will be described, but driving diagnosis to evaluate other safety checks and driving operations such as stopping temporarily and reversing may also be performed.

[0023] The driving diagnosis device 10 can be connected to a server 14, such as a cloud server, via a communication network 16. The diagnosis results of the driving diagnosis device 10 can be transmitted to the server 14, and the server 14 can manage the driving diagnosis results of each vehicle 12 and create driving diagnosis reports, etc.

[0024] The driving diagnosis device 10 includes a diagnosis control unit 20, a vehicle information detection unit 22, an imaging unit 24, a communication unit 26, and a display unit 28 as an example of a notification unit.

[0025] The vehicle information detection unit 22 detects vehicle information related to the vehicle 12. In this embodiment, the vehicle speed, steering angle, yaw rate, and turn signal are acquired as examples of vehicle information, but other vehicle information may also be detected. For example, the vehicle information detection unit 22 may detect vehicle information such as accelerator opening, position information of the vehicle 12, acceleration, distance to obstacles around the vehicle, and route. Specifically, the vehicle information detection unit 22 can apply a plurality of types of sensors and devices that acquire information indicating the state of the surrounding environment of the vehicle 12. Examples of sensors and devices include sensors mounted on the vehicle 12 such as a vehicle speed sensor, an accelerator opening sensor, a steering angle sensor, a yaw rate sensor, and an acceleration sensor, switches or sensors that detect turn signals, stop lamp signals, brake oil pressure, etc., a GNSS (Global Navigation Satellite System) device, an in-vehicle communication device, a navigation system, and a radar device. The GNSS device receives GNSS signals including time information from a plurality of GNSS satellites to determine the position of the vehicle 12. The positioning accuracy of the GNSS device improves as the number of GNSS signals that the GNSS device can receive increases. The in-vehicle communication device is a communication device that performs at least one of vehicle-to-vehicle communication with other vehicles 12 and road-to-vehicle communication with roadside devices via the communication unit 26. The navigation system includes a map information storage unit that stores map information, and performs a process of displaying the position of the vehicle 12 on a map and a process of guiding a route to a destination based on the position information obtained from the GNSS device and the map information stored in the map information storage unit. The radar device includes multiple radars with different detection ranges, detects objects such as pedestrians and other vehicles 12 that exist around the vehicle 12, and obtains the relative position and relative speed of the detected objects and the vehicle 12. The radar device also has a built-in processing device that processes the detection results of surrounding objects. The processing device excludes noise, roadside objects such as guardrails, etc. from monitoring targets based on changes in relative position and relative speed with respect to each object included in the most recent multiple detection results, and tracks and monitors pedestrians, other vehicles 12, etc. as monitoring targets. The radar device then outputs information such as the relative position and relative speed with respect to each monitoring target object.

[0026] In this embodiment, the image capturing unit 24 is mounted in the vehicle cabin, captures an image of the driver, and generates image data representing the captured image of the moving image. The image capturing unit 24 may be an infrared sensor that detects characteristic parts of the driver, such as the eyes and face, by infrared rays. The image capturing unit 24 may further capture an image of at least one of the surroundings of the vehicle 12 in front, on one side, and behind.

[0027] The communication unit 26 establishes communication with the server 14 via the communication network 16 and transmits and receives various information such as image information obtained by the image capture unit 24 and vehicle information detected by the vehicle information detection unit 22 .

[0028] The display unit 28 provides various information to the occupants by displaying information. In this embodiment, the driving diagnosis result is notified by displaying the driving diagnosis result and the like, and the driving diagnosis result is notified by audio output. For example, as shown in FIG. 2, the display unit 28 can be a multimedia display 32 disposed in the center of the instrument panel 30, or a meter display 36 disposed at a position facing the steering wheel 34 of the instrument panel 30. FIG. 2 is a diagram showing an example of the display unit 28 and an example of the arrangement of the display unit 28.

[0029] As shown in Fig. 3, the diagnosis control unit 20 is configured by a general microcomputer including a CPU (Central Processing Unit) 20A, a ROM (Read Only Memory) 20B, a RAM (Random Access Memory) 20C, a storage 20D, an interface (I / F) 20E, and a bus 20F, etc. Fig. 3 is a block diagram showing the configuration of the diagnosis control unit 20 of the driving diagnosis device 10 according to this embodiment.

[0030] In addition, the diagnosis control unit 20 performs a driving diagnosis to evaluate the safety confirmation by the driver in at least one of driving scenes when changing lanes and turning right or left, based on the vehicle information detected by the vehicle information detection unit 22 and the captured image captured by the capture unit 24 when the vehicle information is detected, by having the CPU 20A execute a program stored in the ROM 20B.

[0031] Specifically, the diagnosis control unit 20 has the functions of an acquisition unit 40, an extraction unit 42, an evaluation unit 44, and a control unit 46 as shown in Fig. 4, when the CPU 20A executes a program stored in the ROM 20B. Fig. 4 is a functional block diagram showing the functional configuration of the diagnosis control unit 20 of the driving diagnosis device 10 according to this embodiment.

[0032] The acquisition unit 40 acquires the vehicle information detected by the vehicle information detection unit 22 and the captured images captured by the imaging unit 24. In this embodiment, the acquisition unit 40 acquires the vehicle speed, the steering angle, the yaw rate, the turn signal, and the imaging results of the imaging unit 24.

[0033] The extraction unit 42 extracts driving scenes during a period in which the vehicle speed, steering angle, yaw rate, and turn signal acquired by the acquisition unit 40 satisfy a predetermined extraction condition. In this embodiment, although details will be described later, in order to evaluate safety confirmation during lane changing, a driving scene of lane changing is extracted, and in order to evaluate safety confirmation during right or left turning, a driving scene of right or left turning is extracted.

[0034] The evaluation unit 44 evaluates the driver's safety confirmation based on the captured images acquired by the acquisition unit 40 at a predetermined time before and after the start of the driving scene extracted by the extraction unit 42. For example, the evaluation unit 44 detects the driver's behavior including at least one of the following based on the captured images: whether or not the driver checks the rearview mirror of the vehicle 12, whether or not the driver checks the right side mirror of the vehicle 12, whether or not the driver checks the left side mirror of the vehicle 12, and whether or not the driver turns his head, and evaluates the driver's safety confirmation from the detected behavior. This makes it possible to evaluate the safety confirmation based on the driver's safety confirmation behavior.

[0035] The control unit 46 controls the display unit 28 to report the evaluation of the safety confirmation made by the evaluation unit 44 while the vehicle 12 is being driven. For example, the control unit 46 controls the display unit 28 to display the evaluation result of the safety confirmation when changing lanes or turning right or left, and also reports the evaluation result by voice.

[0036] Next, the details of the driving diagnosis for safety confirmation when changing lanes and the driving diagnosis for safety confirmation when turning right or left will be described with specific examples.

[0037] First, a method for extracting driving scenes and a method for evaluating safe driving will be described with regard to driving diagnosis for safety confirmation when changing lanes.

[0038] The acquisition unit 40 acquires vehicle speed, turn signal, steering angle, yaw rate, GPS timestamp, and captured images by the image capture unit 24 as signals necessary for driving diagnosis of safety confirmation when changing lanes. Note that the turn signal may be omitted, although this will decrease the accuracy of extracting driving scenes, which will be described later. The presence of the turn signal makes it possible to carefully select driving scenes to be evaluated for safety confirmation.

[0039] The extraction unit 42 extracts a driving scene of a lane change, for example, when the yaw rate is 0.7 [deg / sec] or more or when the yaw rate is -0.7 [deg / sec] or less, as a start condition of the driving scene. On the other hand, a predetermined time (for example, 5 seconds) after the start point is set as an end condition of the driving scene. The yaw rate is subjected to LPF (Low Pass Filter) processing of 1.0 [kHz].

[0040] In addition, a driving scene involving lane changing is extracted based on the driving scene extraction conditions that the average vehicle speed in the scene is a predetermined vehicle speed (for example, 20 [km / h] or more, the turn signal is on, the minimum steering angle is -120 [deg] or more or 120 [deg] or less, the minimum yaw angle is -40 [deg] or less or the maximum yaw angle is 40 [deg] or more, and the minimum yaw angle is -100 [deg] or more or the maximum yaw angle is 100 [deg] or less.

[0041] Then, the evaluation unit 44 detects from the captured image whether the driver checks the rearview mirror, the driver's side door mirror, the passenger side door mirror, and swivels their head during a period from a predetermined time (e.g., 4 seconds) before the start of the driving scene extracted by the extraction unit 42 to a predetermined time (e.g., 5 seconds) after the start, and diagnoses whether the driver performed a safety check before changing lanes. For example, the evaluation unit 44 calculates the driver's behavior such as the driver's head swivel coordinate, eye line up / down coordinate, and eye line left / right coordinate from the captured image, and diagnoses whether the driver performed a safety check operation such as checking the rearview mirror, the driver's side door mirror, the passenger side door mirror, and swivels their head.

[0042] If none of these safety check actions before changing lanes are performed, the driving scene is extracted. Note that if the driver's behavior is an error signal containing predetermined error information (such as undetectable), diagnosis is prohibited because it will result in a false diagnosis.

[0043] Next, a method for extracting driving scenes and a method for evaluating safety confirmation when turning right or left will be described with reference to the driving diagnosis for safety confirmation when turning right or left.

[0044] The acquisition unit 40 acquires vehicle speed, turn signal, steering angle, yaw rate, GPS time stamp, and images captured by the image capture unit 24 as signals necessary for driving diagnosis to check safety when turning right or left.

[0045] The extraction unit 42 extracts a driving scene of turning right or left, for example, when the yaw rate is 0.7 [deg / sec] or more or when the yaw rate is -0.7 [deg / sec] or less, as a start condition of the driving scene. On the other hand, the end condition of the driving scene is when a predetermined time (for example, 5 seconds) has passed from the start point. The yaw rate is subjected to LPF (Low Pass Filter) processing of 1.0 [kHz].

[0046] In addition, driving scenes involving right and left turns are extracted based on the following extraction conditions: the maximum yaw rate is 0.8 [deg / sec] or more, or the minimum yaw rate is -0.8 [deg / sec] or less, the maximum vehicle speed in the scene is 15 [km / h] or more, the turn signal is on, and the absolute value of the maximum steering angle is 150 [deg] or more.

[0047] Then, the evaluation unit 44 detects from the captured image whether the driver checks the rearview mirror, the driver's side door mirror, the passenger side door mirror, and swivels his / her head during a period from a predetermined time (e.g., 4 seconds) before the start of the driving scene extracted by the extraction unit 42 to a predetermined time (e.g., 5 seconds) after the start, and diagnoses whether the driver checks for safety before turning right or left. For example, the evaluation unit 44 calculates the driver's behavior such as the driver's head swivel coordinate, eye line up / down coordinate, and eye line left / right coordinate from the captured image, and diagnoses whether the driver performed safety check operations such as checking the rearview mirror, the driver's side door mirror, the passenger side door mirror, and swivels his / her head.

[0048] If none of these safety check actions are taken before turning right or left, the driving scene is extracted as an instance of insufficient safety check.

[0049] If the driver's behavior includes predetermined error information (error signal such as detection impossible), diagnosis is prohibited because it will result in an erroneous diagnosis. That is, if the captured image acquired by the acquisition unit 40 includes predetermined error information, the evaluation unit 44 prohibits the evaluation of the driver's safety confirmation around a predetermined time before and after the start of the driving scene that is the subject of the error information. This makes it possible to improve the evaluation accuracy of the safety confirmation.

[0050] In the conventional driving diagnosis, a driving diagnosis is performed at a fixed interval, such as 10 min, and a report is created, as shown in the upper part of Fig. 5. Therefore, it is not possible to provide feedback to the driver when a safety check is actually insufficient, and even if feedback is given to the driver, there are cases where the driver does not remember it or does not know what went wrong.

[0051] Therefore, the driving diagnosis device 10 according to this embodiment performs driving diagnosis in real time and provides feedback to the driver.

[0052] In order to perform a real-time diagnosis, as shown in the lower part of Fig. 5, a driving diagnosis is performed while overlapping data for a predetermined time period, such as the past 10 [sec], with a shift of a predetermined time, such as 1 [sec]. That is, the diagnosis control unit 20 extracts driving scenes of lane changes and right / left turns from captured images and vehicle information for a predetermined diagnosis time period (e.g., 10 [sec]) longer than the first time period, for each predetermined first time period (e.g., 1 [sec]), and performs a driving diagnosis for safety confirmation. Note that overlapping diagnoses may result in the same diagnosis being performed, so the earlier diagnosis result is given priority and output.

[0053] Next, a specific process performed in the driving diagnosis device 10 according to the present embodiment configured as described above will be described. Fig. 6 is a flowchart showing an example of the flow of the process performed in the diagnosis control unit 20 of the driving diagnosis device 10 according to the present embodiment. The process in Fig. 6 starts, for example, every 1 [sec] as the first time period.

[0054] In step 100, the CPU 20A acquires vehicle information and captured images, and proceeds to step 102. That is, the acquisition unit 40 acquires the vehicle information detected by the vehicle information detection unit 22 and the captured images captured by the imaging unit 24. In this embodiment, the acquisition unit 40 acquires the vehicle speed, steering angle, yaw rate, and the imaging results of the imaging unit 24.

[0055] In step 102, the CPU 20A extracts a driving scene and proceeds to step 104. That is, the extraction unit 42 extracts a driving scene during a period in which the vehicle speed, steering angle, and yaw rate acquired by the acquisition unit 40 satisfy a predetermined extraction condition. In this embodiment, when evaluating safety confirmation during lane change, a driving scene of lane change is extracted according to the above-mentioned condition. Also, when evaluating safety confirmation during right and left turns, a driving scene of right and left turns is extracted according to the above-mentioned condition.

[0056] In step 104, the CPU 20A makes a judgment on safety confirmation and proceeds to step 106. That is, the evaluation unit 44 evaluates the driver's safety confirmation based on the captured images acquired by the acquisition unit 40 at a predetermined time before and after the start of the driving scene extracted by the extraction unit 42. For example, the evaluation unit 44 detects the driver's behavior including at least one of the following based on the captured images: whether or not the driver has checked the rearview mirror of the vehicle 12, whether or not the driver has checked the right side mirror of the vehicle 12, whether or not the driver has checked the left side mirror of the vehicle 12, and whether or not the driver has turned his head, and evaluates the driver's safety confirmation from the detected behavior.

[0057] In step 106, the CPU 20A judges whether or not a safety check has been performed. If the judgment is negative, the process proceeds to step 108, and if the judgment is positive, the process proceeds to step 110.

[0058] In step 108, the CPU 20A notifies the driver that the driving was safe, and ends the series of processes. That is, the control unit 46 performs control to notify the driver of the safety confirmation diagnosis result while driving the vehicle 12 by displaying on the display unit 28 that the driving was safe as an evaluation of the safety confirmation by the evaluation unit 44 while the vehicle 12 is being driven. For example, at least one of a message and an icon image indicating safe driving is displayed on the display unit 28, and sound is output.

[0059] On the other hand, in step 110, the CPU 20A notifies the driver of insufficient safety confirmation and ends the series of processes. That is, the control unit 46 performs control to notify the driver of the safety confirmation diagnosis result by displaying on the display unit 28 a message indicating insufficient safety confirmation as the evaluation of the safety confirmation by the evaluation unit 44 while the vehicle 12 is being driven. For example, at least one of a message and an icon image indicating insufficient safety confirmation is displayed on the display unit 28, and sound is output.

[0060] By performing the processing in this manner, the evaluation of the driver's safety check is notified to the driver, so that the driver can be made aware of the evaluation result of the safety check while driving the vehicle. Furthermore, by performing driving diagnosis with a shift of a predetermined time and overlapping data for the predetermined time, it is possible to evaluate the deceleration operation of the driver in real time and notify the driver.

[0061] Furthermore, by performing driving diagnosis with a shift of a predetermined time and overlapping data for the predetermined time, it is possible to evaluate the deceleration operation of the driver in real time and notify the driver.

[0062] In the above embodiment, the driving diagnosis of safety check when turning right or left or when changing lanes is performed, but the driving scenes are not limited to these two. For example, driving diagnosis of safety check in other driving scenes such as backing up or stopping, driving diagnosis of accelerator operation, driving diagnosis of brake operation, etc. may be further performed. In addition, when driving diagnosis of a plurality of driving scenes is performed, driving evaluation may be performed at the same timing. In this case, the control unit 46 may control the display unit 28 to notify the driver's driving evaluation including the evaluation of safety check at a notification timing at every predetermined interval, and when the evaluation unit 44 evaluates the safety check, the display unit 28 may notify the evaluation of the safety check at the next notification timing. For example, when the driving evaluation is performed as the driving evaluation of the accelerator operation and the driving evaluation of the safety check when turning right or left within a certain diagnosis time (for example, 10 [sec]), the diagnosis result prioritized according to a predetermined priority (for example, the driving evaluation of the safety check when turning right or left) is notified at the notification timing after the diagnosis time has elapsed. This allows the driver to grasp driving evaluation such as safety confirmation at an early stage while driving the vehicle.

[0063] In the above embodiment, the driving diagnosis is performed by the driving diagnosis device 10 mounted on the vehicle 12, but the present invention is not limited to this. For example, an information processing terminal such as a smartphone may be capable of communicating with the vehicle-mounted device, and the function of the diagnosis control unit 20 may be provided in the information processing terminal. Alternatively, the driving diagnosis may be performed by transmitting vehicle information and captured images to the server 14, and the diagnosis results may be transmitted to the diagnosis control unit 20 and displayed on the display unit 28.

[0064] In addition, the processing performed by the diagnosis control unit 20 in each of the above embodiments has been described as software processing performed by executing a program, but is not limited to this. For example, the processing may be performed by hardware such as a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), and an FPGA (Field-Programmable Gate Array). Alternatively, the processing may be a combination of both software and hardware. In the case of software processing, the program may be stored in various storage media and distributed.

[0065] Furthermore, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit and scope of the present invention. [Explanation of symbols]

[0066] 10 Driving diagnosis device (information processing device) 12 Vehicles 20 Diagnosis control unit 22 Vehicle information detection unit 24 Photography Department 28 Display unit (notification unit) 32 Multimedia Displays 36 Meter Display 40 Acquisition Department 42 Extraction part 44 Evaluation Section 46 Control Unit

Claims

1. An acquisition unit that acquires a vehicle speed, a steering angle, a yaw rate, and a captured image of a driver of the vehicle from the vehicle; an extraction unit that extracts a driving scene during a period in which the vehicle speed, the steering angle, and the yaw rate acquired by the acquisition unit satisfy a predetermined extraction condition; an evaluation unit that evaluates the driver's safety confirmation based on the captured images acquired by the acquisition unit around a predetermined time before and after a start time of the driving scene extracted by the extraction unit; a control unit that controls a notification unit to notify the evaluation of the safety confirmation by the evaluation unit while the vehicle is being driven; An information processing device comprising:

2. The information processing device according to claim 1, wherein the control unit controls the notification unit to notify the driver's driving evaluation, including the evaluation of the safety check, at a notification timing at a predetermined interval, and when the evaluation unit has evaluated the safety check, the notification unit to notify the evaluation of the safety check at the next notification timing.

3. The information processing device according to claim 1, wherein the evaluation unit detects the driver's behavior based on the captured image, including at least one of whether or not the driver has checked the rearview mirror of the vehicle, whether or not the driver has checked the right side mirror of the vehicle, whether or not the driver has checked the left side mirror of the vehicle, and whether or not the driver has turned his head, and evaluates the driver's safety confirmation from the detected behavior.

4. 2 . The information processing device according to claim 1 , wherein the acquisition unit further acquires a turn signal from the vehicle, and the extraction unit extracts the driving scene in which the vehicle speed, the steering angle, the yaw rate, and the turn signal acquired by the acquisition unit satisfy the extraction condition.

5. The information processing device according to claim 1, wherein the evaluation unit, when the driver's behavior detected from the captured image acquired by the acquisition unit includes predetermined error information, prohibits evaluation of the driver's safety confirmation around the predetermined time before and after the start of the driving scene that is the subject of the error information.

Citation Information

Patent Citations

  • Face direction detection device and face direction detection method

    JP2007018249A

  • Safety confirmation diagnostic system and safety confirmation diagnostic method

    JP2017151694A

  • Driving skill diagnosis system

    JP2014031050A