Recording controller and recording control program

Abstract

To provide a recording controller that can store vehicle information and a driver's state in correspondence to each other.SOLUTION: A recording controller 10 includes: a vehicle event detection unit 12 that detects a specific vehicle event having occurred on a vehicle; a vehicle event recording control unit 13 that, when a specific vehicle event is detected, causes vehicle information corresponding to the specific vehicle event as recorded to be stored; a driver detection unit 15 that detects a feature point of a driver from a picked-up image; a driver state estimation unit 16 that estimates a state of the driver based on the feature point of the driver; a driver event detection unit 17 that detects a specific driver event having occurred on the driver based on the state of the driver; a driver event recording control unit 18 that, when a specific driver event is detected, causes the feature point of the driver and the estimated state of the driver corresponding to the specific driver event as recorded to be stored in association with the stored vehicle information; and an output control unit 20 that outputs the vehicle information, the feature point of the driver, and the estimated state of the driver as stored.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a recording control device and a recording control program. [Background technology]

[0002] Conventionally, a recording device such as a drive recorder or an EDR (Event Data Recorder) may be installed in a vehicle. Such a vehicle recording device records vehicle information relating to the situation or state of the vehicle, and when an event such as a collision accident occurs in the vehicle, it saves the vehicle information recorded before and after the event. The vehicle information saved in the vehicle recording device is used to analyze the event that occurred. Such a conventional vehicle recording device is disclosed, for example, in Patent Document 1. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6862968 Summary of the Invention [Problem to be solved by the invention]

[0004] There is data that shows that over 90% of vehicle accidents are caused by the driver. For this reason, it is considered necessary for the vehicle recording device to record or store information about the driver's condition, which is the main cause of vehicle accidents, in association with vehicle information in order to analyze the vehicle accident.

[0005] The vehicle recording device disclosed in Patent Document 1 is installed in a vehicle with an automatic driving function and is used to determine whether a vehicle accident occurred due to a malfunction of the automatic driving function or due to driver negligence. In other words, the vehicle recording device disclosed in Patent Document 1 is based on the assumption that the vehicle has an automatic driving function, and is difficult to apply to vehicles that do not have an automatic driving function.

[0006] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a recording control device that can store vehicle information and driver status in association with each other. [Means for solving the problem]

[0007] The recording control device according to the present disclosure includes a vehicle event detection unit that detects a specific vehicle event that has occurred in the vehicle based on vehicle information relating to the state of the vehicle; a vehicle event recording control unit that, when the vehicle event detection unit detects a specific vehicle event, causes the vehicle information corresponding to the specific vehicle event that is recorded in the recording unit to be stored for a predetermined period of time that includes the time of detection by the vehicle event detection unit; a driver detection unit that detects feature points of the driver from an image of the interior of the vehicle; a driver state estimation unit that estimates the driver's state based on the feature points of the driver detected by the driver detection unit; a driver event detection unit that detects a specific driver event that has occurred in the driver based on the driver's state estimated by the driver state estimation unit; a driver event recording control unit that, when the driver event detection unit detects a specific driver event, causes the feature points of the driver that correspond to the specific driver event that is recorded in the recording unit and the estimated driver state to be stored in association with the vehicle information stored in the recording unit for a predetermined period of time that includes the time of detection by the driver event detection unit; and an output control unit that outputs the vehicle information, feature points of the driver, and estimated driver state stored in the recording unit. [Effects of the Invention]

[0008] According to the present disclosure, vehicle information and driver status can be stored in association with each other. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing the configuration of a recording control system to which a recording control device according to a first embodiment is applied. [Figure 2]4 is a flowchart showing the operation of the recording control device according to the first embodiment. [Figure 3] 10 shows a first specific example of the operation of the recording control device according to the first embodiment. [Figure 4] 10 shows a second specific example of the operation of the recording control device according to the first embodiment. [Figure 5] 5A and 5B show an example of the hardware configuration of a recording control device according to the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

[0011] Embodiment 1 A recording control device 10 according to the first embodiment will be described with reference to FIGS.

[0012] First, the configuration of a recording control device 10 according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of a recording control system to which the recording control device 10 according to the first embodiment is applied.

[0013] 1 is applied to a vehicle (not shown) and comprises a recording control device 10, a vehicle information detection unit 31, an imaging device 32, and a display unit 41.

[0014] The vehicle information detection unit 31 is provided in the vehicle. The vehicle information detection unit 31 detects vehicle information related to the state of the vehicle. The vehicle information detection unit 31 is, for example, a speed sensor that detects vehicle speed, an acceleration sensor that detects vehicle acceleration, a brake sensor that detects whether the brake is on or off, an accelerator opening sensor that detects the accelerator opening, a steering angle detection sensor that detects the steering angle of the steering wheel, or a seat belt sensor that detects whether the seat belt is fastened. In this case, the vehicle information is information related to the vehicle speed, vehicle acceleration, whether the brake is on or off, the accelerator opening, the steering angle of the steering wheel, and whether the seat belt is fastened. The vehicle information detection unit 31 transmits the detected vehicle information to the recording control device 10.

[0015] The imaging device 32 is provided in the vehicle cabin. The imaging device 32 is positioned so as to face the inside of the cabin. The imaging device 32 is, for example, an infrared camera or a visible light camera. The imaging device 32 may be shared with a so-called "Driver Monitoring System (DMS)" installed in the vehicle to monitor the status of occupants in the cabin. The imaging device 32 captures images of the interior of the vehicle cabin. The imaging device 32 is installed so as to be able to capture an image of at least the range within the vehicle cabin that includes the range where the driver's upper body should be present. The range within the vehicle cabin where the driver's upper body should be present is, for example, the spatial range near the backrest of the driver's seat or in front of the headrest. The imaging device 32 transmits the captured images to the recording control device 10.

[0016] The display unit 41 can display various types of information recorded or stored in the recording control device 10. The display unit 41 can display, for example, vehicle information, information about the driver's condition, information about a vehicle event such as a vehicle accident that has occurred to the vehicle, or information about a driver event that has occurred to the driver.

[0017] The recording control device 10 has a vehicle information recording unit 11, a vehicle event detection unit 12, a vehicle event recording control unit 13, an image acquisition unit 14, a driver detection unit 15, a driver state estimation unit 16, a driver event detection unit 17, a driver event recording control unit 18, a recording unit 19, and an output control unit 20.

[0018] The vehicle information recording unit 11 records the vehicle information transmitted from the vehicle information detection unit 31 in chronological order. The vehicle information transmitted from the vehicle information detection unit 31 is either transmitted to a recording unit 19 (described later) via the vehicle information recording unit 11, or transmitted to the recording unit 19 without passing through the vehicle information recording unit 11. FIG. 1 shows an example in which the vehicle information is transmitted to the recording unit 19 via the vehicle information recording unit 11.

[0019] The vehicle event detection unit 12 detects a specific vehicle event that has occurred in the vehicle based on the vehicle information recorded in the vehicle information recording unit 11. Here, a specific vehicle event that has occurred in the vehicle is, for example, a collision accident that has occurred in the vehicle. Furthermore, a collision accident that has occurred in the vehicle includes, for example, a major accident that requires the deployment of an airbag, and a minor accident that does not require the deployment of an airbag.

[0020] When the vehicle event detection unit 12 detects a specific vehicle event, the vehicle event recording control unit 13 stores the vehicle information corresponding to the specific vehicle event recorded in the recording unit 19 for a predetermined period including the time of detection by the vehicle event detection unit 12.

[0021] Here, having the vehicle event recording control unit 13 store the vehicle information means, for example, storing the vehicle information recorded in the recording unit 19 as is in the recording unit 19 for a long period of time, or evacuating the vehicle information from the recording unit 19 to a storage unit that serves as a separate storage memory and storing it therein. Therefore, the vehicle event recording control unit 13 can hold the vehicle information until the analysis of the vehicle accident is completed. FIG. 1 shows an example in which the vehicle information recorded in the recording unit 19 is stored as is in the recording unit 19 for a long period of time. Furthermore, the predetermined period including the time of detection by the vehicle event detection unit 12 refers to a predetermined period before and after the time of detection, or a predetermined period going back from the time of detection to a predetermined time.

[0022] The captured image acquisition unit 14 acquires a captured image from the imaging device 32. The captured image acquisition unit 14 transmits the acquired captured image to the driver detection unit 15.

[0023] The driver detection unit 15 acquires the captured image from the captured image acquisition unit 14. The driver detection unit 15 detects feature points of the driver based on the captured image acquired from the captured image acquisition unit 14. The driver detection unit 15 transmits the detected feature points of the driver to the driver state estimation unit 16. The driver detection unit 15 also causes the recording unit 19 to record the detected feature points of the driver in chronological order. Here, the feature points of the driver include, for example, the driver's head position, the driver's facial direction, whether the driver's eyes are open or closed, the driver's line of sight, and facial expression.

[0024] The driver state estimation unit 16 acquires the feature points of the driver from the driver detection unit 15. The driver state estimation unit 16 estimates the state of the driver based on the feature points of the driver acquired from the driver detection unit 15. The driver state estimation unit 16 transmits the estimated state of the driver to the driver event detection unit 17. The driver state estimation unit 16 also causes the recording unit 19 to record the estimated state of the driver in chronological order. Here, the state of the driver may be, for example, a state of looking away, a state of drowsiness, poor posture, etc.

[0025] The driver event detection unit 17 acquires the estimated state of the driver from the driver state estimation unit 16. The driver event detection unit 17 detects a specific driver event that has occurred in the driver based on the state of the driver estimated by the driver state estimation unit 16. Here, the specific driver event that has occurred in the driver is, for example, a sudden change in behavior or movement that has occurred in the driver due to sensing a dangerous state. The driver event detection unit 17 detects that a specific driver event has occurred based on the estimated state of the driver when there is a sudden inattentiveness, sudden drowsiness, or sudden loss of posture, and the amount of change or movement of the driver exceeds a threshold.

[0026] When the driver event detection unit 17 detects a specific driver event, the driver event recording control unit 18 stores the driver feature points and the estimated driver state corresponding to the specific driver event, which are recorded in the recording unit 19, for a predetermined period including the time of detection by the driver event detection unit 17. At this time, the driver event recording control unit 18 stores the driver feature points and the estimated driver state corresponding to the specific driver event in association with the vehicle information corresponding to the specific vehicle event stored in the recording unit 19 in the recording unit 19. Note that the vehicle event recording control unit 13 may store the driver feature points and the estimated driver state corresponding to the specific driver event in association with the vehicle information corresponding to the specific vehicle event stored in the recording unit 19 in the recording unit 19.

[0027] Here, having the driver event recording control unit 18 store the driver's feature points and the estimated driver's state means, for example, storing the driver's feature points and the estimated driver's state recorded in the recording unit 19 as they are for a long period of time in the recording unit 19, or evacuating and storing them from the recording unit 19 to a storage unit that serves as a separate storage memory. Therefore, the driver event recording control unit 18 can hold the driver's feature points and the estimated driver's state until the analysis of the vehicle accident is completed. Figure 1 shows an example in which the driver's feature points and the estimated driver's state recorded in the recording unit 19 are stored as they are for a long period of time in the recording unit 19. Furthermore, the predetermined period including the time of detection by the driver event detection unit 17 refers to a predetermined period before and after the time of detection, or a predetermined period going back from the time of detection to a predetermined time.

[0028] The recording unit 19 records the input vehicle information, captured images, driver characteristics, and estimated driver states in chronological order. The vehicle information, driver characteristics, and driver states recorded in the recording unit 19 are stored in association with one another. The recording unit 19 is, for example, a non-volatile memory.

[0029] The output control unit 20 outputs various pieces of information recorded in the recording unit 19 to the outside of the recording control device 10. For example, when the vehicle event recording control unit 13 causes the recording unit 19 to store vehicle information, or when the driver event recording control unit 18 causes the recording unit 19 to store driver characteristics and an estimated driver state, the output control unit 20 can output the pieces of information while maintaining their correspondence with each other. The output destination of the output control unit 20 is, for example, a display unit 41 or an analysis device (not shown) for analyzing vehicle accidents. FIG. 1 shows an example in which the output control unit 20 is connected to the display unit 41. The display unit 41 is capable of displaying various pieces of information recorded or stored in the recording unit 19 under the control of the output control unit 20.

[0030] Next, the operation of the recording control device 10 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the operation of the recording control device 10 according to the first embodiment.

[0031] In step ST11, the vehicle event detection unit 12 detects a specific vehicle event that has occurred in the vehicle based on vehicle information relating to the state of the vehicle.

[0032] In step ST12, when the vehicle event detection unit 12 detects a specific vehicle event, the vehicle event recording control unit 13 stores the vehicle information corresponding to the specific vehicle event recorded in the recording unit 19 for a predetermined period including the time of detection by the vehicle event detection unit 12.

[0033] In step ST13, the driver detection unit 15 detects characteristic points of the driver from the captured image of the interior of the vehicle.

[0034] In step ST14, the driver state estimation unit 16 estimates the state of the driver based on the feature points of the driver detected by the driver detection unit 15.

[0035] In step ST15, the driver event detection unit 17 detects a specific driver event that has occurred to the driver based on the state of the driver estimated by the driver state estimation unit 16.

[0036] In step ST16, when the driver event detection unit 17 detects a specific driver event, the driver event recording control unit 18 stores the driver characteristics and estimated driver state corresponding to the specific driver event recorded in the recording unit 19 in association with the vehicle information stored in the recording unit 19 for a predetermined period including the time of detection by the driver event detection unit 17.

[0037] In step ST17, the output control unit 20 outputs the vehicle information, the driver's characteristics, and the estimated driver's state stored in the recording unit 19. Then, the operation of the recording control device 10 ends.

[0038] Next, the specific operation of the recording control device 10 will be described with reference to FIGS.

[0039] First, the data elements recorded in chronological order in the vehicle information recording unit 11 and the recording unit 19 are, for example, those specified in the United Nations Convention Regulation No. 160.

[0040] For example, if the data element recorded in the vehicle information recording unit 11 is a change in vehicle speed, the recording period during which the data elements are recorded in chronological order in the vehicle information recording unit 11 is the shorter of 0 to 250 ms or 0 to the time of vehicle event detection + 30 ms, starting from time zero, which is the starting point of detection by the vehicle event detection unit 12. During this recording period, the number of samples per second (recording interval) is 100.

[0041] Furthermore, when the data element recorded in the vehicle information recording unit 11 is the speed displayed by a speedometer installed in the vehicle, the recording period during which the data elements are recorded in chronological order in the vehicle information recording unit 11 is from -5 s to 0 s, starting from time zero, which is the starting point of detection by the vehicle event detection unit 12. During this recording period, the number of samples per second (recording interval) is 2.

[0042] Furthermore, when the data elements recorded in the recording unit 19 are data elements related to the driver's feature points or the estimated driver's state, these data elements are obtained in frame units of the captured image. Therefore, the number of samples per second (recording interval) is 30 or 60, according to the frame cycle (imaging cycle) of the captured image. In this case, the recording period during which the data elements are recorded in chronological order in the recording unit 19 may be set to -5 s to 0 s, corresponding to the recording period during which the data elements are recorded in chronological order in the vehicle information recording unit 11. Furthermore, the recording period in the recording unit 19 may be set to -5 s to 5 s, which is longer than the recording period in the vehicle information recording unit 11.

[0043] Figure 3 shows a first specific example of the operation of the recording control device 10 according to the first embodiment. This figure assumes a case in which the vehicle information recording unit 11 and the recording unit 19 record or save data elements in chronological order when a collision occurs in which the driver of a vehicle traveling straight looks away and is unable to brake in time, causing the vehicle to rear-end the vehicle ahead. Also, in Figure 3, the vehicle information is the vehicle speed, which is the kilometer per hour, the driver's features are the direction of the driver's gaze and facial expression, and the estimated driver's state is a looking-away state and a panicked state.

[0044] As shown in FIG. 3, the vehicle event detection unit 12 detects a collision, which is a specific vehicle event, and the driver event detection unit 17 detects a large gaze shift and a panic state, which are specific driver events. The detection times of these events are close to each other, and the arrows indicate the vehicle event detection. The vehicle event recording control unit 13 stores the vehicle speed going back in time, with the event detection time set to time zero. The driver event recording control unit 18 also stores the driver's gaze direction, the driver's facial expression, whether or not the driver is looking away, and whether or not the driver is in a panic state going back in time, with the event detection time set to time zero. In this case, the frame period is 33.3 ms, but the time (ms) shown in FIG. 3 indicates only a representative time.

[0045] The driver state estimation unit 16 estimates that the vehicle was traveling at 50 km / h when the driver was looking aside at -3000 ms and continued this state until 1667 ms. The vehicle then began to decelerate immediately after that. The driver state estimation unit 16 also estimates that the driver's gaze was directed forward and that the driver's facial expression showed signs of panic. From these points, it is believed that the driver sensed danger as the distance between the vehicle and the vehicle ahead became shorter and applied the brakes suddenly. After the vehicle collision, it is determined that the vehicle collided at time zero.

[0046] Figure 4 shows a second specific example of the operation of the recording control device 10 according to the first embodiment. Figure 4 illustrates a case in which the vehicle information recording unit 11 and the recording unit 19 record or save data elements in chronological order when a driver of a vehicle traveling straight ahead is looking away in the evening when it is difficult to distinguish the scenery ahead of the vehicle, and a pedestrian tries to cross the road from the side of the road in front of the vehicle, causing a collision accident in which the driver is unable to brake in time and hits the pedestrian. In Figure 4, the vehicle information is the vehicle speed, which is the kilometer per hour, the driver's feature points are the direction of the driver's gaze and facial expression, and the estimated driver's state is a state of looking away and a state of panic.

[0047] As shown in Figure 4, the driver event detection unit 17 detects specific driver events, such as a large shift in the driver's line of sight and a panicked state. The time at which this event was detected is indicated by an arrow. The vehicle event recording control unit 13 sets the event detection time as time zero and stores the vehicle speed before and after time zero. The driver event recording control unit 18 sets the event detection time as time zero and stores the driver's line of sight, the driver's facial expression, whether the driver is looking away, and whether the driver is in a panicked state before and after time zero. At this time, the frame period is 33.3 ms, but the time (ms) shown in Figure 4 indicates only a representative time.

[0048] The driver state estimation unit 16 estimates that the driver was looking aside at -1367 ms while the vehicle was traveling at a speed of 50 km / h, and that this state continued until -33 ms. The vehicle then began to decelerate immediately after that. The driver state estimation unit 16 also estimates that the driver's gaze was directed forward and that the driver's facial expression was in a panicked state. From these points, it is considered that the driver noticed a pedestrian crossing in front of the vehicle, sensed danger, and suddenly braked. Furthermore, at 1633 ms, the vehicle stopped with the driver's facial expression still in a panicked state. In a collision accident between a vehicle and a pedestrian, the impact on the vehicle is small, and the vehicle event detection unit 12 cannot detect such a small impact.

[0049] Therefore, in the case of such a collision accident, only the driver event detection unit 17 performs event detection. Note that if the driver's posture is disrupted, such as looking down, leaning back, or arching backward, for a predetermined period of time (for example, 2 seconds or more), it is considered that the driver is unable to drive. Therefore, the driver event detection unit 17 may output the detection of a specific driver event to the driver event recording control unit 18.

[0050] Next, an example of the hardware configuration of the recording control device 10 according to the first embodiment will be described with reference to Fig. 5. Figs. 5A and 5B show an example of the hardware configuration of the recording control device 10 according to the first embodiment.

[0051] 5A, the recording control device 10 is configured by a computer, and the computer has a processor 51 and a memory 52. ​​The memory 52 stores programs that cause the computer to function as the vehicle event detection unit 12, the vehicle event recording control unit 13, the driver detection unit 15, the driver state estimation unit 16, the driver event detection unit 17, the driver event recording control unit 18, and the output control unit 20. The processor 51 reads and executes the programs stored in the memory 52, thereby realizing the functions of the vehicle event detection unit 12, the vehicle event recording control unit 13, the driver detection unit 15, the driver state estimation unit 16, the driver event detection unit 17, the driver event recording control unit 18, and the output control unit 20.

[0052] 5B, the recording control device 10 may include a processing circuit 53. In this case, the processing circuit 53 may be realized by a vehicle event detection unit 12, a vehicle event recording control unit 13, a driver detection unit 15, a driver state estimator 16, a driver event detection unit 17, a driver event recording control unit 18, and an output control unit 20.

[0053] Alternatively, the recording control device 10 may have a processor 51, a memory 52, and a processing circuit 53 (not shown). In this case, some of the functions of the vehicle event detection unit 12, the vehicle event recording control unit 13, the driver detection unit 15, the driver state estimator 16, the driver event detection unit 17, the driver event recording control unit 18, and the output control unit 20 may be realized by the processor 51 and the memory 52, and the remaining functions may be realized by the processing circuit 53.

[0054] The processor 51 is, for example, one that uses at least one of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, a microcontroller, and a digital signal processor (DSP).

[0055] The memory 52 uses, for example, at least one of a semiconductor memory or a magnetic disk. More specifically, the memory 52 uses at least one of a random access memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a solid state drive (SSD), or a hard disk drive (HDD).

[0056] The processing circuit 53 uses, for example, at least one of an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), an SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration).

[0057] As described above, the recording control device 10 according to the first embodiment comprises a vehicle event detection unit 12 that detects a specific vehicle event that has occurred in the vehicle based on vehicle information relating to the state of the vehicle, a vehicle event recording control unit 13 that, when the vehicle event detection unit 12 detects a specific vehicle event, causes the vehicle information corresponding to the specific vehicle event recorded in the recording unit 19 to be saved for a predetermined period including the time of detection by the vehicle event detection unit 12, a driver detection unit 15 that detects feature points of the driver from an image captured of the interior of the vehicle, a driver state estimation unit 16 that estimates the state of the driver based on the feature points of the driver detected by the driver detection unit 15, and a driver state detection unit 17 that detects the driver's state based on the feature points of the driver detected by the driver detection unit 15. The recording control device 10 includes a driver event detection unit 17 that detects a specific driver event that occurred to the driver based on the driver's state estimated by the state estimation unit 16, a driver event recording control unit 18 that, when the driver event detection unit 17 detects a specific driver event, causes the recording unit 19 to store the driver's feature points and estimated driver state corresponding to the specific driver event recorded therein in association with the vehicle information stored in the recording unit 19 for a predetermined period including the time of detection by the driver event detection unit 17, and an output control unit 20 that outputs the vehicle information, driver feature points, and estimated driver state stored in the recording unit 19. Thus, the recording control device 10 can store the vehicle information and the driver's state in association with each other. As a result, the recording control device 10 can provide records that can improve the analysis of vehicle accidents.

[0058] In the recording control device 10, if the vehicle event detection unit 12 cannot detect a specific vehicle event, only the driver event detection unit 17 detects the specific driver event. Therefore, even if the impact on the vehicle is small, such as in a collision between a vehicle and a person, the recording control device 10 can detect the time of the collision from the driver's characteristics and driver state.

[0059] In the recording control device 10, the specific vehicle event detected by the vehicle event detector 12 is a vehicle collision, so the recording control device 10 can detect the time when a vehicle collision accident occurs.

[0060] In the recording control device 10, the driver event detection unit 17 detects that a specific driver event has occurred when the amount of change in driver behavior or movement exceeds a threshold value. This allows the recording control device 10 to detect the occurrence of a specific driver event with high accuracy.

[0061] It should be noted that, within the scope of the present disclosure, any of the components of the embodiments may be modified or omitted. [Explanation of symbols]

[0062] 10 Recording control device, 11 Vehicle information recording unit, 12 Vehicle event detection unit, 13 Vehicle event recording control unit, 14 Image acquisition unit, 15 Driver detection unit, 16 Driver state estimation unit, 17 Driver event detection unit, 18 Driver event recording control unit, 19 Recording unit, 20 Output control unit, 31 Vehicle information detection unit, 32 Imaging device, 41 Display unit, 51 Processor, 52 Memory, 53 Processing circuit.

Claims

1. a vehicle event detection unit that detects a specific vehicle event that has occurred in the vehicle based on vehicle information relating to a state of the vehicle; a vehicle event recording control unit that, when the vehicle event detection unit detects a specific vehicle event, stores vehicle information corresponding to the specific vehicle event recorded in a recording unit for a predetermined period of time including the time of detection by the vehicle event detection unit; a driver detection unit that detects characteristic points of the driver from a captured image of the interior of the vehicle; a driver state estimation unit that estimates a state of the driver based on the feature points of the driver detected by the driver detection unit; a driver event detection unit that detects a specific driver event that has occurred in the driver based on the driver state estimated by the driver state estimation unit; a driver event recording control unit that, when the driver event detection unit detects a specific driver event, stores the driver feature points and the estimated driver state corresponding to the specific driver event recorded in the recording unit in association with the vehicle information stored in the recording unit for a predetermined period including the time of detection by the driver event detection unit; an output control unit that outputs the vehicle information, the driver's characteristics, and the estimated driver's state stored in the recording unit; A recording control device characterized by:

2. If the vehicle event detector cannot detect a specific vehicle event, only the driver event detector detects the specific driver event.

2. The recording control device according to claim 1.

3. The specific vehicle event detected by the vehicle event detection unit is a collision of the vehicle.

2. The recording control device according to claim 1.

4. The driver event detection unit When the amount of change in driver behavior or movement exceeds a threshold, it is detected that a specific driver event has occurred.

4. The recording control device according to claim 1, wherein the recording control device is a recording control device for controlling a recording medium.

5. Computer, a vehicle event detection unit that detects a specific vehicle event that has occurred in the vehicle based on vehicle information relating to a state of the vehicle; a vehicle event recording control unit that, when the vehicle event detection unit detects a specific vehicle event, stores vehicle information corresponding to the specific vehicle event recorded in a recording unit for a predetermined period of time including the time of detection by the vehicle event detection unit; a driver detection unit that detects characteristic points of the driver from a captured image of the interior of the vehicle; a driver state estimation unit that estimates a state of the driver based on the feature points of the driver detected by the driver detection unit; a driver event detection unit that detects a specific driver event that has occurred in the driver based on the driver state estimated by the driver state estimation unit; a driver event recording control unit that, when the driver event detection unit detects a specific driver event, stores the driver feature points and the estimated driver state corresponding to the specific driver event recorded in the recording unit in association with the vehicle information stored in the recording unit for a predetermined period including the time of detection by the driver event detection unit; an output control unit that outputs the vehicle information, the driver's characteristics, and the estimated driver's state stored in the recording unit; A recording control program that functions as a

Images